From what I've seen, interference with the speakers comes when they aren't typically plugged in all the way, so that's where I'd start. Also, if they're touching other metal, they can pick up sounds and amplify them to the point you can hear it.
In some cases, something like Mic In or Line-In might be picking up something, so if the above doesn't work, try muting these two in the audio control panel.