What kind of internet connection do you have? Is it cable, dsl etc?
If you have a dsl connection, contact your isp and have ask them about bridging your modem, and router. If you have a somewhat knowledgeable tech on the phone, they will know exactly what to do. I've had a few customers with this problem, and bridging their connection has seemed to be a fix.