Are you plugged directly into the router/modem? Could be a bad cable, if you are not plugged direct into the router/modem and into a network jack in a room there could be a whole host of problems and interferences that could cause those problems.
If you want to eliminate the router/modem/switch...