I used to get this all the time with my wireless mouse. The 'dead' times corresponded with a faint buzzing in the speakers so I was led to assume that some radio interference (a dodgy microwave perhaps) was preventing my mouse from communicating. I could not track down the RF noise to I switched to a nice wired optical mouse. :)