Yes, I mean power supply.
Hardware diags are more a process of elimination than anything else, and can be especially difficulty with intermittent problems. Many times I go by "smell and feel" until I get to the bottom of it. Eliminating the video card would be one option. My experience and your symptoms make me "smell" a funky PSU, but the only way to find out for sure is to swap it out and see what happens.