you may need to Underclock the GPU, which is a bummer, but ultimately may not be noticeable.
I had what sounds like the exact same issue on my EVGA 980 GTX FTW, and it started when the card was still pretty new.
took me a million years to find the solution. about seven, actually, cause I'm an...