You guys don't wear wedding rings?
Anyway, "I'm married" with men in your situation comes out less as "This can't continue, I'm married" and more usually as "I don't know what to do, I feel this incredible connection with you but I'm married. I love my wife but I have feelings for you too"...