Not being rude but do you keep yourself in shape?
I get the impression you do so its probably not that.
Seriously...I feel just as strongly in regards to either sex when I say that I don't feel sorry for spouses that get cheated on after blatantly neglecting their S.O.
Even if my dick was chopped off I still would make sure my wife was taken care of sexually.