At any point, any of your partners may have been thinking of someone (or even something) else to help themselves get over the edge. The idea of making someone orgasm with, to put it your way, just you is an illusion. People bring a lifetime of experience to the sex they have, including ways to help facilitate orgasm. Sex alone may not be enough to get your wife to come.