If it was with someone I had been with for a long time.. I think I would make it work. As important as sex is to me, that romantic intimacy can't really be replicated so easily.
If intimacy gets difficult then definitely no since I'm not attracted to female parts at all. Maybe it could be post-op but I don't think their male genitalia would work quite the same.
If that wasn't the case then I wouldn't see a problem at all.