I don't have problems with vegetarian/vegan people, but for a date, it will be partially turn-off to me because I'm kind of opposed to modern ideas of vegetarian/vegan diets. It would be like dating a guy with an opposite political view.
So it is unlikely (not impossible at all) that I would date a vegetarian guy
...unless he is interested to turn omnivore.