Masculinity is a changing concept, and has not always been what it is now. Since most people judge everyone on looks, if you're into health and fitness, they're think you're masc.
Truthfully though, who cares. While the gays might worship mascs and treat anyone fem, that's really their internalised misogyny and anyone that denies this has deeper-seated issues than they'd dare to admit.
)