Sure do whatever you want, although you have to accept that our society at this point in time does still conform to pretty strict gender roles. Many will make snap judgements based on appearance and assholes will see it as an invitation to openly harass. In the end, if it makes you happy and you have a strong 'idgaf' resolve, go for it.