I really don't give a damn, to be honest. If a man wants to dress that way, then so be it. In fact, however anyone wants to dress (as long as it's public-appropriate; i.e. no nudity), then I see no problem. It's not YOU that's wearing those clothes, so why does it matter to anyone else?
These are the kind of things I wear outside of school and work, anyways: