This really depends
who, and in what
context.
I don't find at offensive when people ask me, I just find it somewhat rude. I've often found the people that ask when the first meet you, must have some kind of issue with it. Otherwise, why would they need to know.
It's just downright rude though to meet somebody and ask about their sexuality upfront. Particularly if they're a work colleague or something.