When you put something in quotation marks, its supposed to mean it was a direct quote....Harry didn't say that he never loved Taylor. You can love someone without being in love.
I feel bad for them tbh, they never really had a chance to fall in love. The media/press/angry fans/etc were giving them a ridiculously hard time from the start.