Yeah... that's why he started caressing her head and even after she had snatched his hand away the first time, he still went back in to caress her head, before thinking better of it!!
Because he wanted to get her off of him? That's why he threw his cap (?) when she wasn't stopping.
Look at how he reacted after she got away
