OK well... maybe I should have clarified, when I approach him and the hand appears I tap the hand to talk to him but I typically have to try several times and move around slightly to talk to him. I don't have troubles delivering the hearts. Its only when I approach him to start the quest.

Thanks for your replies.