Thank you all for your kind advice
I'm going to continue at Harry's pace without pushing things! I'm already so glad he's comfy when I'm close to him/my hand in the cage, it's a nice feeling especially as I'm quite a big creature compared to him, it's no wonder some hammys might never feel quite comfortable with that!