Hello Sadies. I am new to hamsters and have my first hamster which is a robo. My robo is also 5 months old and I have never once attempted to touch him or take him out of his cage. I feel it is far too soon when he is not okay with my hands yet. Maybe you could take things at his pace? He has a big cage so perhaps he has no need to come out for play time.
If he is okay with you sitting close to him and talking to him then I think that is great. It means he is learning to trust you. I personally would carry on with that.
In the future he may get used to your hand but perhaps not attempting that until he is more settled may work.
This is just my opinion and I am sure other members will have different ideas.