Hello and welcome to HC!
Everything is still new and if that is where he feels ok then I wouldn't worry. My hammy has only started to explore his cage and make a nest this week (I got him last Thursday).
You could scatter some food around his cage to encourage him to explore but I wouldn't worry too much, he'll soon settle in
