well its only been 3 days so far, so once you start picking him up more he will get better. He may also be very tired after moving home and all these new experiences so hence why hes sleeping quite a bit. Plus his nest feels like a safe place so he likes it in there.
Its good that he let you stroke him so keep up with that, but another thing you could try is just putting your hand in the cage and letting him climb on if he choses. Then after a few times when hes climbed on lift your hand up a bit then put it back down (this way you can gain his trust) If he dosen't come on your hand try putting a treat on your hand or even better something like a bit of peanut butter so he has to lick it off.
When he comes on your hand keep completely still and lay your hand flat.
Good luck and i hope some of this helps