Robodwarfs I think you're a really good owner, your own nervousness around him just shows how much you care
And it's natural to be nervous around a new pet, especially if you haven't always had good experiences and it sounds like having your new little Syrian boy in your life might be a really good learning curve for both of you. Like Emilywhite said he can probably sense your nervousness and that will make him more skittish too.
If you're scared of losing him them make sure the room you're planning on handling him in is 100% hamster proof. If that means shoving blankets under doors and tidying things off the floor and building barriers with cardboard boxes then so be it! I've even shoved cardboard tubes and books up behind my radiators due to my own irrational fears before
If you're scared of him not coming back to you then keep a spare cardboard box with you and some treats just in case, it's always easier to tempt a small scared fluff into a safe looking enclosed box space than into your hands.
Sometimes things take time. Cut yourself some slack and just keep slowly interacting with him. The two of you will get used to each other, I'm sure of it!