I think he's telling you he doesn't like your hand in his cage
It might be better to do any spot cleaning or adjustments until he's out of the cage in a playpen nearby or something.
Leather gloves or gardening gloves will be better. The problem with him dangling hanging onto a glove is it will create a kind of tension between you two. They tend to only bite when they're scared or possibly protecting their territory. It can also be that he had a bad experience with hands before you got him.
It sounds like taming isn't there yet. So a) don't do anything to his cage while he's in it (some hamsters also don't like a hand from above). b) I would start from scratch slowly with handtaming in the bathtub or a playpen. Putting some treats on the palm of your hand. Don't try to pick him up for a while.If he puts a paw on your hand when eating the treats then he is gaining confident and beginning to accept you - but all out of the cage,not in it.