Aww I'm not sure but one way is to moisten it enough to get it to come loose without pulling his fur but your little hammy might get slightly damp and it may take a bit off fiddling. It might stress him out but it sounds like its stressing him out having it on there too
Damp towel corner pressed on it while a dry treat is offered the other end to try and keep him busy.