Instead of paint, I know there is a product called Vitacritter. It's a line of critter-safe dyes developed for birds but I know it's been used on chinchilla toys and they're heavy chewers!
Scroll down this page to find it and another product for colouring wood:
Parrot Toy Angels: Toy Making Supplies