Elmer's school glue is supposed to be the safe one
A lot of people have made things from wood lolly sticks/popsicle sticks - they are fine to chew - but I think it's important to make sure they're made quite sound and strong so they can't collapse and injure a hammy.