The stick itself is simply tightly wrapped paper and thus in theory is safe, but unless you can get plain packaged sticks I would recommend popsicle sticks instead as used lollipop stocks can have sugary residue that isn't good for them. All in all, popsicle sticks would be much better than lollipop sticks. The glue you want to use is perfectly safe