I bought some PVA the other day - it says non toxic on the front so am hoping it is ok! You can get it in most craft places, places like WHS Smith etc. Some supermarkets do it too - it is usually with the children's craft
And it dries clear too so you won't see it after!