Most paper would be unsafe in the cage,unless you made it yourself using only natural dyes(which would be difficult to get precise details).
Vegetable based dyes would generally be made by simmering in one cup vinegar and four cups water,then boiling for an hour.There might be slightly different methods than that,although I personally haven't looked deeply into any