Of course
Bendable bridges,clay/terracotta flower pots,and large mugs are some that come to mind right away and are generally cost effective except when you get bendable bridges from Petsmart as those can get expensive for large ones.
The best thing to do is just be creative and improvise.It doesn't have to be expensive or from a pet shop to function,but it can be nice to have a few slightly expensive pieces if you want to have them!