I always aim for 60cm / 2ft high as this seems to be pretty secure and yet it's low enough to step over!
I use Correx for my play pens - I'd be wary about thinner plastic getting gnawed through but if you're supervising it should be ok I would think.