Hi, thank you for the reply!
I thought they were weevils too but by the pictures on google, they don't look anything like weevils, but look exactly like book lice
Also, they're on my bookshelf, on the books, around my couch (which is next to the cage)etc. They are mostly in the cage though, in the places I described before so maybe they're on the furniture just because it's next to the cage? I'm not sure.
This is what they look like, and I included my finger for size comparison
Album — Postimages