This is why I keep lithium batteries in a steel box when they aren't being used. I think you can but purpose built ones, but I use steel ammo boxes from military surplus stores. Its a bit of a pain, and won't stop the toxic clouds of smoke from filling my house, but it could very well prevent my house from being burnt down.

Some day I might make a dedicated battery box corner with a vent to outdoors though because batteries only seem to be getting bigger and more powerful.

Then you are obviously overestimating how dangerous they are, are you not?