alt Hacker NewsThis... Hopefully inference can become so cheap games can have simple LLM's integrated into them. Imagine an RPG with LLM's and with rich worldbuilding; like Fallout NV with LLM's. Honestly, scary!
This... Hopefully inference can become so cheap games can have simple LLM's integrated into them. Imagine an RPG with LLM's and with rich worldbuilding; like Fallout NV with LLM's. Honestly, scary!
Inference is already cheap enough. It's basically free for the quantities people actually want to read.
LLMs only become expensive if you let them generate 1000 lines of code every 2 minutes.