There is a fundamental problem with this thinking, you are making an assumption about scale. There is the apocryphal quote "I think there is a world market for maybe five computers".

You have to believe that LLM scaling (down) is impossible or will never happen. I assure you that this is not the case.