Llamafile is great if you don't want to run any meaningful models because it's limited to 4GB.
That's a Windows limitation, though.
alt Hacker News
That's a Windows limitation, though.