Jev has 64k total token request budget and I do wonder how it will handle highly specialised inputs.
This Jev waitlist that Typesafe AI are utilising is surely going to raise questions pretty soon - it's hard to sell this to bosses when it looks like a pop-up restaurant
I am more curious about a 60k prompt... I haven't seen much discussion about large prompts, is it still < 500ms?
I just got my invite so the waitlist doesn't seem to be particularly long
It's already on Openrouter