Well the Doom demo is again passing a textual structure....I am not really convinced on how it's different than any other llm that execute small context within 100ms. On a MBP M3Max with LFM 2.5B, I get about 500ms -600ms on "source_text": "Invoice #4471 issued March 3, 2026 to Beaver Dam Logistics for $12,840.00, net 30." with a 4 property structure output https://docs.typesafe.ai/primitives/advanced

I can't test it on a better model / my main workstation, but sub 1sec for short prompts is not impressive? I am sure that we can get something like 100ms-300ms with a Qwen 3.8 27b model for a similar query on a 5090 class GPU.

edit: 203ms wall clock on a somewhat busy workstation with https://huggingface.co/LilaRest/gemma-4-31B-it-NVFP4-turbo