https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java

That’s probably the next thing after Software Factories.

I'll be disappointed if this isn't named AbstractAiInfrastructureFactory