Aren't there other ONNX runtimes out there? A quick google search shows a few written in Rust: Tract, RTen, WONNX, Burn&Candle. Also, IIRC there's a Julia-based one as well.
https://github.com/tracel-ai/burn-onnx
I maintain this project at the moment.
It convert ONNX models into native, backend-agnostic Burn code for inference and fine-tuning.
https://github.com/tracel-ai/burn-onnx
I maintain this project at the moment.
It convert ONNX models into native, backend-agnostic Burn code for inference and fine-tuning.