alt Hacker NewsHow much work would it be to use the C++ ONNX run-time with this instead of Python? Is it a Claudeable amount of work?
The iOS version is Swift-based.
How much work would it be to use the C++ ONNX run-time with this instead of Python? Is it a Claudeable amount of work?
The iOS version is Swift-based.
shouldn't be hard. what backend/hardware are you interested in running this with? i'll add an example for using C++ onnx model. btw check out roadmap, our inference engine will be out 1-2 weeks and it is expected to be faster than onnx.