Depends on how its implemented, but Amazon already did add gpt-oss-20b so if the model is similar enough to the OSS variant of GPT, it might not have been as complicated as you might think.
I imagine there's lots of custom kernels and optimization...
Openai hasn't been publishing innovations for quite a while.
I imagine there's lots of custom kernels and optimization...
Openai hasn't been publishing innovations for quite a while.