logoalt Hacker News

gchadwick • today at 8:47 PM • 0 replies • view on HN

Very interesting to see them publish a looped transformer. It's been reported that OpenAI are now using looped transformers, though of course not confirmed.

I think this may be the first public example of a looped transformer model good enough for real world use cases?