logoalt Hacker News

glibg10b • today at 1:42 PM • 2 replies • view on HN

The CoT shows Astra skipping spaces and words. I have never seen this before. Is it a consequence of the looped architecture?


Replies

Starlevel004 • today at 2:23 PM

Both Astra and Sol 6.1 do it, and Sol is even worse as it leaks through everywhere. Whenever it issues a subagent prompt it's just a total vomit of tokens mixed up together.

welferkj • today at 1:56 PM

No, newer models talk to themselves in this degenerated form of English all the time. It's a known problem that deep frying transformers with RL reduces CoT legibility, and the only known way around it is the Most Forbidden Technique - grading chains of thought.

➕ show 2 replies