Yes, we ablated Engrams rigorously and found that it returned world knowledge like FFN without without compute expenditure.
What about mHC? I'm surprised it helped with such a small compute budget.
alt Hacker News
What about mHC? I'm surprised it helped with such a small compute budget.