logoalt Hacker News

sgt101yesterday at 2:10 PM2 repliesview on HN

Why would I believe that any of this works? This is just some blokes idea of what people should do.

There is no evidence offered. No attempt to measure the benefits.


Replies

calebkaiseryesterday at 4:11 PM

Most of the inference techniques (what the author calls context engineering design patterns) listed here originally came from the research community, and there are tons of benchmarks measuring their effectiveness, as well as a great deal of research behind what is happening mechanistically with each.

As the author points out, many of the patterns are fundamentally about in-context learning, and this in particular has been subject to a ton of research from the mechanistic interpretability crew. If you're curious, I think this line of research is fascinating: https://transformer-circuits.pub/2022/in-context-learning-an...

dwaltripyesterday at 7:19 PM

Imagine the gall of someone who just goes on the internet and writes something.