alt Hacker NewsExperiment 3 doesn't involve reading the weights in as part of the prompt. It's a coding exercise. Here are the turns: https://github.com/RikiyaT/lm_understand-logs/tree/main/exp3...
At each point the model has to write code to read the weights in with Python and some other Python code to perform analysis, like this: https://github.com/RikiyaT/lm_understand-logs/blob/main/exp3...
My complaint is that the post presents a confusing mix of experiments that imply capabilities that are more than the sum of their parts. This experiment 3 has nothing to do with experiment 1 for instance. In experiment 1 the model does read in the raw weights like it's reading an image.
If you don't like these experiments, then I can only assume you would complain about CRISPR as well, considering it's a general framework with many disparate parts that work together synergistically, similar to the work Takehi et al. describe. CRISPR was also famously rejected multiple times by reviewers.
Note that being able to both inspect raw weights and run Python code to perform additional analysis means the model has multiple possible techniques at its disposal (generally considered a positive, rather than a "confusing mix").