logoalt Hacker News

SonOfLilitlast Tuesday at 11:37 AM3 repliesview on HN

The moment you start building evaluation pipelines and running experiments to validate your ideas it stops being guessing


Replies

simonwlast Tuesday at 12:30 PM

Right: for me that's when "prompt engineering"/"context engineering" start to earn the "engineering" suffix: when people start being methodical and applying techniques like evals.

show 1 reply
ModernMechlast Tuesday at 3:49 PM

You've heard of science versus pseudo-science? Well..

Engineering: "Will the bridge hold? Yes, here's the analysis, backed by solid science."

Pseudo-engineering: "Will the bridge hold? Probably. I'm not really sure; although I have validated the output of my Rube Goldberg machine, which is supposedly an expert in bridges, and it indicates the bridge will be fine. So we'll go with that."

"prompt engineer" or "context engineer" to me sounds a lot closer to "paranormal investigator" than anything else. Even "software engineer" seems like proper engineering in comparison.

show 1 reply
grugagaglast Tuesday at 1:55 PM

It’s validated and filtered but isn’t it still guessing at the core? Should we call it validated guessing?

show 3 replies