logoalt Hacker News

simonwyesterday at 10:10 PM4 repliesview on HN

You need this skill if you're the engineer that's designing and implementing that preprocessing step.


Replies

dolebirchwoodyesterday at 10:26 PM

The skill amounts to determining "what information is required for System A to achieve Outcome X." We already have a term for this: Critical thinking.

show 1 reply
grafmaxyesterday at 10:33 PM

In the short term horizon I think you are right. But over a longer horizon, we should expect model providers to internalize these mechanisms, similar to how chain of thought has been effectively “internalized” - which in turn has reduced the effectiveness that prompt engineering used to provide as models have gotten better.

yunwalyesterday at 10:22 PM

Non-rhetorical question: is this different enough from data engineering that it needs it’s own name?

ofjcihenyesterday at 10:24 PM

Not at all, just ask the LLM to design and implement it.

AI turtles all the way down.