logoalt Hacker News

clickety_clacktoday at 12:39 PM2 repliesview on HN

It’s easier not to have that separation, just like it was easier not to separate them before LLMs. This is architectural stuff that just hasn’t been figured out yet.


Replies

fzeindltoday at 12:50 PM

No.

With databases there exists a clear boundary, the query planner, which accepts well defined input: the SQL-grammar that separates data (fields, literals) from control (keywords).

There is no such boundary within an LLM.

There might even be, since LLMs seem to form adhoc-programs, but we have no way of proving or seeing it.

show 1 reply
hnuser123456today at 4:21 PM

There is a system prompt, but most LLMs don't seem to "enforce" it enough.

show 1 reply