logoalt Hacker News

alienbaby • today at 8:17 PM • 1 reply • view on HN

I guess then it has no problem working in high dimensional spaces, why would it have?. I wonder if perhaps it's pulling on a bunch of those dimensional threads and getting the outcome it's after, while subtly altering the outcomes across many thousands more dimensions in unnoticed ways. This feels more like an us problem, as in, we think in 4D (just to pick something) and we imagine and theorise in 4d, and propose questions in 4d, whereas a model has no such barriers, and can think in many more D's than we can.


Replies

stopsayingsorry • today at 8:26 PM

Unlikely. Most likely we are just missing something obvious currently by treating llm's as black boxes.