alt Hacker Newsopus 5.5 uses agents and skills in chat sessions as well and maintains internal context that it tries to distill from what you provide
I tried to have it write a synopsis website for the different types of dance patterns in Dance Dance Revolution, with guides on their execution, explanations, and provided song sources. I provided all of the source articles and search websites needed for it to be able to do that, and gave it a sample set I wanted it to utilize and build off of.
It has bits and pieces of information wrong in 90% of the sections it created. Poor song choices, missing song choices, incorrect explanations, incorrect step-patterns, the list goes on.
If you're not an expert in a given field for which you're using it, it's going to look like a genius. If you are, it's untrustworthy and borderline useless.
Maybe it wouldn't be if there were ample training data on my topic, but there isn't.
It utilized the research from millions of papers many very close to the destination answer to make those proofs. What would it do on something that isn't supported like that? Be confidently wrong while sounding right. That's what we've seen repeatedly.
Replies
> If you're not an expert in a given field for which you're using it, it's going to look like a genius.
For someone highly literate, llms aren't going to help you write better. If you're borderline functionally illiterate (this is > 50% of the population according to some studies), I'm sure the llms are awesome.
I've long thought the same about all the hype around coding (plenty of examples from years ago now), but will continue to test the new models. They are improving.
I think my anxieties would be different if I were confident a DDR guide full of lies would be spurned and unprofitable.
In a way, I'm not worried about the LLMs per se as much as a kind of moral and ethical collapse. A debasement of the currency of communication, a market of intellectual-lemons.