alt Hacker News> inconsistency across various parts of the story, items that are introduced, questions that go unanswered etc.
This is a workflow problem.
What the LLM normally needs:
- very basic outline: what the story is about
- basic cast of characters: like fiction/plays of the 18-1900s
Then you go chapter-by-chapter. But the most critical thing is that you MUST provide the chapter beats. From start to end. Location, environment, events, any critical conversations. For a chapter that is 2-3K words, this chapter outline often becomes 2-400 words or more. Because you have the story in your head, you can handle the stuff that the LLM is likely to screw up.
There are ways to build a system where the LLM can keep track of many things, but then that becomes programming, which is just as boring.
Replies
No, this is a problem with the nature of LLMs and the text they generate.
I won't go into too much detail, but I have a plot outline, development bible, story mountain, character outlines, style guide and more. I have four agents running on various tasks; writing, error checking, consistency and critique. They can generate a good story but there are holes and issues so it's far from perfect and I wouldn't give it away for free, never mind put a price on it.
To add to this, in my 9-5 I work as a designer. Colleagues in other parts of the business sometimes come to us with stuff they have created using AI tools. To a layman they look really good, but if you know what to look for you can spot the issues.
At this point in time my opinion is that any AI generated thing is great at making fools of the unaware, or those who are not looking at something critically. It can create something that looks like a duck, walks like a duck, quacks like a duck, but on closer inspection it's not a duck.