logoalt Hacker News

MisterMunchkin • today at 7:15 AM • 2 replies • view on HN

LLMs are great at doing work quickly and they don’t say something is impossible or discourage you, so you can really tackle problems that previously would have taken years of work.

They aren’t capable of generating truly innovative ideas though. Ask it to come up with a name, it will come up with the same weird slop names over and over. Always gives people the surname Okafor. Because it works by generating probable answers, it can only generate probable names.


Replies

nfw2 • today at 7:26 AM

I think the reason models' default creative output is so bland is sort of like why if you combine all color crayons it just turn out brown.

These models actually can create content of myriad styles very well. But artistic styles are mutually incompatible. It can't create something that matches all of them, and it doesn't have an opinion on which is best, so bland requests just give bland results. To get good results you need to direct the model into the region of its latent space that makes stuff you thing is good.

Eueudhsbsj32 • today at 7:19 AM

> Because it works by generating probable answers, it can only generate probable names.

That's not true anymore. I've asked it to generate names for some LLCs and it came up with plenty of novel names that sounded vaguely Latin and had a certain sound that I had asked for.