- About half the people I discuss this with seem to think LLMs are great and don't see any problems with their output. The other half seem to get nothing but an endless stream of plausibly shaped rubbish.
It doesn't seem to depend on what model they use or how they prompt it. In code, there seems to be a loose correlation with testing styles; I've previously noticed that some people write tests to show that the code works as intended, and others try to write tests to show that it can't fail in ways that were unintended. But that correlation is weak.
I'm really puzzled by this.
- The patterns it talks about are true, but imo largely because of model defaults rather than model range. That is, if you prompt for a pelican on a bicycle, each model is going to have a small variety of ways to do it (the default). But if you add more details and requirements to the prompt, there are many, many different ways even a basic model can solve it (the range).
The additional prompting doesn't necessarily need to tell the model specifically what to fix or do better, sometimes it's just enough to break it out of its habit. Asking for a smart looking, middle aged pelican on a sporty red bike isn't making the problem easier but does break it out of its boring defaults.
I wouldn't go so far as to say PEBKAC but the good news is there's still a role for humans in the loop.
- Doing things the same, standard way each time is often good. Most of the code we write is obvious. We notice it when it's a weird quirk rather than just being the most straightforward way.
I wonder how long it will take to fix the quirks?
by bediger4000
0 subcomment
- There's a couple of cyberpunk stories in this one.
by Legend2440
0 subcomment
- What do you mean not arriving? It's already here. AI models are awesome and I use them every day, as does every other software dev I know.
by andrewstuart
1 subcomments
- It’s just another anti AI rant this time focused on the fixable problem of AI tending towards the average.
This will get sorted out in time and in the meantime, instruct the LLM away from averaged answers. It’s not a problem.
If you do not want images that have that instantly recognizable AI style to them - busy, perfect, bright colors pseudo realistic, outside what humans would usually make - then instruct the AI that such images are a failure to meet your goals and instead instruct them in other directions.
- Funny if, after all those trillions of tokens and billions of dollars and grandiose arguments about consciousness, the end of humanity or the next stage of evolution, it turns out it really is just a markov chain after all...
Hacker News