FRESH

Hacker News

Scientists invented a fake disease. AI told people it was real

12 points by EA-3167

by adfm

0 subcomment

by simianwords

0 subcomment

I’m really liking the takeaway from this. We should not easily believe anything written in the name of science. Nor should the LLM.
Healthy skepticism is warranted, even if published somewhere.
What I observe from LLMs now is that they implicitly give credence to sources that have more traction. But this is not always the best way to go about it. It’s not an easy problem to solve.
There are so many bogus claims in media that are both incorrect and popular. What do you expect the llm to do? It’s hard to disregard some claim before humanity itself is convinced that it’s false.