FRESH

Hacker News

Show HN: 1v1 coding game that LLMs struggle with

24 points by levmiseri

by dang

0 subcomment

Macroexpanding the previous threads:
Show HN: Yare 2 – Programmable RTS game - https://news.ycombinator.com/item?id=32394902 - Aug 2022 (26 comments)
Show HN: Yare.io – game where you control units with JavaScript - https://news.ycombinator.com/item?id=27365961 - June 2021 (64 comments)
(Btw, reposts are fine after a year or so; links to past threads are just to satisfy extra-curious readers!)

by vessenes

1 subcomments

Cool!
From the prompt it looks like you don’t give the llms a harness to step through games or simulate - is that correct? If so I’d suggest it’s not a level playing field vs human written bots - if the humans are allowed to watch some games that is.

by javadhu

1 subcomments

Cool project, this is my first time seeing such project using LLMs. Took me a while to understand what's happening on the home page.
A question though, why such powerful bots like Gemini 3.1 failed against Clowder bot? Is it because of inefficient code or the LLMs did not handle edge cases? Or they are not as good as humans when it comes to strategy.

by DeathArrow

0 subcomment

LLMs need to have feedback of the outcomes. Just like a human does.