Can Chinese AI (Kimi K3) file American tax returns (TaxCalcBench)?
12 points by michaelrbock
by dghlsakjg
1 subcomments
For those looking for the answer that don’t want to click through the entire repo: no. Kimi cannot do your American taxes, but origin doesn’t seem to matter.
It appears that no LLM can get more than about a third of returns correct. Kimi K3 is on par with Sonnet 5. They are both very bad at doing your taxes.
by yieldcrv
1 subcomments
I like these tests
In 6 months an LLM will get it to 80%
people will exclaim negatively “it was trained on the eval [to do this incredibly useful thing]”