From Terminal-bench-2.1 details,

> We use a bash-tool-only agent harness to evaluate 89 Terminal-Bench 2.1 tasks from the official repository, where resources are capped at 6 CPU cores and 8GB RAM.

This disqualifies the results. Each terminal bench task has a cpu upper limit and RAM upper limit. Overriding either is disqualification.

For reference, in tbench-2.1,

1. 0 out of 89 task allow 6 cpu cores (highest is 4, and i think only 1 task)

2. 8 out of 89 tasks allow 8GB RAM

This kind of shady benchmarking (I was talking about it just yesterday in a different context https://news.ycombinator.com/item?id=48838212) takes all joy out of building a harness to improve benchmark performance of a model because no matter what you do, you won't beat the headline (cheating) number. This is presumably why this model is not in the official benchmark leaderboard https://www.tbench.ai/leaderboard/terminal-bench/2.1

As an ex Meta employee, this is a little sad but not massively surprising. 'Number go up' is the core performance evaluation metric until PSC is done and you move on.

  uv tool install llm
  llm install llm-meta-ai
  llm keys set meta-ai
  # paste API key here
  llm -m meta-ai/muse-spark-1.1 "Generate an SVG of a pelican riding a bicycle"

For comparison, here's the pelican I got from Muse Spark 1: https://simonwillison.net/2026/Apr/8/muse-spark/

He doesn't have to match Anthropic or OpenAI model revenue if he can deflate theirs by 99%.

All he has to do is keep spending a few billion dollars developing frontier models, release them as open weights, and turn coding models into a commodity. He also needs a good OSS reference harness to match. Very few people are in a position to do this and for it to make business sense.

That's quite likely where things are headed regardless, and he could speed it up significantly.

We should all hope models move from proprietary products to commodities the way compilers did.

This may be one of the best things Zuck could do for the world.

https://dev.meta.ai/docs/getting-started/pricing-rate-limits

- Chinese models

- Grok

- Meta

- Google

- OpenAI

- Anthropic

I think this is a win. I'm building like crazy to take advantage of all these subsidized tokens while I can.

What kind of use case would be best for that shape?

:(

Well, Vietnam is not in the list of restricted territories.

Anyway, what is "your region" ?

Is this where I am now, or is it where I activated my Oculus 2 five years ago ?

I don't know where I need to sign up to try it out. What is pricing? Is it API or subscription, what?

I had the exact same experience with Grok 4.5 as well.

I for one am really glad to get competitive models that will push the major labs to bring prices down. While Chinese open source labs are also great, unfortunately when it comes to US/Western political pressure it won't often have as much of a bearing on labs bringing prices down, especially for enterprises.

Also if these numbers are true, this is truly breaking ground finally for Meta.

Meta's AI org when from a total mismanaged dumpster fire for multiple years to delivering a competitive model in less than a year on essentially their first try?

I have questions regarding if I should even care but I don't so Meta please keep enjoying the irrelevance. lmao