My reading of this is that OpenAI's contract with the Pentagon only prohibits mass surveillance of US citizens to the extent that that surveillance is already prohibited by law. For example, I believe this implies that the DoW can procure data on US citizens en masse from private companies - including, e.g., granular location and financial transaction data - and apply OpenAI's tools to that data to surveil and otherwise target US citizens at scale. As I understand it, this was not the case with Anthropic's contract.
If I'm right, this is abhorrent. However, I've already jumped to a lot of incorrect conclusions in the last few days, so I'm doing my best to withhold judgment for now, and holding out hope for a plausible competing explanation.
(Disclosure, I'm a former OpenAI employee and current shareholder.)
The emphasized language is the delta between what OpenAI agreed and what Anthropic wanted.
OpenAI acceded to demands that the US Government can do whatever it wants that is legal. Anthropic wanted to impose its own morals into the use of its products.
I personally can agree with both, and I do believe that the Administration's behavior towards Anthropic was abhorrant, bad-faith and ultimately damaging to US interests.
More of the same here. Not a wonder why the DoD signed with OpenAI and instead of Anthropic. Delegating morality to the law when you know the law is not adequate seems like "not a good thing".
"For intelligence activities, any handling of private information will comply with the Fourth Amendment, the National Security Act of 1947 and the Foreign Intelligence and Surveillance Act of 1978, Executive Order 12333, and applicable DoD directives requiring a defined foreign intelligence purpose. The AI System shall not be used for unconstrained monitoring of U.S. persons’ private information as consistent with these authorities. The system shall also not be used for domestic law-enforcement activities except as permitted by the Posse Comitatus Act and other applicable law."
But I do think my cancelling ChatGPT so I can try Claude, at this time, sends the message I want to send, which is why I did it.
I wonder how many will do so, and how many will simply accept Sam’s AI written rationalization as this own and keep collecting their obscene pay packages…
Goodbye Sam.
Edit: Also, referring to the DOD as the Department of War is cringe.
So DoW did get the “all lawful purposes” language they were after, with reference to existing (inadequate, in my view) regulations around autonomous weapons and mass surveillance.
Can anyone explain this constraint?
Why do fully autonomous weapons require edge deployment?
Does "fully autonomous" in this context mean "disconnected from the Internet"?
If so, can a drone with Internet connectivity use OpenAI?
Or maybe it's about on-premise requirements: the military doesn't want to depend on OpenAI's DCs for weaponry, and instead wants OpenAI in their own DCs for that?
From what I can tell the Anthropic issue was triggered by something Palantir was doing as a contractor for DoW, not anything related to direct contracts between DoW and Anthropic, and DoW was annoyed that Anthropic interfered with what Palantir was up to.
In other words will OpenAI enforce these "red lines" against use by a third-party government contractor?
If not, this seems pretty meaningless if they are essentially playing PR while hiding behind Palantir.
But I imagine that being honest about your corporate identity is suboptimal. It’s probably an important cognitive dissonance tool for the employees? It’s like when autocracies repeat big obvious lies endlessly. Gives those who want to opt out of reality an option.
Our contract explicitly references the surveillance and autonomous weapons laws and policies as they exist today, so that even if those laws or policies change in the future, use of our systems must still remain aligned with the current standards reflected in the agreement.
So, this apply only if they changes the law, not if they break the law.
"What happens if the government violates the terms of the contract?"
As with any contract, we could terminate it if the counterparty violates the terms. We don’t expect that to happen.
WE COULD [...]. Yeah, I believe
Posted here: https://news.ycombinator.com/item?id=47195085
This feels like IBM in the 1930s selling tabulating machines to the Germans and downplaying their knowledge of their use. They seem to want us to naively believe they won't use it for exactly what the military has always wanted, autonomous weapons and mass surveillance. Further more there are much more mundane use they might make of the technology that is perfectly legal yet morally in gray areas.
> “ The Department of War may use the AI System for all lawful purposes… [proceeds to describe current law, with clear openings if the law changes]”
Thus, OAI is relying on the Trump administration’s interpretation of current law. Which, I will remind readers, suggests that it is legal to kill civilians on boats, kidnap foreign leaders, deploy troops in American cities, shoot American citizens protesting ICE.
Yeah I’ve cancelled my OAI sub.
Weak. You reached a deal that Anthropic could not because you demanded more safeguards than Anthropic?? (Based on what you know, of course).
Makes total sense!
I’m going to be left with scrap PCs and Debian at this rate.
In my mind, the government would be fully happy to use this to surveil citizens (and indeed anyone) with or without any legal basis, but the issue was that Anthropic has a safety stack / training and inference protocols that it follows. Refusals, abuse models, and manual guardrails. They didn’t want to shut those off. Likely there were some very basic technical reasons, some being that the team’s safety posture is fully ingrained in the model itself and thus difficult to remove.
In this document, OpenAI admits that while they are not “turning off” their safety stack, they are completely willing to provide the government with a different model, different guardrails, etc. That should be incredibly concerning. Anthropic was unwilling to do this, cited their ToS, and ultimately had to walk away from the deal. Given that the government (DoW really) framed this in terms of a hilariously stupid position (surveillance and autonomous weapons), Anthropic felt that this was something they could voice to the public and therefore the entire guardrails discussion turned into a “we want the language changed”. Also the government can’t actually compel Anthropic to create new guardrails so they had no choice but to raise the stakes, make this a moral thing, and basically accuse Anthropic of being woke.
IMO this is really sad for OpenAI employees. Yet again Sam Altman proves that he wants to weasel his way around public perception. Folks at the company have to grapple with working for someone of that disposition.
But Sam pretending that he wanted the same restrictions as Anthropic *and* seeing how quickly they swooped in and made a deal with the DoD really skeeves me out. (But Sam always gave me the heebie jeebies).
Anyway, I've always preferred Claude, so I'm going to happily stay a paying customer there. This may end up being a big "branding" differentiator.
> We want AI to be aligned with all of humanity.
One of many contradictions. Liars.
This is weak.
Even Google and Microsoft should be worried. This is like 1936 germany, we have ways to go. Look at the tune this administration is singing, if they get their way these CEOs aren't looking at law suits and federal investigations, the current order of things will be long gone by the time people start asking who's responsible for all the blood on the streets.
As for OpenAI’s defense - not buying it.
“OpenAI’s President Gave Millions to Trump. He Says It’s for Humanity”: https://www.wired.com/story/openai-president-greg-brockman-p...
> No, and we have made our position on this clear to the government.
Look, this is the most important thing that everyone needs to understand: Your opinion on this is not welcome here. Your opinion on how the government uses the tools it purchases are unimportant and a non-factor. It is not appropriate for you to share your opinion on this. The government that was elected by the people is the sole decision maker. That’s the agreed social norm that we have in this country. What you’re doing is a minor subversion of our democratic republic, even if it feels like you’re standing on firm moral ground.
The DoD can and will deploy eye watering amounts of capital in the pursuit of its mission. That mission includes artificial intelligence based war systems. If you want a piece of that pie, even indirectly, you need to shut the fuck up and kiss the ring. That’s the reality. You don’t have to like this, but you’re shockingly naive if you didn’t know the world worked this way. The DoD spends nearly a trillion dollars a year, did you really think that was entirely spent on raw materials?
Their systems will be built to their spec, one way or another. They will seize your source code and training sets. They will build data centers. Nothing can stop this. People are making this about Trump and Hegseth, but it’s bigger than that. This transcends political parties. Obama’s DoD would make the same stand, and you’re naive if you don’t think so. Our war machine never loses in the game of politics.
And it _is_ the US department of war - just now entered into yet another war of aggression against Iran, with no cause nor legal basis (not even domestic IIANM), in and endless list of wars, direct and indirect. With another crown jewel being the support, funding and arming for the still-unhalted genocide in Gaza.