- Absolutely not, even if Europe was given all of the compute in the world. The issues are much much worse. Starting at "data privacy", continuing with the "EU AI Act" and just an overall mindset of regulation and German angst. Many structures in the EU actively prevent and fight against innovation. Oftentimes more subtle but the consequences stay the same. If you ever had to use one of the "sovereign" AI provides such as StackIT, OVH and the-like, I feel with you. It is just so bad in terms of product and performance, there is no comparison at all with Hyperscalers, and it shows. Eventually, it's a cultural and structural problem along the way and the future here looks horrible.
- The question was never do enough computers exist in Europe, but rather can Europe organize the capital and cross-company / cross-border relationships required to build a big model at scale. There the answer still looks iffy at best. This is where the US has, and continues to, thrive and where Europe can’t get out of its own way.
- Can Europe train a frontier AI model?
It seems unlikely at the moment. The writeup you have is quite interesting, but notably distributed compute for frontier is at least a bump in the road.
As other's have pointed out, if resources across Europe came together there could be a good amount of resources today to do so, but it is fragmented.
Project Glasswing, and most recently the blocking of Fable 5 potentially only for non-US citizens have sparked more attention in the political spheres regarding sovereignty/competitiveness of European AI.
There as also this great write-up which explains the trajectory Europe currently has when it comes to AI compute here: https://europe2031.ai/
So theoretically: yes, but there doesn't seem to be a big enough will to attempt to catch up with the trajectory of American hyper-scalers.
- Sure, theoretically, if it could come to an agreement, and meanwhile the cross-border cooperation of even the inter-EU countries is at an abysmal rate, and currently, even during a goddamn land war with Russia, Germany and France can't come to an agreement to build a fighter jet ensemble (together).
- What is this whole thing about Europe being behind on AI? Do Mistral and DeepL not exist? Yes, I know DeepL is niche, but IMHO it is the best translation model out there.
- Why even bother creating a repo like this? Why not just link to a ChatGPT conversation?
by general1465
0 subcomment
- They could, but why? US and China has poured Trillion of USD into training and any semblance of getting those money back seems like some far fetched dream. Currently there is no realistic path to profitability with these models.
What I see as usable product in the future are smaller specialized models which are able to run and be trained with fraction of resources what goes to current frontier models.
- Under normal circumstances, I'd agree with most folks here, it'd be highly unlikely.
However, we're (i think officially) in an arms race.
I wouldn't want to bet against anyone in these unprecedented times (with plenty of historical parallels).
by fancyfredbot
1 subcomments
- Forget regulations, would it make sense for Europe to train a frontier model of it's own? Would it be sufficiently better than fine tuning a Chinese model? Would it actually be competitive with US frontier models? Would enough people pay to use it even within Europe to pay for the training costs? Do we have enough inference capacity that enough people /could/ use it? Would being "European" allow any governments in Europe to trust it, rather than deciding that actually there needs to be a French, German, Italian, Spanish and UK sovereign AI?
I am guessing that enough of these questions can be answered with "no" that nobody really wants to invest.
For the same reason there isn't really a serious third start up competitor to OpenAI and Anthropic.
- No, but EU can train an LLM to regulate others LLM
by niemandhier
1 subcomments
- Being slow is sometimes a problem.
But if the needed total revenue for an investment is so absurdly large, that we need to capture 5-10% of the labour market,
being slow might mean not burning in the crash.
The US drove the CCCP to bankruptcy by investing in nuclear bombs. Maybe history repeats itself.
by antiloper
1 subcomments
- thanks chatgpt
- Are we really discussing a plan that has never been attempted before (training a frontier model on federated hardware) and that would require coordination on a continental scale, sketched on a five-page PDF on GitHub with no discernible author or affiliation? a PDF that, I am sorry to point out, reeks of AI prose in more than one passage?
What are we even doing here.
by isoprophlex
2 subcomments
- Just post the prompt that generated this slop next time. Then we'd have a chance of seeing some original thoughts, instead of a bunch of web searches filtered through a bucket of mediocrity.
- We do. But only for a limited context space, plant images. We do train our own Foundation Model, and it works great. It's the world frontier model. The machine is expensive, yes, but the customers also pay a lot to get it's advantages. And we got the H100`s on ebay.
We also have buerocracy and regulations problems, but not with the AI at all. Only with the military civil dual-use restriction of thermal cameras. The ones we are allowed to sell have ridicolous resolutions. It still works, but it's barely useful.
And our colleagues across town are also world leader in their AI field. They produce all the world best face recognition SW. They had to use tricks to overcome regulations, but it works. They have their own HW as us.
And again other colleagues across town do rent their GPU computes to train their models. That's for office OCR, and speech to text.
The town is Dresden btw
- Unpopular opinion: They can not and they should not.
We live in a world where free open weight-models become competitive with frontier model within a year or two.
It is much more lucrative and proficient in term of business to solve real problems affecting the industries / govs with A.I right now than it is to do the arm race with OpenAI or Anthropic.
That is what Mistral is doing and that served them well so far.
The problem is not regulation and never has been. Regulation is a best a minor stone in the shoes of A.I company in Europe.
The problem is somewhere else: People fails to understand that there is no equivalent in the EU to the unlimited money tap of American VCs and private funding. That's just not a thing here, the investor landscape is much more dry.
Company here just cannot stay unprofitable for 25y while surfing on stocks valuation, it does not work like that in the EU.
And as such they cannot compete with behemoth like OpenAI that burn 80B$ a year of cash while staying afloat.
I do believe the approach of Mistral is the right one: Solve actual problems right now even if not Edge and construct on top of that.
Specially if politically speaking, the White House administration continue to give excellent arguments in favor of sovereignty for the incoming decade. It might be the best strategy they have.
by ForHackernews
1 subcomments
- Who cares? Just distill some existing frontier models and run the inference yourselves. Instant sovereign AI.
by evilturnip
0 subcomment
- I feel like the very thing that EU is great at: more consumer friendly and anti-corporate legistation, also hamstrings it for innovation. Why would VCs invest in AI there instead of in the US where they don't have to worry about any of that.
by giacomoforte
0 subcomment
- No because public EU compute is adminisered by physicists and although they are very competent in their own domains they are winging it when it comes to AI. It like expecting OakRidge to train LLMs...
They already tried training LLMs.
by thomascountz
3 subcomments
- Does Europe need to train a frontier AI model, at all?
"Training a frontier AI model" is a euphemism. The AI industry is, at present, a disproportionately resource-intensive and exploitative activity which carries only an religious promise of making up for itself at some future date (note that the beliefs being touted to board members are different than the gospel spread to users).
More accessible "non-frontier" models are being designed, built, and trained, while bigger models' gains are beginning to asymptote. Economically, Europe does not often hastily participate in new ways of wealth extraction, and with regard to sovereignty, I'd argue that "frontier" models are becoming a liability to the governments who build them and to the populations they're meant to lead.
- This has factored out product development, which is more than compute resources. Just like any industry, some organisation needs to take ownership and responsibility to convert technology to a usable product.
- No. Computers are made in the USA or China, OSs are made in the USA (Linux, Windows, Mac).
I'm still waiting for the European computer but all microcontrollers (no processors yet) made in EU have an ARM (British-American) Cortex and the RAM is made elsewhere.
- They really shouldn’t.
- those that know, do not talk?
- europe2031.ai
- [flagged]
- [dead]
- [dead]
- [dead]
by huflungdung
0 subcomment
- [dead]
by ExoticPearTree
2 subcomments
- No, it cannot. The fundamental problem between the US and EU it is that in the US if something is not explicitly forbidden, it is allowed and in the EU if it is not explicitly allowed it is forbidden.
You cannot have innovation at the speed and scale that you have in the US because the legislation is cumbersome and there is no unified market with the same rules.