New AI models are losing their edge almost immediately
For IT teams, the important shift is not just that models improve faster, but that the deployment target is changing faster too. When a frontier release can be mirrored by smaller, locally runnable variants within days, architecture decisions move from โwhich model is best?โ to โwhich model class fits this workload, security boundary, and operating model?โ That puts extra weight on inference portability, containerization, GPU availability, and how easily teams can swap models without rewriting application logic.
This also changes procurement and integration strategy. If a business application depends on one model providerโs APIs, the technical debt is no longer only in prompts and workflows; it sits in token costs, latency profiles, rate limits, and vendor-specific behavior. Teams that want resilience will increasingly design a model abstraction layer, routing requests across self-hosted and managed endpoints based on task sensitivity, latency tolerance, and cost. That is an integration problem as much as an AI problem.
Operationally, the rise of rapid โpatch-styleโ model updates raises lifecycle pressure. More frequent model refreshes mean more validation work for SRE, security, and QA teams: regression testing, output drift monitoring, and controls for prompt injection or data leakage must be repeated more often. If fine-tuning and test-time reasoning become the main improvement path, governance also needs to track which version is running, what data influenced it, and whether the system can be rolled back cleanly when behavior changes.
The net effect is a split market and a more modular stack. Everyday use cases may increasingly run on cheaper self-hosted models close to the workload, while high-risk decisions stay on premium frontier systems with stronger support and controls. For architects, the practical question is how to build for that split now: portable orchestration, observability, and policy enforcement will matter more than betting everything on the current leader.
In todayโs AI race, breakthroughs are no longer measured in yearsโor even monthsโbut in weeks.
The release of Opus 4.6 just over two weeks ago was a major moment for its maker, Anthropic, delivering state-of-the-art performance in a number of fields. But within a week, Chinese competitor Z.ai had released its own Opus-like model, GLM-5. (Thereโs no suggestion that GLM-5 uses or borrows from Opus in any way.) Many on social media called it a cut-price Opus alternative.
But Z.aiโs lead didnโt last long, either. Just as Anthropic had been undercut by GLM-5โs release, GLM-5 was quickly downloaded, compressed, and re-released in a version that could run locally without internet access.
Allegations have flown about the ways AI companies can match, then surpass, the performance of their competitorsโparticularly how Chinese AI firms can release models rivaling American ones within days or weeks. Google has long complained about the risks of distillation, where companies pepper models with prompts designed to extract internal reasoning patterns and logic by generating massive response datasets, which are then used to train cheaper clone models. One actor allegedly prompted Googleโs Gemini AI model more than 100,000 times to try and unlock the secrets of what makes the model work so powerfully.
โI do think the moat is shrinking,โ says Shayne Longpre, a PhD candidate at the Massachusetts Institute of Technology whose research focuses on AI policy.
The shift is happening both in the speed of releases and the nature of the improvements. Longpre argues that the frontier gap between the best closed models and open-weight alternatives is decreasing drastically. โThe gap between that and fully open-source or open-weight models is about three to six months,โ he explains, pointing to research from the nonprofit research organization Epoch AI tracking model development.
The reason for that dwindling gap is that much of the progress now arrives after a model ships. Longpre describes companies โdoing different reinforcement learning or fine tuning of those systems, or giving them more test time reasoning, or enabling to have longer context windowsโโall of which make the adaptation period much shorter, โrather than having to pre-train a new model from scratch,โ he says.
Each of those iterative improvements compounds speed advantages. โTheyโre pushing things out every one or two weeks with all these variants,โ he says. โItโs like patches to regular software.โ
But American AI companies, which tend to pioneer many of these advances, have become increasingly outspoken against the practice. OpenAI has alleged that DeepSeek trained competitive systems by distilling outputs from American models, in a memo to U.S. lawmakers.
Even when nobody is โstealingโ in the strict sense, the open-weight ecosystem is getting faster at replicating techniques that prove effective in frontier models.
The definition of what โopenโ means in model licenses is partly to blame, says Thibault Schrepel, an associate professor of law at Vrije Universiteit Amsterdam who studies competition in foundation models. โVery often we hear that a system is or is not open source,โ he says. โI think itโs very limited as a way to understand what is or what is not open source.โ
Itโs important to examine the actual terms of those licenses, Schrepel adds. โIf you look carefully at the licenses of all the models, they actually very much limit what you can do with what they call open-source,โ he says. Metaโs Llama 3 license, for instance, includes a trigger for very large services but not smaller ones. โIf you deploy it to more than 700 million users, then you have to ask for a license,โ Schrepel says. That two-tier system can create gray areas where questionable practices can emerge.
To compensate, the market is likely to diverge, MITโs Longpre says. On one side will be cheap, increasingly capable self-hosted models for everyday tasks; on the other, premium frontier systems for harder, high-stakes work. โI think the floor is rising,โ he adds, predicting โmore very affordable, self-hosted, self-hosted, general models of increasingly smaller sizes too.โ But he believes users will still โnavigate to using OpenAI, Google and Anthropic modelsโ for important, skilled work.
Preventing distillation entirely may be impossible, Longpre adds. He believes itโs inevitable that whenever a new model is released, competitors will try to extract and replicate its best elements. โI think itโs an unavoidable problem at the end of the day,โ he says.
Enjoyed this article? Sign up for our newsletter to receive regular insights and stay connected.
