top of page
Search

The Learning Loop is the Moat


Ex CEO of Google, Eric Schmidt, put it in five words: fastest learner wins.


The firms that compound are the ones that close the gap between action and insight fastest. And the agentic era makes it possible to close the loops at a speed and granularity that simply wasn't available before.


AI is not Your Advantage


AI is a commodity. The Stanford HAI AI Index 2025 documents how similar models have become. The gap between the highest and 10th-ranked models dropped from 12% in 2024 to just 5% by early 2025.


The cost trajectory is even more dramatic: the cost of querying a model at GPT-3.5 performance fell from $20.00 to $0.07 per million tokens between November 2022 and October 2024, a more than 280-fold reduction in under two years. This is not a pricing anomaly. It is a structural shift.


Data is a Foundation


Generic AI on generic data produces generic outputs. The question isn't "are we using AI?" It's "are we feeding it anything our competitors cannot?"


Data is the foundation. Learning loops are the mechanism that activates it. And when the loop is genuinely tight something larger emerges: a system that becomes substantively better the more it is used, in ways that are proprietary to you.


We've discussed how context becomes infrastructure in detail.


Evals are the Mechanism


Ethan Mollick, Professor of Innovation at Wharton Business School names the failure mode precisely: "If the output is what matters in your business, you're in trouble. If the process matters, the conversations, the writing of the report more than the report itself, then there's hope."


Most organisations deploying AI right now are optimising for output. Better reports. Faster summaries. The ones building moats are asking a different question: does every interaction make the next one better? Is the system learning? And — this is where it gets hard — who owns the definition of what "better" means, precisely what does good look like?


That's what the AI industry calls 'evals', short for simple evaluations that can be automatically be run on the AI's performance.


OpenAI frames them as the natural successor to OKRs and KPIs. Evals are the extension of measurement for the AI era, and robust evals create compounding advantages and institutional know-how as systems improve.


Bessemer Venture Partners are more direct: instead of chasing leaderboard scores, the companies pulling ahead are building internal eval suites grounded in their own data.


Tobi Lütke at Shopify has pushed this into his entire organisation, teams must demonstrate why AI can't do something before asking for headcount. To demonstrate whether AI can't do something requires an eval.


Learning Loops are the Moat


An agent that handles a customer query is a tool. An agent whose every interaction gets evaluated, feeds back into the system, and makes the next interaction sharper is a compounding asset. The former your competitors can buy tomorrow. The latter takes months of operational signal to build — and every day the loop runs, the gap widens. Its worth having because its hard to do.


For example, Stripe's fraud detection isn't superior because they have access to better AI models than their competitors. It's superior because they've built the tightest feedback loops between AI predictions and human review, creating a learning system that improves faster than pure-AI approaches.


Moats


McKinsey research found that high performers are nearly three times as likely to have fundamentally redesigned individual workflows rather than simply layered AI onto existing ones. Deployment without redesign produces no compounding.


The moat is not the agent. The moat is how well the agent specialises to create value.

Moat

What it is

What it isn't

Proprietary data

Operational signal only your context generates — customer interactions, domain feedback, process outcomes

Feeding AI generic or public data your competitors can access on the same terms

Learning loops

Every interaction improves the next one; usage and learning are the same motion

Deploying AI for static outputs — same quality month on month, no signal feeding back in

Evals

A defined, ongoing measure of what "better" means — the instrument that closes the loop

Measuring success by sentiment or cost saved, with no mechanism to know if the system is actually improving



 
 
 
Agentico Logo

Let's talk

© 2024 Agentico Ltd. All Rights Reserved.

​

Privacy Policy

Thanks for subscribing!

Registered

Agentico Ltd, Reg'd in England & Wales 15428063

ICO Reg'n ZB657122

Location

34-35 Butcher Row, Shrewsbury, Shropshire, SY1 1UW, United Kingdom

Phone

01952 928189

WhatsApp

WhatsApp QR code
Shropshire Chamber of Commerce
bottom of page