Wednesday, December 17, 2025
HomeTechnologyAI, MCP, and the Hidden Prices of Information Hoarding – O’Reilly

AI, MCP, and the Hidden Prices of Information Hoarding – O’Reilly



AI, MCP, and the Hidden Prices of Information Hoarding – O’Reilly

The Mannequin Context Protocol (MCP) is genuinely helpful. It offers individuals who develop AI instruments a standardized approach to name capabilities and entry knowledge from exterior methods. As a substitute of constructing customized integrations for every knowledge supply, you possibly can expose databases, APIs, and inside instruments by means of a typical protocol that any AI can perceive.

Nonetheless, I’ve been watching groups undertake MCP over the previous 12 months, and I’m seeing a disturbing sample. Builders are utilizing MCP to rapidly join their AI assistants to each knowledge supply they will discover—buyer databases, assist tickets, inside APIs, doc shops—and dumping all of it into the AI’s context. And since the AI is wise sufficient to kind by means of an enormous blob of information and select the components which might be related, all of it simply works! Which, counterintuitively, is definitely an issue. The AI cheerfully processes huge quantities of information and produces cheap solutions, so no person even thinks to query the method.

That is knowledge hoarding. And like bodily hoarders who can’t throw something away till their houses develop into so cluttered they’re unliveable, knowledge hoarding has the potential to trigger severe issues for our groups. Builders be taught they will fetch way more knowledge than the AI wants and supply it with little planning or construction, and the AI is wise sufficient to cope with it and nonetheless give good outcomes.

When connecting a brand new knowledge supply takes hours as an alternative of days, many builders don’t take the time to ask what knowledge truly belongs within the context. That’s how you find yourself with methods which might be costly to run and unimaginable to debug, whereas a complete cohort of builders misses the possibility to be taught the essential knowledge structure expertise they should construct sturdy and maintainable purposes.

How Groups Be taught to Hoard

Anthropic launched MCP in late 2024 to present builders a common approach to join AI assistants to their knowledge. As a substitute of sustaining separate code for connectors to let AI entry knowledge from, say, S3, OneDrive, Jira, ServiceNow, and your inside DBs and APIs, you employ the identical easy protocol to offer the AI with all types of information to incorporate in its context. It rapidly gained traction. Corporations like Block and Apollo adopted it, and groups all over the place began utilizing it. The promise is actual; in lots of circumstances, the work of connecting knowledge sources to AI brokers that used to take weeks can now take minutes. However that pace can come at a price.

Let’s begin with an instance: a small staff engaged on an AI instrument that reads buyer assist tickets, categorizes them by urgency, suggests responses, and routes them to the precise division. They wanted to get one thing working rapidly however confronted a problem: They’d buyer knowledge unfold throughout a number of methods. After spending a morning arguing about what knowledge to tug, which fields had been vital, and tips on how to construction the mixing, one developer determined to only construct it, making a single getCustomerData(customerId) MCP instrument that pulls the whole lot they’d mentioned—40 fields from three totally different methods—into one large response object. To the staff’s reduction, it labored! The AI fortunately consumed all 40 fields and began answering questions, and no extra discussions or selections had been wanted. The AI dealt with all the brand new knowledge simply nice, and everybody felt just like the mission was heading in the right direction.

Day two, somebody added order historical past so the assistant may clarify refunds. Quickly the instrument pulled Zendesk standing, CRM standing, eligibility flags that contradicted one another, three totally different identify fields, 4 timestamps for “final seen,” plus total dialog threads, and mixed all of them into an ever-growing knowledge object.

The assistant saved producing reasonable-looking solutions, whilst the information it ingested saved rising in scale. Nonetheless, the mannequin now needed to wade by means of hundreds of irrelevant tokens earlier than answering easy questions like “Is that this buyer eligible for a refund?” The staff ended up with an information structure that buried the sign in noise. That extra load put stress on the AI to dig out that sign, resulting in severe potential long-term issues. However they didn’t understand it but, as a result of the AI saved producing reasonable-looking solutions. As they added extra knowledge sources over the next weeks, the AI began taking longer to reply. Hallucinations crept in that they couldn’t monitor all the way down to any particular knowledge supply. What had been a very helpful instrument turned a bear to take care of.

The staff had fallen into the knowledge hoarding entice: Their early fast wins created a tradition the place individuals simply threw no matter they wanted into the context, and finally it grew right into a upkeep nightmare that solely bought worse as they added extra knowledge sources.

The Abilities That By no means Develop

There are as many opinions on knowledge structure as there are builders, and there are normally some ways to resolve anyone downside. One factor that nearly everybody agrees on is that it takes cautious selections and many expertise. However it’s additionally the topic of a number of debate, particularly inside groups, exactly as a result of there are such a lot of methods to design how your utility shops, transmits, encodes, and makes use of knowledge.

Most of us fall into just-in-case considering at one time or one other, particularly early in our careers—pulling all the information we would probably want simply in case we want it reasonably than fetching solely what we want once we really want it (which is an instance of the alternative, just-in-time considering). Usually once we’re designing our knowledge structure, we’re coping with rapid constraints: ease of entry, measurement, indexing, efficiency, community latency, and reminiscence utilization. However once we use MCP to offer knowledge to an AI, we will usually sidestep a lot of these trade-offs…briefly.

The extra we work with knowledge, the higher we get at designing how our apps use it. The extra early-career builders are uncovered to it, the extra they be taught by means of expertise why, for instance, System A ought to personal buyer standing whereas System B owns fee historical past. Wholesome debate is a vital a part of this studying course of. By way of all of those experiences, we develop an instinct for what “an excessive amount of knowledge” appears like—and tips on how to deal with all of these difficult however essential trade-offs that create friction all through our initiatives.

MCP can take away the friction that comes from these trade-offs by letting us keep away from having to make these selections in any respect. If a developer can wire up the whole lot in only a few minutes, there’s no want for dialogue or debate about what’s truly wanted. The AI appears to deal with no matter knowledge you throw at it, so the code ships with out anybody questioning the design.

With out all of that have making, discussing, and debating knowledge design selections, builders miss the possibility to construct essential psychological fashions about knowledge possession, system boundaries, and the price of transferring pointless knowledge round. They spend their youth connecting as an alternative of architecting. That is one other instance of what I name the cognitive shortcut paradox—AI instruments that make improvement simpler can forestall builders from constructing the very expertise they should use these instruments successfully. Builders who rely solely on MCP to deal with messy knowledge by no means be taught to acknowledge when knowledge structure is problematic, identical to builders who rely solely on instruments like Copilot or Claude Code to generate code by no means be taught to debug what it creates.

The Hidden Prices of Information Hoarding

Groups use MCP as a result of it really works. Many groups fastidiously plan their MCP knowledge structure, and even groups that do fall into the information hoarding entice nonetheless ship profitable merchandise. However MCP continues to be comparatively new, and the hidden prices of information hoarding take time to floor.

Groups usually don’t uncover the issues with an information hoarding method till they should scale their purposes. That bloated context that hardly registered as a price to your first hundred queries begins exhibiting up as an actual line merchandise in your cloud invoice whenever you’re dealing with hundreds of thousands of requests. Each pointless area you’re passing to the AI provides up, and also you’re paying for all that redundant knowledge on each single AI name.

Any developer who’s handled tightly coupled courses is aware of that when one thing goes improper—and it at all times does, finally—it’s lots tougher to debug. You usually find yourself coping with shotgun surgical procedure, that actually disagreeable state of affairs the place fixing one small downside requires modifications that cascade throughout a number of components of your codebase. Hoarded knowledge creates the identical form of technical debt in your AI methods: When the AI offers a improper reply, monitoring down which area it used or why it trusted one system over one other is troublesome, usually unimaginable.

There’s additionally a safety dimension to knowledge hoarding that groups usually miss. Each piece of information you expose by means of an MCP instrument is a possible vulnerability. If an attacker finds an unprotected endpoint, they will pull the whole lot that instrument supplies. In the event you’re hoarding knowledge, that’s your total buyer database as an alternative of simply the three fields truly wanted for the duty. Groups that fall into the information hoarding entice discover themselves violating the precept of least privilege: Purposes ought to have entry to the information they want, however no extra. That may deliver an infinite safety threat to their entire group.

In an excessive case of information hoarding infecting a complete firm, you would possibly uncover that each staff in your group is constructing their very own blob. Assist has one model of buyer knowledge, gross sales has one other, product has a 3rd. The identical buyer appears fully totally different relying on which AI assistant you ask. New groups come alongside, see what seems to be working, and duplicate the sample. Now you’ve bought knowledge hoarding as organizational tradition.

Every staff thought they had been being pragmatic, delivery quick, and avoiding pointless arguments about knowledge structure. However the hoarding sample spreads by means of a company the identical method technical debt spreads by means of a codebase. It begins small and manageable. Earlier than you realize it, it’s all over the place.

Sensible Instruments for Avoiding the Information Hoarding Lure

It may be actually troublesome to educate a staff away from knowledge hoarding after they’ve by no means skilled the issues it causes. Builders are very sensible—they wish to see proof of issues and aren’t going to take a seat by means of summary discussions about knowledge possession and system boundaries when the whole lot they’ve accomplished up to now has labored simply nice.

In Studying Agile, Jennifer Greene and I wrote about how groups resist change as a result of they know that what they’re doing right this moment works. To the individual attempting to get builders to vary, it could seem to be irrational resistance, but it surely’s truly fairly rational to push again in opposition to somebody from the surface telling them to throw out what works right this moment for one thing unproven. However identical to builders finally be taught that taking time for refactoring speeds them up in the long term, groups have to be taught the identical lesson about deliberate knowledge design of their MCP instruments.

Listed below are some practices that may make these discussions simpler, by beginning with constraints that even skeptical builders can see the worth in:

  • Construct instruments round verbs, not nouns. Create checkEligibility() or getRecentTickets() as an alternative of getCustomer(). Verbs pressure you to consider particular actions and naturally restrict scope.
  • Speak about minimizing knowledge wants. Earlier than anybody creates an MCP instrument, have a dialogue about what the smallest piece of information they should present for the AI to do its job is and what experiments they will run to determine what the AI actually wants.
  • Break reads other than reasoning. Separate knowledge fetching from decision-making whenever you design your MCP instruments. A easy findCustomerId() instrument that returns simply an ID makes use of minimal tokens—and won’t even must be an MCP instrument in any respect, if a easy API name will do. Then getCustomerDetailsForRefund(id) pulls solely the particular fields wanted for that call. This sample retains context centered and makes it apparent when somebody’s attempting to fetch the whole lot.
  • Dashboard the waste. The most effective argument in opposition to knowledge hoarding is exhibiting the waste. Observe the ratio of tokens fetched versus tokens used and show them in an “data radiator” model dashboard that everybody can see. When a instrument pulls 5,000 tokens however the AI solely references 200 in its reply, everybody can see the issue. As soon as builders see they’re paying for tokens they by no means use, they get very inquisitive about fixing it.

Fast odor check for knowledge hoarding

  • Device names are nouns (getCustomer()) as an alternative of verbs (checkEligibility()).
  • No person’s ever requested, “Do we actually want all these fields?”
  • You may’t inform which system owns which piece of information.
  • Debugging requires detective work throughout a number of knowledge sources.
  • Your staff hardly ever or by no means discusses the information design of MCP instruments earlier than constructing them.

Wanting Ahead

MCP is a straightforward however highly effective instrument with monumental potential for groups. However as a result of it may be a critically necessary pillar of your total utility structure, issues you introduce on the MCP stage ripple all through your mission. Small errors have large penalties down the street.

The very simplicity of MCP encourages knowledge hoarding. It’s a simple entice to fall into, even for knowledgeable builders. However what worries me most is that builders studying with these instruments proper now would possibly by no means be taught why knowledge hoarding is an issue, and so they received’t develop the architectural judgment that comes from having to make arduous selections about knowledge boundaries. Our job, particularly as leaders and senior engineers, is to assist everybody keep away from the information hoarding entice.

If you deal with MCP selections with the identical care you give any core interface—holding context lean, setting boundaries, revisiting them as you be taught—MCP stays what it must be: a easy, dependable bridge between your AI and the methods that energy it.

RELATED ARTICLES

Most Popular

Recent Comments