Skip to content

Knowledge base

Federated Context Platform for Enterprise AI Agents

For architects bringing agents into a large company: how context layers follow the org chart, what the gateway and catalog do, and where to start reading.

Written by

Updated:

Agentic Engineering 5

Our position. We hold that one big context file does not scale (opens in a new tab): context should be federated in layers that mirror the org chart, each kept by the people who already own that knowledge. Where two layers disagree, an agent can act as a neutral architecture mediator, and that is federated context governance.

The model is Conway’s Law pointed at the agents, and it borrows from data mesh. Treating data as a product gives each domain explicit ownership and quality duties (Deloitte (opens in a new tab)). A single central team cannot keep pace with change across the enterprise, so a monolithic context store becomes the bottleneck (Strategy and architecture).

The context itself falls into layers. Platform context carries shared policies and guardrails, domain context the business rules and decisions, technical context the code and architecture, and agent context the task state and memory. An LLM gateway governs model access, cost and guardrails, and a context catalog holds the metadata that makes each product discoverable. Agents ask the catalog what exists and the gateway for the content, ideally over the Model Context Protocol (opens in a new tab) (The platform layer).

Storage stays polyglot. Hybrid enterprise search beats pure vector search when precision matters, for example on an error code or a product SKU. Knowledge graphs answer multi-hop questions, and Git-style repositories give long-running agents auditable, branchable memory (Storage and retrieval architectures). Source code becomes context through AST parsing and a code knowledge graph (Engineering context products).

Governance belongs in the architecture from the first release. Access control filters data at the retrieval layer, because a prompt instruction cannot hold a security boundary against prompt injection. Event-driven re-indexing, versioned products and named maintainers keep context from going stale (Governance and operations).

Start here

Resources

Documentation

Papers and reports

Posts

In this section

  • Engineering context products

    How documents, conversations and source code become context products, step by step from ingestion to a code knowledge graph, for platform and data teams.

  • Governance and operations

    Federated context stays safe and useful only if it is governed after launch. An orchestrator assembles just the context a task needs, access control filters data at the source instead of trusting the model, and event-driven re-indexing, versioning and named owners keep context from going stale.

  • The platform layer

    The platform layer is the shared part of a federated context platform: an LLM gateway that governs model access, cost and guardrails, and a context catalog that makes every context product discoverable. Agents ask the catalog what exists and the gateway for the content, so they never depend on where it is stored.

  • Storage and retrieval architectures

    No single store serves every context need. Hybrid enterprise search finds relevant documents, knowledge graphs answer multi-hop questions about relationships, and Git-style repositories give long-running agents auditable, branchable memory. A mature platform routes each request to the store that fits it.

  • Strategy and architecture

    Enterprise agents need timely, domain-specific context, and one central store cannot own or refresh it at enterprise scale. Treating context as a product lets each domain publish owned, discoverable context, while a shared platform supplies the gateway, the catalog and the common controls.