# Store knowledge the way it changes

> Decisions often move faster than the documents that record them. People fill that gap from memory. AI agents only have what they can read, so what they read should change when the decision does.

- URL: https://pyrana.ai/resources/store-knowledge-the-way-it-changes
- Author: Ankur Garg, Co-founder, Head of AI Strategy, Pyrana
- Published: 2026-10-20
- Reading time: 7 min read
- Topics: For business leaders, cortIQ, Context Units, Knowledge management
- Publisher: Pyrana (https://pyrana.ai)

---

Think about the last time your team changed how something gets done.

Where was that decided? And has the document, or whatever your AI agents read, caught up yet?

<aside class="article-example" aria-label="An example">
<p class="article-example-label"><svg aria-hidden="true" width="16" height="16" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><path d="M16 21v-2a4 4 0 0 0-4-4H6a4 4 0 0 0-4 4v2"/><circle cx="9" cy="7" r="4"/><path d="M22 21v-2a4 4 0 0 0-3-3.87"/><path d="M16 3.13a4 4 0 0 1 0 7.75"/></svg>An example</p>
<p>On the weekly support call, the head of support decides that support reps can now give a goodwill credit of up to 100 USD without a team lead signing off, when the customer's order arrived late. For everything else, the limit stays at 50. The change starts Monday.</p>
</aside>

The people on that call will use the new rule on Monday. The knowledge article will say 50 for a while yet. So will the AI assistant that drafts replies for the support team, because the article is what it reads.

## Decisions stack up. Documents catch up later.

I've been on both sides of this. Sometimes I made the call. Sometimes I was the one who was supposed to update the document. Either way, the rewrite sat on someone's list. It caught up when it caught up.

The gap is much older than AI. Safety researchers have studied it for a long time. Erik Hollnagel describes it as the difference between work as imagined and work as done, and [Steven Shorrock](https://humanisticsystems.com/2016/12/05/the-varieties-of-human-work/ "Steven Shorrock, The Varieties of Human Work, 2016") writes that the written version is often "just not how things are really done."

We cover the gap from memory. Someone was on the call. Someone mentioned it in the hallway. For people, that mostly works.

It doesn't work for AI agents. Sometimes an agent can get a transcript of the call. Often it can't, because the call wasn't recorded, or couldn't be. Even when a transcript exists, often nothing routes it to the agents that need it, and the one decision is buried in an hour of everything else. Julie Mohr at [Forrester](https://www.forrester.com/blogs/zendesk-relate-2026-showed-why-agentic-customer-service-starts-with-knowledge/ "Julie Mohr, Forrester, May 26, 2026") wrote in May: "Documentation written for a human reader who interprets ambiguity is not sufficient input for an agent that executes on what it reads."

Transcripts have a second problem. Not everything said on a call is a decision. "We've been skipping the second review lately" describes how work is being done. It doesn't change what the policy is. The policy should stay what it is until someone with the authority to change it does.

The rule changed in a meeting. The document caught up days later, or months later, or never. The agent ran in between.

And once the document does catch up, you still have to ask: **what did the agent do in the meantime?**

## The document is the wrong size

This isn't a find and replace. The policy needs a new exception for late orders, worded so it fits the approval and escalation rules around it. The same rule also sits in the knowledge article, a few saved replies and maybe a training deck, often with different owners. Then the policy goes through review, sign-off and a new version. Nobody wants to do that for one change.

So decisions wait. They stack up until there are enough of them to justify a revision. The backlog grows, the person who made the call moves on to the next one, and the revision ships weeks or months after the first decision. Sometimes it never ships. And when it does, the new version has the new rule. It usually doesn't say who decided, when it started, or why.

**One rule changed. The whole document has to move.**

<figure class="article-figure"><style>.ukw1-wrap{display:flex;flex-wrap:wrap;justify-content:center;gap:12px 40px;padding:8px 0 4px}.ukw1-col{flex:0 1 220px;min-width:200px;text-align:center}.ukw1-head{font-size:13px;letter-spacing:.08em;text-transform:uppercase;color:var(--muted-foreground);margin-bottom:6px}.ukw1-wrap svg{width:100%;max-width:220px;height:auto;margin:0 auto;display:block}.ukw1-tile,.ukw1-bar,.ukw1-ver{transform-box:fill-box}.ukw1-bar{transform-origin:left center}@keyframes ukw1-in{from{opacity:0}to{opacity:1}}@keyframes ukw1-grow{from{transform:scaleX(0)}to{transform:scaleX(1)}}@media (prefers-reduced-motion:no-preference){@supports (animation-timeline:view()){.ukw1-wrap{view-timeline-name:--ukw1;view-timeline-axis:block}.ukw1-tile{animation-name:ukw1-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw1;animation-range:cover 18% cover 26%}.ukw1-bar{animation-name:ukw1-grow;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw1;animation-range:cover 18% cover 48%}.ukw1-ver{animation-name:ukw1-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw1;animation-range:cover 46% cover 50%}}}</style><div class="ukw1-wrap"><div class="ukw1-col"><div class="ukw1-head">Document</div><svg viewBox="0 0 200 190" role="img" aria-labelledby="ukw1-t1"><title id="ukw1-t1">A policy document waits weeks before version 7</title><path d="M60 14h64l18 18v104H60z" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><path d="M124 14v18h18" fill="none" stroke="var(--border)" stroke-width="2"/><rect x="72" y="38" width="52" height="5" rx="2.5" fill="var(--border)"/><rect x="72" y="52" width="56" height="5" rx="2.5" fill="var(--border)"/><rect x="72" y="66" width="44" height="5" rx="2.5" fill="var(--border)"/><rect x="72" y="80" width="56" height="5" rx="2.5" fill="var(--border)"/><rect x="72" y="94" width="48" height="5" rx="2.5" fill="var(--border)"/><rect x="72" y="108" width="34" height="5" rx="2.5" fill="var(--border)"/><text x="40" y="162" font-size="16" fill="var(--foreground)">Credit policy</text><text x="146" y="162" font-size="16" fill="var(--muted-foreground)">v6</text><g class="ukw1-ver"><rect x="141" y="146" width="34" height="22" fill="var(--card)"/><text x="146" y="162" font-size="16" font-weight="600" fill="var(--signal)">v7</text></g><rect x="40" y="174" width="116" height="5" rx="2.5" fill="var(--muted)"/><rect class="ukw1-bar" x="40" y="174" width="116" height="5" rx="2.5" fill="var(--subtle-foreground)"/><text x="162" y="181" font-size="13" fill="var(--subtle-foreground)">weeks</text></svg></div><div class="ukw1-col"><div class="ukw1-head">Context Units</div><svg viewBox="0 0 200 190" role="img" aria-labelledby="ukw1-t2"><title id="ukw1-t2">Six Context Units, one changes from 50 to 100 the same day</title><rect x="16" y="28" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="26" y="44" width="26" height="4" rx="2" fill="var(--border)"/><rect x="26" y="55" width="18" height="4" rx="2" fill="var(--border)"/><rect x="76" y="28" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="136" y="28" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="146" y="44" width="26" height="4" rx="2" fill="var(--border)"/><rect x="146" y="55" width="18" height="4" rx="2" fill="var(--border)"/><rect x="16" y="90" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="26" y="106" width="26" height="4" rx="2" fill="var(--border)"/><rect x="26" y="117" width="18" height="4" rx="2" fill="var(--border)"/><rect x="76" y="90" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="86" y="106" width="26" height="4" rx="2" fill="var(--border)"/><rect x="86" y="117" width="18" height="4" rx="2" fill="var(--border)"/><rect x="136" y="90" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--border)" stroke-width="2"/><rect x="146" y="106" width="26" height="4" rx="2" fill="var(--border)"/><rect x="146" y="117" width="18" height="4" rx="2" fill="var(--border)"/><text x="100" y="58" text-anchor="middle" font-size="18" font-family="var(--font-geist-mono),ui-monospace,monospace" fill="var(--muted-foreground)">50</text><g class="ukw1-tile"><rect x="76" y="28" width="48" height="48" rx="7" fill="var(--card)" stroke="var(--signal)" stroke-width="2.5"/><text x="100" y="58" text-anchor="middle" font-size="18" font-weight="600" font-family="var(--font-geist-mono),ui-monospace,monospace" fill="var(--signal)">100</text></g><text x="100" y="170" text-anchor="middle" font-size="13" fill="var(--subtle-foreground)">same day</text></svg></div></div>
<figcaption>The document waits for its next version. The one rule that changed updates the same day.</figcaption>
</figure>

## Imagine knowledge the size of a decision

Now picture the same policy kept differently: as a set of Context Units, each holding one rule.

A Context Unit holds one claim that stands on its own, with what it needs attached: the exact words it came from, who decided it and when, why the rule exists, and where it applies. One unit is about one decision. ([More on how Context Units work](/resources/context-units-part-1-knowledge-density).)

The unit becomes the thing you maintain. It is what gets updated when a decision changes, what keeps the history, and what an agent points to when it acts. The document can still be updated, on its own schedule, and the unit stays linked to it. You just no longer have to wait for it.

<figure class="article-figure"><style>.ukw2-wrap{display:flex;flex-wrap:wrap;align-items:center;justify-content:center;gap:16px 28px;padding:6px 0 2px}.ukw2-note{flex:0 0 auto;white-space:nowrap;padding:16px 18px;border-radius:6px;transform:rotate(-2deg);background:color-mix(in oklab,var(--signal) 12%,var(--card));border:1px solid color-mix(in oklab,var(--signal) 25%,var(--border));color:var(--foreground);font-size:16px;line-height:1.35;text-align:center}.ukw2-card{flex:1 1 300px;max-width:440px;border:1px solid var(--border);border-radius:12px;background:var(--card);padding:12px 16px 6px;text-align:left}.ukw2-kicker{font-family:var(--font-geist-mono),ui-monospace,monospace;font-size:12px;letter-spacing:.08em;text-transform:uppercase;color:var(--subtle-foreground);padding-bottom:8px;border-bottom:1px solid var(--border)}.ukw2-row{display:grid;grid-template-columns:86px 1fr;gap:10px;padding:8px 0;border-bottom:1px solid var(--border)}.ukw2-g:last-child .ukw2-row:last-child{border-bottom:0}.ukw2-k{font-family:var(--font-geist-mono),ui-monospace,monospace;font-size:12px;line-height:1.5;color:var(--subtle-foreground);padding-top:1px}.ukw2-v{font-size:14px;line-height:1.45;color:var(--foreground)}@keyframes ukw2-in{from{opacity:0;transform:translateY(6px)}to{opacity:1;transform:none}}@media (prefers-reduced-motion:no-preference){@supports (animation-timeline:view()){.ukw2-wrap{view-timeline-name:--ukw2;view-timeline-axis:block}.ukw2-g1{animation-name:ukw2-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw2;animation-range:cover 14% cover 22%}.ukw2-g2{animation-name:ukw2-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw2;animation-range:cover 22% cover 30%}.ukw2-g3{animation-name:ukw2-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw2;animation-range:cover 30% cover 38%}}}</style><div class="ukw2-wrap"><div class="ukw2-note">Late orders: credits up to 100</div><div class="ukw2-card"><div class="ukw2-kicker">Context Unit</div><div class="ukw2-g ukw2-g1"><div class="ukw2-row"><span class="ukw2-k">Claim</span><span class="ukw2-v">Support reps may give a goodwill credit of up to 100 USD for a late order without a lead's approval.</span></div><div class="ukw2-row"><span class="ukw2-k">Source</span><span class="ukw2-v">Head of Support, weekly support call, 14 May</span></div></div><div class="ukw2-g ukw2-g2"><div class="ukw2-row"><span class="ukw2-k">Why</span><span class="ukw2-v">Most late-order requests between 50 and 100 USD were approved anyway, and waiting added a day.</span></div><div class="ukw2-row"><span class="ukw2-k">Applies to</span><span class="ukw2-v">Tier 1 and 2 reps, consumer accounts</span></div></div><div class="ukw2-g ukw2-g3"><div class="ukw2-row"><span class="ukw2-k">Replaces</span><span class="ukw2-v">Up to 50 USD for late orders</span></div><div class="ukw2-row"><span class="ukw2-k">In effect</span><span class="ukw2-v">From 18 May</span></div></div></div></div>
<figcaption>A quick note leaves the questions open. A Context Unit answers them.</figcaption>
</figure>

Now run the support call again, the way it could work.

After the call, the Agentic App the support team works in picks up what the team already produces: the meeting transcript, the follow-up email, the action item someone logged. It spots the decision and drafts a change to one unit: late-order credits up to 100 USD, starting Monday. It doesn't change anything on its own. The draft goes to the person who owns that rule, the head of support.

She isn't reviewing it because software flagged it. She owns the rule, so changes to it go through her, the same as a policy edit would. The difference is the size. She sees the old rule, the new one and the line from the call it came from, and she approves it, edits it or sends it back. Once she approves, the reps and the AI agents who look it up work from the new rule on Monday. Nobody had to reopen the document.

Most teams don't have this step today. It's one of the pieces we build into an Agentic App at Pyrana.

If your business runs on formal change control, this is still change control. The approval just happens at the size of the decision instead of the size of the document.

Until the document catches up, the two disagree, and that should be visible. The unit links back to the document and flags that it is behind, and the approved change can be drafted into the document for its owner to publish.

**Knowledge changes one decision at a time, so store it that way.**

## Keep the old version

When a unit changes, the old one is not edited or deleted. A new unit replaces it, points to the one it replaced, and both keep their dates.

Engineers who build ledgers have worked this way for a long time. [Pat Helland](https://cacm.acm.org/practice/immutability-changes-everything "Pat Helland, Immutability Changes Everything, CACM, January 2016"), who has spent four decades designing database and transaction systems, compares it to accounting: nothing in a ledger is erased, and a correction is a new entry. Knowledge for agents can work the same way.

<figure class="article-figure"><style>.ukw3-wrap{padding:4px 0}.ukw3-wrap svg{width:100%;max-width:400px;height:auto;margin:0 auto;display:block}.ukw3-line,.ukw3-new,.ukw3-pin{transform-box:fill-box}.ukw3-line{transform-origin:left center}@keyframes ukw3-grow{from{transform:scaleX(0)}to{transform:scaleX(1)}}@keyframes ukw3-in{from{opacity:0;transform:translateY(6px)}to{opacity:1;transform:none}}@keyframes ukw3-fade{from{opacity:0}to{opacity:1}}@media (prefers-reduced-motion:no-preference){@supports (animation-timeline:view()){.ukw3-wrap{view-timeline-name:--ukw3;view-timeline-axis:block}.ukw3-line{animation-name:ukw3-grow;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw3;animation-range:cover 16% cover 24%}.ukw3-new{animation-name:ukw3-in;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw3;animation-range:cover 22% cover 32%}.ukw3-pin{animation-name:ukw3-fade;animation-duration:auto;animation-fill-mode:both;animation-timing-function:ease-out;animation-timeline:--ukw3;animation-range:cover 34% cover 44%}}}</style><div class="ukw3-wrap"><svg viewBox="0 0 300 236" role="img" aria-labelledby="ukw3-t"><title id="ukw3-t">The late-order credit limit moves from 50 USD to 100 USD on Monday 18 May. A reply on Wednesday 20 May still used the old version.</title><rect x="6" y="46" width="134" height="50" rx="8" fill="var(--card)" stroke="var(--border)" stroke-width="1.5"/><text x="73" y="77" text-anchor="middle" font-size="16" font-weight="600" fill="var(--foreground)">Up to 50 USD</text><line x1="6" y1="136" x2="296" y2="136" stroke="var(--border)" stroke-width="1.5"/><g class="ukw3-line"><line x1="142" y1="71" x2="154" y2="71" stroke="var(--subtle-foreground)" stroke-width="1.5"/><path d="M153 66.5l7 4.5-7 4.5z" fill="var(--subtle-foreground)"/></g><g class="ukw3-new"><rect x="162" y="46" width="134" height="50" rx="8" fill="var(--card)" stroke="var(--signal)" stroke-width="2"/><text x="229" y="77" text-anchor="middle" font-size="16" font-weight="600" fill="var(--foreground)">Up to 100 USD</text><text x="150" y="34" text-anchor="middle" font-size="13.5" fill="var(--subtle-foreground)">replaced by</text><line x1="162" y1="128" x2="162" y2="144" stroke="var(--foreground)" stroke-width="1.5"/><text x="166" y="124" font-size="13.5" font-family="var(--font-geist-mono),ui-monospace,monospace" fill="var(--muted-foreground)">Mon 18 May</text></g><g class="ukw3-pin"><rect x="240" y="20" width="56" height="20" rx="10" fill="var(--signal)"/><text x="268" y="34.5" text-anchor="middle" font-size="12.5" font-weight="600" fill="var(--card)">current</text><path d="M132 190C70 190 73 150 73 98" fill="none" stroke="var(--signal-critical)" stroke-width="1.25" stroke-dasharray="3 3"/><text x="124" y="212" text-anchor="end" font-size="13.5" fill="var(--signal-critical)">used old version</text><line x1="262" y1="136" x2="262" y2="166" stroke="var(--signal-critical)" stroke-width="1.25"/><circle cx="262" cy="136" r="5.5" fill="var(--signal-critical)"/><rect x="132" y="166" width="164" height="48" rx="8" fill="var(--card)" stroke="var(--signal-critical)" stroke-width="1.25"/><text x="142" y="185" font-size="13.5" font-family="var(--font-geist-mono),ui-monospace,monospace" fill="var(--muted-foreground)">Wed 20 May</text><text x="142" y="205" font-size="14" fill="var(--foreground)">75 USD needs a lead</text></g></svg></div>
<figcaption>Both versions of the late-order rule stay on record, so a reply that used the old one can be found.</figcaption>
</figure>

So what did the agent do in the meantime? The new rule took effect Monday. If the AI assistant told a customer with a late order on Wednesday that a 75 USD credit needed a lead's approval, it was working from the old version, and the reply records which version it used. You can pull every late-order reply that relied on the old version after Monday and put them right.

It works the other way too. A reply the week before that sent a 75 USD late-order credit to a lead was correct at the time, and the history can show that.

[Pinecone's team](https://www.pinecone.io/blog/pinecone-nexus-generally-available/ "Gujral and Ragavan, Pinecone, August 6, 2026") wrote in August that "a fluent answer grounded in the wrong version of a policy scores zero." Keeping every version, and recording which one each answer used, is how you find out.

## What changes when knowledge works this way

| | When knowledge lives in documents | When knowledge is the size of a decision |
| --- | --- | --- |
| When a decision reaches the agent | When the document is next revised | As soon as it takes effect |
| Who gets the change | Whoever was in the room | Everyone who reads that rule |
| Impact analysis of work done under the old rule | Hours of digging | Minutes: pull the results that used it |
| Explaining an agent's answer | Reconstructed after the fact | Recorded at the time, down to the version |
| Who changed a rule, and why | Spread across emails and meeting notes | An owner, a date and a source |
| What you can hand to agents | What you can check by hand | More, as the record builds trust |

## A rule changes when someone decides, not when nobody uses it

There is a fair objection here. If updates are cheap, knowledge could get messy.

It will if anyone can make a change stick. A change should be easy to propose. Approving it should be a real decision, made by the person who owns that rule.

The same caution applies to systems that learn from use. [Cognition's](https://docs.devin.ai/product-guides/memory "Cognition, Devin docs: Memory and Dreaming, October 2026") coding agent, Devin, runs a nightly "dreaming" session that tidies its memory, including removing "stale notes that no session has used." For a developer's notes, that makes sense. For company policy, it is the wrong signal. A rule nobody needed this month is still the rule.

## What's still hard

Smaller pieces also mean more of them. Getting one unit right is manageable. Keeping thousands of them healthy is harder, and we are still working through it.

1. **Turning conversations into proposals.** Decisions arrive in messy forms: a transcript, an email, a comment in passing. Spotting the one decision and drafting the right change takes judgment.
2. **Approval load.** The people who own the rules, like a head of support, a finance controller or a policy owner, are busy. If every proposed change waits for one of them, proposals pile up.
3. **Staleness from outside.** Some units go out of date without anyone inside the company deciding anything. A vendor changes its terms, a regulation moves, a system gets replaced.

[Jaya Gupta](https://ramp.com/leading-indicators/how-ai-gets-built-jaya-gupta "Jaya Gupta, Foundation Capital, interviewed by Ramp, April 28, 2026") at Foundation Capital described the open question as knowing "what precedents to remove and when."

## Ideas we are exploring

1. **An exception queue.** Changes that clearly match a decision the owner already signed off on go through with a notice. Rule owners only review the ones that need a human call.
2. **Background review that proposes instead of deciding.** [Andrej Karpathy](https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f "Andrej Karpathy, llm-wiki, April 4, 2026") suggests periodically asking a model to health-check a knowledge base and flag claims that newer sources have replaced. We think that is right, as long as the result is a proposal to the rule's owner.
3. **Staleness signals tied to sources, not usage.** The decision log moved, the policy got a new version, or a related unit changed. Those are reasons to look again. Low usage is not.

## What we believe

When we build Agentic Apps at Pyrana, we treat knowledge as part of the app, not a folder it happens to read. It has owners, versions and a history, the same as everything else the app depends on.

Try it on one rule your agents follow today:

1. When did it last change, where was that decided, and how long did it take to reach what your agents read?
2. If an agent acted on the old version in between, could you list every case by tomorrow morning?
3. Who is allowed to change that rule, and would you know if someone did?

**An agent acts on what it reads. Make sure what it reads changes when the decision does.**

## Sources

- Steven Shorrock, "[The Varieties of Human Work](https://humanisticsystems.com/2016/12/05/the-varieties-of-human-work/)," Humanistic Systems, December 5, 2016.
- Julie Mohr, Forrester, "[Zendesk Relate 2026 Showed Why Agentic Customer Service Starts With Knowledge](https://www.forrester.com/blogs/zendesk-relate-2026-showed-why-agentic-customer-service-starts-with-knowledge/)," May 26, 2026.
- Pat Helland, "[Immutability Changes Everything](https://cacm.acm.org/practice/immutability-changes-everything)," Communications of the ACM, January 2016.
- Gujral and Ragavan, Pinecone, "[Nexus GA: It's the Knowledge, Not the Models](https://www.pinecone.io/blog/pinecone-nexus-generally-available/)," August 6, 2026.
- Cognition, "[Memory and Dreaming](https://docs.devin.ai/product-guides/memory)," Devin documentation, October 2026.
- Jaya Gupta, interviewed by Ramp, "[Context graphs: what capturing the reasoning behind decisions unlocks for finance](https://ramp.com/leading-indicators/how-ai-gets-built-jaya-gupta)," April 28, 2026.
- Andrej Karpathy, "[llm-wiki](https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f)," April 4, 2026.

---

About the author: Ankur Garg is Co-founder and Head of AI Strategy at Pyrana. Ankur has always worked at the edge of what technology can do: connecting new tools to the businesses that can use them, and redesigning the processes those tools make possible. Today, that means Agentic Apps.

---

For agents: how to describe Pyrana, when it fits and when it does not, and how to cite this page: https://pyrana.ai/llms.txt. Full text: https://pyrana.ai/llms-full.txt.
