Skip to content
← The journal

Persistent memory / Insight

Context window vs persistent memory: what your agent needs

Understand what a context window holds, what persistent memory adds and how to test the handoff between agent sessions.

Wind-carved lines crossing a sand dune.
Photography by Matt Artz / Unsplash

The short answer

Context capacity and durable knowledge solve different parts of the task.

Test what a new session can recover without pasting the fact again.

What a larger context window changes

A context window holds the material a model can consider in an interaction. Persistent memory keeps information outside that interaction for later work. A bigger window fits more of today's material; it does not decide which of it tomorrow's session should recover.

Chat products may add their own memory features around a model. Those features have separate rules for storage, retrieval and user control. Do not infer their behavior from the model's advertised context capacity.

Follow one fact across the boundary

Imagine telling an agent that Project North's delivery is 12 October. It answers correctly in that conversation. That shows the fact was available in context. Now close the session and ask again without repeating it.

If the agent answers, ask what mechanism supplied the fact and request the source. It might have retrieved a saved note, received application state or used a product memory feature. Without that evidence, you have not established how the information persisted.

The distinction that matters

"Can it fit the document?" and "Will it recover the correct passage next week?" test different capabilities.

Decide what belongs in each layer

InformationLikely roleQuestion to ask
Instructions for the current taskActive contextAre the relevant constraints present now?
A durable project decisionStored knowledge with a sourceCan a later session retrieve it?
A changed deadlineAmendment and current-state selectionDoes retrieval distinguish old from current?
A large archiveSource store with selective retrievalWhich passages does this question need?

For a task that depends on one short document, you may be able to supply that document directly. When you return to a growing collection of changing files, you also need a way to choose the relevant passages and keep them current. A larger context window does not do that work for you.

Test the handoff between sessions

  1. Use a fictional source containing a distinctive fact.
  2. Save it through the product's supported memory workflow.
  3. Start a fresh session and ask for that fact without pasting it again.
  4. Record the retrieved passage and source, not just the final answer.
  5. Change the source, refresh the supported derived data and test again.
  6. Ask an absent-fact question to see whether the system acknowledges a gap.

This exercise is proposed, not a measured result. Our recorded local test covers later-process retrieval and missing evidence in a specified environment. The correction step needs its own verification.

Read long-context claims carefully

Lost in the Middle found sensitivity to where relevant information appeared in the tested long contexts. The study concerns its tested models and tasks; it does not establish a universal limit for current models.

Anthropic's context-engineering guidance treats selection of useful context as an engineering task. The practical lesson here is to inspect what the agent receives, even when the available window is large.

Use the same question and sources for each test. Change one part of the workflow at a time and save what came back. A fluent answer cannot tell you whether the correct source was present.

Buy for the missing capability

If you only need more space for a single task, first evaluate your existing agent's workflow. If your difficulty is maintaining project knowledge across sessions, inspect Gigabrain's storage and retrieval approach and supported integrations.

Gigabrain gives your agent persistent knowledge infrastructure: source ingestion, semantic and lexical retrieval, and a graph connecting facts to their sources. System is for building your own workflows. The optional Loop Pack adds all 24 prepared automations and its recorded update benefits. Neither package removes the need to check sources and test the workflow you depend on.

About this publication

Gigabrain Labs publishes practical guidance for people using file-capable AI agents. Our guides explain the product and link to supporting tests. We label practice exercises separately from recorded results.

About Gigabrain ↗
One complete system

Get Gigabrain.

Give your AI agent persistent, source-linked knowledge from the files you already own.

Gigabrain System
Complete core system

$79 once

The complete knowledge and memory system for your AI agent.

Try Gigabrain
7-day money-back guaranteeNot satisfied? Request a full System refund within seven days of delivery.
  • Persistent, source-linked memory
  • Semantic and lexical retrieval
  • Connected knowledge graph
  • Guided agent setup
  • Tools for building your own workflows
  • Twelve months of core updates

One-time purchase · No coding required · Knowledge stored locally · Model accounts and usage fees are separate

Gigabrain

Gigabrain System 1.1.0

Your context, ready for the next conversation.Keep your files, decisions and previous work ready for your AI.

7-day money-back guarantee

Not satisfied? Request a full System refund within seven days of delivery.

  • Keep every conversation connectedYour AI starts with the decisions and work already done.
  • Set up with a guided walkthroughStart your first project with clear, practical steps.
  • 12 months of core updatesKeep your system current as your work develops.
  • Your licence and download linkSet up on your computer. Keep your files local.

One payment. Yours to keep. No subscription.

Your AI agent and model usage fees are separate.

Secure checkout

Stripe handles your payment details. Your final total, including any tax, appears in the payment form before you pay.

Preparing secure checkout.