Skip to content
← The journal

Buying decisions / Insight

AI agent memory costs: setup, retrieval, models and maintenance

Estimate model usage, indexing, storage and maintenance separately, with a transparent arithmetic example and a worksheet for your own workflow.

A winding river and roads crossing a broad valley.
Photography by Kjell-Jostein Sivertsen / Unsplash

The short answer

Compare the cost of completing a task correctly, including retrieval and maintenance as well as model usage.

Estimate model usage, indexing, storage and maintenance separately, with a transparent arithmetic example and a worksheet for your own workflow.

A smaller prompt is only one part of the bill

Sending a few relevant passages can reduce a request's input, but retrieving those passages may add indexing, query processing and review. Retries cost something too. Compare the cost of a completed, correct task before deciding that the smaller prompt saves money.

Keep acquisition costs, recurring usage and human maintenance separate. A downloaded software licence and a hosted model account pay for different things. Use your actual provider invoices and observed task traces rather than assuming a tutorial's example rates match your setup.

List the cost categories before comparing plans

CategoryWhat to measure
Software or serviceInitial licence, subscriptions and applicable updates.
Model usageInput, output and any separately billed usage classes.
Retrieval and indexingInitial processing, changed-source work and queries.
Storage and operationsBackups, hosting, monitoring and recovery.
Human reviewSetup, corrections, source maintenance and failed-task recovery.

Some categories may already be covered by tools you own. Others may not appear on a cloud bill because they consume your time. Record those assumptions explicitly instead of counting every existing cost as a new purchase.

Work through a deliberately simple example

Assume 100 tasks. In approach A, each task sends 12,000 input tokens and receives 800 output tokens. In approach B, each sends 3,000 input tokens and receives the same 800 output tokens. Use hypothetical rates of $1 per million input tokens and $4 per million output tokens.

Illustrative calculationAB
Input tokens1,200,000300,000
Output tokens80,00080,000
Input cost$1.20$0.30
Output cost$0.32$0.32
Total for these two categories$1.52$0.62

The difference is $0.90 across 100 tasks, before other costs. These are invented inputs for arithmetic, not current provider prices, measured Gigabrain usage or a promised saving. The worksheet includes a runnable calculation.

Add the costs the example leaves out

If approach B incurs $2 of additional processing in the same period, its modeled total becomes $2.62. That costs $1.10 more than A under these assumptions. The extra processing reverses the saving in this example. Input-token reduction alone cannot establish financial value.

Include retries and review time for incorrect answers. Also distinguish initial indexing from recurring work. Spreading a one-time setup cost over a month or a year changes the comparison, so state the period and expected task volume.

Measure a representative task before scaling

Choose several real task types, record the calls needed to complete them and inspect the result for correctness. Count the full workflow, including retrieval and recovery after failure. Separate cases that already fit comfortably in context from those requiring durable project knowledge.

Count time saved only when it reduces actual work. Record actual review effort and whether the result was usable. With a small pilot, report the cases and assumptions rather than projecting a precise annual return.

Compare usage alongside the software price

The cost worksheet separates usage from software and operating responsibility. Gigabrain's pricing page is the source for current package terms. Model-provider charges and your maintenance effort are separate.

Read the build-versus-buy comparison if you are deciding whether to assemble the system yourself. Weigh the price against the setup and workflows you would otherwise need to build. If Gigabrain looks like a fit, test that judgment on one small project using a supported agent.

Use the measured run as an input record

On 7 September 2026, the recorded retrieval experiment used Python 3.11.14 on macOS 14.7.6. It reused a local model and runtime seed with the Full 1.1.0 archive.

Two fictional corpora, seven queries and four configurations produced 56 retrieval runs. No remote authoring model was requested. This does not make the machine, initial model setup or operator time free.

InputRecorded boundary
Retrieval runs56, with raw per-query output.
Source dataTwo small fictional corpora, available for inspection.
Remote authoring requestNone requested by this runner.
Hardware price, electricity and staff timeNot measured. Supply your own dated inputs.
Package priceUse the current pricing page at purchase time.

The report supports a workload description. It does not support a universal cost per task or a percentage saving against another product.

Add your dated invoices and measured review time to the cost worksheet. Keep the earlier hypothetical token calculation separate.

Method note: Gigabrain Labs prepared this material with AI assistance. Fictional exercises and executed component checks have separate labels.

About this publication

Gigabrain Labs publishes practical guidance for people using file-capable AI agents. Our guides explain the product and link to supporting tests. We label practice exercises separately from recorded results.

About Gigabrain ↗
One complete system

Get Gigabrain.

Give your AI agent persistent, source-linked knowledge from the files you already own.

Gigabrain System
Complete core system

$79 once

The complete knowledge and memory system for your AI agent.

Try Gigabrain
7-day money-back guaranteeNot satisfied? Request a full System refund within seven days of delivery.
  • Persistent, source-linked memory
  • Semantic and lexical retrieval
  • Connected knowledge graph
  • Guided agent setup
  • Tools for building your own workflows
  • Twelve months of core updates

One-time purchase · No coding required · Knowledge stored locally · Model accounts and usage fees are separate

Gigabrain

Gigabrain System 1.1.0

Your context, ready for the next conversation.Keep your files, decisions and previous work ready for your AI.

7-day money-back guarantee

Not satisfied? Request a full System refund within seven days of delivery.

  • Keep every conversation connectedYour AI starts with the decisions and work already done.
  • Set up with a guided walkthroughStart your first project with clear, practical steps.
  • 12 months of core updatesKeep your system current as your work develops.
  • Your licence and download linkSet up on your computer. Keep your files local.

One payment. Yours to keep. No subscription.

Your AI agent and model usage fees are separate.

Secure checkout

Stripe handles your payment details. Your final total, including any tax, appears in the payment form before you pay.

Preparing secure checkout.