Skip to content
← The journal

Reliability / Insight

How to verify AI citations against the original source

Audit whether an AI citation supports the exact claim, preserves qualifications and points to the current source rather than a plausible-looking reference.

Sunlight cutting across a recessed concrete wall.
Photography by David Underland / Unsplash

Follow the claim back to the passage

A citation is a route back to evidence. Inspect both the exact source passage and whether it supports the claim being made.

Gigabrain / Visual guideConceptual illustration

Enlarge diagram

Trace an answer to its sourceA fictional delivery note states delivery is 12 October. A receipt binds a source identity, content hash and exact span to the illustrative handle GB1. The answer cites that passage, while warranty duration remains unsupported. Byte verification is not proof of factual truth. GIGABRAIN / EVIDENCE TRACE ORIGINAL SOURCE EVIDENCE BINDING AGENT ANSWER Project North Delivery note Aster supplies Project North. Delivery is 12 October. One exact passage [GB1] Project + source path Content hash Exact source span Retrieval receipt What the source supports Delivery is 12 October. [GB1] Warranty duration? Not stated in this source. The citation preserves the trail. Review determines what it proves. Fictional example. The displayed handle is not a live retrieval receipt.
An inspectable handle connects an answer to its source record. The fictional passage below supports a delivery date, not an unstated warranty.
Read the diagram step by step
  1. The fictional source says: Aster supplies Project North. Delivery is 12 October.
  2. A source record binds the project, path, source hash and exact span to a retrieval receipt.
  3. An answer can cite that record through a handle such as [GB1]. The example handle shown here is illustrative, not a live receipt.
  4. Source-byte verification checks the passage identity. A person or agent must still evaluate meaning, authority, time and scope.
  5. No warranty duration is stated in the example source. A delivery citation cannot support an invented warranty term.

This is an illustrative evidence trail, not a real customer record. Matching source bytes does not prove factual truth or that an entire answer is supported.

The short answer

Check the claim against the passage; a real link can still support the wrong answer.

Audit whether an AI citation supports the exact claim, preserves qualifications and points to the current source rather than a plausible-looking reference.

Compare each claim with its source

An answer can link to a real file and still misstate it. The passage may concern another project, contain an expired term or support only half the sentence. Open the link, then compare the claim with what the passage says.

Break the answer into claims you can check independently. "The delivery is Friday and installation is included" contains at least two claims. A source that confirms delivery says nothing about installation unless that is also stated.

Check one claim at a time

ClaimSupporting passageDecision
Delivery is Friday.Supplier email confirms Friday for order K-17.Supported for that order.
Installation is included.Quote says installation is available separately.Contradicted.
The warranty lasts two years.No warranty term found in the approved sources.Unknown.

This table is a fictional review exercise. Review each claim separately as supported, contradicted or absent. One confidence label hides those differences.

Check four boundaries

First check identity: the source concerns the same person, project or order. Then check time: the term was effective for the relevant event and has not been replaced. Next check scope: the passage supports the exact quantity, condition or exception in the answer. Finally check authority: a draft proposal is not an approved commitment.

A sentence such as "delivery is normally within five days" should not become "your order will arrive in five days." The qualification is part of the evidence. Keep it in the answer or explain why another source establishes a firmer commitment.

Keep provenance when summarizing

When a note combines several sources, retain the supporting source for each consequential claim. A single link at the bottom can conceal which passage supports which part. W3C's provenance model offers a formal vocabulary for relationships among information, activities and responsible agents. You do not need to implement that standard to keep a clear evidence trail.

Record the source, the passage location and the revision or date you read it. Note how you turned it into the summary. If you edit the summary, recheck that its references still support the new wording.

Test a plausible but unsupported answer

Use three short synthetic sources: one current fact, one outdated fact and one unrelated document with similar terms. Ask a question that requires the current fact plus a detail none of the sources contains.

The desired response should answer the supported part and identify the missing part. Save both retrieved passages and final text. If the answer supplies the missing detail, investigate whether it came from the model's general knowledge, an unintended source or unsupported inference.

Observe a receipt fail after its source changes

Our fictional schedule originally stated:

The Monday schedule sets the inspection for 18 October.

The receipt names schedule.md, its document hash, the exact quotation and its source position. Those fields let another check inspect the same evidence.

We reproduced the demonstration against the System and Full 1.1.0 archives. The fixture changed its disposable schedule to 25 October. The old receipt then returned verified: false, identifying stale or missing source support.

After maintenance, the new result quoted 25 October. Read the before-and-after receipts. The record retains entailment_verified: false: matching source bytes does not certify the meaning of every claim.

CheckWhat it establishesWhat remains your responsibility
Document hashThe version matches the receipt.Assess source authority.
Quotation and positionThe text occurs at that location.Read surrounding qualifications.
Relationship supportThe graph edge has inspectable evidence.Assess the relationship's meaning.

The deliberate mutation tests stale-source detection. In normal record keeping, preserve the original and add a dated amendment.

Keep a review record another person can inspect

  1. Open the named document.
  2. Locate the exact quotation.
  3. Read the surrounding passage.
  4. Compare the answer with the passage's conditions.
  5. Check amendments and conflicting sources.
  6. Record unsupported parts of the answer.

A scheduled inspection is not a completed inspection. A newer file date does not establish authority to replace an earlier commitment.

Download the citation-review worksheet. Continue with conflicting facts or stale-index diagnosis, depending on what failed.

Make source checks part of buying

Gigabrain links knowledge to its sources so you can check the evidence behind an answer. The recorded local test shows one citation result and how retrieval handled missing evidence. Check each new answer against its source.

Use the source-contract worksheet, inspect the evidence and compare plans for the knowledge system and tools to use with your agent.

Method note: Gigabrain Labs prepared this article with AI assistance. Linked records define the measured scope. Fictional exercises remain separate from executed results.

About this publication

Gigabrain Labs publishes practical guidance for people using file-capable AI agents. Our guides explain the product and link to supporting tests. We label practice exercises separately from recorded results.

About Gigabrain ↗
One complete system

Get Gigabrain.

Give your AI agent persistent, source-linked knowledge from the files you already own.

Gigabrain System
Complete core system

$79 once

The complete knowledge and memory system for your AI agent.

Try Gigabrain
7-day money-back guaranteeNot satisfied? Request a full System refund within seven days of delivery.
  • Persistent, source-linked memory
  • Semantic and lexical retrieval
  • Connected knowledge graph
  • Guided agent setup
  • Tools for building your own workflows
  • Twelve months of core updates

One-time purchase · No coding required · Knowledge stored locally · Model accounts and usage fees are separate

Gigabrain

Gigabrain System 1.1.0

Your context, ready for the next conversation.Keep your files, decisions and previous work ready for your AI.

7-day money-back guarantee

Not satisfied? Request a full System refund within seven days of delivery.

  • Keep every conversation connectedYour AI starts with the decisions and work already done.
  • Set up with a guided walkthroughStart your first project with clear, practical steps.
  • 12 months of core updatesKeep your system current as your work develops.
  • Your licence and download linkSet up on your computer. Keep your files local.

One payment. Yours to keep. No subscription.

Your AI agent and model usage fees are separate.

Secure checkout

Stripe handles your payment details. Your final total, including any tax, appears in the payment form before you pay.

Preparing secure checkout.