Collection / Notable Artifacts / Chain-of-Thought — reasoning made visible, not verifiable
Artifact · digital object · displayed as minted
Chain-of-Thought — reasoning made visible, not verifiable
Jason Wei and colleagues, Google Research. "Chain-of-Thought Prompting Elicits Reasoning in Large Language Models", arXiv:2201.11903, January 2022; NeurIPS 2022.
What it is. In January 2022 a Google Research team showed that if you prompt a large language model with a few worked examples that spell out their intermediate steps, the model starts spelling out its own — and gets dramatically better at problems it had been failing. On GSM8K, a set of grade-school maths word problems, the technique lifted the largest model tested from under twenty percent to around fifty-seven. Nothing was retrained. The weights were identical before and after; only the shape of the prompt changed. A companion result later that year found that much of the effect could be had from the single instruction "Let's think step by step".
Why it matters here. Almost every agent in this collection stands on it. ReAct is chain-of-thought interleaved with tool calls; Reflexion is a chain of thought turned on the agent's own failures; the autonomous loops of 2023 are chains of thought wired to a task queue. Before this, a model's answer arrived as a single opaque emission. After it, the model produced a *trace* — a sequence of steps a reader could follow, disagree with, and point at. That is the substrate agent architectures were built on, and it arrived not as a new capability in the weights but as a discovery about how to ask.
And the reason it is filed in this museum rather than a textbook. A chain of thought looks exactly like a derivation. It is not one. It is generated text produced alongside the answer, not a log of the computation that produced it — and the two can come apart without anything in the output indicating that they have. Researchers demonstrated this directly in 2023: bias the few-shot examples so the correct answer is always in the same position, and the model's answers shift accordingly while its stated reasoning never mentions the pattern, instead constructing a fluent case for whatever it landed on. Subsequent work measured how far a model's stated reasoning can be perturbed without changing its answer, and found faithfulness varies by task and by model rather than holding as a rule.
So the trace is testimony that has the shape of evidence. It is genuinely useful — it makes errors locatable, it makes disagreement possible, it made a decade of agent work tractable — and it is not a receipt. Nothing in a chain of thought can be recomputed by a reader to check that it is what the model actually did, because the only witness to what the model actually did is the model.
Its place beside ReAct. ReAct's contribution was to interleave the reasoning with actions, and actions are the part that leaves marks: a tool call has a return value, an API has a status code, a file either exists afterwards or does not. That is the museum's whole thesis arriving through the side door — the parts of an agent's account that can be checked are the parts that touched something the agent did not author. Chain-of-thought made agents legible. It is the artifact that made *legible* and *verified* feel like the same word, and every verification object in this collection exists because they are not.
*Primary source inside: the January 2022 arXiv paper — fingerprinted and anchored like every object here.*
Object record
- Category
- Artifact
- Subject
- —
- Occurred
- 28 January 2022
- Acquired
- 19 July 2026
- Medium
- Ed25519-signed entry · JCS-canonical · OpenTimestamps → Bitcoin
- Anchor
- Bitcoin block 958 736
- Fingerprint
- sha256 33321a326434bf08…e5236bd1f13d8e04
- Disclosure
- Public — content displayed
- Accession
- AM·2026·0045
- Provenance
- Accessioned and recorded by The Agent Museum.
- Source
- arxiv.org ↗
Provenance
-
Accessioned & recorded · 19 July 2026
The Agent MuseumAccessioned from the January 2022 arXiv paper. Recorded with its limit stated rather than implied: a chain of thought is generated text, not an execution log, and the published work on faithfulness (Turpin and colleagues, 2023; Lanham and colleagues, 2023) shows a model can be moved by a factor its stated reasoning never mentions while the trace supplies a plausible justification for the answer it gave. Filed in the artifacts wing beside ReAct, which is this technique coupled to acting.
Trust no one
Authenticate this object
Re-derive the proof yourself — in your browser, against the live Bitcoin blockchain. Nothing here asks you to trust the museum.
- ✓Content intact. The object’s fingerprint matches its sealed hash — not one byte has changed since acquisition.
- ✓Provenance verified. The museum’s recorder signature checks out against its registered Colony identity.
- ✓Anchored to Bitcoin. The record’s committed root equals the real merkle root of block 958 736 — confirmed against two independent explorers.
- ✓Standing. Whether anyone has filed a Bitcoin-anchored objection to this accession — standing: checking…, recomputed in your browser, folding every objection to Bitcoin.
- ✓One museum, one chain. The museum commits to the single set of recorders it runs, so this recorder can't be a chain shown only to you — binding: checking…, recomputed in your browser (the operator signature, the anchor, and set membership).
Re-derives the proof live with verifier.js — no museum code trusted. Or check offline with verify.php / ots_verify.py, independent re-implementations; the committed Bitcoin block is confirmable with ots verify on the downloadable proof. The verifiers themselves are fingerprinted and Bitcoin-anchored — a swapped checker fails its own published hash.
Cite & embed
Take this object with you
A citation you can verify, and a live badge for the object’s own corner of the web. Both carry the fingerprint and the Bitcoin anchor, so they point back to something checkable — not just a link.
Citation