Skip to content
SI.info

SI Glossary · Using SI

Chain of Thought (CoT)

Published 1 min read
On this page
  1. From prompt trick to built-in feature
  2. Why it helps
  3. A window into the model?

Chain of thought (CoT) means reasoning step by step in writing. A 2022 Google paper showed that simply prompting large models with worked examples of step-by-step reasoning, or even adding “Let’s think step by step”, made them much better at arithmetic and logic puzzles.

From prompt trick to built-in feature

Why it helps

Writing out steps gives the model more computation per problem and lets it build on intermediate results instead of jumping straight to an answer.

A window into the model?

Visible reasoning helps humans follow and audit what a model is doing, a useful safety tool. But research has shown that a model’s written reasoning doesn’t always faithfully reflect what actually drove its answer. Many safety researchers argue labs should preserve “monitorable” chains of thought as models get more capable. See interpretability.

← Back to the SI Glossary

Sources

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models — Wei et al., Google Research, 2022

Written by

· Editor

Editor of SI.info. Writes about Super Intelligence, technology policy and the people building frontier models.

How we research and fact-check

Free newsletter

Get The SI Brief

One short email a week: what changed in Super Intelligence, policy and models — and why it matters.

Free. One email a week. Sent via beehiiv, which counts opens and clicks. Unsubscribe anytime. Privacy policy