Skip to content

Reading Agentic Interpretability Without Public Slides | Stanford CS224N Lecture 15

Aug 22, 20261 min
TL;DRLecture 15 is Been Kim's interpretability guest session, but the Winter 2026 site publishes no slides or agenda. This article does not invent lecture content; it maps the five official readings across concept discovery, agentic investigation, and new vocabulary.

🌏 中文版

Video status: Recordings require sign-in or course authorization. Source details

The official CS224N Winter 2026 schedule confirms that the fifteenth regular unit took place on February 24, 2026, guest-taught by Been Kim under the official title Guest Lecture: Interpretability. Unlike the first fourteen units, the course page publishes no Winter 2026 deck and no agenda. It lists only five suggested readings.

This article therefore cannot faithfully reconstruct what was taught. It is a reading map supported by the official list, preserving the series position and material boundary without presenting papers as classroom speech.

Route one: from explaining an answer to an investigating agent

The first official reading is Because we have LLMs, we Can and Should Pursue Agentic Interpretability. This route moves interpretability beyond one visualization or feature attribution toward an investigation that proposes hypotheses, designs probes, calls analysis tools, and accumulates evidence.

Agentic does not mean trustworthy. Every step still needs traceable inputs, tool outputs, counterexamples, and stopping rules. Asking one model to explain itself and then judge the explanation creates a closed confirmation loop.

Route two: from model internals to human concepts

The Pareto Frontier of Human-Centered AI and the AlphaZero concept-discovery paper focus on concept exchange between people and models. The latter discovers concepts in a model and transfers them to people. The question is not only whether a neuron activates, but whether a discovered concept is understandable, usable, and improves later human judgment.

This creates a multi-objective trade-off: predictive performance, human understanding, intervention cost, and actionability need not peak together. An explanation that is faithful but unusable—or intuitive but unfaithful—cannot be summarized merely as “interpretable.”

Route three: existing vocabulary may be insufficient

We Can't Understand AI Using our Existing Vocabulary and Neologism Learning for Controllability and Self-Verbalization ask whether model structure exceeds existing human labels. A concept bottleneck restricted to known vocabulary may force unknown patterns into familiar categories.

Neologism learning introduces new concept tokens that a model can reference, control, or verbalize. Validation must go beyond whether a name sounds plausible: does it correspond to reproducible behavior, generalize across examples, and cause the expected change when intervened upon?

What can and cannot be confirmed

The date, speaker, title, and five official readings are confirmed. The spoken agenda, deck, coverage of each paper, live examples, and conclusions are not. The page HTML contains a commented-out link to an older offering's slides; it is not Winter 2026 public material and is not used here. This article should become a full lecture review only if current slides are later released.

Course video sources

Checked live on the official CS224N page: Winter 2026 lecture videos are on Canvas (sign-in required) and the course says they cannot be opened to non-enrolled students; the Canvas entry redirects to the Stanford sign-in page. The only public recordings the official page points to are the 2024 playlist, and none of its lectures matches this lecture's title, so no video is embedded and recordings from other years are not passed off as this term's.

Course and recording entries:

Checked: 2026-10-10.

Update Log

  • 2026-10-10: Added explicit video status and checked recording sources and access notes.
  • 2026-10-10: Rechecked video status. Confirmed Winter 2026 recordings need sign-in and public recordings are the 2024 playlist with no matching lecture; status unchanged and check date added.

References