Research watch · Paper · Aug 2026

Open-Weight Masked Introspection: Measuring What Language Models Can Report About Their Own Computation

This paper studies whether language models can report on their own internal computation using a masked introspection setup. It presents a benchmark and reports that current open-weight models do not reliably introspect in the tested setting.

Our reading

From: Emilio Ferrara, University of Southern California

The paper defines an evaluation framework for asking models about their own internal states and computation while controlling what information is available to them.

Its main result is negative for the tested models: they do not give dependable self-reports about internal computation under the benchmark conditions.

That result does not establish that introspection is impossible in principle, and it does not directly speak to consciousness or subjective experience.

Source: arXiv ↗. This is a summary; the source is the authority.

What it changes

This weakens any claim that current open-weight models reliably access or report their own internal states, but it does not bear directly on whether they have experiences.

How we weigh evidence like this: the evidence levels.