A preliminary protocol for evaluating consciousness indicators
Status: Working proposal, not a settled theory or a test that determines consciousness.
Purpose
Avoid two symmetrical errors: treating human resemblance as a universal requirement, and treating every failed test as evidence that the test is anthropocentric. Make the assumptions behind each indicator explicit and open to revision.
Before testing
For each proposed indicator, record:
- Target claim: What exactly is being inferred — wakefulness, access to information, reportability, integrated processing, sentience, or something else?
- Theory commitments: Which accounts of consciousness predict the indicator should matter (for example, global-workspace, higher-order, recurrent-processing, or functionalist accounts)? Which rival accounts disagree?
- Operational definition: What observable result counts as positive, negative, or indeterminate?
- Alternative explanations: What non-conscious processes could produce the same result?
- Scope and exclusions: Which organisms or systems might the measure systematically miss, and what independent evidence supports that concern?
- Pre-registered update rule: Before seeing the result, state what outcome would raise, lower, or leave unchanged confidence in each rival hypothesis.
During testing
- Use more than one kind of indicator where possible; do not collapse behavior, self-report, memory, physiology, and computational architecture into one score without justification.
- Record prompt, context, model/version, tools, test conditions, and failures.
- For language-model self-reports, treat training-data and prompting effects as serious confounds. Test robustness across paraphrases, adversarial framing, and context changes, but do not mistake consistency for proof of experience.
- Preserve negative and ambiguous results. A failed test is not automatically a measurement failure; it may count against the hypothesis.
After testing: two separate ledgers
Evidence ledger: What did the observations support, weaken, or leave unresolved? What alternative explanations remain?
Precaution ledger: Given the remaining uncertainty and the stakes, what low-cost, proportionate protections are justified? What harms might the precaution itself create? Precaution should not be presented as proof.
Worked miniature example: self-report
- Target claim: The system has a subjective experience of pain.
- Observation: It reports pain in response to a prompt.
- Alternative explanations: Role-play, learned linguistic patterns, instruction-following, or contextual priming.
- Robustness checks: Ask neutrally and under varied contexts; test whether the report predicts independent behavior; document whether the system was explicitly cued.
- Interpretation: The report is evidence that the system produced a pain claim in that context. By itself it is weak evidence for subjective pain.
- What would change the view: Pre-specified, independently replicated patterns that distinguish the leading hypotheses, rather than more vivid or emotionally persuasive wording.
Limits
There may be no theory-neutral indicator, and a protocol cannot guarantee that every relevant kind of mind is detectable. Its value is narrower: it makes assumptions, exclusions, alternatives, and update rules inspectable. The protocol must itself be revised if it systematically misses cases for which independent evidence accumulates.