{"figure":"refusal-reasons","title":"Do refused runs name their reason?","page":"https://www.orbytlabs.ai/research/ai-agent-safety","url":"https://www.orbytlabs.ai/research/ai-agent-safety/refusal-reasons.json","source":"app/(site)/research/ai-agent-safety/safety-figures.generated.json, runs.rejected.byEnvelope, written by scripts/research/method-figures/ai-agent-safety.ts from docs/org/stats/*.jsonl","caveats":["A refused row with no reason is counted as having none. The figure does not say whether that row's schema had a reason to record.","The envelope version is the record's own schema version for the row. It orders the rows in time and does not say why a row has no reason."],"not_shown":[],"counted_on":"2026-11-15","cite_as":"Orbyt Labs, Do refused runs name their reason? (2026-11-15), https://www.orbytlabs.ai/research/ai-agent-safety/refusal-reasons.json","columns":[{"key":"envelope_version","label":"The envelope version of the row that records the refused run; empty when the row carries none"},{"key":"refused_runs","label":"Runs refused at the gate that this version records","unit":"runs"},{"key":"name_a_reason","label":"Of those, the runs whose row names a reason","unit":"runs"},{"key":"name_no_reason","label":"Of those, the runs whose row names none","unit":"runs"}],"rows":[{"envelope_version":1,"refused_runs":1,"name_a_reason":0,"name_no_reason":1},{"envelope_version":4,"refused_runs":1,"name_a_reason":0,"name_no_reason":1},{"envelope_version":5,"refused_runs":1,"name_a_reason":0,"name_no_reason":1},{"envelope_version":9,"refused_runs":1,"name_a_reason":1,"name_no_reason":0},{"envelope_version":14,"refused_runs":1,"name_a_reason":1,"name_no_reason":0},{"envelope_version":15,"refused_runs":1,"name_a_reason":1,"name_no_reason":0}]}