daily-fix: judge transport errors are RETRY, never dropped d
kind: infra#wf-fix#wf-fix-fp:569c2bb3d2a5#daily-auto-filed
track:Highlight text on any card (body, plan, or an event) to anchor a comment, or leave a whole-task comment here. Mention @claude to summon a reply.
No comments yet.
Overview / Motivation
Auto-filed by the /daily 2026-07-08 problem sweep (transcript-mined; emitting agent: /daily orchestrator).
Goal
Distinguish judge transport errors from content drops in the drop-never-coerce rule.
Workflow gap
- Bug observed: Transcript c16b10ca (issue-1090) 09:34:17Z interp-critique r1: the dropped judge draws were stored API-529 overload errors, freely re-judgeable; drop asymmetry 400/1000 trained draws on C2-icl; 10:07:34Z re-judge recovered 2,635/2,638 (zero refusals), all cells 200/200.
- Why it is a workflow gap: Rule 9 (drop-never-coerce) does not distinguish content-informative judge failures (REFUSAL/non-numeric/out-of-range) from transport failures; a pipeline persisting transport errors as drops silently censors arms, mimicking a selection artifact.
- Confidence (emitter): medium
Proposed change (candidate diff sketch — refine in planning)
Rules 9/23 amendment: transport errors (429/529/timeout/connection) are RETRY-with-backoff, never drops; the per-arm dropped-draw report splits content-drops vs transport-errors; a companion note that eval/batch_judge.py should not persist error:True entries counted as drops (library change = sibling infra task, src/ off-surface here).
Scope / surfaces
- Primary target:
.claude/rules/llm-judging.md - Grep the workflow surface for the pattern before editing and update every hit; list them in the plan.
Constraints / invariants
- Workflow-surface only — never experiment code,
configs/, ortasks/. scripts/workflow_lint.py --check-asks+--check-referencespass; ruff on touched files passes.- This session runs under
EPM_WORKFLOW_FIX_SESSION=1and carries aworkflow_fix_target:Provenance line — it MUST NOT auto-route its own subagents' workflow-fix candidates (recursion guard).
Provenance
- workflow_fix_target: .claude/rules/llm-judging.md
- origin: transcript-mined by /daily 2026-07-08 problem sweep
- evidence: mine-1112-1090 P9 (c16b10ca 09:34:17Z, 10:07:34Z)
Activity