EPS
← All tasks·#426On hold for now

[Proposed] Read: convergent representations of EM + Waluigi effect

kind: infra
track:

Highlight text on any card (body, plan, or an event) to anchor a comment, or leave a whole-task comment here. Mention @claude to summon a reply.

No comments yet.

Captured from Todoist via my-goat autoprocess.

Idea / reading task: Read work on "convergent representations of emergent misalignment" and the Waluigi effect, and assess relevance to the EM-defense / persona-attractor framing (§5 EM Defense).

Why it matters:

  • If EM produces a convergent internal representation across induction methods (insecure code, bad medical advice, villain roleplay), that supports the single-"misaligned persona" attractor hypothesis (Wang et al. 2025) and would unify the §5 results.
  • The Waluigi effect (training for a trait makes its negation easily reachable) is a candidate mechanism for why the assistant persona is fragile under EM. Worth pinning down precisely vs. the persona-selection-model framing.

Open questions:

  • Is there a specific paper/post titled "convergent representations of EM," or is this Thomas's shorthand for the convergence finding in the persona-features / persona-vectors line? Confirm the exact source before deep reading.
  • Does convergence hold in activation space (shared direction) or only behaviorally? This is the crux for whether a single defense direction generalizes.
  • How does Waluigi-style negation interact with truthification (§6) and identity anchoring (§5.3)?

Done condition: 1-paragraph synthesis + decision on whether it joins the project reference list, linked from §5 EM Defense.

Links: Related to research_ideas.md §5 (EM Defense), persona-attractor framing in §7 (User Modeling).

Source: my-goat queue file 2026-05-28T18-00-06_todoist-6gjhm65RV3m5Qm3v_read-convergent-representations-of-em.md (Todoist id 6gjhm65RV3m5Qm3v).

Activity