Political Plasticity: An Analysis of Ideological Adaptability in Large Language Models
Authors: Bruno Bianchi, Diego Tiscornia, Matias Travizano et al.
Summary
The authors study "political plasticity"—how easily LLMs adapt their political stance based on context—using 200 questions about economic and personal freedom. They find that system prompts barely work, but user prompts with few-shot examples successfully shift models' positions, especially on economic issues in larger/newer models. Flipping question polarity revealed counter-intuitive responses suggesting data leakage, and plasticity varied subtly across languages.
Main takeaways:
- System prompts were largely ineffective at inducing political bias; user prompts with examples worked much better
- Larger and newer models showed stronger ideological adaptability, particularly on economic freedom questions
- Inverting question sense caused unexpected shifts, hinting at possible questionnaire format memorization (data leakage)
- Small/old models showed limited or unstable plasticity; frontier models were reliably adaptable
- Language choice produced subtle but noticeable differences in political stance
Relevance
Highly relevant to my work on persona installation and installation-path equivalence (prompt vs fine-tuning). Their finding that user prompts succeed where system prompts fail directly connects to my investigation of how different context placement affects behavioral installation. Also relates to my finding that system-prompt length affects marker localization—both point to how context positioning and format determine behavior uptake.
Threat model
Potential threat/caveat for clean result "Fine-tuning one persona on a two-marker chunk and another on the start marker plants the end marker at every donor answer's end, not chained to the start (LOW confidence)": this item discusses bias.
Abstract
arXiv:2605.08415v1 Announce Type: new Abstract: Since the advent of Large Language Models (LLMs), a significant area of research has focused on their intrinsic biases, particularly in political discourse. This study investigates a different but related concept, "political plasticity", which is defined as the capacity of models to adapt their responses based on the user supplied context. To analyze this, a testing framework was developed using an expanded corpus of 200 politically-oriented questions across economic and personal freedom axes, based on a prior framework by Lester (1996). The study explored several methods to induce political bias, including simplified and topic-based system prompts, as well as user prompts with few-shot examples. The results show that while system prompts were largely ineffective, user prompts successfully elicited significant ideological shifts, particularly along the Economic Freedom axis in larger and newer models. Through a validation experiment, we examined whether models answer questionnaires by recognizing the underlying question format. Inverting the sense of the questions revealed unexpected, counter-intuitive shifts in most models, suggesting potential data leakage. Finally, we also analyzed how model plasticity varies when the experiment is conducted in different languages. The results reveal subtle yet notable shifts across each of the analyzed languages. Overall, our results indicate that small and older LLMs exhibit limited or unstable political plasticity, whereas newer frontier models display reliable, expected adaptability.