Debiasing

Question 1

What is the fundamental, self-referential problem (the “Watchman vibe” or “Meta-Policy Problem”) that motivates the study of debiasing policymakers?

Answer 1

Policy makers often rely on knowledge of cognitive biases to design policies that nudge or debias citizens and organizations. However, the policymakers themselves are subject to the same biases when they are constructing and implementing those policies, creating a systemic problem

Question 2

How is “unbiased” decision-making defined as an ideal for individuals, and what defines a “bias” in this context?

Answer 2

Unbiased Ideal: Often equated with the Rational Choice Theory (RCT) approach: a slow, super effortful way of thinking where the actor considers all options and maximizes their preferences (utility) given their beliefs

2. Bias Definition: Systematic deviations from this rational, effortful way of thinking (System 2). These deviations are typically fast and emotive (System 1) and reduce the actor’s potential or experienced utility

Question 3

Paul Brest’s framework places policy-making procedures along a continuum. Which venues are found at the Formal end and the Informal end, and which is generally more vulnerable to bias?

Answer 3

Formal End: Courts, judicial trials, and administrative agencies. These venues tend to have rules of evidence, pluralistic decision-making, and often require written justifications, which reduce bias

Informal End (Most Vulnerable): Legislatures and legislative committees. These venues often lack formal rules, rely on anecdotes, face direct electoral accountability, and engage in “implicit fact-finding,” making them highly vulnerable to cognitive errors and constituent biases

Question 4

Distinguish between the two main strategies for addressing policy maker bias: Debiasing and Counterbiasing.

Answer 4

Debiasing (System 2) Conscious control; overriding System 1 using rigorous, effortful rationality. Force slowing down, quantification, and intellectual honesty. Cost-benefit analysis or providing data and probability distributions.

Counterbiasing (System 1): Fighting a “System 1 fire with another” by leveraging affective or emotional responses. Short-circuit problematic bias by emphasizing vividness, emotion, or shared identity. | Moms Against Drunk Driving (MADD) tells victim stories to make chronic risks vivid.

Question 5

How would Debiasing (System 2) and Counterbiasing (System 1) approaches be applied to address the Availability Bias (vivid events dominating chronic risks) in legislative fact-finding?

Answer 5

Debiasing (System 2): Implement cost-benefit analysis or a quantification exercise, providing policymakers with objective numbers and statistical realities (e.g., car accidents kill more people than plane crashes)

Counterbiasing (System 1): Make chronic risks more vivid by telling stories or assigning faces and narratives to victims (e.g., using personal testimonials from car accident victims)

Question 6

What systematic process is specifically recommended to mitigate Framing Effects (where the description of options shifts preference) during policy decision-making?

Answer 6

Values-Based Decision Processes

This method forces System 2 deliberation by requiring policymakers to abstractly articulate their policy goals, structure their objectives, quantify criteria (where possible), and evaluate all alternatives systematically against a public rubric, regardless of how the problem was initially described

Question 7

List the six questions Paul Brest proposes in his Diagnostic Framework for assessing whether a policy decision was biased.

Answer 7

1. Is the decision based on incorrect data or analysis?
2. Is there inadequate consideration of the interests at stake?
3. Does it violate axioms of expected utility (e.g., transitivity or procedural invariance)?
4. Is it sensitive to framing in manipulable ways?
5. Is it sensitive to affect (emotion/morals) in variable or manipulable ways?
6. Is the decision maker subject to undue social influence?

Question 8

Provide three examples of structural solutions (process redesign) aimed at reducing bias, and explain why improving the process is often a more politically feasible approach than changing individual attitudes.

Answer 8

1. Examples of Structural Solutions: Use Structured Decision-Making (e.g., checklists, rubrics, trade-off logs); conducting Bias Audits (routine disparate-impact analyses); and promoting Diverse Design Teams to surface blind spots
2. Feasibility: It is less threatening to amend a process than to directly criticize a policymaker (e.g., calling them “biased” or “discriminatory,” which triggers defensiveness). Framing reform as promoting “good government,” “more transparency,” or error prevention is an easier sell

Question 9

Identify three circumstances where debiasing strategies are less likely to work for policymakers.

Answer 9

Debiasing efforts are less likely to succeed when:

1. There are strong external pressures (e.g., electoral pressures or media scrutiny).
2. There is a crisis or time pressure, forcing reliance on System 1 (hot cognition)
   .
3. There is high turnover or a lack of institutional memory.