Framework 7 — Diagnostic Framework

Question 1

What is the first step in diagnosing a metric drop at Meta?

Answer 1

Segmentation (user groups, geography, device type, ad type, cohorts).

Question 2

What is localization in diagnostics?

Answer 2

Narrowing down where the issue lives: upstream, core, or downstream; supply vs demand; targeting vs ranking.

Question 3

Why compare cohorts?

Answer 3

To see if the issue is widespread, isolated, or tied to a specific population or treatment group.

Question 4

What are typical hypotheses for quality or engagement issues?

Answer 4

Bad supply, degraded ranking, signal loss, integrity enforcement, creative fatigue, seasonal effects.

Question 5

What is validation?

Answer 5

Use data, logs, A/B tests, or timeline analysis to confirm or reject hypotheses before taking action.