1
Q
What are the steps of the Meta experimentation framework?
A
- Define success metrics and guardrails
- Form a hypothesis
- Choose the correct test design (A/B, holdout, swarm)
- Run experiment and collect data
- Analyze results
- Make rollout decision
2
Q
Why are guardrails essential?
A
They prevent harm to user experience, advertiser value, and ecosystem health even if primary metrics improve.
3
Q
What is a high-quality hypothesis?
A
A falsifiable statement predicting how a change will affect a specific metric and why.
Decks in class (24)
# Cards
-
Meta Metric Tree Fundamentals41
-
Metric Tree Rapid Fire Drills31
-
5-10-1522
-
Meta Metrics Mastery37
-
presto31
-
Module C: Experiment Diagnosis & CUPED (Meta Product Analytics)61
-
Experiment Math Basics (Explicit)10
-
Pillar 1: Metrics & Systems Thinking36
-
Pillar 2: Experimentation & Statistics0
-
Pillar 3: SQL & Analytical Reasoning0
-
Pillar 4: Product Interpretation & Root-Cause Analysis0
-
Pillar 5: Communication & Structured Answers0
-
DECK 1 — Core Framework (Volume Decomposition)6
-
7 Frameworks7
-
Framework 1 — Multi-Stakeholder5
-
Framework 2 — Product Health (Upstream → Core → Downstream)4
-
Framework 3 — Metric Decomposition10
-
Framework 4 — Quality Framework5
-
Framework 5 — Tradeoff Framework3
-
Framework 6 — Experimentation Framework3
-
Framework 7 — Diagnostic Framework5
-
G-C-MM-E Maste overview30
-
G-C-MM-E Microdeck12
-
RATE MASTERY DECK — 7 CARDS7
