What is being tested in a metric definition question? (2)
What approach do you use if you get a question asking you to define metrics for a product?
The GAME framework.
1. Goals - Agree with the interviewer on what the goals are for the product, and what the primary goal is.
2. Actions - List all the actions users can take in the product (don’t go into too much detail), and prioritize them based on the goals you aligned on (especially the primary goal). Explicitly state which actions you’ll focus on.
3. Metrics - For each prioritized action, define 2-3 specific metrics used to track it. This is your recommendation.
4. Evaluate - Evaluate the metrics you recommended by their trade-offs/limitations.
What is being tested in a metric change question?
Metric change questions test if you know what to do when a key product metric (e.g. traffic, revenue, engagement, etc.) is going up or down for no apparent reason.
What approach do you use if you get a question asking you to diagnose why a metric has changed?
Use my SMRPS method (an adapted DEC method):
Root causes with MECE: Explore possible root causes of the change:
2. MECE - Create a MECE framework for possible root causes.
3. Root causes brainstorm - Brainstorm potential root causes of the problem within this framework.
4. Pull Data - For each root cause, pull data for the root causes you brainstormed
What should I be thinking if I get a metric change question? (2)
What is a MECE framework? (3) What are the 3 benefits of it? (3)
**Characteristics: **
1. Mutually exclusive - no overlap between parts
2. Collectively exhaustive - the parts comprise the whole (there’s nothing that isn’t included in the whole that isn’t included in the parts)
3. To ensure being CE, you’d often have an “other” category
Benefits:
1. There is no overlap between the different parts which means** it’s easy for clients to focus and discuss one element at a time.** You’re never mixing apples and oranges.
2. **No risk of missing something. **Clients are often worried that you will “miss something” and being MECE reassures them.
3. You can split the work up without duplication. Finally, taking a MECE approach enables you to make sure that there’s no duplication of work in your consulting project. It means that John can cover the US market, Julie can focus on Europe, Mike on Asia, etc. Your team can organise itself in a clear and transparent way which once again clients appreciate.
What’s one good source of how to split it if you want to create a MECE framework?
Maths formulas are great to create MECE frameworks. If your framework is a maths formula, it’ll be MECE by definition. (e.g. profits’ math formula is revenue and costs)
What are some common MECE frameworks breakdowns? (5)
What is a great thing to use if you want to find the root cause of a problem?
MECE
What’s an important metric at Meta that I shouldn’t forget about? (not sure if it’s the most important, but it’s important)
Retention
What are the interview types you can expect at Meta, and the question types in each interview type?
1. Product sense
a. Product design
b. Product improvement
c. Product strategy (e.g. “should our company add a product for X?”, “How would you monetize some_product?”, “If you were a PM for some_product, what would you build?”)
2. Analytical thinking (formerly execution)
a. Metric definition
b. Metric change (debugging)
c. Prioritization / trade-off (often about product features)
3. Leadership and drive (these are behavioral questions)
What is the interviewer testing in a prioritization / trade-off question at Meta? (2)
What are a few things the interviewer is looking for in a Meta product sense interview? (4)
Handling critique: The strongest candidates pause, re‑verify the user insight, propose a tweak, and recap the decision path. Staying calm and structured under fire shows you can “lean into push‑back and iterate in real time”
What are a few things the interviewer is looking for in a Meta analytical thinking (formerly execution) interview? (4)
What are a few things the interviewer is looking for in a Meta leadership and drive interview? (5)
What are the question types and sub-types you can expect in a Google PM interview? (5)
Product Insight Questions (34%)
a. Product Design
b. Product Improvement
c. Favorite product
Analytical Questions (21%)
a. Estimation
b. Metrics definition
c. Metrics change
Behavioral Questions (21%)
a. General
b. Googleyness and Leadership - whether you align with Google’s values and can lead and influence effectively.
c. Cross-Functional Collaboration - focuses on how well you can maintain a professional demeanor while engaging in high-pressure situations that require buy-in from a diverse range of stakeholders.
Strategic Insight Questions (14%) - Defining a strategy
Craft and Execution Questions (10%) (though this may have grown in the last couple years)
What are interviewers looking for in a Google product insight question? (2)
When answering a metric definition question, what’s one thing you shouldn’t forget?
You must be able to identify the downsides of your choices (your chosen metrics), and why they are outweighed by the advantages.
When answering a product strategy question, what’s one thing you shouldn’t forget?
You must be able to identify the downsides of your choices (your chosen solution/strategy), and why they are outweighed by the advantages.
In a prioritization / tradeoff question, what should your process be?
PUBFRATS
What are the components of the RICE framework? (4) How do you use it? (1)
How to use it:
Assign numerical values to each of R, I, C, E, then calculate it using RIC/E
Components:
Reach : how many customers this product or feature will affect in a given time period
Impact : the degree to which this product or feature will contribute to your goal
Confidence : how sure you are about the values you’ve chosen in this calculation
Effort : the overall time your team will invest in the project
How do you assign scores for each letter in RICE?
Reach:
Fnd a metric involving number of people reached in a certain unit time (e.g. quarter or year)
Impact:
3: huge impact
2: high impact
1: medium impact
0.5: low impact
0.25: minimal impact
Confidence:
If you have good analytics, user research, and engineering feedback (respectively) for R, I, and C, you’d have 100% confidence. If you have ⅔, it’s 80%. If you’re just working with educated guesses for all 3, it’s 50% or less.
Effort:
Use a rough estimate of person-months or person-weeks required.
- Consider the total amount of person-months (or person-weeks for smaller projects) this product or feature will take, from planning to implementation and testing, taking into account the work from every branch of your team, including product, design, and engineering.
What are interivewers assessing in a product strategy question? (e.g. a strategic insight question at Google) (3)
What should your approach be when you get a question of this form?
“If you were the PM/CEO for [product/business], how would you [objective] over the next [timeframe or constraint]?”