When an interviewer says "X metric dropped 20%—what do you do?", they're grading your process, not a lucky root cause. Here's how I'd run it.
Say the framework out loud first
Interviewers relax when they see structure. I'd narrate:
- Clarify metric definition and time window
- Validate data quality / instrumentation
- Segment to localize the change
- Generate ranked hypotheses
- Propose the next evidence and actions
Diagnosis order I'd trust
| Step | Questions I'd ask |
|---|---|
| Trust | Did tracking change? Bot traffic? Pipeline delay? |
| Scope | Which platforms, geos, cohorts? |
| Funnel | Where did conversion break? |
| External | Seasonality, competitor, outage, marketing mix? |
| Product | Recent launches, experiments, regressions? |
How I'd talk about "what happened"
- Separate knowns, unknowns, and how I'd learn
- Avoid declaring a single cause too early
- Propose a short validation plan (logs, funnel, user reports)
- Tie actions to severity (hotfix vs investigate vs monitor)
Practicing aloud matters more than reading frameworks. Pair this with real product analytics habits on the job. A PM Certification can help build analytical product sense—drill metric prompts weekly. More interview craft in the newsletter.