Weighted scoring model for product managers

Kevin Lee
By
Kevin Lee
Kevin Lee
Kevin Lee
Kevin is a Co-Founder of ProductHQ. He has worked as a VC at Pear Ventures where he invested in and partnered with…
More About Kevin →
×

A weighted scoring model is a prioritization method I use when several product options need to be compared against the same criteria. I assign each criterion a weight, score every option against those criteria, and combine the results into a relative view. The model makes tradeoffs easier to inspect because I can see which assumptions and priorities drive the ranking.

I do not treat the resulting order as an objective truth. A weighted model is a structured set of judgments. If the criteria are incomplete, the evidence is weak, or the weights reflect unspoken politics, a neat total can create more confidence than the decision deserves. I use the model to improve the conversation and expose what needs judgment.

Start with the decision

I first state what I am choosing and what I am not choosing. I might be comparing customer problems for discovery, initiatives for a quarterly planning discussion, or solution options for a specific outcome. The decision boundary keeps the model from becoming a general scorecard for everything the product team does.

I also identify constraints that are not tradeable in this exercise. A regulatory requirement, a security remediation, or an agreed customer obligation may need a different path from discretionary prioritization. I record it rather than forcing every kind of work into one ranking.

Choose criteria that change the decision

I choose criteria that reflect the outcome and the real tradeoffs. Depending on the decision, I may consider customer value, strategic fit, reach, urgency, evidence strength, learning value, risk reduction, revenue potential, or delivery effort. I avoid adding a criterion just because it sounds responsible. If every option receives the same assessment, the criterion adds ceremony without helping me choose.

I define each criterion in plain language. “Customer value” might mean the importance of the problem and the improvement a successful response could create. “Strategic fit” might mean how directly the option supports a stated product direction. “Effort” might include engineering, design, data, migration, enablement, and ongoing operations rather than coding time alone.

Set weights before scoring options

I give each criterion a weight that represents its importance for this decision. The weights can add to 100 percent or to another clear total. I prefer percentages because they make the tradeoff visible: increasing one weight means something else matters relatively less.

I ask the decision group to discuss the weights before debating individual options. This prevents the criteria from changing to favor a preferred idea. If the team cannot agree on whether customer value or learning speed matters more, that disagreement is valuable information about the decision context.

I write why each weight is what it is and note who agreed to it. The weights are not universal product truths. They express the current strategy, horizon, and constraints. I revisit them when the goal or planning context changes.

Define a scoring scale

I choose a small, consistent scale, such as one through five, and describe what the ends and middle mean for every criterion. A high effort score can mean more effort if effort is a cost, while a high value score means more value. I make the direction explicit before anyone fills out the table.

For an effort criterion, I often invert the score so that a higher final result still means a more attractive option. If I do that, I document the transformation. Another option is to keep effort as a cost and subtract it separately. Either approach can work if the team can read the result without guessing.

I prefer anchored examples over vague labels. A top score for evidence strength might require direct observation across relevant contexts, while a low score might mean the claim is mostly untested. The anchors do not eliminate judgment, but they make disagreement more specific.

Score evidence, not enthusiasm

I ask scorers to write a brief rationale and source for important ratings. I separate observation from interpretation. “Teams abandon the workflow at this step” is an observed pattern if the data supports it. “A redesign will solve the problem” is a hypothesis. Both can belong in the discussion, but they should not carry the same confidence.

I can score independently before a group review to reveal where opinions differ. I do not average away a meaningful disagreement immediately. A wide spread may show that the problem definition is ambiguous, the criterion is underdefined, or people are using different evidence.

I also record unknowns. If an option has a high potential value but little evidence, I do not give it a generous score to keep it competitive. I mark the uncertainty and decide whether a learning activity is the right next step.

Calculate and inspect the result

For each option, I multiply the score for a criterion by its weight and add the weighted values across criteria. I can normalize the result to a convenient range, but the presentation should not imply more accuracy than the input supports. A total with several decimals is still built from estimates.

I inspect the contribution of each criterion instead of looking only at the final order. I ask which weight or rating is responsible for a close call. I run a simple sensitivity check by changing a reasonable weight or score and seeing whether the ranking changes. If a small change reverses the result, I treat the options as effectively close and focus on the next decision rather than defending the order.

Use the model with judgment

The model is one input into prioritization. I still consider sequencing, dependencies, team capacity, risk, discovery value, and the cost of delay. An option may score well but be blocked by a dependency. Another may score modestly but unlock learning or reduce a serious operational risk.

I keep exceptions visible. If we choose an option that ranked lower, I write the reason in the decision record. That practice protects the model from becoming a performance or political tool. A transparent exception is easier to review than a ranking that was quietly ignored.

I avoid using a single model to judge people, teams, or individual performance. The uncertainty belongs to the product decision, not to a person’s worth or competence.

Review the model after the decision

Once the work or discovery is complete, I compare important assumptions with what we learned. Did the evidence support the customer value estimate? Did the effort include operational work? Did the chosen criteria reflect the outcome that actually mattered? I update the model or its guidance when the answer reveals a recurring blind spot.

I keep prior versions when the decision is consequential. This creates a useful record of how we thought at the time without pretending that a forecast should have been perfect.

A practical weighted scoring exercise

I choose three to six criteria, define their anchors, and set weights that total 100 percent. Then I score a small set of comparable options, record evidence beside each score, calculate the weighted totals, and run a sensitivity check. I finish with three outputs: the current ranking, the assumptions that could change it, and the next action for each serious candidate.

A weighted scoring model works for me when it makes priorities and tradeoffs explicit. I use it to create a better decision record, not to disguise uncertainty behind arithmetic.

Next step

Build stronger product strategy, prioritization, and outcome-focused decision-making skills in the Product Manager Certification. Subscribe to the Product HQ newsletter for practical frameworks and career-ready product lessons.

Kevin Lee
Kevin Lee
Kevin is a Co-Founder of ProductHQ. He has worked as a VC at Pear Ventures where he invested in and partnered with early-stage founders on product & growth to help them build the foundations of category-defining companies. He has worked as a Product Manager at AltSchool (backed by Andreessen Horowitz, Founders Fund, First Round Capital, Mark Zuckerberg, John Doerr and other exceptional investors). Previously, he was a Senior Product Manager at Kabam (acquired by NetMarble and Fox for a combined $1bn+), where he worked on products through all lifecycles in San Francisco, Vancouver, and Beijing and helped grow one of the company’s products to become the third largest revenue generating product in the company portfolio. In a former life, he worked in Technology Investment Banking at Merrill Lynch. He is also the author / co-author on 10+ gaming patents.