Why weighting often goes wrong in a scorecard
You can have a scorecard with clear criteria and still end up with a discussion based on gut feeling. This usually happens when everything seems “equally important”, or when the weighting is adjusted retrospectively because a candidate is likeable. Weighting isn’t just a spreadsheet trick; it’s an agreement on what really makes the difference in this role.
With a good weighting of the recruitment scorecard You achieve two things at once: you keep the model simple, whilst also guiding the team towards the most important risks and success factors. That is precisely why giving greater weight to 2–3 key criteria often works better than ten criteria with minute differences in percentages.
What “weighting” actually means in recruitment
Weighting means that not all assessment criteria carry the same weighting in the final score. You deliberately choose which elements are “decisive”, as they have a significant impact on performance, safety, quality or turnover.
In practice, there are three common variants:
- Equal weighting: Each criterion carries equal weight (simple, but often too simplistic).
- Top criteria carry greater weight: 2–3 key criteria count double or are given a higher percentage.
- Knockout + weighting: First meet the minimum requirements; only then do the scoring and weighing.
This last approach is often the most justifiable for roles with strict prerequisites (qualifications, driving licence, safety standards), as it prevents a high “overall score” from masking a critical shortcoming.
Step 1: Choose 2–3 key criteria that really make a difference
If you give more weight to more than three criteria, weighting becomes a new source of noise. The trick, therefore, is not to measure more, but to choose more carefully.
Would you like to find out more about data-driven recruitment?
- Recruitment using AI and data
- Takes an average of 3–8 weeks to complete
Use these questions to select key criteria:
- What are the biggest risks of failure? Consider safety, quality issues, loss of customers and staff absences during shift work.
- What is difficult to coach within 90 days? Some skills can be developed, whilst others cannot (e.g. an understanding of safety standards).
- What sets the top performers in your team apart? Not in words, but in actions and results.
Examples by job type
- Blue-collar / manufacturing: safety awareness, focus on quality, troubleshooting.
- Logistics: accuracy, planning/prioritising, ability to cope with stress.
- Sales: needs analysis, discipline in follow-up, dealing with resistance.
If you want to link this to a fixed interview structure, it helps to ensure that your assessment criteria are reflected in your questions. The article How to conduct a structured interview in 8 steps shows how to translate competences into standard questions and rubrics.
Step 2: decide on a simple weighting system that everyone can understand
The simpler the calculation rule, the more likely hiring managers are to actually use it. Instead of 10%, 12% and 8%, a rough breakdown works better.
Introduce one of these three simple models:
- Double score: Core criteria count double (e.g. safety and quality).
- 60/40 model: core criteria totalling 60%, other criteria totalling 40%.
- 3-2-1 model: core criteria: weighting 3; other important criteria: weighting 2; “nice-to-have” criteria: weighting 1.
Sample table: weighting without complicated percentages
This table helps to make weighting clear without turning it into a maths exercise.
| Criterion | Why this matters | Weight | How do you test it? |
|---|---|---|---|
| Safety awareness | Risk of failure: incidents, downtime, liability | 3 | Case study + follow-up questions on previous situations |
| A quality-focused approach | Direct impact on reject rates, rework and customer satisfaction | 3 | Have the STAR question and the approach/standards explained |
| Working together in a team | Impact on data transfer and error prevention | 2 | Behavioural question + specific examples of alignment |
| Learnability | Speeds up induction and reduces staff turnover | 2 | Example of a feedback session + reflection |
| Communication | Supportive, but rarely decisive in this role | 1 | Focus on substance, not on “presentation” |
Step 3: combine weighting with a minimum score (so that you don’t include any accidents in your calculations)
Weighting alone is not enough if a single criterion could be a deal-breaker. In that case, you want a strict minimum threshold, regardless of the overall score.
Practical examples of minimum scores:
- Safety: at least 3/5 (or fail).
- Driving licence/certificate: compulsory attendance (knock-out).
- Compatibility with shift work: explicit consent (knock-out).
This makes your selection process easier to explain and prevents someone from “scoring highly” simply because of their strong communication skills, whilst a key risk remains. It also ties in with the idea from Create a selection scorecard for hiring managers: You should set out your selection criteria before interviewing candidates.
Step 4: Prevent weighting from actually exacerbating bias
Weighting criteria can inadvertently reward the wrong qualities. In sales roles in particular, “persuasiveness” can be overemphasised, leading to a candidate who is weak on substance being ranked higher.
Four checks that prevent many problems
- Assess key criteria on the basis of evidence, not on the basis of impression. Make a record of what you note down as evidence (results, steps, choices).
- Let the interviewers carry out the scoring independently first. Only then should you discuss the differences for each criterion.
- Exclude ‘fit’ from the core weighting. When discussing fitness, translate it into observable behaviour.
- Do not change the weighting during the process. If you do decide to do that, make a note of why and apply it to all candidates.
If you find that you keep making snap judgements, it’s useful to make the team explicitly aware of this pitfall. The short post These 4 mistakes are costing you your best candidates clearly identifies that pattern and provides practical countermeasures.
Step 5: Validate your weighting using simple data from your own hiring process
You don’t need to build a complex model to find out whether your weighting is correct. Start with a brief review after 60–90 days: what does the manager say about performance, and how does that compare with the scorecard?
Look out for two signs:
- Criteria that have proved to be of little predictive value: Everyone scores highly, but performance still varies.
- Criteria that have been underestimated: It later transpired that the low score was, in fact, the reason for the dropout or the problems.
Research shows that structured assessment (such as structured interviews) is generally a better predictor than unstructured interviews. You can find an accessible explanation of the importance of structure in recruitment at The American Psychological Association on structured interviews.
Privacy and documentation: scorecards constitute recruitment data
In practice, a scorecard containing notes and scores forms part of your application file. This means you must take great care with its storage, access and retention periods.
You can find guidelines on this under the The Dutch Data Protection Authority on job application data. Make sure your team knows where scorecards are stored and who is authorised to view them.
A practical starting point: raise the issue of weighting in a single meeting
If you want to weigh things up more effectively as early as tomorrow, schedule a single 30-minute session with the hiring manager and a member of the team. Together, choose 2–3 key criteria, agree on a simple weighting system, and set minimum scores for each.
If you’d like us to look at a scorecard that’s suited to your roles (blue-collar, sales or maritime) and is actually used in practice, we can underpin this with target audience and campaign insights during a short working session. This way, you keep the scorecard simple, whilst ensuring it’s decisive.