# Designing Candidate Scorecards: practice workbook
Talent Engineering Academy | An education initiative by Vitae
Edition 2026.09 | Updated 2026-09-24
Course: https://talentengineering.org/courses/candidate-scorecards

Translate role outcomes into observable criteria, anchored ratings and defensible decision rules.

## Your deliverable
A scorecard with behavioural anchors and a calibration example.

Use fictional information. Keep your completed work in your own secure notes. Exercises and capstone work are self-directed, not independently assessed.

## 1. Outcome and criterion

Your notes:



## 2. Evidence collection method

Your notes:



## 3. Low, adequate and strong anchors

Your notes:



## 4. Missing evidence treatment

Your notes:



## 5. Essential thresholds and weighting rationale

Your notes:



## 6. Independent ratings and calibration notes

Your notes:



## Lesson exercises

### 1. Choose criteria that explain the work

Create five criteria for a fictional role and map each to an outcome and assessment method.

Your response:


Worked example: A quality-lead scorecard uses incident analysis, corrective-action leadership and stakeholder communication. It removes both executive presence and gravitas because neither has a clear, independently assessable definition tied to the role.

Self-review guidance: Check for duplicate constructs and unsupported personality labels. Every criterion should have an evidence route. Remove criteria that the process cannot meaningfully assess.

### 2. Write anchors before seeing candidates

Write three anchors and a missing-evidence rule for two criteria.

Your response:


Worked example: For incident analysis, adequate evidence identifies a plausible cause, checks it against data and proposes a verified corrective action. Strong evidence additionally addresses alternative explanations and recurrence monitoring.

Self-review guidance: A second assessor should be able to explain why an example falls in one band. If the only distinction is more impressive wording, rewrite the anchor around the work demonstrated.

### 3. Use weights and thresholds carefully

Compare two fictional candidates under equal and weighted criteria, then test sensitivity.

Your response:


Worked example: A candidate scores highly on presentation but cannot demonstrate a required safety-critical competence. A weighted average cannot legitimately hide the unmet essential requirement. The panel identifies the evidence gap and determines the appropriate next step.

Self-review guidance: Show whether the ranking changes and why. Keep essential thresholds visible outside the total. If a small arbitrary weight change determines the outcome, seek better evidence rather than overstating precision.

### 4. Calibrate raters and document the decision

Score two fictional responses, write a disagreement note and revise one anchor.

Your response:


Worked example: Two assessors give the same answer scores of two and four. One rewards fluent delivery; the other rewards the actual diagnostic steps. Calibration clarifies that fluency is not part of the incident-analysis criterion.

Self-review guidance: The revision should explain the source of disagreement and improve future interpretation. Preserve the distinction between evidence quality and presentation style unless communication is explicitly being assessed.

## Portfolio review
Check that your work is internally consistent, distinguishes facts from assumptions, names decision owners and explains its limitations. Revise gaps before using the method in real work.

## Further reading
- [CIPD: Selection methods](https://www.cipd.org/uk/knowledge/factsheets/selection-factsheet/): Professional context for selection methods and their limitations.
- [GOV.UK: Discrimination in recruitment](https://www.gov.uk/employer-preventing-discrimination/recruitment): UK legal context. Obtain advice for your jurisdiction and circumstances.

Original educational scenarios. References provide further reading and do not imply endorsement. Check current official rules and appropriate professional advice for real legal, financial or regulated decisions.