Skip to the Scorecard

HomeResourcesQuality of Shortlist Scorecard

Score the process behind the shortlist—not the people on it.

A free, ungated diagnostic for recruitment agencies that want a clearer role brief, more relevant evidence, stronger comparison, better interviews, and a client-ready rationale.

Score My Shortlist Process See the Formula

20 statements · about 5 minutes · no account · no email gate · answers stay in this browser tab

Shortlist quality docketEqual weight
Role definitionDo the criteria trace to the work?20%
Evidence qualityIs the battery focused and comparable?20%
Comparison disciplineDo limits and trade-offs stay visible?20%
Interview verificationDoes uncertainty become a better question?20%
Client handoffCan the client inspect the rationale?20%
Transparent operating scoreNot a candidate benchmark or prediction.

Use the latest real shortlist—not the ideal process.

Choose the state that best describes how your agency handled its most recent comparable shortlist. Honest gaps make the next action more useful.

Role definition

The client brief is translated into observable outcomes and an agreed evidence plan.

0 of 4 answered
The role has 3–5 observable outcomes agreed with the client.
Every assessment is tied to a material role outcome or evidence gap.
Must-have requirements and trainable capabilities are documented separately.
The client knows how assessment evidence will influence the next step.

Evidence quality

The assessment plan is focused, comparable, accessible, and protected from avoidable noise.

0 of 4 answered
The smallest role-relevant battery is used and redundant measures are removed.
Candidates compared for the same role receive a consistent evidence process.
Purpose, timing, support, and the accommodation route are clear before assessment.
Interrupted, incomplete, or access-affected results are documented before interpretation.

Comparison discipline

Ranking follows individual review and keeps trade-offs, limits, and exceptions visible.

0 of 4 answered
Each individual result is reviewed before the ranking or comparison view is used.
Candidates are compared on role-relevant dimensions—not one total score alone.
Confidence, limitations, mixed evidence, and areas to verify remain visible.
Completion rules, ties, and justified exceptions are handled consistently.

Interview verification

Assessment evidence sharpens the interview instead of replacing it.

0 of 4 answered
Interview questions trace to strengths, risks, contradictions, or evidence gaps.
Finalists receive the same core questions and clear rating anchors.
Candidate context and explanations for conflicting evidence are recorded.
Assessment output is never used as the only basis for advancement or rejection.

Client handoff

The client receives an inspectable rationale, clear uncertainty, and one explicit next decision.

0 of 4 answered
The shortlist brief explains why each recommended candidate fits the role.
Strengths, risks, missing evidence, and interview checks appear beside the recommendation.
The recruiter reviews the output and shares it only with the intended client recipient.
The client is asked to record interview, hold, or decline with useful context.

The formula is intentionally simple and inspectable.

Each statement is worth 0–3 points. The 4 statements in each dimension produce up to 12 raw points. All 5 dimensions carry equal weight.

Process scoreround((points earned ÷ 60) × 100)

This is an operational self-assessment—not a validated psychometric instrument, candidate score, industry benchmark, or prediction of placement success.

ScoreOperating bandMeaning
0–39Fragile evidence chainImportant decisions rely on informal practice or missing controls. Start with the lowest dimension.
40–59Inconsistent processUseful elements exist, but quality changes by recruiter, role, or client.
60–79Defensible with gapsThe evidence chain is visible, with specific controls still needing consistency.
80–100Well-controlled processThe workflow is documented and repeatable. Keep reviewing exceptions and outcomes.

Turn the result into one process change.

The score matters less than the conversation it starts. Pick the lowest dimension, agree one repeatable control, and run the scorecard again after 3–5 comparable projects.

  1. Review togetherRecruiter, team lead, and client owner compare where their ratings differ.
  2. Choose one controlFix the root practice in the lowest dimension instead of chasing the overall number.
  3. Document the changeName the owner, the project where it starts, and the evidence that will show it happened.
  4. Re-run deliberatelyCompare the process after several similar projects—not after one unusually easy role.

Questions about the shortlist score.

The scorecard evaluates agency operating practice. It never evaluates a candidate or replaces human review.

Review the Decision Boundary
What does “quality of shortlist” mean here?

It means the quality of the evidence process used to define the role, choose assessments, compare candidates, verify uncertainty, and explain the recommendation to the client. It does not mean the average candidate score.

Is this an industry benchmark?

No. The bands are practical operating descriptions created for this self-assessment. They are not based on a representative agency dataset and should not be presented as a market percentile, scientific norm, or prediction.

How is the score calculated?

Each of 20 statements receives 0–3 points. The points earned are divided by the 60-point maximum, multiplied by 100, and rounded to the nearest whole number. Each of the 5 dimensions therefore contributes 20%.

Are my answers stored or submitted?

No. The calculator runs in this browser tab and does not submit or save the answers. Reloading or leaving the page clears the result unless you print it first.

What should we do with a low score?

Start with the lowest dimension, discuss why the practice is inconsistent, and choose one documented control for the next comparable projects. Re-run the scorecard after the new practice has had time to operate.

Strengthen the evidence chain on one live role.

Create an agency account, choose a focused assessment plan, compare candidates in context, and prepare the client conversation from evidence people can inspect.