Cross-functional · Playbook 59

Recruitment screening: doing it safely

Recruiters see the evidence for each job criterion in every application, faster and more consistently. No candidate is rejected by a machine, no protected characteristic is guessed, and outcomes are tested for bias before and during use.

  • Predictive ML
  • Human in the loop
  • Equality Act 2010
  • UK GDPR
  • ICO
  • EU AI Act (EU hiring only)

At a glance

The problem
Thousands of applications per campaign, read under time pressure, inconsistently, with no record of why people were turned down
Typical volume
Around 60,000 applications a year across 900 vacancies, with peaks for the graduate scheme and seasonal roles
Who's involved
Talent acquisition, hiring managers, HR, diversity and inclusion, data protection, legal, IT
Pilot
10–12 weeks after a 4-week discovery, including bias testing before any live use
Platforms
AWS, Azure, or a sovereign or on-prem stack

An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.

The business problem

A graduate scheme opens and 8,000 applications arrive in three weeks. Recruiters skim each CV for a minute or two. Some are read carefully in the morning and others in a hurry at six in the evening. Two recruiters reading the same CV often reach different views, and the reasons for a rejection are rarely written down. Good candidates are lost, and nobody can show whether the process treats everyone fairly.

Screening tools promise to fix this, and some make it worse. The ICO's audits of AI recruitment tools, reported in November 2024, found features that could filter out candidates by protected characteristic, tools that inferred gender from a candidate's name, and tools that collected far more data than they needed and kept it indefinitely. Models trained on who was hired in the past learn the past's biases. Video tools that claim to read emotion or personality from a face or voice rest on contested science, and in the EU, using AI to infer emotions at work is now banned.

The rules leave little room for shortcuts. The Equality Act 2010 applies to the arrangements an employer makes for deciding who to offer a job, including any tool it buys. Since 5 February 2026, automated decisions about people are allowed only with safeguards, and the ICO's March 2026 report found that many employers who thought they were using decision support were in fact making solely automated decisions. Candidates are entitled to be told about automated decisions and to contest them, and the employer has to be able to explain each outcome.

What AI changes

  • For each application, the assistant finds the evidence against each published job criterion and quotes it, so the recruiter reads a structured summary with the source text beside it.
  • Names, photos, addresses, dates of birth and other details that could reveal a protected characteristic are hidden from the assistant and, where you choose, from the first reviewer too.
  • A person decides every shortlist and every rejection, with the reason recorded against the criteria. There is no score that rejects anyone, and no ranking trained on past hires.
  • Outcomes are tested for bias before go-live and monitored at every stage afterwards, using equality data candidates chose to give, held separately and never seen by the assistant or the recruiter.
  • Candidates are told how AI is used, can ask for a person to review their application, and can ask for adjustments, such as a different format or a conversation instead of an online test.
  • What it doesn't do: no video, voice, face or emotion analysis; no guessing of age, sex, ethnicity, disability or any other protected characteristic; no social media scraping; no automatic rejections.

How success is measured

Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.

Selection rates by group

Pass rate at each stage, compared across groups using equality data candidates gave voluntarily. Any gap is investigated before the tool is used again.

ExampleNo unexplained gap, reviewed every campaign

Recruiter agreement

How often recruiters agree with the evidence summary. Near 100% can mean they've stopped reading.

ExampleStable, with a sample re-read blind each week

Recruiter time per application

Time to reach a decision with the evidence summary, against the baseline.

ExampleDown by around a third

Human review requests

How many candidates asked for a person to review, how quickly they were answered, and how often the outcome changed.

ExampleAnswered within 10 working days

Adjustment requests met

Reasonable adjustment requests met before the candidate's next stage.

ExampleEvery request

Rejection reasons recorded

Share of rejections with a reason written against the published criteria.

ExampleEvery rejection

UK regulation and controls

Cross-sector rules are on the UK regulation map.

  • EHRCEquality Act 2010: discrimination in recruitment

    The employer is liable for the arrangements it uses to decide who gets a job, including a supplier's tool. A criterion or model that puts a group at a disadvantage is indirect discrimination unless it can be objectively justified. So every criterion is tied to the job, the tool is tested for adverse impact before use and monitored afterwards, and protected characteristics are never inferred.

  • EHRCEquality Act 2010: reasonable adjustments, and health questions before an offer

    Disabled candidates are entitled to reasonable adjustments at every stage, including to any automated step. Section 60 limits questions about health before a job offer. Adjustment requests go to a recruiter, never to the model, and health information never enters screening.

  • ICOUK GDPR Articles 22A to 22D (Data (Use and Access) Act 2025, in force 5 February 2026)

    Rejecting a candidate is usually a significant decision. Solely automated decisions are now allowed with safeguards, but where special category data is involved, such as health or ethnicity, the strict limit remains. This design goes further than the law requires: a person with real authority makes every reject decision, and candidates can still make representations, contest the outcome and reach a person.

  • ICOAI tools in recruitment: audit outcomes report (November 2024)

    The ICO's recommendations: monitor for bias and accuracy, using real rather than inferred equality data; tell candidates how AI is used; collect the minimum data and keep it for a set period; do a DPIA early, ideally before procurement; agree controller and processor roles in a contract with written instructions; and state the lawful basis. The procurement questions it published are a good checklist for any supplier.

  • ICORecruitment rewired (March 2026) and draft automated decision-making guidance

    The ICO found many employers using what they called decision support were making solely automated decisions, because the human review was token. A reviewer must understand the tool's output and limits and be able to change the outcome. The ICO also warned that consent and contract are unlikely to be the right lawful basis for most recruitment processing.

  • Government guidanceResponsible AI in recruitment (DSIT, March 2024)

    Government guidance, written with input from the ICO and EHRC, on assurance before buying, during a pilot and in live use: impact assessments, bias audits, accessibility and adjustments, and performance testing. Use it as the plan for the pilot gate.

  • European CommissionEU AI Act: recruitment as a high-risk use (only if you hire in the EU)

    Screening and evaluating candidates is listed in Annex III, with high-risk duties from 2 December 2027 under the Digital Omnibus. Emotion recognition in the workplace has been prohibited since February 2025. Neither applies to UK-only hiring, but a design that already meets them travels well.

The solution

Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.

Recruitment screening: doing it safely: reference architecture
  1. 01Channels

    • Careers site
    • Job boards and agencies
    • Candidate request for review
  2. 02Intake

    • API GatewayAPI ManagementKong, or your existing API gatewayApplications from the applicant tracking system
    • Amazon Comprehend PII detectionAzure Language in Foundry ToolsOpen-source PII detection (e.g. Presidio)Hide identifying details
    • Equality monitoring data: kept apart
  3. 03Intelligence

    • Amazon BedrockMicrosoft FoundryOpen-weight models via vLLMEvidence against criteria
    • SageMaker AI + FairlearnAzure Machine Learning + FairlearnMLflow and Fairlearn on KubernetesAdverse impact testing
    • Agent
      Bedrock AgentCoreFoundry Agent ServiceLangGraph on KubernetesScreening assistant
  4. 04Orchestration

    • Step FunctionsLogic Apps / Durable FunctionsTemporal, or n8nScreening workflow
    • EventBridge + SQSEvent Grid + Service BusApache Kafka or RabbitMQEvents and queues
  5. 05Systems of record

    • Your applicant tracking system
    • Your HR system
  6. 06People

    • Person
      Recruiter decides shortlist or reject
    • Person
      Hiring manager
    • Person
      Fairness reviewer and DPO
  • Cloud or platform service (AWSAzuresovereign / on-prem)
  • AI agent
  • A person decides
  • Your existing systems
  • Outside your organisation

Components, side by side

Recruitment screening: doing it safely: components on AWS, Azure and a sovereign or on-prem stack
LayerAWSAzureSovereign / on-prem
Link to the applicant tracking systemThe applicant tracking system stays the record. Decisions are made and stored there, not in the AI layer.API Gateway, EventBridge, plus your existing integration platform if you have oneAPI Management, Event Grid, plus your existing integration platform if you have oneKong, Kafka, plus your existing integration platform if you have one
Hiding identifying detailsNames, photos, addresses, dates of birth, and clues such as graduation years or school names where they act as a proxy for age.Amazon Comprehend PII detection, plus your own rulesAzure Language in Foundry Tools (PII detection), plus your own rulesOpen-source PII detection (e.g. Presidio)
Evidence against criteriaBoth clouds offer a choice of models, including Claude. The output is quoted evidence per criterion, not a score or a ranking.Amazon BedrockMicrosoft FoundryOpen-weight models served with vLLM on your own GPUs, or IONOS AI Model Hub
Agent runtimeThe original Bedrock Agents closed to new customers on 30 July 2026; new builds use AgentCore.Amazon Bedrock AgentCoreFoundry Agent ServiceAn open-source agent framework (e.g. LangGraph) on Kubernetes
Adverse impact testing and monitoringSageMaker Clarify closed to new customers on 30 July 2026. Use real equality data candidates gave, not inferred data.Amazon SageMaker AI with Fairlearn (open source)Azure Machine Learning with Fairlearn (open source)MLflow and Fairlearn on Kubernetes
Equality monitoring dataOnly the fairness reviewer can join it to outcomes, and only in aggregate.A separate, access-restricted store (S3 with its own KMS key)A separate, access-restricted store (Blob Storage with its own Key Vault key)A separate, access-restricted store (Ceph or IONOS S3 Object Storage) with its own keys
GuardrailsBlock output that comments on age, health, family, nationality or other protected characteristics.Bedrock GuardrailsFoundry guardrails (Azure AI Content Safety)Open-source guardrails (e.g. NeMo Guardrails, Llama Guard)
Video and assessmentsIf you record interviews, people watch them. Test any online assessment for adverse impact and offer an alternative.No face, voice or emotion analysisNo face, voice or emotion analysisNo face, voice or emotion analysis
WorkflowThe rule that only a person can reject sits here, not in a prompt.AWS Step FunctionsLogic Apps or Durable FunctionsTemporal, or n8n
Identity, keys, data protectionIAM Identity Center, KMS, MacieEntra ID, Key Vault, PurviewKeycloak or your existing Active Directory; OpenBao or HashiCorp Vault; an HSM
Monitoring and auditLog the evidence shown, who decided, the decision and the reason, for every application.CloudWatch, CloudTrailAzure Monitor, Log AnalyticsPrometheus, Grafana, OpenTelemetry
UK data residencyIONOS AI Model Hub runs in German data centres: EU, not UK, residency.eu-west-2 (London)UK South / UK WestYour own UK data centre, or a UK or EU provider

On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →

Hybrid and on-prem

Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.

Stays on-prem

The applicant tracking system, the HR system and the equality monitoring data stay where they are. If your monitoring data is held on your own servers today, it can stay there, with the fairness tests run beside it.

Uses cloud AI

Hiding identifying details and finding evidence against criteria can run in a UK cloud region, or on your own GPUs with open-weight models if candidate data must not leave your estate. Only the redacted application and the criteria are sent.

How they connect

A private link (AWS Direct Connect or Azure ExpressRoute) and your API layer. Evidence summaries come back as events and are attached to the application in the applicant tracking system.

If the link drops

Recruiters screen exactly as they do today, in the applicant tracking system. Applications are marked as not yet summarised, and nothing is rejected or delayed by default.

The agents

What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.

Screening assistant

May do

  • Read the redacted application and the published job criteria
  • Quote the evidence it finds for each criterion, and say where it found none
  • Note where an application needs a closer look, such as a career break or an overseas qualification
  • Attach its summary to the application in the applicant tracking system

May not do

  • Reject, shortlist, rank or score a candidate
  • See names, photos, contact details, dates of birth or equality monitoring data
  • Infer or comment on any protected characteristic
  • Read social media or search the web for a candidate
  • Analyse video, voice or faces
  • Contact a candidate

Where a person signs offA recruiter decides every shortlist and every rejection, reads the source as well as the summary, and records the reason against the criteria. Candidate requests for review go to a different recruiter. Permissions are enforced by the platform's identity and policy controls, not by instructions in a prompt.

Middleware and integration

The applicant tracking system stays the record of every application and decision. The AI layer receives redacted applications through an API, adds a summary, and never writes a status. Rejection is an action only a recruiter's account can take.

Equality monitoring data flows on its own path, into a separate store with its own keys. The fairness tests join it to stage outcomes in aggregate, after decisions are made. It is never available to the assistant, the recruiter or the hiring manager.

If the AI is paused, recruitment carries on in the applicant tracking system as it does today. Switching it off is a single setting, and it should be used the moment a bias test fails.

Process and people

  • Job criteria written for each role before advertising, tied to the job, checked for indirect discrimination, and published to candidates.
  • A bias test on past, anonymised applications before go-live, then adverse impact monitoring at every stage of every campaign, reviewed by a named fairness reviewer.
  • A stop rule agreed in advance: if a gap appears that can't be explained, the assistant is paused for that role until it is understood.
  • A clear notice to candidates on how AI is used, how to ask for a person, and how to ask for adjustments, written in plain English.
  • Recruiters trained before go-live on what the assistant can't see, with a weekly blind re-read of a sample to keep the review real.
  • A DPIA before procurement, a contract with the supplier setting out roles, data, retention and bias targets, and a retention period for applications.

Delivery plan

  1. 4 weeks

    Discovery

    Map today's screening, measure the baseline and current selection rates by group, write the criteria for the pilot roles, and complete the DPIA and equality impact assessment.

  2. Gate · must be true to passDPIA and equality impact assessment signed off, criteria agreed, legal and DPO involved, candidate notice drafted.

  3. 3–4 weeks

    Bias testing

    Run the assistant on last year's anonymised applications for the pilot roles and compare evidence summaries with blind human reads, by group.

  4. Gate · must be true to passNo unexplained adverse impact, and the fairness reviewer and DPO sign off.

  5. 6–8 weeks

    Pilot

    One campaign, such as seasonal roles, with recruiters using the summaries and deciding every application, plus a blind sample re-read.

  6. Gate · must be true to passSelection rates stable by group, review requests answered on time, and recruiters trust and check the summaries.

  7. Ongoing

    Scale

    Add roles and campaigns one at a time, each with its own criteria and bias test.

  8. Gate · must be true to passEach new role family passes the same bias-testing gate.

Roles and RACI

Who is responsible, accountable, consulted and informed, by activity
ActivityHead of talent acquisitionHR directorD&I leadSolutions architectI can fill thisTechnical PMI can fill thisEngineersI can fill thisDPO & legalSecurityI can fill this
Business case and benefitsResponsibleAccountableConsultedConsultedConsultedInformedConsultedInformed
Job criteria and candidate noticeResponsibleAccountableConsultedInformedInformedInformedConsultedInformed
DPIA and equality impact assessmentConsultedAccountableResponsibleConsultedInformedInformedResponsibleConsulted
Target architectureConsultedInformedConsultedAccountable and ResponsibleConsultedConsultedConsultedConsulted
Bias testing and monitoringConsultedAccountableResponsibleConsultedConsultedResponsibleConsultedInformed
Build and integrationInformedInformedInformedAccountableResponsibleResponsibleInformedConsulted
Go-live and stop decisionsResponsibleAccountableConsultedConsultedResponsibleInformedConsultedConsulted

Business case and benefits

Head of talent acquisition
R · Responsible
HR director
A · Accountable
D&I lead
C · Consulted
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
I · Informed
DPO & legal
C · Consulted
Security
I · Informed

Job criteria and candidate notice

Head of talent acquisition
R · Responsible
HR director
A · Accountable
D&I lead
C · Consulted
Solutions architect
I · Informed
Technical PM
I · Informed
Engineers
I · Informed
DPO & legal
C · Consulted
Security
I · Informed

DPIA and equality impact assessment

Head of talent acquisition
C · Consulted
HR director
A · Accountable
D&I lead
R · Responsible
Solutions architect
C · Consulted
Technical PM
I · Informed
Engineers
I · Informed
DPO & legal
R · Responsible
Security
C · Consulted

Target architecture

Head of talent acquisition
C · Consulted
HR director
I · Informed
D&I lead
C · Consulted
Solutions architect
A/R · Accountable and Responsible
Technical PM
C · Consulted
Engineers
C · Consulted
DPO & legal
C · Consulted
Security
C · Consulted

Bias testing and monitoring

Head of talent acquisition
C · Consulted
HR director
A · Accountable
D&I lead
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
DPO & legal
C · Consulted
Security
I · Informed

Build and integration

Head of talent acquisition
I · Informed
HR director
I · Informed
D&I lead
I · Informed
Solutions architect
A · Accountable
Technical PM
R · Responsible
Engineers
R · Responsible
DPO & legal
I · Informed
Security
C · Consulted

Go-live and stop decisions

Head of talent acquisition
R · Responsible
HR director
A · Accountable
D&I lead
C · Consulted
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
DPO & legal
C · Consulted
Security
C · Consulted

R ResponsibleA AccountableC ConsultedI Informed· not involved

Where I'd fit

Option A

Lead the architecture

If there's no architect on the programme, I'd own the design end to end: the integration with your applicant tracking system, the redaction, the separate path for equality data, the bias testing and the gates. I'd report to your programme board, and I'd say plainly which parts of screening shouldn't be automated at all.

Option B

Support your architect

If your partner or your own team already has an architect, I'd take on the redaction, the evidence summaries and the fairness monitoring under their lead, and give them a second senior opinion on the rest, especially data protection and the supplier's claims.

Where this goes wrong

  1. Goes wrong

    A model trained on past hires learns who used to be hired, and repeats it.

    How the design avoids it

    No ranking trained on past decisions. Evidence against criteria written for the job, and adverse impact tested before use.

  2. Goes wrong

    Recruiters approve the AI's view in seconds, so a 'human in the loop' is really a rubber stamp.

    How the design avoids it

    No score or verdict to approve, reasons recorded against criteria, and a weekly blind re-read of a sample.

  3. Goes wrong

    Proxies slip through: a graduation year, a postcode, a gap for caring, a name in an email address.

    How the design avoids it

    Redaction rules tested on real applications, and output guardrails that block comment on protected characteristics.

  4. Goes wrong

    The supplier's tool offers video or personality scoring, and someone switches it on.

    How the design avoids it

    Contract terms and configuration that rule it out, and a DPIA that names what's off.

  5. Goes wrong

    Bias is checked once at launch and never again.

    How the design avoids it

    Monitoring at every stage of every campaign, with a stop rule agreed in advance.

On the horizon

Changes already announced or under way that affect this design. More in the UK horizon scan.

  1. Late 2026 to 2027 (expected)
    The ICO's final guidance on automated decision-making, consulted on from 31 March to 29 May 2026, and its statutory code of practice on AI and automated decisions.

    Design against the draft now: meaningful human involvement, information for candidates, and a route to contest every decision.

  2. April 2027
    Employment Rights Act 2025: extended blacklisting protections, including lists compiled by third parties and lists produced with predictive technology.

    Make sure no screening data, model or supplier list carries trade union membership or activity, which is special category data anyway.

  3. 2 December 2027
    EU AI Act: Annex III high-risk duties begin, including for recruitment and selection, under the Digital Omnibus. Only relevant if you hire in the EU.

    If you hire in the EU, work out whether you're provider or deployer, and plan human oversight, logging and documentation now.

  4. Awaited
    The government's response to its 2026 consultation on workplace monitoring technologies.

    Keep monitoring data out of hiring and promotion decisions, so any new rules don't reach into screening.

Questions to ask your partner or vendor

Good answers are specific. Vague answers to any of these are worth following up.

Copy them into your next supplier meeting

  1. Does any part of the tool reject, rank or score candidates, and can that be switched off in the contract?
  2. Was the model trained on past hiring decisions, and whose?
  3. How do you test for adverse impact without guessing anyone's ethnicity, sex or age?
  4. What does a recruiter see, and how do we know they're really reviewing it?
  5. How does a candidate ask for a person, and how quickly do they get an answer?
  6. Where is candidate data processed, how long is it kept, and is it used to train anyone's model?

Planning something like this?

Whether you need someone to lead the design or to support the architect you already have, let's talk it through.

Sam Naseem
Sam NaseemBirmingham, UK · UK & Europe
Available now