Financial services · Playbook 06

I've worked in this sector

Spotting vulnerable customers

Possible signs of vulnerability noticed the first time a customer mentions them, a trained person offered the right support, and outcomes checked so no group of customers is left worse off.

  • Retrieval (RAG)
  • Predictive ML
  • Speech and voice
  • Human in the loop
  • FCA FG21/1
  • FCA Consumer Duty
  • FCA and ICO joint statement
  • UK GDPR
  • Equality Act 2010

At a glance

The problem
Customers mention a bereavement, an illness or money worries, and the next colleague they speak to never hears about it
Typical volume
Around 40,000 calls, chats and emails a week, and a small share of them carry a possible sign of vulnerability
Who's involved
Customer operations, the specialist support team, collections, vulnerability champions, compliance, the DPO, IT
Pilot
8–10 weeks in one contact centre team, after a 3–4 week discovery
Platforms
AWS, Azure, or a sovereign or on-prem stack

An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.

The business problem

A customer calls about a missed loan payment and mentions, almost in passing, that her husband died last month. A small-business owner writes that he's been in hospital and couldn't get to the post. An older customer's account starts sending money to a new payee every day. Each is a possible sign that someone needs more help, and each is easy to miss in a busy queue.

In a typical mid-sized lender, what happens next depends on who picked up. A colleague who has had the training may note it, ask what would help, and refer the customer to the specialist team. Another may not notice, or may note it in free text that no one reads again. The customer has to explain it again on the next call, and may be chased by collections in the meantime.

The FCA's 2025 review found that most customers with characteristics of vulnerability had not told their provider, and that firms struggled to monitor outcomes for them. Its 2026 reviews found firms focused on identifying vulnerable customers without showing how they then met their needs, and with little evidence of how outcomes differ between groups. Spotting signs is only worth doing if it leads to better support and the firm can show it.

What AI changes

  • Calls, chats and emails are read for possible signs of vulnerability across the four FCA drivers: health, life events, resilience and capability. Each flag shows the customer's own words, so the colleague can see why.
  • A trained colleague, not the AI, talks to the customer, asks what would help, and records the need only if the customer agrees.
  • Agreed needs, such as 'prefers email', 'needs more time' or 'a named contact', follow the customer to every channel, so they don't have to explain again.
  • Account activity that suggests financial difficulty or possible financial abuse is flagged to the specialist team, which decides what to do.
  • Unconfirmed flags expire. A possible sign is never kept as a label on someone's file just because a model saw it.
  • Outcomes are monitored by customer group: complaints, arrears outcomes, repeat contacts and how long support took, so the firm can show the Consumer Duty is working for vulnerable customers.

How success is measured

Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.

Time to support

Days from the first sign in a conversation to a trained colleague offering support.

ExampleFrom weeks to within 2 working days

Flags confirmed by a person

The share of AI flags a trained colleague agrees were worth raising. Too low wastes their time; too high may mean signs are being missed.

ExampleReviewed weekly, tuned with the specialist team

Needs recorded with consent

Needs recorded with the customer's agreement and a reason, against free-text notes nobody acts on.

ExampleEvery recorded need

Repeat explanations

Customers who have to tell the firm about their circumstances again.

ExampleDown by half

Outcomes gap

Complaints, arrears outcomes and satisfaction for customers with recorded needs, compared with everyone else.

ExampleGap closing, no group worse off

Intrusion complaints

Customers who feel the firm knew too much or asked too much, and requests to remove a record.

ExampleTracked from day one, investigated every time

UK regulation and controls

Cross-sector rules are on the UK regulation map.

  • FCAFG21/1: guidance on the fair treatment of vulnerable customers

    The FCA's 2025 review kept FG21/1 unchanged under the Consumer Duty. The design follows it: understand the drivers of vulnerability, give staff the skills to respond, and record needs so they can be met consistently. The AI supports colleagues; it doesn't replace the conversation.

  • FCAConsumer Duty (PRIN 2A) and outcomes monitoring

    Firms must show that customers with characteristics of vulnerability get outcomes as good as other customers. The FCA's July 2026 outcomes monitoring review noted firms using risk indicators and AI to help spot vulnerability, and also limited evidence on how outcomes differ by group. Monitoring by group is built in from the pilot, and feeds the annual board report.

  • FCA and ICOJoint statement on vulnerability-related data (27 March 2026)

    Data protection doesn't stop firms supporting vulnerable customers, but they need a clear Article 6 basis and, for health data, an Article 9 condition: explicit consent, or a substantial public interest condition such as safeguarding individuals at risk or their economic well-being. The DPO chooses the conditions per purpose, and the design records which one applies to each need.

  • ICOUK GDPR special category data and the Data Protection Act 2018

    A model inferring a health condition is processing health data. So the AI flags possible signs for a person to explore, unconfirmed flags expire, and only needs the customer agrees to are recorded. A DPIA before the pilot, UK processing, short retention for transcripts, and contracts that stop providers training on your data.

  • ICOEmotion analysis

    The ICO has warned that emotion analysis technology is immature and risks bias and discrimination. This design reads what customers say, not how they sound. Voice stress, emotion and sentiment scoring stay switched off.

  • ICOAutomated decisions (UK GDPR, as amended by the Data (Use and Access) Act 2025)

    Because health data is involved, the strict limit on solely automated significant decisions applies. Nothing here makes one: no treatment, fee, limit, collections or product decision is ever made by the AI.

  • EHRCEquality Act 2010

    Many recorded needs are reasonable adjustments for disabled customers. They must be acted on reliably across every channel. The models are also tested so that accent, age or writing style don't change who gets flagged.

The solution

Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.

Spotting vulnerable customers: reference architecture
  1. 01Channels

    • Phone calls
    • Chat and secure messages
    • Emails and letters
    • Bereavement and power of attorney notices
  2. 02Intake

    • Amazon TranscribeAzure Speech in Foundry ToolsOpen-weight speech models (e.g. Whisper)Call transcription
    • API Gateway, Amazon SESAPI Management, Logic Apps email connectorKong, your existing mail serverMessages and emails
    • EventBridgeEvent GridApache KafkaAccount events
  3. 03Intelligence

    • Amazon BedrockMicrosoft FoundryOpen-weight models via vLLMSpot possible signs in text
    • SageMaker AIAzure Machine LearningMLflow and Kubeflow on KubernetesAccount activity signals
    • Bedrock Knowledge BasesFoundry IQ (Azure AI Search)OpenSearch, or PostgreSQL with pgvectorSupport options knowledge
    • Agent
      Bedrock AgentCoreFoundry Agent ServiceLangGraph on Kubernetes, with open-weight models via vLLMReferral agent
  4. 04Orchestration

    • Step FunctionsLogic Apps / Durable FunctionsTemporalReferral workflow
    • EventBridge + SQSEvent Grid + Service BusApache Kafka or RabbitMQEvents and queues
  5. 05Systems of record

    • CRM with the customer's recorded needs
    • Contact centre and call recording
    • Core banking and lending
    • Collections and arrears
  6. 06People

    • Person
      Front-line colleague: asks and records
    • Person
      Specialist support team
    • Person
      Vulnerability outcomes forum
  • Cloud or platform service (AWSAzuresovereign / on-prem)
  • AI agent
  • A person decides
  • Your existing systems
  • Outside your organisation

Components, side by side

Spotting vulnerable customers: components on AWS, Azure and a sovereign or on-prem stack
LayerAWSAzureSovereign / on-prem
Call transcriptionTranscribe the words only. Leave voice emotion, stress and sentiment features off.Amazon TranscribeAzure Speech in Foundry ToolsOpen-weight speech models (e.g. Whisper)
Messages and emailsAPI Gateway, Amazon SESAPI Management, Logic Apps connectorsKong or your existing API gateway; your mail server
Spotting possible signs in textEvery flag quotes the customer's words and names the FG21/1 driver. AWS and Azure both offer a choice of models, including Claude.Amazon BedrockMicrosoft FoundryOpen-weight models served with vLLM on your own GPUs, or IONOS AI Model Hub
Account activity signalsLimited to signs of financial difficulty and possible financial abuse. Never infer health or addiction from spending.SageMaker AIAzure Machine LearningMLflow and Kubeflow on Kubernetes
Support options knowledge (retrieval)Your approved support options, forbearance policy and referral partners, versioned, so suggestions match current policy.Bedrock Knowledge BasesFoundry IQ, built on Azure AI SearchOpenSearch, or PostgreSQL with pgvector
Agent runtimeThe original Bedrock Agents closed to new customers on 30 July 2026; new builds use AgentCore.Amazon Bedrock AgentCoreFoundry Agent ServiceAn open-source agent framework (e.g. LangGraph) on Kubernetes
Workflow and eventsStep Functions, EventBridge, SQSLogic Apps or Durable Functions, Event Grid, Service BusTemporal or n8n; Apache Kafka or RabbitMQ
Needs recordStructured needs, the customer's consent, the lawful condition and a review date. Not a 'vulnerable' label.In your existing CRMIn your existing CRMIn your existing CRM
Human reviewColleagues see flags where they already work, not in a new screen.In colleagues' existing desktop and the specialist team's case toolIn colleagues' existing desktop and the specialist team's case toolIn colleagues' existing desktop and the specialist team's case tool
Outcomes monitoringOutcomes by group, using data you already hold. SageMaker Model Monitor and Clarify closed to new customers on 30 July 2026, so fairness and drift checks run as your own pipeline jobs.Amazon Athena, plus your BI toolMicrosoft Fabric, Power BIPostgreSQL or Trino, plus Apache Superset or Grafana
GuardrailsBlock diagnoses, labels and judgemental wording in anything the AI drafts.Bedrock GuardrailsFoundry guardrails (Azure AI Content Safety)Open-source guardrails (e.g. NeMo Guardrails, Llama Guard)
Identity, keys, data protectionNeed-to-know access: front-line colleagues see the need, not the history behind it.IAM Identity Center, KMS, MacieEntra ID, Key Vault, PurviewKeycloak or your existing Active Directory; OpenBao or HashiCorp Vault; an HSM
Monitoring and auditLog every flag, who saw it, what they decided and why.CloudWatch, CloudTrailAzure Monitor, Log AnalyticsPrometheus, Grafana, OpenTelemetry
UK data residencyIONOS AI Model Hub runs in German data centres: EU, not UK, residency.eu-west-2 (London)UK South / UK WestYour own UK data centre, or a UK or EU provider

On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →

Hybrid and on-prem

Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.

Stays on-prem

The CRM, core banking, collections and the call recording archive stay where they are. The recording of record never leaves your recording platform.

Uses cloud AI

Transcription, spotting signs in text, the account model and the referral agent can run in AWS or Azure UK regions, or on your own GPUs with open-weight models if conversation data must not leave your estate.

How they connect

A private link (AWS Direct Connect or Azure ExpressRoute) and the API layer. Audio is sent for transcription and not kept on the cloud side; only flags and drafts come back, as events.

If the link drops

Colleagues keep spotting and recording needs as they do today, and agreed needs are still shown from the CRM. Conversations from the outage are checked when the link returns.

The agents

What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.

Referral agent

May do

  • Collect the possible signs for one customer, with quotes and sources
  • Suggest support options from the approved knowledge base
  • Draft a needs record for the colleague to check with the customer
  • Create a referral task for the specialist team
  • Add a short-lived prompt for the next colleague who speaks to the customer, which expires unless confirmed

May not do

  • Record a need on the customer's file without a colleague confirming the customer agreed
  • Label a customer as vulnerable or name a condition
  • Change fees, limits, products, payment plans or collections activity
  • Restrict, freeze or close an account
  • Contact the customer or share anything with a third party

Where a person signs offA trained colleague speaks to the customer and records every need. The specialist team decides every change in treatment, including forbearance and pausing collections, and every concern about possible financial abuse. The agent's permissions are enforced by the platform's identity and policy controls, not by instructions in a prompt.

Middleware and integration

The CRM, the contact centre platform, core banking and collections are reached only through the API layer. If you already run an integration platform, the agent uses it like any other system does.

Conversations and account activity become events. If the CRM or the specialist team's case tool is down, referrals wait safely on the queue, and a retry never creates a duplicate referral.

A recorded need is published as an event, so collections, the contact centre and the app all see it at once, rather than each keeping its own copy.

The AI can be switched off without stopping support. If it's paused, colleagues spot and record needs exactly as they do today.

Process and people

  • A specialist support team that owns every referral, with enough people for the volume the pilot shows, before the AI is switched on.
  • Clear wording for colleagues: how to ask about a possible need, how to ask for consent, and how to take no for an answer.
  • Lived-experience and charity input on the wording and the support options, during discovery, not after launch.
  • A weekly review of a sample of flags, including the ones colleagues rejected, and a monthly fairness check across age, accent and channel.
  • A vulnerability outcomes forum with the authority to change products and processes when the data shows a gap.
  • A named owner for every prompt, model and support policy, with change control, and the DPO signing off any new data source.

Delivery plan

  1. 3–4 weeks

    Discovery

    Map how needs are spotted and recorded today, measure the baseline, agree the lawful conditions with the DPO, and test the wording with customers and colleagues.

  2. Gate · must be true to passBaseline agreed, DPIA started, conditions for processing chosen, specialist team capacity confirmed.

  3. 6–8 weeks

    Pilot

    One contact centre team, in shadow mode: flags go to the specialist team for review only, and are compared with what colleagues spotted.

  4. Gate · must be true to passConfirmed-flag rate within agreed limits, no group over- or under-flagged, wording signed off, DPO and compliance sign-off.

  5. 4–6 weeks

    Production

    Flags go live to that team's colleagues, with monitoring, support and a rollback plan.

  6. Gate · must be true to passMonitoring, outcomes reporting, training and rollback plan in place.

  7. Ongoing

    Scale

    Add channels and teams one at a time, then account activity signals and collections.

  8. Gate · must be true to passEach new channel or signal passes the same pilot gate, including the fairness check.

Roles and RACI

Who is responsible, accountable, consulted and informed, by activity
ActivityCustomer outcomes leadProduct ownerSolutions architectI can fill thisTechnical PMI can fill thisEngineersI can fill thisCompliance & DPOSecurityI can fill this
Business case and benefitsAccountableResponsibleConsultedConsultedInformedConsultedInformed
Target architectureInformedConsultedAccountable and ResponsibleConsultedConsultedConsultedConsulted
DPIA, lawful conditions and consent wordingConsultedConsultedConsultedInformedInformedAccountable and ResponsibleConsulted
Build and integrationInformedConsultedAccountableResponsibleResponsibleInformedConsulted
Pilot testing and fairness checksAccountableResponsibleConsultedResponsibleResponsibleConsultedInformed
Go-live decisionAccountableResponsibleConsultedResponsibleInformedConsultedConsulted
Outcomes monitoring and improvementAccountableResponsibleConsultedConsultedResponsibleConsultedInformed

Business case and benefits

Customer outcomes lead
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
I · Informed
Compliance & DPO
C · Consulted
Security
I · Informed

Target architecture

Customer outcomes lead
I · Informed
Product owner
C · Consulted
Solutions architect
A/R · Accountable and Responsible
Technical PM
C · Consulted
Engineers
C · Consulted
Compliance & DPO
C · Consulted
Security
C · Consulted

DPIA, lawful conditions and consent wording

Customer outcomes lead
C · Consulted
Product owner
C · Consulted
Solutions architect
C · Consulted
Technical PM
I · Informed
Engineers
I · Informed
Compliance & DPO
A/R · Accountable and Responsible
Security
C · Consulted

Build and integration

Customer outcomes lead
I · Informed
Product owner
C · Consulted
Solutions architect
A · Accountable
Technical PM
R · Responsible
Engineers
R · Responsible
Compliance & DPO
I · Informed
Security
C · Consulted

Pilot testing and fairness checks

Customer outcomes lead
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
R · Responsible
Compliance & DPO
C · Consulted
Security
I · Informed

Go-live decision

Customer outcomes lead
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
Compliance & DPO
C · Consulted
Security
C · Consulted

Outcomes monitoring and improvement

Customer outcomes lead
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
Compliance & DPO
C · Consulted
Security
I · Informed

R ResponsibleA AccountableC ConsultedI Informed· not involved

Where I'd fit

Option A

Lead the architecture

If there's no architect on the programme, I'd own the design end to end: the target architecture, the integrations with your CRM, contact centre and collections, the data protection design with your DPO, and the gates. I'd report to your programme board and work closely with your customer outcomes lead.

Option B

Support your architect

If your partner or your own team already has an architect, I'd take on the speech and text pipeline, the agent and the CRM integration under their lead, and give them a second senior opinion on the data protection design, security and outcomes monitoring.

Where this goes wrong

  1. Goes wrong

    Flags become labels. A model's guess sits on a customer's file for years.

    How the design avoids it

    Flags expire unless a colleague confirms a need with the customer. Only needs are recorded, with consent and a review date.

  2. Goes wrong

    It feels like surveillance. Customers find out the bank 'knew' before they told it.

    How the design avoids it

    Read what customers say, not how they sound. No inference of health from spending. Clear wording on what is recorded and why.

  3. Goes wrong

    The specialist team is swamped, so referrals sit in a queue.

    How the design avoids it

    Size the team from the pilot's numbers before go-live, and tune flags with the team, not for them.

  4. Goes wrong

    Spotting improves but outcomes don't.

    How the design avoids it

    Monitor outcomes by group from the start, and give the outcomes forum the authority to change products and processes.

  5. Goes wrong

    The model flags some accents or age groups far more than others.

    How the design avoids it

    Fairness checks across age, accent and channel at the pilot gate and every month after.

On the horizon

Changes already announced or under way that affect this design. More in the UK horizon scan.

  1. Q1 2027
    Final FCA rules on the scope and proportionality of the Consumer Duty (CP26/23, consultation closed 18 September 2026).

    Watch for any change to how outcomes are evidenced, and keep outcomes reporting flexible enough to follow it.

  2. 2026–2027
    The ICO's code of practice on AI and automated decision-making, required by regulations in force since May 2026.

    Keep the flag log, the human decisions and the reasons in a form you could show the ICO as well as the FCA.

  3. Late 2026–2028
    The Cyber Security and Resilience Bill, bringing medium and large managed service providers into regulation.

    Expect your contact centre, CRM and AI suppliers to face new duties, and update supplier assurance and contracts to match.

  4. 2028
    The NCSC's post-quantum cryptography milestone: a full migration plan by 2028.

    Needs records hold sensitive data for a long time. Record which encryption the platform uses and keep it easy to change.

Questions to ask your partner or vendor

Good answers are specific. Vague answers to any of these are worth following up.

Copy them into your next supplier meeting

  1. Which Article 9 condition covers each kind of need we record, and who chose it?
  2. What happens to a flag nobody confirms, and when is it deleted?
  3. Are any voice emotion or sentiment features switched on, anywhere in the contact centre stack?
  4. How do we know the model doesn't flag some groups of customers more than others?
  5. Does the specialist team have the capacity for the referrals the pilot will create?
  6. How will we show the board that outcomes for vulnerable customers have improved, not just that we spotted more?

Planning something like this?

Whether you need someone to lead the design or to support the architect you already have, let's talk it through.

Sam Naseem
Sam NaseemBirmingham, UK · UK & Europe
Available now