Financial services · Playbook 04

I've worked in this sector

Reconciliation and exception handling

Millions of transactions matched every day, the breaks investigated before anyone opens a spreadsheet, and a person approving every posting, with the audit evidence built as the work is done.

  • Predictive ML
  • Agents with tools
  • Human in the loop
  • Event-driven integration
  • FCA safeguarding (CASS 15)
  • FCA CASS 7 and 10
  • SM&CR
  • SYSC
  • Bank of England CHAPS

At a glance

The problem
Rules match most transactions, and the rest become breaks that analysts chase by hand across five systems and a spreadsheet
Typical volume
Around 2 million transactions a day across 40 bank, scheme and partner accounts, leaving 3,000–5,000 unmatched items
Who's involved
Finance operations, treasury, payments operations, safeguarding and CASS oversight, internal audit, IT
Pilot
8–10 weeks on two or three accounts, after a 3–4 week discovery
Platforms
AWS, Azure, or a sovereign or on-prem stack

An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.

The business problem

Every day, the group's own ledgers have to agree with the outside world. That means bank statements from several banks, settlement reports from Faster Payments, Bacs, CHAPS and the card schemes, files from payment processors and partner firms, and the customer balances in the core banking and e-money platforms. Most items match on amount, date and reference. The rest don't, for ordinary reasons: a reference cut short by a scheme's field length, fees netted from a settlement, a payment split across two days, a return, a duplicate, a currency conversion.

In a typical challenger group, deterministic rules match 92–95% of items. That still leaves thousands of breaks a day. Analysts work them in spreadsheets: export, look up the ledger, find the scheme report, search old emails for a similar case, then raise a journal. Aged breaks hide real problems, such as a missed settlement, a mis-posted customer payment or a shortfall in the money held for customers.

Those shortfalls now carry more weight. Since 7 May 2026, payment and e-money firms must reconcile the funds they safeguard every reconciliation day, send the FCA a monthly safeguarding return, and have an annual safeguarding audit. The investment arm already reconciles client money daily under CASS 7. Senior managers are personally accountable for these controls. Speeding up matching only helps if the evidence of who decided what is better than before, not worse.

What AI changes

  • Deterministic rules still run first. They are fast, explainable and already trusted by audit.
  • For what's left, a matching model suggests likely pairs and groups (one-to-many, many-to-many) with a confidence and a plain reason, such as 'same payer, amount less the card scheme fee, one day later'.
  • An agent investigates each break before an analyst opens it. It pulls the scheme report, the statement line, the ledger history and similar past breaks, then proposes a cause and a correcting entry, with the evidence attached.
  • A person approves every match the rules didn't make, and every posting. Larger postings need a second approver, enforced by the ledger, not the AI.
  • Breaks that touch safeguarded funds or client money go to the safeguarding and CASS oversight team the same day, with the shortfall or excess calculated.
  • The audit evidence builds itself: each match, suggestion, approval and posting is stored with who did it, when and why.

How success is measured

Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.

Auto-match rate

Items matched by rules, plus suggestions accepted without change.

ExampleFrom 94% to 98–99%

Breaks aged over 5 days

Unresolved items older than five business days, by account and value.

ExampleDown by three quarters

Analyst time per break

Time from a break appearing to a resolution being approved.

ExampleDown by half

Suggestion acceptance rate

How often analysts accept the model's match or the agent's proposed fix. Very high means it may not be checked; very low means it isn't helping.

ExampleStable, and reviewed weekly

Safeguarding and client money shortfalls

Days with an unresolved shortfall, and how fast each was corrected.

ExampleEvery shortfall resolved the same day

Audit findings

Issues raised by internal audit and the safeguarding and CASS auditors on reconciliation controls.

ExampleFewer each year, none repeated

UK regulation and controls

Cross-sector rules are on the UK regulation map.

  • FCASafeguarding for payment and e-money firms (Payment Services Regulations 2017, Electronic Money Regulations 2011 and CASS 15, in force since 7 May 2026)

    The e-money subsidiary must do internal and external safeguarding reconciliations every reconciliation day, keep a resolution pack, send a monthly safeguarding return and, above £100,000 of safeguarded funds, have an annual audit. Non-standard reconciliation methods must be documented. The AI speeds up matching and investigation, but a person signs off each day's reconciliation and decides every top-up or withdrawal of excess. Name one accountable person for safeguarding.

  • FCACASS 7 (client money) and CASS 10 (resolution pack)

    The investment arm runs an internal client money reconciliation each business day, using a standard method or a documented non-standard one, plus regular external reconciliations, and records each one. Deposits the bank holds as a bank aren't client money. The design keeps the reconciliation method itself in rules and code that audit can read; the AI only helps clear the breaks. Its records sit in the resolution pack index so they can be found quickly in a wind-down.

  • FCA and PRASenior Managers and Certification Regime (SM&CR)

    A named senior manager is accountable for finance and for client assets, and must be able to show they took reasonable steps. Every AI-assisted step is visible to them: what was suggested, who approved it, and how often suggestions were overridden. The regime is being simplified (Phase 1 rules from 24 April 2026, Phase 2 out for consultation), but individual accountability stays.

  • FCASYSC 9 record keeping, plus the record-keeping duties in the Payment Services and E-money Regulations

    Records must be orderly and complete enough for the regulator to check compliance. Every match, suggestion, approval and posting is stored with its reason and kept in write-once storage for the agreed retention period.

  • Bank of EnglandCHAPS ISO 20022 enhanced data

    Since 1 May 2025, CHAPS payments between financial institutions carry LEIs and purpose codes, and property payments carry purpose codes. Richer, structured data makes matching easier, so the matching model uses these fields where they exist. The next set of changes, including the end of fully unstructured addresses, was deferred from November 2026.

  • ICOUK GDPR and the Data Protection Act 2018

    Statement lines and payment references contain personal data. That means a DPIA, processing in UK regions, a clear retention period, and a contract that stops providers training their models on your data. Reconciliation doesn't make decisions about individuals, but a mis-posted customer payment does affect one, so fixes are always approved by a person.

The solution

Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.

Reconciliation and exception handling: reference architecture
  1. 01Sources

    • Bank statements (camt.053, MT940)
    • Scheme and card settlement reports
    • Processor and partner files
  2. 02Intake

    • AWS Transfer FamilyBlob Storage SFTPYour existing managed file transferFile transfer
    • AWS GlueData Factory in Microsoft FabricApache Spark on KubernetesParse and normalise
    • S3 Object LockBlob immutable storageCeph with S3 Object LockEvidence store (write-once)
  3. 03Intelligence

    • SageMaker AIAzure Machine LearningMLflow and Kubeflow on KubernetesMatch suggestions
    • Bedrock Knowledge BasesFoundry IQ (Azure AI Search)OpenSearch, or PostgreSQL with pgvectorPast breaks and procedures
    • Agent
      Bedrock AgentCoreFoundry Agent ServiceLangGraph on Kubernetes, with open-weight models via vLLMBreak investigation agent
  4. 04Orchestration

    • Step FunctionsLogic Apps / Durable FunctionsTemporalDaily reconciliation run
    • EventBridge + SQSEvent Grid + Service BusApache Kafka or RabbitMQEvents and queues
  5. 05Systems of record

    • General ledger and sub-ledgers
    • Core banking and e-money platforms
    • Existing reconciliation platform and rules
  6. 06People

    • Person
      Analyst: accepts matches, proposes fixes
    • Person
      Controller: approves postings
    • Person
      Safeguarding and CASS oversight: signs off
  • Cloud or platform service (AWSAzuresovereign / on-prem)
  • AI agent
  • A person decides
  • Your existing systems
  • Outside your organisation

Components, side by side

Reconciliation and exception handling: components on AWS, Azure and a sovereign or on-prem stack
LayerAWSAzureSovereign / on-prem
Intake: files and messagesBank connectivity (SWIFT, host-to-host, bank APIs) usually stays as it is. Take a copy of each file as it lands.AWS Transfer Family, Amazon S3Blob Storage with SFTP, Logic Apps connectorsYour existing managed file transfer; Ceph or IONOS S3 Object Storage
Parse and normaliseTurn camt.053, MT940, scheme reports and partner CSVs into one transaction format, keeping the original line for evidence.AWS GlueData Factory in Microsoft FabricApache Spark on Kubernetes
Matching data storeHolds both sides of every match, its status and its history.Amazon Aurora PostgreSQLAzure Database for PostgreSQLPostgreSQL
Deterministic matchingKeep the rules auditors already trust. AI starts where the rules stop.In your existing reconciliation platform, or rules in your own codeIn your existing reconciliation platform, or rules in your own codeIn your existing reconciliation platform, or rules in your own code
Match suggestions (ML)A ranking model trained on your own past matches, giving a confidence and a reason for each suggestion. No language model is needed for this.Amazon SageMaker AIAzure Machine LearningMLflow and Kubeflow on Kubernetes
Investigation and draftingReads statement narratives, scheme reports and past cases, then explains a break in plain English. Both clouds offer a choice of models, including Claude.Amazon BedrockMicrosoft FoundryOpen-weight models served with vLLM on your own GPUs, or IONOS AI Model Hub
Past breaks and procedures (retrieval)Resolved breaks, desk procedures and account notes, so the agent learns from how your team fixed the same problem last time.Bedrock Knowledge BasesFoundry IQ, built on Azure AI SearchOpenSearch, or PostgreSQL with pgvector
Agent runtimeThe original Bedrock Agents closed to new customers on 30 July 2026; new builds use AgentCore.Amazon Bedrock AgentCoreFoundry Agent ServiceAn open-source agent framework (e.g. LangGraph) on Kubernetes
WorkflowRuns each day's cycle to the cut-off, and escalates if a safeguarding or client money reconciliation isn't signed off in time.AWS Step FunctionsLogic Apps or Durable FunctionsTemporal, or n8n
Link to the ledgerApproved postings go in through the ledger's own interface, with its own approval limits. The AI has no write access.API Gateway, plus your existing integration platformAPI Management, plus your existing integration platformKong or your existing API gateway
Human reviewAnalysts and controllers work where they already work, not in a new screen.In the existing reconciliation platform or finance workbenchIn the existing reconciliation platform or finance workbenchIn the existing reconciliation platform or finance workbench
Audit evidenceWrite-once storage for every match, suggestion, approval and posting, for the agreed retention period.Amazon S3 with Object Lock, CloudTrailBlob Storage immutable storage, Azure Monitor logsCeph with S3 Object Lock, OpenTelemetry
GuardrailsBedrock GuardrailsFoundry guardrails (Azure AI Content Safety)Open-source guardrails (e.g. NeMo Guardrails, Llama Guard)
Identity, keys, data protectionSeparate roles for proposing and approving, so nobody approves their own fix.IAM Identity Center, KMS, MacieEntra ID, Key Vault, PurviewKeycloak or your existing Active Directory; OpenBao or HashiCorp Vault; an HSM
MonitoringTrack match rates, acceptance rates and ageing by account. A sudden change usually means a source file changed format.CloudWatchAzure Monitor, Log AnalyticsPrometheus, Grafana, OpenTelemetry
UK data residencyIONOS AI Model Hub runs in German data centres: EU, not UK, residency.eu-west-2 (London)UK South / UK WestYour own UK data centre, or a UK or EU provider

On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →

Hybrid and on-prem

Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.

Stays on-prem

The general ledger, core banking, the e-money platform and bank connectivity stay where they are. The deterministic matching and the daily sign-off also run next to them, because they must happen every reconciliation day, whatever else is down.

Uses cloud AI

Match suggestions, the investigation agent and retrieval over past breaks can run in a UK cloud region, or on your own GPUs with open-weight models if statement data must stay inside your estate.

How they connect

A private link (AWS Direct Connect or Azure ExpressRoute) and your API layer. Only the transactions in each break are sent, and suggestions come back as events onto your queue.

If the link drops

Rules matching and the analysts' queue carry on locally, and the day's reconciliations are signed off as they were before the AI. Breaks are investigated by hand until the link returns, then the backlog is picked up.

The agents

What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.

Break investigation agent

May do

  • Read both sides of a break and their history
  • Pull the matching statement lines, scheme reports and ledger entries
  • Search past resolved breaks and desk procedures for similar cases
  • Propose a cause and a correcting entry, with the evidence attached
  • Draft a query to a bank, scheme or partner for the analyst to send
  • Flag breaks that touch safeguarded funds or client money

May not do

  • Post, reverse or approve a journal
  • Move money, including safeguarding top-ups or withdrawals
  • Write off or close a break
  • Contact a bank, scheme, partner or customer
  • Change matching rules or tolerances

Where a person signs offAn analyst accepts or rejects every proposal, and a controller approves every posting, with a second approver above an agreed value. Safeguarding and CASS reconciliations are signed off by the oversight team. The agent's permissions are enforced by the platform's identity and policy controls, and by the ledger's own approval limits, not by instructions in a prompt.

Middleware and integration

The ledger is reached only through its own API or integration layer, never directly. Postings carry an ID, so a retry never posts twice. If you already run an integration platform, the AI uses it like any other system does.

Each file that lands becomes an event. Parsing, matching, suggestions and investigation follow from it, so a late bank statement simply starts its part of the run late. Nothing waits on a fixed batch window that a delayed file can break.

The daily reconciliation never depends on the AI. If the model or agent is down, the rules still match, the breaks still appear in the analysts' queue, and they work them as before. The legal duty to reconcile is met either way.

Process and people

  • Separate proposing from approving: analysts accept matches and propose fixes, controllers approve postings, and nobody approves their own.
  • An exception queue for breaks the agent can't explain, with a named owner per account and an ageing target.
  • A weekly review of a sample of accepted suggestions and approved fixes, including ones that touched safeguarded funds or client money.
  • A named owner for the matching model, each prompt and the procedures library, with change control like any other financial control.
  • Reconciliation methods written down, including where AI is used, ready for the safeguarding and CASS auditors.
  • Analysts trained before go-live, including what the agent can't see: a phone call with the bank, or a partner's internal system.

Delivery plan

  1. 3–4 weeks

    Discovery

    Map every account, source and cut-off, measure today's match rates and break ageing, and pick two or three accounts with the most manual work.

  2. Gate · must be true to passBaseline agreed, data access confirmed, DPIA started, finance, safeguarding oversight and internal audit involved.

  3. 8–10 weeks

    Pilot

    Shadow mode on the chosen accounts: suggestions and proposed fixes are produced, analysts work as normal, and the two are compared.

  4. Gate · must be true to passSuggestion accuracy and acceptance within agreed limits, no wrong posting proposed above tolerance, and internal audit comfortable with the evidence.

  5. 4–6 weeks

    Production

    Suggestions and the agent go live on the pilot accounts, inside the existing approval limits, with monitoring and a rollback plan.

  6. Gate · must be true to passMonitoring, support model, rollback plan, updated reconciliation method documents and analyst training in place.

  7. Ongoing

    Scale

    Add accounts in waves, then safeguarding and client money accounts once the evidence has been through an audit cycle.

  8. Gate · must be true to passEach new account passes the same shadow-mode gate.

Roles and RACI

Who is responsible, accountable, consulted and informed, by activity
ActivityFinance directorProduct ownerSolutions architectI can fill thisTechnical PMI can fill thisEngineersI can fill thisSafeguarding & CASS oversightInternal auditSecurityI can fill this
Business case and benefitsAccountableResponsibleConsultedConsultedInformedConsultedInformedInformed
Target architecture and ledger integrationConsultedConsultedAccountable and ResponsibleConsultedConsultedConsultedConsultedConsulted
Reconciliation method documentsAccountableConsultedConsultedInformedConsultedResponsibleConsultedInformed
Build and integrationInformedConsultedAccountableResponsibleResponsibleInformedInformedConsulted
Accuracy testing on real breaksInformedAccountableResponsibleConsultedResponsibleConsultedConsultedInformed
Go-live decisionAccountableResponsibleConsultedResponsibleInformedConsultedConsultedConsulted
Run, monitor and improveAccountableResponsibleConsultedConsultedResponsibleConsultedInformedConsulted

Business case and benefits

Finance director
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
I · Informed
Safeguarding & CASS oversight
C · Consulted
Internal audit
I · Informed
Security
I · Informed

Target architecture and ledger integration

Finance director
C · Consulted
Product owner
C · Consulted
Solutions architect
A/R · Accountable and Responsible
Technical PM
C · Consulted
Engineers
C · Consulted
Safeguarding & CASS oversight
C · Consulted
Internal audit
C · Consulted
Security
C · Consulted

Reconciliation method documents

Finance director
A · Accountable
Product owner
C · Consulted
Solutions architect
C · Consulted
Technical PM
I · Informed
Engineers
C · Consulted
Safeguarding & CASS oversight
R · Responsible
Internal audit
C · Consulted
Security
I · Informed

Build and integration

Finance director
I · Informed
Product owner
C · Consulted
Solutions architect
A · Accountable
Technical PM
R · Responsible
Engineers
R · Responsible
Safeguarding & CASS oversight
I · Informed
Internal audit
I · Informed
Security
C · Consulted

Accuracy testing on real breaks

Finance director
I · Informed
Product owner
A · Accountable
Solutions architect
R · Responsible
Technical PM
C · Consulted
Engineers
R · Responsible
Safeguarding & CASS oversight
C · Consulted
Internal audit
C · Consulted
Security
I · Informed

Go-live decision

Finance director
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
Safeguarding & CASS oversight
C · Consulted
Internal audit
C · Consulted
Security
C · Consulted

Run, monitor and improve

Finance director
A · Accountable
Product owner
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
Safeguarding & CASS oversight
C · Consulted
Internal audit
I · Informed
Security
C · Consulted

R ResponsibleA AccountableC ConsultedI Informed· not involved

Where I'd fit

Option A

Lead the architecture

If there's no architect on the programme, I'd own the design end to end: how the AI sits beside your existing reconciliation platform, the ledger integration and approval limits, the evidence trail and the gates. I'd work closely with your finance director and safeguarding oversight, and report to your programme board.

Option B

Support your architect

If your partner, your reconciliation vendor or your own team already has an architect, I'd take on the matching model, the agent and the event flows under their lead, and give them a second senior opinion on controls, resilience and the evidence your auditors will ask for.

Where this goes wrong

  1. Goes wrong

    The AI is allowed to post fixes, and a wrong posting reaches a customer's balance.

    How the design avoids it

    No write access to the ledger. Proposals only, approved through the ledger's own limits, with a second approver above an agreed value.

  2. Goes wrong

    The model replaces rules that audit already understood.

    How the design avoids it

    Rules first, unchanged. ML only works on what the rules leave, and the method documents say so.

  3. Goes wrong

    Analysts accept suggestions without looking, so a 99% match rate hides real errors.

    How the design avoids it

    Acceptance rates watched by account, a weekly sample review, and suggestions that show their reason, not just a score.

  4. Goes wrong

    A partner changes its file format and match rates quietly collapse.

    How the design avoids it

    Monitoring on match rates per source, alerts on sudden change, and parsing that keeps the original line.

  5. Goes wrong

    Safeguarding is added on day one, before anyone trusts the evidence.

    How the design avoids it

    Start with operational accounts. Bring in safeguarding and client money accounts after an audit cycle has reviewed the evidence.

On the horizon

Changes already announced or under way that affect this design. More in the UK horizon scan.

  1. In force since 7 May 2026
    The FCA's interim safeguarding rules for payment and e-money firms (CASS 15): daily reconciliations, a monthly return, annual audits and resolution packs. The end-state regime, including any statutory trust, has been deferred for further consultation and depends on HM Treasury replacing the Payment Services and E-money Regulations.

    Make the reconciliation evidence audit-ready now, and keep the method configurable so the end-state rules change settings, not the build.

  2. Deferred from November 2026
    The Bank of England deferred its whole November 2026 RTGS and CHAPS standards release on 27 August 2026, expecting around 12 months' delay. It includes rejecting fully unstructured addresses. Structured remittance data was planned for November 2027.

    Use enhanced CHAPS data in matching where it exists, and plan the parsing changes for the revised dates rather than the old ones.

  3. From September 2027
    CHAPS settlement opens at 01:30 on weekdays instead of 06:00, subject to final confirmation. The Bank of England has consulted on weekend settlement, no earlier than 2029.

    Don't hard-code business days and cut-offs into the reconciliation run. Treat them as configuration.

  4. First half of 2027
    Final rules on Phase 2 of the SM&CR reforms (FCA CP26/37 and PRA CP14/26, consultation open until 22 January 2027), including removing the Certification Regime.

    Keep the map of who is accountable for each reconciliation and control, whatever the regime calls their role.

Questions to ask your partner or vendor

Good answers are specific. Vague answers to any of these are worth following up.

Copy them into your next supplier meeting

  1. What happens to the day's reconciliation when the AI is down?
  2. Can the AI write to the ledger in any way, and where is that blocked?
  3. How will we measure suggestion accuracy on our own breaks, not a supplier's benchmark?
  4. How is the reconciliation method documented for the safeguarding and CASS auditors?
  5. Who owns the matching model and the procedures library after you leave?
  6. What does it cost to run per million transactions, at our volume?

Planning something like this?

Whether you need someone to lead the design or to support the architect you already have, let's talk it through.

Sam Naseem
Sam NaseemBirmingham, UK · UK & Europe
Available now