Insurance · Playbook 09

Damage assessment from photos

Usable photos first time, a likely repair route within hours, and reused or edited images caught before payment. An engineer or handler makes every settlement and total-loss decision.

  • Computer vision
  • Human in the loop
  • Agents with tools
  • Event-driven integration
  • FCA Consumer Duty
  • FCA ICOBS 8
  • ABI salvage code
  • UK GDPR

At a glance

The problem
Photos arrive blurred, incomplete or late, and every claim waits for an engineer or a site visit
Typical volume
Around 6,000 motor and 2,500 home claims a month with photos or video
Who's involved
Claims operations, motor engineers, property surveyors, counter-fraud, the repairer network, IT, compliance, data protection
Pilot
8–10 weeks on one claim type, after a 3-week discovery
Platforms
AWS, Azure, or a sovereign or on-prem stack

An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.

The business problem

Most motor and home claims now come with photos, and many with video. A customer sends six pictures of a dented wing, taken at night, with no wide shot and no number plate. A repairer sends an estimate with close-ups that don't show the rest of the car. A homeowner sends a video of a wet ceiling. Before anyone can decide anything, an engineer or handler has to work out what the pictures show, ask for better ones, and often book a physical inspection anyway.

In a typical insurer, a large share of motor claims wait days for an engineer's first look, and most of that wait is chasing usable images. Meanwhile the car sits in a garage or a storage yard, hire costs run on, and the customer hears nothing. Edited, reused and now AI-generated images are a growing worry too. The ABI reports that insurers detected £1.34bn of fraudulent general insurance claims in 2025, with motor the largest share, and doctored photos are an increasingly common part of them.

Getting the money right matters as much as getting it fast. The FCA's review of total-loss motor claims found some insurers offered less than a vehicle was worth, applied blanket deductions, and only raised offers when customers complained. That led to around £200m of redress for about 270,000 motorists. Home and travel claims handling is under review during 2026 following the Which? super-complaint. Any AI in this process has to make outcomes fairer and more consistent, not just faster.

What AI changes

  • Customers get a guided photo link, not an app: it shows which shots are needed, checks each one for blur, light and framing as they take it, and asks for a retake on the spot.
  • Every image and video is checked for reuse, editing and signs of AI generation, and any C2PA content credentials are read and recorded, before anyone relies on it.
  • A vision model reads the damage and the repairer's estimate together, and suggests a likely route (repair, possible total loss or cash settlement) with its reasons and confidence.
  • Engineers and handlers get one summary: the best images, the damage marked up, the integrity checks, and what the model is unsure about.
  • Anything that suggests a total loss, a structural or battery issue, or a suspicious image goes straight to the right person, never to an automatic outcome.
  • Customers who can't take photos, or would rather not, get a physical inspection as before. The photo route is an option, not a gate.

How success is measured

Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.

Time to first assessment

How long from first notification until an engineer or handler has a usable view of the damage.

ExampleFrom 3–5 days to same day

Usable photos first time

The share of submissions that need no follow-up request for more or better images.

ExampleAbove 85%

Desk assessment rate

Claims an engineer can assess from images, without a site visit, where they agree that's right.

ExampleUp from about a third to over half of motor claims

Engineer override rate

How often the engineer disagrees with the suggested route. Very high means it isn't helping; near zero can mean people have stopped checking.

ExampleStable, and reviewed weekly

Image integrity

Manipulated or reused images confirmed by counter-fraud before payment, and honest customers wrongly flagged.

ExampleMore caught, false flags falling

Fair settlement

Total-loss offers against guide prices, offers raised after challenge, and outcomes by customer group.

ExampleNo group worse off

UK regulation and controls

Cross-sector rules are on the UK regulation map.

  • FCAConsumer Duty (PRIN 2A)

    There's no AI-specific rulebook. The FCA applies the Duty to AI like any other change. The photo route must not add friction or sludge: customers can always choose an inspection instead, every suggestion carries a plain-English reason, and outcomes are monitored by customer group.

  • FCAICOBS 8: claims handling

    Claims must be handled promptly and fairly, and not unreasonably rejected. The FCA's 2024 review of total-loss valuations found low first offers and blanket deductions unfair. So the model never sets a value or applies a deduction. An engineer or handler sets every settlement, and valuations are monitored against guide prices.

  • ABICode of Practice for the Categorisation of Motorised Vehicle Salvage (May 2025)

    Write-offs are categorised A (scrap), B (break), S (repairable, structural) or N (repairable, non-structural), and recorded on MIAFTR, now part of the MIB's Navigate platform. The 2025 update added rules for electric and hybrid vehicles, including high-voltage battery damage. The model can flag a possible total loss. An engineer makes and records the category.

  • IFBInsurance Fraud Bureau and the Insurance Fraud Register

    The Insurance Fraud Register holds confirmed fraud only. An image flag is a reason to look closer, not proof. Counter-fraud investigates, a person decides whether a claim is fraudulent, and only that decision can lead to a register entry or a rejection.

  • ICOUK GDPR and the Data Protection Act 2018

    Photos capture far more than damage: faces, other people's number plates (personal data in the ICO's view), the inside of people's homes, and things that can reveal health or religion. That means a DPIA before the pilot, capture guidance that avoids people, automatic blurring of bystanders and third-party plates, UK processing, a clear retention period, and a contract that stops providers training on your images.

  • ICOAutomated decisions (UK GDPR, as amended by the Data (Use and Access) Act 2025)

    Since 5 February 2026, the strict limit on solely automated significant decisions applies mainly where special category data is involved, and home images can reveal it. Every other automated decision needs safeguards: telling people, letting them challenge it, and a person who can step in. A person on every adverse decision keeps the design clearly within the rules.

  • FCAVulnerable customers (FG21/1)

    Some customers can't take good photos: after a flood, with a disability, or in shock after an accident. The guided link never pressures them, offers help by phone, and flags signs of vulnerability to a trained handler.

The solution

Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.

Damage assessment from photos: reference architecture
  1. 01Channels

    • Customer's phone (guided photo link)
    • Approved repairer network
    • Loss adjusters and assessors
  2. 02Intake

    • API GatewayAPI ManagementKong, or your existing API gatewayGuided capture and upload API
    • Amazon S3 with Object LockBlob Storage with immutable storageCeph with S3 Object Lock, or IONOS S3 Object StorageOriginal image store, write-once
  3. 03Intelligence

    • SageMaker AIAzure Machine LearningMLflow and Kubeflow on KubernetesIntegrity, reuse and redaction models
    • Amazon Bedrock (multimodal models, Bedrock Data Automation)Microsoft Foundry models, Content UnderstandingOpen-weight vision models served with vLLMDamage reading from images and video
    • Agent
      Bedrock AgentCoreFoundry Agent ServiceLangGraph on Kubernetes, with open-weight models via vLLMDamage assessment agent
  4. 04Orchestration

    • Step FunctionsLogic Apps / Durable FunctionsTemporalAssessment workflow
    • EventBridge + SQSEvent Grid + Service BusApache Kafka or RabbitMQEvents and queues
  5. 05Systems of record

    • Core claims system
    • Estimating and valuation tools
    • Fraud scoring and IFB checks
  6. 06People

    • Person
      Motor engineer: route, category, value
    • Person
      Home claims handler or surveyor
    • Person
      Counter-fraud investigator
  • Cloud or platform service (AWSAzuresovereign / on-prem)
  • AI agent
  • A person decides
  • Your existing systems
  • Outside your organisation

Components, side by side

Damage assessment from photos: components on AWS, Azure and a sovereign or on-prem stack
LayerAWSAzureSovereign / on-prem
Guided capture and intakeA link by text or email, not an app download. Quality checks run on the phone as each photo is taken.A web capture page on Amplify Hosting, API Gateway, S3A web capture page on Static Web Apps, API Management, Blob StorageYour web tier, Kong, Ceph or IONOS S3 Object Storage
Original image storeKeep the original file, untouched, with a hash. Every check and every person works from copies.Amazon S3 with Object LockBlob Storage with immutable storageCeph with S3 Object Lock, or IONOS S3 Object Storage
Reading damage in images and videoAsk for structured output: parts, damage type, severity, and what can't be seen. Test on night-time, wet and partial photos, not showroom shots.Multimodal models on Amazon Bedrock; Bedrock Data Automation for videoMultimodal models in Microsoft Foundry; Azure Content Understanding for videoOpen-weight vision-language models served with vLLM on your own GPUs, or IONOS AI Model Hub
Custom models: damaged parts, reuse, edits, redactionTrain on your own labelled claims. Azure Custom Vision retires on 25 September 2028, so don't start new work on it.SageMaker AIAzure Machine LearningMLflow and Kubeflow on Kubernetes
Provenance checksRecord content credentials when present. Their absence is normal and proves nothing; their presence is useful but not proof.The open-source C2PA library, run on AWS Lambda or ECSThe open-source C2PA library, run on Azure Functions or Container AppsThe open-source C2PA library, run on Kubernetes
Duplicate and reuse searchImage fingerprints and embeddings compared against every past claim, and against web images where your counter-fraud team agrees.Amazon OpenSearch Service (vector search)Azure AI Search (vector search)OpenSearch, or PostgreSQL with pgvector
Agent runtimeThe original Bedrock Agents closed to new customers on 30 July 2026; new builds use AgentCore.Amazon Bedrock AgentCoreFoundry Agent ServiceAn open-source agent framework (e.g. LangGraph) on Kubernetes
WorkflowAWS Step FunctionsLogic Apps or Durable FunctionsTemporal, or n8n
Middleware and eventsAmazon EventBridge, SQSEvent Grid, Service BusApache Kafka or RabbitMQ
Link to claims, estimating and valuation systemsReuse the estimating and valuation tools engineers already trust. The model reads their output; it doesn't replace them.API Gateway, plus your existing integration platform if you have oneAPI Management, plus your existing integration platform if you have oneKong or your existing API gateway, plus your existing integration platform if you have one
Human reviewThe marked-up images and reasons appear where engineers already work, not in a new screen.In the engineers' and handlers' existing desktopIn the engineers' and handlers' existing desktopIn the engineers' and handlers' existing desktop
GuardrailsBedrock GuardrailsFoundry guardrails (Azure AI Content Safety)Open-source guardrails (e.g. NeMo Guardrails, Llama Guard)
Identity, keys, data protectionIAM Identity Center, KMS, MacieEntra ID, Key Vault, PurviewKeycloak or your existing Active Directory; OpenBao or HashiCorp Vault; an HSM
Monitoring and auditLog every image check, every suggestion and every human decision, with the reason and the model version.CloudWatch, CloudTrailAzure Monitor, Log AnalyticsPrometheus, Grafana, OpenTelemetry
UK data residencyCheck each model and media service is offered in a UK region before you commit. IONOS AI Model Hub runs in German data centres: EU, not UK, residency.eu-west-2 (London)UK South / UK WestYour own UK data centre, or a UK or EU provider

On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →

Hybrid and on-prem

Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.

Stays on-prem

The core claims system, the estimating and valuation tools, the fraud engine and the long-term image archive can all stay where they are. Many insurers keep claims images on their own storage for years, and nothing here needs them to move.

Uses cloud AI

The multimodal damage reading and the agent can run in AWS or Azure. The integrity and reuse checks are a good fit for your own estate, because they need the original files and the full archive of past claims.

How they connect

A private link (AWS Direct Connect or Azure ExpressRoute) and the API layer. Originals stay in your store; only redacted working copies and the fields the model needs are sent, and results come back as events onto your queue.

If the link drops

The capture page and image store keep working, so customers can still send photos. Engineers assess from the images directly, and the backlog is read when the link returns.

The agents

What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.

Photo capture assistant

May do

  • Show the customer which shots are needed for their type of claim
  • Check each photo for blur, light and framing, and ask for a retake
  • Explain in plain words why a shot is needed
  • Offer a call back or an inspection instead, at any point

May not do

  • Say anything about cover, value or the likely outcome
  • Ask for photos of people, or of rooms beyond the damage
  • Mention fraud checks or question the customer's account
  • Close or delay the claim if the customer stops

Where a person signs offThe assistant decides nothing about the claim. A customer who stops part-way is passed to a handler, not left waiting.

Damage assessment agent

May do

  • Read the images, video and the repairer's estimate together
  • Look up the policy, the vehicle or property details, and claim history
  • Run the integrity, reuse and provenance checks
  • Suggest a likely route (repair, possible total loss, cash settlement) with reasons and confidence
  • Draft a marked-up summary and route it to the right engineer, handler or counter-fraud queue

May not do

  • Decide a total loss or a salvage category
  • Set a value, apply a deduction or make an offer
  • Approve a repair, instruct a repairer or authorise payment
  • Decline or reduce a claim, or record anything on MIAFTR or the IFR
  • Contact the customer or the repairer

Where a person signs offAn engineer or handler signs off every repair route, every total-loss decision and salvage category, and every settlement figure. Counter-fraud decides every suspected-fraud case. The agent's permissions are enforced by the platform's identity and policy controls, not by instructions in a prompt.

Middleware and integration

Images are large and arrive in bursts after storms and floods. Uploads go straight to object storage, and a small event (claim ID, file, hash) goes on the queue. The models work through the queue at their own pace, so a surge never stalls the upload page.

The claims, estimating and valuation systems are reached only through the API layer, never directly. If you already run an integration platform, the AI uses it like any other system. Every message carries an ID, so a retry never attaches the same assessment twice.

The AI can be switched off without stopping the business. If it's paused, photos still arrive and are stored, and engineers assess them exactly as they did before.

Process and people

  • Clear capture guides for each claim type, written with engineers and tested with real customers, including older customers and those using screen readers.
  • An exception queue for low-confidence assessments and failed integrity checks, with a named owner and a target time.
  • Override rules, so engineers know when and how to disagree, and their reasons are captured and used to improve the model.
  • A counter-fraud playbook for image flags: what counts as evidence, how to ask the customer, and when to escalate to the IFB.
  • A weekly sample review of suggestions and total-loss outcomes against guide prices, split by customer group.
  • A named owner for every model, prompt and capture guide, with change control and a retest after every model update.

Delivery plan

  1. 3 weeks

    Discovery

    Map today's process, measure time to first assessment and inspection rates, sample last quarter's photos, and pick the first claim type (often low-speed motor damage).

  2. Gate · must be true to passBaseline agreed, image sample labelled by engineers, DPIA started, counter-fraud and compliance involved.

  3. 6–8 weeks

    Pilot

    Guided capture live for one claim type; the damage model and integrity checks in shadow mode, compared against engineers' decisions.

  4. Gate · must be true to passAgreement and override rate within limits, false fraud flags acceptable, no customer group worse off, compliance sign-off.

  5. 4–6 weeks

    Production

    Suggestions go live in the engineers' desktop for the first claim type, with monitoring, support and a rollback plan.

  6. Gate · must be true to passMonitoring, support model, rollback plan and engineer training in place.

  7. Ongoing

    Scale

    Add home escape-of-water and storm claims, then repairer-submitted images, one at a time.

  8. Gate · must be true to passEach new claim type passes the same pilot gate, with its own capture guide.

Roles and RACI

Who is responsible, accountable, consulted and informed, by activity
ActivityClaims directorEngineering leadSolutions architectI can fill thisTechnical PMI can fill thisEngineersI can fill thisCounter-fraud leadCompliance & DPOSecurityI can fill this
Business case and benefitsAccountableConsultedConsultedResponsibleInformedConsultedConsultedInformed
Target architectureInformedConsultedAccountable and ResponsibleConsultedConsultedConsultedConsultedConsulted
Capture guides and image labellingInformedAccountable and ResponsibleConsultedConsultedResponsibleConsultedConsultedInformed
DPIA and Consumer Duty reviewAccountableConsultedConsultedConsultedInformedConsultedResponsibleConsulted
Integrity checks and fraud referral rulesInformedConsultedConsultedConsultedResponsibleAccountableConsultedConsulted
Build and integrationInformedConsultedAccountableResponsibleResponsibleInformedInformedConsulted
Accuracy testing against engineers' decisionsInformedAccountableResponsibleConsultedResponsibleConsultedConsultedInformed
Go-live decisionAccountableResponsibleConsultedResponsibleInformedConsultedConsultedConsulted
Run, monitor and improveInformedAccountableConsultedConsultedResponsibleConsultedConsultedConsulted

Business case and benefits

Claims director
A · Accountable
Engineering lead
C · Consulted
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
I · Informed

Target architecture

Claims director
I · Informed
Engineering lead
C · Consulted
Solutions architect
A/R · Accountable and Responsible
Technical PM
C · Consulted
Engineers
C · Consulted
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
C · Consulted

Capture guides and image labelling

Claims director
I · Informed
Engineering lead
A/R · Accountable and Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
I · Informed

DPIA and Consumer Duty review

Claims director
A · Accountable
Engineering lead
C · Consulted
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
I · Informed
Counter-fraud lead
C · Consulted
Compliance & DPO
R · Responsible
Security
C · Consulted

Integrity checks and fraud referral rules

Claims director
I · Informed
Engineering lead
C · Consulted
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
Counter-fraud lead
A · Accountable
Compliance & DPO
C · Consulted
Security
C · Consulted

Build and integration

Claims director
I · Informed
Engineering lead
C · Consulted
Solutions architect
A · Accountable
Technical PM
R · Responsible
Engineers
R · Responsible
Counter-fraud lead
I · Informed
Compliance & DPO
I · Informed
Security
C · Consulted

Accuracy testing against engineers' decisions

Claims director
I · Informed
Engineering lead
A · Accountable
Solutions architect
R · Responsible
Technical PM
C · Consulted
Engineers
R · Responsible
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
I · Informed

Go-live decision

Claims director
A · Accountable
Engineering lead
R · Responsible
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
C · Consulted

Run, monitor and improve

Claims director
I · Informed
Engineering lead
A · Accountable
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
Counter-fraud lead
C · Consulted
Compliance & DPO
C · Consulted
Security
C · Consulted

R ResponsibleA AccountableC ConsultedI Informed· not involved

Where I'd fit

Option A

Lead the architecture

If there's no architect on the programme, I'd own the design end to end: the capture flow, the image pipeline and integrity checks, the integration with your claims and estimating systems, and the gates. I'd report to your programme board.

Option B

Support your architect

If your partner or your own team already has an architect, I'd take on the image pipeline, the vision models and the claims-system integration under their lead, and give them a second senior opinion on the rest.

Where this goes wrong

  1. Goes wrong

    The model was trained on clean, daylight photos. Real claims arrive at night, in the rain, cropped and compressed.

    How the design avoids it

    Pilot on last quarter's real images, labelled by your own engineers, every claim type and channel.

  2. Goes wrong

    The model's guess becomes the offer, and settlements drift low.

    How the design avoids it

    The model never sees or sets a value. Engineers set every figure, and valuations are monitored against guide prices.

  3. Goes wrong

    Image flags are treated as proof, and honest customers are accused.

    How the design avoids it

    A flag starts an investigation, never a decline. Measure false flags and review them with counter-fraud every week.

  4. Goes wrong

    The photo route becomes the only route, and customers who can't use it are stuck.

    How the design avoids it

    An inspection or a call back is offered at every step, and drop-outs go to a handler.

  5. Goes wrong

    Images are kept forever and shared too widely, including faces and the inside of homes.

    How the design avoids it

    Redact bystanders and third-party plates, limit who sees originals, and set a retention period in the DPIA.

  6. Goes wrong

    Content credentials are read as a seal of truth.

    How the design avoids it

    Treat them as one signal among several. Missing credentials are normal; present ones can still be wrong.

On the horizon

Changes already announced or under way that affect this design. More in the UK horizon scan.

  1. During 2026 (announced)
    The Insurance Fraud Bureau's unified counter-fraud platform, bringing its intelligence tools and the Insurance Fraud Register together.

    Keep image-integrity evidence in a structured, explainable form, so your counter-fraud team can share confirmed cases through whatever route the IFB provides.

  2. By end of 2026
    The FCA's public update on the Which? super-complaint about home and travel claims.

    Expect sharper expectations on delays, communication and claim acceptance in home claims. Report outcomes for photo-assessed home claims separately from the start.

  3. 2026–2027
    The ICO's code of practice on AI and automated decision-making.

    Regulations in force since May 2026 require the ICO to produce a statutory code. Keep the decision log, the explanations and the human review records in a form you could show the ICO.

  4. Under way
    More phones and cameras sign photos at capture with C2PA content credentials (some phone cameras now sign every photo; specification version 2.4 in April 2026). Researchers have also shown weaknesses in 2026.

    Read and store credentials whenever they're present, and design the checks so they get stronger as signing spreads, without penalising customers whose phones don't sign.

  5. 25 September 2028
    Azure Custom Vision retires, and calls to it will fail.

    If you already run damage or parts classifiers on Custom Vision, plan the move to Azure Machine Learning or Foundry models now, with your labelled images exported.

Questions to ask your partner or vendor

Good answers are specific. Vague answers to any of these are worth following up.

Copy them into your next supplier meeting

  1. What happens to a customer who can't or won't take photos?
  2. How will we measure accuracy against our own engineers' decisions, on our own images?
  3. Can the model ever set or influence a settlement value? Where is that prevented?
  4. How many honest customers will be flagged by the image checks, and who reviews them?
  5. Where are images processed and stored, who can see the originals, and are they used to train anyone's model?
  6. What does it cost to run per thousand claims, at our volume and image sizes?

Planning something like this?

Whether you need someone to lead the design or to support the architect you already have, let's talk it through.

Sam Naseem
Sam NaseemBirmingham, UK · UK & Europe
Available now