Business case and benefits
- COO / sponsor
- A · Accountable
- Knowledge and source owners
- C · Consulted
- Solutions architect
- C · Consulted
- Technical PM
- R · Responsible
- Engineers
- I · Informed
- DPO & information governance
- I · Informed
- Security
- I · Informed
Staff ask a question in plain English and get a short answer with links to the exact sources, drawn only from documents they can already open. When the answer isn't there, it says so.
At a glance
An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.
Most organisations have the answer to a staff question written down somewhere: the expenses policy, the process for a new supplier, the right form for a contract change. The trouble is finding it. It might be on the intranet, in a shared drive, in a wiki, or in an email attachment, often in three versions with no clear owner. Staff ask a colleague, raise a ticket, or go with what they remember.
That costs time across every team, and it creates risk. People follow last year's policy, use an old template, or give a customer an answer that changed months ago. The few people who know where things are spend their days answering the same questions.
An AI assistant over your documents can fix this, but it also exposes a problem many organisations don't know they have: overshared files. Search engines and assistants find whatever a user is technically allowed to open, including the salary spreadsheet in a folder that was shared with everyone years ago. The permissions need cleaning up before the assistant goes live, not after.
Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.
How long staff take to answer a set of common questions, before and after, measured in a short study.
ExampleFrom 15 minutes to under 2
Share of answers that link to a source the user could open and check.
Example100%: no citation, no answer
Answers found wrong or out of date in a weekly sample checked by source owners.
ExampleBelow 3%, falling
Share of questions where the assistant correctly says it can't answer. Gaps are sent to source owners.
ExampleTracked, with gaps closed monthly
Answers that cite a document the user couldn't open, found in testing with test accounts.
ExampleZero, with every case investigated
Tickets and messages to HR, IT and finance asking where something is or what a policy says.
ExampleDown by a third
Cross-sector rules are on the UK regulation map.
Index only what staff need to do their jobs. Sources that are mostly personal data, such as HR casework, grievances, legal matters and personal drives, stay out unless there's a clear need, they're permission-trimmed, and the DPO agrees. A DPIA covers the sources, the logs and the retention periods before the pilot.
The assistant must never become a way round your permissions. Retrieval is filtered by the signed-in user's identity and groups, enforced by the search platform at query time, not by instructions in a prompt. Permissions are synced from each source on a short schedule, and changes such as a leaver or a moved file are tested.
Questions staff ask, answers that mention a person, and logs are all personal data that can fall within a subject access request. The Act confirms you only need a reasonable and proportionate search, but you still need to be able to search the logs by person. Keep logs for a set period, and don't keep conversation histories longer than you need.
The index follows each source's retention: when a document is deleted or expires, it leaves the index on the next sync. Logs of questions and answers have their own short retention period, agreed with information governance.
The NCSC's December 2025 advice is that prompt injection may never be fully fixed, so reduce what a successful attack can do. A document can carry hidden instructions. The assistant treats every document as data, has no tools that act or send, and can only see what the user can see. DSIT's AI Cyber Security Code of Practice names indirect prompt injection as a risk to design for.
If you're a public authority, the ICO's guidance is that AI prompts and outputs you hold are subject to FOI, and retained chat histories must be searched when a request covers them. Short, defined retention keeps this manageable. Official outputs go into your records system, not the chat log.
Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.
01Channels
02Intake
03Intelligence
04Orchestration
05Systems of record
06People
| Layer | AWS | Azure | Sovereign / on-prem |
|---|---|---|---|
| Connectors and syncSync content and permissions together. Permission changes only reach the index on the next sync, so keep it short. | Bedrock Managed Knowledge Base connectors, or Step Functions jobs | Foundry IQ knowledge sources, or Azure AI Search indexers | Temporal or n8n jobs calling each source's API |
| Reading documentsTables, scanned forms and slides need testing on your real documents. | Built-in parsing, or Amazon Textract for scans | Azure Content Understanding (includes Document Intelligence) | Open-source parsing (e.g. Docling) plus an open-weight vision model |
| Permission-aware retrievalAWS says its ACL filtering isn't a security boundary on its own: your app must authenticate users and pass verified identity. Azure's built-in document-level access is still partly in preview; security filters are generally available. | Bedrock Managed Knowledge Base, with document-level access control | Foundry IQ, built on Azure AI Search, with security filters | OpenSearch with document-level security, or PostgreSQL with pgvector and row-level security |
| Answers with citationsAnswer only from retrieved passages, cite each one, and say 'I don't know' when nothing relevant comes back. | Amazon Bedrock | Microsoft Foundry | Open-weight models served with vLLM on your own GPUs, or IONOS AI Model Hub |
| Packaged alternativesQuicker to start if your documents already sit in that platform. Both use your existing permissions, including any overshared files. Amazon Q Business closed to new customers on 31 July 2026. | Amazon Quick (in London since March 2026) | Microsoft 365 Copilot | None: build it from the parts above |
| IdentityOne identity for the user, passed through to retrieval. Never a shared service account that can see everything. | IAM Identity Center | Entra ID | Keycloak, or your existing Active Directory |
| GuardrailsHelp catch injected instructions and personal data in answers, but the real limit is what the user can see. | Bedrock Guardrails | Foundry guardrails (Azure AI Content Safety) | Open-source guardrails (e.g. NeMo Guardrails, Llama Guard) |
| Keys and data protectionUse discovery tools to find personal data and overshared folders before they're indexed. | KMS, Macie | Key Vault, Purview | OpenBao or HashiCorp Vault; an HSM |
| Monitoring and auditLog the question, the sources retrieved and the answer, with a set retention period, searchable by person. | CloudWatch, CloudTrail | Azure Monitor, Log Analytics | Prometheus, Grafana, OpenTelemetry |
| UK data residencyAmazon Quick in London routes inference within European AWS Regions. Microsoft expects in-UK processing for Microsoft 365 Copilot by the end of 2026. Check where each option processes, not just where it stores. | eu-west-2 (London) | UK South / UK West | Your own UK data centre, or a UK or EU provider |
On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →
Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.
Stays on-prem
File servers, the document management system and the directory often stay on your own servers. Sensitive sources can be indexed on-prem only, with an on-prem index and model, while general policies go to the cloud.
Uses cloud AI
The index and the answering model can run in AWS or Azure in a UK region, or entirely on your own GPUs with open-weight models if documents mustn't leave your estate.
How they connect
Sync jobs read content and permissions over a private link (AWS Direct Connect or Azure ExpressRoute), or Azure Arc for on-prem sources. Users sign in with the same identity everywhere, so the cloud index sees the same groups your file servers do.
If the link drops
Cloud-indexed answers stop, and the assistant says so plainly. Staff fall back to normal search. Permission syncs pause, so the index is set to stop serving a source whose permissions are too old, rather than serve stale access.
What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.
Knowledge assistant
Where a person signs offSource owners approve each source before it's indexed, and the DPO approves the scope, especially any source holding personal data. Permissions are enforced by the search platform from the user's verified identity, not by the prompt. The assistant has no tools that act, so a document carrying hidden instructions has nothing to misuse.
Each source is connected through its own API or a supported connector, and the sync reads permissions along with content. The index is a copy, so sync timing matters: a leaver or a moved file should leave the index within the hour, and deletions follow each source's retention.
Identity flows end to end. The user signs in once, and their identity and group memberships go with every query to the index. There's no shared account that can see everything and filter afterwards.
If a source is down, its content stays searchable at its last sync, with a date shown. If its permissions can't be refreshed for longer than an agreed limit, the source is withheld until they can.
The assistant can be switched off without affecting any source. Staff keep searching and browsing as they do today.
List the sources, owners and their permissions, find overshared content, collect 100 real questions, and measure the baseline.
Gate · must be true to passSources and owners agreed, oversharing report reviewed, DPIA started, out-of-scope list signed off by the DPO.
Two or three well-owned sources, such as IT and finance policies, for 200 staff. Test every answer against the question set, and test permissions with test accounts.
Gate · must be true to passCitation rate and wrong-answer rate within agreed limits, zero permission leaks in testing, and DPO and security sign-off.
Open to all staff for the pilot sources, with monitoring, support, owner reporting and a rollback plan.
Gate · must be true to passMonitoring, support model, rollback plan, retention settings and staff guidance in place.
Add sources one at a time, each with an owner, a permissions check and a set of test questions.
Gate · must be true to passEach new source passes the same gate.
| Activity | COO / sponsor | Knowledge and source owners | Solutions architectI can fill this | Technical PMI can fill this | EngineersI can fill this | DPO & information governance | SecurityI can fill this |
|---|---|---|---|---|---|---|---|
| Business case and benefits | Accountable | Consulted | Consulted | Responsible | Informed | Informed | Informed |
| Target architecture | Informed | Consulted | Accountable and Responsible | Consulted | Consulted | Consulted | Consulted |
| Source scope and DPIA | Accountable | Consulted | Consulted | Informed | Informed | Responsible | Consulted |
| Permissions clean-up | Accountable | Responsible | Consulted | Consulted | Responsible | Consulted | Responsible |
| Build and integration | Informed | Informed | Accountable | Responsible | Responsible | Informed | Consulted |
| Answer quality and permission testing | Informed | Responsible | Accountable | Consulted | Responsible | Consulted | Responsible |
| Go-live decision | Accountable | Consulted | Consulted | Responsible | Informed | Consulted | Consulted |
| Run, monitor and improve | Accountable | Responsible | Consulted | Informed | Responsible | Consulted | Consulted |
R ResponsibleA AccountableC ConsultedI Informed· not involved
Option A
If there's no architect on the programme, I'd own the design end to end: the sources and connectors, identity and permission-trimmed retrieval, the index, the answer service, and the gates. I'd report to your programme board and get the DPO and source owners involved at discovery.
Option B
If your partner or your own team already has an architect, I'd take on identity, permission sync and the source integrations under their lead, which is where knowledge assistants usually go wrong, and give them a second senior opinion on the rest.
Goes wrong
The assistant surfaces a salary file from a folder shared with everyone years ago.
How the design avoids it
An oversharing review and clean-up in discovery, and sensitive sources out of scope until they're fixed.
Goes wrong
Permissions are checked in the prompt ('only answer if the user is in HR'), and a clever question gets round it.
How the design avoids it
Retrieval filtered by the platform from the user's verified identity. The model never sees what the user can't.
Goes wrong
Someone leaves or changes team, but the index still serves them old documents until the next weekly sync.
How the design avoids it
Short permission syncs, leaver and mover tests, and sources withheld when their permissions are too stale.
Goes wrong
Answers sound confident but come from an old policy, or from nowhere.
How the design avoids it
Every answer cites its source, 'I don't know' is an accepted answer, and owners retire outdated documents.
Goes wrong
A document with hidden text tells the assistant to reveal or do something.
How the design avoids it
No tools that act or send, documents treated as data, and the user's own permissions as the outer limit.
Changes already announced or under way that affect this design. More in the UK horizon scan.
Microsoft's April 2026 update says it expects local processing of Copilot interactions in the UK by the end of 2026. If you're weighing a packaged option, check where prompts are processed as well as stored, and record it in the DPIA.
ETSI published its baseline AI security standard, based on the UK code, in December 2025, and the government said it would update its code to match. Map your controls for prompt injection, logging and least privilege to it now.
Amazon Q Business closed to new customers on 31 July 2026; Bedrock Managed Knowledge Base became generally available in June 2026; parts of Azure's document-level access control are still in preview. Keep identity, permission sync and source owners in your own design, so the index can change underneath.
Medium and large managed service providers come into regulation, with faster incident reporting. Expect your IT and AI suppliers to face new duties, and update contracts and supplier assurance to match.
Good answers are specific. Vague answers to any of these are worth following up.
Whether you need someone to lead the design or to support the architect you already have, let's talk it through.