Cross-functional · Playbook 63

Internal knowledge assistant

Staff ask a question in plain English and get a short answer with links to the exact sources, drawn only from documents they can already open. When the answer isn't there, it says so.

  • Retrieval (RAG)
  • UK GDPR
  • Access control

At a glance

The problem
Answers are spread across intranet pages, shared drives and wikis, in several versions, so staff ask colleagues or guess
Typical volume
Around 3,000 staff, 200,000 documents across six sources, and 1,500 questions a day once it's live
Who's involved
Operations, IT, information governance, the DPO, security, and an owner for every source
Pilot
6–8 weeks after a 3–4 week discovery
Platforms
AWS, Azure, or a sovereign or on-prem stack

An illustrative scenario. The numbers are typical examples, not a client case study. The cloud services and UK rules were checked on 9 November 2026.

The business problem

Most organisations have the answer to a staff question written down somewhere: the expenses policy, the process for a new supplier, the right form for a contract change. The trouble is finding it. It might be on the intranet, in a shared drive, in a wiki, or in an email attachment, often in three versions with no clear owner. Staff ask a colleague, raise a ticket, or go with what they remember.

That costs time across every team, and it creates risk. People follow last year's policy, use an old template, or give a customer an answer that changed months ago. The few people who know where things are spend their days answering the same questions.

An AI assistant over your documents can fix this, but it also exposes a problem many organisations don't know they have: overshared files. Search engines and assistants find whatever a user is technically allowed to open, including the salary spreadsheet in a folder that was shared with everyone years ago. The permissions need cleaning up before the assistant goes live, not after.

What AI changes

  • Staff ask a question in the tools they already use and get a short answer in seconds, with links to the exact paragraphs it came from.
  • Answers only draw on documents the person asking can already open. The search platform enforces this at query time, from their real identity.
  • When the sources don't cover a question, the assistant says 'I don't know' and points to the owner, instead of guessing.
  • Each source has a named owner, who sees the questions it couldn't answer and the documents most often cited.
  • Outdated and duplicate documents surface quickly, because people now notice when an answer cites them.
  • HR casework, legal matters and personal files stay out of scope unless they're permission-trimmed and the DPO agrees.

How success is measured

Agree these, and measure the baseline, before anything is built. Example targets are typical, not promises.

Time to find an answer

How long staff take to answer a set of common questions, before and after, measured in a short study.

ExampleFrom 15 minutes to under 2

Answers with a citation

Share of answers that link to a source the user could open and check.

Example100%: no citation, no answer

Wrong answers

Answers found wrong or out of date in a weekly sample checked by source owners.

ExampleBelow 3%, falling

Honest 'I don't know'

Share of questions where the assistant correctly says it can't answer. Gaps are sent to source owners.

ExampleTracked, with gaps closed monthly

Permission leaks

Answers that cite a document the user couldn't open, found in testing with test accounts.

ExampleZero, with every case investigated

Repeat questions to experts and help desks

Tickets and messages to HR, IT and finance asking where something is or what a policy says.

ExampleDown by a third

UK regulation and controls

Cross-sector rules are on the UK regulation map.

  • ICOUK GDPR: data minimisation and purpose limitation

    Index only what staff need to do their jobs. Sources that are mostly personal data, such as HR casework, grievances, legal matters and personal drives, stay out unless there's a clear need, they're permission-trimmed, and the DPO agrees. A DPIA covers the sources, the logs and the retention periods before the pilot.

  • ICOUK GDPR security, and access control

    The assistant must never become a way round your permissions. Retrieval is filtered by the signed-in user's identity and groups, enforced by the search platform at query time, not by instructions in a prompt. Permissions are synced from each source on a short schedule, and changes such as a leaver or a moved file are tested.

  • ICOSubject access (UK GDPR Article 15, as amended by the Data (Use and Access) Act 2025)

    Questions staff ask, answers that mention a person, and logs are all personal data that can fall within a subject access request. The Act confirms you only need a reasonable and proportionate search, but you still need to be able to search the logs by person. Keep logs for a set period, and don't keep conversation histories longer than you need.

  • ICOStorage limitation and retention

    The index follows each source's retention: when a document is deleted or expires, it leaves the index on the next sync. Logs of questions and answers have their own short retention period, agreed with information governance.

  • NCSC / DCMSPrompt injection through documents

    The NCSC's December 2025 advice is that prompt injection may never be fully fixed, so reduce what a successful attack can do. A document can carry hidden instructions. The assistant treats every document as data, has no tools that act or send, and can only see what the user can see. DSIT's AI Cyber Security Code of Practice names indirect prompt injection as a risk to design for.

  • ICOFreedom of Information Act 2000 (public bodies)

    If you're a public authority, the ICO's guidance is that AI prompts and outputs you hold are subject to FOI, and retained chat histories must be searched when a request covers them. Short, defined retention keeps this manageable. Official outputs go into your records system, not the chat log.

The solution

Showing AWSAzuresovereign / on-prem services. Switch with the toggle; every diagram and table on this page follows it.

Internal knowledge assistant: reference architecture
  1. 01Channels

    • Chat in your intranet
    • Chat in your collaboration tool
    • Search box with answers
  2. 02Intake

    • IAM Identity CenterEntra IDKeycloak, or your existing Active DirectorySign-in and groups
    • API GatewayAPI ManagementKong, or your existing API gatewayAPI layer
  3. 03Intelligence

    • Bedrock Managed Knowledge BaseFoundry IQ (Azure AI Search)OpenSearch with document-level security, or PostgreSQL with pgvector and row-level securityPermission-aware index
    • Agent
      Amazon BedrockMicrosoft FoundryOpen-weight models served with vLLMAnswer with citations
    • Bedrock GuardrailsFoundry guardrailsNeMo Guardrails or Llama GuardGuardrails
  4. 04Orchestration

    • Step FunctionsLogic Apps / indexer schedulesTemporal, or n8nContent and permission sync
    • EventBridge + SQSEvent Grid + Service BusApache Kafka or RabbitMQChange events
  5. 05Systems of record

    • Your document store
    • Your intranet and wiki
    • Directory: who can open what
    • Records and retention schedule
  6. 06People

    • Person
      Staff asking questions
    • Person
      Source owners: gaps and fixes
    • Person
      DPO and information governance
  • Cloud or platform service (AWSAzuresovereign / on-prem)
  • AI agent
  • A person decides
  • Your existing systems
  • Outside your organisation

Components, side by side

Internal knowledge assistant: components on AWS, Azure and a sovereign or on-prem stack
LayerAWSAzureSovereign / on-prem
Connectors and syncSync content and permissions together. Permission changes only reach the index on the next sync, so keep it short.Bedrock Managed Knowledge Base connectors, or Step Functions jobsFoundry IQ knowledge sources, or Azure AI Search indexersTemporal or n8n jobs calling each source's API
Reading documentsTables, scanned forms and slides need testing on your real documents.Built-in parsing, or Amazon Textract for scansAzure Content Understanding (includes Document Intelligence)Open-source parsing (e.g. Docling) plus an open-weight vision model
Permission-aware retrievalAWS says its ACL filtering isn't a security boundary on its own: your app must authenticate users and pass verified identity. Azure's built-in document-level access is still partly in preview; security filters are generally available.Bedrock Managed Knowledge Base, with document-level access controlFoundry IQ, built on Azure AI Search, with security filtersOpenSearch with document-level security, or PostgreSQL with pgvector and row-level security
Answers with citationsAnswer only from retrieved passages, cite each one, and say 'I don't know' when nothing relevant comes back.Amazon BedrockMicrosoft FoundryOpen-weight models served with vLLM on your own GPUs, or IONOS AI Model Hub
Packaged alternativesQuicker to start if your documents already sit in that platform. Both use your existing permissions, including any overshared files. Amazon Q Business closed to new customers on 31 July 2026.Amazon Quick (in London since March 2026)Microsoft 365 CopilotNone: build it from the parts above
IdentityOne identity for the user, passed through to retrieval. Never a shared service account that can see everything.IAM Identity CenterEntra IDKeycloak, or your existing Active Directory
GuardrailsHelp catch injected instructions and personal data in answers, but the real limit is what the user can see.Bedrock GuardrailsFoundry guardrails (Azure AI Content Safety)Open-source guardrails (e.g. NeMo Guardrails, Llama Guard)
Keys and data protectionUse discovery tools to find personal data and overshared folders before they're indexed.KMS, MacieKey Vault, PurviewOpenBao or HashiCorp Vault; an HSM
Monitoring and auditLog the question, the sources retrieved and the answer, with a set retention period, searchable by person.CloudWatch, CloudTrailAzure Monitor, Log AnalyticsPrometheus, Grafana, OpenTelemetry
UK data residencyAmazon Quick in London routes inference within European AWS Regions. Microsoft expects in-UK processing for Microsoft 365 Copilot by the end of 2026. Check where each option processes, not just where it stores.eu-west-2 (London)UK South / UK WestYour own UK data centre, or a UK or EU provider

On a phone, the table shows the platform you pick. Sovereign / on-prem means open, portable components you can run in your own data centre or with a UK or European provider; IONOS is shown as one example, and others exist. What sovereign cloud means →

Hybrid and on-prem

Many organisations keep core systems and sensitive data on their own servers. This is how the same design works across both.

Stays on-prem

File servers, the document management system and the directory often stay on your own servers. Sensitive sources can be indexed on-prem only, with an on-prem index and model, while general policies go to the cloud.

Uses cloud AI

The index and the answering model can run in AWS or Azure in a UK region, or entirely on your own GPUs with open-weight models if documents mustn't leave your estate.

How they connect

Sync jobs read content and permissions over a private link (AWS Direct Connect or Azure ExpressRoute), or Azure Arc for on-prem sources. Users sign in with the same identity everywhere, so the cloud index sees the same groups your file servers do.

If the link drops

Cloud-indexed answers stop, and the assistant says so plainly. Staff fall back to normal search. Permission syncs pause, so the index is set to stop serving a source whose permissions are too old, rather than serve stale access.

The agents

What each agent may do through its tools, what it may not, and where a person signs off. The limits are enforced by the platform, not the prompt.

Knowledge assistant

May do

  • Search the sources the signed-in user can already open, using their own identity
  • Answer from the passages it retrieves, citing each one with a link
  • Say 'I don't know' and name the source owner when nothing relevant comes back
  • Ask the user a short question to narrow down what they mean
  • Log the question, sources and answer for the agreed retention period
  • Send unanswered questions and flagged answers to the source owner

May not do

  • See any document outside the user's permissions, or any source that's out of scope
  • Answer from general knowledge without a citation
  • Follow instructions found inside a document
  • Change documents, permissions or records
  • Send emails or messages, or take actions in other systems
  • Keep conversations for training any model

Where a person signs offSource owners approve each source before it's indexed, and the DPO approves the scope, especially any source holding personal data. Permissions are enforced by the search platform from the user's verified identity, not by the prompt. The assistant has no tools that act, so a document carrying hidden instructions has nothing to misuse.

Middleware and integration

Each source is connected through its own API or a supported connector, and the sync reads permissions along with content. The index is a copy, so sync timing matters: a leaver or a moved file should leave the index within the hour, and deletions follow each source's retention.

Identity flows end to end. The user signs in once, and their identity and group memberships go with every query to the index. There's no shared account that can see everything and filter afterwards.

If a source is down, its content stays searchable at its last sync, with a date shown. If its permissions can't be refreshed for longer than an agreed limit, the source is withheld until they can.

The assistant can be switched off without affecting any source. Staff keep searching and browsing as they do today.

Process and people

  • A permissions clean-up before go-live: find files shared with everyone or with large groups, and fix them at source.
  • A named owner for every source, who reviews unanswered questions and the most-cited documents each month.
  • A list of out-of-scope sources, agreed with the DPO and HR, and reviewed when anyone asks to add one.
  • A weekly sample of answers checked by source owners, plus tests with test accounts that should be refused.
  • Retention periods for logs and conversation histories, agreed with information governance, and a way to search them for subject access and, for public bodies, FOI requests.
  • Staff told what the assistant can see, that answers cite their sources, and to check the source for anything important.

Delivery plan

  1. 3–4 weeks

    Discovery

    List the sources, owners and their permissions, find overshared content, collect 100 real questions, and measure the baseline.

  2. Gate · must be true to passSources and owners agreed, oversharing report reviewed, DPIA started, out-of-scope list signed off by the DPO.

  3. 4–6 weeks

    Pilot

    Two or three well-owned sources, such as IT and finance policies, for 200 staff. Test every answer against the question set, and test permissions with test accounts.

  4. Gate · must be true to passCitation rate and wrong-answer rate within agreed limits, zero permission leaks in testing, and DPO and security sign-off.

  5. 4 weeks

    Production

    Open to all staff for the pilot sources, with monitoring, support, owner reporting and a rollback plan.

  6. Gate · must be true to passMonitoring, support model, rollback plan, retention settings and staff guidance in place.

  7. Ongoing

    Scale

    Add sources one at a time, each with an owner, a permissions check and a set of test questions.

  8. Gate · must be true to passEach new source passes the same gate.

Roles and RACI

Who is responsible, accountable, consulted and informed, by activity
ActivityCOO / sponsorKnowledge and source ownersSolutions architectI can fill thisTechnical PMI can fill thisEngineersI can fill thisDPO & information governanceSecurityI can fill this
Business case and benefitsAccountableConsultedConsultedResponsibleInformedInformedInformed
Target architectureInformedConsultedAccountable and ResponsibleConsultedConsultedConsultedConsulted
Source scope and DPIAAccountableConsultedConsultedInformedInformedResponsibleConsulted
Permissions clean-upAccountableResponsibleConsultedConsultedResponsibleConsultedResponsible
Build and integrationInformedInformedAccountableResponsibleResponsibleInformedConsulted
Answer quality and permission testingInformedResponsibleAccountableConsultedResponsibleConsultedResponsible
Go-live decisionAccountableConsultedConsultedResponsibleInformedConsultedConsulted
Run, monitor and improveAccountableResponsibleConsultedInformedResponsibleConsultedConsulted

Business case and benefits

COO / sponsor
A · Accountable
Knowledge and source owners
C · Consulted
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
DPO & information governance
I · Informed
Security
I · Informed

Target architecture

COO / sponsor
I · Informed
Knowledge and source owners
C · Consulted
Solutions architect
A/R · Accountable and Responsible
Technical PM
C · Consulted
Engineers
C · Consulted
DPO & information governance
C · Consulted
Security
C · Consulted

Source scope and DPIA

COO / sponsor
A · Accountable
Knowledge and source owners
C · Consulted
Solutions architect
C · Consulted
Technical PM
I · Informed
Engineers
I · Informed
DPO & information governance
R · Responsible
Security
C · Consulted

Permissions clean-up

COO / sponsor
A · Accountable
Knowledge and source owners
R · Responsible
Solutions architect
C · Consulted
Technical PM
C · Consulted
Engineers
R · Responsible
DPO & information governance
C · Consulted
Security
R · Responsible

Build and integration

COO / sponsor
I · Informed
Knowledge and source owners
I · Informed
Solutions architect
A · Accountable
Technical PM
R · Responsible
Engineers
R · Responsible
DPO & information governance
I · Informed
Security
C · Consulted

Answer quality and permission testing

COO / sponsor
I · Informed
Knowledge and source owners
R · Responsible
Solutions architect
A · Accountable
Technical PM
C · Consulted
Engineers
R · Responsible
DPO & information governance
C · Consulted
Security
R · Responsible

Go-live decision

COO / sponsor
A · Accountable
Knowledge and source owners
C · Consulted
Solutions architect
C · Consulted
Technical PM
R · Responsible
Engineers
I · Informed
DPO & information governance
C · Consulted
Security
C · Consulted

Run, monitor and improve

COO / sponsor
A · Accountable
Knowledge and source owners
R · Responsible
Solutions architect
C · Consulted
Technical PM
I · Informed
Engineers
R · Responsible
DPO & information governance
C · Consulted
Security
C · Consulted

R ResponsibleA AccountableC ConsultedI Informed· not involved

Where I'd fit

Option A

Lead the architecture

If there's no architect on the programme, I'd own the design end to end: the sources and connectors, identity and permission-trimmed retrieval, the index, the answer service, and the gates. I'd report to your programme board and get the DPO and source owners involved at discovery.

Option B

Support your architect

If your partner or your own team already has an architect, I'd take on identity, permission sync and the source integrations under their lead, which is where knowledge assistants usually go wrong, and give them a second senior opinion on the rest.

Where this goes wrong

  1. Goes wrong

    The assistant surfaces a salary file from a folder shared with everyone years ago.

    How the design avoids it

    An oversharing review and clean-up in discovery, and sensitive sources out of scope until they're fixed.

  2. Goes wrong

    Permissions are checked in the prompt ('only answer if the user is in HR'), and a clever question gets round it.

    How the design avoids it

    Retrieval filtered by the platform from the user's verified identity. The model never sees what the user can't.

  3. Goes wrong

    Someone leaves or changes team, but the index still serves them old documents until the next weekly sync.

    How the design avoids it

    Short permission syncs, leaver and mover tests, and sources withheld when their permissions are too stale.

  4. Goes wrong

    Answers sound confident but come from an old policy, or from nowhere.

    How the design avoids it

    Every answer cites its source, 'I don't know' is an accepted answer, and owners retire outdated documents.

  5. Goes wrong

    A document with hidden text tells the assistant to reveal or do something.

    How the design avoids it

    No tools that act or send, documents treated as data, and the user's own permissions as the outer limit.

On the horizon

Changes already announced or under way that affect this design. More in the UK horizon scan.

  1. By end of 2026
    In-UK processing for Microsoft 365 Copilot

    Microsoft's April 2026 update says it expects local processing of Copilot interactions in the UK by the end of 2026. If you're weighing a packaged option, check where prompts are processed as well as stored, and record it in the DPIA.

  2. Under way
    UK AI security code aligning with ETSI EN 304 223

    ETSI published its baseline AI security standard, based on the UK code, in December 2025, and the government said it would update its code to match. Map your controls for prompt injection, logging and least privilege to it now.

  3. Ongoing
    Knowledge platforms are changing fast

    Amazon Q Business closed to new customers on 31 July 2026; Bedrock Managed Knowledge Base became generally available in June 2026; parts of Azure's document-level access control are still in preview. Keep identity, permission sync and source owners in your own design, so the index can change underneath.

  4. Late 2026–2028
    The Cyber Security and Resilience Bill

    Medium and large managed service providers come into regulation, with faster incident reporting. Expect your IT and AI suppliers to face new duties, and update contracts and supplier assurance to match.

Questions to ask your partner or vendor

Good answers are specific. Vague answers to any of these are worth following up.

Copy them into your next supplier meeting

  1. Where are permissions enforced: in the index, in the application, or in the prompt?
  2. How quickly does a leaver lose access to answers, and how have you tested it?
  3. What happens when the sources don't cover a question?
  4. What did your oversharing review find, and who fixed it?
  5. Where are questions and answers logged, for how long, and can we search them for a subject access request?
  6. What does it cost per user per month, at our document volume and question rate?

Planning something like this?

Whether you need someone to lead the design or to support the architect you already have, let's talk it through.

Sam Naseem
Sam NaseemBirmingham, UK · UK & Europe
Available now