Document intelligence to business intelligence

Getting information out of PDFs and into something the business can decide with.

Document intelligence, also called intelligent document processing or IDP, turns unstructured source material (PDFs, scans, email, forms) into structured data that lands in a warehouse and drives business intelligence. It is where most enterprises meet agentic AI first, and the pattern most likely to stall between a convincing extraction demo and a number a business will actually act on. Tenhaw has delivered this end to end on Azure: a working proof of concept in two weeks, on a live engagement in the London insurance market, covering ground that had previously taken roughly twelve months.

Theme
Whole programmes
Read time
14 minutes
Questions answered
18 in full
Updated
Evidence basisDelivered, with the limit stated
Usually engaged as
Agentic Proof of Concept. 2–4 weeks, Fixed price · £20k–£55k.
see the engagement →
Evidence basis

We have done this, and here is exactly how far that goes.

We have delivered this pattern end to end, on Azure, on a live engagement, as a working proof of concept rather than a production system. What follows is written from that work rather than from vendor documentation. The provider notes below set out where the clouds genuinely differ.

On this page

The demand signal

Document work is usually where an organisation meets agentic AI first, because the source material already exists, nothing is customer-facing, and the value is easy to describe to a board. It is also the pattern where the published engineering literature is bluntest about the gap between a demo and a system: a study of three production retrieval implementations concluded that validating one is only feasible during operation, and that the robustness of such a system evolves rather than being designed in at the start. That is the four failures below, arrived at from the other direction.

Why it stalls

4 failure modes we keep meeting

The demo extracted beautifully, and it became a proof of concept that never shipped

Extraction accuracy on a curated sample tells you almost nothing about accuracy on the long tail: the scanned fax, the amended schedule, the document where the important number is in a footnote. This is the commonest shape of a proof of concept that never shipped. The programme discovers that 95% accuracy is unusable for a process that requires a defensible number, nobody designed the exception path, and the work stops in the gap between impressive and usable.

Nobody agreed what a correct answer is, so accuracy became an argument

Two experienced underwriters will disagree about what a document says. If you have not established ground truth with the people who own the decision, you cannot measure the system, and every accuracy conversation becomes an argument about the benchmark rather than the model. Pilots stuck in that argument do not fail a test, they simply never get one, which is why they can sit unresolved for quarters.

The extraction works, the BI layer is not ready, and the programme stalls there

This is the most common failure and the least discussed. You now have structured data with no semantic layer, no agreed definitions, and no governance, so the business gets confident answers drawn from the wrong table. The bottleneck moves from the model to the data foundations, and the programme is not resourced for it, so a technically successful pilot sits waiting on a data programme nobody has funded.

Expert review became the bottleneck, because it was built as a queue

Every serious implementation keeps humans in the loop. Most implement it as a review queue that is worked in order, which means scarce expert time is spent uniformly across easy and hard cases. Routing by confidence and consequence is what makes the economics work, and it is usually retrofitted after the queue becomes the bottleneck. Until it is, the business case shows a saving that the operation cannot feel.

How we approach it

7 moves, in order

  1. 01

    Extract to markdown first, then narrow to the fields that matter

    The pipeline we ran starts by using a language model to turn each source document into a markdown representation of itself, and only then narrows to the key fields. Extracting to an intermediate readable form first means the extraction is inspectable by a human and re-runnable when the field list changes, rather than being a black box from PDF to database column.

  2. 02

    Normalise, then enrich, then add semantics

    Extracted fields are normalised into consistent formats, enriched against third-party APIs, and then given semantic enhancement (context and thematic grouping) so downstream logic is working with meaning rather than strings. Each stage is separable, which matters because the enrichment and semantic stages are where accuracy problems are usually diagnosable.

  3. 03

    Requirements as a machine-readable corpus

    The document types, the fields, the validation rules and the edge cases go into structured markdown before any build, and we run the gap-and-contradiction pass over them. On the insurance engagement this surfaced ambiguities the business had not realised were ambiguous, and resolving them took a conversation rather than a rebuild.

  4. 04

    Build against the whole requirement set, paired with your engineers

    The build follows our published AI-engineering-first method: a blank repository, high-level prompts against the full corpus, a security review roughly every fifth prompt, and pair-programming throughout. On the insurance engagement the client's own engineer finished a two-week build 70% confident they could run the process unaided.

  5. 05

    Score confidence by source, not just by model certainty

    On the same engagement we scored confidence using the provenance of the data, which third-party enrichment source it came from, alongside model certainty and a search-based cross-check. A model's own confidence is a weak signal on its own; combining it with where the data came from is what makes routing decisions defensible to the people who own the outcome.

  6. 06

    Land it in business logic and a dashboard, not a database

    The final stages apply business logic to interpret the enriched, semantically grouped data and surface it in an internal dashboard. This is the step that distinguishes document intelligence from document extraction, and it is the one most often descoped when a programme runs late, which is how organisations end up with a populated table nobody uses.

  7. 07

    Treat the semantic layer as in scope, not someone else's problem

    Structured output is worthless if the BI layer answers confidently from the wrong table. Agreed definitions, a governed semantic layer and lineage back to the source document are part of the work, because without them the programme delivers extraction and not intelligence.

Structured output is worthless if the BI layer answers confidently from the wrong table.

Where the cloud actually matters, and where it does not

The hard parts of this pattern (ground truth, exception design, human routing, semantic layer, lineage) are provider-independent, and they are where programmes fail. The provider-specific decisions are the document-understanding service and its handling of layout and tables, how identity and permissions propagate from the source repository through to the warehouse, and what the residency position is for the documents themselves. We have delivered this on Azure. On AWS and Google Cloud the architecture shape is the same and the service choices differ; an engagement there applies the method rather than repeats a delivery, and we say so at the point of engagement.

Ask a technical questionanswers from all 13 guides
Ask anything technical about document intelligence to business intelligence and I will answer from this guide, and tell you first whether this is work we have delivered or an approach we would be taking.

Prefer to talk it through? Ask us on a discovery call →

engage via

Talk to us about document intelligence to business intelligence.

A 30-minute call with James Rooney. We'll tell you honestly which parts of this we have done before and which we would be doing for the first time, and you'll leave with a rough scope either way.

most start with a fixed-price AI Readiness Audit · £44,000 · 4 weeks · working prototypes

// pick a slot · cal.com/tenhaw/professional-servicesLIVE CALENDAR

Calendar not loading? Open it on cal.com or email hello@tenhaw.com.

Questions this guide answers

How long does a document intelligence proof of concept take?

Two to four weeks for a working proof of concept against one document type and one real workflow. On a live engagement in the London insurance market, Tenhaw delivered a working proof of concept extracting information from PDFs into business intelligence on Azure in two weeks, ground the business had been circling for roughly a year. Productionising it is a separate phase, scoped at four to six weeks with a dedicated team.

Why do document extraction projects stall after the demo?

Usually for one of four reasons: accuracy on a curated sample does not survive the long tail and no exception path was designed; nobody established what a correct answer is, so every accuracy discussion becomes an argument about the benchmark; the extraction works but the BI layer has no semantic layer or governance, so the business gets confident answers from the wrong table; or human review was built as a queue rather than routed by confidence and consequence, so expert time becomes the bottleneck.

Our document AI proof of concept worked and never shipped. What now?

Start by working out which of the three gaps you are in, because they need different money and different people. Tenhaw does that diagnosis before scoping a build. If accuracy collapsed on the long tail, the missing piece is exception routing rather than a better model. If nobody can agree what a correct answer is, the next work is a ground-truth set built with the people who own the decision, and it is a fortnight rather than a phase. If the extraction is fine and the numbers are not trusted, you are waiting on a semantic layer and lineage, a data programme with a different sponsor and a different budget line. A proof of concept that never shipped is rarely blocked on the model.

What accuracy is good enough for document intelligence?

There is no universal number, and quoting one is a warning sign. The right question is what the exception path costs. A process that tolerates review can run at accuracy that would be unacceptable for straight-through processing. Design the routing first, by extraction confidence and business consequence, and the accuracy target falls out of it rather than being asserted up front.

Do we need to fix our data platform before doing this?

Not before a proof of concept, and yes before production. Whether the extraction is viable at all is the cheaper question to answer first, so run it against the estate as it stands. Tenhaw did exactly that for a London insurance market business, taking PDFs to business intelligence on Azure in a two-week proof of concept, ahead of any data platform work. But structured output with no semantic layer, agreed definitions or lineage produces confident answers from the wrong table, so data foundations belong in the productionisation scope rather than being discovered during it. That scope usually sits with a different sponsor and a different budget line, which is where programmes with working extraction and untrusted numbers get stuck.

What is intelligent document processing?

Intelligent document processing, or IDP, also called document intelligence, turns unstructured source material such as PDFs, scans, email and forms into structured data that lands in a warehouse and drives business intelligence. It is where most enterprises meet agentic AI first, because the source material already exists, nothing is customer-facing, and the value is easy to describe to a board. It is also the pattern most likely to stall between a convincing extraction demo and a number the business will actually act on, which is why exception handling, ground truth and the BI layer matter as much as the model.

How do you establish ground truth for document extraction?

Build a ground-truth set with the people who own the decision, before anyone argues about models. Two experienced underwriters will disagree about what a document says, so if the decision owners have not agreed what a correct answer is, every accuracy conversation becomes an argument about the benchmark rather than the system. Done properly it is a fortnight of work rather than a phase, built from real documents, including the long tail of scanned faxes, amended schedules and important numbers buried in footnotes, with the experts' disagreements resolved into agreed answers. Skip it and the pilot never fails a test, it simply never gets one, which is how document programmes sit unresolved for quarters.

What does a good document extraction pipeline look like?

Separable stages, in a deliberate order. First use a language model to turn each document into a markdown representation of itself, so the extraction is inspectable by a human and re-runnable when the field list changes, then narrow to the fields that matter. Normalise those fields into consistent formats, enrich them against third-party APIs, then add semantic enhancement, context and thematic grouping, so downstream logic works with meaning rather than strings. Finally apply business logic and surface the result in a dashboard, not just a populated table. Keeping the stages separable matters because enrichment and semantics are where accuracy problems are usually diagnosable.

How do you stop human review becoming the bottleneck in document AI?

Route work by confidence and consequence instead of building a first-in, first-out queue. Every serious implementation keeps humans in the loop, but most implement it as a queue worked in order, which spends scarce expert time uniformly across easy and hard cases until review becomes the bottleneck and the business case shows a saving the operation cannot feel. Score confidence using the provenance of the data, which enrichment source it came from, alongside model certainty and a search-based cross-check, because a model's own confidence is a weak signal on its own. Then send experts only the cases where low confidence meets real consequence.

Does it matter which cloud we use for document intelligence?

Less than the vendors suggest. Tenhaw has delivered this pattern end to end on Azure, including Azure OpenAI. A London specialty insurance proof of concept took PDFs to business intelligence in two weeks, ground the business had circled for roughly a year, with month three productionising it against the client's security standards. The parts where programmes actually fail, ground truth, exception design, human routing, the semantic layer and lineage, are provider-independent and transfer intact. What genuinely differs is the document-understanding service and how it handles layout and tables, how permissions propagate from the source repository through to the warehouse, and the residency position. On AWS or Google Cloud those service choices are scoped with your own platform engineers and priced into the engagement.

We already have an OCR tool. What would document intelligence add?

Everything that happens after the text comes off the page. Optical character recognition and template extraction solve the easy half, which is getting the characters out. Tenhaw builds the other half. Document intelligence carries those fields on: normalised into consistent formats, enriched against third-party sources, grouped semantically so downstream logic works with meaning rather than strings, then interpreted by business logic and surfaced somewhere people actually decide with. That last step is what separates document intelligence from document extraction, and it is the one most often descoped when a programme runs late, which is how organisations end up with a populated table nobody uses. If your current tool reads a stable template accurately and somebody already acts on the output, keep it.

How much does an intelligent document processing project cost?

In two pieces, and it is the second one budgets tend to miss. Tenhaw's Agentic Proof of Concept against one document type and one real workflow is a fixed £20,000 to £55,000 over two to four weeks, set by the complexity of the workflow and the state of the data underneath it. Productionising it is a separate phase, four to six weeks with a dedicated team, and an Agentic Build Team is £70,000 to £85,000 a month. Then there are the data foundations. A governed semantic layer, agreed definitions and lineage back to the source document usually sit with a different sponsor and a different budget line, and programmes that meet that late stall with the extraction working and the numbers untrusted.

Which document type should we start with?

One document type, one real workflow, and a workflow whose output somebody actually decides with. Document work is usually where an organisation meets agentic AI first because the source material already exists, nothing is customer-facing, and the value is easy to describe to a board, so the temptation is to pick the tidiest document type in the building. Resist it. Accuracy on a curated sample tells you almost nothing about the scanned fax, the amended schedule, or the important number sitting in a footnote. Choose something with real exceptions and a named destination for the data, or the proof of concept proves the wrong thing.

Who from the business needs to be involved in a document AI project?

Four groups, and missing any one of them is the usual cause of a stall. The people who own the decision, because ground truth has to be agreed with them and two experienced experts will disagree about what a document says. Your own engineers, because Tenhaw pairs with them throughout the build and the point is that your team can run it afterwards. Whoever owns the warehouse and the semantic layer, since agreed definitions and lineage are usually a different sponsor with a different budget line. And the operations people whose review time you are about to route by confidence and consequence instead of a first-come queue.

Will it handle tables and awkward layouts in our PDFs?

Layout and table handling is one of the genuinely provider-specific decisions in this pattern, so test it on your own documents rather than taking a vendor demo on trust. The pipeline shape helps, and Tenhaw ran this one on Azure for a London insurance market client. Each source document is first turned into a markdown representation of itself, which keeps what the model read inspectable by a human, and only then is it narrowed to the fields that matter. When a layout defeats it, you want that arriving as low confidence and routing to a person rather than as a confident wrong value in a dashboard. Design that exception path before anyone argues about which document-understanding service wins.

What happens when a document format changes after go-live?

Less than you would fear, if the pipeline was built in separable stages. Each document is first turned into a markdown representation of itself and only then narrowed to the fields that matter, so extraction stays inspectable by a human and re-runnable when the field list changes rather than being a black box from PDF to database column. A shape the pipeline has not seen before tends to arrive as low confidence, which is exactly what routing by confidence and consequence exists for. Validating a system like this is only feasible during operation, the published engineering literature says, and its robustness evolves rather than being designed in at the start.

Do our documents leave our own cloud during processing?

Not if the pipeline is deployed the way Tenhaw deploys it, on your infrastructure and under your policies. The delivered version ran end to end on Azure inside a London insurance market client's own regulated estate, with UK data residency the default and the EU available where that is the requirement. The residency question worth settling early is narrower than most people expect, coming down to which region the document-understanding service processes a file in and how identity and permissions propagate from the source repository through to the warehouse. Both are genuinely provider-specific, and both are far cheaper to answer before any documents move.

How do we trace a dashboard number back to the source document?

Design for it, because a sceptical reviewer asks for it first and it is not free. Three mechanisms do the work. Extracting each document into a readable markdown form before narrowing to fields keeps the extraction inspectable by a human rather than a black box. Confidence is scored using the provenance of the data, meaning which third-party enrichment source a value came from, alongside model certainty and a search-based cross-check, so you can say why a number was trusted. And lineage back to the source document belongs in the build alongside the semantic layer, because without it the programme has delivered extraction and not intelligence.