Case study · Healthcare AI platformClient build

Engineering a Five-Product Healthcare AI Platform, and the AI Roadmap Ahead

A healthcare software company sells five products on one platform: clinical documentation, dictation, referral tracking, patient texting and payer-rate benchmarking. We engineered the products and the AI inside them: LLM agents that draft clinical notes behind guardrails, speech models for dictation, and deterministic engines for referrals, texting and rate benchmarking. Then we mapped the 24-month roadmap that adds seven more agents, in the order that is easiest to verify.

Published Oct 4, 202618 min read

See the five use cases
Illustration: the five products that make up the platform.

Key takeaways

What we built
Five healthcare products on one platform: documentation, dictation, referral tracking, patient texting and payer-rate benchmarking.
The AI today
4 LLM agents in the documentation product, speech models in dictation, and deterministic engines in the other three.
The approach
AI where its output can be checked, ordinary code everywhere else, and a person who decides before anything is signed, filed or sent.
What is next
A 24-month roadmap adds 7 more agents behind one shared agent layer, in the order that is easiest to verify.

Results

  • 5

    Products on one platform

    documentation, dictation, referrals, texting, rate benchmarking

  • 4

    LLM agents live

    in the documentation product

  • 7

    Agents on the roadmap

    planned over eight quarters

  • 5

    Deterministic engines

    the core the agents sit on

Five products, five AI use cases

Each product has one clear job for AI, a bounded toolset and a human in the loop. Live means it is in the platform today. Roadmap means it is planned for the next phase.

Illustration of the use case with fictional demo content. Agents marked Roadmap are planned for the next phase and are not shipped yet.

Who uses it

Clinicians, especially in behavioral health, and the operations leads who want notes in one consistent format across a group.

The problem

Charting follows clinicians home. Formats drift between people, telehealth sessions get rewritten, and finished notes are re-keyed into the record.

What we built

A drafting workspace. Paste a transcript, upload a scan or join a meeting, pick a template and get a streamed note to review and sign. AI agents guard the input, draft only what was said, verify codes and build custom templates on request.

  • Transcripts, scanned documents and live meetings as inputs
  • Built-in note formats plus custom templates
  • AI editing: refine, expand and shorten
  • Standard code lookups for diagnoses, drugs and labs
  • Export to PDF, Word and text
  • Usage metered in credits

The AI agents inside

  • AI agentLive

    Input guardrail

    Gatekeeper

    Checks that the input is clinical before anything is drafted, and suggests a better template when it is not.

    Safeguard: Non-clinical or off-topic input never reaches the drafting agent.

  • AI agentLive

    Drafting agent

    Note writer

    Streams a structured note from the transcript and documents only what the transcript contains.

    Safeguard: It never invents or infers facts. Missing fields stay visibly empty so the clinician reviews before signing.

  • AI agentLive

    Code-check agent

    Verification

    Looks up diagnosis, medication and lab codes against standard reference services while it drafts.

    Safeguard: Codes come from reference lookups, not from the model’s memory.

  • AI agentLive

    Template builder

    Customisation

    Turns a plain-English description of a note format into a reusable template that a whole group can share.

    Safeguard: The user previews and edits the template before confirming it.

  • Python
  • FastAPI
  • React
  • LLM on a managed cloud platform
  • Streaming responses
  • Document OCR

How the platform fits together

Five products share one foundation. AI runs in the documentation and dictation products today. The roadmap adds a shared agent layer, so every product’s agents follow the same rules.

  1. Products

    What customers buy

    • Note Studio
    • Voice Desk
    • Handoff
    • Nudge
    • Rate Lens
  2. AI agents today

    In documentation and dictation

    • Input guardrail
    • Drafting agent
    • Code-check agent
    • Template builder
    • Speech engine
  3. Shared agent layerNext

    The first thing the roadmap builds

    • Guardrail at the door
    • Bounded toolsets
    • Provenance and quotes
    • Human review
    • Audit log
    • Evaluation sets
    • Usage metering
    • Kill switches
  4. Deterministic core

    Where the facts live

    • Rules and routing
    • Queries and reports
    • Workflow engine
    • Records
  5. Platform

    What every product shares

    • Sign-in and licensing
    • Per-seat billing
    • Tenant-scoped data
    • Audit trail
    • Cloud data, queues and workers
On this page

About the Platform

A healthcare software company sells five products on one platform: clinical documentation, dictation, referral tracking, patient texting and payer-rate benchmarking. They share one login, one bill and one audit trail, and a customer can start with a single product and add others later.

We engineered the five products and the AI inside them, so the platform works both as five separate products and as one suite.

The Challenge

Healthcare staff lose their days to work that is mostly reading, re-typing and chasing: charting after the visit, keying referrals in from emails and scans, calling patients who do not pick up, and trying to read payer rate files that nobody designed for humans.

That is the right territory for AI agents, and also the risky one. The data is protected health information, the decisions affect patients, and a confident wrong answer costs more than a slow right one. So the question is not whether to add agents, but where, in what order and with what limits.

Our Approach: AI Where It Can Be Checked

We did not bolt chatbots onto five products. The rule is simple: AI goes where its output can be checked, and everything else stays in ordinary code. Where agents run today, in the documentation product, they follow the rules below, and the roadmap extends them to every product.

  • Deterministic core first: The numbers, routing rules and records stay in ordinary code and queries. Agents read, draft and propose on top of them.
  • A guardrail at the door: The documentation agents check that input is clinical before anything is drafted, and refuse the rest.
  • Bounded toolsets: Each agent gets a short list of things it may do, such as reference lookups for codes, and nothing else.
  • Provenance: The drafting agent documents only what the source contains and leaves gaps visibly empty. The roadmap extends this to quoting the exact source line for every extracted value.
  • A person decides: Agents draft, flag and propose. A clinician, coordinator or analyst confirms before anything is signed, filed or sent.
  • Audit and evals: The roadmap makes evaluation sets and audit logging standard for every agent, so changes are measured rather than guessed.

What We Built

Five products on one platform, each doing one job well.

  • Note Studio: A drafting workspace for clinical notes. Paste a transcript, upload a scan or join a meeting, pick a template, and an input guardrail, a drafting agent, a code-check agent and a template builder produce a note for the clinician to review and sign.
  • Voice Desk: A desktop dictation app that records the visit, transcribes it with speaker labels and pastes clean text into whichever application is in focus, with voice commands, snippets and a personal dictionary.
  • Handoff: A referral workflow from send to acknowledge, accept or decline, with patient details revealed in stages, provider identity checks, reminders and expiry, and rules-based triage that routes each referral.
  • Nudge: Two-way patient texting with consent tracking, approved templates, timed reminders, follow-ups when nobody replies and a task queue for exceptions, run by a workflow engine with an audit log.
  • Rate Lens: A payer-rate benchmarking workspace that compares negotiated rates by procedure code with peer and market averages by state and payer, with a branded report.
  • One platform underneath: Shared sign-in and licensing, per-seat billing, tenant-scoped data and an audit trail across all five.

The Engineering Decisions Behind It

Ordinary code where facts matter: Rates, routing rules, records and workflows are deterministic. Three of the five products need no model at all, and that is the right answer for them.

A guardrail before the model: The documentation agents check that input is clinical before anything is drafted, so out-of-scope text never reaches the drafting agent.

Reference lookups, not model memory: Diagnosis, medication and lab codes come from standard reference services while the note is drafted.

Draft only what was said: The drafting agent never invents or infers facts, and missing fields stay visibly empty so the clinician reviews before signing.

Staged disclosure of patient data: Referral details are revealed in stages as a referral progresses, so each party sees only what the stage requires.

Approved messages and enforced opt-outs: Texts go out only from approved templates, and opt-outs are enforced on the server rather than trusted to the interface.

One foundation for five products: Shared sign-in, licensing, billing and audit mean a customer can add a product without a second integration.

Safety and Privacy by Design

The data here is protected health information, so privacy is part of the architecture, not a checklist at the end. These are the rules we hold every agent to.

  • Minimum necessary data: Send a model only what the task needs, and keep identifiers out of prompts when a task does not require them.
  • Redaction in logs and telemetry: Logs and traces never carry patient details.
  • Tenant isolation: Each customer’s data is scoped on every query, so one customer can never reach another’s.
  • Agreements before data: Provider agreements covering protected health information are in place before any such data reaches a model.
  • Controls, not compliance claims: We build the controls. Compliance claims belong to the platform’s owner and its auditors.

Where It Stands Today

The platform runs five products on one foundation. 4 LLM agents work in the documentation product, speech models power dictation, and the referral, texting and benchmarking products run on deterministic engines. That spread is deliberate: it keeps AI where it can be checked, and ordinary code everywhere else.

The next step is a shared agent layer and the 24-month roadmap below: 7 more agents, rolled out in the order that is easiest to verify.

How we work

  1. 1

    Map where the minutes go

    Start from the people: clinicians, coordinators, the front desk and analysts, and where their time goes in each product.

  2. 2

    Pick one job per product

    Choose the one task where an agent saves the most time with the least risk, and leave the rest alone.

  3. 3

    Build the shared layer first

    Guardrails, bounded tools, audit, metering and an evaluation harness, used by every agent that follows.

  4. 4

    Ship one agent at a time

    Each behind a flag, with an evaluation set, a human review step and a rollback.

  5. 5

    Measure, then widen

    Judge each agent on real use against its evaluation set before giving it more to do.

  6. 6

    Operate and keep improving

    Run the evaluation loop continuously, review production samples, and retire or retrain any agent that drifts.

Technology

  • React and TypeScript
  • Node.js and Express
  • Python and FastAPI
  • Electron desktop app
  • Managed cloud LLM platform
  • Speech-to-text models
  • Cloud document database
  • Cloud data warehouse
  • Queues and background workers
  • PDF report generation

The 24-month roadmap

Eight quarters, five products and one shared layer. Each new agent moves through design, a pilot and a staged rollout, and the order follows how easy each one is to check, not how impressive it is. These are planning assumptions, not promises.

  • Build · Shared layer
  • Harden · Evals around what exists
  • Design · Scope, tools, eval set
  • Pilot · Few customers, review on
  • Rollout · Staged, in production
  • Operate · Steady state
Shared agent layer

Guardrails, bounded tools, audit, evals, metering

BBOOOOOO

Build Q1–Q2 · Operate Q3–Q8

Model portability and cost tuning

DDRRR

Design Q4–Q5 · Rollout Q6–Q8

Note Studio

Evals and audit around live agents

HHOOOOOO

Harden Q1–Q2 · Operate Q3–Q8

Voice Desk

Measure speech accuracy on real recordings

HH

Harden Q1–Q2

AINote-structuring agent

DDPRRR

Design Q3–Q4 · Pilot Q5 · Rollout Q6–Q8

Handoff

AIIntake agent

DDPRRRR

Design Q2–Q3 · Pilot Q4 · Rollout Q5–Q8

AIChase agent

DPR

Design Q6 · Pilot Q7 · Rollout Q8

Nudge

AIReply-understanding agent

DPPRRR

Design Q3 · Pilot Q4–Q5 · Rollout Q6–Q8

AITemplate-drafting agent

DPR

Design Q6 · Pilot Q7 · Rollout Q8

Rate Lens

AIAsk-the-data agent

DDPRR

Design Q4–Q5 · Pilot Q6 · Rollout Q7–Q8

AIContract-reader agent

DPR

Design Q6 · Pilot Q7 · Rollout Q8

Across the suite

Referral-to-visit loop

DDPR

Design Q5–Q6 · Pilot Q7 · Rollout Q8

AI agents in production, by quarter

Derived from the roadmap above. An agent counts once its rollout begins.

  • Live today
  • Added by the plan
4Today
4Q1
4Q2
4Q3
4Q4
5Q5
7Q6
8Q7
11Q8

How one referral travels through the suite

The suite earns its complexity when products hand work to each other. This is the journey of a single referral, and which steps are an agent, an engine or a person.

  1. RoadmapAgentHandoff

    1.A referral arrives

    The intake agent reads the email or document and proposes the structured fields, quoting the source text behind each one.

  2. HumanPersonA person

    2.A coordinator confirms

    Every field is checked against its quote before a referral is created. Nothing enters the queue unreviewed.

  3. LiveEngineHandoff

    3.Rules route it

    Screening and priority rules the practice configures send the referral to the right queue, the same way every time.

  4. LiveEngineNudge

    4.The patient is reached

    The workflow engine sends an approved message and handles yes, no and stop. A reply-understanding agent (planned) will read free-text answers and hand unsure ones to staff.

  5. LiveEngineVoice Desk

    5.The visit is captured

    The speech engine transcribes the visit with speaker labels. A note-structuring agent (planned) will draft a structured note from it, citing the lines it used.

  6. LiveAgentNote Studio

    6.The note is drafted and signed

    The drafting agent writes only what was said, the code-check agent verifies codes, and the clinician reviews and signs.

  7. LiveEngineRate Lens

    7.Rates are read against the market

    Separately, leaders compare contracted rates with peer and market averages. An ask-the-data agent (planned) will let them question the data in plain language.

How much each agent may do on its own

Every agent gets an explicit ceiling, agreed before it is built. The rule: nothing that touches a patient or a payer goes beyond drafting for a person to approve. Only read-only or refuse-only agents may act alone.

Note Studio

Input guardrailLive

Acts within limits

Blocks out-of-scope input on its own. It only refuses; it never acts on a record.

Drafting agentLive

Drafts for approval

Streams a draft. The clinician reviews and signs.

Code-check agentLive

Drafts for approval

Verifies codes against reference lookups and shows them in the draft.

Template builderLive

Drafts for approval

Previews a template. The user confirms it.

Voice Desk

Note-structuring agentRoadmap

Drafts for approval

Drafts from the transcript with line citations. Nothing is pasted until approved.

Handoff

Intake agentRoadmap

Drafts for approval

Proposes fields with source quotes. A coordinator confirms.

Chase agentRoadmap

Drafts for approval

Drafts the nudge. A person sends it.

Nudge

Reply-understanding agentRoadmap

Drafts for approval

Proposes the next step. Unsure or clinical replies go to staff untouched.

Template-drafting agentRoadmap

Drafts for approval

An administrator approves every template before it is used.

Rate Lens

Ask-the-data agentRoadmap

Acts within limits

Read-only. Chooses from approved queries and shows the result; it cannot change anything.

Contract-reader agentRoadmap

Drafts for approval

Proposes terms with clause quotes for a person to verify.

Keeping eleven agents honest

Shipping an agent is the start. Over two years the work is staying right while models, prompts, customers and inputs all change. One evaluation loop runs for every agent, for the life of the product.

  1. 1.Golden sets

    Curated, reviewed examples for every agent, written with the people who do the job.

  2. 2.Offline evals

    Every prompt, model or tool change is scored against the golden sets before it can ship.

  3. 3.Shadow mode

    The agent runs on real work with its output hidden, so we can compare it with what people did.

  4. 4.Pilot

    A few willing customers use it with the review step on and the kill switch ready.

  5. 5.Production sampling

    A sample of live outputs is reviewed on a schedule, with permission, to catch drift early.

  6. 6.Fix and re-baseline

    Failures become new golden examples, and the bar moves up for the next change.

  7. Then back to step 1, for the life of the product.

What can go wrong, and what stops it

A long-lived agent programme fails in predictable ways. Each risk has a named control, and each control is one of three kinds: it prevents the failure, detects it early, or contains the damage.

  • 3 prevent
  • 2 detect
  • 3 contain
  • Invented details

    An agent writes a plausible field, code or term that was never in the source.

    Quote the source for every extracted value, leave gaps visibly empty, and require a person to confirm.

    Prevent
  • Instructions hidden in documents

    A referral email or contract contains text that tries to give the agent orders.

    Treat inbound content as data, never as instructions. Agents get bounded tools and no path from document text to action.

    Prevent
  • Patient data in the wrong place

    Identifiers leak into logs, traces or a model request that did not need them.

    Minimum necessary data, redaction in logs and telemetry, and provider agreements in place before any protected data is sent.

    Prevent
  • Over-trust

    People stop checking because the agent is usually right.

    Review screens that force a decision, spot checks of approved work, and an autonomy ceiling that keeps a person in charge.

    Detect
  • Quiet quality drift

    Accuracy slides over months as inputs, prompts or models change.

    Continuous evaluation on golden sets and reviewed production samples, with alerts when scores fall.

    Detect
  • A provider change

    A model is retired or its behaviour shifts, and an agent starts failing.

    A thin model abstraction, versioned prompts and evaluation gates, so changes are tested and reversible.

    Contain
  • Runaway cost

    Usage spikes for one customer and costs follow.

    Per-customer metering and caps, with a graceful fall-back to the deterministic path.

    Contain
  • A bad day

    An agent misbehaves in production.

    A kill switch per agent and per customer, and a rehearsed incident playbook.

    Contain

Why the Roadmap Runs Two Years

Each agent has to pass through design, shadow mode, a pilot with a few customers and a staged rollout. That takes a quarter or more per agent, even with a shared layer, and some depend on others: reply understanding needs the outreach engine, and the referral-to-visit loop needs intake, outreach and documentation all working.

The second reason is trust. Healthcare customers adopt agents slowly and forgive them rarely. A plan that earns trust one safe agent at a time lasts longer than one that ships eleven at once.

  • Quarters 1 to 2, foundation: Build the shared layer and put evaluation and audit around the agents that already exist.
  • Quarters 2 to 6, the first new agents: Referral intake and reply understanding, the two with the clearest payoff and the easiest checks.
  • Quarters 3 to 7, widening: Note structuring for dictation, then ask-the-data for rate benchmarking.
  • Quarters 6 to 8, the hardest and the joined-up: Contract reading, follow-up chasing, template drafting, and the loop that links referrals, outreach and documentation.

The Operating Model

A plan this long needs owners. The plan is a small standing team that owns the shared layer, plus a named owner for each agent.

  • AI product owner: Decides which agent ships next, owns each autonomy ceiling and signs off every rollout stage.
  • Evaluation engineer: Owns the golden sets, the evaluation harness and the production-sampling process.
  • Platform engineers: Own the guardrails, tool gateway, audit log, metering and model abstraction.
  • Clinical and privacy reviewers: Review prompts, outputs and data flows before anything reaches a pilot.
  • Change control for prompts and models: Prompts and model versions are versioned, evaluated and rolled out behind flags like code, with a quick rollback.
  • A kill switch per agent and per customer: Any agent can be turned off for one customer or for all of them in minutes, without a deploy.

Cost and Scale

Agents add a new kind of running cost: model calls, speech minutes and, above all, human review time. Cost has to be designed in, per customer, from the first agent.

  • Meter everything: Every model call and speech minute is attributed to a customer and a product, so cost is visible before it is a surprise.
  • Right-size the model: Small, fast models for classification and routing, larger ones only for drafting, and caching wherever inputs repeat.
  • Cap and degrade gracefully: Per-customer limits with a clear fall-back to the deterministic path, so a cap never breaks a workflow.
  • Count review time: An agent that saves ten minutes but needs eight to check has not saved much. Measure the whole loop.
  • Plan for model change: Providers change models, prices and limits. A thin abstraction and a standing evaluation set make switching an evaluation exercise, not a rewrite.

Decisions to Make First

Before the first new agent is built, five decisions shape everything after. Getting them wrong is expensive; getting them early is cheap.

  • The autonomy ceiling: Agree in writing how much each agent may do alone. The proposal is that nothing that touches a patient or a payer goes beyond drafting for approval.
  • The data boundary: Decide what protected health information may reach a model, which provider terms must exist first, and what stays inside the platform.
  • The review experience: Design how people check agent work, because a slow or easy-to-rubber-stamp review screen quietly undoes every other control.
  • The definition of done: Agree the evaluation bar an agent must clear to leave pilot, before the pilot begins.
  • The shutdown rule: Agree in advance what level of error or complaint pauses an agent.

Where We Start

Sequence matters. The roadmap starts where the agent layer is already proven and the safeguards are easiest to verify, then widens.

  • First, harden what is live: Put evaluation sets and audit logging around the existing documentation agents, so they can be changed with confidence.
  • Second, referral intake: The highest-friction manual step, and a natural fit for an agent that quotes its sources.
  • Third, reply understanding: Extends the timed outreach already in place from keywords to free text, with staff catching anything unsure.
  • Fourth, ask-the-data and contract reading: Valuable, but they need the strictest query and provenance controls, so they come last.
  • Throughout, one shared layer: Each new agent reuses the guardrails, audit and metering, so it starts from something that already works.

Lessons you can reuse

  • Not every product needs an agent

    Three of the five run on deterministic engines, and that is the right answer. Add an agent only where it saves real time at acceptable risk.

  • One layer, not five chatbots

    Shared guardrails, audit and metering make each new agent cheaper to ship and safer to run than the last.

  • Quote the source

    Where an agent extracts or summarises, it shows the exact line it used. Checking takes seconds, and trust follows.

  • Sequence by how easy it is to verify

    Start where outputs are easiest to check, then widen. The strictest agents come last.

  • Set the autonomy ceiling first

    Agree how much each agent may do alone before it is built. Retrofitting limits onto a trusted agent is far harder than starting with them.

  • Count review time as a cost

    An agent that saves ten minutes but needs eight to check has saved little. Measure the whole loop, not just the model.

Questions

What did Brynex Labs build?

We engineered the five products and the AI inside them: the documentation agents, the speech engine for dictation, and the referral triage, texting and rate-benchmarking engines, all on one shared platform foundation.

Which agents are live today?

4 LLM agents run in the documentation product today. The other 7 agents are on the 24-month roadmap and are marked Roadmap throughout this page.

Why a two-year roadmap?

Each agent needs design, shadow mode, a pilot and a staged rollout, and several depend on each other. Spreading them over eight quarters earns customer trust one safe agent at a time, which lasts longer than shipping them all at once.

How do you handle patient data in AI features?

We design agents to receive only the minimum necessary data, keep patient details out of logs, scope every customer’s data on every query, and put provider agreements in place before protected health information reaches a model. Compliance claims belong to the platform owner and its auditors.

Can you build something similar for us?

Yes. We build AI agent layers with guardrails, audit and evaluation, and plan their rollout, for platforms of any size.

Your AI technology partner

Building with AI agents? Bring us the problem. We design, build and run it with you, and we can show you what we already run ourselves.

  • Agents built for production

    Evals, guardrails and observability ship with every agent, so it keeps working after launch.

  • A team that runs a live AI product

    Clinizy Care is ours. We know what breaks in production because we carry the pager.

  • Full-stack ownership

    App, API, AI and cloud from one senior team, with no hand-offs between vendors.

  • You own everything

    100% code and IP ownership, fixed-scope milestones and weekly demos.

Have an AI product to build?

Tell us what you're building. You'll talk to the engineers who ship AI agents for a living, and get a fixed-scope proposal before you commit.

All case studies