Assistencia Labs
For clinicians

Ambient AI scribes: the clearest near-term win, and its limits

Of all the ways AI is entering clinics, ambient documentation is the one clinicians actually feel. Here is what it does well, and where you still have to be careful.

By Ajay Bansal··5 min read
Ambient AI scribes: the clearest near-term win, and its limits

The first three pieces in this series were, fairly, a little sceptical. Diagnostic and predictive models are where clinical AI most often overpromises. So it is worth being just as clear about the flip side: there is one application where AI is already giving clinicians something they can feel, week to week, and it is not diagnosis. It is paperwork.

Ambient AI documentation, often called an AI scribe, listens to a clinical conversation and drafts the note. It is the most tangible near-term win in the whole field. It is also not free of risk, and the risks are different from the ones we have discussed so far. This piece covers both.

The burden that created the demand

To understand why ambient scribes landed so hard, look at where a clinician's day actually goes. A well-known time-and-motion study in Annals of Internal Medicine found that for every hour physicians spent in direct contact with patients, they spent close to two more hours on the electronic health record and desk work, and then took still more documentation home in the evening, the phenomenon clinicians wearily call "pajama time."

That burden is not just tiring. Time lost to documentation is consistently linked to burnout, and burnout is linked to clinicians cutting hours or leaving. Anything that gives that time back is not a productivity nicety; it is a workforce intervention. That is the itch ambient AI scratches.

What an ambient scribe actually does

The workflow is simple to describe. With the patient's knowledge and consent, the tool captures the visit conversation, and a language model turns it into a structured draft note: history, examination findings, assessment, plan. The clinician then reviews, corrects, and signs.

The important word is draft. The clinician is still the author of the record and remains responsible for every word in it. A good ambient scribe changes the clinician's job from composing a note from a blank screen to editing a solid first draft. That is a smaller task, and crucially it is one that can happen during or right after the visit rather than at 10pm.

The evidence so far

The encouraging news is that this is being studied at real scale, not just demoed. One of the largest evaluations to date came from The Permanente Medical Group, which deployed an ambient AI scribe to thousands of physicians across hundreds of thousands of patient encounters and reported reduced documentation time alongside positive feedback from clinicians and patients. In the same programme, the share of the visit that clinicians spent making eye contact rather than looking at a screen rose, from roughly 70 percent to 77 percent, a small number that captures something patients feel.

Two things make this result more credible than a typical vendor case study. It measured outcomes clinicians care about (time, experience) rather than a model metric, and it did so across a large, varied group rather than a hand-picked pilot. That is exactly the kind of evidence the evaluation piece argued you should demand.

The limits you must design around

None of this makes ambient scribes a set-and-forget technology. The failure modes are real and specific.

Fabrication and omission. Language models can produce fluent text that is subtly wrong, inventing a detail that was never said or quietly dropping one that was. Speech-to-text can mishear. A 2024 Associated Press investigation reported that a widely used speech-to-text model regularly invented content speakers never uttered, including imagined medications, even as tens of thousands of medical workers used tools built on it. In a clinical note, a confident fabrication is not a curiosity, it is a patient-safety and medico-legal problem. This is precisely why the clinician-signs-it model is non-negotiable: the draft is a convenience, the review is the safeguard.

The verification trap. The benefit only holds if clinicians actually read the draft carefully. If a tool is good enough that people start signing notes on autopilot, it quietly converts a documentation problem into an accuracy problem. Teams should treat "did the clinician meaningfully review this?" as a live quality question, not an assumption.

Consent and privacy. You are recording a patient conversation and sending it to software. Patients should be told, and told plainly, and given the option to decline. Where the audio goes, how long it is kept, and who can access it are governance questions, not settings to accept without reading.

It does not fit every encounter equally. Conversational visits suit it well. Procedures, terse encounters, multilingual consultations, and heavy background noise are harder. Expect it to help most where the visit is mostly talk.

Why this matters for an outpatient clinic

The economics here are friendlier than for diagnostic AI, and the reason is worth naming. The benefit of an ambient scribe (time saved, notes finished sooner, a clinician less drained at the end of the day) is easy to measure and does not hinge on a rare event or a life-or-death threshold. That is why documentation and other administrative tools, which the next piece turns to, tend to deliver returns faster and more reliably than clinical-prediction tools.

For a busy outpatient or rehabilitation clinic, where the same clinician sees patient after patient and the notes pile up, that is often the most sensible place to let AI in first: a task that is repetitive, time-consuming, and low-risk when a human stays in the loop.

What this means for you

If you are a clinician: an ambient scribe can genuinely give you time back, but only if you keep reading what you sign. Insist on patient consent and know where the recording goes.

If you lead a clinic or system: pilot it on conversational, high-volume clinics first, measure documentation time and clinician experience, and make "meaningful review before signing" an explicit standard rather than a hope.

If you build these tools: the frontier is not fluency, it is faithfulness. Surfacing uncertainty, flagging low-confidence passages, and making omissions visible will matter more than a smoother paragraph.

Documentation is the clearest example of AI helping with the work around care rather than care itself. The next piece stays on that ground and takes on the paperwork clinicians resent most: coding, billing, and prior authorization.

Browse the full AI in Healthcare series.

References

  1. Sinsky C, Colligan L, Li L, et al. Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties. Annals of Internal Medicine. 2016;165(11):753-760. https://www.acpjournals.org/doi/10.7326/M16-0961
  2. Tierney AA, Gayre G, Hoberman B, et al. Ambient Artificial Intelligence Scribes to Alleviate the Burden of Clinical Documentation. NEJM Catalyst Innovations in Care Delivery. 2024. https://catalyst.nejm.org/doi/full/10.1056/CAT.23.0404
  3. Melnick ER, Dyrbye LN, Sinsky CA, et al. The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians. Mayo Clinic Proceedings. 2020;95(3):476-487. https://www.mayoclinicproceedings.org/article/S0025-6196(19)30836-5/fulltext
  4. Burke G, Schellmann H. Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said. Associated Press investigation, October 2024 (syndicated). https://www.columbian.com/news/2024/oct/28/researchers-say-an-ai-powered-transcription-tool-used-in-hospitals/