Ambient Voice Transcriptions Endorsed in a Study by The Permanente Medical Group

This study provides encouraging data on some of these questions. Evaluating This Study TPMG, as most readers know, is the largest medical group in the United States, with nearly 9,800 physicians and 44,000 nurses and other staff. After deploying the Nabla ambient voice solution in October 2023, the organization quickly built up a large database of AI-generated clinical notes to run through their study. Note that this study was carried out by the team at TPMG who installed the ambient voice solution. A study by an independent organization would be more authoritative.  But results were strong enough for us to pay attention. To evaluate AI-generated notes, researchers used the standard PDQI-9 metric. Note that this metric has been criticized for inconsistent results and inaccuracy. Furthermore, the researchers modified the PDQI-9 by removing one domain or scale, and adding two others. It’s hard to tell how the changes might reflect the measure’s accuracy. Still, results were impressive enough in the accuracy of transcriptions to make the study worthwhile. For instance, transcripts achieved, on average, 48 out of a possible 50 points on the “free from bias,” “synthesized,” “internally consistent,” and “succinct” domains. The researchers added surveys to verify anecdotal evidence that patients like the AI solution. Although that survey had a small number (21) of respondents, it’s good to know that 71% of patients...
Source: EMR and HIPAA - Category: Information Technology Authors: Tags: AI/Machine Learning Ambulatory C-Suite Leadership Clinical Communication and Patient Experience EMR-EHR Health IT Company Healthcare IT Ambient Voice Technology EHR Clinical Documentation Healthcare Generative AI Nabla PDQI-9 The Source Type: blogs