A recent survey conducted by the Pew Research Center reveals a significant demand for transparency regarding the use of artificial intelligence (AI) in healthcare. Over 70% of nearly 5,000 American adults surveyed emphasized the necessity for healthcare providers to disclose when AI technology is utilized in medical decisions, such as interpreting medical scans, diagnosing health conditions, and clarifying lab results.
Patient awareness extends beyond core functions; a majority of respondents also indicated a desire to be informed when AI is employed for tasks like note-taking during appointments, managing prescription refills, or scheduling visits.
Trust plays a critical role in shaping public perception of AI in healthcare, according to Andrew Crawford, senior counsel of data and privacy at the Center for Democracy and Technology. While the information that physicians input into AI systems—be it for scribing or diagnostics—is subject to the privacy regulations of the Health Insurance Portability and Accountability Act (HIPAA), it’s crucial that patients comprehend these safeguards and feel confident that their data isn’t being exploited for advertising purposes or sold to third-party data brokers.
Crawford stressed the importance of providers communicating the tools they utilize, particularly innovative technologies like AI, so patients can make informed choices about their care. Nearly half of those surveyed expressed uncertainty about whether AI is utilized in their healthcare settings.
To foster trust, patients should feel empowered to inquire about the role of AI in their treatment, its functioning, the extent of the physician's involvement, and the options available should they prefer to avoid AI applications in their care.
An ongoing class action lawsuit against Sutter Health and Memorial Care underscores patient concerns regarding AI’s role in recording sensitive patient-provider interactions. The lawsuit alleges that medical personnel used AI tools to document confidential communications without gaining prior consent, potentially breaching state and federal laws.
Abridge AI, the clinical documentation service at the heart of these legal challenges, is currently employed by numerous health systems across the country. For instance, Kaiser Permanente implemented it in 40 hospitals and over 600 medical offices in 2024, while the Mayo Clinic incorporated it for roughly 2,000 clinicians serving over 1 million patients in early 2025.
Kaiser Permanente asserts that their usage of the tool mandates patient consent, and that all AI-generated notes will undergo human review before being added to medical records.
There are also concerns about the accuracy of AI systems, as Crawford noted. AI scribes can enable physicians to focus more intently on patient conversations, but inaccuracies in transcription could jeopardize patient safety through misdiagnoses or incorrect prescriptions. Crawford urged that clinicians using these technologies, even for administrative tasks, must ensure their accuracy and undergo thorough testing and evaluation, both prior to and following their deployment, to confirm they serve the intended purpose effectively.
