The realm of healthcare is experiencing a significant shift with the rise of artificial intelligence (AI), yet many people harbor reservations about its integration into medical practices. A recent KFF survey from October 2025 revealed that only 8% of Americans placed substantial trust in AI for managing appointments or analyzing their health records. Moreover, just 32% felt confident trusting an AI healthcare tool for personalized information based on their medical records.
In contrast, numerous healthcare providers and administrators view AI as a transformative asset that could revolutionize patient care. Data from a 2026 survey indicated that over 80% of physicians in the United States have adopted AI in their practices, a stark increase from previous years. Medical professionals are enthusiastic about AI’s capacity to enhance documentation accuracy during patient interactions, serve as a supportive resource for clinicians, and keep tabs on individuals at risk of serious health issues.
The contrast in perceptions regarding AI could exacerbate distrust between patients and providers, especially in a time when public confidence in healthcare is waning. Patients increasingly desire autonomy in their care, raising concerns about the role of AI in medical decisions when technology becomes pervasive in offices and hospitals.
A key concept in addressing these issues is the “human in the loop” approach. This principle emphasizes the necessity of human oversight in the use of AI within healthcare, potentially bridging the divide between patient expectations and medical practice. Surveys show that patients are more comfortable with their physicians utilizing AI as an assistant rather than relying on it independently. Most healthcare professionals also express a preference for AI to function in a supplementary role, rather than as a substitute for their clinical judgment. Consequently, there are genuine apprehensions among healthcare workers regarding job security, as evidenced by recent layoffs of nurses in New York City, who felt their roles were threatened by AI technologies. The “human in the loop” model seems to align the interests of both patients and healthcare providers at this crucial juncture.
According to Alison Callahan, a research scientist at Stanford University, healthcare professionals have always prioritized making optimal decisions for their patients, and AI can support that goal. There is a significant drive among providers to ensure the accuracy of these technological tools.
However, what does implementing the “human in the loop” concept involve? How can patients gain insights into how their physicians are leveraging AI? And what should you discuss with your healthcare provider regarding the increasing reliance on AI in managing health? To explore these questions, I connected with leading experts in the field.
AI is already being woven into the fabric of healthcare, with patients making use of AI chatbots for symptom assessment and wearable health trackers. Meanwhile, major medical institutions are developing elaborate protocols to enhance patient care on a broader scale.
The initial point of contact often involves public-facing AI language models like ChatGPT, where patients increasingly seek information about their health. Physicians are also turning to these tools for research updates and decision-making assistance.
On a broader scale, healthcare facilities are adopting AI for various operational tasks. Many are utilizing AI to organize and summarize patient notes, providing a clearer record of informal observations during consultations. Healthcare systems are also implementing AI for administrative duties, such as scheduling follow-ups, and utilizing it to assist patients with preparatory instructions for procedures like colonoscopies.
Additionally, one of the most ambitious applications of AI involves diagnostic and risk assessment capabilities. Here, AI can serve as a second opinion for triaging in emergency situations or help prioritize patient care based on urgency. Furthermore, these AI programs have the potential to track patient health, using data from wearables to identify who may need more intensive monitoring and care.
Despite its potential, the integration of AI into healthcare remains inconsistent, relying heavily on individual practitioners and institutions to develop their own systems and approaches. This variability emphasizes the importance for patients to proactively inquire about the role of AI in their care.
Experts agree that patients should feel empowered to engage with their healthcare providers about the use of AI, as it is crucial for maintaining trust in the physician-patient relationship. Timothy Keyes, a machine learning scientist at Stanford Health Care, advocates for transparent discussions about AI to strengthen shared decision-making.
Patients should feel comfortable asking their doctors pointed questions, such as whether AI will be involved in their care and how their data will be safeguarded. They should also have the option to decline participation in AI-driven processes they are not comfortable with. Additionally, it’s important for patients to understand how healthcare systems are ensuring the efficacy of AI tools.
Transparency is essential on both sides. If patients have consulted AI tools before their appointment, they should share that with their doctor. At the same time, they might also ask how they can responsibly utilize AI in their own health management.
This landscape presents an opportunity for patients and physicians to engage deeply in their healthcare discussions. Ultimately, the focus should remain on how decisions about patient care are made. Callahan emphasizes the importance of having open dialogues when treatment options are suggested, seeking clarity on how a physician's recommendations align with a patient’s unique health profile.
In conclusion, as AI continues to evolve within medical practice, fostering an informed partnership between doctors and patients can enhance the overall healthcare experience, regardless of the presence or absence of AI tools.
