Insights Commentary Research and Evidence Ethics, Regulation, and Responsible Use

The new clinical skill: Knowing when AI is wrong

May 07, 2026 By Deputy Editor: Vishnu Priya Pulipati, MD, FACE, DipABCL 5 min read
Share Share via Email Share on Facebook Share on LinkedIn Share on Twitter
Objective:

To highlight the importance of clinicians recognizing when AI-generated information may be incorrect or misleading.

Key Findings:
  • AI systems can generate polished responses that may not reflect true clinical reliability.
  • AI performs best in straightforward cases but struggles with complex clinical judgments.
  • Clinicians should ask specific questions to assess AI recommendations' applicability to individual patients.
Interpretation:

AI should be viewed as a collaborator that enhances clinical reasoning, rather than a replacement for independent thought.

Limitations:
  • AI may favor highly cited studies that do not apply to individual patient contexts.
  • AI can oversimplify complex clinical scenarios, leading to potential biases.
Conclusion:

Recognizing when AI is wrong is a crucial competency for modern clinicians, emphasizing the need for judgment in clinical practice.

AACE Endocrine AI is published by Conexiant under a license arrangement with the American Association of Clinical Endocrinology, Inc. (AACE®). The ideas and opinions expressed in AACE Endocrine AI do not necessarily reflect those of Conexiant or AACE. For more information, see Policies.

Related Content