Should you use ChatGPT for medical advice? New study urges caution against total reliance on AI

A surprising discovery reveals health struggles for which users need urgent care. Reports indicate that more than 230 million people a week ask ChatGPT for medical advice, ranging from checking whether foods are safe to eat to seeking remedies.

The study found that while the tool generally handled obvious exigencies, it underestimated more than half of the cases that required emergency care.

A research team created 60 structured clinical scenarios across 21 medical specialties with cases ranging from minor conditions appropriate for home care to real emergencies.

The study also examined how the model responded to users experiencing self-harm and found similar results. The authors noted that the AI responded more reliably for the patients without deliberate self-harm than to those witty it. This suggests that the pattern was not merely inconsistent but revealed a self-contradictory trend in how the model handles sensitive cases.

Is it safe to use ChatGPT for health?

The researchers are not suggesting that consumers should scrap AI health initiatives altogether.

In this connection, Alvira Tyagi, second author of the study said: “ As a medical student training at a time when AI health tools are already in the hands of millions, I see them as technologies we must learn to integrate thoughtfully into care.”

Further, the study reveals that individuals experiencing worsening or concerning symptoms-including chest pain, severe allergic reactions-should seek medical care rather than solely relying on chatbot guidance. Similarly, AI language models are continuously evolving and updated as performance changes over time. The rapidly changing reality needs to be analyzed, and technological improvements need deep observation.