A source list is better than a confident blur

For a clinician, a connected assistant may reduce the scavenger hunt before a visit: what changed in the chart, which medication was updated, which specialist note is new, and which public label or coverage policy is current. That is the promise OpenAI is making.

But “source-backed” can become a decorative phrase if the interface does not make the sources inspectable. A useful answer should leave a compact trail: the chart item or public record it used, its date or version, and the part of the question it could not settle. A medication warning from DailyMed and a general explanation from a broad web source are not interchangeable. Neither is a one-year-old note and a result from last week.

OpenAI reports that physicians rated 99.1% of 4,363 responses safe across 27 evaluated clinical use cases, and that more than 93% of responses were rated “good” or better for accuracy across five connected public data sources. Those are company-reported evaluations of the described system—not proof that every deployment, patient record or future answer will be right. The useful part is the direction of the test: answers should surface evidence for a human to review, not ask people to trust a smooth paragraph because it sounds medical.

The missing fact should be visible too

More connections do not solve the oldest problem in health questions: the system may not have the one fact that changes the answer. A chatbot cannot examine someone, notice how a symptom presents, or reliably know which history detail was never entered. Mayo Clinic advises using AI for general education rather than diagnosis, cross-checking important information and protecting personal information.

That does not mean the technology is useless. It means the best prompt is often smaller. Ask for plain-language definitions, a list of questions to bring to an appointment, or help locating the official label behind a medication term. If a tool is summarizing a connected record, the result should plainly distinguish: “this is in the record,” “this came from a public source,” and “this needs confirmation.”

That last line is not an embarrassing failure state. It may be the safest and most useful thing the assistant says.

A practical standard for healthcare AI

Before relying on an AI assistant around health information, ask four dull questions. They are more useful than a feature list:

- Which record, source and date did this answer use? - What information could change the answer but is missing or uncertain? - Can I open the supporting source or chart item without starting the search again? - What is the next question for my clinician, pharmacist or care team?

The point is not to turn a ten-minute appointment into a new software chore. It is the opposite. If a chatbot helps someone arrive with the right question and a clearer understanding of the paperwork in front of them, it has done real work. If it leaves them with a frightening answer, no source trail and another tab to investigate, it has merely moved the confusion around.