OpenAI announced Wednesday the launch of ChatGPT Health, a specialized version of its AI chatbot designed for health and wellness conversations that will allow users to connect their health and medical records. The feature aims to provide personalized health responses by summarizing care instructions, preparing users for doctor appointments, and helping them understand test results.

The integration of generative AI into healthcare has been a contentious topic since ChatGPT's debut in late 2022, due to concerns about accuracy and potential misuse. Generative AI, like that used in ChatGPT, creates new content based on the data it is trained on, but it is prone to inaccuracies and can sometimes fabricate information.

The announcement comes shortly after SFGate published an investigation detailing the death of a 19-year-old California man in May 2025, who had sought recreational drug advice from ChatGPT for 18 months. The report highlighted the risks associated with relying on AI chatbots for critical guidance, particularly when the AI's safety measures fail. This incident serves as an example of the potential dangers when individuals act on erroneous AI advice.

Despite these known limitations, OpenAI's new Health feature will enable users to link medical records and wellness applications, such as Apple Health and MyFitnessPal, to ChatGPT. This raises concerns about the reliability of the information provided and the potential for users to misinterpret or misuse AI-generated health advice.

Experts caution that while AI can assist in healthcare, it should not replace professional medical advice. The technology's tendency to generate inaccurate or misleading information poses a significant risk, especially when dealing with sensitive health matters. The long-term implications of using AI in healthcare are still being evaluated, and ongoing research is needed to ensure patient safety and data privacy.