A study published after Anthropic and OpenAI each unveiled dedicated AI initiatives for use in health care found that ChatGPT’s Health chatbot exhibited a 50% likelihood to give erroneous advice by recommending that users delay seeking care and yet the situation actually warranted immediate attention.
Such a high error rate wasn’t flagged prior to the rollout of the chatbot, and such an omission brings to light the mistake in the uptake of new tech systems without first subjecting them to rigorous testing by health authorities to ascertain the extent to which they can be relied upon. Mistakes subsequently made as the system is used could worsen the existing trust crisis that the healthcare system in the U.S. is grappling with.
There are instances that show that this is actually already happening. For example, one common algorithm has systematically downplayed the extent to which Black patients are actually sick because the technology was based on how much they were spending on medical care to grade how sick they were. Patients didn’t know the technology was basing its recommendations on their expenditure on medical care.
AI tools have also helped insurers providing Medicare Advantage coverage to double the rate at which they deny elderly patients coverage for care they need or receive. Nearly 8 in 10 such denials were overturned upon appeal by the affected patients. However, only a paltry 1% of such denials ever reach the appeals stage, so it is hard to imagine how many millions of patients don’t receive the care they need.
There are many more examples of how the use of AI in healthcare has adversely impacted the people who are supposed to be served by the system, and each time a patient is negatively affected, trust in the system erodes not just in the affected individual but also their family and others close to them.
This isn’t to say that AI is a bad thing for the healthcare system. Actually, the technology has immense potential in aiding diagnosis, automating data collection and storage, bringing down costs through aspects like telehealth, among others.
The challenge, according to analysts, is the rapid adoption of AI without first conducting rigorous testing to ascertain the extent to which the technology can dependably do what it is intended to do. Policymakers need to step in and regulate how this technology is used within the healthcare system, and the public deserves to be informed about such uses so that trust in the systems can be built and nurtured.
For companies like Apple Inc. (NASDAQ: AAPL) that make healthcare-linked products and solutions like wearables to help users capture and track certain health-related metrics such as their heart rate, it is paramount that they routinely test their systems to avert any errors that could result in costly reputational damage.
About TrillionDollarClub
TrillionDollarClub (“TDC”) is a specialized communications platform with a focus on the biggest and brightest companies covered by IBN. It is one of 75+ brands within the Dynamic Brand Portfolio @ IBN that delivers: (1) access to a vast network of wire solutions via InvestorWire to efficiently and effectively reach a myriad of target markets, demographics and diverse industries; (2) article and editorial syndication to 5,000+ outlets; (3) enhanced press release enhancement to ensure maximum impact; (4) social media distribution via IBN to millions of social media followers; and (5) a full array of tailored corporate communications solutions. With broad reach and a seasoned team of contributing journalists and writers, TDC is uniquely positioned to best serve private and public companies that want to reach a wide audience of investors, influencers, consumers, journalists, and the general public. By cutting through the overload of information in today’s market, TDC brings its clients unparalleled recognition and brand awareness.
TDC is where breaking news, insightful content and actionable information converge.
To receive SMS alerts from TrillionDollarClub, text “Trillion” to 888-902-4192 (U.S. Mobile Phones Only)
For more information, please visit https://www.TrillionDollarClub.net
Please see full terms of use and disclaimers on the TrillionDollarClub website applicable to all content provided by TDC, wherever published or re-published: https://www.TrillionDollarClub.net/Disclaimer
TrillionDollarClub
Austin, TX
www.TrillionDollarClub.net
512.354.7000 Office
[email protected]
TrillionDollarClub is powered by IBN
