What If Generative AI Turned To Be A Flop In Healthcare?
What if generative AI fails to live up to the expectations? The consequences for healthcare could be significant. Let’s analyze the worst-case scenario!
Dr. Bertalan Mesko, PhD
11 May 2026
Key Takeaways
If generative AI fails to demonstrate effectiveness and safety through clinical trials and empirical evidence, it risks exclusion from evidence-based medical practice
A failure of generative AI could erode public trust, provoke ethical concerns with deepfakes, and lead to stringent regulations or outright bans in medical settings, potentially stifling further innovation and investment in the field.
Although I predict the success of generative AI due to its accessibility and usability, analyzing “what if” scenarios is always important as it helps to prepare for future challenges.
The excitement surrounding generative AI is reaching a fever pitch. From tech giants to healthcare leaders, investment in this seemingly game-changing technology is exploding. We’re embracing the trend: we’ve written dozens of articles, created multiple videos, published an ebook, and recently launched a new short course.
However, amidst the enthusiasm, AI expert Gary Marcus raised an important question a few months ago: What if, for all its promise, generative AI fails to deliver long-term? While he outlined the pessimistic scenario in general, I wanted to dissect what genAI being a flop would mean in healthcare and medicine.
How to define generative AI failure in healthcare?
Since the public launch of ChatGPT, we’ve explored the potential of generative AI in medicine. This technology offers promising applications, from enhancing administrative efficiency to functioning as a virtual medical scribe, potentially reshaping how medical facilities operate and interact with patients.
Let’s now consider the other side of the coin. If generative AI fails to live up to the expectations, the consequences for healthcare could be significant. Let’s break down what failure could look like.
We don’t find evidence that it works
A fundamental failure of generative AI would be its inability to be incorporated into evidence-based medicine. Without robust empirical support from well-conducted research and clinical trials, AI technologies can’t be applied in medical practice.
No clinical trials prove its safety
Similarly, a major red flag will be if years go by and we don’t see solid clinical trials to evaluate the potential of generative AI.
And/or find proof that it’s useless
Another clear indicator would be if trials, pilots, and studies would prove that using generative AI in healthcare is inefficient and/or unsafe. This could mean AI systems making inaccurate predictions, leading to incorrect treatments, or compromising patient privacy and safety, ultimately causing more harm than good.
Deep fakes rule the information highways
The use of AI to create deep fakes could provoke significant ethical concerns and public outrage. This could include being used to falsify medical records, create misleading patient data, deepfake medical authorities advocating bogus treatments or arguing against clinically proven ones, or fabricating medical advice. These could be life-threatening scenarios, and right now we are not exactly sure how to ensure such content can’t reach the general population.
People recognize AI text and don’t find it credible enough
As the novelty of generative AI may wane, AI-generated materials – brochures, summaries, etc. – become easily distinguishable and may be seen as less credible and unreliable. Thus generative AI as a tool for creating legitimate medical content could diminish.
What happens next?
Continuing from the potential pitfalls of generative AI in healthcare, let’s explore the broader implications should these technologies fail to fulfill their promises. The consequences would ripple across the healthcare industry affecting public trust, regulatory landscapes, and investment dynamics.
Erosion of trust
Generative AI’s failure to deliver on its promises could erode public trust in AI applications in general, casting doubt on its reliability and effectiveness. This could also slow the adoption of other AI-powered tools in healthcare and beyond.
Leading to bans
If generative AI is unsafe or ineffective in healthcare, regulatory bodies might impose restrictions or bans on its use in sensitive environments such as medical schools and hospitals. Such prohibitions would be a protective measure to prevent harm and preserve the integrity of medical education and patient care, but they would also hinder development and limit the technology’s potential benefits.
Overly stringent regulations
In response to potential risks, policymakers might introduce overly stringent regulations, stifling innovation and halting the development of generative AI in healthcare. This could create a bureaucratic quagmire, slowing progress and discouraging investment.
Investors turn away from the field
If generative AI fails to demonstrate clear value, investors might lose confidence and pull back their funding. This could lead to a decline in research and development, further delaying or even halting progress in this field.
However, I don’t think it is a flop
Having said all that, I still don’t believe generative AI will be a flop in medicine (or elsewhere). It is different from previous technologies in a crucial way: we don’t need to believe how it works to a handful of experts working in specialised labs. Quite the contrary, we can directly interact with and test it, experiment, and discover its potential. Still, thinking about “what if” questions is rarely a waste of time, as it helps us prepare for the future.
I think the very nature of generative AI – its accessibility and the ability for daily hands-on use – suggests that it is unlikely to fail outright. Instead, my greater concern lies with its potentially rapid, unregulated development, which could lead to unforeseen consequences and challenges.
