In 2016, Geoffrey Hinton, a prominent AI researcher, said we should stop training radiologists. He claimed it was “completely obvious” within five years; AI deep learning would outperform radiologists. There has been significant hype around AI in radiology, with more than a few predicting AI would soon replace radiologists or diagnose diseases better.
Despite the bold predictions, the reality has been quite different. Seven years after Hinton’s prediction, not a single radiologist had been replaced by autonomous software. In fact, there is still a high demand for radiologists, with many facilities struggling to fill positions. Most experts now view AI as complementary to radiologists.
The consensus is AI will enhance and augment radiologists’ capabilities. AI is expected to improve workflow efficiency, allowing radiologists to focus on more complex cases. Recent research suggests AI’s benefits vary among individual radiologists, emphasizing the need for personalized integration of AI tools.
As a side note, I believe personalization of AI is the next big thing in AI. chatGPT and the numerous other chatbots are the beginning for AI. I believe what comes next will be AI agents which are specific to industry segments such as healthcare, insurance, real estate, manufacturing, retail, etc. More on this in a future blog post.
I believe the bigger issue than replacing radiologists is enabling radiologists to be more accurate. A recent study published in Radiology estimates approximately 4.2 billion medical imaging exams are performed globally each year. Even under optimal working conditions, the error rate for plain film radiography is estimated to be around 3-5%. For cross-sectional imaging like CT and MRI, error rates are significantly higher, ranging from 20-30%. Not all errors lead to clinically significant consequences. The types of errors can vary from minor discrepancies to major misinterpretations which could affect patient care.
The implications of these error rates are significant. If we assume an average 4% error rate across all imaging modalities, with 4.2 billion exams, the number of potential errors could reach 168 million per year. Fortunately, efforts are ongoing to reduce error rates through various strategies, including AI assistance, double reading, peer review, and improved training and awareness among radiologists.
Based on AI search results, the most common types of medical imaging errors fall in a number of categories. Perceptual errors are the most prevalent, accounting for 60-80% of all radiology errors. These occur when radiologists fail to detect or recognize abnormalities present in the images. The main types of perceptual errors include Missed Findings (underreading), which are the most common errors, occurring in about 42% of cases. This type of error happens when a radiologist fails to identify an abnormality present on the image.
A second type of error is called Satisfaction of Search (SOS). This second most common error occurs in about 22% of cases. This happens when a radiologist stops searching for additional abnormalities after finding one, potentially missing other important findings. A third type of perceptual error is called Faulty Reasoning. These occur in about 9% of cases. Such errors involve correctly identifying an abnormality but attributing it to the wrong cause.
Cognitive Errors occur during the interpretation phase and include two types. First is Misinterpretation. This involves incorrectly interpreting an abnormal finding or, rarely, misinterpreting a normal finding as abnormal. Hopefully not frequent but some errors are a result of a Lack of Knowledge. These errors result from insufficient expertise or experience in identifying certain conditions.
Technical Errors are related to the imaging process itself. First is Poor Image Quality. This can result from incorrect patient positioning, equipment malfunction, or improper imaging techniques. I have experienced this myself. Hopefully rare, but another source of errors is Inappropriate Selection of Imaging Procedures. These errors result from using the wrong type of imaging study for a particular clinical question.
Also, probably rare but errors sometimes are a result of Failure to Communicate Findings. This involves not effectively conveying important results to referring physicians or patients. Incomplete Reporting can happen with complex results, omitting crucial information or recommendations in the radiology reports.
Those are the broad spectrum of possible errors. Some more specific areas of concern would include Missed Fractures. These are especially common in emergency settings, especially in areas like the femur, navicular bone, and cervical spine. Missed Cancer Diagnoses commonly occur in lung nodules on chest radiographs, breast lesions on mammograms, and colorectal carcinomas on barium enema studies.
A final type of error is Overlooked Findings Outside the Primary Area of Interest. In other words, missing abnormalities visible but outside the main region being examined. By understanding these common error types, radiologists and healthcare systems can implement strategies to reduce their occurrence and improve patient care. AI will play a major role in this.
I believe benefits of AI in radiology will be significant. AI enhances diagnostic precision by analyzing medical images with remarkable accuracy, often surpassing human capabilities in detecting abnormalities like tumors or fractures. Studies report AI-assisted radiologists achieve consistently higher accuracy in diagnosis, reducing errors and improving patient outcomes. AI can help optimize workflow by automating routine tasks such as image sorting and preliminary assessments, allowing radiologists to focus on complex cases. AI can significantly reduce turnaround times for diagnostic reports. One study showed a reduction from 11.2 days to 2.7 days.
Reduced workload and burnout can be achieved by using AI to handle repetitive tasks. The result can be alleviated stress and workload for radiologists, helping them maintain high levels of care and accuracy. AI supports personalized medicine by integrating predictive analytics and correlating imaging data with treatment plans. Applications such as dose reduction in imaging and faster scanning procedures improve efficiency while maintaining quality.
The potential benefits are huge but there are challenges and limitations. There is a risk of radiologists relying too heavily on AI recommendations, which could lead to errors if the AI system is inaccurate. The impact from AI may not be consistent. The benefits of AI vary among radiologists based on factors like experience and familiarity with the technology. In some cases, inaccurate AI predictions can negatively affect performance.
AI is only as good as the data it uses. I believe this issue will get increased attention. Equal to that is the “black box” nature of AI algorithms. As I have written before, clinicians have been skeptical of AI diagnoses and treatment plans when they don’t know exactly how the AI algorithms reached its conclusions. Some hospital networks may not have a robust infrastructure to support AI implementation. Despite its promise, the clinical adoption of AI remains limited due to gaps between proof-of-concept studies and real-world applications.
What is the future? Experts believe while AI will not replace radiologists, it will redefine their roles by acting as a powerful tool for improving diagnostic capabilities and workflow efficiency. Early adopters of AI are expected to lead advancements in the field, but successful integration requires addressing current limitations through personalized approaches and ongoing monitoring of AI performance in clinical settings. Based on my readings and the course I have been taking from MIT, I am optimistic the 4% error rate will be reduced significantly and the overall process improvements will lead to better patient outcomes and hospital efficiency.
Perplexity Pro was my research partner for this post. If you are interested in reviewing the sources backing up the various numbers and assertions, the sources of information for the post are here.
In this section, I share what I am up to, pictures of the week, what is new in AI and crypto, and more.
Today’s guest was Conor Grennan, Chief AI Architect at NYU Stern School of Business and CEO and Founder of AI Mindset. His focus the disruptive technologies and game-changing innovations that will define the next phase of AI.
I find these sessions very informative. If you are interested in these sessions, visit here.
I
This week has seen several significant developments in the field of artificial intelligence:
OpenAI Unveils o3 Models
OpenAI announced the successors to its o1 reasoning model family: o3 and o3-mini. These new models are not yet widely available, but safety researchers can sign up for a preview. The announcement marks the end of OpenAI’s “12 Days of OpenAI” event, which included reveals of real-time vision capabilities, ChatGPT Search, and a Santa voice for ChatGPT[21].
ChatGPT Expands Accessibility
OpenAI is making ChatGPT more accessible by introducing a 1-800 number that allows users to interact with the chatbot via landline or flip phone. The service offers 15 minutes of free calling for U.S. users, providing an experience similar to Advanced Voice Mode[21].
ChatGPT Search Available to Free Users
OpenAI has extended ChatGPT Search to free, logged-in users. This feature, previously limited to paid subscribers, enables ChatGPT to access real-time web information for more accurate responses. It has also been integrated into Advanced Voice Mode[21].
Google’s AI Weather Model
Google DeepMind launched GenCast, a new AI weather model that significantly improves prediction accuracy. GenCast can deliver faster, more accurate forecasts up to 15 days ahead, potentially aiding in safeguarding lives and infrastructure during extreme weather events[19].
Quantum Computing Breakthrough
Google unveiled Willow, a state-of-the-art quantum chip that represents a major advancement in quantum computing. Willow has solved a key challenge in quantum error correction and can perform certain computations exponentially faster than traditional supercomputers[19].
EU Draft Guidelines for AI Regulation
The European Union released initial draft guidelines for regulating general-purpose AI models. The draft outlines standards for transparency, copyright compliance, and risk mitigation. Final rules are expected by May 2025, with the current draft open for feedback until November 28[23].
AI in Cultural Heritage
The Vatican and Microsoft have collaborated to create an AI-generated digital twin of St. Peter’s Basilica. This innovation uses advanced photogrammetry and 22 petabytes of data to enhance visitor experiences and aid in conservation efforts[23].
These developments showcase the rapid advancements in AI technology across various sectors, from improved language models and accessibility to breakthroughs in quantum computing and practical applications in weather forecasting and cultural preservation.
This week has seen several significant developments in the cryptocurrency space:
Bitcoin Surpasses $100,000: Bitcoin briefly touched the $100,000 mark, driven by positive inflation data and growing anticipation surrounding key policy decisions. The cryptocurrency is currently trading around $99,200, maintaining its position near this psychological threshold.
XRP Outperforms the Market: XRP has experienced a remarkable surge, rising 14% on Thursday and 45% over the past week. Its market value has reached $192 billion, making it the third-largest cryptocurrency. XRP is now trading at $3.35, approaching its all-time high of $3.40 set in 2018.
Trump Administration’s Crypto Plans: Reports suggest that President-elect Donald Trump’s administration is poised to implement crypto-friendly policies. There are expectations of pro-crypto executive orders on Trump’s first day in office, including potential tax cuts on capital gains and the rolling back of anti-crypto regulations.
SEC Leadership Change: With Gary Gensler stepping down as SEC Chair, crypto advocate Paul Atkins is expected to take over. This change is anticipated to lead to a more favorable regulatory environment for cryptocurrencies.
New Crypto Presales Gaining Traction: Several new cryptocurrency presales are attracting attention, including Wall Street Pepe (WEPE), Solaxy (SOLX), and Meme Index (MEMEX). These projects are offering unique features and investment opportunities in the evolving crypto landscape.
JPMorgan’s Bitcoin Dominance Prediction: JPMorgan analysts expect Bitcoin’s dominance over Ethereum and other alternative tokens to continue throughout 2025, citing several factors supporting this trend.
Upbit Exchange Faces Regulatory Issues: South Korea’s largest cryptocurrency exchange, Upbit, is facing potential suspension due to alleged Know Your Customer (KYC) violations, raising concerns in Asian crypto communities.
DeFAI Emerging as a New Trend: The combination of Decentralized Finance (DeFi) and Artificial Intelligence (AI), known as DeFAI, is gaining attention as a potential new narrative in the crypto space, focusing on enhancing usability, trading efficiency, and decision-making.
These developments reflect the dynamic nature of the cryptocurrency market, with regulatory changes, technological advancements, and market movements shaping the industry’s landscape.
Copyright © 2024. All rights reserved.