In Seattle’s VA hospital, Dr. Nadeem Zafar and his colleague utilized an innovative Augmented Reality Microscope (ARM) to settle a debate regarding the severity of prostate cancer in a patient. Developed by Google and the U.S. Department of Defense, this AI-powered microscope has the potential to transform the field of pathology.
The ARM resembles a conventional microscope but is integrated with AI capabilities. Pathologists can place tissue samples under the ARM, and AI swiftly identifies cancerous regions, marking them with bright green outlines. It also assesses the cancer’s severity through a pixelated heat map on a separate monitor.
This technology addresses critical challenges in pathology, including workforce shortages and mounting caseloads. While it won’t replace digital pathology systems, the ARM offers a cost-effective alternative, allowing pathologists to capture screen grabs of slides.
Collaboration between government and industry, led by the Defense Innovation Unit, has resulted in the development of AI algorithms for the ARM, capable of detecting breast, cervical, prostate cancer, and mitosis. Data privacy and security are ensured through encryption.
While initial research is promising, rigorous testing is ongoing before the ARM can be used in clinical settings. Future use may benefit smaller labs and pathology residents in training. The DIU aims to make the ARM accessible to government users through the General Services Administration website.
Ultimately, the ARM’s goal is to enhance diagnostic accuracy, speed, and cost-effectiveness, benefiting both pathologists and the broader public.
