AI-Enhanced 3D Models in Global Virtual Reality Case Conferences for Surgical Care in a Low-Income Country

Abstract

<strong>Background: </strong>Approximately 5 billion people worldwide lack adequate access to surgical care, primarily in the Global South. Especially in crisis regions and war zones, telemedical applications may enhance health services. This study explores the feasibility of using artificial intelligence (AI)-enhanced 3D imaging and extended reality (XR) technologies for intercontinental surgical case conferences in a low-resource scenario in Uganda. Our pilot study aims to assess the value of these technologies to address the lack of surgical resources and multilateral knowledge exchange.<br /> <strong>Objective: </strong>This study intends to determine the feasibility of using new AI-enhanced image modeling technology within an immersive spatial XR scenario to collaboratively and remotely assess reconstructive patient cases in the resource-limited country of Uganda.<br /> <strong>Methods:</strong> Within a surgical camp at Lamu Medical Centre, Uganda, 3D models of patients’ conditions were created using a smartphone app. Digital models were generated from photographs taken on-site and processed into 3D formats to be visualized in virtual case conferences. Here, surgeons from Uganda and Germany used virtual reality (VR) headsets to collaboratively discuss case strategies while marking surgical approaches on each digital patient model.<br /> <strong>Results:</strong> The study included 15 patients requiring reconstructive surgery, with a diverse range of conditions. The use of XR technology facilitated detailed visualization and discussion of surgical strategies. The process was time-efficient, with a total of under 8 minutes per case for data acquisition and model creation, and resource-efficient with surgeons reporting sufficient quality of smartphone-derived models. Valuable user experience and precise interaction during the VR case processing were found, underlining its potential to improve surgical planning and patient care in resource-limited settings.<br /> <strong>Conclusions:</strong> The findings indicate that AI-enhanced 3D imaging and immersive virtual communication platforms are valuable tools for integrative surgical case assessments. The cost-effectiveness of the used consumer solutions should be especially beneficial for low-resource environments. While the study demonstrates the feasibility of this approach, further research is needed to explore a broader application and impact of these technologies in global health. The study highlights the potential of XR to enhance training and surgical precision, contributing to better health care outcomes in underserved regions.