A Naked Eye 3D Display and Interaction System for Medical Education and Training

Publication date: Available online 23 October 2019Source: Journal of Biomedical InformaticsAuthor(s): Guowen Chen, Tianqi Huang, Zhencheng Fan, Xinran Zhang, Hongen LiaoAbstractTo provide natural simulated objects and intuitive user interaction in medical education and training, we propose a naked eye 3D display and interaction system. The current 3D rendering algorithms for naked eye 3D displays are not suitable for medical use, due to the requirements of displaying and interacting with high quality medical images and simulating soft tissues. Because the traditional 3D rendering procedure and vertex indexing in collision detection will require substantial computing power when using a naked eye 3D display, this method cannot achieve fluent displays and interactions. Thus, we develop a novel octree-based 3D rendering and interaction algorithm for high quality medical models to improve the rendering rate and obtain smooth human machine interactions when using the naked eye 3D display device. We also valuate the soft-body phantom simulation of the naked eye 3D display device by combining the traditional 3D rendering algorithm with the Elastic 3D simulation to simulate deformable tissues. We integrate an incremental interaction method and a Kalman filter-based hand tracking method to achieve a larger user interaction range and robust hand tracking. We used the proposed system to perform human-computer interactions with rigid phantoms and soft-body phantoms. The experimental resul...
Source: Journal of Biomedical Informatics - Category: Information Technology Source Type: research