文章摘要

文章信息/Info

Title:: The precise placement method of surgical guides in orthopedic surgery based on augmented reality

作者:: 章振逸1; 李彬1△; 丁焕文2; 3; 闫晓楠2; 田联房1; 1.华南理工大学自动化科学与工程学院，广州 510641;2.华南理工大学医学院，广州 510006；3. 广州市第一人民医院骨科，广州 510000

Author(s):: ZHANG Zhenyi1; LI Bin1; DING Huanwen2; 3; YAN Xiaonan2; TIAN Lianfang1; 1. School of Automation Science and Engineering, South China University of Technology, Guangzhou 510641,China;2. School of Medicine, South China University of Technology, Guangzhou 510006;3.Department of Orthopaedics, Guangzhou First People’s Hospital,Guangzhou 510000

Keywords:: Virtual-real fusion; 3D printing ; Computer-aided technology; Perspective-n-point problem; Direction acceleration method; 3D reconstruction

摘要:: 针对骨科手术中手动安放手术导板误差较大的问题，本研究提出了基于增强现实(augmented reality，AR)的骨科手术中引导手术导板精确安放方法。首先对术中视频流全局阈值分割，检测手术部位的目标轮廓，并将轮廓外接矩形4个顶点作为匹配跟踪点；利用基于P3P(Perspective-Three-Points)算法实现手术部位的初匹配；在此基础上，提出基于六自由度的Powell算法进行搜索优化，并改进其新一轮搜索方向，将得到的最优匹配矩阵同时作用于虚拟手术导板模型和虚拟手术部位模型；最后术中动态调整手术导板不同安放位置，利用交互式的图割算法提取实际手术导板,与虚拟手术导板进行Dice系数匹配度计算，并根据Dice值确定最佳安放位置。实验表明，该方法具有良好的引导效果。

Abstract:: Regarding the large error of manual placement of surgical guides in orthopedic surgery, we proposed a method for guiding the placement of surgical guides in orthopedic surgery based on augmented reality (AR). First, the intraoperative video stream was segmented by global threshold to detect the target contour of the surgical site, and the four vertices of the rectangle surrounding the contour were used as matching tracking points.We used the perspective-three-points (P3P) algorithm to achieve the initial matching of the surgical site. On this basis, a six-degree-of-freedom Powell algorithm for search optimization was proposed to improve the new search direction.The obtained optimal matching matrix was applied to both the virtual surgical guide plate model and the virtual surgical site model. Finally, different placement positions of the surgical guide plate were adjusted dynamically during the operation. Interactive graph cutting algorithm was used to extract the actual surgical guide plate and calculate the matching degree of Dice coefficient between the actual surgical guide plate and the virtual surgical guide plate,then according to the Dice value to determine the best placement position. Experiments show that this method has a good guiding effect.