Articles | Volume 15, issue 1
https://doi.org/10.5194/ms-15-223-2024
https://doi.org/10.5194/ms-15-223-2024
Research article
 | 
02 Apr 2024
Research article |  | 02 Apr 2024

Development of a flexible endoscopic robot with autonomous tracking control ability using machine vision and deep learning

Sen Qian, Jianxi Zhang, Zongkun Pei, Xiantao Sun, and Zhe Wu

Related authors

Design and error compensation of a 3-degrees-of-freedom cable-driven hybrid 3D-printing mechanism
Sen Qian, Xiao Jiang, Yong Liu, Shuaikang Wang, Xiantao Sun, and Huihui Sun
Mech. Sci., 14, 371–386, https://doi.org/10.5194/ms-14-371-2023,https://doi.org/10.5194/ms-14-371-2023, 2023
Short summary

Related subject area

Subject: Mechanisms and Robotics | Techniques and Approaches: Mathematical Modeling and Analysis
Fault identification of the vehicle suspension system based on binocular vision and kinematic decoupling
Hong Wei, Fulong Liu, Guoxing Li, Xingchen Yun, Muhammad Yousaf Iqbal, and Fengshou Gu
Mech. Sci., 15, 445–460, https://doi.org/10.5194/ms-15-445-2024,https://doi.org/10.5194/ms-15-445-2024, 2024
Short summary
Meshing stiffness characteristics of modified variable hyperbolic circular-arc-tooth-trace cylindrical gears
Dengqiu Ma, Bing Jiang, Zhenhuan Ye, and Yongping Liu
Mech. Sci., 15, 395–405, https://doi.org/10.5194/ms-15-395-2024,https://doi.org/10.5194/ms-15-395-2024, 2024
Short summary
Gravity compensation and output data decoupling of a novel six-dimensional force sensor
Yongli Wang, Ke Jin, Xiao Li, Feifan Cao, and Xuan Yu
Mech. Sci., 15, 367–383, https://doi.org/10.5194/ms-15-367-2024,https://doi.org/10.5194/ms-15-367-2024, 2024
Short summary
A replaceable-component method to construct single-degree-of-freedom multi-mode planar mechanisms with up to eight links
Liangyi Nie, Huafeng Ding, Andrés Kecskeméthy, Kwun-Lon Ting, Shiming Li, Bowen Dong, Zhengpeng Wu, Wenyan Luo, and Xiaoyan Wu
Mech. Sci., 15, 331–351, https://doi.org/10.5194/ms-15-331-2024,https://doi.org/10.5194/ms-15-331-2024, 2024
Short summary
Optimal design and experiments of a novel bobbin thread-hooking mechanism with RRSC (revolute–revolute–spherical–cylindrical) spatial four-bar linkage
Bingliang Ye, Xu Wang, Mingfeng Zheng, Pengbo Ye, and Weiwei Hong
Mech. Sci., 15, 269–279, https://doi.org/10.5194/ms-15-269-2024,https://doi.org/10.5194/ms-15-269-2024, 2024
Short summary

Cited articles

Aghakhani, N., Geravand, M., Shahriari, N., Vendittelli, M., and Oriolo, G.: Task control with remote center of motion constraint forminimally invasive robotic surgery, in: Proceedings of 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Karlsruhe, Germany, 17 October 2013, 1050–4729, https://doi.org/10.1109/ICRA.2013.6631412, 2013. 
Bawa, V. S., Singh, G., Kaping, A. F., Leporini, A., and Landolfo, C.: ESAD: Endoscopic Surgeon Action Detection Dataset, cs.CV, arXiv:2006.07164, https://doi.org/10.48550/arXiv.2006.07164, 12 June 2020. 
Bawa, V. S., Singh, G., KapingA, F., Oleari, E., Leporini, A., Landolfo, C., Zhao, P., Xiang, X., and Luo, G.: The SARAS Endoscopic Surgeon Action Detection (ESAD) dataset: Challenges and methods, cs.CV., arXiv:2104.03178, https://doi.org/10.48550/arXiv.2104.03178, 7 April 2021. 
Berkelman, P. and Ma, J.: A compact modular teleoperated robotic system for laparoscopic surgery, Int. J. Robot. Res., 28, 1198–1215, https://doi.org/10.1177/0278364909104276, 2009. 
Brahmbhatt, J. V., Gudeloglu, A., Liverneaux, P., and Oarekattil, S. J.: Robotic microsurgery optimization, APS, 41, 225–230, https://doi.org/10.5999/aps.2014.41.3.225, 2014. 
Download
Short summary
A flexible endoscopic robot is designed to solve the problem that it is difficult to maintain a stable visual field in traditional endoscopic surgery. The main contribution of this research is to realize the motion planning and primary–secondary teleoperation control of the flexible endoscope robot under remote center motion constraints on the basis of its structure and select the appropriate deep learning algorithm to complete the autonomous tracking function.