Planning of Medical Flexible Needle Motion in Effective Area of Clinical Puncture
<p>General surgical planning based on pulmonary nodules. Techniques such as High-Resolution CT (HRCT), endobronchial ultrasonography (EBUS), and electromagnetic navigation bronchoscope (ENB) are commonly used for lung cancer screening. Transthoracic needle aspiration (TTNA) and bronchial needle aspiration (TBNA) are commonly used for lung cancer treatment; the former is less invasive but requires the needle to be passed through the chest wall from outside the body, which may lead to pneumothorax; the latter is less dangerous but often fails to reach the outer regions of the lung.</p> "> Figure 2
<p>Three key technologies for robot-assisted puncture.</p> "> Figure 3
<p>(<b>Right</b>): Effect of different puncture directions at fixed puncture points (light blue), both reaching the nodes of the lung parenchyma (pink) while avoiding important anatomical structures such as bronchi (yellow) and other tissues (gray). (<b>Top left</b>): Enlarged view of the effect after RCS* planning for different puncture directions. Each trajectory corresponds to the best trajectory for a certain puncture direction, with the red trajectory corresponding to the best direction. (<b>Bottom left</b>): The paths after planning for different puncture directions (black, green, yellow, purple) at the starting point (blue) can all reach the target point (pink) while avoiding obstacles (red), and the path corresponding to the lowest cost is chosen as the best puncture direction.</p> "> Figure 4
<p>The kinematics of a bevel-tip flexible needle.</p> "> Figure 5
<p>Feasible angle and effective area for flexible needle puncture. (<b>a</b>) describes the minimum puncture physiological angle <math display="inline"><semantics> <mi>α</mi> </semantics></math>. A denotes the punctured plane, gray represents the tissue, red represents the obstacle and <math display="inline"><semantics> <mi>τ</mi> </semantics></math> is the target tolerance. (<b>b</b>) describes the effective puncture region (green), the yellow region corresponds to the <math display="inline"><semantics> <mi>α</mi> </semantics></math> region in (<b>a</b>), and the point cloud normal vector (red) points from the center of the sphere to the sphere with the opposite puncture direction (blue).</p> "> Figure 6
<p>All possible puncture directions are shown in (<b>a</b>). In (<b>b</b>), all valid directions are shown in green, with red in the obstacle environment denoting the direction in which a viable puncture path is present and blue denoting the direction in which a viable puncture path is absent.</p> "> Figure 7
<p>Results after RCS* planning, where the starting point (light blue) and all light green represent all valid paths of <math display="inline"><semantics> <msub> <mi>x</mi> <mrow> <mi>g</mi> <mi>o</mi> <mi>a</mi> <mi>l</mi> <mo>_</mo> <mn>2</mn> </mrow> </msub> </semantics></math> (dark green). Purple represents all valid puncture paths of <math display="inline"><semantics> <msub> <mi>x</mi> <mrow> <mi>g</mi> <mi>o</mi> <mi>a</mi> <mi>l</mi> <mo>_</mo> <mn>1</mn> </mrow> </msub> </semantics></math> (pink). Red and dark blue are the best paths.</p> "> Figure 8
<p>(<b>a</b>–<b>c</b>) represent the directions of the effective paths (blue) and the best puncture directions (red) obtained by running the algorithm with the starting point position <math display="inline"><semantics> <msub> <mi>p</mi> <mrow> <mi>s</mi> <mi>t</mi> <mi>a</mi> <mi>r</mi> <mi>t</mi> </mrow> </msub> </semantics></math> and the puncture effective direction (yellow) at the target point <math display="inline"><semantics> <msub> <mi>x</mi> <mrow> <mi>g</mi> <mi>o</mi> <mi>a</mi> <mi>l</mi> <mo>_</mo> <mn>1</mn> </mrow> </msub> </semantics></math> for RCS, RCS* and RRT. Similarly, (<b>d</b>–<b>f</b>) represent the case when the starting point position is <math display="inline"><semantics> <msub> <mi>p</mi> <mrow> <mi>s</mi> <mi>t</mi> <mi>a</mi> <mi>r</mi> <mi>t</mi> </mrow> </msub> </semantics></math> and target point is <math display="inline"><semantics> <msub> <mi>x</mi> <mrow> <mi>g</mi> <mi>o</mi> <mi>a</mi> <mi>l</mi> <mo>_</mo> <mn>2</mn> </mrow> </msub> </semantics></math>.</p> "> Figure 9
<p>Puncture trajectory cost line chart. (<b>a</b>) represents the line graph of three sets of “Cost” in <a href="#sensors-23-00671-t002" class="html-table">Table 2</a> and similarly, (<b>b</b>) represents the line chart of “Cost” in <a href="#sensors-23-00671-t003" class="html-table">Table 3</a>.</p> ">
Abstract
:1. Introduction
2. Related Work
2.1. Three-Dimensional Static Puncture Motion Planning
2.2. Three-Dimensional Dynamic Puncture Motion Planning
3. Definitions and Assumptions
3.1. Flexible Needle Puncture Kinematics
3.2. Flexible Needle Puncture Motion Planning
3.3. Planning Assumptions for Flexible Needle Puncture Motion
- During needle puncture, the shape, size, curvature, and other characteristics of the needle determine the needle movement and directly affect the success rate of needle puncture. The needle is subject to resistance from soft tissues, which leads to changes in the trajectory of the needle movement. Therefore, we assume that the special material of flexible needles used [15,18] is sufficiently flexible. The needle tip bends with maximum curvature as it passes through the tissue, and the needle tail trajectory strictly follows the needle tip trajectory, with and remaining constant.
- Soft tissues may have heterogeneous density and strength and may also be subject to external forces, such as respiration or muscle contraction, which may affect needle movement. We assume that the soft tissues have uniform density and strength as well as the same structure and friction coefficient during puncture and that the position of the surrounding tissues and the target site do not move relative to each other during the puncture.
- During needle puncture, visual sensors or other sensors can be used to measure the needle position and attitude, as well as the needle moment and angular velocity in real-time, and to adjust the needle trajectory to stay on the planned trajectory using the robot’s motion control system. Since the needle trajectory needs to be predicted by planning algorithms, some algorithms with multiresolution properties, such as resolution-complete search (RCS), and RCS* (a resolution-optimal version of RCS), generate paths with very small spaced nodes, which may not be possible by the robot’s motion control system. Therefore, we assume that a control system exists that can adjust the needle trajectory with minimal resolution.
4. Methods
4.1. Problem Description
- 1.
- ;
- 2.
- ;
- 3.
- ;
- 4.
- ;
- 5.
- ;
- 6.
- .
4.2. Algorithm Description
Algorithm 1 Improved RCS* |
Input:
|
- Search Tree: By constructing a search tree with predefined multiresolution motions in the configuration space, the search tree is based on a given start configuration and explores the effective motion plan as it unfolds in the configuration space.
- Reachable Detection (line 7): The curvature restriction removes some nodes that are unlikely to be the final path. It is only necessary that the distance between the target point and the boundary of the reachable region is less than , excluding nodes where the needle tip turns more than 90 degrees.
- Duplicate Detection (line 8): This is the case if there are similar and identical nodes in the search tree to be deleted. (line 12) means that the next node will be performed, and v will be put into CLOSED (line 13).
- Motion Primitive: The Motion Primitive is defined as , where the curvature is , arc length is , and needle base is rotation angle .
- Cutoff Resolution (line 11): The minimum needle insertion and the minimum needle axis rotation are taken as the shear resolution, and the node is not updated when the kinematic element M satisfies .
- Multithreaded: The task of each thread is to process the nodes extracted from the open list, making it possible to process the nodes in parallel.
5. Results
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Sung, H.; Ferlay, J.; Siegel, R.L.; Laversanne, M.; Soerjomataram, I.; Jemal, A.; Bray, F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2021, 71, 209–249. [Google Scholar] [CrossRef] [PubMed]
- Bray, F.; Ferlay, J.; Soerjomataram, I.; Siegel, R.L.; Torre, L.A.; Jemal, A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2018, 68, 394–424. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hu, J.; Gao, S.; Chen, K.; Feng, J. Pulmonary Minimally Invasive High-Tech Diagnostic Manual Pathologized Hybridization Technique Illustration, 1st ed.; Zhejiang University Press: Hangzhou, China, 2021; pp. 272–278. ISBN 9787308214742. [Google Scholar]
- DiMaio, S.P.; Salcudean, S.E. Needle insertion modeling and simulation. IEEE Trans. Robot. Autom. 2003, 19, 864–875. [Google Scholar] [CrossRef] [Green Version]
- DiMaio, S.P.; Salcudean, S.E. Needle steering and motion planning in soft tissues. T-BME 2005, 52, 965–974. [Google Scholar] [CrossRef] [PubMed]
- Duan, X.; Wen, H.; He, R.; Li, X.; Qiu, J. Research progress and key technology analysis of thoracoabdominal percutaneous puncture robot. Robotics 2021, 43, 567–584. Available online: https://kns.cnki.net/kcms/detail/detail.aspx?FileName=JQRR202105006&DbName=DKFX2021 (accessed on 2 January 2023).
- Pinzi, M.; Galvan, S.; Rodriguez y Baena, F. The Adaptive Hermite Fractal Tree (AHFT): A novel surgical 3D path planning approach with curvature and heading constraints. Int. J. Comput. Assist. Radiol. Surg. 2019, 14, 659–670. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fu, M.; Solovey, K.; Salzman, O.; Alterovitz, R. Resolution-Optimal Motion Planning for Steerable Needles. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 23–27 May 2022; pp. 9652–9659. [Google Scholar]
- Zhang, Y.; Qi, Z.; Zhang, H. An improved RRT* algorithm combining motion constraint and artificial potential field for robot-assisted flexible needle insertion in 3D environment. In Proceedings of the 2021 3rd International Conference on Industrial Artificial Intelligence (IAI), Shenyang, China, 8–11 November 2021; pp. 1–6. [Google Scholar]
- Zhang, Y.; Ju, Z.; Zhang, H.; Qi, Z. 3-D Path Planning Using Improved RRT* Algorithm for Robot-Assisted Flexible Needle Insertion in Multilayer Tissues. IEEE Can J. Elect. Com. 2021, 45, 50–62. [Google Scholar] [CrossRef]
- LaValle, S.M.; Kuffner, J.J., Jr. Randomized Kinodynamic Planning. Int. J. Robotics Res. 1999, 20, 378–400. [Google Scholar] [CrossRef]
- Seiler, K.M.; Singh, S.P.; Sukkarieh, S.; Durrant-Whyte, H. Using Lie group symmetries for fast corrective motion planning. Int. J. Robotics Res. 2010, 13, 151–166. [Google Scholar]
- Favaro, A.; Cerri, L.; Galvan, S.; Baena, F.R.Y.; De Momi, E. Automatic Optimized 3D Path Planner for Steerable Catheters with Heuristic Search and Uncertainty Tolerance. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 21–25 May 2018; pp. 9–16. [Google Scholar]
- Liu, F.; Garriga-Casanovas, A.; Secoli, R.; y Baena, F.R. Fast and Adaptive Fractal Tree-Based Path Planning for Programmable Bevel Tip Steerable Needles. IEEE Robot. Autom. Lett. 2016, 1, 601–608. [Google Scholar] [CrossRef] [Green Version]
- Fu, M.; Salzman, O.; Alterovitz, R. Toward Certifiable Motion Planning for Medical Steerable Needles. arXiv 2021, arXiv:2107.04939. [Google Scholar]
- Hoelscher, J.; Fu, M.; Fried, I.; Emerson, M.; Ertop, T.E.; Rox, M.; Alterovitz, R. Backward Planning for a Multi-Stage Steerable Needle Lung Robot. IEEE Robot Autom. Let. 2021, 6, 3987–3994. [Google Scholar] [CrossRef] [PubMed]
- Wu, K.; Li, B.; Zhang, Y.; Dai, X. Review of research on path planning and control methods of flexible steerable needle puncture robot. Comput. Assist. Surg. 2022, 27, 91–112. [Google Scholar] [CrossRef] [PubMed]
- Abolhassani, N.; Patel, R.; Moallem, M. Patel and Mehrdad Moallem. Needle insertion into soft tissue: A survey. Med. Eng. Phys. 2007, 29, 413–431. [Google Scholar] [CrossRef] [PubMed]
- Gao, D.; Lei, Y.; Zheng, H. Needle steering for robot-assisted insertion into soft tissue: A survey. Chin. J. Mech. Eng. 2012, 25, 629–638. [Google Scholar] [CrossRef]
- Duindam, V.; Alterovitz, R.; Sastry, S.; Goldberg, K. Screw-based motion planning for bevel-tip flexible needles in 3D environments with obstacles. In Proceedings of the 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 19–23 May 2008; pp. 2483–2488. [Google Scholar]
- Duindam, V.; Xu, J.; Alterovitz, R.; Sastry, S.; Goldberg, K. Three-dimensional Motion Planning Algorithms for Steerable Needles Using Inverse Kinematics. Int. J. Robotics Res. 2010, 29, 789–800. [Google Scholar] [CrossRef]
- Adagolodjo, Y.; Goffin, L.; De Mathelin, M.; Courtecuisse, H. Robotic Insertion of Flexible Needle in Deformable Structures Using Inverse Finite-Element Simulation. IEEE T Robot. 2019, 35, 697–708. [Google Scholar] [CrossRef] [Green Version]
- Misra, S.; Reed, K.B.; Schafer, B.W.; Ramesh, K.T.; Okamura, A.M. Mechanics of Flexible Needles Robotically Steered through Soft Tissue. Int. J. Robotics Res. 2010, 29, 1640–1660. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fan, X.; Yun, J.; Guo, S. Research on Force Analysis and Path Planning of Flexible Needle Puncture Bending Modeling. J. Phys. Conf. Ser. 2021, 1952. [Google Scholar] [CrossRef]
- Fu, M.; Kuntz, A.; Webster, R.J.; Alterovitz, R. Safe Motion Planning for Steerable Needles Using Cost Maps Automatically Extracted from Pulmonary Images. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; pp. 4942–4949. [Google Scholar]
- Huang, H.; Huang, E.; Li, X.; Li, C.; He, Q.; He, Y. Study on the Direction and Angle of Venous Puncture. 2009. Available online: https://kns.cnki.net/kcms/detail/detail.aspx?FileName=HLXZ200901029&DbName=CJFQ2009 (accessed on 2 January 2023).
Characteristic | AFT | AHFT | RRT | RRT* | RCS | RCS* |
---|---|---|---|---|---|---|
Completeness | ✕ | ✓ | ✕ | ✕ | ✓ | ✓ |
Probabilistic completeness | ✓ | ✕ | ✓ | ✓ | ✕ | ✕ |
Optimality | ✓ | ✕ | ✕ | ✕ | ✕ | ✓ |
Asymptotic optimality | ✓ | ✓ | ✕ | ✓ | ✕ | ✕ |
Optimal resolution | ✕ | ✕ | ✕ | ✕ | ✕ | ✓ |
CS | RCS* | RRT | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Direction | Cost | Direction | Cost | Direction | Cost | |||||||
1 | 0.991465 | 0.001096 | −0.130369 | 64.6193 | 0.991465 | 0.001096 | −0.130369 | 63.1118 | 0.991465 | 0.001096 | −0.130369 | 64.2937 |
2 | 0.957829 | −0.256209 | −0.130076 | 62.9014 | 0.957829 | −0.256209 | −0.130076 | 61.3853 | 0.957829 | −0.256209 | −0.130076 | 63.3354 |
3 | 0.965696 | 0.001197 | −0.259673 | 62.5639 | 0.965696 | 0.001197 | −0.259673 | 60.6194 | 0.965696 | 0.001197 | −0.259673 | 62.5386 |
4 | 0.837163 | −0.482563 | −0.257470 | 65.0225 | 0.933537 | −0.249225 | −0.257673 | 60.0265 | 0.933537 | −0.249225 | −0.257673 | 61.1850 |
5 | 0.933537 | −0.249225 | −0.257673 | 61.1241 | 0.924466 | 0.001275 | −0.381263 | 60.1770 | 0.924466 | 0.001275 | −0.381263 | 61.4550 |
6 | 0.924466 | 0.001275 | −0.381263 | 61.1949 | 0.892368 | −0.238261 | −0.383289 | 59.8760 | 0.892368 | −0.238261 | −0.383289 | 61.0429 |
7 | 0.892368 | −0.238261 | −0.383289 | 61.0548 | 0.865851 | 0.001334 | −0.500299 | 60.6104 | 0.865851 | 0.001334 | −0.500299 | 62.0652 |
8 | 0.865851 | 0.001334 | −0.500299 | 62.4123 | 0.836002 | −0.223848 | −0.500992 | 60.2192 | 0.792878 | 0.001369 | −0.609379 | 64.4184 |
9 | 0.836002 | −0.223848 | −0.500992 | 61.5018 | 0.792878 | 0.001369 | −0.609379 | 63.0487 | 0.766228 | −0.205047 | −0.608974 | 63.6609 |
10 | 0.792878 | 0.001369 | −0.609379 | 64.5335 | 0.766228 | −0.205047 | −0.608974 | 62.3829 | ||||
11 | 0.766228 | −0.205047 | −0.608974 | 62.3829 |
RCS | RCS* | RRT | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Direction | Cost | Direction | Cost | Direction | Cost | |||||||
1 | 0.999999 | 0.000978 | −0.000978 | 80.7644 | 0.999999 | 0.000978 | −0.000978 | 79.3278 | 0.999999 | 0.000978 | −0.000978 | 80.3665 |
2 | 0.991465 | 0.001096 | −0.130369 | 74.9835 | 0.991465 | 0.001096 | −0.130369 | 73.4151 | 0.991465 | 0.001096 | −0.130369 | 74.8899 |
3 | 0.957829 | 0.256209 | −0.130076 | 80.4673 | 0.957829 | −0.256209 | −0.130076 | 74.4401 | 0.957829 | 0.256209 | −0.130076 | 80.4152 |
4 | 0.957829 | −0.256209 | −0.130076 | 76.5572 | 0.965696 | 0.001197 | −0.259673 | 71.8050 | 0.957829 | −0.256209 | −0.130076 | 75.7056 |
5 | 0.965696 | 0.001197 | −0.259673 | 73.0024 | 0.837163 | −0.482563 | −0.257470 | 81.9360 | 0.965696 | 0.001197 | −0.259673 | 73.2365 |
6 | 0.933537 | 0.249225 | −0.257673 | 77.1477 | 0.933537 | −0.249225 | −0.257673 | 72.3398 | 0.933537 | 0.249225 | −0.257673 | 76.1870 |
7 | 0.837163 | −0.482563 | −0.257470 | 81.8952 | 0.924466 | 0.001275 | −0.381263 | 71.5848 | 0.933537 | −0.249225 | −0.257673 | 74.3561 |
8 | 0.933537 | −0.249225 | −0.257673 | 74.6854 | 0.892368 | −0.238261 | −0.383289 | 71.9168 | 0.924466 | 0.001275 | −0.381263 | 72.7260 |
9 | 0.924466 | 0.001275 | −0.381263 | 72.7510 | 0.865851 | 0.001334 | −0.500299 | 71.8018 | 0.892368 | 0.238261 | −0.383289 | 74.9402 |
10 | 0.892368 | 0.238261 | −0.383289 | 75.4871 | 0.836002 | −0.223848 | −0.500992 | 72.3705 | 0.892368 | −0.238261 | −0.383289 | 73.0592 |
11 | 0.892368 | −0.238261 | −0.383289 | 72.9416 | 0.792878 | 0.001369 | −0.609379 | 73.3859 | 0.865851 | 0.001334 | −0.500299 | 73.1431 |
12 | 0.865851 | 0.001334 | −0.500299 | 73.1358 | 0.766228 | −0.205047 | −0.608974 | 74.5285 | 0.836002 | 0.223848 | −0.500992 | 75.9681 |
13 | 0.836002 | 0.223848 | −0.500992 | 76.6867 | 0.836002 | −0.223848 | −0.500992 | 73.9458 | ||||
14 | 0.836002 | −0.223848 | −0.500992 | 73.6244 | 0.792878 | 0.001369 | −0.609379 | 75.3445 | ||||
15 | 0.792878 | 0.001369 | −0.609379 | 74.9628 | 0.766228 | 0.205047 | −0.608974 | 78.4385 | ||||
16 | 0.766228 | 0.205047 | −0.608974 | 78.7849 | 0.766228 | −0.205047 | −0.608974 | 75.6471 | ||||
17 | 0.766228 | −0.205047 | −0.608974 | 75.8855 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Feng, S.; Wang, S.; Jiang, W.; Gao, X. Planning of Medical Flexible Needle Motion in Effective Area of Clinical Puncture. Sensors 2023, 23, 671. https://doi.org/10.3390/s23020671
Feng S, Wang S, Jiang W, Gao X. Planning of Medical Flexible Needle Motion in Effective Area of Clinical Puncture. Sensors. 2023; 23(2):671. https://doi.org/10.3390/s23020671
Chicago/Turabian StyleFeng, Shuai, Shigang Wang, Wanxiong Jiang, and Xueshan Gao. 2023. "Planning of Medical Flexible Needle Motion in Effective Area of Clinical Puncture" Sensors 23, no. 2: 671. https://doi.org/10.3390/s23020671
APA StyleFeng, S., Wang, S., Jiang, W., & Gao, X. (2023). Planning of Medical Flexible Needle Motion in Effective Area of Clinical Puncture. Sensors, 23(2), 671. https://doi.org/10.3390/s23020671