[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

US20100121148A1 - Method and system for steerable medical device path definition and following during insertion and retraction - Google Patents

Method and system for steerable medical device path definition and following during insertion and retraction Download PDF

Info

Publication number
US20100121148A1
US20100121148A1 US12/613,739 US61373909A US2010121148A1 US 20100121148 A1 US20100121148 A1 US 20100121148A1 US 61373909 A US61373909 A US 61373909A US 2010121148 A1 US2010121148 A1 US 2010121148A1
Authority
US
United States
Prior art keywords
medical device
steerable medical
steerable
cross
locations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/613,739
Inventor
Caitlin Quance Donhowe
Amir Belson
Kristoffer John Donowe
Kenneth Robert Krieg
Eric Michael Storne
Thomas J. Yorkey
Jun Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intuitive Surgical Operations Inc
Original Assignee
Intuitive Surgical Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intuitive Surgical Inc filed Critical Intuitive Surgical Inc
Priority to US12/613,768 priority Critical patent/US8568302B2/en
Priority to US12/613,739 priority patent/US20100121148A1/en
Assigned to INTUITIVE SURGICAL, INC. reassignment INTUITIVE SURGICAL, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KRIEG, KENNETH ROBERT, STORNE, ERIC MICHAEL, YORKEY, THOMAS J., BELSON, AMIR, DONHOWE, KRISTOFFER JOHN, DONHOWE, CAITLIN QUANCE, ZHANG, JUN
Publication of US20100121148A1 publication Critical patent/US20100121148A1/en
Priority to US14/042,876 priority patent/US9517000B2/en
Assigned to Intuitive Surgical Operations, Inc. reassignment Intuitive Surgical Operations, Inc. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTUITIVE SURGICAL, INC.
Priority to US15/364,509 priority patent/US9913572B2/en
Assigned to Intuitive Surgical Operations, Inc. reassignment Intuitive Surgical Operations, Inc. CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR EXECUTION DATE PREVIOUSLY RECORDED ON REEL 040245 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: INTUITIVE SURGICAL, INC.
Priority to US16/048,438 priority patent/US20180333039A1/en
Priority to US16/999,592 priority patent/US20210038055A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005Flexible endoscopes
    • A61B1/0051Flexible endoscopes with controlled bending of insertion part
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000096Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147Holding or positioning arrangements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147Holding or positioning arrangements
    • A61B1/00148Holding or positioning arrangements using anchoring means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/00234Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
    • A61B2017/00292Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery mounted on or guided by flexible, e.g. catheter-like, means
    • A61B2017/003Steerable
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/107Visualisation of planned trajectories or target regions
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/03Automatic limiting or abutting means, e.g. for safety

Definitions

  • aspects of this invention are related to medical device path planning, and more particularly are related to path planning for an articulatable multi-segment medical device.
  • An endoscope is a medical device for visualizing the interior of a patient's body. Endoscopes have been used for a variety of medical diagnostic procedures and for a variety of medical interventional procedures.
  • one steerable endoscope has an elongated body with a steerable distal portion and an automatically controlled proximal portion.
  • Such an endoscope is described in U.S. Pat. No. 6,468,203 B2, entitled “Steerable Endoscope and Improved Method of Insertion,” of Amir Belson issued on Oct.22, 2002, which is incorporated herein by reference in its entirety.
  • waypoints of a steerable medical device are stored as the device is moved within a patient.
  • the stored waypoints are an ordered sequence of locations.
  • the ordered sequence of locations defines a safe path within the patient for moving an articulatable portion of the steerable medical device.
  • the articulatable portion of the steerable medical device is constrained to follow the safe path as the articulatable portion moves within the patient or as the device is inserted into the patient.
  • the articulatable portion of the steerable medical device is constrained to remain within a boundary region enclosing the safe path.
  • the articulatable portion of the steerable medical device includes a segment of the steerable medical device.
  • the segment in turn, includes a plurality of links.
  • the boundary region is a tube having a cross-section.
  • cross-sections include, but are not limited to, a circular cross-section, an oblate cross-section, and a rectangular cross cross-section.
  • constraining the articulatable portion of the steerable medical device to remain within a boundary region enclosing the safe path includes generating position and orientation data for each of the plurality of segments. This process uses the ordered sequence of locations and a kinematic model of the plurality of segments of the steerable medical device.
  • the process of generating position and orientation data for each of the plurality of segments includes minimizing a cost function.
  • minimizing a cost function further includes minimizing the sum of the absolute values of relative joint angles, with an additional constraint that link positions must remain within some distance ⁇ of the safe path formed by the waypoints.
  • An apparatus includes a steerable medical device having an articulatable portion.
  • the articulatable portion includes at least one articulatable segment.
  • the apparatus also includes a controller, coupled to the steerable medical device.
  • the controller includes a processor, and a medical device controller coupled to the processor and to the steerable medical device.
  • the processor stores in the memory an ordered sequence of locations of waypoints.
  • the processor also analyzes the ordered sequence of locations and outputs to the medical device controller at lease one command to constrain the articulatable portion within a boundary region enclosing a safe path defined by the ordered sequence of location.
  • FIG. 1 is a diagrammatic view of a steerable medical device including an articulatable portion, and a safe path.
  • FIG. 2 is a diagrammatic view of an apparatus used in one aspect of the processes and operations described herein.
  • FIGS. 3A to 3C are diagrammatic views of boundary regions enclosing a safe path.
  • FIG. 4 is a process flow diagram for one embodiment of a method of configuring a steerable medical device to follow a safe path.
  • FIG. 5 is a diagrammatic view of elements of a kinematic model that can be used in the method of FIG. 4 .
  • a steerable medical device 100 ( FIG. 1 ), sometimes referred to as medical device 100 , includes a plurality of segments 101 - 1 , 101 - 2 , 101 - 3 . . .
  • at least three segments 101 - 1 , 101 - 2 , 101 - 3 include a plurality of movable links 102 - 1 , 102 - 2 and 102 - 3 , respectively.
  • a tip of steerable medical device 100 is at distal end 120 and typically includes at least a camera.
  • a steerable medical device with at least three segments each having a plurality of movable links is illustrative only and in not intended to be limiting.
  • a steerable medical device may include from at least one segment having a plurality of links to a number of segments with movable links needed to provide the required functionality for the steerable medical device.
  • steerable medical device 100 An example of a steerable medical device 100 is a steerable endoscope.
  • steerable medical device 100 is referred to as steerable endoscope 100 .
  • the use of steerable endoscope 100 as an example of a steerable medical device is illustrative only and is not intended to be limiting to this specific steerable medical device.
  • the plurality of movable links in a segment allows that segment to be articulated as steerable endoscope 100 moves into and out of a patient.
  • segments are referred to as articulatable segments.
  • an operator manipulates a direction controller 245 ( FIG. 2 ) to move the tip of steerable endoscope 100 in a particular direction within the patient.
  • a direction controller 245 FIG. 2
  • an endoscope controller 240 FIG. 2
  • steerable endoscope 100 configures each of the links so that each segment is constrained to move along, e.g., to follow, a known safe path 150 ( FIG. 1 ) that is defined, in one aspect, by movement of the tip of endoscope 100 .
  • a safe path is generated. More specifically, as the operator inserts steerable endoscope 100 into a patient and moves steerable endoscope 100 towards a desired location, an ordered sequence of locations ⁇ P k , P k+1 , P k+2 , P k+3 , P k+4 ⁇ ( FIG. 1 ) of the tip of endoscope 100 are recorded in a memory 230 ( FIG. 2 ) as waypoint data 231 , in this example.
  • the ordered sequence of locations ⁇ P k , P k+1 , P k+2 , P k+3 , P k+4 ⁇ represent the motion of the tip of steerable endoscope 100 through the patient.
  • the ordered sequence of locations ⁇ P k , P k+1 , P k+2 , P k+3 , P k+4 ⁇ represent a safe path 150 , which has been chosen by the operator, for steerable endoscope 100 to follow as steerable endoscope 100 is inserted into and withdrawn from the patient.
  • steerable endoscope 100 could be inserted in a passive state, and then all the inserted articulatable segments activated at one.
  • the positions of the links in the articulatable segments at the time of activation provide an ordered sequence of locations that define safe path 150 for additional insertion and for retraction of steerable endoscope 100 .
  • all trailing segments 101 - 1 , 101 - 2 , 101 - 03 . . . of steerable endoscope 100 are constrained to follow safe path 150 that is defined by ordered sequence of locations ⁇ P k , P k+1 , P k+2 , P k+3 , P k+4 ⁇ .
  • trailing segments 101 - 1 , 101 - 2 , 101 - 03 . . . may not follow safe path 150 exactly.
  • the operator can define a boundary region around safe path 150 .
  • the boundary region (See FIGS. 3A to 3C ) is a volume inside which steerable endoscope 100 can move safely.
  • all trailing segments 101 - 1 , 101 - 2 , 101 - 03 . . . are constrained to remain within this boundary region as steerable endoscope 100 moves into the patient.
  • articulatable segments 101 - 1 , 101 - 2 , 101 - 03 . . . are constrained to remain within this boundary region.
  • a safe route for medical device 100 into and out of a patient is generated based on waypoint data 231 recorded as steerable endoscope 100 moves into the patient.
  • segment 101 - 1 When segment 101 - 1 is considered a trailing segment, as just described, segment 101 - 1 is controlled in the same way as the other trailing articulatable segments. However, in another insertion mode, segment 101 - 1 remains directly controlled by the operator and does not change shape with insertion. In this insertion mode, segment 101 - 1 would not be considered a trailing segment.
  • FIGS. 3A to 3C are illustrations of boundary regions 310 A to 310 C, with different cross-sectional shapes, for safe path 150 defined by ordered sequence of locations ⁇ P k , P k+1 , P k+2 , P k+3 , P k+4 ⁇ .
  • boundary region 310 A has a circular cross-section.
  • boundary region 310 B has an oblate cross-section.
  • boundary region 310 C has a rectangular cross-section, and in particular, a specific instance of a rectangular cross-section, a square cross-section.
  • each location P k is a point in space (x k , y k , z k ) relative to a fixed reference frame.
  • each of boundary regions 310 A, 310 B, 310 C defines a three-dimensional volume enclosing safe path 150 .
  • This volume is referred to as a tube having a cross section to convey the three-dimensional characteristics of the volume.
  • Tube as used here, is not a physical tube inserted in the patient to define the volume.
  • FIGS. 3A to 3C are illustrative only and are not intended to be limiting. In view of this disclosure, for a particular medical procedure and steerable medical device, an appropriately shaped boundary region or regions can be selected.
  • boundary region it is not necessary that the boundary region have the same cross-sectional shape over the entire extent of the safe path.
  • a first portion of a boundary region could have a first cross-sectional shape
  • a second portion of the boundary region could have a second cross-sectional shape that is different from the first cross-sectional shape.
  • FIG. 4 is a process flow diagram for one embodiment of a method 400 used with a steerable medical device such as steerable endoscope 100 .
  • instructions in a METHOD 400 module 232 ( FIG. 2 ) in memory 230 are executed on a processor in processor module 250 to perform at least some of the operations described more completely below.
  • STORE WAYPOINTS operation 420 saves waypoints of the tip of steerable endoscope 100 as an ordered sequence of locations.
  • the ordered sequence of locations represents the trajectory of the tip as steerable endoscope 100 is inserted into the patient.
  • the ordered sequence of locations defines a safe path 150 that has been selected by the operator of steerable endoscope 100 .
  • FOLLOW SAFE PATH process 430 configures the articulatable portion of endoscope 100 so that the articulatable portion of endoscope 100 is constrained to follow safe path 150 as the articulatable portion moves within the patient.
  • following the safe path does not mean that the safe path is followed exactly, but rather that the articulatable portion steerable endoscope 100 stays at least within a safe region, sometimes called a boundary region, about safe path 150 .
  • FIG. 4 one embodiment of STORE WAYPOINTS operation 420 and FOLLOW SAFE PATH process 430 are illustrated and described more completely below. This embodiment is illustrative only and is not intended to be limiting to the specific operations and processes described. In view of this disclosure, one knowledgeable in the field can utilize other techniques to move the articulatable portion of a steerable medical into and out of a patient while following the safe path described herein.
  • an INTIALIZE operation 401 is performed upon initiation of method 400 .
  • INTIALIZE operation 401 initializes any variables, memory structures etc that are need for subsequent operations in method 400 .
  • INITIALIZE operation 401 uses display controller 235 ( FIG. 2 ) to generate a display on display device 210 that permits the operator of steerable endoscope 100 to select parameters that define the extent of the boundary region, for example.
  • INTIALIZE operation 401 transfers processing to ESTABLISH WAYPOINT operation 402 in STORE WAYPOINTS operation 420 .
  • ESTABLISH WAYPOINT operation 402 a waypoint on the safe path of the endoscope is established. This can be done in a variety of ways. Accordingly, check operations 410 to 412 , as discussed more completely below, are illustrative only and are not intended to be limiting to this particular implementation.
  • DEVICE MOTION PAUSED check operation 410 transfers processing to DEVICE MOTION RESUMED check operation 411 .
  • steerable endoscope 100 is paused to determine a safe trajectory for the tip, the operator uses the camera and illumination at the tip of steerable endoscope 100 to determine a safe trajectory inside the body cavity.
  • the endoscope tip may be oriented in any direction to provide views of the body cavity.
  • INSERTION check operation 412 determines whether after the pause, the operation is continuing to insert endoscope 100 or is retracting endoscope 100 . If the operator is continuing to insert endoscope 100 , check operation 412 transfers processing to SAVE WAYPOINT operation 430 . Conversely, if the operator is retracting endoscope 100 , check operation 412 transfers to DEVICE MOTION PAUSED check operation 410 and to MAINTAIN SEGMENTS IN BOUNDARY REGION operation 405 .
  • the combination of operations 410 to 412 is one way to allow an operator to establish a waypoint.
  • the operator could, for example, push a button when a safe trajectory has been identified and the operator is about to move the endoscope tip on that trajectory.
  • SAVE WAYPOINT operation 403 records the previous location of the tip as a waypoint in WAYPOINT DATA 403 a, which in FIG. 2 is shown as waypoint data 231 .
  • SAVE WAYPOINT operation 403 upon completion, transfers processing to NEW LINK INSERTED check operation 404 .
  • SAVE WAYPOINT operation 403 also transfers back to the start of ESTABLISH WAYPOINT operation 402 in case the operator decides to change the direction of the safe trajectory.
  • insertion of a link is used as a trigger to record another waypoint for the tip.
  • other criteria can be used so long as locations of the tip are saved with sufficient resolution to permit determining a safe path.
  • steerable endoscope 100 is moved further into the patient along the safe trajectory, as each new link is inserted in the patient, the location of the tip is saved as another waypoint.
  • NEW LINK INSERTED check operation 404 transfers processing to SAVE WAYPOINT operation 403 , which was described above, and to UPDATE check operation 409 .
  • UPDATE check operation 409 is shown with a dotted line in FIG. 4 because check operation 409 is optional.
  • the configuration of the trailing segments of endoscope 100 is updated only after a predefined number of new waypoints have been saved.
  • UPDATE check operation 409 does not transfer processing to process 405 until the predefined number of new waypoints is available in WAYPOINT DATA 403 A.
  • UPDATE check operation 409 checks the states of the articulatable segments and if none of the articulatable segments have state articulating, UPDATE check operation 409 does not transfer processing to process 405 .
  • the configuration of the trailing segments of endoscope 100 is updated for each new waypoint and so UPDATE check operation 409 is not needed.
  • FOLLOW SAFE PATH process 430 includes MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 and SEND COMMAND process 406 .
  • P k denotes the Cartesian coordinates of the endoscope tip when the number of the inserted links is k.
  • the boundary region defines a volume around safe path 150 , i.e., a volume that encloses safe path 150 .
  • the trailing segments can safely pass through any part of the boundary region as the trailing segments move towards the surgical site, or move away from the surgical site.
  • a kinematic model of steerable endoscope 100 is used in MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 .
  • a first level 501 of model 500 defines the number of articulatable segments in a plurality of articulatable segments of the steerable endoscope.
  • the steerable endoscope has four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4.
  • a second level 502 of model 500 is a representation of links and joints in each of four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4.
  • each segment includes eight links, where adjacent links are separated by a joint.
  • the joints are numbered sequentially from the distal end to the proximal end of the endoscope, starting with a value one. (This numbering sequence is for convenience only. In other aspects, the numbering may increase in going from a proximal location towards a distal location.)
  • Each link has a fixed length and the associated joint can rotate in a single plane, either the x-plane or the y-plane. The joints alternate so adjacent links rotate in different planes.
  • each of four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4 has an angle of rotation about the x-axis and an angle of rotation about the y-axis.
  • the angle of rotation about the x-axis is ⁇ y 1 , (sometimes referred to as pitch) and the angle of rotation about the y-axis is ⁇ x 1 (sometimes referred to as yaw).
  • the angle of rotation about the x-axis is ⁇ y 2
  • the angle of rotation about the y-axis is ⁇ x 2 .
  • the angle of rotation about the x-axis is ⁇ y 3
  • the angle of rotation about the y-axis is ⁇ x 3
  • the angle of rotation about the x-axis is ⁇ y 4
  • the angle of rotation about the y-axis is ⁇ x 4 .
  • Row 505 in model 500 gives the initial constraint on the joint angles.
  • the joint angles for a segment are assumed to be equal.
  • each joint angle is one-fourth of the corresponding segment angle.
  • Row 506 in model 500 gives the roll matrix for each joint.
  • y-links are links that cause motion in the y-direction rather than links that rotate about the y-direction.
  • This definition results in R x ( ⁇ y ).
  • x-links are links that cause motion in the x-direction rather than links that rotate about the x-direction.
  • R y ( ⁇ x ) Those knowledgeable in the field understand that alternative definitions can be used in the kinematic model, where x-links are links that rotate about the x-direction and y-links are links that rotate about the y-direction. Irrespective of the kinematic model definitions, the results are equivalent.
  • model 500 is illustrative only and is not intended to be limiting. Model 500 is used in one example that is developed more completely below.
  • a cost function is minimized to generate position and orientation data of the endoscope segments in MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 .
  • positions and orientations are generated for each of the links in the articulatable portion of endoscope 100 .
  • the positions and orientations are constrained within the boundary region.
  • the cost function allows the position and orientation to be optimized for a variety of criteria, for example, but not limited to: 1) maximum tip controllability; 2) maximum distance of the segments from inverse-kinematic singularities; 3) maximum distance of the segments from articulation limits; 4) maximum distance from user-defined body-cavity boundaries (organs, adhesions, etc.); 5) minimum distance from the defined path.
  • the cost function may be a dynamically changing function of any number of criteria. However, the number of criteria is selected so the cost function can be minimized and the segments positioned to achieve the constrained movement within an endoscope movement time acceptable to the operator. Conventional techniques are used by a processor to minimize the cost function selected subject to the position constraints imposed.
  • an embodiment of process 405 determines the optimal configuration of the segments (relative segment angles) to satisfy the constraint that the segment links stay “near to” the path defined by the tip forward motion and any additional constraints on the link (or segment) positions.
  • the segments may be allowed to assume positions within a tubular bounding region 310 A ( FIG. 3A ) around the tip path while encouraging tip manipulability.
  • distance ⁇ is specified by the operator.
  • MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 transfers processing to SEND COMMAND process 406 ( FIG. 4 ).
  • SEND COMMAND process 406 the processor in processor module 250 ( FIG. 2 ) sends at least one command to the motors in endoscope controller 240 to configure the articulatable segments based on the locations and orientations generated in process 405 , i.e., based on the configuration generated in process 405 . This constrains the articulatable segments within the boundary region as endoscope 100 moves further into the patient.
  • SEND COMMAND process 406 transfers to DEVICE MOTION PAUSED check operation 410 and to RETRACTION AND LINK RETRACTED check operation 407 .
  • RETRACTION AND LINK RETRACTED check operation 407 determines whether endoscope 100 is being retracted and whether a link has been retracted. If both of these conditions are true, check operation 407 transfers to DELETE WAYPOINT operation 408 .
  • DELETE WAYPOINT operation 408 deletes the stored waypoint for the withdrawn link and transfers to operation 405 . Hence, operations 405 to 408 cause endoscope 100 to follow safe path 150 as endoscope 100 is retracted from the patient.
  • endoscope controller 240 configures the segments so that as the segments move forward, the segments are constrained to stay within the boundary region.
  • the segments may not follow the trajectory of the tip exactly, but the segments follow a path within the boundary region that is safe.
  • the control of the joint angles at constant endoscopic length increments is considered such that the endoscope configuration is kept within a safety area, the boundary region described above, during the process of insertion and withdrawal.
  • a configuration of the trailing links that is closest, as measured by Euclidean norm, to the tip trajectory is generated in process 405 , since the tip trajectory represents a safe route selected by the operator.
  • P k denotes the Cartesian coordinate of the endoscope tip when the number of the inserted links is k.
  • p k is the coordinate of each link determined by the kinematics model.
  • J n + 1 1 2 ⁇ ⁇ p n + 1 - P ⁇ 2 ⁇ 1 2 ⁇ ⁇ ⁇ ⁇ n ⁇ p ⁇ ⁇ ⁇ ⁇ ⁇ n + p n - P ⁇ 2 . ( 4 )
  • the first input parameter be defined as:
  • the vector of joint angles is defined as:
  • q jw [ ⁇ x 1 4 , ⁇ y 1 4 , ⁇ x 1 4 , ⁇ y 1 4 , ⁇ x 1 4 , ⁇ y 1 4 , ⁇ x 1 4 , ⁇ y 1 4 , ⁇ x 2 4 , ⁇ y 2 4 , ⁇ x 2 4 , ⁇ y 2 4 , ⁇ x 2 4 , ⁇ y 2 4 , ⁇ x 2 4 , ⁇ y 2 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 , ⁇ y 3 4 , ⁇ x 3 4 ,
  • T 1 ⁇ ⁇ w ⁇ ( 1 ) [ R y ⁇ ( - ⁇ x 1 4 ) ( 0 0 - a ⁇ ( 1 ) ) 0 1 ]
  • ⁇ T 1 ⁇ ⁇ w ⁇ ( 3 ) [ R y ⁇ ( - ⁇ x 1 4 ) ( 0 0 - a ⁇ ( 3 ) ) 0 1 ]
  • ⁇ T 1 ⁇ ⁇ w ⁇ ( 5 ) [ R y ⁇ ( - ⁇ x 1 4 ) ( 0 0 - a ⁇ ( 5 ) ) 0 1 ]
  • ⁇ T 1 ⁇ ⁇ w ⁇ ( 7 ) [ R y ⁇ ( - ⁇ x 1 4 ) ( 0 0 - a ⁇ ( 7 ) 0 1 ]
  • ⁇ T 1 ⁇ ⁇ w ⁇ ( 2 ) [ R x ⁇ ( ⁇ ( - x
  • the cumulative transform to the base from the distal end of link k can be derived as
  • R is a rotation matrix
  • each waypoint only includes two degrees of freedom corresponding to an insertion depth and the above processes become less computationally intensive while the safe path is followed.
  • System controller 220 ( FIG. 2 ) is illustrated as unified structures for ease of illustration and understanding. This is illustrative only and is not intended to be limiting. The various component of system controller 220 can be located apart and still perform the functions described.
  • Memory refers to a volatile memory, a non-volatile memory, or any combination of the two.
  • a processor is coupled to a memory containing instructions executed by the processor. This could be accomplished within a computer system, or alternatively via a connection to another computer via modems and analog lines, or digital interfaces and a digital carrier line.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Endoscopes (AREA)

Abstract

Waypoints for a steerable medical device are stored as the steerable medical device is moved within a patient. The stored waypoints are an ordered sequence of locations. The ordered sequence of locations defines a safe path within the patient for moving an articulatable portion of the steerable medical device. The articulatable portion of the steerable medical device is constrained to follow the safe path as the articulatable portion moves within the patient. For example, the articulatable portion of the steerable medical device is constrained to remain within a boundary region enclosing the safe path as the articulatable portion of the steerable medical device follows the safe path.

Description

    RELATED APPLICATION
  • The present application claims the benefit of U.S. Provisional Patent Application No. 61/113,534 filed Nov. 11, 2008 entitled “Method for Robotic Endoscope Path Definition and Following During Insertion and Retraction,” naming as inventors, Caitlin Donhowe, Jun Zhang, Kristoffer Donhowe, Eric Storne, Thomas Yorkey, Kenneth R. Krieg, and Amir Belson, the entirety of which is hereby incorporated by reference.
  • BACKGROUND
  • 1. Field of Invention
  • Aspects of this invention are related to medical device path planning, and more particularly are related to path planning for an articulatable multi-segment medical device.
  • 2. Related Art
  • An endoscope is a medical device for visualizing the interior of a patient's body. Endoscopes have been used for a variety of medical diagnostic procedures and for a variety of medical interventional procedures.
  • Many different types of endoscopes are known. For example, one steerable endoscope has an elongated body with a steerable distal portion and an automatically controlled proximal portion. Such an endoscope is described in U.S. Pat. No. 6,468,203 B2, entitled “Steerable Endoscope and Improved Method of Insertion,” of Amir Belson issued on Oct.22, 2002, which is incorporated herein by reference in its entirety.
  • In general, conventional medical device path-planning is performed using medical imaging data usually CAT, X-ray, MRI, PET of fluoroscopy imaging data. Path-planning is considered in U.S. Pat. No. 5,611,025, entitled “Virtual internal cavity inspection system,” issued Mar. 11, 1997; U.S. Pat. No. 7,167,180, entitled “Automatic path planning system and method,” issued Jan. 23,2007; U.S. Pat. No. 6,380,958, entitled “Medical-technical System,” issued Apr. 30, 2002; U.S. Patent Application Publication No. US 2008/0091340 A1 (filed Dec. 26, 2004, disclosing “Targeted Marching”); and U.S. Patent Application Publication No. US 2003/0109780 A1 (filed Jun. 6, 2002, disclosing “Methods and Apparatus for Surgical Planning”).
  • SUMMARY
  • Unlike prior art methods that required path planning prior to use of a steerable medical device, waypoints of a steerable medical device are stored as the device is moved within a patient. The stored waypoints are an ordered sequence of locations. The ordered sequence of locations defines a safe path within the patient for moving an articulatable portion of the steerable medical device.
  • Thus, the articulatable portion of the steerable medical device is constrained to follow the safe path as the articulatable portion moves within the patient or as the device is inserted into the patient. In one aspect, the articulatable portion of the steerable medical device is constrained to remain within a boundary region enclosing the safe path.
  • In one embodiment, the articulatable portion of the steerable medical device includes a segment of the steerable medical device. The segment, in turn, includes a plurality of links.
  • In another aspect, the boundary region is a tube having a cross-section. Examples of cross-sections include, but are not limited to, a circular cross-section, an oblate cross-section, and a rectangular cross cross-section.
  • In still yet another aspect, constraining the articulatable portion of the steerable medical device to remain within a boundary region enclosing the safe path includes generating position and orientation data for each of the plurality of segments. This process uses the ordered sequence of locations and a kinematic model of the plurality of segments of the steerable medical device.
  • The process of generating position and orientation data for each of the plurality of segments includes minimizing a cost function. In one aspect, minimizing a cost function further includes minimizing the sum of the absolute values of relative joint angles, with an additional constraint that link positions must remain within some distance Δ of the safe path formed by the waypoints.
  • An apparatus includes a steerable medical device having an articulatable portion. The articulatable portion includes at least one articulatable segment. The apparatus also includes a controller, coupled to the steerable medical device. The controller includes a processor, and a medical device controller coupled to the processor and to the steerable medical device. The processor stores in the memory an ordered sequence of locations of waypoints. The processor also analyzes the ordered sequence of locations and outputs to the medical device controller at lease one command to constrain the articulatable portion within a boundary region enclosing a safe path defined by the ordered sequence of location.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagrammatic view of a steerable medical device including an articulatable portion, and a safe path.
  • FIG. 2 is a diagrammatic view of an apparatus used in one aspect of the processes and operations described herein.
  • FIGS. 3A to 3C are diagrammatic views of boundary regions enclosing a safe path.
  • FIG. 4 is a process flow diagram for one embodiment of a method of configuring a steerable medical device to follow a safe path.
  • FIG. 5 is a diagrammatic view of elements of a kinematic model that can be used in the method of FIG. 4.
  • In the drawings, the first digit of a figure number indicates the figure in which the element with that figure number first appeared.
  • DETAILED DESCRIPTION
  • In one aspect, a steerable medical device 100 (FIG. 1), sometimes referred to as medical device 100, includes a plurality of segments 101-1, 101-2, 101-3 . . . In the embodiment of FIG. 1, at least three segments 101-1, 101-2, 101-3 include a plurality of movable links 102-1, 102-2 and 102-3, respectively. In one aspect, a tip of steerable medical device 100 is at distal end 120 and typically includes at least a camera.
  • The use of a steerable medical device with at least three segments each having a plurality of movable links is illustrative only and in not intended to be limiting. In view of this disclosure, a steerable medical device may include from at least one segment having a plurality of links to a number of segments with movable links needed to provide the required functionality for the steerable medical device.
  • An example of a steerable medical device 100 is a steerable endoscope. In the following description, steerable medical device 100 is referred to as steerable endoscope 100. The use of steerable endoscope 100 as an example of a steerable medical device is illustrative only and is not intended to be limiting to this specific steerable medical device.
  • The plurality of movable links in a segment allows that segment to be articulated as steerable endoscope 100 moves into and out of a patient. Thus, such segments are referred to as articulatable segments.
  • In one aspect, an operator manipulates a direction controller 245 (FIG. 2) to move the tip of steerable endoscope 100 in a particular direction within the patient. In response to commands from a processor in processor module 250, as described more completely below, and a signal from direction controller 245, an endoscope controller 240 (FIG. 2) for steerable endoscope 100 configures each of the links so that each segment is constrained to move along, e.g., to follow, a known safe path 150 (FIG. 1) that is defined, in one aspect, by movement of the tip of endoscope 100.
  • In one embodiment, as the operator steers the tip of steerable endoscope 100 through the patient, a safe path is generated. More specifically, as the operator inserts steerable endoscope 100 into a patient and moves steerable endoscope 100 towards a desired location, an ordered sequence of locations {Pk, Pk+1, Pk+2, Pk+3, Pk+4} (FIG. 1) of the tip of endoscope 100 are recorded in a memory 230 (FIG. 2) as waypoint data 231, in this example.
  • The ordered sequence of locations {Pk, Pk+1, Pk+2, Pk+3, Pk+4} (FIG. 1) represent the motion of the tip of steerable endoscope 100 through the patient. Thus, the ordered sequence of locations {Pk, Pk+1, Pk+2, Pk+3, Pk+4} represent a safe path 150, which has been chosen by the operator, for steerable endoscope 100 to follow as steerable endoscope 100 is inserted into and withdrawn from the patient.
  • Using the tip movement to generate an ordered sequence of locations that define safe path 150 is illustrative only and is not intended to be limiting. Alternatively, steerable endoscope 100 could be inserted in a passive state, and then all the inserted articulatable segments activated at one. The positions of the links in the articulatable segments at the time of activation provide an ordered sequence of locations that define safe path 150 for additional insertion and for retraction of steerable endoscope 100.
  • In one aspect, as described more completely below, all trailing segments 101-1, 101-2, 101-03 . . . of steerable endoscope 100 are constrained to follow safe path 150 that is defined by ordered sequence of locations {Pk, Pk+1, Pk+2, Pk+3, Pk+4}. However, trailing segments 101-1, 101-2, 101-03 . . . may not follow safe path 150 exactly. In one aspect, the operator can define a boundary region around safe path 150. The boundary region (See FIGS. 3A to 3C) is a volume inside which steerable endoscope 100 can move safely. In one aspect, all trailing segments 101-1, 101-2, 101-03 . . . are constrained to remain within this boundary region as steerable endoscope 100 moves into the patient.
  • Also, in another aspect, as medical device 100 is withdrawn from the patient, articulatable segments 101-1, 101-2, 101-03 . . . are constrained to remain within this boundary region. Hence, unlike prior art techniques that required advance planning, a safe route for medical device 100 into and out of a patient is generated based on waypoint data 231 recorded as steerable endoscope 100 moves into the patient.
  • When segment 101-1 is considered a trailing segment, as just described, segment 101-1 is controlled in the same way as the other trailing articulatable segments. However, in another insertion mode, segment 101-1 remains directly controlled by the operator and does not change shape with insertion. In this insertion mode, segment 101-1 would not be considered a trailing segment.
  • FIGS. 3A to 3C are illustrations of boundary regions 310A to 310C, with different cross-sectional shapes, for safe path 150 defined by ordered sequence of locations {Pk, Pk+1, Pk+2, Pk+3, Pk+4}. In FIG. 3A, boundary region 310A has a circular cross-section. In FIG. 3B, boundary region 310B has an oblate cross-section. In FIG. 3C, boundary region 310C has a rectangular cross-section, and in particular, a specific instance of a rectangular cross-section, a square cross-section.
  • In one aspect, each location Pk is a point in space (xk, yk, zk) relative to a fixed reference frame. Thus, each of boundary regions 310A, 310B, 310C defines a three-dimensional volume enclosing safe path 150. This volume is referred to as a tube having a cross section to convey the three-dimensional characteristics of the volume. Tube, as used here, is not a physical tube inserted in the patient to define the volume.
  • The particular cross-sectional shapes of the boundary regions illustrated in FIGS. 3A to 3C are illustrative only and are not intended to be limiting. In view of this disclosure, for a particular medical procedure and steerable medical device, an appropriately shaped boundary region or regions can be selected.
  • It is not necessary that the boundary region have the same cross-sectional shape over the entire extent of the safe path. For example, a first portion of a boundary region could have a first cross-sectional shape, and a second portion of the boundary region could have a second cross-sectional shape that is different from the first cross-sectional shape.
  • FIG. 4 is a process flow diagram for one embodiment of a method 400 used with a steerable medical device such as steerable endoscope 100. In one aspect, instructions in a METHOD 400 module 232 (FIG. 2) in memory 230 are executed on a processor in processor module 250 to perform at least some of the operations described more completely below.
  • In method 400, STORE WAYPOINTS operation 420, as described more completely below, saves waypoints of the tip of steerable endoscope 100 as an ordered sequence of locations. The ordered sequence of locations represents the trajectory of the tip as steerable endoscope 100 is inserted into the patient. As described above, the ordered sequence of locations defines a safe path 150 that has been selected by the operator of steerable endoscope 100.
  • The stored ordered sequence of locations is retrieved and analyzed in FOLLOW SAFE PATH process 430. FOLLOW SAFE PATH process 430 configures the articulatable portion of endoscope 100 so that the articulatable portion of endoscope 100 is constrained to follow safe path 150 as the articulatable portion moves within the patient. Herein, following the safe path does not mean that the safe path is followed exactly, but rather that the articulatable portion steerable endoscope 100 stays at least within a safe region, sometimes called a boundary region, about safe path 150.
  • In FIG. 4, one embodiment of STORE WAYPOINTS operation 420 and FOLLOW SAFE PATH process 430 are illustrated and described more completely below. This embodiment is illustrative only and is not intended to be limiting to the specific operations and processes described. In view of this disclosure, one knowledgeable in the field can utilize other techniques to move the articulatable portion of a steerable medical into and out of a patient while following the safe path described herein.
  • In FIG. 4, upon initiation of method 400, an INTIALIZE operation 401 is performed. INTIALIZE operation 401 initializes any variables, memory structures etc that are need for subsequent operations in method 400. In one aspect, INITIALIZE operation 401 uses display controller 235 (FIG. 2) to generate a display on display device 210 that permits the operator of steerable endoscope 100 to select parameters that define the extent of the boundary region, for example. Upon completion INTIALIZE operation 401 (FIG. 4) transfers processing to ESTABLISH WAYPOINT operation 402 in STORE WAYPOINTS operation 420.
  • In ESTABLISH WAYPOINT operation 402, a waypoint on the safe path of the endoscope is established. This can be done in a variety of ways. Accordingly, check operations 410 to 412, as discussed more completely below, are illustrative only and are not intended to be limiting to this particular implementation.
  • In one aspect, as the operator inserts steerable endoscope 100 into a body cavity (for instance, through an incision in the stomach into the abdominal cavity) insertion is paused periodically. When motion of endoscope 100 is paused, DEVICE MOTION PAUSED check operation 410 transfers processing to DEVICE MOTION RESUMED check operation 411.
  • If steerable endoscope 100 is paused to determine a safe trajectory for the tip, the operator uses the camera and illumination at the tip of steerable endoscope 100 to determine a safe trajectory inside the body cavity. When viewing the interior of the body cavity and determining a safe direction for farther insertion, the endoscope tip may be oriented in any direction to provide views of the body cavity.
  • Once a safe trajectory is determined, the tip is oriented in the direction that the operator intends steerable endoscope 100 to travel upon farther insertion. The operator then inserts endoscope 100 farther into the patient. However, the operator could also retract endoscope 100 after the pause. Thus, upon resumption of motion of endoscope 100, DEVICE MOTION RESUMED check operation 411 transfers processing to INSERTION check operation 412.
  • INSERTION check operation 412 determines whether after the pause, the operation is continuing to insert endoscope 100 or is retracting endoscope 100. If the operator is continuing to insert endoscope 100, check operation 412 transfers processing to SAVE WAYPOINT operation 430. Conversely, if the operator is retracting endoscope 100, check operation 412 transfers to DEVICE MOTION PAUSED check operation 410 and to MAINTAIN SEGMENTS IN BOUNDARY REGION operation 405.
  • Again, the combination of operations 410 to 412 is one way to allow an operator to establish a waypoint. Alternatively, the operator could, for example, push a button when a safe trajectory has been identified and the operator is about to move the endoscope tip on that trajectory.
  • SAVE WAYPOINT operation 403 records the previous location of the tip as a waypoint in WAYPOINT DATA 403a, which in FIG. 2 is shown as waypoint data 231. SAVE WAYPOINT operation 403, upon completion, transfers processing to NEW LINK INSERTED check operation 404. SAVE WAYPOINT operation 403 also transfers back to the start of ESTABLISH WAYPOINT operation 402 in case the operator decides to change the direction of the safe trajectory.
  • In this example, insertion of a link is used as a trigger to record another waypoint for the tip. However, other criteria can be used so long as locations of the tip are saved with sufficient resolution to permit determining a safe path. As steerable endoscope 100 is moved further into the patient along the safe trajectory, as each new link is inserted in the patient, the location of the tip is saved as another waypoint. In this example, when a new link is inserted, NEW LINK INSERTED check operation 404 transfers processing to SAVE WAYPOINT operation 403, which was described above, and to UPDATE check operation 409.
  • UPDATE check operation 409 is shown with a dotted line in FIG. 4 because check operation 409 is optional. In one aspect, the configuration of the trailing segments of endoscope 100 is updated only after a predefined number of new waypoints have been saved. In this aspect, UPDATE check operation 409 does not transfer processing to process 405 until the predefined number of new waypoints is available in WAYPOINT DATA 403A. Also, UPDATE check operation 409 checks the states of the articulatable segments and if none of the articulatable segments have state articulating, UPDATE check operation 409 does not transfer processing to process 405. Alternatively, the configuration of the trailing segments of endoscope 100 is updated for each new waypoint and so UPDATE check operation 409 is not needed.
  • In this embodiment, FOLLOW SAFE PATH process 430 includes MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 and SEND COMMAND process 406. MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 uses the saved waypoints to generate a configuration for each of the inserted links so that trailing segments 101-1 to 101-3 follow safe path 150 of the tip as defined by the waypoints. As noted above, for some steerable medical devices, it may not be possible to configure the trailing segments to follow exactly safe path 150. Thus, in one aspect, a boundary region about the ordered sequence of locations {Pk}k=1 N is generated. Here, Pk denotes the Cartesian coordinates of the endoscope tip when the number of the inserted links is k. After the endoscope has been inserted for N links, the path trajectory of the endoscope tip is recorded as ordered sequence of locations {Pk}k=1 N in memory 230 (FIG. 2).
  • As described above, the boundary region defines a volume around safe path 150, i.e., a volume that encloses safe path 150. The trailing segments can safely pass through any part of the boundary region as the trailing segments move towards the surgical site, or move away from the surgical site.
  • In one aspect, a kinematic model of steerable endoscope 100, such as model 500 in FIG. 5, is used in MAINTAIN SEGMENTS IN BOUNDARY REGION process 405. In kinematic model 500, (FIG. 5), a first level 501 of model 500 defines the number of articulatable segments in a plurality of articulatable segments of the steerable endoscope. In this example, the steerable endoscope has four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4.
  • A second level 502 of model 500 is a representation of links and joints in each of four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4. In this example, each segment includes eight links, where adjacent links are separated by a joint. The joints are numbered sequentially from the distal end to the proximal end of the endoscope, starting with a value one. (This numbering sequence is for convenience only. In other aspects, the numbering may increase in going from a proximal location towards a distal location.) Each link has a fixed length and the associated joint can rotate in a single plane, either the x-plane or the y-plane. The joints alternate so adjacent links rotate in different planes.
  • In model 500, each of four articulatable segments Seg 1, Seg 2, Seg 3, and Seg 4 has an angle of rotation about the x-axis and an angle of rotation about the y-axis. For articulatable segment Seg 1, the angle of rotation about the x-axis is θy 1, (sometimes referred to as pitch) and the angle of rotation about the y-axis is θx 1 (sometimes referred to as yaw). For articulatable segment Seg 2, the angle of rotation about the x-axis is θy 2, and the angle of rotation about the y-axis is θx 2. For articulatable segment Seg 3, the angle of rotation about the x-axis is θy 3, and the angle of rotation about the y-axis is θx 3. For articulatable segment Seg 4, the angle of rotation about the x-axis is θy 4, and the angle of rotation about the y-axis is θx 4.
  • Row 505 in model 500 gives the initial constraint on the joint angles. In this example, the joint angles for a segment are assumed to be equal. Thus, each joint angle is one-fourth of the corresponding segment angle. Row 506 in model 500 gives the roll matrix for each joint.
  • In this model, y-links are links that cause motion in the y-direction rather than links that rotate about the y-direction. This definition results in Rxy). Similarly, in this model, x-links are links that cause motion in the x-direction rather than links that rotate about the x-direction. This definition results in Ryx) Those knowledgeable in the field understand that alternative definitions can be used in the kinematic model, where x-links are links that rotate about the x-direction and y-links are links that rotate about the y-direction. Irrespective of the kinematic model definitions, the results are equivalent.
  • Thus, model 500 is illustrative only and is not intended to be limiting. Model 500 is used in one example that is developed more completely below.
  • Using stored ordered sequence of locations {Pk}k=1 N and kinematic model 500, a cost function is minimized to generate position and orientation data of the endoscope segments in MAINTAIN SEGMENTS IN BOUNDARY REGION process 405. Specifically, in one aspect, positions and orientations are generated for each of the links in the articulatable portion of endoscope 100. The positions and orientations are constrained within the boundary region.
  • The cost function allows the position and orientation to be optimized for a variety of criteria, for example, but not limited to: 1) maximum tip controllability; 2) maximum distance of the segments from inverse-kinematic singularities; 3) maximum distance of the segments from articulation limits; 4) maximum distance from user-defined body-cavity boundaries (organs, adhesions, etc.); 5) minimum distance from the defined path.
  • In process 405, the cost function may be a dynamically changing function of any number of criteria. However, the number of criteria is selected so the cost function can be minimized and the segments positioned to achieve the constrained movement within an endoscope movement time acceptable to the operator. Conventional techniques are used by a processor to minimize the cost function selected subject to the position constraints imposed.
  • In an additional aspect, an embodiment of process 405 determines the optimal configuration of the segments (relative segment angles) to satisfy the constraint that the segment links stay “near to” the path defined by the tip forward motion and any additional constraints on the link (or segment) positions.
  • For example, in process 405, the segments may be allowed to assume positions within a tubular bounding region 310A (FIG. 3A) around the tip path while encouraging tip manipulability. One way to encourage tip manipulability in process 405 is to minimize the sum of the absolute values of the relative joint angles, with the additional constraint that the link positions not deviate by more than a distance at each of the waypoints in ordered sequence of locations {Pk}k=1 N. In one aspect, distance Δ is specified by the operator.
  • Upon determining the configuration for each of the articulatable segments, MAINTAIN SEGMENTS IN BOUNDARY REGION process 405 transfers processing to SEND COMMAND process 406 (FIG. 4). In SEND COMMAND process 406, the processor in processor module 250 (FIG. 2) sends at least one command to the motors in endoscope controller 240 to configure the articulatable segments based on the locations and orientations generated in process 405, i.e., based on the configuration generated in process 405. This constrains the articulatable segments within the boundary region as endoscope 100 moves further into the patient.
  • SEND COMMAND process 406 transfers to DEVICE MOTION PAUSED check operation 410 and to RETRACTION AND LINK RETRACTED check operation 407. RETRACTION AND LINK RETRACTED check operation 407 determines whether endoscope 100 is being retracted and whether a link has been retracted. If both of these conditions are true, check operation 407 transfers to DELETE WAYPOINT operation 408.
  • DELETE WAYPOINT operation 408 deletes the stored waypoint for the withdrawn link and transfers to operation 405. Hence, operations 405 to 408 cause endoscope 100 to follow safe path 150 as endoscope 100 is retracted from the patient.
  • In the example of FIG. 2, in response to the command, endoscope controller 240 configures the segments so that as the segments move forward, the segments are constrained to stay within the boundary region. Thus, the segments may not follow the trajectory of the tip exactly, but the segments follow a path within the boundary region that is safe.
  • When the operator starts to withdraw the endoscope from the patient, the waypoints in the stored ordered sequence of locations {Pk}k=1 N decrease by one as each link is withdrawn. Processes 405 and 406 are used as steerable endoscope is withdrawn to maintain endoscope 100 with the boundary region.
  • As a further example of process 405, the control of the joint angles at constant endoscopic length increments is considered such that the endoscope configuration is kept within a safety area, the boundary region described above, during the process of insertion and withdrawal. In this example, a configuration of the trailing links that is closest, as measured by Euclidean norm, to the tip trajectory is generated in process 405, since the tip trajectory represents a safe route selected by the operator.
  • As described above Pk denotes the Cartesian coordinate of the endoscope tip when the number of the inserted links is k. After the endoscope has been inserted for N links, the path trajectory of the endoscope tip is recorded in a series {Pk}k=1 N. Process 405 controls the joint angles to achieve an endoscope link configuration close to the waypoints in recorded series {Pk}k=1 N. This is formulated as the following optimization, where J is the cost function discussed above:
  • min θ J = 1 2 k = 1 N p k - P k 2 ( 1 )
  • subject to

  • θmin≦θ≦θmax,   (2)
  • where pk is the coordinate of each link determined by the kinematics model.
  • To apply an iterative procedure to solve this problem, assume that at the n-th step, a solution is θn and the next increment Δθn is to be determined. The new link coordinate is approximated by

  • p n+1 ≈p n+∇θ n p·Δθ n.   (3)
  • Substituting expression (3) into the cost function gives:
  • J n + 1 = 1 2 p n + 1 - P 2 1 2 θ n p · Δ θ n + p n - P 2 . ( 4 )
  • This is indeed a quadratic programming problem:
  • min Δ θ J = 1 2 Δ θ n ( θ n p ) T θ n p Δ θ n + ( p n - P ) T θ n p Δ θ n , ( 5 )
  • subject to

  • θmin−θn≦Δθn≦θmax−θn.   (6)
  • Kinematics Model
  • With respect to FIG. 5, let the first input parameter be defined as:
  • q = [ θ x 1 θ y 1 θ x 2 θ y 2 θ x 3 θ y 3 θ x 4 θ y 4 ] . ( 7 )
  • The vector of joint angles is defined as:
  • q jw = [ θ x 1 4 , θ y 1 4 , θ x 1 4 , θ y 1 4 , θ x 1 4 , θ y 1 4 , θ x 1 4 , θ y 1 4 , θ x 2 4 , θ y 2 4 , θ x 2 4 , θ y 2 4 , θ x 2 4 , θ y 2 4 , θ x 2 4 , θ y 2 4 , θ x 3 4 , θ y 3 4 , θ x 3 4 , θ y 3 4 , θ x 3 4 , θ y 3 4 , θ x 3 4 , θ y 3 4 , θ x 4 4 , θ y 4 4 , θ x 4 4 , θ y 4 4 , θ x 4 4 , θ y 4 4 , θ x 4 4 , θ y 4 4 ] , ( 8 )
  • and the state of each link is defined as:
  • T 1 w ( 1 ) = [ R y ( - θ x 1 4 ) ( 0 0 - a ( 1 ) ) 0 1 ] , T 1 w ( 3 ) = [ R y ( - θ x 1 4 ) ( 0 0 - a ( 3 ) ) 0 1 ] , T 1 w ( 5 ) = [ R y ( - θ x 1 4 ) ( 0 0 - a ( 5 ) ) 0 1 ] , T 1 w ( 7 ) = [ R y ( - θ x 1 4 ) ( 0 0 - a ( 7 ) ) 0 1 ] , T 1 w ( 2 ) = [ R x ( θ y 1 4 ) ( 0 0 - a ( 2 ) ) 0 1 ] , T 1 w ( 4 ) = [ R x ( θ y 1 4 ) ( 0 0 - a ( 4 ) ) 0 1 ] , T 1 w ( 6 ) = [ R x ( θ y 1 4 ) ( 0 0 - a ( 6 ) ) 0 1 ] , T 1 w ( 8 ) = [ R x ( θ y 1 4 ) ( 0 0 - a ( 8 ) ) 0 1 ] , where R x ( θ ) = [ 1 0 0 0 cos ( θ ) - sin ( θ ) 0 sin ( θ ) cos ( θ ) ] and R y ( - θ ) = [ cos ( θ ) 0 - sin ( θ ) 0 1 0 sin ( θ ) 0 cos ( θ ) ] ( 9 )
  • The rest of the Tlw's can be obtained in a similar fashion. In particular,
  • T 1 w ( 33 ) = [ I ( 0 0 - a ( 33 ) ) 0 1 ] . ( 10 )
  • Notice that all these Tlw's are in the Special Euclidean Lie group SE(4).
  • The cumulative transform to the base from the distal end of link k can be derived as
  • T c 1 ( k ) = j = 1 k T 1 w ( j ) = T 1 w ( 1 ) × T 1 w ( 2 ) × × T 1 w ( k ) . ( 11 )
  • In this section, gradient ∇θlk is derived, where l is the position vector for link k. To this end, define the basis for the skew-symmetric matrix so(3) as follows:
  • σ x = [ 0 0 0 0 0 - 1 0 1 0 ] , σ y = [ 0 0 1 0 0 0 - 1 0 0 ] , σ z = [ 0 - 1 0 1 0 0 0 0 0 ] . ( 12 )
  • The rotation matrices can then be described as

  • R x(θ)=exp(σxθ), R y(θ)=exp(σyθ), R z(θ)=exp(σ2θ).   (13)
  • Suppose that R is a rotation matrix
  • R = [ r 11 r 12 r 13 r 21 r 22 r 23 r 31 r 32 r 33 ] . ( 14 )
  • Since RRT=I, an important property for R can be derived:

  • x R T =r 11σx +r 21σy +r 31σz,   (15)

  • R Tσx R=r 11σx +r 12σy +r 13 σz,   (16)

  • y R T =r 12σx +r 22σy +r 32σz,   (17)

  • R Tσy R=r 21σx +r 22σy +r 23σz,   (18)
  • Now, the gradient dTcl(k)/dθ is derived. Let
  • T lw ( k ) = [ R k a k 0 1 ] and T c l ( k ) = [ S k l k 0 1 ] . ( 19 )
  • It is easy to derive that
  • S k = R 1 R 2 R k , ( 20 ) l k = R 1 R 2 R k - 1 a k + R 1 R 2 R k - 2 a k - 1 + + R 1 a 2 + a 1 = S k - 1 a k + S k - 2 a k - 1 + + S 1 a 2 + a 1 , ( 21 )
  • and l1=a1. We therefore have
  • S k θ = θ ( R 1 R 2 R k ) , ( 22 ) l k θ = S k - 1 θ a k + S k - 2 θ a k - 1 + + S 1 θ a 2 , ( k 2 ) . ( 23 )
  • When θ=θx 1, for k≧7, we have
  • S k θ x 1 S k T = θ x 1 ( R 1 R 2 R k ) S k T = R 1 θ x 1 ( R 2 R k ) S k T + R 1 R 2 R 3 θ x 1 ( R 4 R k ) S k T + R 1 R 2 R 3 R 4 R 5 θ x 1 ( R 6 R k ) S k T + R 1 R 2 R 3 R 4 R 5 R 6 R 7 θ x 1 ( R 8 R k ) S k T ( 24 ) = ( - σ y 4 ) + R 1 R 2 ( - σ y 4 ) ( R 1 R 2 ) T + R 1 R 2 R 3 R 4 ( - σ y 4 ) ( R 1 R 2 R 3 R 4 ) T + R 1 R 2 R 3 R 4 R 5 R 6 ( - σ y 4 ) ( R 1 R 2 R 3 R 4 R 5 R 6 ) T ( 25 ) = - σ y 4 + S 2 ( - σ y 4 ) S 2 T + S 4 ( - σ y 4 ) S 4 T + S 6 ( - σ y 4 ) S 6 T , ( 26 )
  • which in turn yields
  • S k θ x 1 = - 1 4 ( σ y + S 2 σ y S 2 T + S 4 σ y S 4 T + S 6 σ y S 6 T ) S k . ( 27 )
  • For k=5 or 6, we obtain
  • S k θ x 1 S k T = - σ y 4 + S 2 ( - σ y 4 ) S 2 T + S 4 ( - σ y 4 ) S 4 T , thus S k θ x 1 = - 1 4 ( σ y + S 2 σ y S 2 T + S 4 σ y S 4 T ) S k ; ( 28 )
  • for k=3 or 4,
  • S k θ x 1 = - 1 4 ( σ y + S 2 σ y S 2 T ) S k ; ( 29 )
  • and for k=1 or 2,
  • S k θ x 1 = - 1 4 σ y S k ; ( 30 )
  • In summary,
  • S k θ x 1 = { - 1 4 σ y S k , k = 1 , 2 ; - 1 4 ( σ y + S 2 σ y S 2 T ) S k , k = 3 , 4 ; - 1 4 ( σ y + S 2 σ y S 2 T + S 4 σ y S 4 T ) S k , k = 5 , 6 ; - 1 4 ( σ y + S 2 σ y S 2 T + S 4 σ y S 4 T + S 6 σ y S 6 T ) S k , k 7. ( 31 ) S k θ x 2 = { 0 , k 8 ; - 1 4 ( S 8 σ y S 8 T ) S k , k = 9 , 10 ; - 1 4 ( S 8 σ y S 8 T + S 10 σ y S 10 T ) S k , k = 11 , 12 ; - 1 4 ( S 8 σ y S 8 T + S 10 σ y S 10 T + S 12 σ y S 12 T ) S k , k = 13 , 14 ; - 1 4 ( S 8 σ y S 8 T + S 10 σ y S 10 T + S 12 σ y S 12 T + S 14 σ y S 14 T ) S k , k 15. ( 32 ) S k θ x 3 = { 0 , k 16 ; - 1 4 ( S 16 σ y S 16 T ) S k , k = 17 , 18 ; - 1 4 ( S 16 σ y S 16 T + S 18 σ y S 18 T ) S k , k = 19 , 20 ; - 1 4 ( S 16 σ y S 16 T + S 18 σ y S 18 T + S 20 σ y S 20 T ) S k , k = 21 , 22 ; - 1 4 ( S 16 σ y S 16 T + S 18 σ y S 18 T + S 20 σ y S 20 T + S 22 σ y S 22 T ) S k , k 23. ( 33 )
  • Similarly,
  • S k θ y 1 = { 0 , k = 1 ; 1 4 ( S 1 σ x S 1 T ) S k , k = 2 , 3 ; 1 4 ( S 1 σ x S 1 T + S 3 σ x S 3 T ) S k , k = 4 , 5 ; 1 4 ( S 1 σ x S 1 T + S 3 σ x S 3 T + S 5 σ x S 5 T ) S k , k = 6 , 7 ; 1 4 ( S 1 σ x S 1 T + S 3 σ x S 3 T + S 5 σ x S 5 T + S 7 σ x S 7 T ) S k , k 8. ( 34 ) S k θ y 2 = { 0 , k 9 ; 1 4 ( S 9 σ x S 9 T ) S k , k = 10 , 11 ; 1 4 ( S 9 σ x S 9 T + S 11 σ x S 11 T ) S k , k = 12 , 13 ; 1 4 ( S 9 σ x S 9 T + S 11 σ x S 11 T + S 13 σ x S 13 T ) S k , k = 14 , 15 ; 1 4 ( S 9 σ x S 9 T + S 11 σ x S 11 T + S 13 σ x S 13 T + S 15 σ x S 15 T ) S k , k 16. ( 35 ) S k θ y 3 = { 0 , k 17 ; - 1 4 ( S 17 σ x S 17 T ) S k , k = 18 , 19 ; - 1 4 ( S 17 σ x S 17 T + S 19 σ x S 19 T ) S k , k = 20 , 21 ; - 1 4 ( S 17 σ x S 17 T + S 19 σ x S 19 T + S 21 σ x S 21 T ) S k , k = 22 , 23 ; - 1 4 ( S 17 σ x S 17 T + S 19 σ x S 19 T + S 21 σ x S 21 T + S 23 σ x S 23 T ) S k , k 24. ( 36 )
  • In this subsection, the Jacobian is derived. Let
  • T J ( k ) = j = k + 1 N T lw ( j ) = T lw ( k + 1 ) × × T lw ( N ) , ( 37 )
  • and denote its blocks as
  • T J ( k ) = [ R k J l k J 0 1 ] . ( 38 )
  • Recalling Eq. (19), we have
  • T c l ( N ) θ x 1 = [ S N θ x 1 l N θ x 1 0 0 ] = T lw ( 1 ) θ x 1 T lw ( 2 ) T lw ( N ) + T lw ( 1 ) T lw ( 2 ) T lw ( 3 ) θ x 1 T lw ( 4 ) T lw ( N ) + T lw ( 1 ) T lw ( 2 ) T lw ( 3 ) T lw ( 4 ) T lw ( 5 ) θ x 1 T lw ( 6 ) T lw ( N ) + T lw ( 1 ) T lw ( 2 ) T lw ( 3 ) T lw ( 4 ) T lw ( 5 ) T lw ( 6 ) T lw ( 7 ) θ x 1 T lw ( 8 ) T lw ( N ) = [ - R 1 σ y 4 0 0 0 ] T J ( 1 ) + T c l ( 2 ) [ - R 3 σ y 4 0 0 0 ] T J ( 3 ) + T c l ( 4 ) [ - R 5 σ y 4 0 0 0 ] T J ( 5 ) + T c l ( 6 ) [ - R 7 σ y 4 0 0 0 ] T J ( 7 ) . ( 39 )
  • The last equality is obtained by the definition of Tcl and TJ. Proceeding further, we have
  • T c l ( N ) θ x 1 = [ - R 1 σ y 4 0 0 0 ] [ R 1 J l 1 J 0 1 ] + [ S 2 l 2 0 1 ] [ - R 3 σ y 4 0 0 0 ] [ R 3 J l 3 J 0 1 ] + [ S 4 l 4 0 1 ] [ - R 5 σ y 4 0 0 0 ] [ R 5 J l 5 J 0 1 ] + [ S 6 l 6 0 1 ] [ - R 7 σ y 4 0 0 0 ] [ R 7 J l 7 J 0 1 ] = [ - S 1 σ y 4 R 1 J - S 3 σ y 4 R 3 J - S 5 σ y 4 R 5 J - S 7 σ y 4 R 7 J 0 - S 1 σ y 4 l 1 J - S 3 σ y 4 l 3 J - S 5 σ y 4 l 5 J - S 7 σ y 4 l 7 J 0 ] .
  • Therefore, the derivative of the position vector lN with respect to the joint angle θx 1 is
  • l N θ x 1 = - S 1 σ y 4 l 1 J - S 3 σ y 4 l 3 J - S 5 σ y 4 l 5 J - S 7 σ y 4 l 7 J = S 1 4 [ - l 1 , 3 J 0 l 1 , 1 J ] + S 3 4 [ - l 3 , 3 J 0 l 3 , 1 J ] + S 5 4 [ - l 5 , 3 J 0 l 5 , 1 J ] + S 7 4 [ - l 7 , 3 J 0 l 7 , 1 J ] . ( 40 )
  • In the above examples, the sequence of ordered locations and six-degrees of freedom were considered in configuring articulatable segments to remain within a boundary region, sometimes called a safe region. However, in some applications, consideration of only two-degrees of freedom may be sufficient. The x-y position could be controlled, or the pitch and the yaw could be controlled. In these applications, each waypoint only includes two degrees of freedom corresponding to an insertion depth and the above processes become less computationally intensive while the safe path is followed.
  • System controller 220 (FIG. 2) is illustrated as unified structures for ease of illustration and understanding. This is illustrative only and is not intended to be limiting. The various component of system controller 220 can be located apart and still perform the functions described.
  • The above description and the accompanying drawings that illustrate aspects and embodiments of the present inventions should not be taken as limiting—the claims define the protected inventions. Various mechanical, compositional, structural, electrical, and operational changes may be made without departing from the spirit and scope of this description and the claims. In some instances, well-known circuits, structures, and techniques have not been shown or described in detail to avoid obscuring the invention.
  • While the memory in FIG. 2 is illustrated as a unified structure, this should not be interpreted as requiring that all memory is at the same physical location. All or part of the memory can be in a different physical location than a processor. Memory refers to a volatile memory, a non-volatile memory, or any combination of the two.
  • A processor is coupled to a memory containing instructions executed by the processor. This could be accomplished within a computer system, or alternatively via a connection to another computer via modems and analog lines, or digital interfaces and a digital carrier line.
  • All examples and illustrative references are non-limiting and should not be used to limit the claims to specific implementations and embodiments described herein and their equivalents. The headings are solely for formatting and should not be used to limit the subject matter in any way, because text under one heading may cross reference or apply to text under one or more headings. Finally, in view of this disclosure, particular features described in relation to one aspect or embodiment may be applied to other disclosed aspects or embodiments of the invention, even though not specifically shown in the drawings or described in the text.

Claims (13)

1. A method comprising:
storing waypoints of a steerable medical device, wherein said stored waypoints comprise an ordered sequence of locations, and further wherein said ordered sequence of locations defines a safe path for moving an articulatable portion of said steerable medical device within a patient;
constraining said articulatable portion of said steerable medical device to follow said safe path as said articulatable portion moves within said patient.
2. The method of claim 1 wherein said constraining further comprises:
constraining said articulatable portion of said steerable medical device to remain within a boundary region enclosing said safe path as said articulatable portion of said steerable medical device follows said safe path.
3. The method of claim 2 wherein said boundary region comprises a tube having a cross-section.
4. The method of claim 3 wherein said cross-section comprises one of a circular cross-section, an oblate cross-section, and a rectangular cross cross-section.
5. The method of claim 2 wherein said articulatable portion is included in a plurality of segments of said steerable medical device.
6. The method of claim 5 wherein said constraining said articulatable portion of said steerable medical device to remain within a boundary region enclosing said safe path further comprises:
generating position and orientation data for each of said plurality of segments using said ordered sequence of locations and a kinematic model of said plurality of segments of said steerable medical device.
7. The method of claim 6 wherein said generating further comprises:
minimizing a cost function to generate said position and orientation data for each of said plurality of segments.
8. The method of claim 7 wherein said minimizing a cost function further comprises:
minimizing the sum of the absolute values of relative joint angles, with an additional constraint that link positions not deviate by more than a distance Δ at each of the waypoints in said ordered sequence of locations.
9. The method of claim 1 wherein said articulatable portion of said steerable medical device comprises a segment of said steerable medical device and said segment comprises a plurality of links.
10. An apparatus comprising:
a steerable medical device having an articulatable portion; and
a controller, coupled to said steerable medical device, comprising:
a processor;
a memory coupled to said processor; and
a medical device controller coupled to said processor and to said steerable medical device; and
wherein said processor stores in said memory an ordered sequence of locations; and
said processor analyzes said ordered sequence of locations and outputs to said medical device controller at least one command to constrain said articulatable portion within a boundary region enclosing a safe path defined by said ordered sequence of locations.
11. The apparatus of claim 10 wherein said articulatable portion of said steerable medical device comprises a segment of said steerable medical device and said segment comprises a plurality of links.
12. The apparatus of claim 10 wherein said boundary region comprises a tube having a cross-section.
13. The apparatus of claim 12 wherein said cross-section comprises one of a circular cross-section, an oblate cross-section, and a square cross cross-section.
US12/613,739 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction Abandoned US20100121148A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US12/613,768 US8568302B2 (en) 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction
US12/613,739 US20100121148A1 (en) 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction
US14/042,876 US9517000B2 (en) 2008-11-11 2013-10-01 Method and system for steerable medical device path definition and following during insertion and retraction
US15/364,509 US9913572B2 (en) 2008-11-11 2016-11-30 Method and system for steerable medical device path definition and following during insertion and retraction
US16/048,438 US20180333039A1 (en) 2008-11-11 2018-07-30 Method and system for steerable medical device path definition and following during insertion and retraction
US16/999,592 US20210038055A1 (en) 2008-11-11 2020-08-21 Method and system for steerable medical device path definition and following during insertion and retraction

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11353408P 2008-11-11 2008-11-11
US12/613,739 US20100121148A1 (en) 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US12/613,768 Continuation-In-Part US8568302B2 (en) 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction
US16/048,438 Continuation US20180333039A1 (en) 2008-11-11 2018-07-30 Method and system for steerable medical device path definition and following during insertion and retraction

Publications (1)

Publication Number Publication Date
US20100121148A1 true US20100121148A1 (en) 2010-05-13

Family

ID=42165847

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/613,739 Abandoned US20100121148A1 (en) 2008-11-11 2009-11-06 Method and system for steerable medical device path definition and following during insertion and retraction
US16/048,438 Abandoned US20180333039A1 (en) 2008-11-11 2018-07-30 Method and system for steerable medical device path definition and following during insertion and retraction
US16/999,592 Pending US20210038055A1 (en) 2008-11-11 2020-08-21 Method and system for steerable medical device path definition and following during insertion and retraction

Family Applications After (2)

Application Number Title Priority Date Filing Date
US16/048,438 Abandoned US20180333039A1 (en) 2008-11-11 2018-07-30 Method and system for steerable medical device path definition and following during insertion and retraction
US16/999,592 Pending US20210038055A1 (en) 2008-11-11 2020-08-21 Method and system for steerable medical device path definition and following during insertion and retraction

Country Status (1)

Country Link
US (3) US20100121148A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100121145A1 (en) * 2008-11-11 2010-05-13 Caitlin Donhowe Method and system for measuring inserted length of a medical device using internal referenced sensors
US20100121151A1 (en) * 2008-11-11 2010-05-13 Intuitive Surgical, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US20110035087A1 (en) * 2009-08-10 2011-02-10 Samsung Electronics Co., Ltd. Method and apparatus to plan motion path of robot
JP2016055397A (en) * 2014-09-11 2016-04-21 株式会社デンソー Positioning control device
US9486189B2 (en) 2010-12-02 2016-11-08 Hitachi Aloka Medical, Ltd. Assembly for use with surgery system
US9572481B2 (en) 2011-05-13 2017-02-21 Intuitive Surgical Operations, Inc. Medical system with multiple operating modes for steering a medical instrument through linked body passages

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6468203B2 (en) * 2000-04-03 2002-10-22 Neoguide Systems, Inc. Steerable endoscope and improved method of insertion
US6610007B2 (en) * 2000-04-03 2003-08-26 Neoguide Systems, Inc. Steerable segmented endoscope and method of insertion
US20040176683A1 (en) * 2003-03-07 2004-09-09 Katherine Whitin Method and apparatus for tracking insertion depth
US20040249269A1 (en) * 2003-03-27 2004-12-09 Terumo Kabushiki Kaisha Positioning system for an applicator and positioning method for an applicator
US20060258912A1 (en) * 2000-04-03 2006-11-16 Amir Belson Activated polymer articulated instruments and methods of insertion
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures
US20070197896A1 (en) * 2005-12-09 2007-08-23 Hansen Medical, Inc Robotic catheter system and methods
US20070249901A1 (en) * 2003-03-07 2007-10-25 Ohline Robert M Instrument having radio frequency identification systems and methods for use
US20070270650A1 (en) * 2006-05-19 2007-11-22 Robert Eno Methods and apparatus for displaying three-dimensional orientation of a steerable distal tip of an endoscope
US20080234700A1 (en) * 2005-10-11 2008-09-25 Koninklijke Philips Electronics, N.V. 3D Tool Path Planning, Simulation and Control System
US20080287963A1 (en) * 2005-12-30 2008-11-20 Rogers Theodore W Methods and apparatus to shape flexible entry guides for minimally invasive surgery
US20090099420A1 (en) * 2007-10-11 2009-04-16 Neoguide Systems, Inc. System for managing bowden cables in articulating instruments
US20090137952A1 (en) * 2007-08-14 2009-05-28 Ramamurthy Bhaskar S Robotic instrument systems and methods utilizing optical fiber sensor
US20090171271A1 (en) * 2005-11-15 2009-07-02 The Johns Hopkins University Active Cannula for Bio-Sensing and Surgical Intervention
US20090216083A1 (en) * 2008-02-25 2009-08-27 Neoguide Systems, Inc. Systems and Methods for Articulating an Elongate Body
US20100121145A1 (en) * 2008-11-11 2010-05-13 Caitlin Donhowe Method and system for measuring inserted length of a medical device using internal referenced sensors
US8568302B2 (en) * 2008-11-11 2013-10-29 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9266239B2 (en) * 2005-12-27 2016-02-23 Intuitive Surgical Operations, Inc. Constraint based control in a minimally invasive surgical apparatus
WO2009097461A1 (en) * 2008-01-29 2009-08-06 Neoguide Systems Inc. Apparatus and methods for automatically controlling an endoscope

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6610007B2 (en) * 2000-04-03 2003-08-26 Neoguide Systems, Inc. Steerable segmented endoscope and method of insertion
US20030191367A1 (en) * 2000-04-03 2003-10-09 Amir Belson Steerable segmented endoscope and method of insertion
US6468203B2 (en) * 2000-04-03 2002-10-22 Neoguide Systems, Inc. Steerable endoscope and improved method of insertion
US20060258912A1 (en) * 2000-04-03 2006-11-16 Amir Belson Activated polymer articulated instruments and methods of insertion
US20070249901A1 (en) * 2003-03-07 2007-10-25 Ohline Robert M Instrument having radio frequency identification systems and methods for use
US20040176683A1 (en) * 2003-03-07 2004-09-09 Katherine Whitin Method and apparatus for tracking insertion depth
US20040249269A1 (en) * 2003-03-27 2004-12-09 Terumo Kabushiki Kaisha Positioning system for an applicator and positioning method for an applicator
US20070135803A1 (en) * 2005-09-14 2007-06-14 Amir Belson Methods and apparatus for performing transluminal and other procedures
US20080234700A1 (en) * 2005-10-11 2008-09-25 Koninklijke Philips Electronics, N.V. 3D Tool Path Planning, Simulation and Control System
US20090171271A1 (en) * 2005-11-15 2009-07-02 The Johns Hopkins University Active Cannula for Bio-Sensing and Surgical Intervention
US20070197896A1 (en) * 2005-12-09 2007-08-23 Hansen Medical, Inc Robotic catheter system and methods
US20080287963A1 (en) * 2005-12-30 2008-11-20 Rogers Theodore W Methods and apparatus to shape flexible entry guides for minimally invasive surgery
US20070270650A1 (en) * 2006-05-19 2007-11-22 Robert Eno Methods and apparatus for displaying three-dimensional orientation of a steerable distal tip of an endoscope
US20090137952A1 (en) * 2007-08-14 2009-05-28 Ramamurthy Bhaskar S Robotic instrument systems and methods utilizing optical fiber sensor
US20090099420A1 (en) * 2007-10-11 2009-04-16 Neoguide Systems, Inc. System for managing bowden cables in articulating instruments
US20090216083A1 (en) * 2008-02-25 2009-08-27 Neoguide Systems, Inc. Systems and Methods for Articulating an Elongate Body
US20100121145A1 (en) * 2008-11-11 2010-05-13 Caitlin Donhowe Method and system for measuring inserted length of a medical device using internal referenced sensors
US8568302B2 (en) * 2008-11-11 2013-10-29 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US20140031625A1 (en) * 2008-11-11 2014-01-30 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100121145A1 (en) * 2008-11-11 2010-05-13 Caitlin Donhowe Method and system for measuring inserted length of a medical device using internal referenced sensors
US20100121151A1 (en) * 2008-11-11 2010-05-13 Intuitive Surgical, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US8568302B2 (en) 2008-11-11 2013-10-29 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US9055865B2 (en) 2008-11-11 2015-06-16 Intuitive Surgical Operations, Inc. Method and system for measuring inserted length of a medical device using internal referenced sensors
US9517000B2 (en) 2008-11-11 2016-12-13 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US9913572B2 (en) 2008-11-11 2018-03-13 Intuitive Surgical Operations, Inc. Method and system for steerable medical device path definition and following during insertion and retraction
US20110035087A1 (en) * 2009-08-10 2011-02-10 Samsung Electronics Co., Ltd. Method and apparatus to plan motion path of robot
US9411335B2 (en) * 2009-08-10 2016-08-09 Samsung Electronics Co., Ltd. Method and apparatus to plan motion path of robot
US9486189B2 (en) 2010-12-02 2016-11-08 Hitachi Aloka Medical, Ltd. Assembly for use with surgery system
US9572481B2 (en) 2011-05-13 2017-02-21 Intuitive Surgical Operations, Inc. Medical system with multiple operating modes for steering a medical instrument through linked body passages
US11490793B2 (en) 2011-05-13 2022-11-08 Intuitive Surgical Operations, Inc. Medical system with multiple operating modes for steering a medical instrument through linked body passages
JP2016055397A (en) * 2014-09-11 2016-04-21 株式会社デンソー Positioning control device

Also Published As

Publication number Publication date
US20180333039A1 (en) 2018-11-22
US20210038055A1 (en) 2021-02-11

Similar Documents

Publication Publication Date Title
US9913572B2 (en) Method and system for steerable medical device path definition and following during insertion and retraction
US20210038055A1 (en) Method and system for steerable medical device path definition and following during insertion and retraction
US11638618B2 (en) Systems and methods for aligning inputs on medical instruments
US10803662B2 (en) Methods, systems, and computer readable media for transoral lung access
US11280690B2 (en) Detection of undesirable forces on a robotic manipulator
US10912620B2 (en) Snare tool manipulator system
KR102250269B1 (en) Tracking and guiding devices and related methods for surgical robotic systems
KR20210024484A (en) Medical system with integrated pulley sharing
EP2066245B1 (en) Active cannula configuration for minimally invasive surgery
US20230094574A1 (en) Alignment interfaces for percutaneous access
KR20210073542A (en) Systems and methods for docking medical instruments
KR20200136931A (en) Methods and systems for mapping and navigation
KR20200122337A (en) Systems and methods for driving medical devices
US20220265378A1 (en) Systems and methods for saturated robotic movement
CN108882967A (en) Robot for the image guidance that conduit is placed
US20140316434A1 (en) Systems and methods for robot-assisted transurethral exploration and intervention
US20230363635A1 (en) Endoscopic anatomical feature tracking
JP6053358B2 (en) Surgery support device
US20210093407A1 (en) Systems and methods for collision avoidance using object models
US20230200629A1 (en) Collision avoidance in surgical robotics based on detection of contact information
US20230190396A1 (en) Collision avoidance in surgical robotics based on non-contact information
US9055865B2 (en) Method and system for measuring inserted length of a medical device using internal referenced sensors
US20230190394A1 (en) Instrument insertion assistant
CN117297773A (en) Surgical instrument control method, surgical robot, and storage medium
US20230226684A1 (en) High stiffness bar with internal actuators and internal cabling

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTUITIVE SURGICAL, INC.,CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DONHOWE, CAITLIN QUANCE;BELSON, AMIR;DONHOWE, KRISTOFFER JOHN;AND OTHERS;SIGNING DATES FROM 20091209 TO 20100119;REEL/FRAME:023835/0152

AS Assignment

Owner name: INTUITIVE SURGICAL OPERATIONS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTUITIVE SURGICAL, INC.;REEL/FRAME:040245/0001

Effective date: 20100101

AS Assignment

Owner name: INTUITIVE SURGICAL OPERATIONS, INC., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR EXECUTION DATE PREVIOUSLY RECORDED ON REEL 040245 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:INTUITIVE SURGICAL, INC.;REEL/FRAME:043111/0884

Effective date: 20100219

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION