[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2010081094A3 - A system for registration and information overlay on deformable surfaces from video data - Google Patents

A system for registration and information overlay on deformable surfaces from video data Download PDF

Info

Publication number
WO2010081094A3
WO2010081094A3 PCT/US2010/020649 US2010020649W WO2010081094A3 WO 2010081094 A3 WO2010081094 A3 WO 2010081094A3 US 2010020649 W US2010020649 W US 2010020649W WO 2010081094 A3 WO2010081094 A3 WO 2010081094A3
Authority
WO
WIPO (PCT)
Prior art keywords
points
internal structure
image signal
time interval
supplemental data
Prior art date
Application number
PCT/US2010/020649
Other languages
French (fr)
Other versions
WO2010081094A2 (en
Inventor
Gregory D. Hager
Li-ming SU
Russell H. Taylor
Balazs Peter Vagvolgyi
Original Assignee
The Johns Hopkins University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Johns Hopkins University filed Critical The Johns Hopkins University
Publication of WO2010081094A2 publication Critical patent/WO2010081094A2/en
Publication of WO2010081094A3 publication Critical patent/WO2010081094A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B34/37—Master-slave robots
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Image Processing (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

A surgical system including an optical imaging device arranged to image an internal structure of a subject under observation, a processor in communication with the optical imaging device, and a visual display in communication with the processor. The optical imaging device provides a first image signal corresponding to at least a portion of the internal structure corresponding to a first time interval and a second image signal corresponding to a least a portion of the internal structure corresponding to a second time interval. The processor is operable to determine a first set of points corresponding to the at least a portion of the internal structure corresponding to the first time interval from the first image signal, determine a second set of points corresponding to the at least a portion of the internal structure corresponding to the second time interval from the second image signal based on the determined first set of points, receive supplemental data corresponding to the at least a portion of the internal structure, register the supplemental data with at least one of the first set of points or the second set of points, and output a display image signal, to the visual display, corresponding to an overlay of the supplemental data with at least one of the first set of points or the second set of points based on the registering supplemental data.
PCT/US2010/020649 2009-01-09 2010-01-11 A system for registration and information overlay on deformable surfaces from video data WO2010081094A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14346809P 2009-01-09 2009-01-09
US61/143,468 2009-01-09

Publications (2)

Publication Number Publication Date
WO2010081094A2 WO2010081094A2 (en) 2010-07-15
WO2010081094A3 true WO2010081094A3 (en) 2010-10-21

Family

ID=42317195

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/020649 WO2010081094A2 (en) 2009-01-09 2010-01-11 A system for registration and information overlay on deformable surfaces from video data

Country Status (1)

Country Link
WO (1) WO2010081094A2 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9610063B2 (en) 2010-03-26 2017-04-04 The Johns Hopkins University Methods and apparatus for ultrasound strain imaging
US10152951B2 (en) 2011-02-28 2018-12-11 Varian Medical Systems International Ag Method and system for interactive control of window/level parameters of multi-image displays
US9982995B2 (en) 2011-05-24 2018-05-29 Koninklijke Philips N.V. 3D scanner using structured lighting
DE102011080260B4 (en) 2011-08-02 2021-07-15 Siemens Healthcare Gmbh Method and arrangement for the computer-aided display and evaluation of medical examination data
US11523874B2 (en) * 2014-02-04 2022-12-13 Koninklijke Philips N.V. Visualization of depth and position of blood vessels and robot guided visualization of blood vessel cross section
WO2015151098A2 (en) 2014-04-02 2015-10-08 M.S.T. Medical Surgery Technologies Ltd. An articulated structured light based-laparoscope
US10524865B2 (en) * 2016-12-16 2020-01-07 General Electric Company Combination of 3D ultrasound and computed tomography for guidance in interventional medical procedures
US10499997B2 (en) 2017-01-03 2019-12-10 Mako Surgical Corp. Systems and methods for surgical navigation
CN113994382A (en) * 2020-04-28 2022-01-28 深圳市大疆创新科技有限公司 Depth map generation method, electronic device, calculation processing device, and storage medium
CN112149495B (en) * 2020-08-07 2023-07-28 中国矿业大学(北京) Video key frame extraction method based on parallax tracking

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030078477A1 (en) * 2001-10-18 2003-04-24 Korea Electrotechnology Research Institute Fluorescence endoscope apparatus and method for imaging tissue within a body using the same
US20040239760A1 (en) * 2003-05-27 2004-12-02 Olympus Corporation Medical image recording apparatus, endoscopic image display method, endoscopic image capture method, and portable storage medium therefor
JP2005013409A (en) * 2003-06-25 2005-01-20 Olympus Corp Endoscope apparatus or endoscope system
JP2006280921A (en) * 2005-03-07 2006-10-19 Hitachi Medical Corp Magnetic resonance imaging apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030078477A1 (en) * 2001-10-18 2003-04-24 Korea Electrotechnology Research Institute Fluorescence endoscope apparatus and method for imaging tissue within a body using the same
US20040239760A1 (en) * 2003-05-27 2004-12-02 Olympus Corporation Medical image recording apparatus, endoscopic image display method, endoscopic image capture method, and portable storage medium therefor
JP2005013409A (en) * 2003-06-25 2005-01-20 Olympus Corp Endoscope apparatus or endoscope system
JP2006280921A (en) * 2005-03-07 2006-10-19 Hitachi Medical Corp Magnetic resonance imaging apparatus

Also Published As

Publication number Publication date
WO2010081094A2 (en) 2010-07-15

Similar Documents

Publication Publication Date Title
WO2010081094A3 (en) A system for registration and information overlay on deformable surfaces from video data
WO2009057409A1 (en) Endoscope device
EP2037667A3 (en) Image sensing apparatus and imaging system
WO2011053921A3 (en) Visual tracking and annotation of clinically important anatomical landmarks for surgical interventions
WO2014037953A3 (en) Digital system for surgical video capturing and display
MX2008009016A (en) Interactive input system.
FR2917939B1 (en) SYSTEM FOR DEFROSTING OR DEMEMBING AN OPTICAL INSTRUMENT AND IMAGE ACQUISITION DEVICE EQUIPPED WITH SUCH A SYSTEM.
EP2254023A3 (en) Systems, apparatus and fast methods for aligning images to external markers in Near-to-Eye display systems
WO2012009359A3 (en) Three-dimensional thermal imaging for the detection of skin lesions and other natural and abnormal conditions
WO2007038736A3 (en) System and method for correlating captured images with their site locations on maps
WO2011044000A3 (en) Mobile device visual input systems and methods
WO2010086778A3 (en) Examination apparatus
EP2153794A3 (en) System for and method of visualizing an interior of a body
WO2009001542A1 (en) Image information display processing device
WO2008057278A3 (en) An integrated display having multiple capture devices
WO2008070498A3 (en) Device for providing location-based data
EP2284494A3 (en) Aircraft panel display system with graphical image integrity
WO2008054768A3 (en) Methods for constructing association maps of imaging data and biological data
EP2312829A3 (en) Image taking device and camera system
WO2010019537A3 (en) Object identification in images
WO2008079580A3 (en) System and method for surgical navigation
EP2166375A3 (en) System and method of extracting plane features
WO2006111965A8 (en) System and method for producing an augmented image of an organ of a patient
EP1681860A3 (en) Multi-screen system and multi-screen implementation method
WO2005072464A3 (en) Method and apparatus of information systems for rowers

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10729632

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10729632

Country of ref document: EP

Kind code of ref document: A2