US7668370B2 - Segmenting a series of 2D or 3D images - Google Patents
Segmenting a series of 2D or 3D images Download PDFInfo
- Publication number
- US7668370B2 US7668370B2 US10/527,862 US52786205A US7668370B2 US 7668370 B2 US7668370 B2 US 7668370B2 US 52786205 A US52786205 A US 52786205A US 7668370 B2 US7668370 B2 US 7668370B2
- Authority
- US
- United States
- Prior art keywords
- images
- series
- image
- transformation
- segmentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime, expires
Links
- 230000009466 transformation Effects 0.000 claims abstract description 67
- 230000011218 segmentation Effects 0.000 claims abstract description 40
- 238000000844 transformation Methods 0.000 claims abstract description 22
- 210000000056 organ Anatomy 0.000 claims abstract description 17
- 238000000034 method Methods 0.000 claims description 32
- 238000002591 computed tomography Methods 0.000 claims description 7
- 238000009206 nuclear medicine Methods 0.000 claims description 7
- 238000002604 ultrasonography Methods 0.000 claims description 7
- 238000003709 image segmentation Methods 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 claims 8
- 238000012952 Resampling Methods 0.000 claims 1
- 238000012544 monitoring process Methods 0.000 abstract description 6
- 230000008901 benefit Effects 0.000 description 2
- 230000000747 cardiac effect Effects 0.000 description 2
- 238000002560 therapeutic procedure Methods 0.000 description 2
- 210000003484 anatomy Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000005240 left ventricle Anatomy 0.000 description 1
- 210000004165 myocardium Anatomy 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30061—Lung
Definitions
- the invention relates to a method and to an apparatus having means for segmenting a series of 2D or 3D images obtained of a patient's organ or other body part, wherein a first segmentation is carried out on a first image of the series of images and wherein the first segmentation is used for the subsequent segmentation of the remainder of images of said series of images.
- Such a method and apparatus is known from U.S. Pat. No. 5,903,664, showing a cardiac segmentation system acquiring a series of images as slices through a volume, and as images at different time periods throughout a cardiac cycle.
- a first image of a series of images is segmented by making use of a threshold.
- the centroid of this image is used as a seed point in segmenting adjacent images. This is repeated for a number of images in order that all images are accordingly segmented.
- each separate transformation embodies a fitting operation between two images of said series of images, and wherein substantially all images of the series of images are subjected to such a transformation, whereby the first segmentation on the first image of the series of images is modified and subsequently applied to any further image of the series of images according to the transformation or sequence of transformations that fits the said first image to said further image of the series of images.
- the invention is also embodied in the method and in software operated by the apparatus, which method and software are characterized in that in relation to the images a series of transformations are established wherein each separate transformation embodies a fitting operation between two images of said series of images, and wherein substantially all images of the series of images are subjected to such a transformation, and that the first segmentation on the first image of the series of images is modified and subsequently applied to any further image of the series of images according to the transformation or sequence of transformations that fits the said first image to said further image of the series of images.
- any type of segmentation can be applied initially as the first segmentation on the first image.
- This segmentation can be carried out either manually or (semi) automatically by means and methods that are known per se in the art.
- the result of this segmentation which can be moulded according to the needs of the user, is according to the invention simply and quickly propagated to the other images of the series of images.
- each transformation relates to adjacent or immediately successive images of the series of images.
- the differences between adjacent or immediately successive images of said series of images are rather limited allowing that the accuracy requirements of the transformation remain fairly limited.
- An important benefit of the invention lies in that it proves particularly useful when there are two or more series of images, whereby the segmentation applied to the first series of images can also be applied to the other series of images. This allows for ease of comparison among the said series.
- the method according to the invention applies to all types of organs and other patient's body parts.
- the apparatus, software and method according to the invention are preferably characterized in that prior to establishing the said series of transformations, the series of images are converted to a modified series of images showing the walls of the organ in a flat plane wherein the left and right part of said plane substantially correspond to the inside and outside of said organ, and that the said series of transformations are applied to the modified series of images.
- FIG. 1 shows a schematic flow sheet of the operation of an apparatus according to the invention
- FIG. 2 shows schematically an image of a heart and a modified image thereof
- FIG. 3 shows the modified image of the heart in two subsequent images.
- the invention applies to processing of both 2D and 3D images.
- medical diagnosis, therapy planning and monitoring of the effect of therapy it is often required to accurately segment various anatomical structures that are present in medical images of the patient. Medical image segmentation has therefore received considerable attention during the last few decades.
- the invention proposes an apparatus and method which make it easy to apply the selected segmentation to all images in a series of images or to several series of images, whereby it is only required to apply an initial segmentation to a selected first image of the series of images.
- An image 1 undergoes a segmentation in box 2 resulting in a desired segmented image 3 .
- the said first image 1 and consecutively further images i, whereby i may range from 2 to n, are supplied to a box 4 in which a transformation T l,i is calculated in order to arrive at a best fit of image 1 and image i.
- This transform T 1,i is supplied to a box 5 , which also receives the initial segmented image 3 and which converts these both information flows into a segmented image 6 corresponding to the original image i.
- the apparatus of the invention repeats this process for every i in the range 2 to n, so that in relation to a region of interest of the concerning images, a series of transformations are established, wherein each separate transformation embodies a best fit between two images of said series of images, and wherein each image of the series of images is subject of such a transformation.
- FIG. 1 relates to each individual transformation among images such that always image 1 forms part thereof, it is also possible that each individual transformation relates to adjacent or—in other words—immediately successive images of the series of images.
- the invention is also applicable when there are two or more series of images whereby the segmentation of the first series of images (which is based on the segmentation of the first image from this first series of images) applies to all series of images.
- the respective series of images are collected with different means of monitoring the patient, which means are selected from the group MR, CT, NM and US.
- the respective series of images may also be collected at different times.
- the images may relate to a substantially sphere-like organ such as a heart.
- a conversion of the image of the heart shown at the left-hand part takes place to a modified image as shown in the right-hand part of FIG. 2 .
- This type of transformation is known as a resample operation and results in a showing of the walls of the concerning organ in a flat plane, wherein the left- and right-hand part of said plane substantially correspond to the inside and outside of the concerning organ.
- the ease of working of the apparatus and method of the invention is highly supported by this prior operation allowing that the transformation can take place to the modified image which is simpler to operate. An example of this is shown with reference to FIG. 3 .
- FIG. 3 shows at the left-hand part an image i and on the right-hand part a subsequent image i+1.
- the region of interest of these images is the so-called myocardium of the left ventricle of the heart, the position of which is indicated in the left-hand Figure by r 1 -r 2 .
- this position has changed to r 1 - r 2 .
- the change in position from r 1 -r 2 to r 1 - r 2 represents the transformation that fits image i to image i+1 and which is used for applying the segmentation of image i to image i+1.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (13)
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02078922.8 | 2002-09-19 | ||
EP02078922 | 2002-09-19 | ||
EP02078922 | 2002-09-19 | ||
PCT/IB2003/003898 WO2004027712A2 (en) | 2002-09-19 | 2003-09-05 | Segmenting a series of 2d or 3d images |
Publications (2)
Publication Number | Publication Date |
---|---|
US20050271271A1 US20050271271A1 (en) | 2005-12-08 |
US7668370B2 true US7668370B2 (en) | 2010-02-23 |
Family
ID=32011009
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/527,862 Expired - Lifetime US7668370B2 (en) | 2002-09-19 | 2003-09-05 | Segmenting a series of 2D or 3D images |
Country Status (5)
Country | Link |
---|---|
US (1) | US7668370B2 (en) |
EP (1) | EP1543474B1 (en) |
JP (1) | JP2006500098A (en) |
AU (1) | AU2003256022A1 (en) |
WO (1) | WO2004027712A2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050277466A1 (en) * | 2004-05-26 | 2005-12-15 | Playdata Systems, Inc. | Method and system for creating event data and making same available to be served |
US20090175515A1 (en) * | 2006-06-08 | 2009-07-09 | Tomtec Imaging Systems Gmbh | Method, device, and computer programme for evaluating images of a cavity |
US9436995B2 (en) | 2014-04-27 | 2016-09-06 | International Business Machines Corporation | Discriminating between normal and abnormal left ventricles in echocardiography |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1831843A2 (en) | 2004-12-21 | 2007-09-12 | Koninklijke Philips Electronics N.V. | Handling of datasets |
US8111885B2 (en) * | 2005-02-10 | 2012-02-07 | Koninklijke Philips Electronics N.V. | Image processing device and method |
US7940977B2 (en) | 2006-10-25 | 2011-05-10 | Rcadia Medical Imaging Ltd. | Method and system for automatic analysis of blood vessel structures to identify calcium or soft plaque pathologies |
US7940970B2 (en) | 2006-10-25 | 2011-05-10 | Rcadia Medical Imaging, Ltd | Method and system for automatic quality control used in computerized analysis of CT angiography |
US7860283B2 (en) | 2006-10-25 | 2010-12-28 | Rcadia Medical Imaging Ltd. | Method and system for the presentation of blood vessel structures and identified pathologies |
US7983459B2 (en) | 2006-10-25 | 2011-07-19 | Rcadia Medical Imaging Ltd. | Creating a blood vessel tree from imaging data |
US7873194B2 (en) | 2006-10-25 | 2011-01-18 | Rcadia Medical Imaging Ltd. | Method and system for automatic analysis of blood vessel structures and pathologies in support of a triple rule-out procedure |
WO2008067617A1 (en) * | 2006-12-08 | 2008-06-12 | Cuoretech Pty Ltd | Ultrasound catheter and method |
FR3068813B1 (en) * | 2017-07-10 | 2021-07-02 | Univ Aix Marseille | METHOD AND DEVICE FOR IMAGE SEGMENTATION BY AUTOMATIC PROPAGATION IN ONE (N + 1) -TH DIMENSION OF AN IMAGE SEGMENTATION INITIALIZED IN N DIMENSION |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4953554A (en) * | 1988-03-04 | 1990-09-04 | Resonex, Inc. | Magnetic resonance imaging method |
US5381791A (en) * | 1992-03-10 | 1995-01-17 | Siemens Medical Systems, Inc. | Automatic indentification of anatomical features of interest from data acquired in nuclear medicine studies and automatic positioning of scintillation cameras to carry out such studies at optimal positions |
US5435310A (en) * | 1993-06-23 | 1995-07-25 | University Of Washington | Determining cardiac wall thickness and motion by imaging and three-dimensional modeling |
US5680862A (en) * | 1995-02-01 | 1997-10-28 | The Board Of Trustees Of The Leland Stanford Junior University | Iterative method of determining trajectory of a moving region in a moving material using velocity measurements in a fixed frame of reference |
US5757953A (en) * | 1996-02-29 | 1998-05-26 | Eastman Kodak Company | Automated method and system for region decomposition in digital radiographic images |
US5800355A (en) * | 1995-09-27 | 1998-09-01 | Kabushiki Kaisha Toshiba | Image processing apparatus and method for quantitatively detecting and correcting the twist between images |
US5982909A (en) * | 1996-04-23 | 1999-11-09 | Eastman Kodak Company | Method for region tracking in an image sequence using a two-dimensional mesh |
US6120453A (en) * | 1997-11-17 | 2000-09-19 | Sharp; William A. | Three-dimensional ultrasound system based on the coordination of multiple ultrasonic transducers |
US6195445B1 (en) * | 1997-06-30 | 2001-02-27 | Siemens Corporate Research, Inc. | Motion compensation of an image sequence using optimal polyline tracking |
US20010048753A1 (en) * | 1998-04-02 | 2001-12-06 | Ming-Chieh Lee | Semantic video object segmentation and tracking |
US6346124B1 (en) * | 1998-08-25 | 2002-02-12 | University Of Florida | Autonomous boundary detection system for echocardiographic images |
US6353679B1 (en) * | 1998-11-03 | 2002-03-05 | Compaq Computer Corporation | Sample refinement method of multiple mode probability density estimation |
US6396961B1 (en) * | 1997-11-12 | 2002-05-28 | Sarnoff Corporation | Method and apparatus for fixating a camera on a target point using image alignment |
US20020072671A1 (en) * | 2000-12-07 | 2002-06-13 | Cedric Chenal | Automated border detection in ultrasonic diagnostic images |
US20020072670A1 (en) * | 2000-12-07 | 2002-06-13 | Cedric Chenal | Acquisition, analysis and display of ultrasonic diagnostic cardiac images |
-
2003
- 2003-09-05 US US10/527,862 patent/US7668370B2/en not_active Expired - Lifetime
- 2003-09-05 EP EP03797432.6A patent/EP1543474B1/en not_active Expired - Lifetime
- 2003-09-05 WO PCT/IB2003/003898 patent/WO2004027712A2/en active Application Filing
- 2003-09-05 JP JP2004537392A patent/JP2006500098A/en active Pending
- 2003-09-05 AU AU2003256022A patent/AU2003256022A1/en not_active Abandoned
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4953554A (en) * | 1988-03-04 | 1990-09-04 | Resonex, Inc. | Magnetic resonance imaging method |
US5381791A (en) * | 1992-03-10 | 1995-01-17 | Siemens Medical Systems, Inc. | Automatic indentification of anatomical features of interest from data acquired in nuclear medicine studies and automatic positioning of scintillation cameras to carry out such studies at optimal positions |
US5435310A (en) * | 1993-06-23 | 1995-07-25 | University Of Washington | Determining cardiac wall thickness and motion by imaging and three-dimensional modeling |
US5680862A (en) * | 1995-02-01 | 1997-10-28 | The Board Of Trustees Of The Leland Stanford Junior University | Iterative method of determining trajectory of a moving region in a moving material using velocity measurements in a fixed frame of reference |
US5800355A (en) * | 1995-09-27 | 1998-09-01 | Kabushiki Kaisha Toshiba | Image processing apparatus and method for quantitatively detecting and correcting the twist between images |
US5757953A (en) * | 1996-02-29 | 1998-05-26 | Eastman Kodak Company | Automated method and system for region decomposition in digital radiographic images |
US5982909A (en) * | 1996-04-23 | 1999-11-09 | Eastman Kodak Company | Method for region tracking in an image sequence using a two-dimensional mesh |
US6195445B1 (en) * | 1997-06-30 | 2001-02-27 | Siemens Corporate Research, Inc. | Motion compensation of an image sequence using optimal polyline tracking |
US6396961B1 (en) * | 1997-11-12 | 2002-05-28 | Sarnoff Corporation | Method and apparatus for fixating a camera on a target point using image alignment |
US6120453A (en) * | 1997-11-17 | 2000-09-19 | Sharp; William A. | Three-dimensional ultrasound system based on the coordination of multiple ultrasonic transducers |
US20010048753A1 (en) * | 1998-04-02 | 2001-12-06 | Ming-Chieh Lee | Semantic video object segmentation and tracking |
US6346124B1 (en) * | 1998-08-25 | 2002-02-12 | University Of Florida | Autonomous boundary detection system for echocardiographic images |
US6353679B1 (en) * | 1998-11-03 | 2002-03-05 | Compaq Computer Corporation | Sample refinement method of multiple mode probability density estimation |
US20020072671A1 (en) * | 2000-12-07 | 2002-06-13 | Cedric Chenal | Automated border detection in ultrasonic diagnostic images |
US20020072670A1 (en) * | 2000-12-07 | 2002-06-13 | Cedric Chenal | Acquisition, analysis and display of ultrasonic diagnostic cardiac images |
Non-Patent Citations (5)
Title |
---|
E.G. Caini et al; "Analysis of Left Ventricular Wall Motion Using Dynamic Alignment", Piscataway, NJ, IEEE, 2000, pp. 695-698, XP 010528659. |
J. Benois-Pineau et al; "Motion and Structure Based Image Segmentation for Object Oriented Time-Varying Sequences Coding", Pattern Recognition, 1994, vol. 1, Confer. |
M. Pardas et al; "Motion Estimation Based Tracking of Active Contours", Pattern Recognition Letters, North-Holland Publ. Amsterdam, NL, vol. 22, No. 13, Nov. 2001, pp. 144. |
Malassiotis et al., Tracking the Left Ventricle in Echocardiographic Images by Learning Heart Dynamics, Mar. 1999, IEEE Transactions of Medical Imaging, vol. 18, No. 3, pp. 282-290. * |
T. O'Donnell et al; "Multi-Modality Model-Based Registration in the Cardiac Domain", Proceedings 2000 IEEE Conference on Computer Viion and Pattern Recognition. CVPR 2000. HIL. |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050277466A1 (en) * | 2004-05-26 | 2005-12-15 | Playdata Systems, Inc. | Method and system for creating event data and making same available to be served |
US9087380B2 (en) * | 2004-05-26 | 2015-07-21 | Timothy J. Lock | Method and system for creating event data and making same available to be served |
US20090175515A1 (en) * | 2006-06-08 | 2009-07-09 | Tomtec Imaging Systems Gmbh | Method, device, and computer programme for evaluating images of a cavity |
US8077944B2 (en) * | 2006-06-08 | 2011-12-13 | Tomtec Imaging Systems Gmbh | Method, device, and computer programme for evaluating images of a cavity |
US9436995B2 (en) | 2014-04-27 | 2016-09-06 | International Business Machines Corporation | Discriminating between normal and abnormal left ventricles in echocardiography |
US10769778B2 (en) | 2014-04-27 | 2020-09-08 | International Business Machines Corporation | Discriminating between normal and abnormal left ventricles in echocardiography |
Also Published As
Publication number | Publication date |
---|---|
EP1543474B1 (en) | 2018-12-26 |
AU2003256022A1 (en) | 2004-04-08 |
JP2006500098A (en) | 2006-01-05 |
US20050271271A1 (en) | 2005-12-08 |
EP1543474A2 (en) | 2005-06-22 |
WO2004027712A2 (en) | 2004-04-01 |
WO2004027712A3 (en) | 2004-08-26 |
AU2003256022A8 (en) | 2004-04-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10699410B2 (en) | Automatic change detection in medical images | |
US11559221B2 (en) | Multi-task progressive networks for patient modeling for medical scans | |
US8787648B2 (en) | CT surrogate by auto-segmentation of magnetic resonance images | |
US7778686B2 (en) | Method and apparatus for medical intervention procedure planning and location and navigation of an intervention tool | |
CN102727236B (en) | By the method and apparatus using the medical image of 3D model generation organ | |
US7567696B2 (en) | System and method for detecting the aortic valve using a model-based segmentation technique | |
EP3652747B1 (en) | Methods and systems for guidance in cardiac resynchronization therapy | |
RU2595757C2 (en) | Device to superimpose images | |
US20090010519A1 (en) | Medical image processing apparatus and medical image diagnosis apparatus | |
US20120287131A1 (en) | Image processing apparatus and image registration method | |
US7668370B2 (en) | Segmenting a series of 2D or 3D images | |
JP2008534105A (en) | Method, system and computer program for partitioning structures in a data set | |
EP2059173B1 (en) | System and method for measuring left ventricular torsion | |
JP2019082745A (en) | Artificial intelligence ejection fraction determination method | |
CN115861172A (en) | Wall motion estimation method and device based on self-adaptive regularized optical flow model | |
JP4424916B2 (en) | How to create a sequence | |
US11837352B2 (en) | Body representations | |
Wang et al. | Instantiation-Net: 3D Mesh Reconstruction from Single 2D Image for Right Ventricle | |
KR20240086195A (en) | Deformable Image Registration and Synthetic Image Generation System Based On Unsupervised Learning Using Diffusion Model and Method Thereof | |
CN113643285A (en) | Myocardial bulls-eye diagram analysis method, system and medium based on artificial neural network | |
Verdugo et al. | Cardiac motion quantification: a new software based on non-rigid registration | |
LLmmmS | d) Patent Application Publication tio, Pub. No: US 2005/0271271 A1 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KONINKLIJKE PHILIPS ELECTRONICS, N.V., NETHERLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NOBLE, NICHOLAS MICHAEL IAN;SPREEUWERS, LIEUWE JAN;BREEUWER, MARCEL;REEL/FRAME:016978/0233;SIGNING DATES FROM 20040419 TO 20040423 Owner name: KONINKLIJKE PHILIPS ELECTRONICS, N.V.,NETHERLANDS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NOBLE, NICHOLAS MICHAEL IAN;SPREEUWERS, LIEUWE JAN;BREEUWER, MARCEL;SIGNING DATES FROM 20040419 TO 20040423;REEL/FRAME:016978/0233 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552) Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |