WO2018055061A1 - Hyperspectral tissue imaging - Google Patents
Hyperspectral tissue imaging Download PDFInfo
- Publication number
- WO2018055061A1 WO2018055061A1 PCT/EP2017/073955 EP2017073955W WO2018055061A1 WO 2018055061 A1 WO2018055061 A1 WO 2018055061A1 EP 2017073955 W EP2017073955 W EP 2017073955W WO 2018055061 A1 WO2018055061 A1 WO 2018055061A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- hyperspectral
- tissue
- illumination
- image data
- camera
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title abstract description 11
- 238000005286 illumination Methods 0.000 claims abstract description 88
- 238000000701 chemical imaging Methods 0.000 claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 11
- 239000011888 foil Substances 0.000 claims description 9
- 239000000523 sample Substances 0.000 claims description 9
- 239000002872 contrast media Substances 0.000 claims description 8
- 238000002604 ultrasonography Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 3
- 230000003595 spectral effect Effects 0.000 description 5
- 238000001356 surgical procedure Methods 0.000 description 5
- 206010028980 Neoplasm Diseases 0.000 description 4
- 238000012800 visualization Methods 0.000 description 4
- 230000001419 dependent effect Effects 0.000 description 3
- 230000002708 enhancing effect Effects 0.000 description 2
- 210000003238 esophagus Anatomy 0.000 description 2
- 238000002073 fluorescence micrograph Methods 0.000 description 2
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 description 2
- 229960004657 indocyanine green Drugs 0.000 description 2
- 230000003387 muscular Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 230000035515 penetration Effects 0.000 description 2
- 210000000664 rectum Anatomy 0.000 description 2
- 238000002271 resection Methods 0.000 description 2
- 210000002784 stomach Anatomy 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 241001491366 Euphydryas colon Species 0.000 description 1
- 210000001072 colon Anatomy 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000002324 minimally invasive surgery Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 238000011477 surgical intervention Methods 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/0035—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/12—Diagnosis using ultrasonic, sonic or infrasonic waves in body cavities or body tracts, e.g. by using catheters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/44—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device
- A61B8/4416—Constructional features of the ultrasonic, sonic or infrasonic diagnostic device related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/042—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0661—Endoscope light sources
- A61B1/0684—Endoscope light sources using light emitting diodes [LED]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/07—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/313—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/02—Details of sensors specially adapted for in-vivo measurements
- A61B2562/0233—Special features of optical sensors or probes classified in A61B5/00
- A61B2562/0238—Optical sensor arrangements for performing transmission measurements on body tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
- A61B5/0086—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters using infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
- A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
- A61B5/6848—Needles
Definitions
- the present invention relates to tissue imaging, and relates in particular to a hyperspectral imaging system and to a method for generating image data of a tissue of interest.
- WO 2010/028612 relates to spectral analysis and describes a device for monitoring of structural changes in the parenchyma tissue of various parenchymatous organs.
- the device comprises a spectroscope with a spectroscopic probe, the source of near infrared radiation with a connected optical fiber, that contains on its other ending means for directing the light beam and also means for introducing the optical fiber and a spectroscopic probe into the examined organ.
- a hyperspectral imaging system for medical application comprises a hyperspectral camera, a first illumination arrangement, a second illumination arrangement, a target arrangement space, and a processing unit.
- the target arrangement space is provided to arrange a tissue of interest, or tissue probe, therein for hyperspectral imaging of the tissue.
- the hyperspectral camera is arranged on a first side of the target arrangement space.
- the first illumination arrangement is configured to provide top illumination from the first side to a tissue provided in the target arrangement space
- the second illumination arrangement is configured to provide back illumination from a second side to the tissue.
- the second side is opposite to the first side.
- the second illumination arrangement is provided as an insertable light source.
- the hyperspectral camera is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination.
- the processing unit is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
- a hyperspectral image is a hypercube dataset i.e. a set of images acquired at different wavelength bands.
- a hyperspectral camera is a camera that is able to record for each image point apart from the gray values also spectral information.
- the hyperspectral camera can also be referred to as multispectral camera or sensor.
- the hyperspectral camera is capable of taking images at different wavelengths.
- the hyperspectral camera is provided as a so-called filter wheel solution or as a so-called hyperspectral mosaic snapshot imager.
- the first and second illumination arrangement can also be referred to as first and second light sources.
- the second illumination arrangement can also be referred to as trans-illumination light source.
- the first side can also be referred to as the camera side.
- the second side can also be referred to as the back site.
- the tissue is arranged between the second light source and the hyperspectral camera.
- the tissue is provided in the arrangement space.
- the second illumination arrangement is arranged on a second side of the tissue arrangement space, which second side is opposite to the first side.
- the hyperspectral camera is provided with filters that are provided integrally with an image sensor of the hyperspectral camera.
- the hyperspectral imaging is provided, for example, for medical applications, such as enhancing critical structures or enhancing tumor tissue in order to improve tumor resection and to lower the comorbidity.
- the hyperspectral camera is equipped with optical filters at different wavelengths; and at least the second illumination arrangement comprises a broad band light source.
- the hyperspectral camera is standard and at least the second illumination arrangement comprises light sources with specific wavelengths.
- the light sources may be provided as LEDs.
- images of varied wavelengths are sequentially acquired by switching on each type of LED (or LED combination) in a sequence.
- the color LEDs configuration e.g., spectral distribution
- LEDs control are determined according to the application.
- the front and transillumination systems are used when imaging fluorescent contrast agents, such as Indocyanine green (ICG).
- ICG Indocyanine green
- the trans-illumination increases the effective penetration depth, and the relative intensities in the front- and back illuminated images correspond to the depth that the contrast agent is located at.
- the first illumination is provided by surrounding light of an environment illuminating the tissue.
- the first illumination arrangement relates to the surrounding light sources, and thus in a certain way comprises the surrounding light sources.
- the illumination and camera system make use of cross- polarizers, in order to minimize the glare that an uncovered part of the (trans-illuminating) light source would cause in the camera image.
- the light source is external to the body, and the light is coupled via (fiber-optic) light guides to the trans-illumination system.
- the second illumination arrangement comprises an implantable light source.
- the implantable light source comprises a thin and flexible light emitting foil that is insertable to a location of interest via a trocar or needle and that is placeable at least party surrounding a tissue of interest.
- the light emitting foil may contain a flexible OLED layer.
- the light emitting foil can be placed at least partly surrounding a tissue of interest, such that light can be provided evenly from below for better imaging results.
- the light source can be temporarily implantable.
- the implantable light source is a small LED light source insertable into the body via needle.
- the second illumination is configured to be provided to a tissue region of interest via an endoscope or laparoscope arrangement.
- the second illumination arrangement comprises a light source that is insertable into a natural opening of a body of a patient.
- hyperspectral camera is configured to be arranged outside the natural opening.
- the natural opening is a colon/rectum, esophagus, stomach etc.
- the second illumination arrangement also comprises an ultrasound probe to provide ultrasound image data of the tissue of interest.
- the hyperspectral camera is provided as an external camera.
- the hyperspectral camera is provided as an insertable camera that is insertable via an endoscope or trocar or needle.
- the hyperspectral camera is attached to an eye-piece of an endoscope.
- a method for generating image data of a tissue of interest for medical application comprises the following steps: a) arranging tissue of interest in a target arrangement space;
- a system comprises hyperspectral camera and two illuminations systems, from which a first one is a top illumination light source and a second one is a back illumination light source. For example, illumination is provided from the position such that the tissue is in between the light source and hyperspectral camera.
- Hyperspectral images are acquired when illuminated with the first illumination system and when illuminated with second illumination system. The images of the first and second are combined to provide a combine superficial and deeper view of the tissue.
- Fig. 1 shows a schematic setup of an example of a hyperspectral imaging system.
- Fig. 2 shows a schematic setup of on insertable light source.
- Fig. 3 shows another example of a hyperspectral imaging system in use for imaging a tissue of a patient.
- Fig. 4 shows an example of an image sequence.
- Fig. 5 shows another example of an image sequence.
- Fig. 6 shows basic steps of an example of a method for generating image data of a tissue of interest.
- Fig. 1 shows an example of a hyperspectral imaging system 10.
- the system 10 comprises a hyperspectral camera 12. Further, a first illumination arrangement 14 and a second illumination arrangement 16 are provided. Still further, a target arrangement space 18 is provided. A processing unit 20 is also schematically indicated.
- the target arrangement space 18 is provided to arrange a tissue of interest 22 therein for hyperspectral imaging of the tissue.
- the hyperspectral camera 12 is arranged on a first side of the target arrangement space 18.
- the first illumination arrangement 14 is configured to provide top illumination 24 from the first side to a tissue provided in the target arrangement space 18.
- the second illumination arrangement 16 is configured to provide back illumination 26 from a second side to the tissue, wherein in relation to the target arrangement space 18, the second side is opposite to the first side.
- the first side is the upper side
- the second side is the lower side.
- the hyperspectral camera 12 is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination.
- the processing unit 20 is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest. As an option, this data is provided for further processing via an interface 28.
- the hyperspectral camera is equipped with optical filters at different wavelengths; and at least the second illumination arrangement 16 comprises a broad band light source.
- the hyperspectral camera is standard and at least the second illumination arrangement 16 comprises light sources with specific wavelengths.
- the first illumination 24 is provided by surrounding light of environment illuminating the tissue, as indicated in Fig. 1.
- the first illumination 24 is provided by at least one separate light source (not shown in detail).
- a combination of surrounding light and one or more light sources illuminating the tissue are provided.
- the second illumination arrangement 16 is provided as an insertable light source.
- a trocar 50 is provided to insert a thin and flexible light emitting foil 52 to a location of interest via the trocar 50.
- the light emitting foil 52 may contain a flexible OLED layer.
- the foil can then be placed at least party surrounding a tissue of interest 54, as indicated in the right part of Fig. 2. In this way, the light emitting foil can provide light evenly from below.
- a needle is provided to insert the light emitting foil.
- the combination of trans- and top- illumination may be used in laparoscopic interventions to enhance the visualization of structures of interest (vessels, tumor) during minimally invasive procedures.
- the top illumination can be provided by the laparoscope illumination system.
- the back illumination is made by a light source that is introduced in the surgical cavity by entering a light source that is introduced via a trocar and positioned behind the tissue of interest, as shown in Fig. 2.
- the light source may also be a thin surface that can be rolled up to a small cylinder shape so that it can again be introduced through a trocar and spread out once inside the surgical cavity.
- the second illumination arrangement 16 comprises an implantable light source.
- the second illumination is configured to be provided to a tissue region of interest via an endoscope or laparoscope arrangement.
- the second light source is a temporarily implantable light emitting marker. These can be introduced before the surgery, for instance via a percutaneous needle intervention or can be implanted during the surgical intervention.
- Fig. 3 shows a patient 32 with a region of interest 34, for example a surgery field of the patient with a tissue 36 of interest.
- a hyperspectral camera 38 can make images when the tissue is illuminated with a first light source 38 from atop and when the tissue is illuminated by a second light source 42 below the tissue resulting in trans-illuminated images.
- Two types of images are then acquired: the first set will provide detailed information of the superficial layer and the second the deeper structures. Combining the two will provide a detailed image of the superficial and deeper structures of the tissue.
- the second illumination arrangement 16 comprises a light source (not shown in detail) that is insertable into a natural opening of a body of a patient.
- the hyperspectral camera can be arranged outside the natural opening, i.e. colon/rectum, esophagus, stomach etc.
- the second illumination arrangement 16 also comprises an ultrasound probe 44 to provide ultrasound image data of the tissue of interest.
- the hyperspectral camera is provided as an insertable camera that is insertable via an endoscope or trocar or needle.
- the hyperspectral camera 12 is attached to an eye-piece of an endoscope.
- the hyper/multi-spectral imaging setup comprises a standard camera and dedicated multi-spectral LED-illumination at specific wavelengths.
- images of varied wavelengths are sequentially acquired by switching on each type of LED (or LED combination) in sequence.
- the LEDs configuration e.g., spectral distribution
- LEDs control are determined according to the application.
- the user might perceive the light flickering with different LEDs switched on/off.
- it is provided to remove the lighting flickering. Since light temporal flickering is visible for the frequency lower than 50 Hz, an alternative is to use a higher frame-rate of the camera (i.e. 100 Hz), which can acquire multi-spectral imaging data without the temporal flickering.
- polarizers are used between the light source and the tissue and between the tissue and the camera in order to remove reflected light from the surface, in a similar manner. Reflected light from watery tissue surfaces can cause saturation of camera pixels thus limiting the quality of spectral information recorded by the sensor and that is mainly carried by scattered light.
- a fluorescent contrast agent is introduced into the tissue.
- the contrast agent that is close to the surface will fluoresce with high intensity, while in deeper tissue, the fluorescence will be weak. In the case of transillumination, the reverse is true.
- the system can create a fluorescence image with increased penetration depth.
- the depth location of the contrast agent may be reconstructed from the relative intensities in the fluorescence images.
- Fig. 4 shows pictures of a slice of tissue using top illumination; from the three images, the left and center images are acquired at different wavelengths; the right image is a combination of the previous image where superficial structures are enhanced.
- multispectral-imaging camera left and center
- a setup has been used with a filter wheel containing filters at different wavelength bands.
- the result of one possible combination is shown to enhance fat tissue (darkest areas, indicated with a first arrow 62), a mix of fat and muscular tissue (grey, indicated with a second arrow 64), and muscular layer (hyper-intense area, indicated with a third arrow 66). Structures on the surface of the ex- vivo tissue are well enhanced and appear in high detail thanks to the combination of different spectral information.
- Fig. 5 shows pictures of a slice of tissue using top and back illumination; from the three images, the left and center images are acquired at different wavelengths (same bands as in the previous experiment of Fig. 4) using both top and back illumination; the right image is a combination of the previous image where superficial and deeper structures are enhanced, thus contributing to enhance finer details.
- the same tissue sample has been illuminated as in Fig. 4 by both top and back light sources.
- combined illumination provides for higher contrast and enhanced visualization of deeper structures, which overall contribute to a sharper definition of fine details.
- the visualization of the latter may become relevant in certain procedure, especially in case of boundary definition for tumor resection.
- Fig 6 shows an example of a method 100 for generating image data of a tissue of interest for medical application.
- the method 100 comprises the following steps: In a first step 102, also referred to as step a), arranging tissue of interest in a target arrangement space is provided. In a second step 104, also referred to as step b), illuminating the tissue from a first side and detecting first hyperspectral image data of the tissue with a hyperspectral camera is provided. The hyperspectral camera is arranged on a first side of the target arrangement space. In a third step 106, also referred to as step c), illuminating the tissue from a second side and detecting second hyperspectral image data of the tissue with the
- the hyperspectral camera In relation to the target arrangement space, the second side is opposite to the first side.
- the second illumination arrangement is provided as an insertable light source.
- step d the first hyperspectral image data and the second hyperspectral image data are combined to generate combined hyperspectral image data of the tissue of interest.
- the steps b) and c) are provide simultaneously. In an alternative example, the steps b) and c) are provide consecutively.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Endoscopes (AREA)
Abstract
The present invention relates to tissue imaging. In order to provide a further improved hyperspectral imaging, a hyperspectral imaging system (10) for medical application is provided that comprises a hyperspectral camera (12), a first illumination arrangement (14), a second illumination arrangement (16), a target arrangement space (18), and a processing unit (20). The target arrangement space is provided to arrange tissue of interest (22) therein for hyperspectral imaging of the tissue. The hyperspectral camera is arranged on a first side of the target arrangement space. The first illumination arrangement is configured to provide top illumination (24) from the first side to a tissue provided in the target arrangement space; and the second illumination arrangement is configured to provide back illumination (26) from a second side to the tissue, wherein in relation to the target arrangement space the second side is opposite to the first side, and wherein the second illumination arrangement is provided as an insertable light source. The hyperspectral camera is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination. Further, the processing unit is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
Description
Hyperspectral tissue imaging
FIELD OF THE INVENTION
The present invention relates to tissue imaging, and relates in particular to a hyperspectral imaging system and to a method for generating image data of a tissue of interest.
BACKGROUND OF THE INVENTION
For retrieving information about a tissue of interest, hyperspectral cameras are used, for example, to image a surface of the tissue of interest. Thereby, superficial tissue structures can be enhanced. This technique is becoming used more frequently, for example, for better visualization of critical structures during surgery. WO 2010/028612 relates to spectral analysis and describes a device for monitoring of structural changes in the parenchyma tissue of various parenchymatous organs. The device comprises a spectroscope with a spectroscopic probe, the source of near infrared radiation with a connected optical fiber, that contains on its other ending means for directing the light beam and also means for introducing the optical fiber and a spectroscopic probe into the examined organ. However, it is desirable to be able to retrieve more information about the tissue of interest.
SUMMARY OF THE INVENTION
There may be a need to provide a further improved hyperspectral imaging.
The object of the present invention is solved by the subject-matter of the independent claims; further embodiments are incorporated in the dependent claims. It should be noted that the following described aspects of the invention apply also for the hyperspectral imaging system and to the method for generating image data of a tissue of interest.
According to the present invention, a hyperspectral imaging system for medical application is provided that comprises a hyperspectral camera, a first illumination arrangement, a second illumination arrangement, a target arrangement space, and a processing unit. The target arrangement space is provided to arrange a tissue of interest, or tissue probe, therein for hyperspectral imaging of the tissue. The hyperspectral camera is arranged on a first side of the target arrangement space. The first illumination arrangement is
configured to provide top illumination from the first side to a tissue provided in the target arrangement space, and the second illumination arrangement is configured to provide back illumination from a second side to the tissue. In relation to the target arrangement space, the second side is opposite to the first side. The second illumination arrangement is provided as an insertable light source. Further, the hyperspectral camera is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination. Still further, the processing unit is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
This results in improved knowledge about the characteristic or properties of the tissue of interest.
A hyperspectral image is a hypercube dataset i.e. a set of images acquired at different wavelength bands.
A hyperspectral camera is a camera that is able to record for each image point apart from the gray values also spectral information. The hyperspectral camera can also be referred to as multispectral camera or sensor. The hyperspectral camera is capable of taking images at different wavelengths.
In an example, the hyperspectral camera is provided as a so-called filter wheel solution or as a so-called hyperspectral mosaic snapshot imager.
The first and second illumination arrangement can also be referred to as first and second light sources. The second illumination arrangement can also be referred to as trans-illumination light source.
The first side can also be referred to as the camera side. The second side can also be referred to as the back site.
The tissue is arranged between the second light source and the hyperspectral camera.
For the second illumination, the tissue is provided in the arrangement space.
The second illumination arrangement is arranged on a second side of the tissue arrangement space, which second side is opposite to the first side.
In an example, the hyperspectral camera is provided with filters that are provided integrally with an image sensor of the hyperspectral camera.
The hyperspectral imaging is provided, for example, for medical applications, such as enhancing critical structures or enhancing tumor tissue in order to improve tumor resection and to lower the comorbidity.
According to an example, the hyperspectral camera is equipped with optical filters at different wavelengths; and at least the second illumination arrangement comprises a broad band light source.
According to an example, the hyperspectral camera is standard and at least the second illumination arrangement comprises light sources with specific wavelengths. The light sources may be provided as LEDs. In this manner, images of varied wavelengths are sequentially acquired by switching on each type of LED (or LED combination) in a sequence. The color LEDs configuration (e.g., spectral distribution) and LEDs control are determined according to the application.
For example, at least one of the first and second illumination arrangement is provided to be able to excite fluorescent contrast agents. In an example, the front and transillumination systems are used when imaging fluorescent contrast agents, such as Indocyanine green (ICG). The trans-illumination increases the effective penetration depth, and the relative intensities in the front- and back illuminated images correspond to the depth that the contrast agent is located at.
According to an example, the first illumination is provided by surrounding light of an environment illuminating the tissue. Hence, the first illumination arrangement relates to the surrounding light sources, and thus in a certain way comprises the surrounding light sources.
For example, in case of surgery, the surrounding light of a clinical
examination and operation environment radiates the tissue.
In an example, the illumination and camera system make use of cross- polarizers, in order to minimize the glare that an uncovered part of the (trans-illuminating) light source would cause in the camera image.
In an example, the light source is external to the body, and the light is coupled via (fiber-optic) light guides to the trans-illumination system.
According to an example, the second illumination arrangement comprises an implantable light source.
According to an example, the implantable light source comprises a thin and flexible light emitting foil that is insertable to a location of interest via a trocar or needle and that is placeable at least party surrounding a tissue of interest.
For example, the light emitting foil may contain a flexible OLED layer. The light emitting foil can be placed at least partly surrounding a tissue of interest, such that light can be provided evenly from below for better imaging results.
The light source can be temporarily implantable. In an example, the implantable light source is a small LED light source insertable into the body via needle. According to an example, the second illumination is configured to be provided to a tissue region of interest via an endoscope or laparoscope arrangement.
According to an example, the second illumination arrangement comprises a light source that is insertable into a natural opening of a body of a patient; and the
hyperspectral camera is configured to be arranged outside the natural opening.
For example, the natural opening is a colon/rectum, esophagus, stomach etc.
According to an example, the second illumination arrangement also comprises an ultrasound probe to provide ultrasound image data of the tissue of interest.
This results in additional data related to the tissue, and thus provides an even enhanced knowledge about the current situation.
According to an example, the hyperspectral camera is provided as an external camera.
This allows imaging of tissue or tissue probes of an object from outside the object, for examples open-laid tissue in case of open surgery.
According to an example, the hyperspectral camera is provided as an insertable camera that is insertable via an endoscope or trocar or needle.
This allows imaging of tissue or tissue probes inside an object.
According to an example, the hyperspectral camera is attached to an eye-piece of an endoscope.
According to the present invention, also a method for generating image data of a tissue of interest for medical application is provided that comprises the following steps: a) arranging tissue of interest in a target arrangement space;
b) illuminating the tissue from a first side and detecting first hyperspectral image data of the tissue with a hyperspectral camera; wherein the hyperspectral camera is arranged on a first side of the target arrangement space;
c) illuminating the tissue from a second side and detecting second hyperspectral image data of the tissue with the hyperspectral camera; wherein in relation to the target arrangement space the second side is opposite to the first side and wherein the second illumination arrangement is provided as an insertable light source; and
d) combining the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
According to an aspect, superficial and deeper hyperspectral imaging of tissue is provided. A system comprises hyperspectral camera and two illuminations systems, from which a first one is a top illumination light source and a second one is a back illumination light source. For example, illumination is provided from the position such that the tissue is in between the light source and hyperspectral camera. Hyperspectral images are acquired when illuminated with the first illumination system and when illuminated with second illumination system. The images of the first and second are combined to provide a combine superficial and deeper view of the tissue.
These and other aspects of the present invention will become apparent from and be elucidated with reference to the embodiments described hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
Exemplary embodiments of the invention will be described in the following with reference to the following drawings:
Fig. 1 shows a schematic setup of an example of a hyperspectral imaging system.
Fig. 2 shows a schematic setup of on insertable light source.
Fig. 3 shows another example of a hyperspectral imaging system in use for imaging a tissue of a patient.
Fig. 4 shows an example of an image sequence.
Fig. 5 shows another example of an image sequence.
Fig. 6 shows basic steps of an example of a method for generating image data of a tissue of interest. DETAILED DESCRIPTION OF EMBODIMENTS
Fig. 1 shows an example of a hyperspectral imaging system 10. The system 10 comprises a hyperspectral camera 12. Further, a first illumination arrangement 14 and a second illumination arrangement 16 are provided. Still further, a target arrangement space 18 is provided. A processing unit 20 is also schematically indicated. The target arrangement space 18 is provided to arrange a tissue of interest 22 therein for hyperspectral imaging of the tissue. The hyperspectral camera 12 is arranged on a first side of the target arrangement space 18. The first illumination arrangement 14 is configured to provide top illumination 24 from the first side to a tissue provided in the target arrangement space 18. The second illumination arrangement 16 is configured to provide back illumination 26 from a second side
to the tissue, wherein in relation to the target arrangement space 18, the second side is opposite to the first side. In the example shown, the first side is the upper side, and the second side is the lower side. The hyperspectral camera 12 is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination. The processing unit 20 is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest. As an option, this data is provided for further processing via an interface 28.
In an example, the hyperspectral camera is equipped with optical filters at different wavelengths; and at least the second illumination arrangement 16 comprises a broad band light source.
In another example, the hyperspectral camera is standard and at least the second illumination arrangement 16 comprises light sources with specific wavelengths.
In still another example, the first illumination 24 is provided by surrounding light of environment illuminating the tissue, as indicated in Fig. 1.
In an alternative option, the first illumination 24 is provided by at least one separate light source (not shown in detail). In another option, a combination of surrounding light and one or more light sources illuminating the tissue are provided.
In a further example, the second illumination arrangement 16 is provided as an insertable light source. For example, as shown in Fig. 2, left part, a trocar 50 is provided to insert a thin and flexible light emitting foil 52 to a location of interest via the trocar 50. For example, the light emitting foil 52 may contain a flexible OLED layer. The foil can then be placed at least party surrounding a tissue of interest 54, as indicated in the right part of Fig. 2. In this way, the light emitting foil can provide light evenly from below.
In another option (not shown), a needle is provided to insert the light emitting foil.
For example, the combination of trans- and top- illumination may be used in laparoscopic interventions to enhance the visualization of structures of interest (vessels, tumor) during minimally invasive procedures. In this case the top illumination can be provided by the laparoscope illumination system. The back illumination is made by a light source that is introduced in the surgical cavity by entering a light source that is introduced via a trocar and positioned behind the tissue of interest, as shown in Fig. 2. The light source may also be a thin surface that can be rolled up to a small cylinder shape so that it can again be introduced through a trocar and spread out once inside the surgical cavity.
In a further example, not shown in detail, the second illumination arrangement 16 comprises an implantable light source. For example, the second illumination is configured to be provided to a tissue region of interest via an endoscope or laparoscope arrangement.
In a further example, the second light source is a temporarily implantable light emitting marker. These can be introduced before the surgery, for instance via a percutaneous needle intervention or can be implanted during the surgical intervention.
Fig. 3 shows a patient 32 with a region of interest 34, for example a surgery field of the patient with a tissue 36 of interest. A hyperspectral camera 38 can make images when the tissue is illuminated with a first light source 38 from atop and when the tissue is illuminated by a second light source 42 below the tissue resulting in trans-illuminated images. Two types of images are then acquired: the first set will provide detailed information of the superficial layer and the second the deeper structures. Combining the two will provide a detailed image of the superficial and deeper structures of the tissue.
In an example, the second illumination arrangement 16 comprises a light source (not shown in detail) that is insertable into a natural opening of a body of a patient. The hyperspectral camera can be arranged outside the natural opening, i.e. colon/rectum, esophagus, stomach etc.
As an option, indicated in Fig. 3, the second illumination arrangement 16 also comprises an ultrasound probe 44 to provide ultrasound image data of the tissue of interest.
In an example, the hyperspectral camera is provided as an insertable camera that is insertable via an endoscope or trocar or needle.
As an option (not further shown), the hyperspectral camera 12 is attached to an eye-piece of an endoscope.
In another option, the hyper/multi-spectral imaging setup comprises a standard camera and dedicated multi-spectral LED-illumination at specific wavelengths. In this setup images of varied wavelengths are sequentially acquired by switching on each type of LED (or LED combination) in sequence. The LEDs configuration (e.g., spectral distribution) and LEDs control are determined according to the application.
In this imaging process, the user might perceive the light flickering with different LEDs switched on/off. As an option, it is provided to remove the lighting flickering. Since light temporal flickering is visible for the frequency lower than 50 Hz, an alternative is to use a higher frame-rate of the camera (i.e. 100 Hz), which can acquire multi-spectral imaging data without the temporal flickering.
In a further option, polarizers are used between the light source and the tissue and between the tissue and the camera in order to remove reflected light from the surface, in a similar manner. Reflected light from watery tissue surfaces can cause saturation of camera pixels thus limiting the quality of spectral information recorded by the sensor and that is mainly carried by scattered light.
As a further example, a fluorescent contrast agent is introduced into the tissue. When illuminating from the front, the contrast agent that is close to the surface will fluoresce with high intensity, while in deeper tissue, the fluorescence will be weak. In the case of transillumination, the reverse is true. By combining the images, the system can create a fluorescence image with increased penetration depth. In addition, the depth location of the contrast agent may be reconstructed from the relative intensities in the fluorescence images.
In Figs. 4 and 5, examples of generated images are shown.
Fig. 4 shows pictures of a slice of tissue using top illumination; from the three images, the left and center images are acquired at different wavelengths; the right image is a combination of the previous image where superficial structures are enhanced. In Fig. 4, the result from an imaging sequence of a slice of tissue with top illumination with a
multispectral-imaging camera (left and center) is given. To produce these images, a setup has been used with a filter wheel containing filters at different wavelength bands. On the right, the result of one possible combination (for example, ratio of 550nm and 740nm) is shown to enhance fat tissue (darkest areas, indicated with a first arrow 62), a mix of fat and muscular tissue (grey, indicated with a second arrow 64), and muscular layer (hyper-intense area, indicated with a third arrow 66). Structures on the surface of the ex- vivo tissue are well enhanced and appear in high detail thanks to the combination of different spectral information.
Fig. 5 shows pictures of a slice of tissue using top and back illumination; from the three images, the left and center images are acquired at different wavelengths (same bands as in the previous experiment of Fig. 4) using both top and back illumination; the right image is a combination of the previous image where superficial and deeper structures are enhanced, thus contributing to enhance finer details. In Fig. 5, the same tissue sample has been illuminated as in Fig. 4 by both top and back light sources. As can be seen, combined illumination provides for higher contrast and enhanced visualization of deeper structures, which overall contribute to a sharper definition of fine details. The visualization of the latter may become relevant in certain procedure, especially in case of boundary definition for tumor resection.
Fig 6 shows an example of a method 100 for generating image data of a tissue of interest for medical application. The method 100 comprises the following steps: In a first step 102, also referred to as step a), arranging tissue of interest in a target arrangement space is provided. In a second step 104, also referred to as step b), illuminating the tissue from a first side and detecting first hyperspectral image data of the tissue with a hyperspectral camera is provided. The hyperspectral camera is arranged on a first side of the target arrangement space. In a third step 106, also referred to as step c), illuminating the tissue from a second side and detecting second hyperspectral image data of the tissue with the
hyperspectral camera is provided. In relation to the target arrangement space, the second side is opposite to the first side. The second illumination arrangement is provided as an insertable light source. In a fourth step 108, also referred to as step d), the first hyperspectral image data and the second hyperspectral image data are combined to generate combined hyperspectral image data of the tissue of interest.
In an example, the steps b) and c) are provide simultaneously. In an alternative example, the steps b) and c) are provide consecutively.
It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, a person skilled in the art will gather from the above and the following description that, unless otherwise notified, in addition to any combination of features belonging to one type of subject matter also any combination between features relating to different subject matters is considered to be disclosed with this application.
However, all features can be combined providing synergetic effects that are more than the simple summation of the features.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.
In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. A single processor or other unit may fulfil the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a
combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
Claims
1. A hyperspectral imaging system (10) for medical application, comprising:
a hyperspectral camera (12);
a first illumination arrangement (14);
a second illumination arrangement (16);
- a target arrangement space (18); and
a processing unit (20);
wherein the target arrangement space is provided to arrange tissue of interest (22) therein for hyperspectral imaging of the tissue;
wherein the hyperspectral camera is arranged on a first side of the target arrangement space;
wherein the first illumination arrangement is configured to provide top illumination (24) from the first side to a tissue provided in the target arrangement space;
wherein the second illumination arrangement is configured to provide back illumination (26) from a second side to the tissue, wherein in relation to the target arrangement space the second side is opposite to the first side, and wherein the second illumination arrangement is provided as an insertable light source;
wherein the hyperspectral camera is configured to provide first hyperspectral image data based on the top illumination and second hyperspectral image data based on the back illumination; and
wherein the processing unit is configured to combine the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
2. Hyperspectral imaging system according to claim 1, wherein the system comprises an interface (28) configured to provide the hyperspectral image data.
3. Hyperspectral imaging system according to claim 1 or 2, wherein the hyperspectral camera is equipped with optical filters at different wavelengths; and at least the second illumination arrangement comprises a broad band light source.
4. Hyperspectral imaging system according to claim 1, 2 or 3, wherein the hyperspectral camera is standard and at least the second illumination arrangement comprises light sources with specific wavelengths.
5. Hyperspectral imaging system according to one of the preceding claims, wherein the first illumination is provided by surrounding light of an environment illuminating the tissue.
6. Hyperspectral imaging system according to one of the preceding claims, wherein the second illumination arrangement comprises an implantable light source.
7. Hyperspectral imaging system according to claim 6, wherein the implantable light source comprises a thin and flexible light emitting foil that is insertable to a location of interest via a trocar or needle and that is placeable at least party surrounding a tissue of interest.
8. Hyperspectral imaging system according to one of the preceding claims, wherein the second illumination is configured to be provided to a tissue region of interest via an endoscope or laparoscope or trocar or needle arrangement.
9. Hyperspectral imaging system according to one of the preceding claims, wherein the second illumination arrangement comprises a light source that is insertable into a natural opening of a body of a patient; and the hyperspectral camera is configured to be arranged outside the natural opening.
10. Hyperspectral imaging system according to one of the preceding claims, wherein the second illumination arrangement also comprises an ultrasound probe (44) to provide ultrasound image data of the tissue of interest.
11. Hyperspectral imaging system according to one of the preceding claims, wherein the hyperspectral camera is provided as an insertable camera that is insertable via an endoscope or trocar or needle.
12. Hyperspectral imaging system according to one of the preceding claims, wherein the hyperspectral camera is attached to an eye-piece of an endoscope.
13. Hyperspectral imaging system according to one of the preceding claims, wherein a fiuorescent contrast agent is introduced into the tissue, and wherein at least one of the first and second illumination arrangement is provided to be able to excite fiuorescent contrast agents.
14. A method (100) for generating image data of a tissue of interest for medical application, comprising the following steps:
a) arranging (102) tissue of interest in a target arrangement space;
b) illuminating (104) the tissue from a first side and detecting first hyperspectral image data of the tissue with a hyperspectral camera; wherein the hyperspectral camera is arranged on a first side of the target arrangement space;
c) illuminating (106) the tissue from a second side and detecting second hyperspectral image data of the tissue with the hyperspectral camera; wherein in relation to the target arrangement space the second side is opposite to the first side wherein the second illumination arrangement is provided as an insertable light source; and
d) combining (108) the first hyperspectral image data and the second hyperspectral image data to generate combined hyperspectral image data of the tissue of interest.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP16189899 | 2016-09-21 | ||
EP16189899.4 | 2016-09-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018055061A1 true WO2018055061A1 (en) | 2018-03-29 |
Family
ID=57137811
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2017/073955 WO2018055061A1 (en) | 2016-09-21 | 2017-09-21 | Hyperspectral tissue imaging |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2018055061A1 (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010028612A1 (en) | 2008-09-11 | 2010-03-18 | Jiri Votruba | Device for spectral analysis of parenchyma |
WO2013116316A1 (en) * | 2012-01-30 | 2013-08-08 | Scanadu Incorporated | Hyperspectral imaging systems, units, and methods |
-
2017
- 2017-09-21 WO PCT/EP2017/073955 patent/WO2018055061A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010028612A1 (en) | 2008-09-11 | 2010-03-18 | Jiri Votruba | Device for spectral analysis of parenchyma |
WO2013116316A1 (en) * | 2012-01-30 | 2013-08-08 | Scanadu Incorporated | Hyperspectral imaging systems, units, and methods |
Non-Patent Citations (3)
Title |
---|
DIWAN P. ARIANA ET AL: "Quality evaluation of pickling cucumbers using hyperspectral reflectance and transmittance imaging: Part I. Development of a prototype", SENSING AND INSTRUMENTATION FOR FOOD QUALITY AND SAFETY, vol. 2, no. 3, 27 June 2008 (2008-06-27), US, pages 144 - 151, XP055353899, ISSN: 1932-7587, DOI: 10.1007/s11694-008-9057-x * |
MOHAMADREZA NAJIMINAINI ET AL: "Nanohole-array-based device for 2D snapshot multispectral imaging", SCIENTIFIC REPORTS, vol. 3, 5 September 2013 (2013-09-05), XP055353833, DOI: 10.1038/srep02589 * |
RAK-HWAN KIM ET AL: "Waterproof AlInGaP optoelectronics on stretchable substrates with applications in biomedicine and robotics", NATURE MATERIALS, vol. 9, no. 11, 17 October 2010 (2010-10-17), pages 929 - 937, XP055059704, ISSN: 1476-1122, DOI: 10.1038/nmat2879 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11751971B2 (en) | Imaging and display system for guiding medical interventions | |
US11656448B2 (en) | Method and apparatus for quantitative hyperspectral fluorescence and reflectance imaging for surgical guidance | |
US20220230334A1 (en) | Pen-type medical fluorescent imaging device and system for aligning multiple fluorescent images using the same | |
US20200367818A1 (en) | Devices, systems, and methods for tumor visualization and removal | |
JP6057921B2 (en) | Living body observation device | |
US8917319B2 (en) | Image processing apparatus and endoscope system | |
CN102083362B (en) | Locating and analyzing perforator flaps for plastic and reconstructive surgery | |
US20160278678A1 (en) | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance | |
US11436726B2 (en) | Medical image processing system | |
US20130006109A1 (en) | Endoscope apparatus | |
WO2015023990A1 (en) | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance | |
EP2223646A1 (en) | Biological observation apparatus and endoscopic apparatus | |
JP2019141578A (en) | Image processing method and apparatus using elastic mapping of vascular plexus structures | |
JP6785990B2 (en) | Medical image processing equipment and endoscopic equipment | |
US20140085448A1 (en) | Image processing apparatus | |
US20230237659A1 (en) | Image processing apparatus, endoscope system, operation method of image processing apparatus, and non-transitory computer readable medium | |
US20230039047A1 (en) | Image processing apparatus, image processing method, navigation method and endoscope system | |
WO2018055061A1 (en) | Hyperspectral tissue imaging | |
CN116269160A (en) | Endoscope system, medical catheter, image processing method, and computer storage medium | |
RU2596869C1 (en) | Device for fluorescent diagnosis and monitoring of photodynamic therapy | |
KR20150026325A (en) | Image acquisition and projection apparatus which enable simultaneous implementation of visible optical image and invisible fluorescence image | |
US10537225B2 (en) | Marking method and resecting method | |
CN114041737B (en) | Imaging device applied to endoscope | |
KR102372603B1 (en) | Medical system providing functional image | |
US20220183544A1 (en) | Medical Instrumentation Utilizing Narrowband Imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17771754 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17771754 Country of ref document: EP Kind code of ref document: A1 |