WO1998035262A1 - Infrared spectroscopy for medical imaging - Google Patents
Infrared spectroscopy for medical imaging Download PDFInfo
- Publication number
- WO1998035262A1 WO1998035262A1 PCT/CA1998/000092 CA9800092W WO9835262A1 WO 1998035262 A1 WO1998035262 A1 WO 1998035262A1 CA 9800092 W CA9800092 W CA 9800092W WO 9835262 A1 WO9835262 A1 WO 9835262A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- infrared
- channel
- spectral
- imaging module
- channels
- Prior art date
Links
- 238000004566 IR spectroscopy Methods 0.000 title description 2
- 238000002059 diagnostic imaging Methods 0.000 title description 2
- 238000000701 chemical imaging Methods 0.000 claims abstract description 24
- 230000002380 cytological effect Effects 0.000 claims abstract description 19
- 238000012360 testing method Methods 0.000 claims abstract description 17
- 238000012634 optical imaging Methods 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 12
- 230000003595 spectral effect Effects 0.000 claims description 21
- 238000000034 method Methods 0.000 claims description 20
- 230000003287 optical effect Effects 0.000 claims description 12
- 238000001429 visible spectrum Methods 0.000 claims description 4
- 238000002329 infrared spectrum Methods 0.000 claims description 3
- 230000011218 segmentation Effects 0.000 abstract description 18
- 210000004027 cell Anatomy 0.000 description 19
- 239000000463 material Substances 0.000 description 11
- 210000001519 tissue Anatomy 0.000 description 11
- 238000010521 absorption reaction Methods 0.000 description 10
- 238000004458 analytical method Methods 0.000 description 9
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000003491 array Methods 0.000 description 6
- 229910052739 hydrogen Inorganic materials 0.000 description 6
- 239000001257 hydrogen Substances 0.000 description 6
- 238000005286 illumination Methods 0.000 description 6
- 230000003902 lesion Effects 0.000 description 6
- 238000000605 extraction Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 5
- 238000012216 screening Methods 0.000 description 5
- 210000002919 epithelial cell Anatomy 0.000 description 4
- 238000010191 image analysis Methods 0.000 description 4
- 238000009595 pap smear Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000004497 NIR spectroscopy Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 239000011824 nuclear material Substances 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 206010008342 Cervix carcinoma Diseases 0.000 description 2
- 208000006105 Uterine Cervical Neoplasms Diseases 0.000 description 2
- 125000003368 amide group Chemical group 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- CREMABGTGYGIQB-UHFFFAOYSA-N carbon carbon Chemical compound C.C CREMABGTGYGIQB-UHFFFAOYSA-N 0.000 description 2
- 239000011203 carbon fibre reinforced carbon Substances 0.000 description 2
- 201000010881 cervical cancer Diseases 0.000 description 2
- 210000003679 cervix uteri Anatomy 0.000 description 2
- 210000000805 cytoplasm Anatomy 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000003211 malignant effect Effects 0.000 description 2
- 125000000325 methylidene group Chemical group [H]C([H])=* 0.000 description 2
- 102000039446 nucleic acids Human genes 0.000 description 2
- 108020004707 nucleic acids Proteins 0.000 description 2
- 150000007523 nucleic acids Chemical class 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 229910014033 C-OH Inorganic materials 0.000 description 1
- 229910014570 C—OH Inorganic materials 0.000 description 1
- 229920002527 Glycogen Polymers 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 229910019142 PO4 Inorganic materials 0.000 description 1
- 238000000862 absorption spectrum Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 210000000481 breast Anatomy 0.000 description 1
- 239000013590 bulk material Substances 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 150000001720 carbohydrates Chemical class 0.000 description 1
- 235000014633 carbohydrates Nutrition 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 229940096919 glycogen Drugs 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 150000002500 ions Chemical class 0.000 description 1
- 150000002632 lipids Chemical class 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 125000002496 methyl group Chemical group [H]C([H])([H])* 0.000 description 1
- 238000001000 micrograph Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 150000002894 organic compounds Chemical class 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- NBIIXXVUZAFLBC-UHFFFAOYSA-K phosphate Chemical compound [O-]P([O-])([O-])=O NBIIXXVUZAFLBC-UHFFFAOYSA-K 0.000 description 1
- 239000010452 phosphate Substances 0.000 description 1
- 150000004713 phosphodiesters Chemical group 0.000 description 1
- 230000026731 phosphorylation Effects 0.000 description 1
- 238000006366 phosphorylation reaction Methods 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 239000002243 precursor Substances 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012306 spectroscopic technique Methods 0.000 description 1
- 238000004611 spectroscopical analysis Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 239000013077 target material Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/1006—Beam splitting or combining systems for splitting or combining different wavelengths
- G02B27/1013—Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/141—Beam splitting or combining systems operating by reflection only using dichroic mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/144—Beam splitting or combining systems operating by reflection only using partially transparent surfaces without spectral selectivity
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/145—Beam splitting or combining systems operating by reflection only having sequential partially reflecting surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/693—Acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/30—Writer recognition; Reading and verifying signatures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
Definitions
- the present invention relates to Near Infrared (NIR) spectroscopy and more particularly to a multi -channel spectral imaging module utilizing NIR for discriminating between normal and pre-cancerous cells prepared in the form of cells or cell groupings on a microscope slide.
- NIR Near Infrared
- Pap i.e. Papanicolaou
- the Pap test is a screening test for evidence of pre- cancerous lesions in exfoliated cervical cells.
- the Pap test involves a tedious, manual examination of tens of thousands of cervical epithelial cells, and as a result is costly to apply and is subject to human error. Nevertheless, the Pap test has an enviable record of reducing cervical cancer mortality in the countries where it is applied. Thus, an automated alternative has been eagerly sought .
- image analysis typically comprises a series of four steps.
- the third step is known as feature extraction. Each of the segmented regions or objects in the image is subjected to a range of mathematical measures that seek to encapsulate the visual appearance in numerical form.
- the fourth step known as classification involves using the numerical features to arrive at some type of conclusion about the object's identity.
- NIR spectroscopy is an established technique for the extraction of quantitative measures in a wide variety of materials. Recently, NIR spectroscopy has been applied to human tissue samples in order to discriminate between cancerous or pre-cancerous tissue and normal tissue.
- NIR-based cancer screening protocols including a screening protocol for the early detection of pre-cancerous lesions of the uterine cervix and carcinomatous breast tissue.
- the present invention provides a multi-channel spectral imaging module utilizing NIR spectroscopic techniques to produce a rapid and effective discrimination between normal and pre- cancerous cells prepared in the form cells or cell groupings on a microscope slide or similar sub-structure .
- the subject invention is intended to function as part of an automated system comprising components described in co- pending patent applications entitled Automated Scanning of Microscope Slides International Patent Application No . CA96/00475 filed July 18, 1996, Pipeline Processor for Medical and Biological Applications U.S. Patent Application No. 08/683,440 filed July 18, 1996, Multi-Spectral Segmentation International Patent Application No. CA96/00477 filed July 18, 1996, Neural- Network Assisted Multi-Spectral Segmentation International Patent Application No. CA96/00619 filed September 18, 1996, Automated Focus System International Patent Application No. CA96/00476 filed July 18, 1996, Window Texture Extraction International Patent Application No.
- the present invention comprises a multichannel spectral imaging module for an automated testing system for cytological applications.
- one or two of the channels in the imaging system comprise NIR (Near Infrared) channels.
- the NIR channels augment the visible spectrum images produced by a multi -spectral camera system and provide new and useful channels of information.
- the NIR channels are used to improve segmentation performance, to create a new set of features for classification, or as discrimination measures independent of the visible light channels.
- a pair of differential NIR channels are utilized to provide a high-speed and real-time scan of cellular material to quickly discriminate between normal and abnormal cells or tissue and may be extended to other important diagnostic properties of the cells.
- the NIR channels are effective for producing rapid and effective discrimination between normal and pre-cancerous cells prepared in the form cells or cell groupings on a microscope slide or similar sub-structure .
- the present invention provides a multi-channel spectral imaging module for an automated testing system for cytological application, said multi-channel spectral imaging module comprising: (a) a light source module for illuminating a cytological specimen, said light source including a visible light source and an infrared light source and a control input for actuating said visible and infrared light sources; (b) an optical imaging module for receiving illuminated images of said cytological specimen and including a lens system for focussing said illuminated images; (c) a prism module for receiving said illuminated images from said optical imaging module, said prism module including three prism elements for producing three respective image channels in the visible spectrum and a fourth prism element for producing an image channel in the infrared spectrum, and said prism module further including a digitizer for each of said channels for converting the image into an output signal.
- the present invention provides a method for generating multi-spectral image date for a cytological specimen, said method comprising the steps of: (a) exposing said cytological specimen to a burst of broad-band light; (b) separating said burst of broad-band light images into a plurality of spectral bands; (c) simultaneously capturing an image for each of said spectral bands and generating electrical signals corresponding to each of said captured spectral images; (d) converting the electrical signals corresponding to said captured spectral images into a data form suitable for further processing by an automated testing system; (e) exposing said cytological specimen to a burst of light in an infrared spectral band; (f) simultaneously capturing an image in said infrared spectral band and an generating electrical signal corresponding to said captured infrared spectral image; (g) converting the electrical signal corresponding to said captured infrared spectral image into a data form suitable for further processing by an automated testing system.
- Fig. 1 shows in diagrammatic form a multi-channel spectral imaging module according to the present invention
- Fig. 2 shows the prism assembly of Fig. 1 in more detail ;
- Fig . 3 shows the arrangement of CCD arrays for the imaging module of Fig. 1;
- Fig. 4 shows the illumination mixer of Fig. 1 in more detail ;
- Fig. 5 depicts linear discriminant analysis utilizing outputs from the multi -channel spectral imaging module according to the present invention
- Fig. 6 shows threshold identification based on outputs from the multi-channel spectral imaging module according to the present invention
- Fig. 7 shows composite feature measurement based on the outputs from the multi -channel spectral imaging module according to the present invention
- Fig. 8 an embodiment of the multi -channel spectral imaging module according to the present invention in which the NIR channels are operated in a differential mode
- Fig. 9 shows the known Infrared spectra of cervical tissues in the asymmetric phosphate stretching region.
- the automated system for cytological testing as described in the co-pending applications by the common owner of the present invention as outlined above utilizes three narrowly defined optical bands in the visible . range to characterize the cells under examination.
- the three bands are chosen so as to maximize the optical contrast between the nucleus and cytoplasm of the cell and the background material.
- the information obtained from three bands is used to generate a segmentation map of the image on a pixel -by-pixel basis.
- the segmentation map is subjected to further processing to improve the integrity and quality of the captured information.
- a feature extraction operation is performed.
- Feature extraction involves subjecting each of the segmented regions or objects in the image to a range of mathematical measures that seek to encapsulate the visual appearance in numerical form.
- classification involves using the numerical features to arrive at some type of conclusion about the object's identity. It will be appreciated that the utilization of three channels of information provides an information foundation which ensures the quality and reliability of the captured information during the various processing steps performed by the automated system.
- the present invention comprises a multi-channel spectral imaging module for the multi- spectral camera system described in the co-pending patent application entitled Multi-Spectral Imaging System and Method for Cytology International Patent Application No. CA97/00318 filed May 9, 1997 by the common owner of the subject invention.
- the multi -spectral camera as described in the co-pending application comprises an electro-optical system that creates digitized, spectrally-separated images for computer acquisition, display and analysis.
- the system operates with high resolution and at high speed, simultaneously producing three, spectrally-resolved, spatially coincident micro-graphic images for capture and storage by computer.
- the simultaneous acquisition of spectrally-resolved images in the visible light region permits the high-speed application of polychromatic stain protocols in automated analysis procedures.
- the simultaneous capture of the images also ensures that image registration is maintained for image processing operations which as will be appreciated is a problem in systems which serially capture images.
- the multi -channel spectral imaging module comprises one or two NIR (Near Infrared) channels.
- the NIR channels are utilized to augment the visible spectrum images produced as per the common applicant's multi- spectral camera system to provide a new and useful channel of information.
- the near- infrared absorption properties of the cervical epithelial cells may be integrated into this technique to yield a new channel of information.
- normal epithelial nuclei reach an absorption plateau in the range of 1215 cm -1 while malignant epithelial nuclei near an absorption peak according to known studies (ex., PTT Wong,et al . Applied Spectroscopy 48(7) 1058 (1993)).
- the ratio of absorbencies, measured on bulk material, is approximately 1.8 in a 5 cm “1 range centred at this frequency. Nearby, as shown in Fig. 9, the absorbencies of the normal and malignant materials converge at 1240 cm "1 , providing a suitable channel for response normalization. These narrow NIR bands are ideally exploited for discriminative purposes in the context of present invention.
- the NIR channels are used to improve segmentation performance, to create a new set of features for classification, or as discrimination measures on their own.
- restricting the use of the NIR channels to regions of the samples that contain nuclear material also improves the effective signal-to- noise ratio of the measurement over bulk tissue measurements thereby improving the discrimination capability of the system.
- a pair of differential NIR channels i.e. the 1215 cm "1 band providing an interrogation channel and the 1240 cm " 1 band providing a reference channel
- this embodiment may be extended to other important diagnostic properties of the cells.
- the multi-spectral imaging module 10 comprises an optical imaging module 12, a prism module 14, a series of CCD (Charge Coupled Device) array sensors 16, and an illumination mixer 18.
- CCD Charge Coupled Device
- the principal function of the optical imaging module 12 is gathering a microscope image of a specimen S (e.g. a cytological specimen S placed on a suitable carrier such as a slide C) and enlarging the microscopic image with minimal monochromatic or chromatic aberrations.
- the optical imaging module 12 comprises two lens systems: an objective lens 22 and a telan lens 24.
- the objective lens 22 is designed for infinite-conjugate operation meaning that the object is placed in the focal plane of the objective lens 22 and a real image is produced at an infinite distance away on the optical axis 23.
- the objective lens 22 alone carries all of the monochromatic and chromatic error corrections and produces a flat-image field over the area of interest.
- the telan lens 24 is used to gather this infinite-conjugate image from the objective lens 22 and reconstruct a real magnified image MI a short distance from the optical imaging module 12.
- the magnified image MI is optically coupled to the prism module 14.
- the magnifying power of optical imaging module 12 is expressed as the negative of the ratio of the two effective focal lengths of the objective 22 and telan 24 lenses, as follows:
- magnification is independent of tube length unlike the older 160 mm DIN standard for microscopes as will be familiar to those skilled in the art .
- the prism module 14 is optically coupled to the output of the optical imaging module 12 to receive the magnified image MI.
- the prism module 14 comprises an optical prism assembly 20 which is used to create five-spectrally resolved channels 17a to 17e.
- the channels 17 for the imaging system comprise three visible-light channels 17a, 17b and 17c, and single NIR channel 17d or a differential NIR channel pair 17d and 17e.
- the visible- light channels 17a, 17b, 17c comprise narrow band channels having centre wavelengths 530 nm, 577 nm and 639 nm as described in co- pending International Patent Application No . CA97/00318 filed May 9, 1997.
- the prism assembly 20 comprises a set of five interlocking glass prisms 21, with each prism 21a, 21b, 21c, 21d, 21e, 21f corresponding to a respective channel 17a, 17b, 17c, 17d, 17e and 17f.
- Each glass prism 21 includes a dichroic, multi-layer interference band-pass optical filter 23 on one of its surfaces.
- the prism assembly 20 receives the magnified image MI projected from the telan lens 24 in the optical imaging module 12 and creates a set of five equivalent images that have been filtered to reject all but the five bands of the respective channels 17.
- the .prism assembly 20 re-directs each one of the five images to the associated CCD array sensor 16a along five separate paths (i.e. channels 17) to accomplish a low-loss spatial separation.
- the prism assembly 20 provides simultaneous spectral and spatial separation of the magnified image MI from the optical module 12 with high through-put, low optical energy loss, minimal distortion and minimal mis-registration difficulties .
- the CCD sensor arrays 16 are coupled to the prism module 14 and arranged to collect and digitize the spectrally- resolved images projected from the associated prism element 21 for each channel 17.
- the CCD sensor arrays 16 comprise charge coupled devices and are shown individually as 16a, 16b, 16c, 16d, and 16e in Fig. 1.
- a sensor array 16 is provided for each channel 17.
- the CCD sensor arrays 16 operate in parallel to simultaneously digitize the respective images from the five channels 17a to 17e.
- the digitized images are then transferred over a set of fibre optical links (not shown) to the subsequent stages of the automated testing system (not shown) for further processing as described in the co-pending patent applications outlined.
- each CCD sensor array 16 is mounted on a respective micro-positioning device 19, shown individually as 19a, 19b, 19c, 19d and 19e.
- the micro-positioning devices 19 are used to align the CCD sensor arrays 16 and bring the images form each respective channel 17 into registration with the associated CCD 16. Once the initial calibration is completed and the CCD arrays 16 are registered with the image paths, it is usually not necessary to adjust the alignment again.
- an infrared light source 26 is provided in addition to a visible light source 28.
- the visible light source 28 comprises a stroboscopic flash lamp which provides the light source for the three visible optical channels 17a to 17c.
- the infrared light source 26 may comprise a suitable commercially available infrared lamp or a tunable laser system.
- the illumination mixer 18 combines the output from the visible light source 28 with the output from the infrared radiation source 26. As shown in Fig. 4, the illumination mixer 18 comprises a beam-splitter 30 and a shutter 32.
- the beam-splitter 30 is arranged to mix the outputs from the two radiation sources 26 and 28 in order to provide optimal illumination of the specimen S.
- the shutter 32 is used to selectively couple the output from the infrared light source 26 to the optical imaging module 12. The actuation of the shutter 32 is synchronized with the strobing of the lamp 28.
- the information generated from the NIR channel (s) 17d and 17e is exploited in three ways: (1) to improve segmentation performance; (2) to provide a new set of features for classification; or (3) to provide an independent discrimination measure .
- the multi-spectral segmentation procedure comprises a hardware-encoded analysis routine embedded in the FPGA logic of a special-purpose computer.
- several processing steps are applied to the images.
- images from each of the three visible light channels i.e. 17a, 17b, 17c
- the absorption maps show the properties of each of imaged pixels independently of material thickness.
- a new fourth absorption map and a new fifth absorption map are produced to show the material properties associated with the NIR formed images of the specimen S.
- the NIR channels 17d and 17e add two new axes of information to a multidimensional space representing the material properties of the specimen S. If enough examples of nuclei and cytoplasm are studied, this multi-dimensional space will yield discrimination information expressed in terms of the occupation of different regions of this multi-dimensional space. Thus, for every new pixel that enters the system for analysis, a point in this space can be defined and, based on the region that it occupies, its identity may be determined. This is illustrated by Fig. 5 which depicts the application of linear discriminant analysis techniques to a feature space 100 having three dimensions.
- the feature space 100 comprises upper 101 and lower 102 portions which are separated by a discrimination boundary 103.
- the upper region 101 is associated with class I while the lower portion 102 is associated with class II.
- a segmentation technique that employs a hardware-embedded linear discriminant analysis reduces the degree of error typically associated with segmentation decisions by correlating a series of observations concerning the distribution pattern of material absorption.
- this technique opens the door to a multiplicity of similar types of discriminant analysis.
- this type of algorithm can undergo a continual improvement by the adjustment of a table of coefficients that describe the decision hyper- surface without the necessity of altering the system architecture .
- the two NIR channels 17d and 17e are used to provide new sets of features for the specimen S.
- the mathematical transformations applied to the outputs from the three visible channels 17a to 17c may be applied with equal utility to the outputs from the NIR channels 17d and 17e.
- morphological, textural , densitometric, and contextual features may be extracted from the NIR channel (s) 17d and 17e.
- a number of correlating features may be generated through comparisons with the three visible light channels 17a, 17b or 17c and the NIR channels 17d, 17e.
- the outputs from the NIR channels 17d and 17e are also utilized to provide an independent discrimination measure as depicted in Fig. 6. For instance after absorption baselines are calculated, the automated testing system uses a threshold 111 to determine whether any of the resultant segmented objects generated from in specimen S is abnormal 112, whereas normal objects take the distribution denoted by 113.
- the discrimination measures from the NIR channels 17d, 17e can form the basis of an automated decision process or may be included in a computer-aided review of the sample for full diagnosis by a cytotechnologist . Another application of information generated from the NIR channels 17d, 17e is as part of a wide set of statistical measures for the specimen S as a whole.
- a normal NIR feature representation is indicated by the distribution at 121
- an abnormal NIR feature representation is indicated by the distribution at 122.
- the two NIR channels 17d and 17e are operated in a differential mode to provide a real-time discrimination between normal and abnormal cellular material in the specimen S (or between any two biological states that exhibit differences in this or any other pair of NIR bands) .
- the first NIR channel 17d provides an interrogation signal channel 50 and the second NIR channel 17e provides a reference signal channel 51.
- the interrogation 50 and reference 51 channels form the inputs for a differential amplifier 52.
- the differential ampli ier 52 produces an output 53 based on the difference between the interrogation 50 and the reference 51 signals.
- the output 53 from the differential amplifier 52 provides one input for a division amplifier 54.
- the other input of the division amplifier 54 is coupled to the reference channel 51.
- the division amplifier 54 produces a pixel signal denoted by 60 at the output 55.
- the reference channel 51 In operation, local variations in the thickness of the specimen S and/or variations in the illumination intensity are compensated- for by the reference channel 51.
- the interrogation signal 50 is subtracted from the reference signal 51 and the resulting signal 53 is normalized with the reference signal 51 by the division amplifier 54.
- results of the high-speed scan can then be subjected to a more detailed analysis by a computing system, and images of the suspicious material could be displayed to a human review on a monitor or the regions found could be flagged for further study by conventional means.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Multimedia (AREA)
- Biomedical Technology (AREA)
- Signal Processing (AREA)
- Molecular Biology (AREA)
- Quality & Reliability (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Dispersion Chemistry (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU59773/98A AU5977398A (en) | 1997-02-06 | 1998-02-06 | Infrared spectroscopy for medical imaging |
CA002279945A CA2279945A1 (en) | 1997-02-06 | 1998-02-06 | Infrared spectroscopy for medical imaging |
US09/368,521 US6181414B1 (en) | 1998-02-06 | 1999-08-05 | Infrared spectroscopy for medical imaging |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US3745497P | 1997-02-06 | 1997-02-06 | |
US60/037,454 | 1997-02-06 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/368,521 Continuation US6181414B1 (en) | 1998-02-06 | 1999-08-05 | Infrared spectroscopy for medical imaging |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1998035262A1 true WO1998035262A1 (en) | 1998-08-13 |
Family
ID=21894450
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CA1998/000092 WO1998035262A1 (en) | 1997-02-06 | 1998-02-06 | Infrared spectroscopy for medical imaging |
Country Status (3)
Country | Link |
---|---|
AU (1) | AU5977398A (en) |
CA (1) | CA2279945A1 (en) |
WO (1) | WO1998035262A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2005088385A1 (en) * | 2004-03-10 | 2005-09-22 | Raytheon Company | Dual-band sensor system utilizing a wavelength-selective beamsplitter |
US7019296B2 (en) | 2000-10-13 | 2006-03-28 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7046359B2 (en) | 2004-06-30 | 2006-05-16 | Chemimage Corporation | System and method for dynamic chemical imaging |
WO2007064431A1 (en) * | 2005-11-30 | 2007-06-07 | Corning Incorporated | Light separator |
US7580126B2 (en) | 2004-06-30 | 2009-08-25 | Chemimage Corp. | Method and apparatus for producing a streaming Raman image of nucleation, aggregation, and chemical interaction |
CN109813716A (en) * | 2017-11-22 | 2019-05-28 | 北京汉能光伏投资有限公司 | Solar components fault detection system and method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3806257A (en) * | 1973-05-04 | 1974-04-23 | Corning Glass Works | Operator viewing optics for a slide classification system |
EP0174778A1 (en) * | 1984-08-30 | 1986-03-19 | Rank Cintel Limited | Apparatus for individually processing optical images of different Wavelengths |
DE19623821A1 (en) * | 1995-06-14 | 1996-12-19 | Asahi Seimitsu Kk | Colour splitter appts. |
-
1998
- 1998-02-06 WO PCT/CA1998/000092 patent/WO1998035262A1/en active Search and Examination
- 1998-02-06 CA CA002279945A patent/CA2279945A1/en not_active Abandoned
- 1998-02-06 AU AU59773/98A patent/AU5977398A/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3806257A (en) * | 1973-05-04 | 1974-04-23 | Corning Glass Works | Operator viewing optics for a slide classification system |
EP0174778A1 (en) * | 1984-08-30 | 1986-03-19 | Rank Cintel Limited | Apparatus for individually processing optical images of different Wavelengths |
DE19623821A1 (en) * | 1995-06-14 | 1996-12-19 | Asahi Seimitsu Kk | Colour splitter appts. |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7436500B2 (en) | 2000-10-13 | 2008-10-14 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7123360B2 (en) | 2000-10-13 | 2006-10-17 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7317516B2 (en) | 2000-10-13 | 2008-01-08 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7061606B2 (en) | 2000-10-13 | 2006-06-13 | Chem Image Corporation | Near infrared chemical imaging microscope |
US7268861B2 (en) | 2000-10-13 | 2007-09-11 | Chemimage Corporation | Near infrared chemical imaging microscope |
USRE39977E1 (en) | 2000-10-13 | 2008-01-01 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7019296B2 (en) | 2000-10-13 | 2006-03-28 | Chemimage Corporation | Near infrared chemical imaging microscope |
US7268862B2 (en) | 2000-10-13 | 2007-09-11 | Chem Image Corporation | Near infrared chemical imaging microscope |
US7298484B2 (en) | 2004-03-10 | 2007-11-20 | Raytheon Company | Dual-band sensor system utilizing a wavelength-selective beamsplitter |
WO2005088385A1 (en) * | 2004-03-10 | 2005-09-22 | Raytheon Company | Dual-band sensor system utilizing a wavelength-selective beamsplitter |
US7317526B2 (en) | 2004-06-30 | 2008-01-08 | Chem Image Corporation | System and method for dynamic chemical imaging |
US7046359B2 (en) | 2004-06-30 | 2006-05-16 | Chemimage Corporation | System and method for dynamic chemical imaging |
US7580126B2 (en) | 2004-06-30 | 2009-08-25 | Chemimage Corp. | Method and apparatus for producing a streaming Raman image of nucleation, aggregation, and chemical interaction |
WO2007064431A1 (en) * | 2005-11-30 | 2007-06-07 | Corning Incorporated | Light separator |
CN109813716A (en) * | 2017-11-22 | 2019-05-28 | 北京汉能光伏投资有限公司 | Solar components fault detection system and method |
CN109813716B (en) * | 2017-11-22 | 2024-03-08 | 东君新能源有限公司 | Solar module fault detection system and method |
Also Published As
Publication number | Publication date |
---|---|
CA2279945A1 (en) | 1998-08-13 |
AU5977398A (en) | 1998-08-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6181414B1 (en) | Infrared spectroscopy for medical imaging | |
US6274871B1 (en) | Method and system for performing infrared study on a biological sample | |
US6690817B1 (en) | Spectral bio-imaging data for cell classification using internal reference | |
US6750964B2 (en) | Spectral imaging methods and systems | |
CA2803933C (en) | Method for analyzing biological specimens by spectral imaging | |
AU2012272604B2 (en) | Method for analyzing biological specimens by spectral imaging | |
US8816279B2 (en) | Tunable laser-based infrared imaging system and method of use thereof | |
EP3009832A1 (en) | A cytological system and method for analyzing a biological sample by raman spectroscopy | |
US7587078B2 (en) | Automated image analysis | |
US20120083678A1 (en) | System and method for raman chemical analysis of lung cancer with digital staining | |
JP2002521685A (en) | Spectral topography of mammalian material | |
EP3377865A1 (en) | Raman-based immunoassay systems and methods | |
CN1553165A (en) | Automatic multispectral cell smear and analyzing instrument and method used for cervical cell analysis | |
Ortega et al. | Hyperspectral database of pathological in-vitro human brain samples to detect carcinogenic tissues | |
Bird et al. | Cytology by infrared micro-spectroscopy: Automatic distinction of cell types in urinary cytology | |
WO1998035262A1 (en) | Infrared spectroscopy for medical imaging | |
Maggioni et al. | Hyperspectral microscopic analysis of normal, benign and carcinoma microarray tissue sections | |
WO2000010451A1 (en) | System and method for spectral topography of mammalian matter using white light illumination | |
CA2858931C (en) | Method of analyzing a biological sample, and device implementing this method | |
WO2002006880A2 (en) | Plastic substrates slide apparatus for infrared microscopy analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
ENP | Entry into the national phase |
Ref document number: 2279945 Country of ref document: CA Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 09368521 Country of ref document: US |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
NENP | Non-entry into the national phase |
Ref document number: 1998533464 Country of ref document: JP |
|
122 | Ep: pct application non-entry in european phase | ||
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) |