[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

US8965098B2 - Cell-image analyzing apparatus - Google Patents

Cell-image analyzing apparatus Download PDF

Info

Publication number
US8965098B2
US8965098B2 US12/724,753 US72475310A US8965098B2 US 8965098 B2 US8965098 B2 US 8965098B2 US 72475310 A US72475310 A US 72475310A US 8965098 B2 US8965098 B2 US 8965098B2
Authority
US
United States
Prior art keywords
cell
cells
image
contour
vessel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/724,753
Other versions
US20100232674A1 (en
Inventor
Genta Amakawa
Kosuke Takagi
Yuichiro Matsuo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Evident Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AMAKAWA, GENTA, MATSUO, YUICHIRO, TAKAGI, KOSUKE
Publication of US20100232674A1 publication Critical patent/US20100232674A1/en
Application granted granted Critical
Publication of US8965098B2 publication Critical patent/US8965098B2/en
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION CHANGE OF ADDRESS Assignors: OLYMPUS CORPORATION
Assigned to EVIDENT CORPORATION reassignment EVIDENT CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OLYMPUS CORPORATION
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/693—Acquisition
    • G06K9/00134—

Definitions

  • the present invention relates to a cell-image analyzing apparatus for imaging cells and analyzing characteristic quantities of the cells from captured images.
  • Fluorescent substances and luminescent substances are easy to handle and thus are very effective means for delimiting cell themselves, particular proteins etc. On the other hand, however, fluorescent substances and luminescent substances sometimes behave as toxicants or stimulants for cells, specifically for living cells, to be a cause of precluding an accurate analysis result.
  • This microscope of JP Kokai No. 2004-354650 is provided with a light source, an illumination optical system for introducing light from the light source to an object for observation, an aperture arranged at the pupil position of the illumination optical system, and an observation optical system for observing, at a position displaced from the in-focus position, an image of the object illuminated by the light passing through the aperture.
  • a cell-image analyzing apparatus includes: a cell imaging system having an imaging optical system and an image sensor, for imaging cells that exist in a vessel; and a cell-image analyzer for automatically analyzing a predetermined characteristic quantity on the cells using a cell image captured via the cell imaging system, upon delimiting cell regions; wherein the cell-image analyzing apparatus has a cell-contour emphasizing system for automatically emphasizing contour portions of images of the cells that exist in the vessel, which is arranged at a shot position of the cell imaging system.
  • the cell-contour emphasizing system is constructed of a cell-contour emphasizing position focusing system for automatically adjusting a focus of the imaging optical system to a position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
  • the cell-contour emphasizing system is constructed of a cell-contour emphasizing illumination system for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
  • the cell-contour emphasizing system includes: a cell-contour emphasizing position focusing system for automatically adjusting a focus of the imaging optical system to a position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized; and a cell-contour emphasizing illumination system for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
  • the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to an intracellular domain of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, and then is shifted along an optical axis of the imaging optical system by a preset amount, to a position where the intracellular domain of the cells is blurred and the contour portions of the cells are distinctly seen in the cell image.
  • the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to a bottom surface of the vessel, which is arranged at the shot position of the cell imaging system, and then is shifted along an optical axis of the imaging optical system by a preset amount, which is determined in accordance with a thickness of the cells that exist in the vessel.
  • the cell-contour emphasizing illumination system is configured as a tilted illumination system.
  • the present invention provides a cell-image analyzing apparatus that makes it possible to automatically recognize individual cells accurately when used for cell images captured in an unstained, bright-field condition or for cell images captured from cells as living, to thereby greatly save fatigue of an analyst and time for processing in a cell analysis procedure.
  • the capacity of accurate automatic recognition of individual cells may lead to discoveries of something new, for it allows us to carry out statistical data analysis, for which visual observation is insufficient in capacity.
  • cells can be steadily recognized, elucidation of diseases and establishment of therapies would be accelerated through combining various cell analyses and carrying out new cell analyses one after another.
  • FIG. 1 is a block diagram that shows the schematic configuration of a cell-image analyzing apparatus according to the present invention.
  • FIG. 2 is an explanatory diagram that shows the schematic configuration of the entire cell-image analyzing apparatus according to one embodiment mode of the present invention.
  • FIG. 3 is an explanatory diagram that schematically shows the entire procedure of cell analysis.
  • FIG. 4 is an explanatory diagram that shows a state where the contour portion of an image of a cell is emphasized.
  • FIGS. 5A-5B are explanatory diagrams that show one example of the method for emphasizing the contour portion of an image of a cell by the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode, showing: a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to an intracellular organelle; and a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to the cell contour; respectively.
  • FIG. 6 is a flowchart that shows a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode.
  • FIG. 7 is a flowchart that shows one example of an automatic setting procedure for an offset value, which is set for shifting the focus of the imaging optical system in the procedure shown in FIG. 6 from the bottom surface of the vessel to a preset position at which the contour portions of the images of the cells are emphasized.
  • FIGS. 8A-8C are photographs that show a relation between a focusing position of the imaging optical system in reference to cells and a state and result of recognition of cell contours by the cell-image analyzer, showing: a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on the contours of the cells; a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on an intracellular organelle; and a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on an intracellular organelle; respectively.
  • FIGS. 9A-9B are diagrams that schematically show the relation between a focusing position of the imaging optical system in reference to cells and recognition of cell contours by the cell-image analyzer, showing: a state where the focus of the imaging optical system is positioned on an intracellular organelle (left-side drawing) and recognitions of cell contours by the cell-image analyzer in this state (right-side drawings); and a state where the focus of the imaging optical system is positioned on a cell-contour emphasizing point and a recognition of a cell contour by the cell-image analyzer in this state (right-side drawing); respectively.
  • FIGS. 10A-10B are explanatory diagrams that show the state where the focus of the imaging optical system is adjusted to a position different from positions of intracellular organelles, in another method for capturing a cell image with a contour portion of an image of the cell being emphasized via the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode, showing: a state in which the focus of the imaging optical system is adjusted to a position where images of intracellular organelles are blurred; and a state in which the focus of the imaging optical system is adjusted to a position where an image of the entire cell is blurred; respectively.
  • FIG. 11 is an explanatory diagram that schematically shows the normal illumination and the tilted illumination for a cell.
  • FIGS. 12A-12B are explanatory diagrams that schematically show how the shadow of the contour portion of a cell is cast when the illumination angle is changed in a tilted illumination via the cell-contour emphasizing illumination system in the cell-image analyzing apparatus of this embodiment mode, showing: an illumination condition where the tilt angle is small and a shadow of the cell contour cast in this condition; and an illumination condition where the tilt angle is large and a shadow of the cell contour cast in this condition; respectively.
  • FIGS. 13A-13B are explanatory diagrams that show examples of misrecognition of cell regions, which has conventionally been caused in a cell-image analysis using an image analyzing apparatus, showing: a case where a single cell is recognized as plural cells; and a case where plural cells are recognized as a single cell; respectively.
  • FIGS. 14A-14B are explanatory diagrams that show the procedure of cytoplasm recognition by a cell-analyzing apparatus using a transmitted image of unstained cells, showing: a step of extracting possible borders as “lines”; and a step of determining contours of individual cells from the extracted possible borders of the cells; respectively.
  • FIG. 15 is an explanatory diagram that shows the first problem caused in recognition of cell regions in a case where cells are distinctly imaged in a transmitted image.
  • FIGS. 16A-16B are explanatory diagrams that show the second problem caused in recognition of cell regions in cases where cells are distinctly imaged in transmitted images, respectively.
  • FIG. 1 is a block diagram that shows the schematic configuration of a cell-image analyzing apparatus according to the present invention.
  • the cell-image analyzing apparatus according to the present invention has a cell imaging system 1 , a cell-image analyzer 2 , and a cell-contour emphasizing system 3 .
  • the cell imaging system 1 has an imaging optical system 1 a and an image sensor 1 b , to image cells existing in a vessel, which is not shown in FIG. 1 but is arranged at the shot position.
  • the cell-image analyzer 2 automatically analyzes a predetermined characteristic quantity on the cells using a cell image captured via the cell imaging system 1 , upon delimiting cell regions.
  • the cell-contour emphasizing system 3 automatically emphasizes contour portions of images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1 .
  • the cell-contour emphasizing system 3 preferably is constructed of a cell-contour emphasizing position focusing system 3 a for automatically adjusting a focus of the imaging optical system 1 a to a preset position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1 , are emphasized.
  • the cell-contour emphasizing system 3 may be constructed of a cell-contour emphasizing illumination system 3 b for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1 , are emphasized.
  • the cell-contour emphasizing system 3 is provided with the cell-contour emphasizing position focusing system 3 a and the cell-contour emphasizing illumination system 3 b.
  • the cell-contour emphasizing position focusing system 3 a is configured so that, in imaging cells via the cell imaging system 1 , the focus of the imaging optical system 1 a is displaced in the direction of the optical axis from a position of the intracellular domain (domain where organelles exist) to a preset position where the contours of the cells are emphasized.
  • the cell-contour emphasizing position focusing system 3 a is configured so that, for example, the focus of the imaging optical system 1 a is first adjusted to the intracellular domain of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1 , and then is shifted along the optical axis of the imaging optical system 1 a by a preset amount, to a position where the intracellular domain is blurred and the contour portions of the cells are distinctly seen in the cell image.
  • the cell-contour emphasizing position focusing system 3 a is configured so that, for example, the focus of the imaging optical system 1 a is first adjusted to the bottom surface of the vessel, which is arranged at the shot position of the cell imaging system 1 , and then is shifted along the optical axis of the imaging optical system 1 a by a preset amount, which is determined in accordance with a thickness of the cells that exist in the vessel.
  • the cell-contour emphasizing illumination system 3 b is configured as a tilted illumination system.
  • a cell-contour emphasizing system 3 for automatically emphasizing contour portions of images of cells 5 that exist in a vessel 4 , which is arranged at the shot position of the cell imaging system 1 , an image with distinct contours of the individual cells 5 can be obtained and thus, in an automatic analysis of the image captured via the cell imaging system 1 , cell contours can be determined and the individual cells are accurately recognizable.
  • the cell-image analyzing apparatus of the present invention makes it possible to automatically conduct the procedure from imaging through recognition of the cells without using visual observation via human eyes, to thereby greatly save fatigue of the analyst and the time for processing, increase the number of cells to be analyzed per unit time, and further, to conduct the cell analysis accurately.
  • FIG. 2 is an explanatory diagram that shows the schematic configuration of the entire cell-image analyzing apparatus according to one embodiment mode of the present invention.
  • the cell-image analyzing apparatus of this embodiment mode is configured so that the cell imaging system 1 shown in FIG. 1 has a microscope imaging optical system 1 a provided with an objective 1 a 1 and a tube lens 1 a 2 , and a solid-state image sensor 1 b such as a CCD or CMOS.
  • the objective 1 a 1 is configured to be movable in the direction of the optical axis for focusing by an electric control mechanism not shown.
  • the tube lens 1 a g forms an image of the cells 5 that exist in the vessel 4 on an image capture surface of the solid-state image sensor 1 b .
  • the cell imaging system 1 images the cells existing in the vessel 4 , which is arranged at the shot position.
  • the cell-image analyzer 2 is configured to have a central processor unit of a personal computer 12 and an image-analyzing software installed there, to automatically analyze a predetermined characteristic quantity on the cells 5 using an image of the cells 5 captured via the cell imaging system 1 , upon delimiting regions of the cells 5 .
  • the reference numeral 6 denotes an electric XY stage, which mounts the vessel 4 and operates upon receiving power supply and operation instruction from a controller 10 described later.
  • the reference numeral 8 denotes an illumination light source for illuminating the cells 5 .
  • the reference numeral 10 denotes a controller, which controls the electric XY stage 6 , the illumination light source 8 , and the objective 1 a 1 in accordance with instructions from the personal computer 12 .
  • the reference numeral 11 denotes a camera controller, which is connected with the solid-state image sensor 1 b and the personal computer 12 , to perform imaging control and transmission of captured image information to the personal computer 12 upon receiving predetermined instruction signals from the personal computer 12 .
  • the reference numeral 13 denotes a monitor connected with the personal computer 12 .
  • the cell-contour emphasizing system 3 shown in FIG. 1 includes a cell-contour emphasizing position focusing system 3 a and a cell-contour emphasizing illumination system 3 b.
  • the cell-contour emphasizing position focusing system 3 a includes an autofocusing mechanism not shown in FIG. 2 and an electric control mechanism not shown, which is connected with the controller 10 .
  • the cell-contour emphasizing position focusing system 3 a is configured to move the objective 1 a 1 in a direction of the optical axis so that, when a predetermined instruction signal is transmitted from the computer 12 to the controller 10 , the focus of the imaging optical system 1 a is automatically adjusted to the preset position where images of the contour portions of the cells 5 that exist in the vessel 4 , which is positioned at the shot position of the cell imaging system 1 , are emphasized.
  • the cell-contour emphasizing position focusing system 3 a first conducts an autofocusing process for adjusting the focus of the imaging optical system 1 a to an intracellular organelle of a cell 5 , and then conducts a process of shifting the focus of the imaging optical system 1 a in the direction of the optical axis by a preset offset amount so that images of the contour portions of the cells 5 are emphasized.
  • the cell-contour emphasizing illumination system 3 b is configured as a tilted illumination system 8 .
  • the tilted illumination system 8 irradiates the cells 5 with illumination light as obliquely tilted in reference to the optical axis of the imaging optical system 1 a so that the contour portions of the images of the cells 5 that exist in the vessel 4 , which is arranged at the shot position of the cell imaging system 1 , are emphasized.
  • the tilted illumination system 8 is configured to provide an illumination mode in which R, G, B components of illumination light are sequentially switched to one another via a control by the controller 10 .
  • FIG. 3 is an explanatory diagram that schematically shows the entire procedure of cell analysis.
  • a cell sample as an object of the analysis is prepared. Then, the cell sample is imaged upon segmented into plural view fields. Then, the individual captured images are analyzed so that plural cells appearing in each image are recognized upon divided into individual cell regions. Then, regarding the individual cells for which their regions are recognized, a predetermined statistical processing such as averaging of cell size (area) is conducted.
  • an analyst puts the cells 5 in the vessel 4 such as a multiwell plate, a slide glass etc., mounts the vessel 4 containing the cells 5 on the electric XY stage 6 , and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 via the controller 10 . Then, via the controller 10 and the camera controller 11 , the cell imaging system 1 performs imaging of the cells existing in the vessel 4 , which has been conveyed to the shot position, upon dividing the entire field into plural view fields.
  • an autofocusing process by the autofocusing mechanism to adjust the focus of the imaging optical system 1 a to an intracellular organelle, a process of shifting the focus of the imaging optical system 1 a for emphasizing images of contour portions of the cells 5 , and an imaging process under the respective R, G, B components of illumination light, are performed in this order.
  • the cell-image analyzer 2 Upon completion of the imaging procedure on the cells for every visual field, the cell-image analyzer 2 recognizes regions of individual cells in the image of the cells 5 , and then conducts a statistical procedure regarding the individual cells for which their cell regions are recognized, based on parameters that have been preliminarily set via analysts, such as total number of cells, average cell size (area), and total amount of fluorescence of individual cells.
  • the frequency of misrecognition of cell regions differs by morphology of cells that are the object of analysis.
  • cells such as cell nuclei having a relatively regular morphology, or a circular or elliptical shape
  • cells such as cytoplasm or cell membranes having an unstructed morphology
  • recognition of individual cells often is difficult.
  • Such cells having an unsturcted morphology can be classified into adherent cells (regular cells) and suspension cells (e.g. blood cells). Of these types of cells, adherent cells adhere to a bottom surface of a vessel or the like, to present a much complicated morphology.
  • cytoplasm in a case where cytoplasm is to be recognized via a cell-analyzing apparatus using a transmitted image of unstained cells, first, possible borders of cells are extracted as “lines”, and then contours of individual cells are determined as selected out of the extracted possible borders of cells, as shown in FIGS. 14A-14B .
  • the extraction of possible borders is made by picking up portions where a difference in luminance is large in the image. For example, in a black and white image, a portion where a contrast between black and white exists appears as a “line”. Such a portion is extracted as a possible border of a cell.
  • the cell-image analyzing apparatus of this embodiment mode is configured to automatically emphasize a contour portion of an image of a cell via a cell-contour emphasizing system 3 , as shown in FIG. 4 .
  • FIGS. 5A-5B are explanatory diagrams that show one example of the method for emphasizing the contour portion of an image of a cell by the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode.
  • FIG. 5A is a diagram that shows a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to an intracellular organelle
  • FIG. 5B is a diagram that shows a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to the cell contour.
  • FIG. 6 is a flowchart that shows a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode.
  • FIG. 7 is a flowchart that shows one example of an automatic setting procedure for an offset value, which is set for shifting the focus of the imaging optical system in the procedure shown in FIG. 6 from the bottom surface of the vessel to a preset position at which the contour portions of the images of the cells are emphasized.
  • a position of the bottom surface of the vessel, which contains the cells, in the direction of the optical axis is detected.
  • the detection can be made by a mechanical method (for example, a method by measuring an amount of reflection from the bottom surface upon radiating it with laser light). It can be regarded that the individual cells have substantially the same size. Therefore, upon setting a certain amount of shift along the optical axis as an offset amount, imaging of a predetermined cell position can be made (for example, imaging of the bottom portion of a cell with a shift amount Z 3 (see FIG. 5B ), the upper portion of the cell with a shift amount Z 2 (see FIG. 5B ), and the middle portion of the cell with a shift amount Z 1 (see FIG. 5A )).
  • the shift amounts Z 2 and Z 3 which are amounts of shift of the focus of the imaging optical system 1 a in the direction of the optical axis from the bottom surface of the vessel, are defined as offset amounts, so that the focus of the imaging optical system 1 a is adjusted to the bottom or the upper portion of the cell as shown in FIG. 5B .
  • FIG. 6 show a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode.
  • an analyst puts the vessel 4 containing cells on an electric XY stage 6 and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 (step S 1 ).
  • the autofocusing mechanism repeatedly performs hardware AF (autofocusing), in which the objective 1 a 1 of the imaging optical system 1 a is shifted in the direction of the optical axis, until the focus of the imaging optical system 1 a is adjusted to the bottom surface of the vessel 4 (step S 2 through step S 4 ). If preset times of trials of the hardware AF yet fail to achieve focusing onto the bottom surface of the vessel 4 , the procedure is ended with a caution (step S 5 ).
  • hardware AF autofocusing
  • the objective 1 a 1 of the imaging optical system 1 a is moved so that the focusing position of the imaging optical system 1 a on the bottom surface of the vessel 4 , which has been achieved by autofocusing via the autofocusing mechanism, is shifted in the direction of the optical axis by this offset amount (step S 6 ).
  • the cell imaging system 1 captures a transmitted illumination image of the cells 5 contained in the vessel 4 , which is arranged at the shot position (step S 7 ).
  • the captured image is stored in the storage area of the personal computer 12 (step S 8 ).
  • step 9 The sequence from the conveyance of the vessel 4 to the shot position of the cell imaging system 1 (step 1 ) through the storage of the captured image in a predetermined storage area (step 8 ) is performed for every imaging region of the cells (step 9 ).
  • this average thickness can be manually set.
  • automatic setting of an offset value is available in the cell-image analyzing apparatus of this embodiment mode.
  • FIG. 7 shows one example of the procedure for automatically setting the offset amount on the basis of captured cell images.
  • an analyst puts the vessel 4 containing cells on the electric XY stage 6 and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 (step S 11 ).
  • the autofocusing mechanism repeatedly performs hardware AF (autofocusing), in which the objective 1 a 1 of the imaging optical system 1 a is shifted in the direction of the optical axis, until the focus of the imaging optical system 1 a is adjusted to the bottom surface of the vessel 4 . (step S 12 through step S 14 ). If preset times of trials of the hardware AF yet fail to achieve focusing onto the bottom surface of the vessel 4 , the procedure is ended with a caution (step S 15 ).
  • hardware AF autofocusing
  • the cell imaging system 1 captures a transmitted illumination image of the cells 5 contained in the vessel 4 , which is arranged at the shot position (Step 16 ).
  • the cell-image analyzer 2 extracts contours as possible cell borders from the captured image, and performs a predetermined score judgment in accordance with the number of the contours. For example, when the number of contours having a certain contrast is decreased, a high score is counted (step 17 ).
  • the cell-image analyzing apparatus repeats a sequence of moving the objective 1 a 1 of the imaging optical system 1 a by a preset amount in the direction of the optical axis (step S 19 ), imaging the cells 5 by the cell imaging system 1 (step S 16 ), and performing the predetermined score judgment upon extracting the cell contours (step S 17 ) until the score of extracted contours counts to the maximum value (step S 18 ).
  • the cell-image analyzing apparatus stores the shift amount (offset amount) of the focusing position of the imaging optical system 1 a in the direction of the optical axis from that at the bottom surface of the vessel 4 , which has been achieved by autofocusing via the autofocusing mechanism, in the storage area of the personal computer 12 (step S 20 ).
  • the automatic setting procedure for the offset amount is ended in the cell-image analyzing apparatus of this embodiment mode.
  • characteristics of images differ in accordance with the focusing position of the imaging optical system 1 a in reference to the cells 5 .
  • the characteristics of images differ as shown in FIGS. 8A-8C and FIGS. 9A-9B .
  • FIGS. 8A-8C are photographs that show a relation between the focusing position of the imaging optical system 1 a in reference to the cells 5 and a state and result of recognition of cell contours by the cell-image analyzer 2 .
  • FIG. 8A shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on the contours of the cells 5
  • FIG. 8B shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on an intracellular organelle of the cells 5
  • FIG. 8C shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on an intracellular organelle of the cells 5 .
  • FIGS. 9A-9B are diagrams that schematically show the relation between a focusing position of the imaging optical system 1 a in reference to the cells 5 and recognition of cell contours by the cell-image analyzer 2 .
  • FIG. 9A shows a state where the focus of the imaging optical system is positioned on an intracellular organelle (left-side drawing) and recognitions of cell contours by the cell-image analyzer in this state (right-side drawings)
  • FIG. 9B shows a state where the focus of the imaging optical system is positioned on a cell-contour emphasizing point and a recognition of a cell contour by the cell-image analyzer in this state (right-side drawing).
  • FIGS. 8B , 8 C and 9 A When the focus of the imaging optical system 1 a is positioned on an intracellular organelle, it is so difficult to recognize border regions of cells accurately that an attempt to recognize cell contours via the cell-image analyzer 2 often fails, as shown in FIGS. 8B , 8 C and 9 A.
  • a cell is irrecognizable (right-side top drawing of FIG. 9A )
  • individual organelles are recognized ( FIG. 8C , right-side middle drawing of FIG. 9A )
  • border regions are misrecognized ( FIG. 8B , right-side bottom drawing of FIG. 9A ).
  • FIGS. 10A-10B there is a technique of making intracellular organelles inconspicuous by focusing the imaging optical system 1 a on a position displaced from the intracellular organelles.
  • the intracellular organelles are blurred and rendered inconspicuous as shown in FIG. 10A , to make the contour region of the cell relatively conspicuous.
  • the shift amount of the objective 1 a 1 is increased, the image of the entire cell comes to be blurred as shown in FIG. 10B .
  • a cell has a certain thickness, it is possible to recognize the contour of the cell.
  • Either of the above-described techniques that is, the technique in which the objective 1 a 1 is moved by an offset amount or the technique in which the imaging optical system 1 a is focused on a position other than a position of intracellular organelles, is available for emphasizing cell contours upon the focus being set at a position other than the normally used position (i.e. the position where the intracellular domain is in focus).
  • the cell-contour emphasizing system 3 is provided with a cell-contour emphasizing illumination system 3 b as a second means for emphasizing contour portions of cells, to perform tilted illumination for the cells 5 in the vessel 4 , which is arranged at the shot position. If the tilted illumination is adopted, an adjustment of the illumination angle can make the contours of the cells 5 emphasized, by itself or in a combination with a change of the focusing position of the imaging optical system 1 a .
  • the tilted illumination is an illumination technique for making an object conspicuous by casting a “shadow”. The size of the shadow correlates to the “height” of an illumination object.
  • tilted illumination is performed via the cell-contour emphasizing illumination system 3 b , to emphasize the contour portions of the cells 5 on the basis of the principle that a shadow grows as an illumination angle increases.
  • the contour portions of the cells are higher than intracellular organelles, when the cells are illuminated under the tilted illumination, the contour portions of the cells are emphasized as casting shadows like black rings.
  • FIG. 11 is an explanatory diagram that schematically shows the normal illumination and the tilted illumination for a cell.
  • FIG. 12A-12B are explanatory diagrams that schematically show how the shadow of the contour portion of a cell is cast when the illumination angle is changed in a tilted illumination via the cell-contour emphasizing illumination system 3 b in the cell-image analyzing apparatus of this embodiment mode.
  • FIG. 12A shows an illumination condition where the tilt angle is small and a shadow of the cell contour cast in this condition
  • FIG. 12B shows an illumination condition where the tilt angle is large and a shadow of the cell contour cast in this condition.
  • the cell-image analyzing apparatus of this embodiment mode makes it possible to automatically recognize individual cells accurately when used for cell images captured in an unstained, bright-field condition or for cell images captured from cells as living, to thereby greatly save fatigue of an analyst and time for processing in a cell analysis procedure.
  • the cell-image analyzing apparatus is useful in the fields of medical science and biology, where cells are imaged and characteristic quantities of the cells are analyzed from the captured image of the cells.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Image Processing (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)

Abstract

A cell-image analyzing apparatus includes: a cell imaging system having an imaging optical system and an image sensor, for imaging cells that exist in a vessel; a cell-image analyzer for automatically analyzing a predetermined characteristic quantity on the cells using a cell image captured via the cell imaging system, upon delimiting cell regions; and a cell-contour emphasizing system for automatically emphasizing contour portions of images of the cells that exist in the vessel, which is arranged at a shot position of the cell imaging system.

Description

This application claims benefits of Japanese Patent Application No. 2009-062608 filed in Japan on Mar. 16, 2009, the contents of which are hereby incorporated by reference.
BACKGROUND OF THE INVENTION
1) Field of the Invention
The present invention relates to a cell-image analyzing apparatus for imaging cells and analyzing characteristic quantities of the cells from captured images.
2) Description of Related Art
Cell analysis is indispensable for elucidation and therapy establishment of various diseases such as cancer. Therefore, a great deal of effort has been put into elucidation of states, kinetics, morphologies, properties etc. of cells upon isolation of cell strains. Also, fluorescent substances and luminescent substances have conventionally been used to facilitate delimitation of cells, particular proteins etc. in elucidation of the cells and the particular proteins.
Fluorescent substances and luminescent substances are easy to handle and thus are very effective means for delimiting cell themselves, particular proteins etc. On the other hand, however, fluorescent substances and luminescent substances sometimes behave as toxicants or stimulants for cells, specifically for living cells, to be a cause of precluding an accurate analysis result.
Therefore, in recent years, it is held to be very important to observe and analyze states, proliferation, morphologies etc. of cells under as natural a condition as possible without stimulating the cells via a fluorescent substance or a luminescent substance.
Conventionally, in a case where cells are observed and analyzed without being stimulated, a microscope such as recited in Japanese Patent Kokai No. 2004-354650 is used.
This microscope of JP Kokai No. 2004-354650 is provided with a light source, an illumination optical system for introducing light from the light source to an object for observation, an aperture arranged at the pupil position of the illumination optical system, and an observation optical system for observing, at a position displaced from the in-focus position, an image of the object illuminated by the light passing through the aperture.
Most of cells are colorless and transparent themselves. Therefore, in a case where cells are imaged via a normal observation technique using no fluorescent substance, even if automatic analysis of the cells from the captured image are attempted using an image analyzing apparatus, individual cells cannot be recognized, to make it difficult to obtain an accurate analysis result. By this reason, in cases where analysis is made without stimulating the cells, analysts would conventionally use a microscope as disclosed in JP Kokai No. 2004-354650, to visually observe states of the cells.
SUMMARY OF THE INVENTION
A cell-image analyzing apparatus according to the present invention includes: a cell imaging system having an imaging optical system and an image sensor, for imaging cells that exist in a vessel; and a cell-image analyzer for automatically analyzing a predetermined characteristic quantity on the cells using a cell image captured via the cell imaging system, upon delimiting cell regions; wherein the cell-image analyzing apparatus has a cell-contour emphasizing system for automatically emphasizing contour portions of images of the cells that exist in the vessel, which is arranged at a shot position of the cell imaging system.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing system is constructed of a cell-contour emphasizing position focusing system for automatically adjusting a focus of the imaging optical system to a position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing system is constructed of a cell-contour emphasizing illumination system for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing system includes: a cell-contour emphasizing position focusing system for automatically adjusting a focus of the imaging optical system to a position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized; and a cell-contour emphasizing illumination system for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, are emphasized.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to an intracellular domain of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system, and then is shifted along an optical axis of the imaging optical system by a preset amount, to a position where the intracellular domain of the cells is blurred and the contour portions of the cells are distinctly seen in the cell image.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to a bottom surface of the vessel, which is arranged at the shot position of the cell imaging system, and then is shifted along an optical axis of the imaging optical system by a preset amount, which is determined in accordance with a thickness of the cells that exist in the vessel.
In the cell-image analyzing apparatus according to the present invention, it is preferred that the cell-contour emphasizing illumination system is configured as a tilted illumination system.
The present invention provides a cell-image analyzing apparatus that makes it possible to automatically recognize individual cells accurately when used for cell images captured in an unstained, bright-field condition or for cell images captured from cells as living, to thereby greatly save fatigue of an analyst and time for processing in a cell analysis procedure. In addition, the capacity of accurate automatic recognition of individual cells may lead to discoveries of something new, for it allows us to carry out statistical data analysis, for which visual observation is insufficient in capacity. Further, since cells can be steadily recognized, elucidation of diseases and establishment of therapies would be accelerated through combining various cell analyses and carrying out new cell analyses one after another.
This and other objects as well as features and advantages of the present invention will become apparent from the following detailed description of the preferred embodiment when taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1. is a block diagram that shows the schematic configuration of a cell-image analyzing apparatus according to the present invention.
FIG. 2. is an explanatory diagram that shows the schematic configuration of the entire cell-image analyzing apparatus according to one embodiment mode of the present invention.
FIG. 3. is an explanatory diagram that schematically shows the entire procedure of cell analysis.
FIG. 4 is an explanatory diagram that shows a state where the contour portion of an image of a cell is emphasized.
FIGS. 5A-5B are explanatory diagrams that show one example of the method for emphasizing the contour portion of an image of a cell by the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode, showing: a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to an intracellular organelle; and a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to the cell contour; respectively.
FIG. 6 is a flowchart that shows a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode.
FIG. 7 is a flowchart that shows one example of an automatic setting procedure for an offset value, which is set for shifting the focus of the imaging optical system in the procedure shown in FIG. 6 from the bottom surface of the vessel to a preset position at which the contour portions of the images of the cells are emphasized.
FIGS. 8A-8C are photographs that show a relation between a focusing position of the imaging optical system in reference to cells and a state and result of recognition of cell contours by the cell-image analyzer, showing: a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on the contours of the cells; a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on an intracellular organelle; and a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system is positioned on an intracellular organelle; respectively.
FIGS. 9A-9B are diagrams that schematically show the relation between a focusing position of the imaging optical system in reference to cells and recognition of cell contours by the cell-image analyzer, showing: a state where the focus of the imaging optical system is positioned on an intracellular organelle (left-side drawing) and recognitions of cell contours by the cell-image analyzer in this state (right-side drawings); and a state where the focus of the imaging optical system is positioned on a cell-contour emphasizing point and a recognition of a cell contour by the cell-image analyzer in this state (right-side drawing); respectively.
FIGS. 10A-10B are explanatory diagrams that show the state where the focus of the imaging optical system is adjusted to a position different from positions of intracellular organelles, in another method for capturing a cell image with a contour portion of an image of the cell being emphasized via the cell-contour emphasizing position focusing system of the cell-contour emphasizing system in the cell-image analyzing apparatus according to this embodiment mode, showing: a state in which the focus of the imaging optical system is adjusted to a position where images of intracellular organelles are blurred; and a state in which the focus of the imaging optical system is adjusted to a position where an image of the entire cell is blurred; respectively.
FIG. 11 is an explanatory diagram that schematically shows the normal illumination and the tilted illumination for a cell.
FIGS. 12A-12B are explanatory diagrams that schematically show how the shadow of the contour portion of a cell is cast when the illumination angle is changed in a tilted illumination via the cell-contour emphasizing illumination system in the cell-image analyzing apparatus of this embodiment mode, showing: an illumination condition where the tilt angle is small and a shadow of the cell contour cast in this condition; and an illumination condition where the tilt angle is large and a shadow of the cell contour cast in this condition; respectively.
FIGS. 13A-13B are explanatory diagrams that show examples of misrecognition of cell regions, which has conventionally been caused in a cell-image analysis using an image analyzing apparatus, showing: a case where a single cell is recognized as plural cells; and a case where plural cells are recognized as a single cell; respectively.
FIGS. 14A-14B are explanatory diagrams that show the procedure of cytoplasm recognition by a cell-analyzing apparatus using a transmitted image of unstained cells, showing: a step of extracting possible borders as “lines”; and a step of determining contours of individual cells from the extracted possible borders of the cells; respectively.
FIG. 15 is an explanatory diagram that shows the first problem caused in recognition of cell regions in a case where cells are distinctly imaged in a transmitted image.
FIGS. 16A-16B are explanatory diagrams that show the second problem caused in recognition of cell regions in cases where cells are distinctly imaged in transmitted images, respectively.
 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Preceding the explanation of the embodiment mode of the invention, the problem to be solved, the configuration, and the function and effect of the present invention will be explained.
FIG. 1 is a block diagram that shows the schematic configuration of a cell-image analyzing apparatus according to the present invention. The cell-image analyzing apparatus according to the present invention has a cell imaging system 1, a cell-image analyzer 2, and a cell-contour emphasizing system 3.
The cell imaging system 1 has an imaging optical system 1 a and an image sensor 1 b, to image cells existing in a vessel, which is not shown in FIG. 1 but is arranged at the shot position.
The cell-image analyzer 2 automatically analyzes a predetermined characteristic quantity on the cells using a cell image captured via the cell imaging system 1, upon delimiting cell regions.
The cell-contour emphasizing system 3 automatically emphasizes contour portions of images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1.
The cell-contour emphasizing system 3 preferably is constructed of a cell-contour emphasizing position focusing system 3 a for automatically adjusting a focus of the imaging optical system 1 a to a preset position where the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1, are emphasized. Alternatively, the cell-contour emphasizing system 3 may be constructed of a cell-contour emphasizing illumination system 3 b for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1, are emphasized. Alternatively, it is much preferable that the cell-contour emphasizing system 3 is provided with the cell-contour emphasizing position focusing system 3 a and the cell-contour emphasizing illumination system 3 b.
The cell-contour emphasizing position focusing system 3 a is configured so that, in imaging cells via the cell imaging system 1, the focus of the imaging optical system 1 a is displaced in the direction of the optical axis from a position of the intracellular domain (domain where organelles exist) to a preset position where the contours of the cells are emphasized. To be specific, the cell-contour emphasizing position focusing system 3 a is configured so that, for example, the focus of the imaging optical system 1 a is first adjusted to the intracellular domain of the cells that exist in the vessel, which is arranged at the shot position of the cell imaging system 1, and then is shifted along the optical axis of the imaging optical system 1 a by a preset amount, to a position where the intracellular domain is blurred and the contour portions of the cells are distinctly seen in the cell image.
Alternatively, the cell-contour emphasizing position focusing system 3 a is configured so that, for example, the focus of the imaging optical system 1 a is first adjusted to the bottom surface of the vessel, which is arranged at the shot position of the cell imaging system 1, and then is shifted along the optical axis of the imaging optical system 1 a by a preset amount, which is determined in accordance with a thickness of the cells that exist in the vessel. The cell-contour emphasizing illumination system 3 b is configured as a tilted illumination system.
Conventionally, in a case where cells are analyzed with no stimulus being given by staining or the like, where cells are analyzed chronologically or where cells are analyzed as living in view of morphology or proliferation, an attempt to automatically analyze the cells from a captured image, which is obtained through imaging of the cells, by using an image analyzing apparatus has resulted in a failure to recognize cells because of colorlessness of the cells or has resulted in a failure to accurately recognize cells because a clustered state of cells, which often occurs in a cultivated condition, causes misrecognition of cell contours in an image.
Therefore, conventionally, in order to accurately analyze cells in an unstained condition, analysts have been obliged to adopt, not the automatic analysis of cell images via an image analyzing apparatus, but the method of analysis in which individual cells are visually recognized in microscopy. These analyses usually are conducted by analysts through their eyes for counting cells, measuring cell growth and morphology, etc. However, since such a technique using visual observation requires a great deal of work and time for cell analysis, a feasible number of cells for analysis is limited to be small and the analyst suffers from a great fatigue.
On the other hand, as in the cell-image analyzing apparatus according to the present invention, if there is provided a cell-contour emphasizing system 3 for automatically emphasizing contour portions of images of cells 5 that exist in a vessel 4, which is arranged at the shot position of the cell imaging system 1, an image with distinct contours of the individual cells 5 can be obtained and thus, in an automatic analysis of the image captured via the cell imaging system 1, cell contours can be determined and the individual cells are accurately recognizable.
Therefore, in a case where an analysis is made without using a stain such as a fluorescent substance in a bright-field condition or where cells as living are analyzed, the cell-image analyzing apparatus of the present invention makes it possible to automatically conduct the procedure from imaging through recognition of the cells without using visual observation via human eyes, to thereby greatly save fatigue of the analyst and the time for processing, increase the number of cells to be analyzed per unit time, and further, to conduct the cell analysis accurately.
Next, the explanation is made on the embodiment mode of the cell-image analyzing apparatus according to the present invention.
FIG. 2. is an explanatory diagram that shows the schematic configuration of the entire cell-image analyzing apparatus according to one embodiment mode of the present invention. The cell-image analyzing apparatus of this embodiment mode is configured so that the cell imaging system 1 shown in FIG. 1 has a microscope imaging optical system 1 a provided with an objective 1 a 1 and a tube lens 1 a 2, and a solid-state image sensor 1 b such as a CCD or CMOS. The objective 1 a 1 is configured to be movable in the direction of the optical axis for focusing by an electric control mechanism not shown. The tube lens 1 a g forms an image of the cells 5 that exist in the vessel 4 on an image capture surface of the solid-state image sensor 1 b. The cell imaging system 1 images the cells existing in the vessel 4, which is arranged at the shot position.
The cell-image analyzer 2 is configured to have a central processor unit of a personal computer 12 and an image-analyzing software installed there, to automatically analyze a predetermined characteristic quantity on the cells 5 using an image of the cells 5 captured via the cell imaging system 1, upon delimiting regions of the cells 5.
In FIG. 2, the reference numeral 6 denotes an electric XY stage, which mounts the vessel 4 and operates upon receiving power supply and operation instruction from a controller 10 described later. The reference numeral 8 denotes an illumination light source for illuminating the cells 5. The reference numeral 10 denotes a controller, which controls the electric XY stage 6, the illumination light source 8, and the objective 1 a 1 in accordance with instructions from the personal computer 12. The reference numeral 11 denotes a camera controller, which is connected with the solid-state image sensor 1 b and the personal computer 12, to perform imaging control and transmission of captured image information to the personal computer 12 upon receiving predetermined instruction signals from the personal computer 12. The reference numeral 13 denotes a monitor connected with the personal computer 12.
Also, in the cell-image analyzing apparatus of this embodiment, the cell-contour emphasizing system 3 shown in FIG. 1 includes a cell-contour emphasizing position focusing system 3 a and a cell-contour emphasizing illumination system 3 b.
The cell-contour emphasizing position focusing system 3 a includes an autofocusing mechanism not shown in FIG. 2 and an electric control mechanism not shown, which is connected with the controller 10. The cell-contour emphasizing position focusing system 3 a is configured to move the objective 1 a 1 in a direction of the optical axis so that, when a predetermined instruction signal is transmitted from the computer 12 to the controller 10, the focus of the imaging optical system 1 a is automatically adjusted to the preset position where images of the contour portions of the cells 5 that exist in the vessel 4, which is positioned at the shot position of the cell imaging system 1, are emphasized.
To be specific, the cell-contour emphasizing position focusing system 3 a first conducts an autofocusing process for adjusting the focus of the imaging optical system 1 a to an intracellular organelle of a cell 5, and then conducts a process of shifting the focus of the imaging optical system 1 a in the direction of the optical axis by a preset offset amount so that images of the contour portions of the cells 5 are emphasized.
The cell-contour emphasizing illumination system 3 b is configured as a tilted illumination system 8. The tilted illumination system 8 irradiates the cells 5 with illumination light as obliquely tilted in reference to the optical axis of the imaging optical system 1 a so that the contour portions of the images of the cells 5 that exist in the vessel 4, which is arranged at the shot position of the cell imaging system 1, are emphasized. In addition, the tilted illumination system 8 is configured to provide an illumination mode in which R, G, B components of illumination light are sequentially switched to one another via a control by the controller 10.
FIG. 3. is an explanatory diagram that schematically shows the entire procedure of cell analysis.
In a cell analysis, first, a cell sample as an object of the analysis is prepared. Then, the cell sample is imaged upon segmented into plural view fields. Then, the individual captured images are analyzed so that plural cells appearing in each image are recognized upon divided into individual cell regions. Then, regarding the individual cells for which their regions are recognized, a predetermined statistical processing such as averaging of cell size (area) is conducted.
In a case where a cell analysis is made using the cell-image analyzing apparatus of this embodiment mode, an analyst puts the cells 5 in the vessel 4 such as a multiwell plate, a slide glass etc., mounts the vessel 4 containing the cells 5 on the electric XY stage 6, and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 via the controller 10. Then, via the controller 10 and the camera controller 11, the cell imaging system 1 performs imaging of the cells existing in the vessel 4, which has been conveyed to the shot position, upon dividing the entire field into plural view fields. In the imaging, an autofocusing process by the autofocusing mechanism to adjust the focus of the imaging optical system 1 a to an intracellular organelle, a process of shifting the focus of the imaging optical system 1 a for emphasizing images of contour portions of the cells 5, and an imaging process under the respective R, G, B components of illumination light, are performed in this order.
Upon completion of the imaging procedure on the cells for every visual field, the cell-image analyzer 2 recognizes regions of individual cells in the image of the cells 5, and then conducts a statistical procedure regarding the individual cells for which their cell regions are recognized, based on parameters that have been preliminarily set via analysts, such as total number of cells, average cell size (area), and total amount of fluorescence of individual cells.
Here, explanation is made on causes that have conventionally prevented analysts from accurately performing automatic analysis of cells using an image analyzing apparatus.
In order to perform automatic analysis of cells accurately using an image analyzing apparatus, it is necessary to delimit regions of individual cells so that the individual cells are accurately recognized in an image analysis of a cell image. However, in such a case where cell analysis is automatically conducted from a cell image using an image analyzing apparatus, there have been a problem that regions of individual cells are often misrecognized, e.g. a single cell being misrecognized as plural cells as shown in FIG. 13A or plural cells being misrecognized as a single cell as shown in FIG. 13B.
The frequency of misrecognition of cell regions differs by morphology of cells that are the object of analysis. For example, regarding cells such as cell nuclei having a relatively regular morphology, or a circular or elliptical shape, it is relatively easy to recognize individual cells. On the other hand, regarding cells such as cytoplasm or cell membranes having an unstructed morphology, recognition of individual cells often is difficult. Such cells having an unsturcted morphology can be classified into adherent cells (regular cells) and suspension cells (e.g. blood cells). Of these types of cells, adherent cells adhere to a bottom surface of a vessel or the like, to present a much complicated morphology.
Although it is relatively easy to recognize individual cells regarding cell nuclei as stated above, for the purpose of capturing an image of the cell nuclei that is in such a condition as to allow individual cells to be easily recognizable, it usually is necessary to specifically stain the cell nuclei using a staining substance such as a fluorescent substance. However, a large part of the staining substances such as fluorescent substances used for staining cell nuclei have toxicity and thus cannot be used in a case where cells are observed as living. Therefore, for an analysis of living cells, it is necessary to recognize individual cells using an image captured in an unstained condition.
For example, in a case where cytoplasm is to be recognized via a cell-analyzing apparatus using a transmitted image of unstained cells, first, possible borders of cells are extracted as “lines”, and then contours of individual cells are determined as selected out of the extracted possible borders of cells, as shown in FIGS. 14A-14B. Here, the extraction of possible borders is made by picking up portions where a difference in luminance is large in the image. For example, in a black and white image, a portion where a contrast between black and white exists appears as a “line”. Such a portion is extracted as a possible border of a cell.
In a case where cells are distinctly imaged in a transmitted image, not only cytoplasm, or borders of cells (=cell membrane), but also intracellular organelles are observable. However, in such a case, two many “line” components, which are possible borders of cells, appear as shown in FIG. 15, to make it very difficult to trace borders of individual cells using a cell-analyzing apparatus.
In addition, the nature of a transmitted image does not always allow distinct imaging of cells. As shown in FIGS. 16A-16B, for example, “line” components as possible borders of cells often are fragmented. In such a case, the “line” components have to be joined together using a cell-analyzing apparatus, to restore borders of individual cells. However, if the morphology of cells is much complicated, it is difficult to restore borders of the cells.
In order to solve this problem, the cell-image analyzing apparatus of this embodiment mode is configured to automatically emphasize a contour portion of an image of a cell via a cell-contour emphasizing system 3, as shown in FIG. 4.
FIGS. 5A-5B are explanatory diagrams that show one example of the method for emphasizing the contour portion of an image of a cell by the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode. To be specific, FIG. 5A is a diagram that shows a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to an intracellular organelle, and FIG. 5B is a diagram that shows a state where the focus of the imaging optical system is adjusted to the bottom surface of the vessel and then an offset value is set so that the focus is shifted to the cell contour.
FIG. 6 is a flowchart that shows a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode. FIG. 7 is a flowchart that shows one example of an automatic setting procedure for an offset value, which is set for shifting the focus of the imaging optical system in the procedure shown in FIG. 6 from the bottom surface of the vessel to a preset position at which the contour portions of the images of the cells are emphasized.
Cells adhere to the bottom surface of a vessel, or, if suspension cells, sink to touch the bottom surface. Therefore, first, a position of the bottom surface of the vessel, which contains the cells, in the direction of the optical axis is detected. The detection can be made by a mechanical method (for example, a method by measuring an amount of reflection from the bottom surface upon radiating it with laser light). It can be regarded that the individual cells have substantially the same size. Therefore, upon setting a certain amount of shift along the optical axis as an offset amount, imaging of a predetermined cell position can be made (for example, imaging of the bottom portion of a cell with a shift amount Z3 (see FIG. 5B), the upper portion of the cell with a shift amount Z2 (see FIG. 5B), and the middle portion of the cell with a shift amount Z1 (see FIG. 5A)).
In the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 according to the cell-image analyzing apparatus of this embodiment mode, the shift amounts Z2 and Z3, which are amounts of shift of the focus of the imaging optical system 1 a in the direction of the optical axis from the bottom surface of the vessel, are defined as offset amounts, so that the focus of the imaging optical system 1 a is adjusted to the bottom or the upper portion of the cell as shown in FIG. 5B.
FIG. 6 show a series of processes of capturing an image with contour portions of images of cells being emphasized via the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus according to this embodiment mode.
First, an analyst puts the vessel 4 containing cells on an electric XY stage 6 and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 (step S1).
Then, the autofocusing mechanism repeatedly performs hardware AF (autofocusing), in which the objective 1 a 1 of the imaging optical system 1 a is shifted in the direction of the optical axis, until the focus of the imaging optical system 1 a is adjusted to the bottom surface of the vessel 4 (step S2 through step S4). If preset times of trials of the hardware AF yet fail to achieve focusing onto the bottom surface of the vessel 4, the procedure is ended with a caution (step S5).
Then, on the basis of a preset offset value, which has been set, for example, through an offset setting procedure described later in reference to FIG. 7 and stored in a storage area of the personal computer 12, the objective 1 a 1 of the imaging optical system 1 a is moved so that the focusing position of the imaging optical system 1 a on the bottom surface of the vessel 4, which has been achieved by autofocusing via the autofocusing mechanism, is shifted in the direction of the optical axis by this offset amount (step S6).
Then, the cell imaging system 1 captures a transmitted illumination image of the cells 5 contained in the vessel 4, which is arranged at the shot position (step S7).
Then, the captured image is stored in the storage area of the personal computer 12 (step S8).
The sequence from the conveyance of the vessel 4 to the shot position of the cell imaging system 1 (step 1) through the storage of the captured image in a predetermined storage area (step 8) is performed for every imaging region of the cells (step 9).
Regarding the offset amount, if an average thickness of cells is known in advance, this average thickness can be manually set. Preferably, automatic setting of an offset value is available in the cell-image analyzing apparatus of this embodiment mode.
FIG. 7 shows one example of the procedure for automatically setting the offset amount on the basis of captured cell images.
First, an analyst puts the vessel 4 containing cells on the electric XY stage 6 and actuates the cell-image analyzing apparatus. Consequently, the electric XY stage 6 conveys the vessel 4 to the shot position of the cell imaging system 1 (step S11).
Then, the autofocusing mechanism repeatedly performs hardware AF (autofocusing), in which the objective 1 a 1 of the imaging optical system 1 a is shifted in the direction of the optical axis, until the focus of the imaging optical system 1 a is adjusted to the bottom surface of the vessel 4. (step S12 through step S14). If preset times of trials of the hardware AF yet fail to achieve focusing onto the bottom surface of the vessel 4, the procedure is ended with a caution (step S15).
Then, the cell imaging system 1 captures a transmitted illumination image of the cells 5 contained in the vessel 4, which is arranged at the shot position (Step 16).
Then, the cell-image analyzer 2 extracts contours as possible cell borders from the captured image, and performs a predetermined score judgment in accordance with the number of the contours. For example, when the number of contours having a certain contrast is decreased, a high score is counted (step 17). The cell-image analyzing apparatus repeats a sequence of moving the objective 1 a 1 of the imaging optical system 1 a by a preset amount in the direction of the optical axis (step S19), imaging the cells 5 by the cell imaging system 1 (step S16), and performing the predetermined score judgment upon extracting the cell contours (step S17) until the score of extracted contours counts to the maximum value (step S18).
When the score of extracted contours counts to the maximum value (step S18), the cell-image analyzing apparatus stores the shift amount (offset amount) of the focusing position of the imaging optical system 1 a in the direction of the optical axis from that at the bottom surface of the vessel 4, which has been achieved by autofocusing via the autofocusing mechanism, in the storage area of the personal computer 12 (step S20). Whereby, the automatic setting procedure for the offset amount is ended in the cell-image analyzing apparatus of this embodiment mode.
Regarding transmitted images, characteristics of images differ in accordance with the focusing position of the imaging optical system 1 a in reference to the cells 5. For example, the characteristics of images differ as shown in FIGS. 8A-8C and FIGS. 9A-9B.
FIGS. 8A-8C are photographs that show a relation between the focusing position of the imaging optical system 1 a in reference to the cells 5 and a state and result of recognition of cell contours by the cell-image analyzer 2. To be specific, FIG. 8A shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on the contours of the cells 5, FIG. 8B shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on an intracellular organelle of the cells 5, and FIG. 8C shows a state of recognition (left-side photo) and a result of the recognition (right-side photo) in a condition where the focus of the imaging optical system 1 a is positioned on an intracellular organelle of the cells 5.
FIGS. 9A-9B are diagrams that schematically show the relation between a focusing position of the imaging optical system 1 a in reference to the cells 5 and recognition of cell contours by the cell-image analyzer 2. To be specific, FIG. 9A shows a state where the focus of the imaging optical system is positioned on an intracellular organelle (left-side drawing) and recognitions of cell contours by the cell-image analyzer in this state (right-side drawings), and FIG. 9B shows a state where the focus of the imaging optical system is positioned on a cell-contour emphasizing point and a recognition of a cell contour by the cell-image analyzer in this state (right-side drawing).
When the focus of the imaging optical system 1 a is positioned on an intracellular organelle, it is so difficult to recognize border regions of cells accurately that an attempt to recognize cell contours via the cell-image analyzer 2 often fails, as shown in FIGS. 8B, 8C and 9A. To be specific, a cell is irrecognizable (right-side top drawing of FIG. 9A), individual organelles are recognized (FIG. 8C, right-side middle drawing of FIG. 9A), or border regions are misrecognized (FIG. 8B, right-side bottom drawing of FIG. 9A).
Regarding the technique of capturing an image in a condition where contour portions of images of cells are emphasized via the cell-contour emphasizing position focusing system 3 a of the cell-contour emphasizing system 3 in the cell-image analyzing apparatus of this embodiment mode, there are another methods for relatively emphasizing contour portions of cells, other than the technique described above in which the focusing position of the imaging optical system 1 a is shifted by a certain offset amount.
For example, as shown in FIGS. 10A-10B, there is a technique of making intracellular organelles inconspicuous by focusing the imaging optical system 1 a on a position displaced from the intracellular organelles. When the objective 1 a 1 is shifted in the direction of the optical axis by a certain amount so that the imaging optical system 1 a is focused on a position different from the intracellular organelles, the intracellular organelles are blurred and rendered inconspicuous as shown in FIG. 10A, to make the contour region of the cell relatively conspicuous. In addition, if the shift amount of the objective 1 a 1 is increased, the image of the entire cell comes to be blurred as shown in FIG. 10B. However, since a cell has a certain thickness, it is possible to recognize the contour of the cell.
Either of the above-described techniques, that is, the technique in which the objective 1 a 1 is moved by an offset amount or the technique in which the imaging optical system 1 a is focused on a position other than a position of intracellular organelles, is available for emphasizing cell contours upon the focus being set at a position other than the normally used position (i.e. the position where the intracellular domain is in focus).
Also, in the cell-image analyzing apparatus of this embodiment mode, the cell-contour emphasizing system 3 is provided with a cell-contour emphasizing illumination system 3 b as a second means for emphasizing contour portions of cells, to perform tilted illumination for the cells 5 in the vessel 4, which is arranged at the shot position. If the tilted illumination is adopted, an adjustment of the illumination angle can make the contours of the cells 5 emphasized, by itself or in a combination with a change of the focusing position of the imaging optical system 1 a. In short, the tilted illumination is an illumination technique for making an object conspicuous by casting a “shadow”. The size of the shadow correlates to the “height” of an illumination object.
Therefore, in the cell-image analyzing apparatus of this embodiment mode, tilted illumination is performed via the cell-contour emphasizing illumination system 3 b, to emphasize the contour portions of the cells 5 on the basis of the principle that a shadow grows as an illumination angle increases. To be specific, since the contour portions of the cells are higher than intracellular organelles, when the cells are illuminated under the tilted illumination, the contour portions of the cells are emphasized as casting shadows like black rings. FIG. 11 is an explanatory diagram that schematically shows the normal illumination and the tilted illumination for a cell. FIGS. 12A-12B are explanatory diagrams that schematically show how the shadow of the contour portion of a cell is cast when the illumination angle is changed in a tilted illumination via the cell-contour emphasizing illumination system 3 b in the cell-image analyzing apparatus of this embodiment mode. To be specific, FIG. 12A shows an illumination condition where the tilt angle is small and a shadow of the cell contour cast in this condition, and FIG. 12B shows an illumination condition where the tilt angle is large and a shadow of the cell contour cast in this condition.
In this way, when a cell-contour emphasizing operation is performed by the cell-contour emphasizing position focusing system 3 a and the cell-contour emphasizing illumination system 3 b in the cell-contour emphasizing system 3 of the cell-image analyzing apparatus of this embodiment mode, cell contours are emphasized as thickened and intracellular organelles are blurred to be relatively inconspicuous. As a result, in the detection process in which “line” components are detected via the cell-image analyzer 2 out of the captured image, the contour portions of the cells are easily detected while the above-described problems, or fragmentation of contour regions and detection of too many possible contours are obviated, to facilitate accurate recognition of the individual cells. Therefore, the cell-image analyzing apparatus of this embodiment mode makes it possible to automatically recognize individual cells accurately when used for cell images captured in an unstained, bright-field condition or for cell images captured from cells as living, to thereby greatly save fatigue of an analyst and time for processing in a cell analysis procedure.
As is clear from the explanations above, the cell-image analyzing apparatus according to the present invention is useful in the fields of medical science and biology, where cells are imaged and characteristic quantities of the cells are analyzed from the captured image of the cells.

Claims (11)

What is claimed is:
1. A cell-image analyzing apparatus comprising:
a cell imaging system comprising (i) an imaging optical system for forming an optical image of cells that exist in a vessel, and (ii) an image sensor for capturing images of the cells that exist in the vessel by converting the optical image of the cells formed by the imaging optical system into electronic cell image data;
a cell-contour emphasizing system which optically emphasizes contour portions of the cells that exist in the vessel, the vessel being arranged at a shot position of the cell imaging system, such that the contour portions of the cells appear emphasized in the optical image of the cells which is formed by the imaging optical system before the optical image of the cells is converted into the electronic cell image data; and
a cell-image analyzer which analyzes a predetermined characteristic quantity of the cells using the electronic cell image data generated by the cell imaging system, upon delimiting cell regions;
wherein the cell imaging system captures the images of the cells that exist in the vessel, with the contour portions of the cells having been emphasized by the cell-contour emphasizing system, and then the cell-image analyzer automatically analyzes the predetermined characteristic quantity of the cells upon delimiting the cell regions using the electronic cell image data in which the contour portions of the cells that exist in the vessel have been automatically emphasized by the cell-contour emphasizing system and captured by the cell imaging system; and
wherein the cell-contour emphasizing system comprises a cell-contour emphasizing position focusing system including an autofocusing mechanism for automatically adjusting a focus of the imaging optical system to a position where the contour portions of the cells that exist in the vessel are emphasized in the optical image of the cells.
2. A cell-image analyzing apparatus comprising:
a cell imaging system comprising (i) an imaging optical system for forming an optical image of cells that exist in a vessel, and (ii) an image sensor for capturing images of the cells that exist in the vessel by converting the optical image of the cells formed by the imaging optical system into electronic cell image data;
a cell-contour emphasizing system which optically emphasizes contour portions of the cells that exist in the vessel, the vessel being arranged at a shot position of the cell imaging system, such that the contour portions of the cells appear emphasized in the optical image of the cells which is formed by the imaging optical system before the optical image of the cells is converted into the electronic cell image data; and
a cell-image analyzer which analyzes a predetermined characteristic quantity of the cells using the electronic cell image data generated by the cell imaging system, upon delimiting cell regions;
wherein the cell imaging system captures the images of the cells that exist in the vessel, with the contour portions of the cells having been emphasized by the cell-contour emphasizing system, and then the cell-image analyzer automatically analyzes the predetermined characteristic quantity of the cells upon delimiting the cell regions using the electronic cell image data in which the contour portions of the cells that exist in the vessel have been automatically emphasized by the cell-contour emphasizing system and captured by the cell imaging system; and
wherein the cell-contour emphasizing system comprises a cell-contour emphasizing illumination system including a light source for illuminating the cells in such a manner that the contour portions of the cells that exist in the vessel are emphasized in the optical image of the cells.
3. The cell-image analyzing apparatus according to claim 1, wherein the cell-contour emphasizing system further comprises a cell-contour emphasizing illumination system including a light source for illuminating the cells in such a manner that the contour portions of the images of the cells that exist in the vessel are emphasized.
4. The cell-image analyzing apparatus according to claim 1, wherein the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to an intracellular domain of the cells that exist in the vessel by the autofocusing mechanism, and then is shifted along an optical axis of the imaging optical system by a preset amount to a position where the intracellular domain of the cells is blurred and the contour portions of the cells are distinctly seen in the optical image of the cells.
5. The cell-image analyzing apparatus according to claim 1, wherein the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to a bottom surface of the vessel by the autofocusing mechanism, and then is shifted along an optical axis of the imaging optical system by a preset amount which is determined in accordance with a thickness of the cells that exist in the vessel.
6. The cell-image analyzing apparatus according to claim 2, wherein the cell-contour emphasizing illumination system comprises a tilted illumination system configured to irradiate the cells with illumination light rays from the light source such that the light rays are obliquely tilted with respect to an optical axis of the imaging optical system and such that the contour portions of the cells are emphasized with cast shadows in the optical image of the cells.
7. The cell-image analyzing apparatus according to claim 3, wherein the cell-contour emphasizing illumination system comprises a tilted illumination system configured to irradiate the cells with illumination light rays from the light source in a manner obliquely tilted with respect to an optical axis of the imaging optical system such that the contour portions of the cells are emphasized with cast shadows in the optical image of the cells.
8. The cell-image analyzing apparatus according to claim 3, wherein the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to an intracellular domain of the cells that exist in the vessel by the autofocusing mechanism, and then is shifted along an optical axis of the imaging optical system by a preset amount to a position where the intracellular domain of the cells is blurred and the contour portions of the cells are distinctly seen in the optical image of the cells.
9. The cell-image analyzing apparatus according to claim 8, wherein the cell-contour emphasizing illumination system comprises a tilted illumination system configured to irradiate the cells with illumination light rays from the light source such that the light rays are obliquely tilted with respect to an optical axis of the imaging optical system and such that the contour portions of the cells are emphasized with cast shadows in the optical image of the cells.
10. The cell-image analyzing apparatus according to claim 3, wherein the cell-contour emphasizing position focusing system is configured so that the focus of the imaging optical system is first adjusted to a bottom surface of the vessel by the autofocusing mechanism, and then is shifted along an optical axis of the imaging optical system by a preset amount which is determined in accordance with a thickness of the cells that exist in the vessel.
11. The cell-image analyzing apparatus according to claim 10, wherein the cell-contour emphasizing illumination system comprises a tilted illumination system configured to irradiate the cells with illumination light rays from the light source such that the light rays are obliquely tilted with respect to an optical axis of the imaging optical system and such that the contour portions of the cells are emphasized with cast shadows in the optical image of the cells.
US12/724,753 2009-03-16 2010-03-16 Cell-image analyzing apparatus Expired - Fee Related US8965098B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009062608A JP5430188B2 (en) 2009-03-16 2009-03-16 Cell image analysis apparatus and method for capturing cell image
JP2009-062608 2009-03-16

Publications (2)

Publication Number Publication Date
US20100232674A1 US20100232674A1 (en) 2010-09-16
US8965098B2 true US8965098B2 (en) 2015-02-24

Family

ID=42730741

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/724,753 Expired - Fee Related US8965098B2 (en) 2009-03-16 2010-03-16 Cell-image analyzing apparatus

Country Status (2)

Country Link
US (1) US8965098B2 (en)
JP (1) JP5430188B2 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2758765B1 (en) * 2011-09-22 2020-08-12 FOCE Technology International B.V. Optical platelet counter method
JP6194791B2 (en) * 2013-12-27 2017-09-13 富士ゼロックス株式会社 Image processing apparatus and program
JP6219214B2 (en) 2014-03-31 2017-10-25 富士フイルム株式会社 Cell imaging control apparatus and method, and program
WO2017090741A1 (en) * 2015-11-25 2017-06-01 国立研究開発法人理化学研究所 Region detecting method and region detecting device related to cell aggregation
JPWO2018207361A1 (en) 2017-05-12 2020-03-12 オリンパス株式会社 Cell image acquisition device
JP7130109B2 (en) * 2019-03-04 2022-09-02 株式会社日立ハイテク Inspection device and inspection method

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001211896A (en) 1999-11-26 2001-08-07 Olympus Optical Co Ltd Image analysis method, device for it, and recording medium
US6716588B2 (en) * 1999-12-09 2004-04-06 Cellomics, Inc. System for cell-based screening
JP2004354650A (en) 2003-05-28 2004-12-16 Olympus Corp Microscopic observation method and microscope used therefor
JP2005003909A (en) 2003-06-11 2005-01-06 Japan Science & Technology Agency Thin layer oblique illumination method of optical system
JP2006271210A (en) 2005-03-28 2006-10-12 Olympus Corp Automatic cell-culturing device
JP2007041510A (en) 2005-06-28 2007-02-15 Olympus Corp Observation apparatus and observation system provided with the same
US20070206845A1 (en) * 2006-01-09 2007-09-06 Cytokinetics, Inc. Granularity analysis in cellular phenotypes
JP2008005768A (en) 2006-06-29 2008-01-17 Fujitsu Ltd Micro-injection apparatus and method for automatically adjusting focus
US7711174B2 (en) * 2004-05-13 2010-05-04 The Charles Stark Draper Laboratory, Inc. Methods and systems for imaging cells
US7796815B2 (en) * 2005-06-10 2010-09-14 The Cleveland Clinic Foundation Image analysis of biological objects
US20110019897A1 (en) * 2009-07-24 2011-01-27 Olympus Corporation Cell-image analyzing apparatus
US7907769B2 (en) * 2004-05-13 2011-03-15 The Charles Stark Draper Laboratory, Inc. Image-based methods for measuring global nuclear patterns as epigenetic markers of cell differentiation
US20110075928A1 (en) * 2009-09-25 2011-03-31 Jeong Hwan J High-resolution, common-path interferometric imaging systems and methods
US8086016B2 (en) * 2008-02-05 2011-12-27 Olympus Corporation Apparatus, a method and software for analyzing a cell image
US8179597B2 (en) * 2006-05-31 2012-05-15 Olympus Corporation Biological specimen imaging method and biological specimen imaging apparatus

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61164159A (en) * 1985-01-16 1986-07-24 Sumitomo Electric Ind Ltd Automatic measuring method of cell
JPS62201332A (en) * 1985-11-14 1987-09-05 Sumitomo Electric Ind Ltd Monitoring method for cell culture
JPH02245881A (en) * 1989-03-18 1990-10-01 Sumitomo Metal Ind Ltd Automatic cell analyzing device
JP2008139796A (en) * 2006-12-05 2008-06-19 Keyence Corp Fluorescence microscope, method of operating fluorescence microscope, fluorescence microscope operation program, computer-readable recording medium, and recorded equipment

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001211896A (en) 1999-11-26 2001-08-07 Olympus Optical Co Ltd Image analysis method, device for it, and recording medium
US6716588B2 (en) * 1999-12-09 2004-04-06 Cellomics, Inc. System for cell-based screening
JP2004354650A (en) 2003-05-28 2004-12-16 Olympus Corp Microscopic observation method and microscope used therefor
JP2005003909A (en) 2003-06-11 2005-01-06 Japan Science & Technology Agency Thin layer oblique illumination method of optical system
US7711174B2 (en) * 2004-05-13 2010-05-04 The Charles Stark Draper Laboratory, Inc. Methods and systems for imaging cells
US7920736B2 (en) * 2004-05-13 2011-04-05 The Charles Stark Draper Laboratory, Inc. Methods and systems for imaging cells
US7907769B2 (en) * 2004-05-13 2011-03-15 The Charles Stark Draper Laboratory, Inc. Image-based methods for measuring global nuclear patterns as epigenetic markers of cell differentiation
JP2006271210A (en) 2005-03-28 2006-10-12 Olympus Corp Automatic cell-culturing device
US7796815B2 (en) * 2005-06-10 2010-09-14 The Cleveland Clinic Foundation Image analysis of biological objects
US8068670B2 (en) * 2005-06-10 2011-11-29 The Cleveland Clinic Foundation Image analysis of biological objects
JP2007041510A (en) 2005-06-28 2007-02-15 Olympus Corp Observation apparatus and observation system provided with the same
US20070206845A1 (en) * 2006-01-09 2007-09-06 Cytokinetics, Inc. Granularity analysis in cellular phenotypes
US8179597B2 (en) * 2006-05-31 2012-05-15 Olympus Corporation Biological specimen imaging method and biological specimen imaging apparatus
JP2008005768A (en) 2006-06-29 2008-01-17 Fujitsu Ltd Micro-injection apparatus and method for automatically adjusting focus
US7936939B2 (en) * 2006-06-29 2011-05-03 Fujitsu Limited Microinjection apparatus and automatic focal point adjustment method
US8086016B2 (en) * 2008-02-05 2011-12-27 Olympus Corporation Apparatus, a method and software for analyzing a cell image
US20110019897A1 (en) * 2009-07-24 2011-01-27 Olympus Corporation Cell-image analyzing apparatus
US20110075928A1 (en) * 2009-09-25 2011-03-31 Jeong Hwan J High-resolution, common-path interferometric imaging systems and methods

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Kanji Yahiro: "Development of system for observation and evaluation of non-staining cells": Journal of Bioscience and Bioengineering: vol. 83. No. 9 (and English translation thereof).

Also Published As

Publication number Publication date
US20100232674A1 (en) 2010-09-16
JP5430188B2 (en) 2014-02-26
JP2010216920A (en) 2010-09-30

Similar Documents

Publication Publication Date Title
US12005443B2 (en) Apparatus and method for analyzing a bodily sample
US11262571B2 (en) Determining a staining-quality parameter of a blood sample
EP3436864B1 (en) Image processing device for identifying blood parasites
US8965098B2 (en) Cell-image analyzing apparatus
JP5259207B2 (en) Cell image analysis apparatus and method and software thereof
JP2012008450A (en) Microscope and focusing method
US8237785B2 (en) Automatic focusing apparatus for use in a microscope in which fluorescence emitted from a cell is captured so as to acquire a cell image, and automatic focusing method therefor
CN111504885B (en) Analysis method of full-automatic blood smear morphological analysis device based on machine vision
CN110709749B (en) Combined bright field and phase contrast microscope system and image processing apparatus equipped therewith
WO2010015563A1 (en) Imaging system and method for enhancing microscopic images of unstained cells
US20220383629A1 (en) Label-free cell classification and screening system based on hybrid transfer learning
CN106971141B (en) Cell region specifying method, cell imaging system, and cell image processing device
JP2021184769A (en) Cell suction support device and control method of cell suction support device
JP2018109707A (en) Microscope parameter setting method and observation method
CN114518362A (en) Sperm quality analysis device, system, method and readable storage medium
JP2021148793A (en) Method for determining characteristics of sample container in in-vitro diagnostics system, analyzing device, and in-vitro diagnostics system
WO2022047171A1 (en) Method and system for label-free imaging and classification of malaria parasites
JP6276220B2 (en) Imaging apparatus and imaging method
CN101583972B (en) Apparatus for determining positions of objects contained in a sample
JP2006226916A (en) Quantitative analyzer, analytical method, and analytical program

Legal Events

Date Code Title Description
AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AMAKAWA, GENTA;TAKAGI, KOSUKE;MATSUO, YUICHIRO;REEL/FRAME:024268/0700

Effective date: 20100409

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: CHANGE OF ADDRESS;ASSIGNOR:OLYMPUS CORPORATION;REEL/FRAME:039344/0502

Effective date: 20160401

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: EVIDENT CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OLYMPUS CORPORATION;REEL/FRAME:062492/0267

Effective date: 20221024

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230224