JP2010172673A - Endoscope system, processor for endoscope, and endoscopy aiding method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve smooth and accurate endoscopy by reducing a burden on a physician in detecting a lesion. <P>SOLUTION: A light source 50 for normal illumination light and a light source 51 for special illumination light irradiate normal illumination light and special illumination light alternately in accumulation period units of a solid imaging element 23. A lesion candidate detecting circuit 73 analyzes a special photographed image Pb by the special illumination light and detects a lesion candidate. An image composition processing circuit 74 forms a composite image Pd from the special photographed image Pb and a mark image Pc having a mark 80 indicating the lesion candidate detected by the lesion candidate detecting circuit 73. A display control circuit 45 makes a parallel display of a normal photographed image Pa by the normal illumination light and the composite image Pd on a monitor 18. The lesion can thereby be found without taking time, and accuracy in identifying the lesion candidate can be markedly improved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an endoscope system, an endoscope processor device capable of observing an observation site in a subject with normal illumination light such as white light and special illumination light such as infrared light, The present invention also relates to an endoscopy support method.

  Conventionally, inspection using an electronic endoscope has been widely used in the medical field. The electronic endoscope has a solid-state imaging device such as a CCD image sensor at the distal end of an insertion portion that is inserted into a body cavity (subject) of a patient. The electronic endoscope is connected to the processor device and the light source device via a cord and a connector.

  The processor device performs various processes on the imaging signal output from the solid-state imaging device, and generates an endoscopic image for diagnosis. The endoscopic image is displayed on a monitor connected to the processor device. The light source device has a white light source such as a xenon lamp and supplies illumination light for in-subject illumination to the electronic endoscope.

  In the field of medical diagnosis using an electronic endoscope, in order to facilitate the detection of lesions, not white light having a broad spectral characteristic in the visible light region (hereinafter referred to as normal illumination light), but a narrow wavelength band. Light (hereinafter referred to as special illumination light) is irradiated onto the site to be observed, and the reflected light from this is imaged (hereinafter, the image obtained in this way is distinguished from the normal captured image by the normal illumination light as a special captured image. A technique called Narrow Band Imaging (hereinafter abbreviated as “NBI”) is being spotlighted. According to NBI, it is possible to easily obtain an image in which blood vessels in the submucosal layer are emphasized, and an image in which organ structures such as stomach wall and intestinal surface tissue are emphasized.

  As a method for realizing NBI, a filter in which a filter unit for normal illumination light and a filter unit for special illumination light are integrated is arranged on an optical path of illumination light from a light source, and switching between doctors (operators) is performed. There has been proposed a technique in which a filter is mechanically moved by a motor or the like in accordance with an operation to obtain a normal captured image and a special captured image (see Patent Document 1).

Patent Document 1 describes that a mark indicating a lesion is usually input to one of special captured images via a touch panel or a mouse, and the input mark is reflected on the other image and displayed. Yes. Specifically, mark input information for one captured image is stored. Then, when switching to the other shooting, the stored input information is read, and a mark is inserted at a corresponding position in the other shooting image.
Japanese Patent Laid-Open No. 10-201700

  In Patent Document 1, the detection of a lesion depends on a doctor to the last, and the burden on the doctor cannot be reduced. In addition, there is no guarantee that the tip of the electronic endoscope or the site to be observed will not move from the time when the image is marked to the time when the other image is taken. And the mark input operation itself is wasted, and there is no significant effect when the mark positions are synchronized.

  Further, in NBI, there is a demand for ensuring diagnosis (identity) between a normal captured image and a special captured image and performing a diagnosis while comparing the images. If the imaging timing of two images may be greatly opened as in Patent Document 1, the simultaneity of the two images cannot be maintained because the synchronism of the two images cannot be maintained.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a smooth and accurate endoscopy by reducing the burden on a doctor for detecting a lesion.

  In order to achieve the above object, an endoscope system of the present invention includes a solid-state imaging device that captures image light of an observation site in a subject and outputs an imaging signal, normal illumination light, and normal illumination light. Is a set of illumination light generation means for irradiating special illumination light having different spectral characteristics and a set of images obtained by image light of normal illumination light and special illumination light based on imaging signals continuously output from the solid-state imaging device. An image generation unit that generates a normal captured image and a special captured image, a lesion candidate detection unit that analyzes a special captured image of a set of captured images and detects a lesion candidate that is a suspected lesion, and Display control means for simultaneously displaying on the monitor candidate lesions detected from a normal captured image of the captured image of the set and a special captured image corresponding to the normal captured image is provided.

  The display control means inserts a mark indicating a lesion candidate into at least one of a set of captured images. As the mark, in addition to simple symbols such as arrows, circles, and cross marks, a lesion candidate may be filled with a specific color, a lesion candidate may be bordered, or a fill or border may be blinked.

  In addition, the display control means can simultaneously display both of a set of captured images.

  The display control means performs either a parallel display of a normal captured image and a special captured image or a superimposed display of a normal captured image and a special captured image. The display control means displays at least a moving image of the normal captured image when displaying the normal captured image and the special captured image simultaneously. You may comprise so that selection of the parallel display of a normal picked-up image and a special picked-up image and the switch of a superimposition display is selectable. Each image may have the same display size, or one of them may be reduced. It is also possible to display a mark separately from each image.

  It is preferable that an operation input unit for selecting a lesion candidate mark and an electronic scaling processing unit for enlarging a portion where the selected mark is inserted in response to an operation input of the operation input unit. In this case, the display control means displays the image enlarged by the electronic scaling processing means. The image to be enlarged may be either a normal photographed image or a special photographed image.

  It is preferable to include a recording control unit that automatically records at least one of a set of captured images in a memory when a lesion candidate is detected by the lesion candidate detection unit. The trigger for automatically recording an image is not limited to when a recording instruction operation is performed or when a lesion candidate is detected by the lesion candidate detection means, but also when a mark is selected by the operation input means. I do not care. Further, a photographed image in which a mark is inserted may be recorded, and data on the position and size of a lesion candidate may be recorded as supplementary information of the photographed image.

  The sampling rate of the lesion candidate detection unit may be every time a set of captured images are generated by the image generation unit, or may be every fixed time longer than that. A lesion candidate may be detected according to an operation input.

  The display control means displays a message reporting that a lesion candidate has been detected by the lesion candidate detection means, separately from the lesion candidate. The message includes characters, icons, and the like.

  It is preferable to provide voice notification means for reporting by voice that a lesion candidate has been detected by the lesion candidate detection means.

  The illumination light generating means preferably includes a normal illumination light source that emits normal illumination light and a special illumination light source that emits special illumination light.

  Alternatively, the illumination light generating means includes a normal illumination light, a light source that emits illumination light including a wavelength band component of the special illumination light, a region that transmits the normal illumination light, and a region that transmits the special illumination light, It is preferable to include a filter rotatably disposed on the optical path of illumination light from the light source, and a rotation driving unit that rotates the filter in synchronization with the accumulation period of the solid-state imaging device.

  Alternatively, the illumination light generating means includes a first laser light source that emits a first laser light having a first wavelength as a center wavelength, and an optical fiber that transmits the first laser light incident on the light incident side. A first wavelength conversion material disposed on the light emitting side of the optical fiber and excited and emitted by a first laser beam, and a second laser having a second wavelength shorter than the first wavelength as a central wavelength A second laser light source for emitting light, an optical coupling means for introducing the second laser light into the optical path on the light incident side of the optical fiber, and provided in front of the optical path from the light emitting side of the optical fiber. A second wavelength conversion material that excites and emits light in a specific visible wavelength band longer than the second wavelength by the second laser light, and the first laser light and the excitation light emission from the first wavelength conversion material Mixing with light to obtain white light, excitation from the second wavelength conversion material It is preferred that from light to obtain a special illumination light.

  In addition, the endoscope system of the present invention is a special imaging device that captures image light of an observation site in a subject and outputs an imaging signal, normal illumination light, and normal illumination light that have different spectral characteristics. A set of normal captured images that are obtained by image light of normal illumination light and special illumination light based on the illumination light generating means for illuminating illumination light and the imaging signal output from the solid-state image sensor. An image generation means for generating a special photographed image, a lesion candidate detection means for analyzing a special photographed image of a set of photographed images and detecting a lesion candidate that is a suspected lesion, and a set of photographs Display control means for simultaneously displaying a normal captured image of the image and a lesion candidate detected from a special captured image corresponding to the normal captured image on a monitor is provided.

  The processor unit for an endoscope of the present invention is obtained based on image signals continuously output from a solid-state image sensor, using normal illumination light and image light of special illumination light having spectral characteristics different from those of normal illumination light. Image generation means for generating a set of normal captured images and special captured images, and lesion candidate detecting means for analyzing a special captured image of the set of captured images and detecting a lesion candidate that is a suspected lesion And a display control means for simultaneously displaying on the monitor candidate lesions detected from a normal captured image of the set of captured images and a special captured image corresponding to the normal captured image.

  The endoscopic inspection support method of the present invention includes solid-state imaging using normal illumination light and an illumination light generation step of irradiating the special illumination light having a spectral characteristic different from that of the normal illumination light with the illumination light generation means, and the image generation means. An image generation step for generating a set of normal photographic images and special photographic images obtained by image light of normal illumination light and special illumination light based on imaging signals continuously output from the element, and a set of photographic images A lesion candidate detection step of analyzing a specially-captured image and detecting a lesion candidate that is a suspicious portion as a lesion by the lesion candidate detecting means, and a normal imaging of a set of the captured images by the display control means And a display control step for simultaneously displaying on the monitor the lesion candidates detected from the image and the special captured image corresponding to the normal captured image.

  According to the present invention, a normal captured image by normal illumination light and a special captured image by special illumination light can be obtained substantially simultaneously, a lesion candidate is detected from the special captured image, and the normal captured image and the corresponding lesion candidate are detected. Are simultaneously displayed, the doctor can save the time and effort of detecting the lesion, and the accuracy of the examination can be increased by maintaining the simultaneity of the images. Therefore, it is possible to reduce the burden on the doctor for detecting the lesion and realize a smooth and accurate endoscopic examination.

  In FIG. 1, the endoscope system 2 includes an electronic endoscope 10, a processor device 11, and a light source device 12. As is well known, the electronic endoscope 10 includes a flexible insertion portion 13 that is inserted into a body cavity of a patient, an operation portion 14 that is connected to a proximal end portion of the insertion portion 13, a processor device 11, and a light source. A connector 15 connected to the apparatus 12, an operation unit 14, and a universal cord 16 that connects the connectors 15 are included.

  An observation window 20, an illumination window 21 (both see FIG. 2) and the like are provided at the distal end of the insertion portion 13. In the back of the observation window 20, a solid-state image sensor 23 for intra-body cavity imaging is disposed via an objective optical system 22 (see FIG. 2 for both). The illumination window 21 irradiates the observation site with illumination light from the light source 58 guided by the light guide 58 disposed in the universal cord 16 and the insertion portion 13 and the illumination lens 24 (both see FIG. 2). To do.

  The operation unit 14 includes an angle knob for bending the distal end of the insertion unit 13 in the vertical and horizontal directions, an air supply / water supply button for ejecting air and water from the distal end of the insertion unit 13, and an endoscopic image. There are provided operation members such as a release button 17 for recording a still image and a zoom button for instructing enlargement / reduction of the endoscopic image displayed on the monitor 18.

  Further, a forceps port through which a treatment tool such as an electric knife is inserted is provided on the distal end side of the operation unit 14. The forceps opening communicates with a forceps outlet provided at the distal end of the insertion portion 13 through a forceps channel in the insertion portion 13.

  The processor device 11 is electrically connected to the light source device 12 and comprehensively controls the operation of the endoscope system 2. The processor device 11 supplies power to the electronic endoscope 10 via the universal cord 16 or a transmission cable inserted into the insertion portion 13 and controls the driving of the solid-state imaging device 23. In addition, the processor device 11 receives the imaging signal output from the solid-state imaging device 23 via the transmission cable, and performs various processes on the received imaging signal to generate image data. The image data generated by the processor device 11 is displayed as an endoscopic image on the monitor 18 connected to the processor device 11 with a cable.

  In FIG. 2, the electronic endoscope 10 is provided with the above-described observation window 20, illumination window 21, objective optical system 22, solid-state imaging device 23, and illumination lens 24 at the distal end of the insertion portion 13. Further, an analog signal processing circuit (hereinafter abbreviated as AFE) 26, a drive circuit 27, and a CPU 28 are provided in the operation unit 14.

  The solid-state image sensor 23 is composed of an interline transfer type CCD image sensor, a CMOS image sensor, or the like. The solid-state imaging device 23 is arranged so that image light of an observation site in the body cavity that passes through the observation window 20 and the objective optical system 22 (consisting of a lens group and a prism) is incident on the imaging surface. On the imaging surface of the solid-state imaging device 23, a color filter composed of a plurality of color segments (for example, a primary color filter with a Bayer array) is formed.

  The AFE 26 includes a correlated double sampling circuit (hereinafter abbreviated as CDS) 29, an automatic gain control circuit (hereinafter abbreviated as AGC) 30, and an analog / digital converter (hereinafter abbreviated as A / D) 31. Yes. The CDS 29 performs correlated double sampling processing on the imaging signal output from the solid-state imaging device 23 to remove reset noise and amplifier noise generated in the solid-state imaging device 23. The AGC 30 amplifies the imaging signal from which noise has been removed by the CDS 29 with a gain (amplification factor) specified by the processor device 11. The A / D 31 converts the imaging signal amplified by the AGC 30 into a digital signal having a predetermined number of bits. The imaging signal digitized by the A / D 31 is input to the processor device 11 via the universal code 16 and the connector 15 and is stored in a working memory (not shown) of a digital signal processing circuit (hereinafter abbreviated as DSP) 40. Once stored.

  The driving circuit 27 generates a driving pulse (vertical / horizontal scanning pulse, reset pulse, etc.) for the solid-state imaging device 23 and a synchronization pulse for the AFE 26. The solid-state imaging device 23 performs an imaging operation according to the drive pulse from the drive circuit 27 and outputs an imaging signal. Each unit 29 to 31 of the AFE 26 operates based on a synchronization pulse from the drive circuit 27.

  After the electronic endoscope 10 and the processor device 11 are connected, the CPU 28 drives the drive circuit 27 and adjusts the gain of the AGC 30 based on an operation start instruction from the CPU 41 of the processor device 11.

  The CPU 41 controls the overall operation of the processor device 11. The CPU 41 is connected to each unit via a data bus, an address bus, and a control line (not shown). The ROM 42 stores various programs (OS, application programs, etc.) and data (graphic data, etc.) for controlling the operation of the processor device 11. The CPU 41 reads out necessary programs and data from the ROM 42, develops them in the RAM 43, which is a working memory, and sequentially processes the read programs. Further, the CPU 41 obtains information that changes for each examination, such as examination date and time, character information such as patient and surgeon information, from a network such as an operation unit 46 and a LAN (Local Area Network) described later, and stores them in the RAM 43.

  The DSP 40 reads the imaging signal from the AFE 26 from the work memory. The DSP 40 performs various signal processing such as color separation, color interpolation, gain correction, white balance adjustment, and gamma correction on the read image pickup signal to generate image data. Image data generated by the DSP 40 is input to a working memory (not shown) of a digital image processing circuit (hereinafter abbreviated as DIP) 44.

  The DIP 44 executes various image processes according to the control of the CPU 41. The DIP 44 reads the image data processed by the DSP 40 from the work memory. The DIP 44 performs various types of image processing such as electronic scaling, color enhancement, and edge enhancement on the read image data. The image data that has been subjected to various image processing by the DIP 44 is input to the display control circuit 45.

  The display control circuit 45 includes a VRAM 76 (see FIG. 3) that stores processed image data from the DIP 44. The display control circuit 45 receives graphic data in the ROM 42 and the RAM 43 from the CPU 41. The graphic data includes a display mask that hides the invalid pixel area of the endoscopic image and displays only the effective pixel area, character information such as examination date and time, patient and surgeon information, a graphical user interface (GUI). Interface). The display control circuit 45 performs various display control processes such as a display mask, character information, GUI superimposition processing, and drawing processing on the display screen of the monitor 18 on the image data from the DIP 44.

  The display control circuit 45 reads the image data from the VRAM 76 and converts the read image data into a video signal (component signal, composite signal, etc.) corresponding to the display format of the monitor 18. Thereby, an endoscopic image is displayed on the monitor 18. The configurations of the DIP 44 and the display control circuit 45 will be described in detail later.

  The operation unit 46 is an operation panel provided on the housing of the processor device 11 or a known input device such as a mouse or a keyboard. The CPU 41 operates each unit in response to an operation signal from the operation unit 46.

  In addition to the above, the processor device 11 receives compressed image data in conjunction with a compression processing circuit that performs image compression on the image data in a predetermined compression format (for example, JPEG format) or the operation of the release button 17. Media I / F for recording on removable media such as CF card, magneto-optical disk (MO), CD-R, network I / F for controlling transmission of various data with networks such as LAN (Local Area Network), etc. Is provided. These are connected to the CPU 41 via a data bus or the like.

  The light source device 12 has two light sources: a normal illumination light source (hereinafter abbreviated as a normal light source) 50 and a special illumination light source (hereinafter abbreviated as a special light source) 51. The normal light source 50 is a xenon lamp or a white LED (light emitting diode) that generates light having a broad wavelength from red to blue (for example, light having a wavelength band of 480 nm to 750 nm, hereinafter referred to as normal illumination light). . On the other hand, the special light source 51 generates light in a specific narrow wavelength band (hereinafter referred to as special illumination light) contrary to the normal light source 50, and is, for example, a blue LED or an LD (laser diode). The special light source 51 emits special illumination light in the vicinity of 450, 500, 550, 600, and 780 nm, alone or in combination.

  Imaging with special illumination light in the vicinity of 450 nm is suitable for observing the fine structure on the surface of the site to be observed, such as blood vessels and pit patterns on the surface layer. With illumination light in the vicinity of 500 nm, it is possible to observe a macro uneven structure such as a depression or a bulge in the observation site. Illumination light in the vicinity of 550 nm has a high absorption rate by hemoglobin, and is suitable for observation of fine blood vessels and redness, and illumination light in the vicinity of 600 nm is suitable for observation of thickening. The deep blood vessels can be observed clearly by injecting a fluorescent substance such as indocyanine green (ICG) intravenously and using illumination light in the vicinity of 780 nm.

  The light sources 50 and 51 are driven by light source drivers 52 and 53, respectively. The aperture mechanisms 54 and 55 are arranged on the light emission side of the light sources 50 and 51 and increase or decrease the amount of light incident on the condenser lenses 56 and 57. The condenser lenses 56 and 57 collect the light that has passed through the aperture mechanisms 54 and 55 and guide it to the incident end of the light guide 58.

  The CPU 59 communicates with the CPU 41 of the processor device 11 and controls the operation of the light source drivers 52 and 53 and the diaphragm mechanisms 54 and 55. The illumination light guided to the exit end of the light guide 58 is diffused by the illumination lens 24 and irradiated to the site to be observed in the body cavity through the illumination window 21.

  For example, the light guide 58 is formed by bundling a plurality of quartz optical fibers with a wound tape or the like. The two light guides 58a and 58b arranged on the light emission side of each of the light sources 50 and 51 are combined in the light source device 12 using a known optical fiber combining technique, and a single light guide 58 is combined. Become. Instead of dividing the light guide 58 into two branches 58a and 58b, two light guides may be provided for the light sources 50 and 51, respectively.

  The endoscope system 2 is provided with a normal imaging mode using normal illumination light, a special imaging mode using special illumination light, and a lesion candidate display mode. Switching between the modes is performed by operating the operation unit 46.

  When the normal shooting mode is selected, the CPU 41 controls the driving of the light source drivers 52 and 53 via the CPU 59 to turn on the normal light source 50 and turn off the special light source 51. The illumination light applied to the observation site is usually only illumination light. On the other hand, when the special photographing mode is selected, the CPU 41 controls driving of the light source drivers 52 and 53 via the CPU 59 to turn off the normal light source 50 and turn on the special light source 51. The illumination light irradiated to the site to be observed is only special illumination light.

  When the lesion candidate display mode is selected, the normal light source 50 and the special light source 51 are alternately turned on and off in units of the accumulation period of the solid-state image sensor 23. The illumination light applied to the site to be observed is sequentially switched between normal illumination light and special illumination light in units of accumulation periods of the solid-state imaging device 23. Alternatively, the normal light source 50 is turned on, and the special light source 51 is alternately turned on / off in units of the accumulation period of the solid-state imaging device 23. Alternatively, the normal light source 50 is turned on, and the wavelength of the light from the special light source 51 is switched in units of the accumulation period of the solid-state image sensor 23.

  In FIG. 3 showing the configuration of the DIP 44 and the display control circuit 45, the DIP 44 has a normal captured image processing circuit 70, a special captured image processing circuit 71, an electronic magnification processing circuit 72, and a lesion candidate detection circuit 73. An imaging signal obtained by irradiating normal illumination light and special illumination light is input to the normal captured image processing circuit 70 and the special captured image processing circuit 71, respectively. Each of the image processing circuits 70 and 71 generates an endoscopic image from the input imaging signal. Hereinafter, the endoscopic image generated by the normal captured image processing circuit 70 is referred to as a normal captured image Pa, and the endoscopic image generated by the special captured image processing circuit 71 is referred to as a special captured image Pb (both refer to FIG. 4).

  The electronic magnification processing circuit 72 performs electronic magnification processing on the normal captured image Pa or the special captured image Pb in accordance with the operation of the zoom button of the operation unit 14 of the electronic endoscope 10 or the like. When the zoom button or the like is not operated, the electronic magnification processing circuit 72 does not operate. Therefore, the normal captured image Pa or the special captured image Pb is output as it is input from the image processing circuits 70 and 71. .

  The lesion candidate detection circuit 73 operates when the lesion candidate display mode is selected. The lesion candidate detection circuit 73 analyzes the special captured image Pb from the special captured image processing circuit 71 and detects a portion suspected as a lesion in the special captured image Pb (hereinafter abbreviated as a lesion candidate). Specifically, information on the shape and color (which differs depending on the wavelength of the special illumination light) that is highly likely to be a lesion derived from past diagnosis results is stored in the ROM 42. Then, for each predetermined region (search area) of the special photographed image Pb, the degree of coincidence of the shape and color with the information stored in the ROM 42 is detected. At this time, detection is performed over the entire area of the special photographed image Pb while varying the size and angle of the search area. Then, a portion where the degree of coincidence exceeds a certain threshold is determined as a lesion candidate. It should be noted that the sampling rate for detecting lesion candidates may be every time the special captured image Pb is input, or every certain time longer than that. There may be an operation input instructing detection of a lesion candidate.

  The lesion candidate detection circuit 73, together with the special photographed image Pb that has been analyzed, an image representing the detected lesion candidate in a specific color (for example, white) (hereinafter referred to as a mark image Pc, see FIG. 4), or a lesion candidate Information representing the position and size in the special photographed image Pb is output. In the former case, the data of the mark image Pc is directly input to the image composition processing circuit 74 of the display control circuit 45. The image composition processing circuit 74 inserts the mark 80 (see FIG. 4) into the special captured image Pb by superimposing the special captured image Pb and the mark image Pc. In the latter case, the image composition processing circuit 74 performs processing for inserting the mark 80 into the special photographed image Pb based on the information indicating the position and size. The image composition processing circuit 74 may convert the information indicating the position and size into the mark image Pc. Hereinafter, the former case where the mark image Pc is output from the lesion candidate detection circuit 73 will be described as an example.

  In FIG. 4, the image composition processing circuit 74 first superimposes the special captured image Pb and the mark image Pc having the mark 80 in which the lesion candidate is filled with a specific color to form a composite image Pd (1). Next, the composite image Pd is reduced (2). Under the instruction of the CPU 41, the display control circuit 45 arranges the composite image Pd reduced in (2) on the upper right end of the normal captured image Pa and displays it in parallel (3).

  When no lesion candidate is detected by the lesion candidate detection circuit 73 and there is no mark image Pc, the image composition processing circuit 74 does not execute the process (1) and starts the process from (2). Note that the mark 80 may fill a lesion candidate with a specific color as in this example, or may border the lesion candidate or blink the border or border. Simple symbols such as arrows, circles, and crosses may be used.

  Returning to FIG. 3, the image output selection circuit 75 includes two switches SW1 and SW2. The on / off of each switch SW1, SW2 is interlocked with the switching of each mode by the operation of the operation unit 46. When the normal imaging mode is selected, SW1 is on, SW2 is off, when the special imaging mode is selected, SW2 is on, SW1 is off, and when the lesion candidate display mode is selected, both SW1 and SW2 are on It becomes.

  The output terminals of the electronic scaling processing circuit 72 and the image composition processing circuit 74 are connected to the input terminals of the switches SW1 and SW2, respectively. The output terminals of the switches SW1 and SW2 are connected to the digital / analog converter via the VRAM 76. (Hereinafter abbreviated as D / A) 77. A normal captured image Pa or an enlarged image thereof is input to the switch SW1, and a special captured image Pb or an enlarged image thereof or a reduced composite image Pd is input to the switch SW2. The image data that has passed through the image output selection circuit 75 is written in the VRAM 76, converted into an analog signal by the D / A 77, and output to the monitor 18.

  In the normal shooting mode and the special shooting mode, the display control circuit 45 displays only the moving image of the normal shooting image Pa or the special shooting image Pb on the monitor 18.

  When the zoom button is operated, the display control circuit 45 causes the monitor 18 to display an enlarged image that has been subjected to the electronic scaling process by the electronic scaling process circuit 72. Further, when the release button 17 is operated, the still image of the normal captured image Pa or the special captured image Pb is displayed, and the display of the moving image is again displayed after the lapse of the specified time.

  As shown in FIG. 5, in the lesion candidate display mode, the display control circuit 45 displays the normal captured image Pa and the composite image Pd in parallel on the monitor 18. As already shown in FIG. 4, the parallel display mode is a parent-child image display of the normal captured image Pa and the composite image Pd, both of which are moving images or the normal captured image Pa are moving images, and only the composite image Pd is displayed as a still image. Is done. The display size of the normal captured image Pa is the same as that in the normal capture mode.

  The mark 80 is inserted only when a lesion candidate is detected by the lesion candidate detection circuit 73. When only the composite image Pd is displayed as a still image, the display of the special captured image Pb and the mark 80 is updated each time a lesion candidate is newly detected by the lesion candidate detection circuit 73. When a plurality of lesion candidates are detected, a plurality of marks 80 are inserted.

  The mark 80 can be selected by operating the operation unit 46. When the mark 80 is selected, the electronic scaling processing circuit 72 obtains the position information of the mark 80 from the lesion candidate detection circuit 73 and the like, and automatically enlarges the periphery of the mark 80 at a predetermined magnification. . Thereby, the display on the monitor 18 is switched to the parallel display of the enlarged image of the normal captured image Pa and the composite image Pd shown in FIG. When the mark 80 is selected again, the display of FIG. 6 returns to FIG. The same applies when the zoom button is operated.

  Next, the operation of the endoscope system 2 configured as described above will be described. When observing the inside of a patient's body cavity with the electronic endoscope 10, the surgeon connects the electronic endoscope 10 and the devices 11 and 12, and turns on the power of the devices 11 and 12. Then, the operation unit 46 is operated to input information on the patient and instruct to start the examination.

  After instructing the start of the examination, the surgeon inserts the insertion portion 13 into the body cavity and monitors the endoscopic image in the body cavity by the solid-state imaging device 23 while illuminating the body cavity with the illumination light from the light source device 12. Observe at 18.

  The imaging signal output from the solid-state imaging device 23 is subjected to various processes by the units 29 to 31 of the AFE 26 and then input to the DSP 40 of the processor device 11. In the DSP 40, various signal processing is performed on the input image pickup signal, and image data is generated. The image data generated by the DSP 40 is output to the DIP 44.

  In the DIP 44, various image processing is performed on the image data from the DSP 40 under the control of the CPU 41. The image data processed by the DIP 44 is input to the VRAM 76 of the display control circuit 45. In the display control circuit 45, various display control processes are executed in accordance with the graphic data from the CPU 41. As a result, the image data is displayed on the monitor 18 as an endoscopic image.

  When the normal photographing mode is selected on the operation unit 46, under the instruction of the CPU 41, the normal light source 50 is turned on, the special light source 51 is turned off, and only the normal illumination light is irradiated on the site to be observed. Further, SW1 of the image output selection circuit 75 is turned on and SW2 is turned off. Naturally, only the moving image of the normal captured image Pa is displayed on the monitor 18.

  On the other hand, when the special photographing mode is selected, the normal light source 50 is turned off and the special light source 51 is turned on. Special illumination light is irradiated to the site to be observed. Also, SW2 of the image output selection circuit 75 is turned on and SW1 is turned off. Only the moving image of the special captured image Pb is displayed on the monitor 18.

  In step (hereinafter abbreviated as S) 10 in FIG. 7, when the lesion candidate display mode is selected by the operation unit 46, the normal light source 50 and the special light source 51 are turned off. Alternatively, the normal light source 50 is turned on, and the special light source 51 is alternately turned on and off in units of the accumulation period of the solid-state imaging device 23. Alternatively, the normal light source 50 is turned on, and the wavelength of the light from the special light source 51 is switched in units of the accumulation period of the solid-state imaging device 23. Both SW1 and SW2 of the image output selection circuit 75 are turned on. At the same time, the lesion candidate detection circuit 73 detects a lesion candidate of the special photographed image Pb. Further, a composite image Pd is generated by the image composition processing circuit 74, and parallel display of the normal captured image Pa and the composite image Pd is started (S11).

  When no lesion candidate is detected by the lesion candidate detection circuit 73 (no in S12), the mark image Pc is not output, and therefore the mark 80 is not inserted into the special photographed image Pb.

  On the other hand, when a lesion candidate is detected by the lesion candidate detection circuit 73 (yes in S12), as shown in S13, the mark 80 is placed at a corresponding portion of the special photographed image Pb (composite image Pd) by the image composition processing circuit 74. Inserted.

  The surgeon confirms that the mark 80 has appeared, and observes the corresponding portion of the mark 80 in the normal captured image Pa in detail. Further, the operation unit 46 is operated as necessary to select the mark 80 (yes in S14). When the mark 80 is selected, enlargement processing is automatically executed by the electronic scaling processing circuit 72, and the normal captured image Pa is switched to an enlarged image (S15). These series of processes are repeatedly executed until another mode is selected (Yes in S16) and the mode is changed to another mode (S17), or the inspection is completed and the power is turned off (Yes in S18).

  As described above, the normal captured image Pa and the special captured image Pb are acquired almost simultaneously, the lesion candidate is detected from the special captured image Pb, the normal captured image Pa and the composite image Pd are displayed in parallel, and the lesion candidate is displayed. Is indicated by the mark 80, so that the lesion can be found without taking time and effort.

  The special captured image Pb can detect a lesion that is difficult to find in the normal captured image Pa. Further, the normal photographed image Pa and the special photographed image Pb are kept in synchronism with a time difference of only one frame. Therefore, the corresponding portion of the normal captured image Pa indicated by the mark 80 is not shifted, and the identification accuracy of the lesion candidate can be significantly improved.

  Since the enlarged image is displayed when the mark 80 is selected, detailed observation of the lesion candidate can be assisted. Since the electronic zoom processing circuit is provided as standard in the DIP mounted on the general-purpose processor device, it can be used as it is. Note that the special captured image Pb may be enlarged to display an enlarged image of the special captured image Pb.

  When the mark 80 appears, the currently observed image has a relatively high utility value as a material for diagnosis. Therefore, the surgeon has a high probability of operating the release button 17 to record a still image. For this reason, when a lesion candidate is detected by the lesion candidate detection circuit 73, it is preferable to automatically perform still image recording of the normal captured image Pa and the special captured image Pb.

  Specifically, in response to detection of a lesion candidate by the lesion candidate detection circuit 73, the CPU 41 controls the operation of the media I / F and the like, and the still image of the normal captured image Pa or the special captured image Pb is removed as a removable medium. To record. The trouble of operating the release button 17 can be saved. Still image recording may be executed when the mark 80 is selected and the display is switched to an enlarged image, not when a lesion candidate is detected. Further, a photographed image in which the mark 80 is inserted may be recorded, and data on the position and size of a lesion candidate may be recorded as supplementary information of the photographed image.

  In the above embodiment, as an example of display, a parent / child image of a normal captured image Pa or an enlarged image and one composite image Pd is cited. By doing so, it is possible to individually observe the normal captured image Pa and the special captured image Pb. However, the present invention is not limited to this, and for example, the display forms shown in FIGS. Good.

  In the display form shown in FIG. 8, the normal captured image Pa and the composite images Pd1 and Pd2 are arranged. The composite images Pd1 and Pd2 are displayed side by side when the lesion candidate detection circuit 73 detects two lesion candidates. In this case, two mark images Pc are generated according to each location. The image composition processing circuit 74 superimposes the two mark images Pc and the special captured image Pb to generate composite images Pd1 and Pd2. When three or more lesion candidates are detected, three or more composite images Pd are displayed side by side as long as the display range allows.

  Even in a configuration in which a plurality of types of special captured images Pb can be acquired, a plurality of composite images Pd corresponding to the plurality of types of special captured images Pb are generated and displayed side by side as in the case of FIG. May be. As in the above-described embodiment, there is a difficulty in visibility when a plurality of marks 80 are inserted into the composite image Pd having a relatively small display size even in the eyelids. However, if the display form of FIG. It becomes easy to distinguish. In particular, when generating a plurality of composite images Pd corresponding to a plurality of types of special captured images Pb, as described in paragraph [0042], the observation target differs depending on the special captured image Pb. Can be visually discriminated.

  The display form shown in FIG. 9 is a two-divided image in which a normal captured image Pa and a composite image Pd having the same display size are arranged side by side. The display size of each image is slightly smaller than the normal captured image Pa in the normal shooting mode. In this case, the magnification of the reduction process shown in FIG. 4B is increased, and the reduction process is performed on each of the normal captured image Pa and the composite image Pd. Compared to the above-described embodiment, the display size of the composite image Pd, and hence the special captured image Pb, is increased, and therefore the special captured image Pb can be observed in the same manner as the normal captured image Pa. Further, the corresponding portion of the normal photographed image Pa indicated by the mark 80 is easy to understand.

  The display form shown in FIG. 10 is a superposition of the normal captured image Pa and the composite image Pd. The display size of each image is the same as the normal captured image Pa in the normal shooting mode. In this case, the reduction process shown in FIG. 4 (2) is not performed, and the superimposition process of (1) is applied to the normal captured image Pa and the composite image Pd. Although the normal captured image Pa and the special captured image Pb cannot be individually observed, the corresponding portion of the normal captured image Pa indicated by the mark 80 can be identified most reliably.

  In FIG. 11, the normal captured image Pa and the composite image Pd shown in FIG. 5 and the enlarged images of the normal captured image Pa are reduced and arranged vertically and displayed on the monitor 18. In this case, after the process shown in FIG. 4 is executed, the normal captured image Pa, the composite image Pd, and the enlarged image are reduced. The entire normal captured image Pa and the local area can be grasped at the same time, and the convenience of inspection can be further enhanced.

  In addition, the display form of each image shown so far is an example, and various deformation | transformation are possible. For example, instead of arranging the composite image Pd outside the normal captured image Pa (parallel display) as in the above-described embodiment, a reduced image of the composite image Pd is superimposed on the normal captured image Pa to generate a so-called nested image (picture In-picture, PinP). Moreover, in order to enable display according to the operator's intention, each display form exemplified above may be configured to be selectable.

  The mark image Pc may be displayed instead of the composite image Pd without superimposing the special captured image Pb and the mark image Pc. In this case, by adding a grid to the display mask or the like, the corresponding portion of the mark 80 of the normal captured image Pa is easily understood.

  Furthermore, a plurality of monitors may be prepared, and a multi-monitor format may be employed, such that the first unit is for displaying the normal captured image Pa and the second unit is for displaying the composite image Pd.

  In the above embodiment, the fact that a lesion candidate has been detected is only reported by the appearance of the mark 80. In addition, as shown in FIG. 12, a message indicating that a lesion candidate has been detected is displayed. (In addition to the characters in this example, a notification icon may be blinked, etc.) may be displayed in a pop-up window 82, or may be reported by a voice message or a beep through the speaker 18a of the monitor 18 (see FIG. 2). Good.

  When the special shooting mode is selected, the normal light source 50 and the special light source 51 are not alternately turned on and off as in the above embodiment, but the normal light source 50 is turned off, only the special light source 51 is turned on, and the special light source 50 is turned on. A captured image Pb may be obtained.

  In the above embodiment, the normal illumination light and the special illumination light are generated using the two light sources 50 and 51, but the present invention is not limited to this. For example, an LED or LD that can change the oscillation wavelength of the illumination light according to the drive current may be used. Since only one light source is required, it is possible to contribute to the reduction of parts cost and installation space.

  A light source device 85 shown in FIG. 13 may be used. The basic configuration of the light source device 85 is the same as that of the light source device 12, but a disk-shaped filter 86 in which a normal illumination light filter unit and a special illumination light filter unit are integrated, and a rotation shaft 86 a of the filter 86. The motor 87 connected, the motor driver 88 which controls the drive of the motor 87, and the position sensor 89 which detects the rotation position of the filter 86 are provided. Further, a halogen lamp that emits white light is used as the light source 90, and the light guide 58 is used as one light source.

  In FIG. 14, the filter 86 includes, for example, a first normal illumination light transmission region 95, a second normal illumination light transmission region 96, a blue light transmission region 97, a green light transmission region 98, an infrared light transmission region 99, and a first light shielding. A region 100 and a second light shielding region 101 are provided. Each of these regions 95 to 101 has a sector shape having a predetermined central angle, and the central angles of the first and second normal illumination light transmission regions 95 and 96 are θ1, θ2 (θ1> θ2), and blue light transmission, respectively. The region 97, the green light transmission region 98, and the infrared light transmission region 99 are α, β, γ, and the first and second light shielding regions 100 and 101 are ω.

  The first and second normal illumination light transmission regions 95 and 96 transmit the wavelength band component of white light from the light source 90, that is, normal illumination light. The blue light transmission region 97, the green light transmission region 98, and the infrared light transmission region 99 select light of a narrow wavelength band near 450 nm, 550 nm, and 780 nm, that is, special illumination light, from the white light from the light source 90, respectively. Transparent. The special illumination light that passes through each of the regions 97 to 99 has a half-value width that is narrower than the wavelength band to which each of the RGB pixels of the solid-state image sensor 23 is sensitive. The first and second light shielding regions 100 and 101 shield the illumination light corresponding to the readout period of the solid-state imaging device 23.

  The filter 86 is divided into a first compartment 102 and a second compartment 103. In the first section 102, a first light shielding region 100, a blue light transmission region 97, and a first normal illumination light transmission region 95 are sequentially arranged along the rotation direction 104 of the filter 86. In the second section 103, a second light shielding region 101, an infrared light transmission region 99, a green light transmission region 98, and a second normal illumination light transmission region 96 are sequentially arranged along the rotation direction 104.

  The filter 86 is rotated once for two imaging operations of the solid-state imaging device 23 by the motor 87 under the control of the motor driver 88 based on the detection result of the position sensor 89 (one imaging of the solid-state imaging device 23). Rotated 180 degrees). For this reason, during one imaging, each region provided in the first section 102 or the second section 103 traverses the front surface of the light source 90 in order, and the illumination light whose wavelength, amount of transmitted light, etc. are modulated is observed. Is irradiated.

  More specifically, as shown in FIG. 15, in the first imaging accumulation period T1 of the solid-state imaging device 23, the first normal illumination light transmission region 95 and the blue light transmission region 97 of the first section 102 are followed by the readout period t1. The first light-shielding region 100, the second normal illumination light transmission region 96, the green light transmission region 98, and the infrared light transmission region 99 in the second imaging period T2, and the second reading period t2 in the second reading period t2. The filter 86 is rotated so that the light shielding regions 101 each cross the front of the light source 90.

  Accordingly, in the first half of imaging, signal charges due to normal illumination light and blue light are accumulated in each pixel of the solid-state imaging device 23. In the latter half of imaging, signal charges due to fluorescence generated by normal illumination light, green light, and infrared light are accumulated. Hereinafter, the image data obtained by the first half imaging is referred to as the first half image data, and the image data obtained by the second half imaging is referred to as the second half image data.

  The first half of the image data is superimposed with the image light of the observation site by normal illumination light and blue light, and the second half of the image data is the observation site by fluorescence generated by normal illumination light, green light, and infrared light. Image light is superimposed. The DIP 44 extracts the RGB color components from the two image data, compares them, and calculates them, thereby calculating the pixel value of the normal illumination light and the pixel value of the special illumination light of each color, respectively. Pa and special captured image Pb are generated.

  In the above comparison and calculation, the ratio of the illumination light amount of the normal illumination light by the first and second normal illumination light transmission regions 95 and 96 is used. For example, the B pixel value of the first half image data is composed of the image light of the observed portion of the normal illumination light (the blue component thereof) from the first normal illumination light transmission region 95 and the blue light from the blue light transmission region 97. On the other hand, the B pixel value of the second half image data is only the normal illumination light (blue component thereof) from the second normal illumination light transmission region 96. For this reason, when the illumination light amount of the normal illumination light by the first normal illumination light transmission region 95 is x times that of the second normal illumination light transmission region 96, the B pixel value of the second half image data is multiplied by x, By subtracting from the B pixel value of the first half image data, the B pixel value by blue light can be calculated.

  In the case of green light and infrared light, since the pixel value of the first half image data is composed only of the normal illumination light from the first normal illumination light transmission region 95 in contrast to the blue light, the pixel value of the first half image data is set to 1 / x. Doubled and subtracted from the pixel value of the second half image data. As the pixel value by the normal illumination light, an appropriate one of the color pixel values of the first and second half image data may be used, such as the first half image data for the B pixel value and the second half image data for the G and R pixel values. .

  As a method of changing the illumination light amount of the normal illumination light by the first and second normal illumination light transmission regions 95 and 96, the central angle, that is, the area, in other words, the length of time crossing the front surface of the light source 90, or the transmittance Adjust at least one of the

  The configuration of the filter is not limited to the above example. For example, the first section 102 may be only the first normal illumination light transmission area 95, and the blue light transmission area 97 may be disposed in the second section 103. Alternatively, two or more sections may be used, and usually both special captured images may be generated from image data for two or more frames.

  Note that if the filter is configured with an adapter that can be attached to and detached from the distal end of the insertion portion 13 of the electronic endoscope 10, it can be applied to a conventional endoscope system having a white light source such as a xenon lamp only by changing the software. can do.

  Moreover, you may use the light source device 111 of the endoscope system 110 shown in FIG. The light source device 111 includes a blue laser light source (first laser light source) 121 having a center wavelength of 445 nm, a near ultraviolet laser light source (second laser light source) 122 having a center wavelength of 375 nm, a blue laser light source 121 and a near ultraviolet laser light source 122. Collimator lenses 123 and 123 that collimate the laser beams, a polarization beam splitter 124 that is an optical coupling unit that combines the two laser beams, and a polarization beam splitter 124 multiplex them on the same optical axis. A condensing lens 125 for condensing the laser light and a light guide 58. The CPU 59 functions as a control unit that controls the turning on and off of each laser beam via the light source drivers 52 and 53 using the blue laser light source 121 and the near ultraviolet laser light source 122.

  The laser light from the blue laser light source 121 and the laser light from the near-ultraviolet laser light source 122 are combined by the polarization beam splitter 124 and are incident on the incident end of the light guide 58 by the condenser lens 125. The light guide 58 propagates the incident laser light to the distal end side of the insertion portion 13 of the electronic endoscope 10.

  On the other hand, on the light emitting side of the light guide 58, a condenser lens 131 is disposed, and a wavelength conversion member 135 in which a first wavelength conversion material and a second wavelength conversion material are integrated is disposed. The wavelength conversion member 135 is a block of blocks formed integrally by dispersing and arranging a plurality of types of fluorescent materials. The first wavelength conversion material that constitutes the wavelength conversion member 135 has a plurality of types of phosphors that absorb part of the laser light from the blue laser light source 121 and excite and emit green to yellow light. As a result, the laser light from the blue laser light source 121 and the green to yellow excitation light converted from the laser light are combined to generate white light, that is, normal illumination light.

  The second wavelength conversion material constituting the wavelength conversion member 135 absorbs the laser light from the near-ultraviolet laser light source 122 and emits green light by excitation. Examples of materials that emit green light include LiTbW2O8, which is a green phosphor (Yoji Tsutomu Oda, “About phosphors for white LEDs”, IEICE Technical Report ED2005-28, CFM2005-20, SDM2005-28). , pp.69-74 (2005-05)) and beta-sialon (Eu) blue phosphor (Naoto Hirosaki, "Temperature dependence of oxynitride and nitride phosphors for white light-emitting diodes" 53rd Applied Physics Related Lecture Proceedings) etc. can be used. The wavelength conversion member 135 is formed by integrally dispersing and arranging phosphors included in the first wavelength conversion material and the second wavelength conversion material. In addition to randomly dispersing each phosphor, for example, the first wavelength conversion material and the second wavelength conversion material are each made into a minute block, and these phosphor blocks are joined to each other. Appropriate changes can be made accordingly.

  With the above configuration, each laser beam emitted from the light guide 58 is applied to the wavelength conversion member 135. The wavelength conversion member 135 absorbs part of the blue laser light from the blue laser light source 121 by the second wavelength conversion material, and excites and emits light having a wavelength longer than the blue laser light (green to yellow light). Then, the light is combined with the laser light from the blue laser light source 121 to generate white light, that is, normal illumination light. The wavelength conversion member 135 absorbs part or all of the near-ultraviolet laser light from the near-ultraviolet laser light source 122 by the second wavelength conversion material, and excites and emits narrow band green light and blue light. Illumination light is generated. As a result, normal illumination light by white light resulting from the combination of green to yellow light and blue laser light excited by the first wavelength conversion material, and narrow-band green light and blue light excited by the second wavelength conversion material The special illumination light is emitted in front of the optical path.

  When the normal photographing mode is selected, the CPU 41 controls the light source drivers 52 and 53 via the CPU 59 to turn on the blue laser light source 121 and turn off the near ultraviolet laser light source 122. The blue laser light emitted from the light guide 58 is applied to the wavelength conversion member 135, and the first to wavelength conversion material of the wavelength conversion member 135 combines the green to yellow excitation light emission and the blue laser light to produce white light. (Normal illumination light) is generated. Since this white light is irradiated to the site to be observed, the illumination light is only normal illumination light.

  On the other hand, when the special photographing mode is selected, the CPU 41 controls the driving of the light source drivers 52 and 53 via the CPU 59 to turn off the blue laser light source 121 and turn on the near ultraviolet laser light source 122. The near-ultraviolet laser light emitted from the light guide 58 is applied to the wavelength conversion member 135, and the second wavelength conversion material of the wavelength conversion member 135 absorbs part or all of the near-ultraviolet laser light, so that the narrow-band green color is obtained. Excitation emission (special illumination light) to light and blue light. Since the narrow-band green light and blue light are irradiated to the site to be observed, the illumination light is only the special illumination light.

  When the lesion candidate display mode is selected, the blue laser light source 121 and the near-ultraviolet laser light source 122 are alternately turned on and off in units of the accumulation period of the solid-state imaging device 23. The illumination light applied to the site to be observed is sequentially switched between normal illumination light and special illumination light in units of accumulation periods of the solid-state imaging device 23. Alternatively, the blue laser light source 121 is turned on, and the near-ultraviolet laser light source 122 is alternately turned on and off in units of the accumulation period of the solid-state imaging device 23. Even in such a configuration, it is possible to obtain the same effect as in the above embodiment.

  In the above embodiment, a special captured image is usually generated based on an imaging signal for at least two frames continuously output from the solid-state imaging device, but the present invention is not limited to this. Normally, if the interval of the special captured image can be kept at the same level and does not cause a sense of incongruity by visual recognition, for example, a special captured image is usually generated from an imaging signal having an interval of several to several tens of frames. Also good.

  In the above embodiment, the electronic endoscope 10 is illustrated as an endoscope, but an ultrasonic endoscope having an ultrasonic transducer disposed at the tip may be used.

It is an external view which shows the structure of an endoscope system. It is a block diagram which shows the structure of an endoscope system. It is a block diagram which shows the detailed structure of a digital image processing circuit and a display control circuit. It is a figure which shows typically the process of a display control circuit. It is a figure which shows the display form of the normal picked-up image and a synthesized image in a lesion candidate display mode. It is a figure which shows the display form of the enlarged image of a normal picked-up image, and a synthesized image in lesion candidate display mode. It is a flowchart which shows the process sequence in a lesion candidate display mode. It is a figure which shows another display form of a normal picked-up image and a synthesized image. It is a figure which shows another display form of a normal picked-up image and a synthesized image. It is a figure which shows another display form of a normal picked-up image and a synthesized image. It is a figure which shows the display form of a normal picked-up image, a synthesized image, and an enlarged image. It is a figure which shows the state which displayed the pop-up window which shows having detected the lesion candidate. It is a block diagram which shows another form of a light source device. It is a figure which shows the structure of a filter. It is a timing chart which shows the imaging operation of a solid-state image sensor, and the operation of a filter. It is a block diagram which shows the form of another light source device using a laser light source.

2,110 Endoscope system 10 Electronic endoscope 11 Processor unit 12, 85, 111 Light source unit 18 Monitor 18a Speaker 23 Solid-state image sensor 40 Digital signal processing circuit (DSP)
41 CPU
44 Digital Image Processing Circuit (DIP)
45 Display control circuit 46 Operation unit 50, 51 Light source for special illumination light (usually special light source)
70, 71 Normal, specially-photographed image processing circuit 72 Electronic scaling processing circuit 73 Lesion candidate detection circuit 74 Image composition processing circuit 80 Mark 82 Pop-up window 86 Filter 87 Motor 90 Light source 95, 96 First, second normal illumination light transmission region 97, 98, 99 Blue light, green light, infrared light transmission region 121 Blue laser light source 122 Near ultraviolet laser light source 124 Polarizing beam splitter 135 Wavelength conversion member

Claims (15)

A solid-state imaging device that captures image light of an observation site in a subject and outputs an imaging signal;
Illumination light generating means for irradiating normal illumination light and special illumination light having spectral characteristics different from that of normal illumination light;
Based on imaging signals continuously output from the solid-state imaging device, a set of normal captured images obtained by image light of normal illumination light and special illumination light, image generation means for generating a special captured image;
A lesion candidate detecting means for analyzing a special captured image of a set of captured images and detecting a lesion candidate which is a suspected lesion;
An endoscopic system comprising: a normal control image of a set of captured images and a display control means for simultaneously displaying on a monitor a lesion candidate detected from a special captured image corresponding to the normal image. .   The endoscope system according to claim 1, wherein the display control unit inserts a mark indicating a lesion candidate into at least one of a set of captured images.   The endoscope system according to claim 2, wherein the display control unit displays both of a set of captured images at the same time.   The endoscope system according to claim 3, wherein the display control unit performs either a parallel display of a normal captured image and a special captured image, or a superimposed display of a normal captured image and a special captured image.   The endoscope system according to claim 3 or 4, wherein the display control unit displays at least a moving image of the normal captured image when the normal captured image and the special captured image are displayed simultaneously. Operation input means for selecting a lesion candidate mark;
An electronic scaling processing means for enlarging a portion where the selected mark is inserted in response to an operation input of the operation input means,
6. The endoscope system according to claim 2, wherein the display control unit displays an image enlarged by the electronic scaling processing unit.   7. A recording control unit that automatically records at least one of a set of captured images in a memory when a lesion candidate is detected by the lesion candidate detection unit. The endoscope system according to Crab.   The endoscopy according to any one of claims 1 to 7, wherein the display control means displays a message reporting that a lesion candidate is detected by the lesion candidate detection means, separately from a lesion candidate. Mirror system.   The endoscope system according to any one of claims 1 to 8, further comprising voice notification means for reporting by voice that a lesion candidate has been detected by the lesion candidate detection means.   The endoscope according to any one of claims 1 to 9, wherein the illumination light generating means includes a light source for normal illumination light that emits normal illumination light and a light source for special illumination light that emits special illumination light. system. The illumination light generating means includes a light source that emits illumination light including wavelength components of normal illumination light and special illumination light, and
A filter that is configured of a region that transmits normal illumination light and a region that transmits special illumination light, and is disposed rotatably on the optical path of the illumination light from the light source;
The endoscope system according to any one of claims 1 to 9, further comprising: a rotation driving unit that rotates the filter in synchronization with an accumulation period of the solid-state imaging device. The illumination light generation means includes a first laser light source that emits a first laser light having a first wavelength as a center wavelength;
An optical fiber that transmits the first laser beam incident on the light incident side; and
A first wavelength conversion material disposed on the light exit side of the optical fiber and excited and emitted by a first laser beam;
A second laser light source that emits a second laser light having a second wavelength shorter than the first wavelength as a central wavelength;
Optical coupling means for introducing a second laser beam into the optical path on the light incident side of the optical fiber;
A second wavelength conversion material that is provided in front of the optical path from the light exit side of the optical fiber, and that excites and emits light in a specific visible wavelength band longer than the second wavelength by the second laser light;
The first laser light and the excitation light emitted from the first wavelength conversion material are mixed to obtain white light, and the special illumination light is obtained from the excitation light emission from the second wavelength conversion material. The endoscope system according to any one of Items 1 to 9. A solid-state imaging device that captures image light of an observation site in a subject and outputs an imaging signal;
Illumination light generating means for irradiating normal illumination light and special illumination light having spectral characteristics different from that of normal illumination light;
An image generation means for generating a set of normal captured images and special captured images that are obtained by normal illumination light and image light of special illumination light based on an imaging signal output from the solid-state image sensor; ,
A lesion candidate detecting means for analyzing a special captured image of a set of captured images and detecting a lesion candidate which is a suspected lesion;
An endoscopic system comprising: a normal control image of a set of captured images and a display control means for simultaneously displaying on a monitor a lesion candidate detected from a special captured image corresponding to the normal image. . Based on imaging signals output continuously from the solid-state image sensor, a set of normal and special images obtained from normal illumination light and special illumination light that has different spectral characteristics from normal illumination light. Image generating means for generating;
A lesion candidate detecting means for analyzing a special captured image of a set of captured images and detecting a lesion candidate which is a suspected lesion;
A display control means for simultaneously displaying a normal captured image of a set of captured images and a lesion candidate detected from a special captured image corresponding to the normal captured image on a monitor; Processor device. Illumination light generation step of irradiating normal illumination light and special illumination light having spectral characteristics different from that of normal illumination light with the illumination light generation means;
An image generation step for generating a set of normal captured images and special captured images obtained by image light of normal illumination light and special illumination light based on image signals continuously output from the solid-state image sensor by the image generation means When,
A lesion candidate detection step of analyzing a special captured image of the set of captured images and detecting a lesion candidate that is a portion suspected of being a lesion by the lesion candidate detection means;
The display control means comprises a display control step for simultaneously displaying on the monitor candidate lesions detected from a normal captured image of a set of captured images and a special captured image corresponding to the normal captured image. Endoscopy support method.

Images