JPWO2012042966A1 - Image display device, image display method, and image display program - Google Patents

Abstract

An image display device 4 according to the present invention is an image display device having a display unit 12 capable of still image display of an image picked up inside the body or continuous reproduction of still images. A contour emphasis processing unit 163 that performs contour emphasis processing and a display control unit 161 that causes the display unit 12 to display an image that has undergone the contour emphasis processing by the contour emphasis processing unit 163 are provided. By changing the emphasis level, an image that has been subjected to the contour emphasis process at an optimum emphasis level that is easy to observe both during continuous playback of still images and during still image display is displayed.

Description

  The present invention relates to an image display device, an image display method, and an image display program for continuously reproducing still images obtained by imaging the inside of the body.

  In recent years, in the field of endoscopes, capsule endoscopes, which are swallowable endoscopes that are provided with an imaging function and a wireless communication function, have appeared, and a subject that has been imaged by the capsule endoscope has been introduced. A capsule endoscope system that acquires an image in a specimen has been developed. The capsule endoscope is taken from the subject's mouth for observation (examination) until it is naturally excreted from the subject. Is moved in accordance with the peristaltic motion and functions to image the inside of the subject at intervals of 0.5 seconds (see, for example, Patent Document 1).

  While the capsule endoscope moves in the subject, images captured by the capsule endoscope are sequentially transmitted to the outside by wireless communication and received by the receiving device via the receiving antenna provided outside. Is done. This receiving apparatus can acquire an image in a subject by a capsule endoscope by reconstructing an image based on radio signals sequentially received via a receiving antenna. This receiving apparatus sequentially stores acquired images in a memory. The subject can freely move from swallowing the capsule endoscope to naturally discharging by carrying the receiving device having the wireless communication function and the memory function. Thereafter, an examiner such as a doctor or a nurse causes the image display device to capture an image stored in the memory of the receiving device, and an image in the subject based on the obtained image, for example, an organ image, is displayed on the display of the image display device. Display. The examiner can observe the organ image displayed on the display and diagnose the subject.

  An image captured by the capsule endoscope is a still image. In general, an image display device has a processing function of continuously reproducing a series of still images captured by a capsule endoscope along a time series.

  As the above-described image display apparatus, there is also known an apparatus that performs contour emphasis processing for emphasizing a frequency band that constitutes a notable structural component when displaying an image in order to facilitate inspection. (For example, refer to Patent Document 2). In such an image display device, the inspector can freely set the enhancement level of the contour enhancement process so that the image can be observed with a desired resolution.

JP 2006-280792 A JP-A-8-313823

  The image captured by the capsule endoscope is not a moving image but a still image captured at a predetermined interval. When an image display device that performs contour enhancement processing continuously reproduces such still images, the structural component that is enhanced changes each time the image is switched, so the contour of the structural component is excessively emphasized and observed. There is a problem that the burden on the inspector who observes a large number of images is increased.

  The present invention has been made in view of the above, and an object of the present invention is to provide an image display device, an image display method, and an image display program that can reduce the burden on an examiner who observes a large amount of images.

  In order to solve the above-described problems and achieve the object, an image display apparatus according to the present invention is an image display apparatus having display means capable of displaying still images of images taken inside the body or continuously reproducing still images. And an edge enhancement processing unit that performs an edge enhancement process on the image according to a display mode; and a display control unit that causes the display unit to display an image on which the edge enhancement process has been performed by the edge enhancement processing unit. It is characterized by having.

  Further, in the image display device according to the present invention, the contour emphasis processing means lowers the emphasis level of the contour emphasis processing for the image to be continuously reproduced than the emphasis level for the still image display target image. .

  Further, the image display device according to the present invention is characterized in that the contour emphasis processing means does not perform the contour emphasis processing when performing continuous reproduction of still images.

  In the image display device according to the present invention, the contour emphasis processing means changes the emphasis level of the contour emphasis processing for the still image continuous reproduction image according to the display rate of the still image continuous reproduction. And

  Further, in the image display device according to the present invention, the contour enhancement processing means is configured to perform the contour enhancement processing based on a correspondence relationship between a display rate of continuous reproduction of still images obtained in advance and the enhancement level of the contour enhancement processing. The emphasis level is changed.

  Further, the image display device according to the present invention detects the amount of motion of the pixel area set on each image, and sets the display rate for continuous playback of still images of each image according to the detected amount of motion. And display rate setting means associated with each image.

  Further, the image display device according to the present invention detects the amount of motion of the pixel area set on each image, and sets the display rate for continuous playback of still images of each image according to the detected amount of motion. Display rate setting means associated with each image, and an emphasis level of the contour emphasis processing at the time of continuous reproduction is set according to the display rate of each image associated with the display rate setting means, and the contour associated with each image And an emphasis level setting means.

  The image display device according to the present invention is characterized in that the image has an imaging means and is captured by a capsule medical device introduced into the body.

  The image display method according to the present invention is an image display method in which an image captured inside the body is displayed as a still image or a continuous reproduction of a still image on the display means. The image is subjected to contour enhancement processing according to the display mode. A contour enhancement processing step to be performed; and a display step of causing the display means to continuously reproduce the image on which the contour enhancement processing has been performed in the contour enhancement processing step.

  An image display program according to the present invention is an image display program for causing an image captured inside the body to be displayed as a still image or to continuously reproduce a still image, and to perform an edge enhancement process according to the display mode on the image. A contour enhancement processing procedure to be performed, and a display procedure for causing the display means to continuously reproduce the image subjected to the contour enhancement processing in the contour enhancement processing procedure.

  According to the present invention, the enhancement level of the outline enhancement process is changed according to the display content, and the outline enhancement process is performed with an optimum enhancement level that is easy to observe both when still images are displayed continuously and when still images are displayed. Since the broken image is displayed, the burden on the examiner who observes a large amount of images can be reduced.

FIG. 1 is a schematic view schematically illustrating a configuration example of a capsule endoscope system using the image display apparatus according to the first embodiment. FIG. 2 is a block diagram schematically showing a configuration example of the image display apparatus shown in FIG. FIG. 3 is a diagram showing an outline of the frequency transfer characteristic of the enhancement filter stored in the filter storage unit shown in FIG. FIG. 4 is a flowchart showing a processing procedure in which the image display apparatus shown in FIG. 2 displays an in-vivo image. FIG. 5 is a diagram illustrating an example of a screen configuration on which an instruction for continuous playback of still images is input. FIG. 6 is a diagram showing an outline of the frequency transfer characteristic of the enhancement filter used by the contour enhancement processing unit shown in FIG. FIG. 7 is a flowchart showing another processing procedure in which the image display apparatus shown in FIG. 2 displays the in-vivo image. FIG. 8 is a block diagram schematically illustrating a configuration example of the image display apparatus according to the second embodiment. FIG. 9 is a flowchart showing a processing procedure in which the image display device shown in FIG. 8 displays an in-vivo image. FIG. 10 is a diagram illustrating a configuration example of a table referred to by the enhancement level setting unit illustrated in FIG. FIG. 11 is a diagram for explaining the correspondence between the display rate and the edge enhancement level referred to by the enhancement level setting unit shown in FIG. FIG. 12 is a diagram for explaining the correspondence between the display rate and the edge enhancement level referred to by the enhancement level setting unit shown in FIG. FIG. 13 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the first modification of the second embodiment. FIG. 14 is a flowchart showing a processing procedure in which the image display device shown in FIG. 13 displays an in-vivo image. FIG. 15 is a flowchart showing the processing procedure of the display rate setting process shown in FIG. FIG. 16 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the second modification of the second embodiment. FIG. 17 is a flowchart showing a processing procedure in which the image display apparatus shown in FIG. 16 displays an in-vivo image. FIG. 18 is a flowchart showing a processing procedure of the contour emphasis level writing processing shown in FIG. FIG. 19 is a flowchart showing a processing procedure of the in-vivo image display processing shown in FIG. FIG. 20 is a diagram illustrating another example of a filter used by the contour enhancement processing unit illustrated in FIG.

  The best mode for carrying out the present invention will be described below in detail with reference to the drawings. In the description of the drawings, the same portions are denoted by the same reference numerals. Further, the present invention is not limited to the embodiments.

(Embodiment 1)
First, the first embodiment will be described. FIG. 1 is a schematic view schematically illustrating a configuration example of a capsule endoscope system using the image display apparatus according to the first embodiment. As shown in FIG. 1, the capsule endoscope system includes a capsule endoscope 2 that moves along a passage route in the subject 1 and captures an image in the subject 1, and a capsule endoscope. A receiving device 3 that receives an image transmitted from the mirror 2, an image display device 4 that displays an image in the subject 1 captured by the capsule endoscope 2, and the receiving device 3 and the image display device 4. And a portable recording medium 5 for transferring information between them.

  The capsule endoscope 2 has an imaging function for imaging the inside of the subject 1 and a wireless communication function for transmitting an image obtained by imaging the inside of the subject 1 to the receiving device 3. The capsule endoscope 2 passes through the esophagus in the subject 1 by being swallowed by the subject 1, and advances in the body cavity by the peristaltic movement of the digestive tract cavity. At the same time, the capsule endoscope 2 sequentially captures images in the body cavity of the subject 1 at intervals of 0.5 seconds, for example, and sequentially transmits the obtained images in the subject 1 to the receiving device 3.

  The receiving device 3 is connected to receiving antennas 3a to 3h. The receiving device 3 performs wireless communication with the capsule endoscope 2 via the receiving antennas 3a to 3h. Specifically, the reception device 3 receives a radio signal from the capsule endoscope via any of the reception antennas 3a to 3h, and acquires an image in the subject 1 based on the received radio signal. To do. In addition, a portable recording medium 5 is detachably attached to the receiving device 3. The receiving device 3 sequentially stores images in the subject 1 sequentially acquired from the capsule endoscope 2 in a portable recording medium 5 attached to the receiving device 3.

  The receiving antennas 3a to 3h are realized by using, for example, a loop antenna, and receive a radio signal transmitted from the capsule endoscope 2. As shown in FIG. 1, the receiving antennas 3 a to 3 h are arranged at predetermined positions on the body surface of the subject 1, for example, at positions corresponding to the passage route of the capsule endoscope 2. The receiving antennas 3a to 3h may be arranged at predetermined positions of a jacket to be worn by the subject 1. In this case, the receiving antennas 3a to 3h are arranged at predetermined positions on the body surface corresponding to the passage route of the capsule endoscope 2 of the subject 1 when the subject 1 wears this jacket. The subject 1 may be provided with a plurality of receiving antennas. Further, the number of receiving antennas is not particularly limited to eight.

  The portable recording medium 5 is detachable from the receiving device 3 and the image display device 4, and can output information to the attached device or record information output from the attached device. It has a structure. Specifically, the portable recording medium 5 is information that is attached to the receiving device 3 and transmitted from the capsule endoscope 2 while the capsule endoscope 2 is moving in the body cavity of the subject 1. Record. After the capsule endoscope 2 is ejected from the subject 1, that is, after imaging inside the subject 1 is finished, the portable recording medium 5 is taken out from the receiving device 3 and is displayed on the image display device 4. The recorded information is read out by the image display device 4. Such a portable recording medium 5 is, for example, an SD memory card or the like. Further, information may be exchanged between the receiving device 3 and the image display device 4 by connecting the receiving device 3 and the image display device 4 by wire connection or wireless connection.

  The image display device 4 is for displaying an image taken by the capsule endoscope 2 and is based on an image obtained through the portable recording medium 5, for example, in the subject 1. It has a configuration like a terminal device that displays an image of an organ or the like. Further, the image display device 4 has a processing function for an inspector such as a doctor or a nurse to make a diagnosis based on the image in the subject by the capsule endoscope 2. The image display device 4 has a processing function of continuously reproducing a series of still images captured by a capsule endoscope along a time series. The examiner diagnoses the subject 1 by observing (inspecting) a desired site in the subject 1 based on each image displayed on the image display device 4.

  FIG. 2 is a functional block diagram schematically showing a configuration example of the image display device 4 shown in FIG. As shown in FIG. 2, the image display device 4 includes an input unit 11 that receives input of various information for displaying and observing an image in the subject 1 captured by the capsule endoscope 2, and the subject A display unit 12 that displays various information for diagnosing by observing (inspecting) the inside of the subject 1, such as an image in the image 1, and an image stored in the portable recording medium 5 and writing information A reader / writer unit 13. The image display device 4 also includes a storage unit 14 that stores various information necessary for observation and diagnosis of the subject 1 such as an image captured from the portable recording medium 5, and drive control of each component of the image display device 4. And a control unit 16 that performs input / output control and information processing of various information input / output to / from each component. Further, the image display device 4 may be provided with a connection interface for transmitting / receiving information to / from an external device connected by wire or wirelessly via a network or the like.

  The input unit 11 is realized by using a pointing device such as a keyboard or a mouse or a combination thereof, and controls instruction information for processing performed by the image display device 4 and various types of information regarding the subject 1 in accordance with an input operation by the examiner. Input to unit 16. For example, the input unit 11 includes instruction information for instructing processing for storing an image captured from the portable recording medium 5 in the storage unit 14, instruction information for instructing processing for displaying an image in the subject 1 on the display unit 12, In addition, patient information such as the name, sex, date of birth, or patient ID of the subject 1 is input to the control unit 16. As instruction information for instructing display processing of an image in the subject 1, information for instructing continuous reproduction of a series of still images captured by the capsule endoscope 2, or instructing still image display by stopping continuous reproduction There is information to do.

  The display unit 12 is realized using various displays such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display, and displays various types of information instructed to be displayed by the control unit 16. For example, the display unit 12 displays an image in the subject 1 captured by the capsule endoscope 2, patient information, and the like as various information for examining and diagnosing the subject 1.

  The reader / writer unit 13 detachably mounts the portable recording medium 5 described above, and exchanges various information with the mounted portable recording medium 5. Specifically, the reader / writer unit 13 captures information stored in the attached portable recording medium 5, for example, an image by the capsule endoscope 2, and transfers the obtained image or the like to the control unit 16. Further, the reader / writer unit 13 has a function of recording input information from the control unit 16 and a function of performing format processing on the mounted portable recording medium 5.

  The storage unit 14 is realized by using various IC memories such as RAM or EEPROM, a hard disk, or the like. The storage unit 14 has a structure in which an optical disk or a magneto-optical disk is detachably mounted, and is realized by using a drive that can read or write an image or the like on the mounted optical disk or the magneto-optical disk. Also good. The storage unit 14 stores various types of information such as images instructed to be stored by the control unit 16 on itself or on various types of discs loaded. In addition, the storage unit 14 reads information stored in itself or on various discs loaded by the control unit 16 and instructs the control unit 16 to read the information.

  The control unit 16 reads various programs stored in a memory (not shown) and executes each processing procedure shown in the program, whereby the input unit 11, the display unit 12, the reader / writer unit 13, the storage unit 14, and not shown. Each drive control of the connection interface, input / output control of information with respect to each of these components, and information processing for inputting / outputting various information to / from these components are performed.

  The control unit 16 includes a display control unit 161 and an image processing unit 162. The display control unit 161 causes the display unit 12 to display and output various types of information including an image in the subject 1 based on the instruction information input from the input unit 11.

  The image processing unit 162 processes each piece of image information stored in the storage unit 14 and outputs the processed image information. The image processing unit 162 performs, for example, contour enhancement processing, γ correction processing, noise reduction processing, white balance processing, synchronization processing, brightness adjustment processing, color correction processing, YCbCr conversion processing, RGB conversion processing, and the like.

  The contour emphasis processing unit 163 performs contour emphasis processing for emphasizing the contour of the structural component in the image processing performed by the image processing unit 162. The contour emphasis processing unit 163 performs contour emphasis processing for converting the image into a higher resolution than the original image by emphasizing the frequency band constituting the structural component to be noted. The contour enhancement processing unit 163 includes a filter storage unit 164 that stores various enhancement filters used for the contour enhancement processing.

  FIG. 3 is a diagram showing an outline of the frequency transfer characteristic of the enhancement filter stored in the filter storage unit 164 shown in FIG. The enhancement filter used in the contour enhancement processing corresponds to a frequency transfer coefficient of 1.0 or more so that the frequency component can be enhanced in the frequency band Wa constituting the structural component of interest, for example, as a curve Cf in FIG. It has an attached frequency transfer characteristic. The emphasis filter is set with a frequency transfer coefficient so as to suppress the frequency component as it approaches the high frequency band where the noise component increases. The signal input to the filter is output with each frequency component multiplied by the frequency transfer coefficient. For this reason, when an image signal is input to the enhancement filter, it is output in a state where the frequency component of the frequency band Wa is increased. As a result, the image signal filtered by the enhancement filter is displayed in a state where the contour of the structural component of interest is enhanced. In the curve indicating the frequency transfer characteristic of the enhancement filter, the frequency transfer coefficient in the frequency band Wa increases as the enhancement level of the edge enhancement process increases.

  The edge enhancement processing unit 163 filters the image signal with an enhancement filter corresponding to the enhancement level of the edge enhancement processing set via the input unit 11 among the enhancement filters stored in the filter storage unit 164. Perform edge enhancement processing on the image.

  The contour emphasis processing unit 163 performs contour emphasis processing on the image according to the display mode. The contour enhancement processing unit 163 does not perform the contour enhancement processing when instructed to continuously reproduce still images. The display control unit 161 causes the display unit 12 to continuously reproduce still images. Note that when the edge enhancement process is not performed, the image processing unit 162 is a noise suppression filter having a frequency transfer characteristic that suppresses a frequency component as it approaches a high frequency band in which the noise component increases, as indicated by a curve Cn in FIG. May be used to filter the image signal.

  FIG. 4 is a flowchart showing a processing procedure in which the image display device 4 shown in FIG. 2 displays an image in the subject 1 stored in the storage unit 14. As shown in FIG. 4, in the image display device 4, first, the control unit 16 is an in-vivo image group that is a series of images obtained by imaging the inside of the subject 1 based on whether or not instruction information is input by the input unit 11. It is determined whether there is a display instruction for (step S1). When the control unit 16 determines that there is no display instruction for the in-vivo image group (step S1: No), the determination process of step S1 is repeated until it is determined that there is a display instruction for the in-vivo image group. On the other hand, when the control unit 16 determines that there is a display instruction for a series of images in the subject 1 (step S1: Yes), among the information stored in the storage unit 14, the in-vivo image group to be displayed is instructed. Is referred to (step S2).

  Then, the control unit 16 determines whether there is an instruction for continuous playback of still images (step S3). The control unit 16 determines that the continuous reproduction of the still image is instructed when the instruction information for instructing the continuous reproduction of the still image input from the input unit 11 is input.

  FIG. 5 is a diagram illustrating an example of a screen configuration on which an instruction for continuous playback of still images is input. A window W shown in FIG. 5 is provided on the right side of the image display area A1 and the image display area A1 where the in-vivo images are continuously reproduced or displayed as still images, and reduced images of the selected images selected in advance by the examiner in time series. It has a selection image display area A2 displayed side by side in the vertical direction and a reproduction operation icon group provided below the image display area A1. As the reproduction operation icon group, for example, in addition to the “re” icon 24 for continuously reproducing the image in the forward direction at the standard speed, the “frame” icon 25 for reproducing the image in the forward direction at a low speed, and the image at a high speed The “high re” icon 26 for continuously reproducing the image in the forward direction, the “reverse re” icon 27 for continuously reproducing the image in the reverse direction at the standard speed, and the “replay” icon 27 for continuously reproducing the image in the reverse direction at the low speed A “reverse frame” icon 28, a “high reverse” icon 29 for continuously reproducing images in the reverse direction at high speed, and a “stop” icon 30 for temporarily stopping continuous image reproduction are displayed. Instruction information for instructing continuous reproduction of still images is input from the input unit 11 to the control unit 16 by selection input of the “re” icon 24. This selection input is executed by a click operation after the cursor 23 is moved onto the “re” icon 24. Further, when the “frame” icon 25, the “high re” icon 26, the “reverse re” icon 27, the “reverse frame” icon 28 or the “high reverse” icon 29 is selected, the forward direction is set at a predetermined display rate. Or, the continuous reproduction of the still image is instructed in the reverse direction. The display rate is the number of rewrites per second for an image displayed on the display unit 12.

  In step S3, when the control unit 16 determines that there is an instruction to continuously reproduce still images (step S3: Yes), the contour enhancement processing in the contour enhancement processing unit 163 is turned off (step S4). Thereafter, the display control unit 161 performs a continuous reproduction process of a still image for causing the display unit 12 to continuously reproduce the image instructed to be displayed (step S5). On the other hand, when the control unit 16 determines in step S3 that there is no instruction for continuous reproduction of still images (step S3: No), the process proceeds to step S7 described later.

  As a result, the images of the display target image group are continuously reproduced as they are in the image display area A1 in the window W of FIG. For example, in the image display area A1, the image P1 with the display number 1 is displayed in the left area of the image display area A1, and the image P2 with the display number 2 is displayed in the right area of the image display area A1.

  Then, the control unit 16 determines whether there is an instruction to stop still image continuous reproduction (step S6). For example, when the “stop” icon 30 shown in FIG. 5 is selected, stop of continuous playback of still images is instructed.

  When the control unit 16 determines that there is no instruction to stop still image continuous reproduction (step S6: No), the control unit 16 returns to step S4. As a result, the image with the display number 3 is displayed in the left area of the image display area A1, and the image with the display number 4 is displayed in the right area of the image display area A1.

  On the other hand, when the “stop” icon 30 shown in FIG. 5 is selected and the control unit 16 determines that there is an instruction to stop the continuous reproduction of still images (step S6: Yes), the control unit 16 performs still image display. Then, the contour enhancement processing in the contour enhancement processing unit 163 is turned on (step S7). Thereafter, the contour enhancement processing unit 163 performs contour enhancement processing on the still image display target image (step S8). Then, the display control unit 161 performs a still image display process for displaying the image that has been subjected to the contour enhancement processing by the contour enhancement processing unit 163 in a stationary state on the display unit 12 (step S9). As a result, in the image display area A1 of the display screen, an image having a high resolution feeling that has been subjected to the contour enhancement process is displayed in a stationary state.

  Subsequently, the control unit 16 determines whether or not there is a display end instruction for the in-vivo image group (step S10). When it is determined that there is no display end instruction for the in-vivo image group (step S10: No), the control unit 16 returns to step S3 and continues the display process. On the other hand, when the control unit 16 determines that there is a display end instruction for the in-vivo image group (step S10: Yes), the display process for the in-vivo image group in the display unit 12 ends.

  As described above, in the first embodiment, when the continuous reproduction of the still image is instructed, the contour enhancement processing is automatically turned off, and the image that has not been subjected to the contour enhancement processing is continuously reproduced. Therefore, the structural component is not emphasized, and the burden on the examiner who observes a large amount of images can be reduced.

(Modification of Embodiment 1)
Next, a modification of the first embodiment will be described. In the modification of the first embodiment, when the contour enhancement processing unit 163 is instructed to continuously reproduce still images, the contour enhancement processing unit 163 sets the enhancement level of the contour enhancement processing for the images to be continuously reproduced for the still image display target image. The contour enhancement process is performed at a level lower than the enhancement level.

  Specifically, the contour enhancement processing unit 163 uses an enhancement filter having a frequency transfer characteristic indicated by a curve Cfh in FIG. 6 when performing the contour enhancement processing on an image to be displayed as a still image. Filter. On the other hand, the contour enhancement processing unit 163 has a smaller frequency transfer coefficient for the frequency band Wa than the curve Cfh, as shown by the curve Cfw in FIG. The image signal is filtered using an enhancement filter having a frequency transfer characteristic of

  Next, with reference to FIG. 7, an image display process in the first modification of the first embodiment will be described. As shown in FIG. 7, the control unit 16 performs a display instruction determination process (step S11) by performing the same processing procedure as step S1 to step S3 in FIG. 4, and refers to the in-vivo image group to be displayed. (Step S12), it is determined whether there is an instruction for continuous reproduction of still images (Step S13).

  If the control unit 16 determines that there is an instruction for continuous playback of still images (step S13: Yes), the enhancement level of the contour enhancement processing in the contour enhancement processing unit 163 is set to a low level (step S14). The contour enhancement processing unit 163 is caused to perform contour enhancement processing on the images to be continuously reproduced (step S15). In this case, the contour emphasis processing unit 163 uses an emphasis filter having a frequency transfer characteristic indicated by a curve Cfw in FIG. 6 and outputs an image signal to be continuously reproduced with an emphasis level lower than the emphasis level for the still image display target image. Filter.

  The display control unit 161 performs a continuous reproduction process of a still image that causes the display unit 12 to continuously reproduce the image that has been subjected to the contour enhancement processing by the contour enhancement processing unit 163 (step S16). As a result, during the continuous reproduction process of still images, images that do not emphasize the outline of the structural component are displayed sequentially. Next, as in step S6 shown in FIG. 4, the control unit 16 determines whether there is an instruction to stop continuous playback of still images (step S17), and determines that there is no instruction to stop continuous playback of still images. If it is (step S17: No), the process returns to step S14, and the contour enhancement process is performed on the next continuous reproduction target image while maintaining the low level.

  On the other hand, the control unit 16 determines that there is an instruction to stop continuous playback of still images (step S17: Yes), or determines that there is no instruction to continuously playback still images (step S13: No). In order to perform still image display, the enhancement level of the contour emphasis processing in the contour emphasis processing unit 163 is set to a high level (step S18), and the contour emphasis processing unit 163 sets the contour for the still image display target image. The enhancement process is executed (step S19). In this case, the contour emphasis processing unit 163 uses an emphasis filter having a frequency transfer characteristic indicated by a curve Cfh in FIG. 6, and outputs an image signal to be displayed as a still image at an emphasis level higher than the enhancement level for an image to be continuously reproduced. Filter.

  Then, the display control unit 161 performs a still image display process for causing the display unit 12 to display a still image on the image subjected to the contour enhancement process by the contour enhancement processing unit 163 (step S20). As a result, in the image display area of the display screen, an image with a high resolution feeling that has been subjected to the contour enhancement process is displayed in a stationary state. The control unit 16 determines whether or not there is a display end instruction for the in-vivo image group, similarly to step S10 shown in FIG. 4 (step S21). When it is determined that there is no display end instruction for the in-vivo image group (step S21: No), the control unit 16 returns to step S13, continues the display process, and determines that there is a display end instruction for the in-vivo image group. (Step S21: Yes), the display process for the in-vivo image group in the display unit 12 is terminated.

  As described above, in the modification of the first embodiment, the enhancement level of the contour emphasis processing is changed between the continuous reproduction of the still image and the still image display, and either the continuous reproduction of the still image or the still image display is performed. In this case, an image subjected to the contour enhancement process at an optimum enhancement level that is easy to observe is displayed, thereby reducing the burden on the examiner who observes a large number of images.

(Embodiment 2)
Next, a second embodiment will be described. In the second embodiment, a case will be described in which, when an instruction for continuous playback of still images is given, the enhancement level is changed in accordance with the display rate in the continuous playback of still images.

  FIG. 8 is a functional block diagram schematically illustrating a configuration example of the image display apparatus according to the second embodiment. As shown in FIG. 8, the image display device 204 according to the second exemplary embodiment has a control unit having the same function as the control unit 16 instead of the control unit 16 as compared with the image display device 4 shown in FIG. 2. 216. The control unit 216 includes a display control unit 161 and an image processing unit 262. The contour enhancement processing unit 263 of the image processing unit 262 includes an enhancement level setting unit 265 and a correspondence relationship storage unit 268 in addition to the filter storage unit 164.

  When the enhancement level setting unit 265 is instructed to continuously reproduce still images, the enhancement level setting unit 265 sets and changes the enhancement level of the contour enhancement process according to the display rate of the images to be continuously reproduced. The correspondence between each display rate and the enhancement level when continuously reproducing still images is obtained in advance and stored in the correspondence storage 268, and the enhancement level setting unit 265 is stored in the correspondence storage 268. With reference to the correspondence relationship between the displayed display rate and the enhancement level, the enhancement level corresponding to the display rate of continuous reproduction of still images that is actually performed is obtained. The enhancement level setting unit 265 sets the enhancement level of the contour enhancement process by changing the enhancement filter used in the contour enhancement process to the enhancement filter corresponding to the obtained enhancement level.

  Next, image display processing of the image display device 204 will be described with reference to FIG. As shown in FIG. 9, the control unit 216 performs a display instruction determination process (step S31) by performing the same processing procedure as steps S1 to S3 in FIG. 4, and refers to the in-vivo image group to be displayed. (Step S32), it is determined whether or not there is an instruction to continuously reproduce still images (Step S33).

  When the control unit 216 determines that there is an instruction for continuous reproduction of still images (step S33: Yes), the enhancement level setting unit 265 illustrates the enhancement level K0 of the currently set outline enhancement process. After saving in the built-in memory (step S34), the display rate for the images to be continuously reproduced is referred to (step S35). For example, the display rate is set according to each reproduction operation icon. In addition, a low display rate is associated in advance with the image of the site to be observed in the subject in order to carefully observe the image, and a high display rate is associated with the image other than the region to be observed in order to shorten the observation time. It may be attached. Thereby, the observation target can be carefully observed and the observation time can be shortened. The enhancement level setting unit 265 refers to the display rate set according to each reproduction operation icon and the display rate associated with the images to be continuously reproduced. On the other hand, when the control unit 216 determines that there is no instruction for continuous reproduction of still images (step S33: No), the process proceeds to step S40 described later.

  The enhancement level setting unit 265 refers to the correspondence between the display rate and the enhancement level, and sets the contour enhancement level K corresponding to the display rate referred to in step S35 (step S36).

  FIG. 10 is a diagram illustrating a configuration example of a table referred to by the enhancement level setting unit 265. In this table T1, with a threshold for a predetermined display rate as a boundary, when the display rate is slower than this threshold (“slow” display rate), a high-level contour emphasis level is associated and faster than the threshold. In the case of the display rate (“fast” display rate), a low level edge enhancement level is associated. For example, the enhancement filter corresponding to the high level has a frequency transfer characteristic shown by a curve Cfh in FIG. 6, and the enhancement filter corresponding to the low level corresponds to the frequency band Wa rather than the curve Cfh like the curve Cfw in FIG. 6. It has a frequency transfer characteristic with a small frequency transfer coefficient. The enhancement level setting unit 265 sets a high-level contour enhancement level when the referred display rate is included in the “slow” display rate, and a low-level contour enhancement level when included in the “fast” display rate. Set. As shown in FIG. 5, when a plurality of images are arranged side by side and sequentially played back, the determination is made for the display rate set according to each playback operation icon and the plurality of images to be displayed. Based on the attached display rate, for example, the added value of the display time of multiple images to be displayed, the average value of the display time of each image, the value obtained by multiplying the average value by the number of displayed images, the multiple display objects May be the maximum value of the display times of the images or the minimum value of the display times of the plurality of images to be displayed.

  The contour enhancement processing unit 263 performs contour enhancement processing on the images to be continuously reproduced using the enhancement filter corresponding to the contour enhancement level K set by the enhancement level setting unit 265 (step S37). Then, the display control unit 161 performs a continuous reproduction process of still images that causes the display unit 12 to continuously reproduce the image that has been subjected to the contour enhancement processing by the contour enhancement processing unit 263 (step S38). As a result, at the time of continuous reproduction processing of still images, images with an appropriate resolution feeling corresponding to the display rate are sequentially displayed. Next, as in step S6 shown in FIG. 4, the control unit 216 determines whether there is an instruction to stop continuous playback of still images (step S39), and determines that there is no instruction to stop continuous playback of still images. If it has been (step S39: No), the process returns to step S35, and the contour enhancement level K is set with reference to the display rate of the image to be continuously reproduced.

  On the other hand, when the control unit 216 determines that there is an instruction to stop the continuous reproduction of still images (step S39: Yes), the enhancement level setting unit 265 uses the contour enhancement processing unit 263 to perform still image display. The enhancement level of the contour enhancement processing is set to the original enhancement level K0 set by the inspector himself (step S40). Then, the contour emphasis processing unit 263 performs contour emphasis processing on the still image display target image at the emphasis level set by the emphasis level setting unit 265 (step S41), and the display control unit 161 performs the contour emphasis processing unit. A still image display process is performed for displaying the image subjected to the contour enhancement process in H.263 on the display unit 12 as a still image (step S42). As a result, in the image display area of the display screen, the image that has been subjected to the contour emphasis processing at the inspector's desired emphasis level is displayed in a stationary state.

  The control unit 216 determines whether there is a display end instruction for the in-vivo image group, similarly to step S10 shown in FIG. 4 (step S43). When the control unit 216 determines that there is no display end instruction for the in-vivo image group (step S43: No), the control unit 216 returns to step S33, continues the display process, and determines that there is a display end instruction for the in-vivo image group. (Step S43: Yes), the display process for the in-vivo image group in the display unit 12 is terminated.

  As described above, in the second embodiment, the optimum enhancement level corresponding to the display rate automatically set according to each reproduction operation icon, the display rate of continuous playback of still images, and the like during continuous playback of still images. Thus, the contour emphasis process is performed and images that have been subjected to the contour emphasis process are continuously reproduced so as to be easily observed. Therefore, the burden on the examiner who observes a large number of images can be reduced.

  Note that the correspondence between each display rate for continuous playback of still images and the edge enhancement level is, for example, as shown in Table T1 in FIG. For example, two threshold values may be set and the display rate may be divided into three stages to correspond to high, medium or low level contour enhancement levels. .

  In addition, the correspondence between each display rate for continuous reproduction of still images and the contour emphasis level is proportional to each display rate and each emphasis level for contour emphasis processing, for example, as shown by a straight line A1 in FIG. It may be a thing. In addition, the correspondence between each display rate for continuous reproduction of still images and the contour enhancement level is, for example, as shown by a curve A2 in FIG. You may do.

(Modification 1 of Embodiment 2)
Next, Modification 1 of Embodiment 2 will be described. The first modification of the second embodiment includes a display rate setting unit that detects a motion amount of a pixel area set on each image and sets a display rate for continuous reproduction of each image according to the detected motion amount. The image display device will be described.

  FIG. 13 is a functional block diagram schematically illustrating a configuration example of an image display apparatus according to the first modification of the second embodiment. As illustrated in FIG. 13, the image display device 304 according to the first modification of the second embodiment includes an image processing unit 362 further including a display rate setting unit 366 as compared with the image processing unit 262 illustrated in FIG. 8. Have.

  The display rate setting unit 366 includes a motion amount detection unit 367 that is set on each image and detects a motion amount of a pixel area configured by pixels. The display rate setting unit 366 sets a display rate for continuous reproduction of each image according to the amount of motion detected by the motion amount detection unit 367, and associates the set display rate with each image. Since the capsule endoscope 2 is moved by the peristaltic motion of the digestive organ, the capsule endoscope 2 may stay in the same place or suddenly move inside the digestive organ. As a result, as for the obtained in-vivo images, substantially the same images are continuous when they remain, and images that are greatly changed are continuous when the movement is intense. Accordingly, if all images are displayed at the same display rate when continuously reproduced, the display may appear to stop or the display speed may appear to suddenly increase. Therefore, in the image display device 304, a display rate setting unit 366 is provided to detect the amount of motion of a predetermined pixel area set on the image from the image, and the display rate of continuous playback is automatically set in accordance with the amount of motion. Change to display.

  When the enhancement level setting unit 265 is instructed to continuously reproduce still images, the enhancement level of the contour enhancement processing is determined according to the display rate associated with the images to be continuously reproduced by the display rate setting unit 366. Change the setting.

  Next, image display processing of the image display apparatus shown in FIG. 13 will be described with reference to the flowchart of FIG. As shown in FIG. 14, the control unit 316 acquires the in-vivo image group to be displayed from the storage unit 14 based on the instruction information input by the input unit 11 (step S51). Then, the display rate setting unit 366 performs display rate setting processing for setting the display rate for each image in the acquired in-vivo image group and associating it with each image (step S52). Next, the control unit 316 performs image display processing of the acquired in-vivo image group by performing processing similar to the processing procedures illustrated in FIG. 9 (step S53). In this case, the contour enhancement processing unit 263 sets the enhancement level K of the contour enhancement processing with reference to the display rate associated with the continuous reproduction target image.

  Next, the display rate setting process shown in FIG. 14 will be described with reference to the flowchart of FIG. As illustrated in FIG. 15, the motion amount detection unit 367 performs a motion amount detection process of detecting a motion amount with respect to the display rate setting target image in the in-vivo image group acquired by the control unit 316 (step S <b> 61). The motion amount detection unit 367 calculates a correlation value, for example, a normalized cross-correlation value of a plurality of pixel regions set on each image of the series of images captured by the capsule endoscope 2, and each of the series of images A motion vector of each pixel area between adjacent images is calculated as a motion amount. This pixel area is an area constituted by one or more pixel blocks on the image.

  Then, the display rate setting unit 366 sets a display rate for continuous reproduction of each image according to the motion amount detected by the motion amount detection unit 367 (step S62), and the set display rate is set to the image data of this image. A display rate writing process for writing in the header information is performed (step S63). For each image, the display rate setting unit 366 refers to the correspondence between the amount of motion obtained in advance and the display rate that is optimal for observation for each amount of motion, and sets the display rate for continuous playback of each image. Set according to the amount of movement.

  Then, the display rate setting unit 366 determines whether or not the writing of the display rate information to all the in-vivo images has been completed (step S64). When the display rate setting unit 366 determines that the writing of the display rate to all in-vivo images has not been completed (step S64: No), the display rate setting unit 366 returns to step S61 and applies to the next display rate setting target image. After detecting the amount of movement, the display rate is set. If the display rate setting unit 366 determines that the writing of the display rate to all in-vivo images has been completed (step S64: Yes), the display rate setting process ends.

  As described above, in the first modification of the second embodiment, even when the display rate at the time of continuous playback is not associated with each image in advance, the display in the continuous playback of each image is automatically performed within the image display device 304. By setting the rate, it is possible to perform contour enhancement processing at an optimum enhancement level corresponding to the set display rate of continuous reproduction.

(Modification 2 of Embodiment 2)
Next, a second modification of the second embodiment will be described. In the second modification of the second embodiment, as compared with the first modification of the second embodiment, the enhancement level of the contour enhancement process is further set from the display rate associated with each image and associated with each image.

  FIG. 16 is a functional block diagram schematically illustrating a configuration example of an image display device according to the second modification of the second embodiment. As illustrated in FIG. 16, the image display device 404 according to the second modification of the second embodiment includes an edge enhancement level writing unit 468, a correspondence relationship storage unit 469, and an image processing unit 362 illustrated in FIG. 13. The image processing unit 462 further includes:

  The contour emphasis level writing unit 468 sets the emphasis level of the contour emphasis processing at the time of continuous reproduction of a still image according to the display rate of each image associated by the display rate setting unit 366, and associates it with each image. The correspondence between each display rate and the enhancement level when continuously reproducing still images is obtained in advance and stored in the correspondence storage unit 469. The contour enhancement level writing unit 468 includes the correspondence storage unit 469. The correspondence relationship between the display rate and the enhancement level stored in the image is referred to, and the enhancement level corresponding to the display rate of the continuous reproduction of the still image is obtained and associated with each image. When the contour enhancement processing unit 463 is instructed to continuously reproduce still images, the contour enhancement processing unit 463 changes the enhancement level of the contour enhancement processing to the enhancement level associated with the continuous reproduction target image by the contour enhancement level writing unit 468. After that, outline enhancement processing is performed.

  Next, image display processing of the image display device 404 shown in FIG. 16 will be described with reference to FIG. As shown in FIG. 17, the control unit 416 acquires the in-vivo image group to be displayed from the storage unit 14 (step S71) and displays it by the display rate setting unit 366, similarly to step S51 and step S52 shown in FIG. Rate setting processing is performed (step S72). The display rate setting process is executed by performing the same procedure as each procedure shown in FIG.

  Next, the contour emphasis level writing unit 468 sets the emphasis level of the contour emphasis processing at the time of continuous reproduction of the still image according to the display rate of each image associated in the display rate setting processing, and writes the image to the image. Emphasis level writing processing is performed (step S73). The control unit 416 performs image display processing of the acquired in-vivo image group (step S74). In this case, the contour enhancement processing unit 463 reads the contour enhancement level of the header information of the image data of the images to be continuously reproduced, and performs the contour enhancement processing.

  Next, the edge enhancement level writing process shown in FIG. 17 will be described with reference to FIG. As shown in FIG. 18, the contour emphasis level writing unit 468 refers to the display rate included in the header information of the image to be written with the contour emphasis level (step S81). Then, the contour emphasis level writing unit 468 sets the emphasis level of the contour emphasis processing at the time of continuous reproduction of each image according to the referred display rate (step S82), and sets the emphasis level of the set contour emphasis processing as follows. This is written in the header information of this image (step S83). The contour emphasis level writing unit 468 refers to the correspondence between each display rate obtained in advance and the emphasis level of the contour emphasis processing that is optimal for observation for each display rate, and sets the emphasis level of each image. Set according to the display rate.

  Then, the contour emphasis level writing unit 468 determines whether or not the emphasis level has been written in all the in-vivo images (step S84). If the contour emphasis level writing unit 468 determines that the emphasis level has not been written in all the in-vivo images (step S84: No), the process returns to step S81, and the next emphasis level writing target image is displayed. On the other hand, after referring to the display rate, the emphasis level is set. If the contour emphasis level writing unit 468 determines that the emphasis level has been written to all in-vivo images (step S84: Yes), the contour emphasis level writing process is terminated.

  Next, the in-vivo image display process shown in FIG. 17 will be described with reference to FIG. As illustrated in FIG. 19, the control unit 416 performs a display instruction determination process (step S31-1) by performing the same processing procedure as steps S31 to S33 in FIG. 9, and selects the in-vivo image group to be displayed. Reference is made (step S32-1), and it is determined whether there is an instruction to continuously display and display still images (step S33-1).

  When the control unit 416 determines that there is an instruction for continuous playback of still images (step S33-1: Yes), the contour enhancement processing unit 463 determines the enhancement level K0 of the currently set contour enhancement processing. Is stored (step S34-1). Subsequently, the contour emphasis processing unit 463 reads the emphasis level of the contour emphasis processing included in the header information of the image data to be continuously reproduced (step S35-1), and uses an emphasis filter corresponding to the read emphasis level. Edge enhancement processing is performed on images to be continuously reproduced (step S37-1). The display control unit 161 performs a continuous reproduction process of a still image that causes the display unit 12 to continuously reproduce the image that has been subjected to the contour enhancement processing by the contour enhancement processing unit 463 (step S38-1). As a result, at the time of continuous playback processing of still images, images with appropriate resolution corresponding to the amount of motion of the images are sequentially displayed. Next, similarly to step S6 shown in FIG. 4, the control unit 416 determines whether or not there is an instruction to stop continuous playback of still images (step S39-1), and there is no instruction to stop continuous playback of still images. If it is determined (step S39-1: No), the process returns to step S35-1, and the enhancement level of the contour enhancement processing of the image to be continuously reproduced is referred to next.

  On the other hand, when the control unit 416 determines that there is an instruction to stop continuous playback of still images (step S39-1: Yes), or when it is determined that there is no instruction to continuously playback still images. (Step S33-1: No), the contour emphasis processing unit 463 sets the emphasis level of the contour emphasis processing to the original emphasis level K0 set by the examiner in order to perform still image display (Step S40). -1) The contour enhancement process is performed on the still image display target image (step S41-1), and the display control unit 161 displays the image subjected to the contour enhancement process by the contour enhancement processing unit 463 on the display unit 12. Still image display processing for displaying a still image is performed (step S42-1). As a result, in the image display area of the display screen, the image that has been subjected to the contour emphasis processing at the inspector's desired emphasis level is displayed in a stationary state.

  The control unit 416 determines whether or not there is a display end instruction for the in-vivo image group, similarly to step S10 illustrated in FIG. 4 (step S43-1). When the control unit 416 determines that there is no display end instruction for the in-vivo image group (step S43-1: No), the control unit 416 returns to step S33-1, continues the display process, and receives a display end instruction for the in-vivo image group. If it is determined (step S43-1: Yes), the display process for the in-vivo image group in the display unit 12 is terminated.

  As described above, in the second modification of the second embodiment, the enhancement level of the contour enhancement process is associated with each image in advance, and the contour enhancement process is performed with the enhancement level associated with the image. It is not necessary to set the enhancement level of the contour enhancement process during continuous reproduction.

  In the first and second embodiments, the case where the contour enhancement process is performed using an enhancement filter having a frequency transfer characteristic that is convex upward with a size corresponding to a predetermined enhancement level has been described as an example. Of course, the present invention is not limited to this. For example, contour enhancement processing is performed on all in-vivo images at a constant enhancement level set by the examiner, and contour blurring processing for blurring the contours of structural components is further performed on images for which continuous reproduction is instructed. In this case, the image display apparatus filters the image signal using the enhancement filter having the frequency transfer characteristic illustrated in the curve Cf1 in FIG. As in Cb, the image signal may be filtered using a contour blur filter having a frequency transfer characteristic in which the frequency transfer coefficient is smaller than 1.0 contrary to the curve Cf. And when changing an emphasis level, what is necessary is just to change the minimum value of the frequency transfer coefficient of the outline blurring filter to be used corresponding to a display rate.

DESCRIPTION OF SYMBOLS 1 Subject 2 Capsule endoscope 3 Receiving device 3a-3h Receiving antenna 4,204,304,404 Image display device 5 Portable recording medium 11 Input part 12 Display part 13 Reader / writer part 14 Storage part 16,216,316 , 416 Control unit 161 Display control unit 162, 262, 362, 462 Image processing unit 163, 263, 463 Outline enhancement processing unit 164 Filter storage unit 265 Enhancement level setting unit 366 Display rate setting unit 367 Motion amount detection unit 468 Outline enhancement level Writing part

The present invention relates to an image display apparatus for successively reproducing still images captured through the body, an image display method and image display program.

Claims (10)

An image display device having display means capable of displaying still images of images taken inside the body or continuously reproducing still images,
Contour emphasis processing means for performing contour emphasis processing according to the display mode for the image;
Display control means for causing the display means to display an image that has undergone outline enhancement processing by the outline enhancement processing means;
An image display device comprising:   The image display apparatus according to claim 1, wherein the contour enhancement processing unit lowers the enhancement level of the contour enhancement processing for the continuous reproduction target image lower than the enhancement level for the still image display target image.   The image display apparatus according to claim 1, wherein the contour emphasis processing unit does not perform the contour emphasis processing when continuously reproducing still images.   2. The image display according to claim 1, wherein the contour emphasis processing unit changes an emphasis level of the contour emphasis processing on an image to be continuously reproduced of still images according to a display rate of still image continuous reproduction. apparatus.   The contour emphasis processing means changes the emphasis level of the contour emphasis processing based on a correspondence relationship between a display rate of continuous reproduction of still images obtained in advance and an emphasis level of the contour emphasis processing. The image display device according to claim 4.   Further provided is a display rate setting means for detecting the amount of motion of the pixel area set on each image, setting a display rate for continuous playback of each image according to the detected amount of motion, and associating it with each image The image display device according to claim 4. Display rate setting means for detecting a motion amount of a pixel area set on each image, setting a display rate at the time of continuous reproduction of each image according to the detected motion amount, and associating with each image;
An outline emphasis level setting means for setting an emphasis level of the outline emphasis processing at the time of continuous reproduction according to a display rate of each image associated by the display rate setting means, and associating with each image;
The image display device according to claim 1, further comprising:   The image display apparatus according to claim 1, wherein the image includes an imaging unit and is captured by a capsule medical device introduced into the body. An image display method for causing a display means to perform still image display of an image captured inside the body or continuous reproduction of still images,
A contour enhancement processing step for performing contour enhancement processing according to a display mode for the image;
A display step of causing the display means to continuously reproduce the image on which the contour enhancement processing has been performed in the contour enhancement processing step;
An image display method comprising: In the display means for performing still image display of images taken inside the body or continuous playback of still images,
Contour enhancement processing procedure for performing contour enhancement processing according to the display mode for the image;
A display procedure for continuously reproducing the image subjected to the contour emphasis processing in the contour emphasis processing procedure;
An image display program for executing

Images