JP5231160B2 - Image display device, image display method, and image display program - Google Patents

Description

  The present invention relates to an image display device that displays a series of images obtained by imaging the internal organs of a subject such as a patient in time series, and in particular, can display a list of a plurality of images included in the series of images. The present invention relates to an image display device, an image display method, and an image display program.

  2. Description of the Related Art Conventionally, in the field of endoscopes, capsule endoscopes that are swallowable endoscopes having an imaging function and a wireless communication function in a capsule-type housing have appeared. A capsule endoscope is introduced into an organ of a subject such as a patient by ingestion or the like. Thereafter, the capsule endoscope inside the subject takes an image inside the organ of the subject (hereinafter sometimes referred to as an in-vivo image) while moving inside the organ by a peristaltic motion or the like, and the obtained body Send images to the outside wirelessly. Such a capsule endoscope sequentially captures in-vivo images in time series from the time it is introduced into the subject to the time it is discharged outside the subject, and the obtained in-vivo images are taken in time-sequential order. Wireless transmission to the outside.

  The in-vivo images wirelessly transmitted in chronological order by such a capsule endoscope are sequentially received by a receiving device outside the subject. This receiving apparatus stores in-vivo image groups received from the capsule endoscope in time series in a recording medium inserted in advance. Thereafter, the recording medium storing the in-vivo image group is removed from the receiving device and inserted into the image display device. The image display apparatus takes in the in-vivo image group in the inserted recording medium and sequentially displays the obtained in-vivo images on the display. In addition, the image display device presets the extraction condition of the display target image, extracts a plurality of in-vivo images to be displayed from the in-vivo image group based on the set extraction condition, and extracts the extracted plurality of in-vivo images. In-vivo images can also be listed on the screen. A medical worker such as a doctor or a nurse can observe each in-vivo image displayed on the image display device and observe (examine) the inside of the organ of the subject through the observation of the in-vivo image.

  In addition, as an image display device that displays a group of in-vivo images of a subject as described above, for example, there is a device that displays a stream of images by a capsule endoscope together with a plurality of fixed total graphical displays of a data stream (Patent Document 1). reference). There is also a system that divides an image stream captured by a capsule endoscope into a plurality of image streams and displays the plurality of image streams substantially simultaneously (see Patent Document 2).

JP 2007-222657 A Special table 2007-519440 gazette

  However, in the above-described conventional image display device, in-vivo images that are not extracted as a list display target among a series of in-vivo images captured by the capsule endoscope, that is, a plurality of in-vivo images displayed in a list on the screen are displayed. It is difficult to confirm information such as the number or type of in-vivo images latent between images. In recent years, in the field of endoscopes, from the viewpoint of efficiently observing in-vivo images of a subject, there has been a demand for an image display device capable of confirming information on the in-vivo images that exist between the images of the list display images. Yes.

  The present invention has been made in view of the above circumstances, and is an image display device, an image display method, and an image display device capable of confirming information on in-vivo images latent between images of a plurality of in-vivo images displayed as a list on the screen, and An object is to provide an image display program.

  In order to solve the above-described problems and achieve the object, an image display device according to the present invention includes an image acquisition unit that acquires a series of images taken in time series, and a plurality of images from the series of images. An image extracting unit for extracting an image; a display unit for displaying a list of the plurality of images extracted by the image extracting unit; and a plurality of the plurality of images in a display mode showing information on latent images between the images of the plurality of images. And a display control unit that controls the display unit to display a list of images.

  In the image display device according to the present invention as set forth in the invention described above, the display control unit adds a mark indicating information on the latent image between the images of the plurality of images and displays the list of the plurality of images. The display unit is controlled as described above.

  The image display device according to the present invention is characterized in that, in the above invention, the mark is different for each type of characteristic image latent between the images of the plurality of images.

  The image display apparatus according to the present invention further includes an input unit that inputs selection information of any of the plurality of marks added between the images of the plurality of images in the above-described invention, and the display control unit includes: The display unit is controlled to additionally display a latent image corresponding to the mark selected by the selection information.

  Further, in the image display device according to the present invention, in the above invention, when the display control unit includes a characteristic image in the plurality of images, the display control unit The display unit is controlled to add a mark indicating the type of characteristic image.

  In the image display device according to the present invention as set forth in the invention described above, the display control unit adds the additional information indicating the information of the latent image between the images of the plurality of images, and displays the plurality of images as a list. The display unit is controlled as described above.

  In the image display device according to the present invention as set forth in the invention described above, the additional information is numerical information indicating the number of latent images or the imaging time of the latent images between the images of the plurality of images.

  In the image display device according to the present invention as set forth in the invention described above, the additional information is graph information that changes according to the number of latent images or the imaging time of the latent images between the images of the plurality of images. And

  The image display device according to the present invention is characterized in that, in the above invention, the additional information is color information that differs according to the number of latent images or the imaging time between the images of the plurality of images. To do.

  In the image display device according to the present invention as set forth in the invention described above, the information on the latent image is the number of latent images or the imaging time for each of the plurality of images, and the display control unit The display unit is controlled to display a list of the plurality of images by changing the inter-image distances of the plurality of images according to the number of latent images or the imaging time.

  In the image display device according to the present invention as set forth in the invention described above, the information on the latent image is the number of latent images or the imaging time for each of the plurality of images, and the display control unit The display unit is controlled to display a list of the plurality of images by changing the frame color of the plurality of images according to the number of latent images or the imaging time.

  In the image display device according to the present invention as set forth in the invention described above, the characteristic image is selected by a user.

  In the image display device according to the present invention as set forth in the invention described above, the characteristic image is an image including color information peculiar to a bleeding part or a lesion part.

  In addition, an image display method according to the present invention includes an image extraction step of extracting a plurality of images from a series of images taken in time series, and between the images of the plurality of images extracted by the image extraction step. And a list display step of displaying a list of the plurality of images in a display mode showing information of latent latent images.

  The image display method according to the present invention further includes a determination step of determining whether or not a characteristic image exists between the images of the plurality of images extracted by the image extraction step in the above invention, The list display step is characterized in that the plurality of images are displayed in a list in a display mode indicating information on the latent image that is the characteristic image.

  The image display method according to the present invention further includes a counting step of counting the number of latent images for each of the plurality of images extracted by the image extraction step in the above invention, wherein the list display step includes: The plurality of images are displayed in a list in a display mode that indicates the number of latent images for each of the plurality of images.

  In addition, an image display program according to the present invention includes an image extraction procedure for extracting a plurality of images from a series of images taken along a time series, and an image between the images extracted by the image extraction procedure. A list display procedure for displaying a list of the plurality of images in a display mode that shows information of latent latent images is executed by a computer.

  The image display program according to the present invention further includes a determination procedure for determining whether or not a characteristic image exists between the images of the plurality of images extracted by the image extraction procedure in the above invention, The list display procedure is characterized in that the plurality of images are displayed in a list in a display mode indicating information on the latent image that is the characteristic image.

  The image display program according to the present invention further includes a counting procedure for counting the number of latent images for each of the plurality of images extracted by the image extraction procedure in the above invention, and the list display procedure includes: The plurality of images are displayed in a list in a display mode that indicates the number of latent images for each of the plurality of images.

  In the image display device according to the present invention, the image acquisition unit acquires a series of images taken in time series, the image extraction unit extracts a plurality of images from the series of images, and the display unit The plurality of images extracted by the image extraction unit are displayed in a list, and the display control unit displays the plurality of images in a display manner that displays information on latent images between the images of the plurality of images. The display unit is controlled as follows. For this reason, there is an effect that it is possible to realize an image display device capable of confirming information on a latent image between images of a plurality of in-vivo images while observing a plurality of in-vivo images displayed in a list on the screen. .

  Further, in the image display method according to the present invention, an image extraction step of extracting a plurality of images from a series of images taken in time series is performed, and between the images of the plurality of images extracted by the image extraction step. A list display step of displaying a list of the plurality of images in a display mode showing information of latent images latent in the image. For this reason, there is an effect that it is possible to realize an image display method capable of confirming information on latent images between images of a plurality of in-vivo images while observing a plurality of in-vivo images displayed in a list on the screen. .

  In the image display program according to the present invention, an image extraction procedure for extracting a plurality of images from a series of images taken in time series is executed, and the images of the plurality of images extracted by the image extraction procedure are executed. A list display procedure for displaying a list of the plurality of images in a display mode that shows information of latent images that exist in between is executed. For this reason, there is an effect that it is possible to realize an image display program capable of confirming information on latent images between images of a plurality of in-vivo images while observing a plurality of in-vivo images displayed in a list on the screen. .

  Exemplary embodiments of an image display device, an image display method, and an image display program according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a configuration example of the in-vivo information acquiring system including the image display device according to the first embodiment of the present invention. As shown in FIG. 1, the in-subject information acquisition system according to the first embodiment is wirelessly transmitted by a capsule endoscope 2 that captures an in-vivo image of the subject 1 and the capsule endoscope 2. In order to exchange data between the receiving device 3 that receives the image signal, the image display device 4 that displays the in-vivo image captured by the capsule endoscope 2, and the receiving device 3 and the image display device 4. The portable recording medium 5 is provided.

  The capsule endoscope 2 is a capsule endoscope device that is formed in a size that can be introduced into the organ of the subject 1, and includes an imaging function and a wireless communication function inside the capsule casing. Specifically, the capsule endoscope 2 is introduced into the organ of the subject 1 by oral ingestion or the like. Thereafter, the capsule endoscope 2 inside the subject 1 sequentially captures the in-vivo images in time series while moving inside the organ by a peristaltic motion or the like, and receives the image signals of the obtained in-vivo images from the outside Wireless transmission is sequentially performed to the device 3. In this case, the capsule endoscope 2 adds time data indicating the imaging time of the in-vivo image to the image signal, and sequentially wirelessly transmits the image data including the in-vivo image image data and the time data. The capsule endoscope 2 sequentially repeats the in-vivo image capturing operation and the wireless transmission operation during a period from introduction into the organ of the subject 1 to discharge to the outside of the subject 1.

  The receiving device 3 includes a plurality of receiving antennas 3a to 3h, and receives a radio signal from the capsule endoscope 2 inside the subject 1 via at least one of the plurality of receiving antennas 3a to 3h. . The receiving device 3 performs predetermined communication processing such as demodulation processing on the radio signal received from the capsule endoscope 2, extracts an image signal included in the radio signal, and extracts the extracted image signal. First, an in-vivo image of the subject 1 is generated. The receiving apparatus 3 sequentially repeats such processing to acquire an in-vivo image group of the subject 1 by the capsule endoscope 2. In this case, the receiving device 3 acquires the image data of the in-vivo image in this way and also acquires the time data of the in-vivo image added to the image signal. A recording medium 5 is inserted in the receiving device 3 in advance. The receiving device 3 stores in the recording medium 5 each image data of the in-vivo image group of the subject 1 in a manner associated with time data such as the imaging time of each in-vivo image.

  The receiving antennas 3 a to 3 h of the receiving device 3 may be distributed on the body surface of the subject 1 as shown in FIG. 1 or may be arranged on a jacket worn by the subject 1. . Further, the number of receiving antennas provided in the receiving device 3 may be one or more, and is not particularly limited to eight.

  The image display device 4 has a configuration like a workstation that acquires various data such as in-vivo image groups of the subject 1 and displays the acquired various data such as in-vivo image groups. Specifically, the image display device 4 is loaded with the recording medium 5 removed from the receiving device 3 described above, and takes in the storage data of the recording medium 5. As a result, the image display device 4 acquires various data such as an in-vivo image group of the subject 1 by the capsule endoscope 2. The image display device 4 displays each in-vivo image in the in-vivo image group thus acquired as a still image or a moving image, or displays a list of a plurality of in-vivo images extracted from the in-vivo image group. A medical worker such as a doctor or a nurse observes each in-vivo image displayed on the image display device 4 and observes the inside of the organ of the subject 1 through observation of each in-vivo image. As a result, the subject 1 Can be diagnosed.

  The recording medium 5 is a portable recording medium for transferring data between the receiving apparatus 3 and the image display apparatus 4 described above. Specifically, the recording medium 5 is detachable from the receiving device 3 and the image display device 4, and has a structure capable of outputting and recording data when being inserted into both. When the recording medium 5 is attached to the receiving device 3, the recording medium 5 records various data such as an in-vivo image group received by the receiving device 3 from the capsule endoscope 2. The recording medium 5 in a state where such various data is accumulated is detached from the receiving device 3 and then inserted into the image display device 4. In this case, the data stored in the recording medium 5 is taken into the image display device 4.

  Next, the configuration of the image display device 4 according to the first embodiment of the present invention will be described in detail. FIG. 2 is a block diagram schematically illustrating a configuration example of the image display apparatus according to the first embodiment of the present invention. As shown in FIG. 2, the image display device 4 according to the first embodiment includes a reader / writer 11 that captures data stored in the recording medium 5 described above, an input unit 12 that inputs various types of information, and the body of the subject 1. A display unit 13 that displays an image and the like, a storage unit 14 that stores various data captured by the reader / writer 11, and a control unit 15 that controls each component of the image display device 4 are provided.

  The reader / writer 11 functions as an image acquisition unit that acquires an in-vivo image group of the subject 1 by the capsule endoscope 2 described above. Specifically, the reader / writer 11 removably inserts the recording medium 5 detached from the receiving device 3 described above, and takes in the storage data of the recording medium 5 based on the control of the control unit 15. In this way, the reader / writer 11 acquires various data such as image data and time data of the in-vivo image group of the subject 1, and transfers the acquired various data to the control unit 15. Note that the in-vivo image group acquired by the reader / writer 11 is a series of images in which the above-described capsule endoscope 2 images the inside of the organ of the subject 1 in time series. On the other hand, when the initialized recording medium 5 is inserted, the reader / writer 11 writes the data instructed by the control unit 15 to the recording medium 5. In this case, the reader / writer 11 writes specific data such as the patient name, patient ID, examination date, and examination ID of the subject 1 in the recording medium 5.

  The input unit 12 is realized using an input device such as a keyboard and a mouse, and inputs various types of information to the control unit 15 in response to an input operation by the user. As various information input to the control unit 15 by the input unit 12, for example, various instruction information instructed to the control unit 15, specific data of the subject 1, and in-vivo images to be displayed as a list are extracted. For example, information on image extraction conditions.

  The display unit 13 is realized by using a display capable of displaying an image such as a CRT display or a liquid crystal display, and displays various information and various data instructed to be displayed by the control unit 15. Specifically, the display unit 13 includes a group of in-vivo images of the subject 1 by the capsule endoscope 2 described above, specific data of the subject 1, input information by the input unit 12, and various types for input operation or display operation. A GUI (Graphical User Interface) or the like is displayed. More specifically, the display unit 13 displays each in-vivo image in the in-vivo image group of the subject 1 in a still image display or a moving image display in chronological order or in reverse chronological order based on the control of the control unit 15. The display unit 13 displays a list of a plurality of in-vivo images extracted from the in-vivo image group of the subject 1 based on the control of the control unit 15. At the same time, the display unit 13 displays in-vivo images that have not been extracted as a list display target in the in-vivo image group of the subject 1, that is, in-vivo images that are latent between these in-vivo images (hereinafter, latent images). May be displayed).

  The storage unit 14 is realized by using a rewritable nonvolatile storage medium such as an EEPROM or a hard disk. The storage unit 14 stores various data that is instructed to be written by the control unit 15, and transmits the storage data that is instructed to be read by the control unit 15 to the control unit 15. Specifically, based on the control of the control unit 15, the storage unit 14 inputs information by the input unit 12 such as specific data of the subject 1, acquired data by the reader / writer 11 such as an in-vivo image group of the subject 1, Various data and various information such as image extraction conditions for extracting in-vivo images to be listed are stored. Further, the storage unit 14 is an in-vivo image folder 14a that is a storage area for storing the acquired in-vivo image and an extraction area that is a storage area for storing in-vivo images extracted from the in-vivo image group in the in-vivo image folder 14a. And an image folder 14b. The storage unit 14 stores the in-vivo image group of the subject 1 in the in-vivo image folder 14a, and stores a plurality of in-vivo images extracted as a list display target from the in-vivo image group in the extracted image folder 14b. To do. Note that the storage unit 14 may store each in-vivo image data of the subject 1 without providing such folders as the in-vivo image folder 14a and the extracted image folder 14b. In this case, the storage unit 14 adds identifiable additional information such as a flag to each in-vivo image extracted as a list display target from the in-vivo image group of the subject 1 to distinguish it from the in-vivo images that are not the list display target. In this manner, each in-vivo image to be displayed in a list may be stored.

  The control unit 15 is realized by using a storage unit that stores a program or the like for realizing the function of the image display device 4 and a CPU or the like that executes the program in the storage unit. The control unit 15 controls each operation of the reader / writer 11, the input unit 12, the display unit 13, and the storage unit 14, which are each component of the image display device 4, and inputs / outputs signals between the components. To control. Specifically, the control unit 15 controls the reader / writer 11 to capture the stored data of the recording medium 5 based on the instruction information input by the input unit 12, and stores the captured stored data. The storage unit 14 is controlled. In addition, the control unit 15 controls the reader / writer 11 so as to store the specific data of the subject 1 input by the input unit 12 in the recording medium 5.

  The control unit 15 also includes a display control unit 15a that controls the display operation of the display unit 13, an image extraction unit 15b that extracts in-vivo images to be displayed as a list, an extraction condition setting unit 15c that sets image extraction conditions, An image processing unit 15d that performs various processes on the in-vivo images in the in-vivo image group.

  Based on the instruction information input by the input unit 12, the display control unit 15 a controls the display unit 13 so that each in-vivo image in the in-vivo image group of the subject 1 is displayed as a still image or a moving image. In this case, the display control unit 15a reads out the in-vivo image group of the subject 1 from the in-vivo image folder 14a of the storage unit 14, and sets the in-vivo images in the read in-vivo image group in time series order or time series. The display unit 13 is controlled to display still images or moving images in reverse order. On the other hand, the display control unit 15 a presets the number of in-vivo images to be displayed on one screen based on the input information from the input unit 12. The display control unit 15 a displays the in-vivo image group of the subject 1 in a display mode that shows information on latent images between images of a plurality of in-vivo images that are list display targets based on the instruction information input by the input unit 12. The display unit 13 is controlled to display a list of a plurality of in-vivo images. In this case, the display control unit 15a reads a plurality of in-vivo images from the extracted image folder 14b of the storage unit 14 for each preset display number. The display control unit 15a adds a mark indicating information on the latent image (specifically, a characteristic image type of the latent image) between the images of the plurality of in-vivo images to display the plurality of in-vivo images. The display unit 13 is controlled to display a list. Further, when a desired mark is selected from among the marks between the images by the user's operation of the input unit 12, the display control unit 15a displays so as to additionally display a latent image corresponding to the selected mark. The unit 13 is controlled. The plurality of in-vivo images stored in the extracted image folder 14b are extracted from the in-vivo image group of the subject 1 by the image extraction unit 15b.

  Further, the display control unit 15a determines whether or not the characteristic images are included in the plurality of in-vivo images to be displayed as a list on the display unit 13, and when the characteristic images are included, the display control unit 15a The display unit 13 is controlled so that a mark indicating the type of the characteristic image is added to the characteristic image. The display control unit 15a sets display / non-display of the mark based on the instruction information input by the input unit 12.

  Here, the above-described characteristic image is a characteristic in-vivo image that is noticed by a medical staff such as a doctor or a nurse. For example, an in-vivo image that seems to be a bleeding part, an in-vivo image that captures a lesioned part, or a clip An in-vivo image showing a foreign body such as an in-vivo image, an in-vivo image of a joint of an organ such as a pylorus, an in-vivo image selected from the in-vivo images displayed on the display unit 13 based on input information of the input unit 12 . Further, the above-described marks are of different colors or shapes depending on the types of such characteristic images.

  The image extraction unit 15b extracts a plurality of in-vivo images to be displayed as a list from the in-vivo image group of the subject 1 based on the image extraction conditions set by the extraction condition setting unit 15c. In this case, the image extraction unit 15b extracts an in-vivo image that matches the image extraction condition set by the extraction condition setting unit 15c from the in-vivo image group of the subject 1 in the in-vivo image folder 14a. The in-vivo image extracted by the image extracting unit 15b is stored in the extracted image folder 14b of the storage unit 14. Whenever the extraction condition setting unit 15c changes the image extraction condition, the image extraction unit 15b re-extracts the in-vivo image that matches the changed image extraction condition from the in-vivo image group of the subject 1. .

  The extraction condition setting unit 15 c sets image extraction conditions for the above-described image extraction unit 15 b to extract the list-display-target in-vivo images from the in-vivo image group of the subject 1. The extraction condition setting unit 15 c changes the image extraction condition based on the input information from the input unit 12. Such image extraction conditions are stored in the storage unit 14 based on the control of the control unit 15 and are appropriately read out by the control unit 15. Note that the image extraction condition set by the extraction condition setting unit 15c can be changed hierarchically, for example, a threshold of similarity between in-vivo images that are continuous in time series.

  The image processing unit 15d performs predetermined image processing on each in-vivo image included in the in-vivo image group of the subject 1, and calculates information necessary for the above-described in-vivo image extraction processing by the image extraction unit 15b. Specifically, the image processing unit 15d reads the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a of the storage unit 14, and extracts the color information of each in-vivo image in the in-vivo image group. Based on the color information of each in-vivo image, the image processing unit 15d calculates, for each image, the similarity between in-vivo images that are continuous in time series in the in-vivo image group. The image processing unit 15d calculates a motion vector between adjacent images in the in-vivo image group, and calculates a similarity between the in-vivo images for each image based on the calculated motion vector of each in-vivo image. May be. The image processing unit 15d associates each similarity calculated for each image with each in-vivo image in the in-vivo image group. The control unit 15 stores the similarities in the storage unit 14 in a manner associated with the in-vivo images. The similarity between the in-vivo images stored in the storage unit 14 is appropriately read out by the control unit 15 and used when the above-described image extraction unit 15b extracts the in-vivo images to be displayed as a list.

  Next, the operation of the image display device 4 according to the first embodiment of the present invention will be described. FIG. 3 is a flowchart illustrating a processing procedure of the image display apparatus when displaying a mark of a characteristic image and displaying a list of a plurality of in-vivo images. The image display device 4 according to the first embodiment extracts a plurality of in-vivo images to be displayed in a list from the acquired in-vivo image group of the subject 1, and lists the plurality of in-vivo images for each preset display number. indicate. In this case, if a characteristic image is included in the latent images latent between the images of the plurality of in-vivo images, the image display device 4 displays a mark of the characteristic image as information on the latent image.

  Specifically, as shown in FIG. 3, the control unit 15 of the image display apparatus 4 according to the first embodiment first determines whether or not there is an in-vivo image list display instruction (step S101). In this step S101, the control unit 15 determines that there is an in-vivo image list display instruction when the list display instruction information is input by the input unit 12, and if the list display instruction information is not input, It is determined that there is no instruction to display the list. When determining that there is no in-vivo image list display instruction (No in step S101), the control unit 15 repeats step S101 until the input unit 12 inputs instruction information for list display.

  On the other hand, when the control unit 15 determines in step S101 that there is an in-vivo image list display instruction (Yes in step S101), the control unit 15 extracts an in-vivo image to be displayed as a list from a previously acquired in-vivo image group (step S102). ).

  In step S102, the image extraction unit 15b matches the image extraction condition set in advance by the extraction condition setting unit 15c from the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a of the storage unit 14. A plurality of in-vivo images are extracted. In this case, the image extraction unit 15b compares the similarity between the in-vivo images in the in-vivo image group and the image extraction condition, and extracts the plurality of in-vivo images based on the comparison result. Note that the similarity between the in-vivo images is calculated in advance by the image processing unit 15d as described above. The control unit 15 controls the storage unit 14 so as to store the plurality of in-vivo images extracted in this way in the extracted image folder 14b.

  Next, the control unit 15 determines whether or not a characteristic image exists between the images of the plurality of in-vivo images that are the list display targets (step S103). In step S103, the display control unit 15a selects a plurality of in-vivo images other than the list-displayed in-vivo images from the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a, that is, a list display target. A latent image latent between the in-vivo images is read from the storage unit 14. Here, when the characteristic image is an in-vivo image including a characteristic part such as a bleeding part or a lesion part as a subject, the characteristic image includes color information (red or the like) peculiar to the bleeding part or the lesion part. included. On the other hand, when the characteristic image is an in-vivo image selected based on the input information of the input unit 12, the characteristic image includes the in-vivo image selected by the user from each in-vivo image displayed on the display unit 13. A flag indicating that the image is displayed is added. The display control unit 15a determines whether or not the latent image is a characteristic image based on the color information or flag of the latent image read from the storage unit 14. The display control unit 15a repeatedly executes the characteristic image determination process for all the latent images included in the storage unit 14.

  When at least one of all the latent images is a characteristic image, the control unit 15 determines that the characteristic image is latent among the images of the plurality of in-vivo images that are the list display targets (Yes in step S103). Then, the in-vivo images are displayed as a list on the display unit 13 in a display manner indicating the information of the latent characteristic images (step S104).

  In step S104, the display control unit 15a reads a plurality of in-vivo images extracted by the image extraction unit 15b in step S102 from the extracted image folder 14b of the storage unit 14. Then, the display control unit 15a controls the display unit 13 to display a list of the plurality of in-vivo images for each preset number of in-vivo images displayed in one screen. Further, the display control unit 15a displays so as to add a mark indicating the type of the characteristic image between the images of the plurality of in-vivo images between which the characteristic image determined in step S103 is latent. The unit 13 is controlled.

  Based on the control of the display control unit 15a, the display unit 13 displays a list of a plurality of in-vivo images to be displayed as a list, and an image in which a characteristic image among the plurality of in-vivo images is latent. In the meantime, a mark indicating the type of latent characteristic image is displayed.

  On the other hand, when all the latent images in the storage unit 14 are not characteristic images in step S103 described above, the control unit 15 determines that there is no characteristic image between the images of the plurality of in-vivo images that are the list display targets. Judgment is made (No at Step S103). In this case, the control unit 15 causes the display unit 13 to display a list of the plurality of in-vivo images extracted in step S102 described above (step S105). In step S105, the display control unit 15a reads a plurality of in-vivo images extracted by the image extraction unit 15b in step S102 from the extracted image folder 14b of the storage unit 14. Then, the display control unit 15a controls the display unit 13 to display a list of the plurality of in-vivo images for each preset number of in-vivo images displayed in one screen.

  Thereafter, the control unit 15 determines whether or not to end the list display process of in-vivo images (step S106). When the instruction information to end the process is input by the input unit 12, based on the input instruction information. Thus, it is determined that the process is finished (step S106, Yes), and this process is finished. On the other hand, the control unit 15 determines that the process is not finished when the process end instruction information is not input in step S106 (No in step S106), returns to the above-described step S101, and the processes after step S101. Repeat the procedure.

  Next, an example in which the number of in-vivo images displayed as a list in one screen is 15 is shown, and in-vivo images are displayed in a list in a display mode that shows information about characteristic images that exist between images. The operation of the image display device 4 will be specifically described. FIG. 4 is a schematic view illustrating a list display mode of in-vivo images by the image display device according to the first embodiment of the present invention. FIG. 5 is a schematic diagram illustrating a state in which the image display device additionally displays a characteristic image corresponding to the mark.

  In the image display apparatus 4 in which the in-vivo image list display instruction information is input by the input unit 12, the control unit 15 displays the in-vivo image list display based on the list display instruction information input by the input unit 12. Judge that there is an instruction. In such a state, the image extraction unit 15b selects the in-vivo image that matches the image extraction condition by the extraction condition setting unit 15c from the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a of the storage unit 14. P1 to P15 are extracted. The control unit 15 controls the storage unit 14 to store the plurality of in-vivo images P1 to P15 in the extracted image folder 14b as in-vivo images to be displayed as a list.

  The display control unit 15a determines whether or not a characteristic image is latent between the images of the plurality of in-vivo images P1 to P15 that are the list display targets. In this case, the display control unit 15a, from among the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a, a latent image that exists between the images of the plurality of in-vivo images P1 to P15 that are the list display targets. Is read. The display control unit 15a determines whether or not the latent image is a characteristic image based on the read color information of the latent image or additional information such as a flag. Further, when the latent image is a characteristic image, the display control unit 15a determines the type of the characteristic image based on the color information or additional information of the latent image. The display control unit 15a repeatedly executes the characteristic image determination process and the type determination process for all the latent images that exist between the in-vivo images P1 to P15. The display control unit 15a may determine whether the image is a characteristic image based on the color information or additional information of the latent image read from the storage unit 14 in this way, and determine the type of the characteristic image. However, the present invention is not limited to this, and at the timing when the data of the in-vivo image group is acquired from the reader / writer 11, it is determined in real time whether each in-vivo image is a characteristic image to determine the type of the characteristic image. Also good.

  Thereafter, the display control unit 15a associates different marks according to the types of characteristic images with respect to the characteristic images among all the latent images among the in-vivo images P1 to P15. Then, the display control unit 15a controls the display unit 13 so as to display a list of the plurality of in-vivo images P1 to P15 that are the list display targets. In addition, the display control unit 15a adds a mark indicating the type of the characteristic image between images in which the characteristic image is hidden among the plurality of in-vivo images P1 to P15. To control. In this case, the display control unit 15a controls the display unit 13 so as to add a mark associated with a characteristic image latent between the images. The display control unit 15a repeatedly executes the control of the display unit 13 for each characteristic image that is latent between the plurality of in-vivo images P1 to P15.

  Based on the control of the display control unit 15a, the display unit 13 displays a list of in-vivo images P1 to P15 to be listed, and a characteristic image among the plurality of in-vivo images P1 to P15 is displayed. Characteristic image marks are displayed between the latent images. Specifically, as shown in FIG. 4, the display unit 13 displays a list of a plurality of in-vivo images P1 to P15 in a list display window 13a for in-vivo images. The display unit 13 displays the marks M1 to M3 between the in-vivo images P1 and P2 in which the characteristic image is latent, displays the mark M3 between the in-vivo images P4 and P5, and the in-vivo images P11 and P12. The mark M3 is displayed between the images.

  Here, the marks M1 to M3 are different depending on the type of characteristic image, as shown in FIG. The mark M1 is a characteristic image selected based on the input information of the input unit 12, that is, an in-vivo image selected by the user from each in-vivo image displayed on the display unit 13 (hereinafter, referred to as a pickup image in some cases). ) Is a mark indicating that. The mark M2 is a mark indicating that the subject is an in-vivo image including a bleeding part as a subject. The mark M3 is a mark indicating that the in-vivo image includes a lesioned part as a subject.

  Note that the display control unit 15a described above can switch the display / non-display setting of the marks M1 to M3 of the characteristic image based on the input information of the input unit 12. Specifically, as shown in FIG. 4, the display unit 13 displays a setting GUI 16 for setting display or non-display of the marks M1 to M3 in the list display window 13a. The setting GUI 16 includes check boxes 16a to 16c for switching between display and non-display settings of the characteristic image marks M1 to M3. The check box 16a is used to switch the display / non-display setting of the mark M1 of the pickup image among the characteristic images. The check box 16b is for switching the display / non-display setting of the mark M2 of the in-vivo image of the bleeding part in the characteristic image. The check box 16c is for switching the display / non-display setting of the mark M3 of the in-vivo image of the lesioned part in the characteristic image.

  When the check box 16a is turned on by the click operation of the check box 16a, the input unit 12 inputs instruction information for setting the mark M1 to the display state, and when the check box 16a is turned off. Instruction information for putting the mark M1 in a non-display state is input to the control unit 15. When the check box 16b is turned on by clicking the check box 16b, the input unit 12 inputs instruction information for setting the mark M2 to the display state, and when the check box 16b is turned off. Instruction information for putting the mark M2 in a non-display state is input to the control unit 15. When the check box 16c is turned on by the click operation of the check box 16c, the input unit 12 inputs instruction information for setting the mark M3 to the display state and when the check box 16c is turned off. Instruction information for putting the mark M3 in a non-display state is input to the control unit 15. FIG. 4 illustrates check boxes 16a to 16c that are in an on state.

  The display control unit 15a sets each of the marks M1 to M3 to the display state or the non-display state based on each instruction information for instructing the display setting or the non-display setting of each of the marks M1 to M3. The display unit 13 appropriately displays marks M1 to M3 between the in-vivo images P1 to P15 based on the control of the display control unit 15a. In FIG. 4, all of the marks M1 to M3 are set to the display state, and the display unit 13 is configured to display the in-vivo images P1 and P2, the in-vivo images P4 and P5, as described above. The marks M1 to M3 are appropriately displayed between the in-vivo images P11 and P12.

  A user such as a doctor or a nurse can easily view a plurality of in-vivo images P1 to P15 extracted from the in-vivo image group of the subject 1 based on a desired image extraction condition by visually recognizing the list display window 13a. It is possible to easily observe what kind of characteristic image is latent between the plurality of in-vivo images P1 to P15. Accordingly, the user can easily determine the relevance between the characteristic images latent between the images and the in-vivo images P1 to P15 displayed as a list, and the plurality of in-vivo images P1 to P15 and the marks M1 to M3. The positional relationship with the characteristic image indicated by either can be easily recognized. As a result, a target in-vivo image useful for observation and diagnosis inside the organ of the subject 1 can be easily found.

  On the other hand, the display control unit 15a has a feature in the plurality of in-vivo images P1 to P15 based on additional information such as color information or flags of the in-vivo images of the plurality of in-vivo images P1 to P15 that are the list display targets. It is determined whether or not a target image is included. When the characteristic images are included in the in-vivo images P1 to P15, the display control unit 15a displays the characteristic image among the in-vivo images P1 to P15 so as to add a mark indicating the type of the characteristic image. The unit 13 is controlled. Based on the control of the display control unit 15a, the display unit 13 adds a mark M1 to the in-vivo image P13, which is a pickup image, for example, and adds a mark M2 to the in-vivo image P3 of the bleeding part, as shown in FIG. The mark M3 is added to the in-vivo images P4 and P5 of the lesioned part. In this case, the display unit 13 appropriately displays the marks M1 to M3 in the vicinity of the in-vivo images P3, P4, P5, and P13 that are such characteristic images (for example, in the vicinity of the corners of the image).

  A user such as a doctor or a nurse can easily determine that the in-vivo image P3 is an in-vivo image of the bleeding part by visually recognizing the mark M2 added to the in-vivo image P3. Similarly, the user can easily determine that the in-vivo images P4 and P5 are in-vivo images of the lesioned part by visually recognizing the mark M3 added to the in-vivo images P4 and P5, and add it to the in-vivo image P13. By visually recognizing the marked mark M1, it can be easily determined that the in-vivo image P13 is a pickup image.

  On the other hand, when the user selects a desired mark from among the marks M1 to M3 added between the images of the plurality of in-vivo images P1 to P15 that are the list display targets, the display control unit 15a selects the selected mark. The display unit 13 additionally displays a latent image that is a characteristic image corresponding to. That is, the input unit 12 inputs selection information for selecting any one of the marks M1 to M3 displayed between the images in response to an input operation by the user. The display control unit 15a controls the display unit 13 to additionally display the latent image corresponding to the mark selected by the selection information.

  Specifically, as shown in FIG. 5, the input unit 12 responds to a click operation performed by moving the mouse cursor 17 to a mark M3 added between the in-vivo images P11 and P12, for example. The selection information of M3 is input to the control unit 15. The display control unit 15a controls the display unit 13 to additionally display a characteristic image Q1 corresponding to the mark selected by the selection information, that is, the mark M3 between the in-vivo images P11 and P12. The display unit 13 additionally displays an image display window 18 including the characteristic image Q1 corresponding to the mark M3 based on the control of the display control unit 15a. In this way, the display unit 13 pops up the characteristic image Q1 that is hidden between the in-vivo images P11 and P12.

  Here, the shape of the image display window 18 may be a desired shape, but as shown in FIG. 5, it is desirable that the shape is a balloon shape indicating the selected mark M3. Thereby, the display unit 13 can easily display the correspondence between the characteristic image Q1 and the mark M3 in the image display window 18.

  The display unit 13 displays the list display window 13a based on the control of the display control unit 15a. In the list display window 13a, as shown in FIGS. 4 and 5, a time bar 13b and a slider 13c are displayed to indicate any time position among the plurality of in-vivo images displayed in a list. The time bar 13 b is a graphic bar indicating the overall time position of the in-vivo image group of the subject 1. The slider 13c moves along the time bar 13b and moves on the time bar 13b corresponding to the in-vivo image selected from the in-vivo images being displayed in the list (in-vivo images P1 to P15 in FIGS. 4 and 5). Point to the time position.

  4 and 5, the display control unit 15a sets the number of in-vivo images to be displayed as a list in the list display window 13a to 15 but the number of in-vivo images to be displayed in the list display window 13a. May be any desired number, and is not particularly limited to 15. In FIG. 5, in-vivo images P1 to P15 among a plurality of in-vivo images to be displayed in a list are displayed. However, the display unit 13 performs an image scrolling operation, a slider 13c moving operation, or setting of the number of displayed images. A list of the remaining in-vivo images can be displayed by changing or the like.

  As described above, in the first embodiment of the present invention, it is determined whether or not a characteristic image is latent between images of a plurality of in-vivo images that are list display targets. A mark indicating information such as the type of the latent characteristic image is added between images in which the characteristic images of the plurality of in-vivo images are latent to display a list of the plurality of in-vivo images. Configured. Therefore, while observing a plurality of in-vivo images listed on the screen, an image display device, an image display method, and an image display device capable of confirming information on characteristic images that exist between the images of the in-vivo images, and An image display program can be realized.

  By using the image display device according to the first embodiment, while observing a plurality of in-vivo images extracted from a group of in-vivo images of a subject based on a desired image extraction condition, It can be easily recognized what characteristic images are latent between the images. As a result, it is possible to easily determine the relevance between the characteristic images latent between the images and the plurality of in-vivo images displayed as a list, and the positional relationship between the plurality of in-vivo images and the latent characteristic images between the images. Can be easily recognized. As a result, a target in-vivo image useful for observation and diagnosis inside the organ of the subject can be easily found.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In Embodiment 1 described above, a mark indicating information on a characteristic image is added between images in which a characteristic image is hidden among the images of the plurality of in-vivo images that are the list display targets. In the second embodiment, additional information indicating the number of latent images is added between each of the plurality of in-vivo images that are the list display targets.

  FIG. 6 is a block diagram schematically illustrating a configuration example of the image display apparatus according to the second embodiment of the present invention. As illustrated in FIG. 6, the image display device 24 according to the second embodiment includes a control unit 25 instead of the control unit 15 of the image display device 4 according to the first embodiment described above. The control unit 25 includes a display control unit 25a instead of the display control unit 15a of the image display device 4 according to the first embodiment described above. The in-subject information acquisition system according to the second embodiment includes an image display device 24 instead of the image display device 4 of the in-subject information acquisition system according to the first embodiment (see FIG. 1). . Other configurations are the same as those of the first embodiment, and the same reference numerals are given to the same components.

  As described above, the control unit 25 includes the display control unit 25a instead of the display control unit 15a of the image display apparatus 4 according to the first embodiment. The control unit 25 has the same functions as the control unit 15 in the first embodiment described above, except for the function of the display control unit 25a.

  Instead of the characteristic image mark described above, the display control unit 25a displays additional information indicating information on latent in-vivo images (that is, latent images) between images of a plurality of in-vivo images to be displayed as a list. The display unit 13 is controlled so as to display a list of the plurality of in-vivo images added between the images. Specifically, the display control unit 25a reads out a plurality of in-vivo images from the extracted image folder 14b of the storage unit 14 based on the instruction information input by the input unit 12, and sets each of the preset number of displayed images. The display unit 13 is controlled to display a list of a plurality of in-vivo images. In addition, the display control unit 25a causes the display unit 13 to add additional information indicating the number of latent images for each of the plurality of in-vivo images between the images of the plurality of in-vivo images that are the list display targets. Control. In addition, the display control unit 25a has a display control unit 15a of the image display device 4 according to the first embodiment described above except for the function of causing the display unit 13 to display additional information indicating the number of latent images for each image. Has the same function.

  Next, the operation of the image display device 24 according to the second embodiment of the present invention will be described. FIG. 7 is a flowchart illustrating the processing procedure of the image display apparatus when displaying additional information indicating the number of latent images and displaying a list of a plurality of in-vivo images. The image display device 24 according to the second embodiment extracts a plurality of in-vivo images to be displayed as a list from the acquired in-vivo image group of the subject 1, and lists the plurality of in-vivo images for each preset display number. indicate. In this case, the image display device 24 displays additional information indicating the number of latent images between images, which is an example of latent image information, between the images of the plurality of in-vivo images.

  Specifically, as shown in FIG. 7, the control unit 25 of the image display device 24 according to the second embodiment first determines whether or not there is an in-vivo image list display instruction (step S201). In step S201, the control unit 25 determines the presence / absence of an in-vivo image list display instruction in the same manner as in step S101 illustrated in FIG. 3, and determines that there is no in-vivo image list display instruction (No in step S201). This step S201 is repeated until the list display instruction information is input by the input unit 12.

  On the other hand, when the control unit 25 determines in step S201 that there is an in-vivo image list display instruction (step S201, Yes), the control unit 25 extracts the in-vivo images to be displayed in a list from the previously acquired in-vivo image group (step S202). ). In step S202, the image extraction unit 15b extracts a plurality of in-vivo images that are subject to list display from the in-vivo image group of the subject 1 as in step S102 illustrated in FIG. The control unit 25 controls the storage unit 14 to store the plurality of in-vivo images extracted in this way in the extracted image folder 14b.

  Next, the control unit 25 performs a counting process of the number of latent images for each in-vivo image extracted in step S202 (step S203). In step S203, the display control unit 25a displays a plurality of in-vivo images extracted by the image extraction unit 15b as a list display target in the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a of the storage unit 14. The number of remaining in-vivo images is counted for each of the plurality of in-vivo images. Here, the number of the remaining in-vivo images is the number of latent images that exist between the images of the plurality of in-vivo images to be displayed as a list. The display control unit 25a counts the number of latent images between the images of the plurality of in-vivo images that are the list display targets by performing the counting process for each image in this way.

  Subsequently, the control unit 25 causes the display unit 13 to display a list of in-vivo images in a display manner that indicates the number of latent images for each image (step S204). In step S204, the display control unit 25a reads a plurality of in-vivo images extracted by the image extraction unit 15b in step S202 from the extracted image folder 14b of the storage unit 14. Then, the display control unit 25a controls the display unit 13 to display a list of the plurality of in-vivo images for each preset number of in-vivo images displayed in one screen. Further, the display control unit 25a controls the display unit 13 so as to add additional information indicating the number of latent images between the images counted in step S203 between the plurality of in-vivo images.

  Based on the control of the display control unit 25a, the display unit 13 displays a list of a plurality of in-vivo images to be displayed as a list, and displays the number of latent images between the images in the plurality of in-vivo images. Additional information to be displayed is displayed.

  Thereafter, similarly to step S106 shown in FIG. 3, the control unit 25 determines whether or not to end the in-vivo image list display process (step S205), and determines that the process ends (step S205, Yes). This process is terminated. On the other hand, when the control unit 25 determines in step S205 that the process is not finished (No in step S205), the control unit 25 returns to step S201 described above, and repeats the processing procedure after step S201.

  Next, an example in which the number of in-vivo images displayed as a list in one screen is 15 is illustrated, and images when displaying in-vivo images as a list in a display mode that shows information on potential images between images The operation of the display device 24 will be specifically described. FIG. 8 is a schematic view illustrating a list display mode of in-vivo images by the image display device according to the second embodiment of the present invention.

  In the image display device 24 in which the instruction information for displaying the list of in-vivo images is input by the input unit 12, the control unit 25 displays the list of in-vivo images on the basis of the instruction information for list display input by the input unit 12. Judge that there is an instruction. In such a state, the image extraction unit 15b selects the in-vivo image that matches the image extraction condition by the extraction condition setting unit 15c from the in-vivo image group of the subject 1 stored in the in-vivo image folder 14a of the storage unit 14. P1 to P15 are extracted. The control unit 25 controls the storage unit 14 to store the plurality of in-vivo images P1 to P15 in the extracted image folder 14b as in-vivo images to be displayed as a list.

  The display control unit 25a performs a process of counting the number of latent images for each of the plurality of in-vivo images P1 to P15 that are the list display targets. In this case, the display control unit 25 a reads the in-vivo image group of the subject 1 stored in the in-vivo image folder 14 a of the storage unit 14. The display control unit 25a counts the number of latent images that exist between the in-vivo images P1 and P2 in the read in-vivo image group, and then the latent images that exist between the in-vivo images P2 and P3. Count the number of sheets. The display control unit 25a repeatedly executes the process of counting the number of latent images in the same manner between the images after the in-vivo image P3. In this way, the display control unit 25a counts the number of latent images between the plurality of in-vivo images P1 to P15.

  When the above-described image extraction unit 15b extracts 16 or more in-vivo images from the in-vivo image group of the subject 1 as the list display target in-vivo images, the display control unit 25a displays the fifteenth list display target. The counting process of the number of latent images is repeatedly executed between images after the image (that is, the in-vivo image P15).

  Thereafter, the display control unit 25a controls the display unit 13 so as to display a list of a plurality of in-vivo images P1 to P15 that are targets for list display. In addition, the display control unit 25a controls the display unit 13 to add additional information indicating the number of latent images for each image between the plurality of in-vivo images P1 to P15. In this case, the display control unit 25a causes the display unit 13 to display a count processing result of the number of latent images for each of the in-vivo images P1 to P15 as the additional information. When the number of in-vivo images to be displayed on the list is 16 or more, the display control unit 25a also displays the images after the fifteenth list display target image (that is, the in-vivo image P15). Repeat control.

  Based on the control of the display control unit 25a, the display unit 13 displays a list of the in-vivo images P1 to P15 to be displayed as a list, and a latent potential for each image between the plurality of in-vivo images P1 to P15. Additional information indicating the number of images is displayed. Specifically, as shown in FIG. 8, the display unit 13 displays a list of a plurality of in-vivo images P1 to P15 in a list display window 13a for in-vivo images. In addition, the display unit 13 displays additional information A1 to A14 indicating the number of latent images for each of the images in the plurality of in-vivo images P1 to P15. Further, the display unit 13 displays additional information A15 indicating the number of latent images between images after the in-vivo image P15 on the side opposite to the additional information A14 on the side of the in-vivo image P15.

  Here, the additional information A1 to A15 is numerical information indicating the result of counting the number of latent images for each image by the display control unit 25a. Specifically, the additional information A1 is numerical information indicating the number of latent images latent between the in-vivo images P1 and P2, and the additional information A2 is a latent image latent between the in-vivo images P2 and P3. The additional information A3 is numerical information indicating the number of latent images that exist between the in-vivo images P3 and P4. Similarly, the additional information A4 to A14 is numerical information indicating the number of latent images between the in-vivo images P4 to P15.

  The additional information A15 is numerical information indicating the number of latent images latent after the in-vivo image P15 which is the fifteenth list display target image when the number of in-vivo images to be listed is fifteen. On the other hand, when the number of in-vivo images to be listed is 16 or more, the additional information A15 is numerical information indicating the number of latent images that exist between the in-vivo image P15 and the 16th list-display target image. It is.

  A user such as a doctor or a nurse can easily view a plurality of in-vivo images P1 to P15 extracted from the in-vivo image group of the subject 1 based on a desired image extraction condition by visually recognizing the list display window 13a. It is possible to easily observe how many in-vivo images are latent between the plurality of in-vivo images P1 to P15. For this reason, the user can visually recognize each image interval of the in-vivo images P1 to P15 displayed as a list, and can easily grasp the positional relationship between the in-vivo images in the in-vivo images P1 to P15. As a result, the in-vivo images can be efficiently observed in a short time while easily discriminating each imaging region of the in-vivo images P1 to P15 displayed in the list.

  In FIG. 8, the display control unit 25a sets the number of in-vivo images to be displayed as a list in the list display window 13a to 15 but the desired number of in-vivo images to be displayed in the list display window 13a is desired. However, the number is not particularly limited to 15. Further, in FIG. 8, in-vivo images P1 to P15 among a plurality of in-vivo images to be displayed as a list are displayed, but the display unit 13 is configured to scroll the image, move the slider 13c, or set the number of displayed images. A list of the remaining in-vivo images can be displayed by changing or the like. In this case, the display control unit 25a also applies to the images after the fifteenth list display target image (in-vivo image P15) as in the case of the in-vivo images P1 to P15 described above. The display unit 13 is controlled to add additional information indicating the number of latent images. The display unit 13 displays additional information indicating the number of latent images for each image between the images after the in-vivo image P15 based on the control of the display control unit 25a.

  As described above, in the second embodiment of the present invention, additional information indicating the number of latent images that are latent between images of a plurality of in-vivo images to be displayed in a list is added for each image. It was configured to display a list of multiple in-vivo images. Therefore, an image display device, an image display method, and an image that can confirm information on latent images between images of the plurality of in-vivo images while observing the plurality of in-vivo images displayed in a list on the screen. A display program can be realized.

  By using the image display device according to the second embodiment, while observing a plurality of in-vivo images extracted from a group of in-vivo images of a subject based on a desired image extraction condition, It is possible to easily recognize how many in-vivo images are latent between images. For this reason, each image interval of the plurality of in-vivo images displayed in a list can be visually recognized, and thereby the positional relationship between the in-vivo images in the plurality of in-vivo images can be easily grasped. As a result, it is possible to observe the in-vivo images efficiently in a short time while easily discriminating each imaging region of the plurality of in-vivo images.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. In the second embodiment described above, additional information indicating the number of latent images is added between the images of a plurality of in-vivo images that are list display targets. In the third embodiment, the list display target is displayed. The inter-image distances of the plurality of in-vivo images are changed according to the number of latent images between the images, and the plurality of in-vivo images are displayed in a list.

  FIG. 9 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the third embodiment of the present invention. As illustrated in FIG. 9, the image display device 34 according to the third embodiment includes a control unit 35 instead of the control unit 25 of the image display device 24 according to the second embodiment described above. The control unit 35 includes a display control unit 35a instead of the display control unit 25a of the image display device 24 according to the second embodiment. The in-subject information acquisition system according to the third embodiment includes an image display device 34 instead of the image display device 24 of the in-subject information acquisition system according to the second embodiment. Other configurations are the same as those of the second embodiment, and the same components are denoted by the same reference numerals.

  As described above, the control unit 35 includes the display control unit 35a instead of the display control unit 25a of the image display device 24 according to the second embodiment. The control unit 35 has the same function as the control unit 25 in the second embodiment described above, except for the function of the display control unit 35a.

  Instead of adding the additional information indicating the number of latent images between the images, the display control unit 35a changes the inter-image distances of the plurality of in-vivo images to be displayed in a list according to the number of latent images between the images. Then, the display unit 13 is controlled to display a list of the plurality of in-vivo images. Specifically, the display control unit 35 a reads a plurality of in-vivo images from the extracted image folder 14 b of the storage unit 14 based on the instruction information input by the input unit 12. The display control unit 35a counts the number of latent images between each of the plurality of in-vivo images, as in the case of the second embodiment described above. The display control unit 35a displays the plurality of in-vivo images in a list in a manner in which the distance between the images is changed according to the number of latent images of the respective images by a preset display number. To control. In addition, the display control unit 35a has the above-described embodiment except for the function of causing the display unit 13 to display a list of in-vivo images in such a manner that the inter-image distance is changed according to the number of latent images between the images. 2 has the same function as that of the display control unit 25a of the image display device 24 according to FIG.

  Next, the operation of the image display device 34 according to the third embodiment of the present invention will be described. FIG. 10 is a schematic view illustrating a list display mode of in-vivo images by the image display device according to the third embodiment of the present invention. The image display device 34 according to the third embodiment is related to the above-described second embodiment except for the operation for displaying a list of a plurality of in-vivo images by changing the distance between images according to the number of latent images for each image. The operation is the same as that of the image display device 24. That is, the control unit 35 of the image display device 34 executes a processing procedure different from that in the second embodiment in step S204 of steps S201 to S205 shown in FIG. In addition, the control part 35 performs the process sequence similar to the case of Embodiment 2 in remaining step S201-S203 and step S205. Hereinafter, the operation of the image display device 34 in step S204 will be described by exemplifying a case where the number of in-vivo images displayed as a list on one screen is 15.

  In step S204 described above, the display control unit 35a displays the in-vivo images P1 to P15 in a manner in which the inter-image distances of the plurality of in-vivo images P1 to P15 that are the list display targets are changed according to the number of latent images for each image. The display unit 13 is controlled to display a list. In this case, the display control unit 35a converts the number of latent images between the images into an inter-image distance, and displays the in-vivo images P1 to P15 as a list by separating the in-vivo images by the obtained inter-image distance. The display unit 13 is controlled. The image interval distance controlled by the display control unit 35a increases with an increase in the number of latent images between images and decreases with a decrease in the number of latent images between images. When the number of in-vivo images to be displayed in the list is 16 or more, the display control unit 35a also displays the images after the fifteenth list display target image (that is, the in-vivo image P15). Repeat control.

  Based on the control of the display control unit 35a, as shown in FIG. 10, the display unit 13 changes the distance between the images in accordance with the number of latent images between the images. A list of in-vivo images P1 to P15 is displayed. In this case, for example, when the number of latent images between the in-vivo images P1 and P2 is larger than the number of latent images between the in-vivo images P2 and P3, the display unit 13 images the in-vivo images P1 and P2. The distance L1 is made larger than the distance L2 between the in-vivo images P2 and P3. Similarly, the display unit 13 relatively increases the inter-image distance between images in which a larger number of in-vivo images are latent between the in-vivo images P1 to P15 than the other images. The inter-image distance between images in which a small number of in-vivo images are latent as compared with other images is relatively reduced.

  A user such as a doctor or a nurse can easily view a plurality of in-vivo images P1 to P15 extracted from the in-vivo image group of the subject 1 based on a desired image extraction condition by visually recognizing the list display window 13a. The number of latent in-vivo images (that is, the number of latent images) can be easily compared between the plurality of in-vivo images P1 to P15. For this reason, the user can intuitively recognize the image intervals of the list-displayed in-vivo images P1 to P15, thereby easily grasping the positional relationship between the in-vivo images in the in-vivo images P1 to P15. As a result, the in-vivo images can be efficiently observed in a short time while easily discriminating each imaging region of the in-vivo images P1 to P15 displayed in the list.

  In FIG. 10, the display control unit 35a sets the number of in-vivo images to be displayed as a list in the list display window 13a to 15 but the desired number of in-vivo images to be displayed in the list display window 13a. However, the number is not particularly limited to 15. In FIG. 10, in-vivo images P1 to P15 among a plurality of in-vivo images to be displayed as a list are displayed. The display unit 13 is configured to scroll the image, move the slider 13c, or set the number of displayed images. A list of the remaining in-vivo images can be displayed by changing or the like. In this case, the display control unit 35a also applies to each of the images after the fifteenth list display target image (in-vivo image P15) as in the case of the in-vivo images P1 to P15 described above. The display unit 13 is controlled to change the inter-image distance according to the number of latent images. The display unit 13 changes the inter-image distance after the in-vivo image P15 based on the control of the display control unit 35a in accordance with the number of latent images for each image.

  As described above, in the third embodiment of the present invention, the inter-image distances of a plurality of in-vivo images to be displayed in a list are changed according to the number of latent images between the images, and the plurality of in-vivo images are displayed. Are configured in the same manner as in the second embodiment. For this reason, as in the case of the above-described second embodiment, while confirming a plurality of in-vivo images displayed in a list on the screen, confirming information on latent images between these in-vivo images. An image display device, an image display method, and an image display program that can perform the above are realized.

  By using the image display device according to the third embodiment, while observing a plurality of in-vivo images extracted from a group of in-vivo images of the subject based on a desired image extraction condition, It is possible to easily compare the magnitude relationship between the number of latent in-vivo images (that is, the number of latent images). For this reason, each image interval of the plurality of in-vivo images displayed in a list can be intuitively recognized, and thereby the positional relationship between the in-vivo images in the plurality of in-vivo images can be easily grasped. As a result, it is possible to observe the in-vivo images efficiently in a short time while easily discriminating each imaging region of the plurality of in-vivo images.

  In the first embodiment described above, different marks are added depending on the types of characteristic images that exist between the images of the plurality of in-vivo images that are the list display targets, and the types of characteristic images that exist between the images are determined. Further, numerical information indicating the latent number of characteristic images may be added to the mark of the characteristic image. In this case, the display control unit 15a counts the latent number of characteristic images for each of the plurality of in-vivo images. The display control unit 15a adds numerical information indicating the latent image of the characteristic image for each image to the above-described characteristic image mark (for example, the marks M1 to M3), and the characteristic image mark including the numerical information. The display unit 13 is controlled so as to add between the images. Based on the control of the display control unit 15a, the display unit 13 displays a mark of a characteristic image including such numerical information between images where the characteristic image is latent. By visually recognizing the mark of the characteristic image including such numerical information, the user can recognize the type and the number of latent images latent between the images, and as a result, a list of the characteristic images latent between the images. The relevance and positional relationship with the in-vivo image to be displayed can be known more easily.

  In the first embodiment described above, a single characteristic image corresponding to this mark is displayed in the image display window additionally displayed when the mark of the characteristic image is selected by the operation of the input unit 12 by the user. In the case where a plurality of characteristic images corresponding to the mark exist, a plurality of characteristic images corresponding to the mark may be displayed in the image display window.

  Further, in the above-described second embodiment, numerical information indicating the number of latent images for each image is added as additional information indicating information on latent images between the images of the plurality of in-vivo images to be listed. However, the present invention is not limited to this, and the additional information indicating the information of the latent image may be different color information according to the number of latent images between the images. In this case, the display control unit 25a converts the number of latent images between images of a plurality of in-vivo images to be displayed in a list into color information, and adds the obtained color information to the number of latent images between images. The information is added as information, and the display unit 13 is controlled to display a list of the plurality of in-vivo images. The color information changes, for example, from a warm color such as red to a cold color such as blue or a cold color to warm color as the number of latent images increases or decreases between images. The display unit 13 displays a list of the plurality of in-vivo images based on the control of the display control unit 25a, and color information indicating the number of latent images between the images in the plurality of in-vivo images. Is displayed.

  Alternatively, the additional information indicating the information on the latent image may be graph information that changes in accordance with the number of latent images between images. FIG. 11 is a schematic diagram illustrating a specific example of additional information indicating latent image information. The display control unit 25a may add bar graph-shaped graph information as shown in FIG. 11 to the display unit 13 as additional information indicating the number of latent images between images. In this case, the display control unit 25a increases / decreases the bar length D of the graph information shown in FIG. 11 according to the increase / decrease of the number of latent images between images, and sets the bar length D according to the number of latent images between images. The display unit 13 is controlled so that a plurality of in-vivo images are displayed as a list by adding the graph information to be included between the images. The display unit 13 displays a list of the plurality of in-vivo images based on the control of the display control unit 25a, and displays graph information having the bar length D between the images of the plurality of in-vivo images.

  Alternatively, the additional information indicating the latent image information may be different color information depending on the number of latent images between images. FIG. 12 is a schematic diagram illustrating another specific example of additional information indicating information of a latent image. The display control unit 25a may cause the display unit 13 to add pie chart-shaped graph information as illustrated in FIG. 12 as additional information indicating the number of latent images between images. In this case, the display control unit 25a increases / decreases the pie chart area (the hatched portion shown in FIG. 12) of the graph information according to the increase / decrease in the number of latent images between images, and according to the number of latent images between the images. The display unit 13 is controlled so as to display a list of a plurality of in-vivo images by adding graph information having a circular graph region between the images. The display unit 13 displays a list of the plurality of in-vivo images based on the control of the display control unit 25a, and displays graph information having the pie chart region between the images of the plurality of in-vivo images.

  On the other hand, in the above-described second embodiment, additional information indicating the number of latent images for each image is added between the images of the plurality of in-vivo images that are the list display targets. Additional information indicating an imaging time of a latent image between the in-vivo images may be added. In this case, the display control unit 25a also stores time data of each latent image (data indicating imaging time of the in-vivo image by the capsule endoscope 2) that is latent between the images of the plurality of in-vivo images that are the list display targets. In addition, the total imaging time of the latent image between each of the plurality of in-vivo images is calculated. Instead of executing the above-described process of counting the number of latent images for each image, the display control unit 25a executes a process for calculating the total imaging time of the latent images for each of the images, and calculates the latent image for each of the images. The display unit 13 is controlled so that additional information indicating the total imaging time is added and a plurality of in-vivo images are displayed as a list. The display unit 13 displays a list of the plurality of in-vivo images based on the control of the display control unit 25a, and displays the total imaging time of the latent images between the images in the plurality of in-vivo images. Additional information to be displayed is displayed.

  The additional information may be numerical information indicating the total imaging time of the latent images for each image, or may be different color information depending on the total imaging time of the latent images for each image. When the additional information is color information, the display control unit 25a converts the total imaging time of the latent images for each of the plurality of in-vivo images that are the list display targets into color information. The display control unit 25a adds the obtained color information as additional information indicating the total imaging time of latent images for each image, and controls the display unit 13 to display a list of these in-vivo images. Such color information changes, for example, from a warm color such as red to a cold color such as blue, or from a cold color to a warm color as the total imaging time of latent images for each image increases or decreases.

  Alternatively, the additional information may be bar graph-like graph information (see FIG. 11) in which the bar length D increases or decreases according to the increase or decrease in the total imaging time of the latent images for each image, or the latent information for each image. It may be graph information (see FIG. 12) in which the pie chart area increases or decreases according to the increase or decrease of the total image capturing time. In this case, the display control unit 25a increases or decreases the bar length D or the pie chart area of the graph information according to the increase or decrease of the total imaging time of the latent image for each image. The display control unit 25a displays a list of a plurality of in-vivo images by adding graph information having a bar length D or a pie chart area corresponding to the total imaging time of the latent images between the images to each image. The unit 13 is controlled.

  On the other hand, in the above-described second embodiment, additional information indicating the number of latent images for each image is added between the images of the plurality of in-vivo images that are the list display targets. Color information may be added to each image frame of the plurality of in-vivo images as additional information indicating the latent image information latent between the in-vivo images.

  FIG. 13 is a schematic diagram illustrating a modified example of the list display mode of in-vivo images by the image display device according to the second embodiment of the present invention. Specifically, the display control unit 25a converts the number of latent images or the total imaging time of latent images between images of a plurality of in-vivo images that are list display targets into color information. The display control unit 25a adds the obtained color information to each image frame as additional information indicating the number of latent images for each image or the total imaging time of the latent images, and displays a list of these in-vivo images. The display unit 13 is controlled. The color information changes from a warm color such as red to a cold color such as blue or a cold color to warm color, for example, with an increase or decrease in the number of latent images between images or the total imaging time of latent images. As shown in FIG. 13, the display unit 13 displays a list of the plurality of in-vivo images based on the control of the display control unit 25a, and displays each of the plurality of in-vivo images in each image frame. Color information indicating the number of latent images or the total imaging time of latent images is displayed.

  On the other hand, in Embodiment 3 described above, the distance between the images of the plurality of in-vivo images that are the list display targets is changed according to the number of latent images between the images. The inter-image distances of the plurality of in-vivo images may be changed according to the imaging time of the latent images. In this case, the display control unit 35a also stores time data of each latent image (data indicating imaging time of the in-vivo image by the capsule endoscope 2) that is latent between the images of the plurality of in-vivo images that are the list display targets. In addition, the total imaging time of the latent image between each of the plurality of in-vivo images is calculated. Instead of executing the above-described counting process of the number of latent images for each image, the display control unit 35a performs a calculation process for the total imaging time of the latent images for each of the images, and the latent image for each of the images is calculated. The total imaging time is converted into the distance between images. The display control unit 35a controls the display unit 13 to display a list of a plurality of in-vivo images by separating the in-vivo images by the obtained distance between images. The image interval distance controlled by the display control unit 35a increases with an increase in the total imaging time of the latent images between the images, and decreases with a decrease in the total imaging time of the latent images between the images. Based on the control of the display control unit 35a, the display unit 13 displays a list of a plurality of in-vivo images that are subject to list display in a manner in which the distance between the images is changed according to the total imaging time of the latent images for each image. To do.

  In the above-described first to third embodiments, when a plurality of in-vivo images are displayed in a list, a mark indicating characteristic image information or additional information indicating the number of latent images is added between the images of the plurality of in-vivo images. Alternatively, although the distance between the images is changed according to the number of latent images for each image, the present invention is not limited to this, and an image display device that appropriately combines these first to third embodiments may be used.

  For example, the image display device 4 according to the first embodiment displays the mark of the characteristic image between the images as described above, and the list display target is the same as the image display device 24 according to the second embodiment. Additional information indicating the number of latent images or the total imaging time may be displayed between each of a plurality of in-vivo images. In this case, the display control unit 15a of the image display device 4 only needs to have the same function as the display control unit 25a in the second embodiment. Further, the image display device 4 according to the first embodiment displays the mark of the characteristic image between the images as described above, and, similar to the image display device 34 according to the third embodiment, for each image. A plurality of in-vivo images to be listed may be displayed as a list by changing the distance between the images according to the number of latent images or the total imaging time. In this case, the display control unit 15a of the image display device 4 only needs to have the same function as the display control unit 35a in the third embodiment.

  On the other hand, in Embodiments 1 to 3 described above, a threshold relating to the similarity of in-vivo images is set as an image extraction condition for extracting in-vivo images to be displayed as a list. It is not limited to the threshold regarding similarity. For example, the image extraction condition may be a threshold relating to a predetermined color level such as red or green in the in-vivo image, a threshold relating to the average color level of the in-vivo image, or in the in-vivo image. It may be a threshold value related to a predetermined color spread level (number of pixels of a predetermined color), or is a frame interval number when thinning out or extracting an in-vivo image from a group of in-vivo images taken in time series. It may be a combination of at least two of these.

It is a schematic diagram which shows one structural example of the in-subject information acquisition system provided with the image display apparatus concerning Embodiment 1 of this invention. 1 is a block diagram schematically showing a configuration example of an image display apparatus according to a first embodiment of the present invention. It is a flowchart which illustrates the process sequence of the image display apparatus at the time of displaying the mark of a characteristic image, and displaying a list of several in-vivo images. It is a schematic diagram which illustrates the list display mode of the in-vivo image by the image display apparatus concerning Embodiment 1 of this invention. It is a schematic diagram which illustrates the state which the image display apparatus additionally displayed the characteristic image corresponding to a mark. It is a block diagram which shows typically one structural example of the image display apparatus concerning Embodiment 2 of this invention. It is a flowchart which illustrates the process sequence of the image display apparatus at the time of displaying the additional information which shows the number of latent images, and displaying a list of several in-vivo images. It is a schematic diagram which illustrates the list display mode of the in-vivo image by the image display apparatus concerning Embodiment 2 of this invention. It is a block diagram which shows typically the example of 1 structure of the image display apparatus concerning Embodiment 3 of this invention. It is a schematic diagram which illustrates the list display mode of the in-vivo image by the image display apparatus concerning Embodiment 3 of this invention. It is a schematic diagram which shows a specific example of the additional information which shows the information of a latent image. It is a schematic diagram which shows another specific example of the additional information which shows the information of a latent image. It is a schematic diagram which shows the modification of the list display mode of the in-vivo image by the image display apparatus concerning Embodiment 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Subject 2 Capsule endoscope 3 Reception apparatus 3a-3h Reception antenna 4, 24, 34 Image display apparatus 5 Recording medium 11 Reader / writer 12 Input part 13 Display part 13a List display window 13b Time bar 13c Slider 14 Storage part 14a In-vivo image folder 14b Extracted image folder 15, 25, 35 Control unit 15a, 25a, 35a Display control unit 15b Image extraction unit 15c Extraction condition setting unit 15d Image processing unit 16 Setting GUI
16a to 16c Check box 17 Mouse cursor 18 Image display window A1 to A15 Additional information M1 to M3 Mark P1 to P15 In-vivo image Q1 Characteristic image

Claims (17)

An image acquisition unit for acquiring a series of images taken along a time series;
An image extraction unit for extracting a plurality of images from the series of images;
A display unit for displaying a list of the plurality of images extracted by the image extraction unit;
A mark indicating information on a latent image between images of the plurality of images, and a mark that is different for each type of characteristic image latent between the images of the plurality of images is added between the images of the plurality of images. a display control section for controlling the display unit so as to list said plurality of images Te,
An image display device comprising: An input unit for inputting selection information of any of the plurality of marks added between the images of the plurality of images;
The display controller, the image display apparatus according to claim 1, wherein the controller controls the display unit to add display potential image corresponding to the mark selected by said selection information. When the display image includes a characteristic image in the plurality of images, the display control unit adds a mark indicating the type of the characteristic image to the characteristic image of the plurality of images. the image display apparatus according to claim 1 or 2, characterized in that to control. The display control unit further controls the display unit to display the plurality of images in a list by adding additional information indicating the information of the latent image between the images of the plurality of images. The image display device according to claim 1. The image display device according to claim 4 , wherein the additional information is numerical information indicating the number of latent images latent in the plurality of images or the imaging time. The image display apparatus according to claim 4 , wherein the additional information is graph information that changes in accordance with the number of latent images latent in the plurality of images or the imaging time. The image display apparatus according to claim 4 , wherein the additional information is color information that varies depending on a number of latent images latent in the plurality of images or an imaging time. The latent image information includes the number of latent images or the imaging time for each of the plurality of images,
The display control unit is further configured to change the inter-image distance between the plurality of images according to the number of latent images or the imaging time for each of the images, and to display the plurality of images as a list. The image display apparatus according to claim 1, wherein the image display apparatus is controlled. The latent image information includes the number of latent images or the imaging time for each of the plurality of images,
The display control unit further controls the display unit to display a list of the plurality of images by changing the frame color of the plurality of images according to the number of latent images or the imaging time between the images. The image display device according to claim 1. The image display apparatus according to claim 1 , wherein the characteristic image is selected by a user. The image display apparatus according to claim 1 , wherein the characteristic image is an image including color information unique to a bleeding part or a lesion part. An image extraction step of extracting a plurality of images from a series of images taken along a time series;
A mark indicating information of a latent image between the images of the plurality of images extracted by the image extraction step , wherein the mark is different for each type of characteristic image latent between the images of the plurality of images. A list display step for displaying a list of the plurality of images by adding between images ;
An image display method comprising: The image display method according to claim 12, characterized in further including that the determination step of determining whether the potential is characteristic image between the images of the plurality of images extracted by the image extracting step. A counting step of counting the number of latent images for each of the plurality of images extracted by the image extraction step;
The image display method according to claim 12 , wherein the list display step further displays the list of the plurality of images in a display form indicating the number of latent images for each of the plurality of images. An image extraction procedure for extracting a plurality of images from a series of images taken in time series,
A mark indicating information of a latent image between images of the plurality of images extracted by the image extraction procedure , wherein the mark is different for each type of characteristic image latent between the images of the plurality of images. A list display procedure for displaying a list of the plurality of images by adding between images ;
An image display program for causing a computer to execute. The image display program according to claim 15, characterized in further including that a determination procedure for determining whether the potential is characteristic image between the images of the plurality of images extracted by the image extraction procedure. A counting procedure for counting the number of latent images for each of the plurality of images extracted by the image extraction procedure;
16. The image display program according to claim 15 , wherein the list display procedure further displays the plurality of images in a display form indicating the number of latent images for each of the plurality of images.

Images