JP4891646B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device that displays a series of images in a subject taken in time series, and in particular, a plurality of images taken by a multi-lens capsule endoscope equipped with a plurality of image sensors. The present invention relates to an image display device that displays

  Conventionally, in the field of endoscope, a swallowable capsule endoscope having an imaging function and a wireless communication function has been proposed, and an image in a subject can be captured using such a capsule endoscope. An in-subject information acquisition system has been developed. The capsule endoscope is swallowed through the body cavity, for example, the stomach, small intestine, and other organs, after being swallowed from the subject's mouth for observation (examination) and before being spontaneously discharged. While moving, images in the subject are sequentially captured at intervals of, for example, 0.5 seconds.

  While the capsule endoscope moves within the subject, images captured by the capsule endoscope are sequentially transmitted to an external receiving device by wireless communication. The receiving device has a wireless communication function and a memory function, and sequentially stores images received from the capsule endoscope in the subject in the memory. The subject can act freely by carrying such a receiving apparatus from swallowing the capsule endoscope to spontaneous discharge. After the capsule endoscope is spontaneously ejected from the subject, the doctor or nurse takes the image stored in the memory of the receiving device into the image display device, and the image of the organ in the subject is displayed in the image display device. It is possible to make a diagnosis of a subject by displaying the information (for example, see Patent Document 1).

  On the other hand, in such an in-subject information acquisition system, a multi-lens capsule endoscope equipped with a plurality of image sensors may be used. Such a multi-lens capsule endoscope has a plurality of image sensors that capture images in different directions, and acquires images in a plurality of directions imaged by the plurality of image sensors (see, for example, Patent Document 2). In this case, the multi-lens capsule endoscope wirelessly transmits the acquired images in a plurality of directions to the receiving device. The receiving apparatus sequentially accumulates images in a plurality of directions captured by such a multi-lens capsule endoscope. The image display device captures images in a plurality of directions accumulated in the receiving device, classifies the acquired images in the plurality of directions for each imaging element of the multi-lens capsule endoscope described above, and stores the images. Thereafter, the image display device sequentially displays the images of the respective image groups classified for each imaging element in this way.

Japanese Patent Laid-Open No. 2003-19111 US Patent Application Publication No. 2002/0109774

  However, the above-described conventional image display device displays images of each image group captured by the multi-lens capsule endoscope simply on the same screen in time series. A plurality of images captured by the mirror, that is, a plurality of images captured from completely different subjects are displayed side by side on the same screen. It is difficult to grasp the contents of each image while observing a plurality of such images at the same time. Therefore, it is difficult to observe an image in a subject imaged by a multi-lens capsule endoscope. There was a point.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image display device capable of displaying an image in a subject imaged by a multi-lens capsule endoscope in an easily observable manner. And

In order to solve the above-described problems and achieve the object, an image display device according to the present invention includes a plurality of image groups in a subject imaged by an imaging element group mounted on a multi-lens capsule endoscope. Display means for displaying each image included in each of the first and second image groups, a first image included in the first image group, and an image included in the second image group. Setting means for setting a synchronous display mode for synchronously displaying a second image obtained by imaging a subject common to the first image on each display area of the display means; and setting the synchronous display mode by the setting means In this case, the image processing apparatus includes control means for performing control to display the first image and the second image in synchronization with each display area of the display means.

In the image display device according to the present invention as set forth in the invention described above, the setting unit sets a time difference between the imaging time of the first image and the imaging time of the second image, and the control unit includes: Control is performed to synchronously display the first image and the second image having the time difference in each display area of the display means.

In the image display device according to the present invention , in the above invention, the default data in which the time difference between the imaging time of the first image and the imaging time of the second image is set for each part in the subject is stored. Storage means for storing, wherein the control means switches the time difference for each part in the subject based on the default data, and has the time difference set for each part in the subject. Control is performed to synchronously display one image and the second image in each display area of the display means.

In the image display device according to the present invention as set forth in the invention described above, the setting means can change the time difference.

In the image display device according to the present invention as set forth in the invention described above, the setting unit sets a frame number difference between the first image and the second image, and the control unit includes the frame number. Control is performed to display the first image and the second image having the difference in synchronization with each display area of the display means.

In the image display apparatus according to the present invention , in the above invention, a memory for storing default data in which a difference in frame number between the first image and the second image is set for each region in the subject. The control means switches the frame number difference for each part in the subject based on the default data, and calculates the frame number difference set for each part in the subject. Control is performed to synchronously display the first image and the second image that are included in each display area of the display means.

In the image display apparatus according to the present invention as set forth in the invention described above, the setting means can change the difference between the frame numbers.

In the image display device according to the present invention , in the above invention, the display means includes a first reduced image corresponding to the first image and a second reduced image corresponding to the second image. Further, the setting means sets the association between the first reduced image and the second reduced image.

The image display apparatus according to the present invention is characterized in that, in the above-mentioned invention, the display means displays an index indicating an association between the first reduced image and the second reduced image.

In the image display device according to the present invention , in the above invention, the display means includes a first time slider indicating a temporal position of an image included in the first image group and the second image group. A second time slider indicating a temporal position of an image included in the first time slider and the second time slider, wherein the first time slider and the second time slider are the first image and the second image. It is one of the setting means for setting a time difference or a frame number difference.

In the image display device according to the present invention , in the above invention, the second image is obtained by capturing a subject common to the first image from an image capturing direction different from that of the first image. Features.

In the image display device according to the present invention as set forth in the invention described above, the setting means includes a display mode for displaying images included in the first image group in time series and the second image group. The display mode for displaying the images to be displayed in time series is set independently.

  According to the present invention, images obtained by imaging the same subject common to the first and second images respectively included in a plurality of image groups of the subject from a plurality of imaging directions are displayed in each display area of the display unit. Sequentially synchronous display is possible. As a result, an image display device capable of sequentially displaying each image included in the multidirectional image group in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope in an easily observable manner is realized. There is an effect that can be done.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, exemplary embodiments of an image display device according to the invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

(Embodiment 1)
FIG. 1 is a schematic diagram schematically illustrating a configuration example of an in-vivo information acquiring system including an image display device according to the first embodiment of the present invention. As shown in FIG. 1, this in-subject information acquisition system includes a capsule endoscope 2 that moves in the digestive tract of the subject 1 and captures an image in the subject 1, and a capsule endoscope 2. The receiving device 3 that receives the transmitted wireless signal and stores the image included in the received wireless signal, and the image that is stored in the receiving device 3, that is, the image that is displayed by the capsule endoscope 2 is displayed. A display device 4 and a portable recording medium 5 for transferring data between the receiving device 3 and the image display device 4 are provided.

  The capsule endoscope 2 is a multi-eye capsule endoscope equipped with an image sensor group that captures images in different directions. Such a multi-lens capsule endoscope 2 is introduced into the subject 1, and has a multi-directional imaging function for sequentially capturing images in a plurality of directions in the subject 1 in time series, and imaging. And a wireless communication function for wirelessly transmitting the multidirectional image group to the outside. Specifically, the capsule endoscope 2 passes through the esophagus in the subject 1 by being swallowed by the subject 1 and advances in the body cavity by the peristalsis of the digestive tract cavity. At the same time, the capsule endoscope 2 sequentially captures multi-directional images in the subject 1 at a predetermined interval, for example, at intervals of 0.5 seconds, and performs multiple imaging in the subject 1 via predetermined radio waves. The image of the direction is sequentially transmitted to the receiving device 3.

  The receiving device 3 is connected to, for example, a plurality of receiving antennas 3 a to 3 h distributed on the body surface of the subject 1, and is connected to the capsule endoscope 2 via any of the plurality of receiving antennas 3 a to 3 h. The multi-directional image in the subject 1 is acquired based on the received wireless signal. In addition, the receiving device 3 is detachably inserted into the portable recording medium 5, and is sequentially acquired based on a radio signal from the capsule endoscope 2, that is, captured by the capsule endoscope 2. Multi-directional images are sequentially stored in the portable recording medium 5. In this way, the receiving device 3 has a multidirectional image group (that is, a plurality of images classified for each image sensor) in the subject 1 captured by the image sensor group of the capsule endoscope 2 in time series. Image group) is stored in the portable recording medium 5.

  The receiving antennas 3a to 3h are realized using, for example, a loop antenna, and receive a radio signal transmitted by the capsule endoscope 2. As shown in FIG. 1, the receiving antennas 3 a to 3 h are arranged at predetermined positions on the body surface of the subject 1, for example, at positions corresponding to the passage route (that is, the digestive tract) of the capsule endoscope 2 in the subject 1. Distributed. The receiving antennas 3a to 3h may be distributed at predetermined positions of a jacket worn by the subject 1. In this case, the receiving antennas 3a to 3h are placed at predetermined positions on the body surface of the subject 1 corresponding to the passage path of the capsule endoscope 2 in the subject 1 when the subject 1 wears this jacket. Be placed. One or more such receiving antennas may be arranged with respect to the subject 1, and the number of the receiving antennas is not particularly limited to eight.

  The portable recording medium 5 is a portable recording medium such as CompactFlash (registered trademark). The portable recording medium 5 is detachable from the receiving device 3 and the image display device 4 and has a structure capable of outputting and recording data when being inserted into both. Specifically, when the portable recording medium 5 is inserted into the receiving device 3, the portable recording medium 5 stores various data such as a multidirectional image group obtained by the capsule endoscope 2 and its imaging time obtained by the receiving device 3. Store sequentially. On the other hand, when the portable recording medium 5 is inserted into the image display device 4, the storage data such as a multidirectional image group by the capsule endoscope 2 described above is output to the image display device 4. In this way, the stored information data of the portable recording medium 5 is taken into the image display device 4. In the portable recording medium 5, information related to the subject 1 of the capsule endoscopy is written by the image display device 4. In this capsule endoscope examination, the capsule endoscope 2 is introduced into the subject 1 and an image captured by the capsule endoscope 2 is observed.

  The image display device 4 is for displaying multidirectional images and the like captured by the capsule endoscope 2. Specifically, the image display device 4 captures various data such as multidirectional images captured by the capsule endoscope 2 by capturing various data stored in the portable recording medium 5 by the receiving device 3. It has a configuration such as a workstation that displays multidirectional images in the subject 1 based on the acquired data. In this case, the image display device 4 classifies the acquired multidirectional image group for each image pickup element of the capsule endoscope 2 and stores it in the storage unit. Such an image display device 4 is configured to store at least one of each image included in one image group and each image included in the other image group of the multidirectional image group in the subject 1 in a predetermined manner. It has an image display function for sequentially displaying in the display area. Furthermore, the image display device 4 has a processing function for a user such as a doctor or a nurse to observe (examine) an image in the subject 1 and diagnose the subject 1. In this case, the user sequentially displays the images in the subject 1 on the image display device 4 and observes (examines) the parts in the subject 1, such as the esophagus, stomach, small intestine, and large intestine. In addition, the subject 1 can be diagnosed.

  Next, the configuration of the image display device 4 according to the first embodiment of the present invention will be described. FIG. 2 is a block diagram schematically illustrating a configuration example of the image display device 4 according to the first embodiment of the present invention. As shown in FIG. 2, the image display device 4 includes an input unit 11 for inputting various information or data, a display unit 12 for displaying an image in the subject 1, a GUI (Graphical User Interface), and the like, And a card interface (I / F) 13 for capturing stored data such as images in the specimen 1 accumulated in the portable recording medium 5. The image display device 4 also has an input / output I / F 14 for inputting / outputting various information or data to / from an external computer or printer or a portable recording medium and various data such as an image of the subject 1. It has the memory | storage part 15 to preserve | save and the control part 16 which controls the drive of each structure part of the image display apparatus 4. FIG.

  The input unit 11 is realized using an input device such as a keyboard and a mouse, and inputs various information or data to the control unit 16 by an input operation by a user. Specifically, the input unit 11 sets instruction information for instructing the control unit 16, patient information regarding the subject 1, and setting information for setting the image display mode of the image of the subject 1 displayed on the display unit 12. Then, data necessary for displaying the image of the subject 1 in the image display mode is input.

  The patient information is registered in the receiving device 3 through, for example, the portable recording medium 5 in order to initialize the receiving device 3 as a receiving device for performing a capsule endoscopy on the subject 1. Is. Examples of such patient information include the patient name, sex, date of birth, patient ID, and the like of the subject 1.

  The display unit 12 is realized using various displays such as a CRT display or a liquid crystal display, and displays various information or data instructed to be displayed by the control unit 16. Specifically, the display unit 12 displays various information and data for observing and diagnosing the subject 1, for example, among a plurality of images of the subject 1 captured by the imaging element group of the capsule endoscope 2. Each image included in each of the two image groups is displayed. The display unit 12 displays a GUI that functions as a setting unit that sets various image display modes for displaying the image of the subject 1. In addition to setting various image display modes, such a GUI functions as a setting unit that sets data (for example, time difference data described later) necessary to display an image of the subject 1 in the set image display mode. Furthermore, it functions as an operating means for displaying and operating the image of the subject 1.

  The card I / F 13 is for taking in the storage data of the portable recording medium 5 described above. Specifically, the card I / F 13 is detachably inserted into the portable recording medium 5, reads the stored data stored in the portable recording medium 5, and sends the obtained stored data to the control unit 16. Forward. Further, the card I / F 13 writes information instructed to be written by the control unit 16, for example, the above-described patient information, etc., to the inserted portable recording medium 5.

  The input / output I / F 14 inputs / outputs various kinds of data between, for example, an external computer or a peripheral device such as a printer and the image display device 4, or an inserted portable recording medium and the image display device 4 Input / output various data between Specifically, the input / output I / F 14 can be detachably inserted into a portable recording medium such as a flexible disk (FD), a compact disk (CD), or a DVD (Digital Versatile Disk). This is realized by using a drive or the like for performing various data reading processing or writing processing on the recording medium. The input / output I / F 14 has a structure capable of data communication with a peripheral device such as an external computer or a printer via a predetermined cable or LAN. Such an input / output I / F 14 writes data instructed by the control unit 16 to a recording medium in the drive, or outputs data instructed by the control unit 16 to an external computer or a peripheral device such as a printer. Output. The input / output I / F 14 reads data instructed to be read by the control unit 16 from a recording medium in the drive, and transfers the obtained data to the control unit 16.

  The storage unit 15 is realized by using information recording means capable of storing and reading various data and information such as a RAM, an EEPROM, or a hard disk, and stores information or data instructed to be written by the control unit 16. The storage information or storage data instructed to be read by 16 is transmitted to the control unit 16. Such a storage unit 15 includes an examination folder 15a for holding and managing an examination file of the subject 1 including an image group of the subject 1, patient information, examination information (for example, examination date and examination ID), and the like. And a management folder 15b for holding and managing various files such as a chart (report), a still image, and a moving image of the subject 1 generated by the processing function of the display device 4. In this case, the storage unit 15 includes, in the examination folder 15a, the first image group PG1 among the image groups in the subject 1 captured by the imaging element group of the multi-lens capsule endoscope 2 described above. The second image group PG2 is saved.

  Note that the first image group PG1 and the second image group PG2 are respectively provided by two image sensors that capture images in different directions from among the image sensor groups mounted on the multi-lens capsule endoscope 2 described above. It is the captured image group. For example, the first image group PG1 is captured by an image sensor that captures an image in the forward direction of the capsule endoscope 2 (that is, the traveling direction of the subject 1 in the digestive tract). On the other hand, the second image group PG2 is captured by an image sensor that captures an image in the backward direction of the capsule endoscope 2 (that is, the direction opposite to the traveling direction of the subject 1 in the digestive tract).

  As described above, the control unit 16 controls each drive of the image display device 4 such as the input unit 11, the display unit 12, the card I / F 13, the input / output I / F 14, and the storage unit 15, Controls input / output of information to / from each component. Specifically, the control unit 16 includes a multi-directional image group (for example, the first image group PG1 and the second image group PG2 described above) of the subject 1 acquired through the portable recording medium 5 and the multi-images. An examination file obtained by generating a file in which time information relating to the imaging time of each image included in the directional image group, patient information of the subject 1 and examination information for the subject 1 are associated with each other and created as a file Is stored in the examination folder 15a. In this case, the control unit 16 holds and manages each examination file stored in the examination folder 15a for each subject or each examination ID, for example.

  Such a control unit 16 includes a display control unit 16a, an image processing unit 16b, a report creation unit 16c, and an image file creation unit 16d. The display control unit 16a has a plurality of image display modes, and controls the display operation of the display unit 12 according to a mode selected from the plurality of image display modes.

  The image processing unit 16 b performs various processes on a plurality of image groups in the subject 1 acquired via the portable recording medium 5. Specifically, the image processing unit 16b performs predetermined image processing on a plurality of image groups acquired via the portable recording medium 5, and selects the plurality of image groups (that is, multidirectional image groups). Each image group (for example, the first image group and the second image group) classified by the image pickup device of the capsule endoscope 2 is stored in the storage unit 15. Further, the image processing unit 16 b creates a reduced image (for example, a thumbnail image) of the image displayed in the display area of the display unit 12 based on the instruction information input by the input unit 11.

  The report creation unit 16c creates a report describing the diagnosis results and the like related to the subject 1 using various information input by the input unit 11, the image of the subject 1 and the like. The image file creation unit 16d creates an image file of a desired still image or moving image based on an image group (for example, the first image group PG1 or the second image group PG2 of the subject 1) included in the examination file. .

  Next, the display screen of the display unit 12 will be specifically exemplified, and various GUIs displayed on the display unit 12 and the operation of the display control unit 16a for controlling the display operation of the display unit 12 will be described. FIG. 3 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on the display unit 12. When a predetermined login process is performed by the control unit 16, the display control unit 16a displays a window W1 as shown in FIG.

In this window W1, images P _n (n = 0, 1, 2, 3,...) Included in the first image group PG1 stored in the examination folder 15a of the storage unit 15 and the second image group PG2 are displayed. The included image Q _m (m = 0, 1, 2, 3,...) And the above-described various GUIs are displayed. Specifically, as shown in FIG. 3, in the window W1, a main image display area 100 for displaying the images P _n and Q _m and various display operations for images displayed in the main image display area 100 are performed. A display operation icon group 110 that is an operation GUI and a capture icon 120 that is a GUI for instructing creation of a reduced image (for example, a thumbnail image) of the image displayed in the main image display area 100 are formed. In this case, the main-image display area 100 includes a display area 101 for sequentially displaying such images P _n, and a display area 102 for sequentially displaying such images Q _m.

The window W1 includes a synchronization icon 130, which is a setting GUI for setting any one of the plurality of image display modes of the display control unit 16a, and the display areas 101 and 102 in the main image display area 100. A data setting area 131 for setting a time difference ΔT between the image capturing time of the image P _{n and} the image capturing time of Q _m is displayed. Further, in the window W1, the temporal lengths of the first image group PG1 and the second image group PG2 displayed in the main image display area 100 (for example, from the start of imaging of the first image group PG1 and the second image group PG2). A time scale TS indicating the elapsed time) and a GUI indicating a time position of the image P _n displayed in the display area 101 (that is, a position on the time scale TS corresponding to the image P _n in time). A time slider 132 and a time slider 133 that is a GUI indicating the temporal position of the image Q _m displayed in the display area 102 (that is, the position on the time scale TS corresponding to the image Q _m in time) are formed. Is done.

Here, the time slider 132 with points to temporal position of the image P _n displayed in the display area 101, under the control of the display control unit 16a, synchronized with the switching of the images P _n in the display region 101 The time scale TS moves in the forward or backward direction of the time series. In this case, the display control unit 16 a causes the display area 101 to display an image P _n corresponding to the current temporal position indicated by the time slider 132 in synchronization with the movement of the time slider 132. On the other hand, the time slider 133, with points to the temporal position of the image Q _m displayed in the display area 102, under the control of the display control unit 16a, in synchronization with the switching of the image Q _m in the display area 102 Move on the time scale TS in the forward or backward direction of the time series. In this case, the display control unit 16 a causes the display area 102 to display an image Q _m corresponding to the current temporal position indicated by the time slider 133 in synchronization with the movement of the time slider 133.

Such time sliders 132 and 133 can set the time difference ΔT between the images P _n and Q _{m in} the same manner as the data setting area 131 described above by dragging using the input unit 11. In this case, as shown in FIG. 3, the time position interval indicated by the time sliders 132 and 133 corresponds to the time difference ΔT between the images P _n and Q _m displayed in the data setting area 131.

Accordingly, the synchronization icon 130, the data setting area 131, and the time sliders 132 and 133 described above display the synchronous display mode in which the images P _n and Q _m having the time difference ΔT are synchronously displayed on the display areas 101 and 102, respectively. It is GUI which functions as a setting means to set as the image display mode. Such a synchronization icon 130 sets a synchronous display mode when a click operation is performed using the input unit 11. Specifically, the input unit 11 inputs setting information for instructing setting of the synchronous display mode to the control unit 16 by performing a click operation of the synchronization icon 130 once. In this case, the display control unit 16a selects a synchronous display mode from a plurality of image display modes based on the setting information input by the input unit 11.

  The synchronization icon 130 sets the normal display mode as the image display mode of the display control unit 16a when the click operation is performed again (that is, cancels the synchronous display mode). Specifically, the input unit 11 inputs setting information for instructing setting of the normal display mode to the control unit 16 by performing a click operation on the synchronization icon 130 again. In this case, the display control unit 16a selects the normal display mode from the plurality of image display modes based on the setting information input by the input unit 11.

Note that this synchronous display mode is an image display mode in which the image P _n and the image Q _{m obtained} by imaging the subject common to the image P _n (for example, the lesion E) are synchronously displayed in the display areas 101 and 102. . In such a synchronous display mode, the difference between the imaging times of the images P _n and Q _m displayed synchronously in the display areas 101 and 102 is the time difference set by the data setting area 131 or the time sliders 132 and 133 described above. It is almost equivalent to ΔT. In this case, the frame number n (n = 0, 1, 2, 3,...) Of the image P _n in the first image group PG1 and the frame number m (m = 0, 1, 1,...) Of the image Q _m in the second image group PG2. 2, 3) corresponds to the time difference ΔT. For example, when both the first image group PG1 and the second image group PG2 are captured at intervals of 0.5 seconds per image, the time difference ΔT between the image capturing times of the images P _n and Q _m is set to 1000 msec. The difference (mn) between the frame numbers of the images P _n and Q _m is 2.

On the other hand, the above-described normal display mode is an image display mode in which the images P _n and Q _m are sequentially displayed along the frame numbers in the display areas 101 and 102 regardless of the time difference ΔT. In the normal display mode, the frame numbers n and m of the images P _n and Q _m displayed in the display areas 101 and 102 are usually the same value.

Further, as shown in FIG. 3, the window W1 includes a sub-image display area 140 for additionally displaying reduced images of the images P _n and Q _m instructed by clicking the capture icon 120, and the sub-image display area. A scroll bar 141 for performing a scroll operation of the reduced image (for example, thumbnail image) displayed in 140 is formed. Specifically, the input unit 11 performs a click operation on the capture icon 120 to provide instruction information for instructing creation of reduced images of the images P _n and Q _m displayed in the display areas 101 and 102, as a control unit. 16 In this case, the image processing unit 16b creates reduced images of the images P _n and Q _m each time the instruction information is input by the input unit 11. The display control unit 16a stores the reduced image created by the image processing unit 16b in the storage unit 15 and sequentially displays the reduced image in the sub-image display area 140. In this way, in the sub-image display area 140, for example, thumbnail images SP1, SP2, SP3, SP5 corresponding to the images displayed in the display area 101 and thumbnail images corresponding to the images displayed in the display area 102 are displayed. SP4 and SP6 are displayed.

  In addition, a cursor K for performing click operations or drag operations of various GUIs by operating the input unit 11 and a Close icon 150 for closing such a window W1 are formed in the window W1.

Here, the display operation icon group 110 displayed in the window W1 includes a reproduction icon 111, a frame reproduction icon 112, a cue icon 113, a reverse reproduction icon 114, a reverse frame reproduction icon 115, and a reverse cueing. It consists of an icon 116. Such a display operation icon group 110 sets a display operation of the images P _n and Q _{m in} the display areas 101 and 102 by a click operation using the input unit 11. In this case, the input unit 11 inputs display instruction information corresponding to the icons included in the display operation icon group 110 to the control unit 16 by clicking any one of the display operation icon groups 110. The display control unit 16a sequentially displays the images P _n and Q _m in the display areas 101 and 102 based on the display instruction information input by the input unit 11.

Specifically, when the reproduction icon 111 is clicked, the display control unit 16a sequentially displays the images P _n and Q _m in the display areas 101 and 102 along the time-series forward direction. When the reproduction icon 112 is clicked, the images P _n and Q _m are sequentially displayed in the display areas 101 and 102 in the time-series forward direction. In addition, when the reverse playback icon 114 is clicked, the display control unit 16a sequentially displays the images P _n and Q _m in the display areas 101 and 102 in the time-series reverse direction to perform reverse frame playback. When the icon 115 is clicked, the images P _n and Q _m are sequentially displayed in the display areas 101 and 102 in the time series reverse direction each time.

  On the other hand, when the click operation of the cue icon 113 is performed, the display control unit 16a displays the last image of the first image group PG1 on the display area 101 and the last image of the second image group PG2. Is displayed in the display area 102. Further, when the reverse operation icon 116 is clicked, the display control unit 16a displays the first image of the first image group PG1 on the display area 101 and displays the first image of the second image group PG2. It is displayed in the display area 102.

The display areas 101 and 102 described above are highlighted in a frame shape with a predetermined color or pattern when an image is displayed. In this case, the time slider 132 indicating the temporal position of the image P _n displayed in the display area 101 and the thumbnail images SP1, SP2, SP3, SP5 corresponding to the images displayed in the display area 101 are displayed in the display area 101. Is highlighted in the same way as Further, the time slider 133 indicating the temporal position of the image Q _m displayed in the display area 102 and the thumbnail images SP4 and SP6 corresponding to the image displayed in the display area 102 are the same as the highlighted display of the display area 102. Is highlighted. By such highlighting, the correspondence between the display area 101, the time slider 132, and the thumbnail images SP1, SP2, SP3, SP5 can be easily recognized, and the display area 102, the time slider 133, the thumbnail images SP4, SP6, and Can be easily recognized.

  Next, setting of the time difference ΔT using the data setting area 131 or the time sliders 132 and 133 described above will be described. FIG. 4 is a schematic diagram for explaining a procedure for setting the time difference ΔT using the data setting area 131 or the time sliders 132 and 133.

In FIG. 4, first, images P _n and Q _m are displayed in the display areas 101 and 102 of the main image display area 100, respectively. Next, when the first image group PG1 is captured by an image sensor that directs the imaging field of view in the forward direction of the capsule endoscope 2, images P _n and Q _m displayed in the display areas 101 and 102 are displayed. the time slider 133 and drag operation using the input unit 11 with reference, sequentially switching the image Q _m moves the time slider 133. Drag in such time slider 133, locates the image Q _m a subject common is imaged on the image P _n currently displayed in the display area 101 from the second image group PG2, such images P _n, Q _m Are displayed in the display areas 101 and 102. In this case, the images P _n and Q _m are obtained by capturing images of subjects that are common to each other from different directions.

In this state, the interval between the time sliders 132 and 133 corresponds to the time difference ΔT between the images P _n and Q _m . In this way, the time sliders 132 and 133 can set the time difference ΔT between the images P _n and Q _m . In this case, the data setting area 131 displays the numerical value of the time difference ΔT set by the time sliders 132 and 133.

Alternatively, the time sliders 132 and 133 are dragged so as to find the images P _n and Q _m obtained by changing the viewpoint of the lesioned part E or the characteristic inner wall in the digestive tract, and the images P _n and Q _m A time difference ΔT may be set.

Specifically, the images P _n and Q _m are displayed on the display areas 101 and 102 of the main image display area 100, respectively, and then the input unit 11 is used while referring to the image P _n displayed on the display area 101. By dragging the time slider 132, the time slider 132 is moved and the images _Pn are sequentially switched. By the drag operation of the time slider 132, an image P _n in which a characteristic subject (for example, a lesioned part E or a characteristic inner wall in the digestive tract) is imaged is searched from the first image group PG1, and the characteristic subject is detected. The image P _n is displayed in the display area 101.

Then, the time slider 133 and drag operation using the input unit 11 while referring to the image Q _m displayed on the display area 102, sequentially switching the image Q _m moves the time slider 133. Drag in such time slider 133, locates the image Q _m of characteristic objects that are common to the image P _n as described above is imaged from the second image group PG2, displays the image Q _m of such distinctive object It is displayed in the area 102. In this case, the images P _n and Q _m are obtained by capturing characteristic objects in common with each other from different directions.

In this state, the interval between the time sliders 132 and 133 corresponds to the time difference ΔT between the images P _n and Q _m , and as a result, the time sliders 132 and 133 can set the time difference ΔT between the images P _n and Q _m. . Also in this case, the data setting area 131 displays the numerical value of the time difference ΔT set by the time sliders 132 and 133.

The time difference ΔT between the images P _n and Q _m can also be set by directly inputting a numerical value into the data setting area 131 using the input unit 11. In this case, the time sliders 132 and 133 move so as to form an interval corresponding to the time difference ΔT input to the data setting area 131.

When the time difference ΔT is set by the data setting area 131 or the time sliders 132 and 133, the input unit 11 inputs time difference data corresponding to the time difference ΔT to the control unit 16. In this case, the control unit 16 stores the time difference data input by the input unit 11 in the storage unit 15, and stores and manages this time difference data as the time difference ΔT between the images P _n and Q _{m in} the above-described synchronous display mode. When the time difference ΔT is reset by the data setting area 131 or the time sliders 132 and 133, the control unit 16 resets the time difference data held and managed in the storage unit 15 (that is, after the change). The time difference data corresponding to ΔT is updated.

Next, the operation of the control unit 16 that performs control to display the images P _n and Q _m synchronously in the display areas 101 and 102 in the synchronous display mode will be described. FIG. 5 is a flowchart for explaining a processing procedure of the control unit 16 for synchronously displaying the images P _n and Q _m having the time difference ΔT set using the GUI in the display areas 101 and 102.

In FIG. 5, first, the control unit 16 selects the synchronous display mode set by the above-described synchronous icon 130 as the image display mode (step S101). In this case, the display control unit 16a selects the synchronous display mode from the plurality of image display modes based on the setting information input from the input unit 11 by clicking the synchronization icon 130. When the synchronous display mode is set in this way, the control unit 16 reads the time difference data set by the data setting area 131 or the time sliders 132 and 133 from the storage unit 15 (step S102). The display control unit 16a acquires the time difference data read in this way as the time difference ΔT between the images P _n and Q _m in the synchronous display mode.

Next, the control unit 16 initializes the frame number of the first image group PG1 (step S103). In this case, the display control unit 16a initializes the frame number n of the display target image in the first image group PG1 (for example, sets n = 0). Subsequently, the control unit 16 calculates the display processing target frame number m in the second image group PG2 based on the set time difference data (step S104). In this case, the display control unit 16a, based on the time difference data read in step S102 described above, the image Q _m with a time difference ΔT for the image P _n to be displayed synchronously on the display area 101 (e.g., n = 0) The frame number m is calculated.

Thereafter, the control unit 16 determines whether or not there is an image display instruction for the images P _n and Q _m (step S105). Specifically, the input unit 11 includes any of the icons included in the display operation icon group 110 described above (for example, the playback icon 111, the frame playback icon 112, the cue icon 113, the reverse playback icon 114, and the reverse frame playback icon 115). When the reverse cue icon 116) is clicked, display instruction information corresponding to the clicked icon is input to the control unit 16. When the display instruction information is not input from the input unit 11, the control unit 16 determines that there is no image display instruction for the images P _n and Q _m (No in Step S105), and repeats Step S105. That is, the control unit 16 repeats this step S105 until such display instruction information is input by the input unit 11.

On the other hand, when such display instruction information is input from the input unit 11, the control unit 16 determines that there is an image display instruction for the images P _n and Q _m based on the input display instruction information (step S105, Yes). ), The images P _n and Q _m of the current frame numbers n and m are synchronously displayed in the display areas 101 and 102 (step S106). In this case, the display control unit 16a reads the image P _n of the current frame number n (n = 0, 1, 2, 3,...) From the first image group PG1 stored in the storage unit 15 and obtains it. Control is performed to display the obtained image P _n in the display area 101. In synchronization with the display of the image P _n , the display control unit 16a reads the image Q _m of the current frame number m from the second image group PG2 stored in the storage unit 15, and the obtained image Q _m Is displayed in the display area 102. In this way, the display control unit 16a displays the images P _n and Q _m having the set time difference ΔT in the display areas 101 and 102 in a synchronized manner.

Here, the current frame number m is the frame number of the image Q _m having a time difference ΔT with respect to the image P _n displayed in the display area 101 in step S106. Therefore, the current frame number m has a frame number difference α (α = 1, 2, 3,...) Corresponding to the time difference ΔT with respect to the frame number n. That is, in step S106, the display control unit 16a displays the images P _n and Q _m (m = n + α) having the frame number difference α corresponding to the set time difference ΔT in the display areas 101 and 102.

  The current frame number n in step S106 is the frame number n (= 0) initialized in step S103 described above or the frame number n updated in step S107 described later.

Thereafter, the control unit 16 updates the frame number n of the first image group PG1 (step S107). In this case, the display control unit 16a updates (for example, adds +1) the frame number n of the first image group PG1 in order to read the image _Pn displayed in the display area 101 from the storage unit 15 in the next step S106.

Next, the control unit 16 determines whether or not the time difference data is changed (reset) by the data setting area 131 or the time sliders 132 and 133 described above (step S108). Specifically, the input unit 11 inputs time difference data reset by the data setting area 131 or the time sliders 132 and 133 to the control unit 16. When the reset time difference data is not input from the input unit 11, the control unit 16 determines that the time difference ΔT has not been changed (No in step S108), and updates the frame number m of the second image group PG2 (step S108). S109). In this case, the display control unit 16a, the frame number of the second image group PG2 to read the image Q _m to be displayed in synchronization with the images P _n display area 102 in step S106 in the next from the storage unit 15 m (m = n + α) is updated according to the frame number n (for example, +1 is added).

On the other hand, when the reset time difference data is input from the input unit 11, the control unit 16 determines that the time difference ΔT has been changed based on the input time difference data (Yes in step S108) and stores the data. The time difference data in the unit 15 is updated to time difference data corresponding to the changed time difference ΔT. Thereafter, the control unit 16 calculates the frame number m of the second image group PG2 based on the changed time difference data (step S110). In this case, the display control unit 16a has the changed time difference ΔT with respect to the image P _n displayed synchronously in the display region 101 in the next step S106 based on the changed (after reset) time difference data. The frame number m (m = n + β) of the image Q _m is calculated. The frame number difference β is a frame number difference between the images P _n and Q _m having the changed time difference ΔT.

  Thereafter, the control unit 16 determines whether or not there is a pause instruction for the control of displaying the images Pn and Qm in the display areas 101 and 102 (step S111). Specifically, the control unit 16 receives the display instruction information corresponding to any of the frame playback icon 112, the cue icon 113, the reverse frame playback icon 115, and the reverse cue icon 116 in the above-described step S105. If it is input from, it is determined that there is a pause instruction (Yes in step S111). In this case, the control unit 16 returns to step S105 described above and repeats the processing procedure after step S105.

On the other hand, when the display instruction information corresponding to the reproduction icon 111 or the reverse reproduction icon 114 is input from the input unit 11 in step S105 described above, the control unit 16 determines that there is no pause instruction (No in step S111). In this case, the control unit 16 determines whether or not the synchronous display processing of the images P _n and Q _m in the synchronous display mode has been completed (step S112).

Specifically, when the frame number n updated in step S107 described above is equal to or greater than the number of frames of the first image group PG1, or the frame number m updated in step S109 described above or the step described above. If the frame number m calculated in S110 is equal to or greater than the number of frames of the second image group PG2, it is determined that the synchronous display processing of the images P _n and Q _m in the synchronous display mode has been completed (Yes in step S112). The synchronous display process in the synchronous display mode is completed.

On the other hand, the control unit 16 calculates that the frame number n updated in step S107 described above is less than the number of frames of the first image group PG1, and the frame number m updated in step S109 described above or calculated in step S110 described above. When the frame number m is less than the number of frames of the second image group PG2, it is determined that the synchronous display processing of the images P _n and Q _m in the synchronous display mode has not been completed (No in step S112), and the above-described step Return to S106. Then, the control part 16 repeats the process sequence after this step S106.

Next, the case where the first image group PG1 and the second image group PG2 in the subject 1 are imaged at intervals of 0.5 seconds per image by the imaging element group of the multi-lens capsule endoscope 2 is exemplified. The operation of the control unit 16 that performs control to sequentially display the images P _n and Q _m sequentially in the display areas 101 and 102 in the synchronous display mode will be specifically described. FIG. 6 is a schematic diagram for explaining a specific example of the operation of the control unit 16 that sequentially displays the images P _n and Q _m having the set time difference ΔT in the display areas 101 and 102 in sequence.

  In FIG. 6, the first image group PG <b> 1 is obtained by an image sensor 2 a having an imaging field in the forward direction (advancing direction of the capsule endoscope 2) among the image sensor groups mounted on the multi-lens capsule endoscope 2. For example, it is an image group captured at intervals of 0.5 seconds. The second image group PG2 is imaged at intervals of, for example, 0.5 seconds by the imaging element 2b having an imaging field in the backward direction (opposite to the traveling direction of the capsule endoscope 2) of the imaging element group. Image group. The control unit 16 stores the multidirectional image group captured via the portable recording medium 5 in the inspection folder 15 a of the storage unit 15. In this case, the image processing unit 16b classifies the multidirectional image group for each imaging element of the capsule endoscope 2 to form the first image group PG1 and the second image group PG2, and these are stored in the examination folder. Save in 15a.

Here, when the time difference ΔT is set by the data setting area 131 or the time sliders 132 and 133 and the synchronous display mode is set by the synchronization icon 130, the control unit 16 sets the image P having the time difference ΔT as described above. _n and Q _m are displayed synchronously in the display areas 101 and 102. Specifically, when the time difference ΔT is set to, for example, 1000 msec, the display control unit 16a displays the first image P ₀ (frame number n = 0) of the first image group PG1 captured at 0.5 second intervals. And the image Q ₂ having a time difference ΔT of 1000 msec with respect to the image P ₀ from the second image group PG 2 captured at intervals of 0.5 seconds are displayed synchronously on the display areas 101 and 102. Thereafter, the display control unit 16a synchronously displays the image P ₁ with the frame number n = 1 and the image Q ₃ having a time difference ΔT of 1000 msec with respect to the image P ₁ in each of the display areas 101 and 102. The image P ₂ with the number n = 2 and the image Q ₄ having a time difference ΔT of 1000 msec with respect to the image P ₂ are synchronously displayed, and the image P ₃ with the frame number n = ₃ and 1000 msec with respect to the image P ₃ are displayed. The image Q ₅ having the time difference ΔT is displayed synchronously.

Thus, the display control unit 16a, the image _{Q m (m = n + α} ) and the sequential synchronization on each of the display areas 101 and 102 having a time difference ΔT of 1000msec the image P _n and the image P _n of the frame number n Display. In addition, when the first image group PG1 and the second image group PG2 are captured at intervals of 0.5 seconds per image, the frame number difference α between the images P _n and Q _m having a time difference ΔT of 1000 msec is 2. .

The display control unit 16a also displays the images P _n and Q _m to be displayed synchronously in the display areas 101 and 102 each time the time difference ΔT is changed (reset) by the data setting area 131 or the time sliders 132 and 133. Is switched to the changed time difference ΔT. In this case, the display control unit 16a sequentially and synchronously displays the images P _n and Q _m (m = n + β) having the frame number difference β (β: integer) corresponding to the changed ΔT in the display areas 101 and 102. Let

Next, the images P _n and Q _m that are synchronously displayed in the display areas 101 and 102 in the synchronous display mode will be described. FIG. 7 is a schematic diagram for explaining the relationship between the images P _n and Q _m displayed synchronously in the display areas 101 and 102 in the synchronous display mode. As shown in FIG. 7, images P _n and Q _m (for example, m = n + 2) having a set time difference ΔT are stored in the main image display area 100 based on the control of the display control unit 16a in the synchronous display mode. The display areas 101 and 102 are displayed synchronously.

When the images P _n and Q _m are synchronously displayed in the display areas 101 and 102 as described above, a subject common to the image P _n is captured in the image Q _m . Specifically, the imaging device 2a is an image including, for example, a lesioned part E located in the front direction of the capsule endoscope 2 (that is, the traveling direction of the capsule endoscope 2 in the digestive tract of the subject 1) in the subject. Image _Pn . On the other hand, the image pickup element 2b, after the capsule endoscope 2 has passed the position of the lesion portion E, capturing an image Q _m including lesions E positioned toward the rear of the capsule endoscope 2 in the subject .

Here, the elapsed time from when the lesioned part E is imaged from one imaging direction by the imaging element 2a until the imaging is performed from the other imaging direction by the imaging element 2b is synchronized with the display areas 101 and 102 in the synchronous display mode. This is substantially equal to the time difference ΔT between the displayed images P _n and Q _m . That is, by setting a time difference ΔT that is substantially equivalent to the elapsed time using the data setting area 131 or the time sliders 132 and 133, the images P _n and Q _m having the time difference ΔT are subject to a common subject (for example, a lesion) Part E) is obtained by imaging from different imaging directions.

  Note that the elapsed time is such that after the imaging element 2a images the lesioned part E located in front of the capsule endoscope 2, the capsule endoscope 2 passes through the position of the lesioned part E, and then the imaging is performed. This is the time elapsed until the element 2b images the lesioned part E located behind the capsule endoscope 2.

Thus, by sequentially displaying the images P _n and Q _m on which the subjects common to each other are captured in the respective display areas 101 and 102, a user such as a doctor or a nurse can easily view the image in the subject 1. In addition to being able to observe, for example, characteristic sites such as the lesioned part E and the inner wall of the digestive tract (for example, a pleat-like site) that is difficult to observe from one direction can be easily observed from a plurality of directions.

  Next, the report creation unit 16c included in the control unit 16 will be described. As described above, the report creation unit 16c creates a report that describes the diagnosis results and the like related to the subject 1 using various information input by the input unit 11, images of the subject 1 and the like. In this case, the report creating unit 16c can put the facility logo of the facility inspecting the subject 1 at a desired position of the report. FIG. 8 is a schematic diagram showing a specific example of a window for displaying a setting GUI for attaching a facility logo to a desired position in a report.

  As shown in FIG. 8, in this window W2, a drive setting unit 201 for setting a desired drive from among the drives of the input / output I / F 14 or the storage unit 15 and the drive setting unit 201 are set. A file display area 202 for displaying a list of files in the drive and a logo display area 203 for displaying a facility logo stored in a file selected from the file display area 202 are formed. In the window W2, a logo position setting unit 204 for setting the position of the facility logo to be included in the report, a Clear icon 205 for deleting the facility logo displayed in the logo display area 203, and the report are displayed. An OK icon 206 for determining the insertion of the facility logo and a Cancel icon 207 for canceling the setting insertion of the facility logo are formed.

  The drive setting unit 201 displays a drop-down list of each drive in the input / output I / F 14 and the storage unit 15 by operating the input unit 11, and sets a desired drive from the drop list. The file display area 202 displays a list of files in the drive set by the drive setting unit 201. A desired file among the files displayed in a list in the file display area 202 is selected by a click operation of the input unit 11. The logo display area 203 displays an image of the facility logo stored in the file selected from the file display area 202.

  The logo position setting unit 204 displays a drop-down list of facility logo positions to be included in the report by operating the input unit 11, and sets a desired position from the drop list. The drop-down list of the logo position setting unit 204 includes, for example, upper left, upper right, upper center, lower left, lower right, and lower center in the report. The report creation unit 16c selects a desired position selected from the drop-down list by clicking the input unit 11 as the facility logo insertion position in the report.

  When the instruction information corresponding to the OK icon 206 is input by the input unit 11, the report creation unit 16 c is displayed in the above-described logo display area 203 at the position in the report set by the logo position setting unit 204. A facility logo, that is, a facility logo in a file selected from the file display area 202 is inserted. In this way, the report creating unit 16c can include the facility logo of the facility that examined the subject 1 in the report related to the subject 1. In addition, when the insertion position of the facility logo is changed by the logo position setting unit 204 described above, the report creation unit 16c changes the insertion position of the facility logo in the report in response to the setting change.

  Next, the insertion setting of the manufacturer logo for the report of the subject 1 will be described. The report creation unit 16c puts a maker logo at a predetermined position (for example, a footer) in the report of the subject 1 in the default setting. By changing the maker logo insertion setting, the report creation unit 16c can create a report without the maker logo. it can. FIG. 9 is a schematic diagram showing a specific example of a window that displays a setting GUI for changing the maker logo insertion setting in the report.

  As shown in FIG. 9, the window W3 includes a check box 210 for setting whether or not to insert a manufacturer logo (manufacturer logo) at a predetermined position in the report, an OK icon 211, and a Cancel icon 212. It is formed. When the user desires to insert the manufacturer logo into the report, he / she operates the input unit 11 to set the check box 210 to a checked state (a state where a check mark is displayed), and clicks an OK icon 211. In this case, the report creation unit 16c receives setting information for setting whether or not to insert the manufacturer logo in the report by the input unit 11, and inserts the manufacturer logo at a predetermined position (for example, a footer) in the report based on the setting information. .

  On the other hand, when the user does not wish to insert the manufacturer logo in the report, the user operates the input unit 11 to set the check box 210 to the unchecked state (the state where no mark is displayed) and clicks the OK icon 211. . In this case, the report creation unit 16c receives the setting information for setting no insertion of the manufacturer logo in the report by the input unit 11, and creates a report without the manufacturer logo based on the setting information. It should be noted that such setting of presence / absence of the manufacturer logo may be switched only when logged in with service authority.

  Next, creation of a report related to the subject 1 will be described. FIG. 10 is a schematic diagram illustrating a specific example of a window that displays a setting GUI for setting predetermined data described in a report. As shown in FIG. 10, in this window W4, a doctor name text box 220 for setting a doctor name described in the report, a facility name text box 221 for setting a facility name described in the report, and an address described in the report An address text box 222 for setting a telephone number, a telephone number text box 223 for setting a telephone number to be described in the report, a mail address text box 224 for setting an e-mail address to be described in the report, an OK icon 225, and a Cancel icon 226. And are formed.

  In the doctor name text box 220, for example, the name of the doctor who diagnosed the subject 1 is input by the operation of the input unit 11. In the facility name text box 221, for example, the name of a facility such as a hospital that diagnosed the subject 1 is input by operating the input unit 11. In the address text box 222, for example, the address of the facility where the subject 1 is diagnosed is input by the operation of the input unit 11. In the telephone number text box 223, for example, the telephone number of the facility where the subject 1 is diagnosed is input by operating the input unit 11. In the e-mail address text box 224, for example, an e-mail address addressed to a doctor who diagnosed the subject 1 or a facility is input by the operation of the input unit 11.

  When the input unit 11 performs a click operation on the OK icon 225, the input unit 11 inputs the doctor name text box 220, the facility name text box 221, the address text box 222, the telephone number text box 223, and the mail address text box 224. Text data such as letters or numbers is input to the control unit 16. In this case, the report creation unit 16c grasps the doctor name, facility name, address, telephone number, and e-mail address described in the report based on the text data input by the input unit in this way. In this way, the doctor name, facility name, address, telephone number, and e-mail address described in the report are set. When creating the report of the subject 1, the report creating unit 16c automatically inserts the doctor name, facility name, address, telephone number, and e-mail address set in this way at predetermined positions in the report. .

  FIG. 11 is a schematic diagram illustrating a specific example of a window that displays a GUI for creating a report of the subject 1. As shown in FIG. 11, in this window W5, a report format R of the subject 1 to be created is formed, and a doctor who sets a doctor name to be described at a predetermined position in the report in the report format R A name setting unit 230, a facility name setting unit 231 for setting a facility name described at a predetermined position in the report, an address setting unit 232 for setting an address described at a predetermined position in the report, and a predetermined position in the report A telephone number setting unit 233 for setting a telephone number to be described and a mail address setting unit 234 for setting an electronic mail address described at a predetermined position in the report are formed. In the window W5, a diagnostic information text box 235 for inputting diagnostic information such as findings and summaries related to the diagnostic result of the subject 1 is formed in the format R of the report, and in the vicinity of the format R of the report. In addition, a Save icon 236 and an Export icon 237 are formed.

  The report creation unit 16c includes the patient information A1 of the subject 1 stored in the examination folder 15a of the storage unit 15, the images A2 and A3 in the subject 1, and the images in the format R of the report. Antenna arrangement diagrams A4 and A5 for estimating the parts A2 and A3 are inserted.

  The doctor name setting unit 230 automatically inserts the doctor name input in the doctor name text box 220 when creating a new report. The doctor name setting unit 230 displays a drop-down list of doctor names by operating the input unit 11 and sets a desired doctor name from the doctor name drop list. In this case, the doctor name setting unit 230 displays a drop-down list including the doctor name first input in the doctor name text box 220 and the doctor name re-input. The report creation unit 16c can insert a desired doctor name selected from the doctor name drop-down list into the report.

  The facility name setting unit 231 automatically inserts the facility name input in the facility name text box 221 when creating a new report. The facility name setting unit 231 displays a facility name drop-down list by the operation of the input unit 11, and sets a desired facility name from the facility name drop list. In this case, the facility name setting unit 231 displays a drop-down list including the facility name first input in the facility name text box 221 and the facility name re-input. The report creation unit 16c can insert a desired facility name selected from the facility name drop-down list into the report.

  The address setting unit 232 automatically inserts the address input in the address text box 222 when creating a new report. The address setting unit 232 displays an address drop-down list by operating the input unit 11 and sets a desired address from the address drop list. In this case, the address setting unit 232 displays a drop-down list including the address first input in the address text box 222 and the re-input address. The report creation unit 16c can insert a desired address selected from the address drop-down list into the report.

  The telephone number setting unit 233 automatically inserts the telephone number input in the telephone number text box 223 when creating a new report. The telephone number setting unit 233 displays a telephone number drop-down list by operating the input unit 11, and sets a desired telephone number from the telephone number drop list. In this case, the telephone number setting unit 233 displays a drop-down list including the telephone number initially input in the telephone number text box 223 described above and the telephone number re-input. The report creating unit 16c can insert a desired telephone number selected from the drop-down list of such telephone numbers into the report.

  The email address setting unit 234 automatically inserts the email address input in the email address text box 224 when creating a new report. The e-mail address setting unit 234 displays a drop-down list of e-mail addresses by operating the input unit 11, and sets a desired e-mail address from the e-mail address drop list. In this case, the mail address setting unit 234 displays a drop-down list including the electronic mail address first input in the mail address text box 224 and the re-input electronic mail address. The report creation unit 16c can insert a desired email address selected from the drop-down list of email addresses into the report.

  The report creation unit 16c includes the doctor name, facility name, address, telephone number, and e-mail address set as described above, the patient information A1 of the subject 1, and the subject input in the diagnostic information text box 235. The report is created by inserting the diagnostic information 1, the images A <b> 2 and A <b> 3 in the subject 1, and the antenna layout diagrams A <b> 4 and A <b> 5 at predetermined positions.

  The report file (report data) of the subject 1 created by the report creating unit 16 c is stored in the storage unit 15 based on the control of the control unit 16 when the save icon 236 is clicked using the input unit 11. Are stored in the management folder 15b. The report file of the subject 1 is inserted into the drive of the input / output I / F 14 based on the control of the control unit 16 when the click operation of the Export icon 237 using the input unit 11 is performed. The data is output (recorded) to a portable recording medium (FD, CD, DVD, etc.).

  Next, the image file creation unit 16d included in the control unit 16 will be described. As described above, the image file creation unit 16d selects a desired still image based on the image group (for example, the first image group PG1 and the second image group PG2) included in the inspection file stored in the inspection folder 15a. Or create a moving image file.

  Specifically, the image file creation unit 16d selects one or more desired images from the first image group PG1 or the second image group PG2 of the subject 1 based on the instruction information input by the input unit 11, for example. Extraction is performed, and a still image file or a moving image file is created based on the extracted one or more images. In this case, the control unit 16 saves the still image file or the moving image file created by the image file generation unit 16 d in the management folder 15 b of the storage unit 15.

  The still image file created by the image file creation unit 16d is an image file that can be output in a general-purpose still image data format such as GIF, JPEG, or TIF. The moving image file created by the image file creating unit 16d is an image file that can be output in a general-purpose moving image data format such as WMV or MPEG.

  FIG. 12 is a schematic diagram showing a specific example of a window displaying a GUI for outputting a still image file or a moving image file of the subject 1 created by the image file creation unit 16d to a desired drive. As shown in FIG. 12, in this window W6, a still image file display area 240 for displaying a list of still image files, a moving image file display area 241 for displaying a list of moving image files, a still image file to be output, and An output file display area 242 for displaying a moving image file and an add icon 243 for adding an output target still image file or moving image file to the output file display area 242 are formed. In the window W6, a drive setting unit 244 that sets the output destination drive of the still image file and the moving image file to be output, and an image file output to the drive set by the drive setting unit 244 are executed. An Export icon 245 is formed. Further, the window W6 includes an image display area 246 for displaying a still image file selected from the still image file display area 240 or a moving image file selected from the moving image file display area 241, and an image display area. A display operation icon group 247 for performing a display operation of a still image or a moving image displayed on H.246 is formed.

  The still image file display area 240 displays a list of still image files created by the image file creation unit 16d. A desired still image file among the still image files displayed as a list in the still image file display area 240 is selected by a click operation of the input unit 11. Thereafter, when the add icon 243 is clicked by the input unit 11, the desired still image file is added to the output file display area 242. The output file display area 242 displays the desired still image file added in this way as an output target.

  The moving image file display area 241 displays a list of moving image files created by the image file creating unit 16d. A desired moving image file among the moving image files displayed in a list in the moving image file display area 241 is selected by a click operation of the input unit 11. Thereafter, when the add icon 243 is clicked by the input unit 11, the desired moving image file is added to the output file display area 242. The output file display area 242 displays the desired moving image file added in this way as an output target.

  The drive setting unit 244 displays a drop-down list of each drive in the input / output I / F 14 and the storage unit 15 by operating the input unit 11, and a desired drive, that is, an output file display area 242 from this drop list. Set the output destination drive of the output still image file and moving image file displayed in. In this case, the drive setting unit 244 sets the output destination drive in this way, thereby setting the recording medium for storing the output still image file and moving image file displayed in the output file display area 242. As a recording medium for storing the still image file and the moving image file to be output, a hard disk constituting the storage unit 15 and a portable recording medium inserted in the input / output I / F 14 (for example, FD, CD, DVD etc.).

  When the Export icon 245 is clicked by the input unit 11, the output still image file and moving image file are output to the drive set by the drive setting unit 244 and stored in the recording medium of this drive.

  The image display area 246 is a still image file selected from the still image file display area 240 or a moving image selected from the moving image file display area 241 based on a display operation using the display operation icon group 247. Play or reverse play the file.

  Note that the report file created by the above-described report creation unit 16c is output to a set desired drive and stored in a recording medium of this drive, almost like the still image file or moving image file. FIG. 13 is a schematic diagram illustrating a specific example of a window displaying a GUI for outputting a report file of the subject 1 created by the report creation unit 16c to a desired drive.

  As shown in FIG. 13, in this window W7, a drive setting unit 250 for setting the output destination drive of the report file to be output, and a capacity display area 251 indicating the free capacity of the drive set by the drive setting unit 250 are displayed. Then, an OK icon 252 and a Cancel icon 253 are formed. The window W7 is displayed when the Export icon 237 formed in the report creation window W5 illustrated in FIG. 11 is clicked by the input unit 11.

  The drive setting unit 250 displays a drop-down list of each drive in the input / output I / F 14 and the storage unit 15 by operating the input unit 11, and a desired drive, that is, a report creation unit 16c is selected from the drop list. Set the output destination drive for the created report file. In this case, the drive setting unit 250 sets the output destination drive in this way, thereby storing the report file created by the report creation unit 16c (for example, the hard disk constituting the storage unit 15, the input / output FD, CD, DVD, etc. inserted in the I / F 14) are set.

  When the OK icon 252 is clicked by the input unit 11, the report file to be output is output to the drive set by the drive setting unit 250 and stored in the recording medium of this drive.

  Next, setting of user authority of the image display device 4 will be described. Depending on the method of examining the subject 1 performed by the user (doctor or nurse, etc.), the type of software processing permitted to be used by the user authority set in the image display device 4 by default may not be suitable for the actual operation. is there. In this case, the type of software processing permitted to be used may be changed depending on the user authority of the image display device 4.

  FIG. 14 is a schematic diagram illustrating a specific example of a window that displays a setting GUI for changing the setting of the user authority of the image display device 4. As shown in FIG. 14, in this window W8, the user authority display area 261 for displaying a list of software processes depending on the user authority of the image display apparatus 4 and the use of the software processes listed in the user authority display area 261 are displayed. A check box group 262 for setting permission or use prohibition, an OK icon 263, and a Cancel icon 264 are formed.

  The user authority display area 261 changes and displays a list of software processes in which user authority settings can be changed according to the type of user who has logged into the software of the image display device 4 (for example, an administrator or a general user). . In this case, each check box of the check box group 262 is formed for each software processing name displayed as a list in the user authority display area 261.

  Specifically, a user (for example, an administrator) who has logged into the software of the image display device 4 operates the input unit 11 to select a general user (for example, from among software processes displayed in a list in the user authority display area 261). Check the check box corresponding to the software process that is permitted to be used by a doctor or nurse (check mark is displayed), and check the check box corresponding to the software process that is prohibited to be used (check mark is not displayed). And the OK icon 263 is clicked.

  Thus, by setting each check box of the check box group 262 to a checked state or a non-checked state as necessary, the user authority for the general user can be reset, and software permitted to be used by the user authority The type of processing can be set to suit the operation of general users.

  As described above, in the first embodiment of the present invention, the first and second of the plurality of image groups in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope. A time difference ΔT between the imaging times of the first and second images included in each of the image groups is set by the GUI, and the first image and the second image having the time difference ΔT are displayed in each display area of the display unit. The first image and the second image in which the subject common to the first image is captured are sequentially displayed in synchronization in each display area. For this reason, images obtained by imaging the same subject common to the first and second images from a plurality of imaging directions can be sequentially and synchronously displayed in the display areas of the display unit. As a result, an image display device capable of sequentially displaying each image included in the multidirectional image group in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope in an easily observable manner is realized. can do.

  By using the image display apparatus according to the first embodiment of the present invention and displaying a multidirectional image group in a subject synchronously, a user such as a doctor or a nurse can easily observe the image in the subject. In addition, for example, a characteristic site such as a lesion and an inner wall of the digestive tract (for example, a pleat-like site) that is difficult to observe from one direction can be easily observed from a plurality of directions.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In the image display apparatus according to the first embodiment described above, the time difference ΔT between the images P _n and Q _{m to be} displayed synchronously in the display areas 101 and 102 of the display unit 12 is set using the GUI. In the image display apparatus according to the second embodiment, the default data of the time difference ΔT set in advance for each part in the subject is stored in the storage unit 15, and the time difference ΔT of the images P _n and Q _m is set based on the default data. Like to do.

FIG. 15 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the second embodiment of the present invention. As illustrated in FIG. 15, the image display device 24 includes a control unit 26 instead of the control unit 16 of the image display device 4 according to the first embodiment described above. The control unit 26 includes a display control unit 26a instead of the display control unit 16a of the control unit 16 of the image display device 4 described above, and includes an image processing unit 26b instead of the image processing unit 16b. Further, the storage unit 15 of the image display device 4 according to the second embodiment stores in advance default data 15c of the time difference ΔT between the images P _n and Q _m in the synchronous display mode. Other configurations are the same as those of the first embodiment, and the same reference numerals are given to the same components.

  The in-subject information acquisition system using the image display device 24 according to the second embodiment of the present invention is replaced with the image display device 4 of the in-subject information acquisition system according to the first embodiment illustrated in FIG. This is realized by having the image display device 24.

The control unit 26 has substantially the same function as the control unit 16 of the image display device 4 according to the first embodiment described above. In this case, the control unit 26 sets the time difference ΔT between the images P _n and Q _m displayed synchronously in the display areas 101 and 102 in the synchronous display mode for each part of the subject 1 (for example, the esophagus, stomach, small intestine, large intestine, etc.). As preset data, the default data 15c of the time difference ΔT stored in the storage unit 15 is held and managed. The control unit 26 reads the time difference data for each part preset by the default data 15c as necessary, and calculates the time difference ΔT between the images P _n and Q _m for each part of the subject 1 based on the read time difference data. Set to.

The display control unit 26a has substantially the same function as the display control unit 16a of the image display device 4 according to the first embodiment described above. In this case, the display control unit 26a calculates the time difference ΔT between the images P _n and Q _m in the synchronous display mode based on the time difference data for each part of the subject 1 preset by the default data 15c. Set every time. In the synchronous display mode, the display control unit 26a performs control to sequentially display the image images P _n and Q _m having the time difference ΔT set based on the default data 15c in the display areas 101 and 102 sequentially.

  The time difference ΔT set for each part of the subject 1 by the display control unit 26a is displayed in the data setting area 131 described above. Further, the time sliders 132 and 133 move so as to form a temporal position interval corresponding to the time difference ΔT for each part.

The image processing unit 26b has substantially the same function as the image processing unit 16b of the image display device 4 according to the first embodiment described above. In this case, the image processing unit 26b detects color information (for example, average color) of each image included in each of the first image group PG1 and the second image group PG2, and based on the detected color information of each image, Each part (for example, esophagus, stomach, small intestine, large intestine, etc.) of the subject 1 captured in each image is discriminated. That is, the image processing unit 26b detects the color information of the image _Pn of the frame number n (n = 0, 1, 2, 3,...), And determines the imaging part of the image _Pn based on the detected color information. Determine. The image processing unit 26b, the frame number m and detecting the color information of the image Q _m of (m = 0, 1, 2, 3, ...), the imaging region of the image Q _m on the basis of the detected color information Determine.

  Next, the default data 15c of the time difference ΔT stored in the storage unit 15 will be described. FIG. 16 is a schematic diagram showing a specific example of the default data 15c of the time difference ΔT set for each part of the subject 1. As shown in FIG. 16, the default data 15c is a data group in a table format in which each time difference ΔT set in advance and each part of the subject 1 are associated with each other. Specifically, as the time difference ΔT included in the default data 15c, for example, the time difference ΔT1 associated with the esophagus of the subject 1, the time difference ΔT2 associated with the stomach of the subject 1, and the small intestine of the subject 1 are associated. And a time difference ΔT4 associated with the large intestine of the subject 1.

  Such time differences ΔT1, ΔT2, ΔT3, and ΔT4 are set based on the average passage time of the capsule endoscope 2 for each part of the subject 1 and the average length of each part (organ). Specifically, the time difference ΔT1 is set based on the average transit time of the capsule endoscope 2 in the esophagus of the subject 1 and the average length of the esophagus, and the time difference ΔT2 is a capsule type in the stomach of the subject 1 It is set based on the average transit time of the endoscope 2 and the average length of the stomach. The time difference ΔT3 is set based on the average transit time of the capsule endoscope 2 in the small intestine of the subject 1 and the average length of the small intestine, and the time difference ΔT4 is a capsule endoscope in the large intestine of the subject 1. 2 and the average length of the large intestine. In this case, the magnitude relationship of the time differences ΔT1, ΔT2, ΔT3, and ΔT4 is usually ΔT1 <ΔT2 ≦ ΔT3 <ΔT4.

Next, the operation of the control unit 26 that performs control for synchronously displaying the images P _n and Q _m in the display areas 101 and 102 in the synchronous display mode will be described. FIG. 17 is a flowchart for explaining the processing procedure of the control unit 26 that displays the images P _n and Q _m having the time difference ΔT based on the default data 15c in the display areas 101 and 102 synchronously.

  In FIG. 17, first, similarly to step S101 described above, the control unit 26 selects the synchronous display mode set by the synchronous icon 130 as the image display mode (step S201). In this case, the display control unit 26a selects the synchronous display mode from the plurality of image display modes based on the setting information input from the input unit 11 by clicking the synchronization icon 130.

  Next, the control unit 26 initializes the frame number of the first image group PG1 as in step S103 described above (step S202). In this case, the display control unit 26a initializes the frame number n of the display processing target image in the first image group PG1 (for example, sets n = 0).

Thereafter, the control unit 26 reads time difference data set in advance by the default data 15c from the storage unit 15 (step S203). In this case, the image processing unit 26b detects the color information (for example, average color) of the image P ₀ with the frame number n = 0 initialized in step S202, and captures the image P ₀ based on the detected color information. Determine the site. The display control unit 26a selects time difference data of the imaging region (that is, the region of the subject 1 imaged in the image P ₀ ) determined by the image processing unit 26b from the default data 15c, and the selected time difference data is selected. Originally, a time difference ΔT between the images P _n and Q _m of the imaging region is set.

Next, the control unit 26 calculates the frame number m of the display processing target image in the second image group PG2 based on the time difference data selected from the default data 15c in step S203 (step S204). . In this case, the display control unit 26a, based on the time difference data selected from the default data 15c in step S203 described above, the image P _n (e.g. n = 0) the frame number of the image Q _m with a time difference ΔT for m is calculated.

Thereafter, similarly to step S105 described above, the control unit 26 determines whether or not there is an image display instruction for the images P _n and Q _m (step S205). Specifically, when the display instruction information corresponding to any of the display operation icon groups 110 described above is not input from the input unit 11, the control unit 26 determines that there is no image display instruction for the images P _n and Q _m ( Step S205, No), this step S205 is repeated. That is, the control unit 26 repeats this step S205 until such display instruction information is input by the input unit 11.

On the other hand, when the display instruction information is input from the input unit 11, the control unit 26 determines that there is an image display instruction for the images P _n and Q _m based on the input display instruction information (step S205, Yes). In the same manner as in step S106 described above, the images P _n and Q _m of the current frame numbers n and m are synchronously displayed in the display areas 101 and 102 (step S206). In this case, the display control unit 26a reads the image _Pn of the current frame number n (n = 0, 1, 2, 3,...) From the first image group PG1 stored in the storage unit 15 and obtains it. Control is performed to display the obtained image P _n in the display area 101. In synchronization with the display of the image P _n , the display control unit 26a reads the image Q _m of the current frame number m from the second image group PG2 stored in the storage unit 15, and the obtained image Q _m Is displayed in the display area 102. In this manner, the display control unit 16a synchronously displays the images P _n and Q _m (m = n + α) having the time difference ΔT according to the imaging region on the display areas 101 and 102.

  The current frame number n in step S206 is the frame number n (= 0) initialized in step S202 described above or the frame number n updated in step S207 described later.

Thereafter, the control unit 26 updates the frame number n of the first image group PG1 as in step S107 described above (step S207). In this case, the display control unit 26a updates (for example, adds +1) the frame number n of the first image group PG1 in order to read the image _Pn displayed in the display area 101 from the storage unit 15 in the next step S206.

Next, the control unit 26 determines whether or not the imaging site (the site of the subject 1) of the image P _n to be displayed next in the display area 101 shifts to a subsequent site (for example, the stomach with respect to the esophagus) (step). S208). In this case, the image processing unit 26b determines the imaging region of the image _Pn based on the color information of the currently displayed image _Pn , and the image _{Pn + 1} of the frame number updated in step S207. The imaging region of the image P _{n + 1} is discriminated based on the color information. When the imaging parts of the images P _n and P _{n + 1} determined by the image processing part 26b are the same, the control unit 26 does not shift the imaging part of the image P _n (that is, the part of the subject 1). (Step S208, No), and the frame number m of the second image group PG2 is updated as in Step S109 described above (Step S209). In this case, the display control unit 26a, the frame number of the second image group PG2 to read the image Q _m to be displayed in synchronization with the images P _n display area 102 in step S206 in the next from the storage unit 15 m (m = n + α) is updated according to the frame number n (for example, +1 is added).

On the other hand, when the imaging parts of the images P _n and P _{n + 1} determined by the image processing part 26b are different, the control part 26 has a transition of the imaging part of the image P _n (that is, the part of the subject 1). (Step S208, Yes), the time difference data of the imaging part after the transition is selected from the default data 15c, and the current time difference ΔT is updated to the time difference ΔT of the imaging part after the transition. Thereafter, the control unit 26 calculates the frame number m of the second image group PG2 based on the time difference data of the imaging region after the transition (step S210). In this case, based on the time difference data of the imaged region after the transition, the display control unit 26a calculates the time difference ΔT of the imaged region after the transition with respect to the image _Pn displayed synchronously in the display area 101 in the next step S206. A frame number m (m = n + β) of the image Q _m is calculated.

  Thereafter, similarly to step S111 described above, the control unit 26 determines whether or not there has been a pause instruction for the control of displaying the images Pn and Qm in the display areas 101 and 102 (step S211), and pauses. When it is determined that there is an instruction (step S211, Yes), the process returns to the above-described step S205, and the processing procedure after step S205 is repeated.

On the other hand, when the control unit 26 determines that there is no pause instruction (No at Step S211,), similarly to Step S112 described above, whether or not the synchronous display processing of the images P _n and Q _m in the synchronous display mode has ended. Is determined (step S212). When the control unit 26 determines that the synchronous display process of the images P _n and Q _m in the synchronous display mode has been completed (step S212, Yes), the synchronous display process in the synchronous display mode is completed. On the other hand, if the control unit 26 determines that the synchronous display processing of the images P _n and Q _m in the synchronous display mode has not been completed (No at Step S212), the control unit 26 returns to Step S206 described above, and the steps after Step S206 are performed. Repeat the procedure.

Next, as the time difference ΔT for each part of the default data 15c, as shown in FIG. 16, the case where the esophageal time difference ΔT1, the stomach time difference ΔT2, the small intestine time difference ΔT3, and the large intestine time difference ΔT4 are set as an example is illustrated. The operation of the control unit 26 that performs control for synchronously displaying the images Pn and Qm having the time difference ΔT for each part based on the default data 15c in the display areas 101 and 102 will be specifically described. FIG. 18 is a schematic diagram for explaining a specific example of the operation of the control unit 26 for sequentially displaying the images P _n and Q _m having the time difference ΔT for each part based on the default data 15c in the display areas 101 and 102 in sequence. FIG.

In FIG. 18, image groups B1, B2, B3, and B4 are image groups for each part included in the first image group PG1, and are image groups obtained by imaging the esophagus, stomach, small intestine, and large intestine of the subject 1, respectively. It is. The image groups C1, C2, C3, and C4 are image groups for each part included in the second image group PG2, and are image groups obtained by imaging the esophagus, stomach, small intestine, and large intestine of the subject 1, respectively. In this case, the image P _n (n = 0, 1, 2, 3,...) Is included in any one of the image groups B1, B2, B3, B4, and the image Q _m (m = 0, 1, 2, 2, 4). 3,...) Is included in one of the image groups C1, C2, C3, C4.

  When the control unit 26 synchronously displays the images of the image groups B1 and C1 in which the esophagus of the subject 1 is captured, the control unit 26 sets the time difference ΔT1 in the default data 15c, and the image in which the stomach of the subject 1 is captured. When synchronously displaying the images of the groups B2 and C2, the time difference ΔT2 in the default data 15c is set. Further, when synchronously displaying the images of the image groups B3 and C3 in which the small intestine of the subject 1 is captured, the control unit 26 sets the time difference ΔT3 in the default data 15c, and the large intestine of the subject 1 is captured. When synchronously displaying the images in the image groups B4 and C4, the time difference ΔT4 in the default data 15c is set.

Specifically, the image processing unit 26b determines the imaging region (esophagus) of the head image based on the color information of the head image (that is, the image P ₀ ) of the image group B1. In this case, the display control unit 26a sets a time difference ΔT1 corresponding to the esophagus in the default data 15c, and calculates the frame number m of the image group C1 of the esophagus having the time difference ΔT1 with respect to the leading image of the image group B1. To do. The image of the frame number m is an image of the esophagus included in the image group C1, and is an image in which a subject common to the top image of the image group B1 is captured.

The display control unit 26a maintains the setting of this time difference ΔT1 until, for example, the imaging region of the image P _n displayed in the display area 101 shifts from the esophagus to the stomach, and the images P _n and Q of the esophagus having the time difference ΔT1. _m (that is, each image of the image groups B1 and C1) is displayed synchronously in the display areas 101 and 102. The images P _n and Q _m of the esophagus displayed synchronously in this manner are images obtained by capturing subjects that are common to each other.

Thereafter, when the terminal image of the image group B1 of the esophagus is displayed in the display area 101, the image processing unit 26b uses the color information of the terminal image of the image group B1 and the color information of the top image of the image group B2. In addition, it is determined that the imaging region of the image P _n moves from the esophagus to the stomach. In this case, the display control unit 26a sets a time difference ΔT2 corresponding to the stomach in the default data 15c instead of the time difference ΔT1 described above, and the stomach control unit 26a has the time difference ΔT2 with respect to the first image of the stomach image group B2. The frame number m of the image group C2 is calculated. The image of frame number m is an image of the stomach included in the image group C2, and is an image obtained by capturing an object common to the top image of the image group B2.

The display control unit 26a maintains the setting of the time difference ΔT2 until the imaging part of the image P _n displayed in the display area 101 shifts from the stomach to the small intestine, for example, and the stomach images P _n and Q having the time difference ΔT2 are maintained. _m (that is, each image in the image groups B2 and C2) is displayed synchronously in the display areas 101 and 102. The stomach images P _n and Q _m displayed synchronously in this way are images obtained by imaging subjects that are common to each other.

Thereafter, when the terminal image of the stomach image group B2 is displayed in the display area 101, the image processing unit 26b uses the color information of the terminal image of the image group B2 and the color information of the head image of the image group B3. In addition, it is determined that the imaging region of the image P _n shifts from the stomach to the small intestine. In this case, the display control unit 26a sets a time difference ΔT3 corresponding to the small intestine in the default data 15c instead of the time difference ΔT2 described above, and the small intestine having the time difference ΔT3 with respect to the leading image of the small intestine image group B3. The frame number m of the image group C3 is calculated. The image of frame number m is an image of the small intestine included in the image group C3, and is an image in which a subject common to the top image of the image group B3 is captured.

The display control unit 26a maintains the setting of the time difference ΔT3 until the imaging region of the image P _n displayed in the display area 101 shifts from, for example, the small intestine to the large intestine, and the small intestine images P _n and Q having the time difference ΔT3. _m (that is, each image in the image groups B3 and C3) is synchronously displayed in the display areas 101 and 102. The small intestine images P _n and Q _m displayed synchronously in this way are images obtained by capturing images of subjects that are common to each other.

Thereafter, when the terminal image of the small intestine image group B3 is displayed in the display area 101, the image processing unit 26b is based on the color information of the terminal image of the image group B3 and the color information of the leading image of the image group B4. In addition, it is determined that the imaging region of the image P _n shifts from the small intestine to the large intestine. In this case, the display control unit 26a sets a time difference ΔT4 corresponding to the large intestine in the default data 15c instead of the above-described time difference ΔT3, and the large intestine having the time difference ΔT4 with respect to the first image in the large intestine image group B4. The frame number m of the image group C4 is calculated. The image of frame number m is an image of the large intestine included in the image group C4, and is an image in which a subject common to the top image of the image group B4 is captured.

The display control unit 26a maintains the setting of this time difference ΔT4 as long as the imaging region of the image P _n displayed in the display area 101 is the large intestine, and also displays the large intestine images P _n and Q _m having the time difference ΔT4 (that is, the image). Each image of the groups B4 and C4) is synchronously displayed on the display areas 101 and 102. The large intestine images P _n and Q _{m that} are synchronously displayed in this way are images obtained by capturing subjects that are common to each other.

  As described above, in the second embodiment of the present invention, the first and second of the plurality of image groups in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope. Default data in which the time difference ΔT between the imaging times of the first and second images included in each image group is preset for each part of the subject is stored in the storage unit, and the part of the subject is based on the default data The first image having the time difference ΔT set for each time and the second image are sequentially displayed in synchronization with each display area of the display unit, and a subject common to the first image and the first image is captured. The second image thus formed is sequentially displayed in synchronization with each display area. For this reason, even when the part of the subject imaged in the image sequentially shifts, images obtained by imaging the same subject common to the first and second images from a plurality of imaging directions are displayed. The display can be sequentially synchronized with each display area. As a result, while enjoying substantially the same effect as the first embodiment described above, each is included in the multidirectional image group in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope. Therefore, it is possible to realize an image display apparatus that can sequentially display each image to be observed for each part of the subject in an easy-to-view manner.

  By using the image display apparatus according to the second embodiment of the present invention to display a multidirectional image group in a subject synchronously, a user such as a doctor or a nurse images the same subject from a plurality of imaging directions. The images obtained in this way can be displayed sequentially and synchronously with a simple operation, which makes it possible to easily observe a series of images in the subject from the esophagus to the large intestine, for example, and for example, a characteristic site such as a lesion In addition, it is possible to easily observe the inner wall of the digestive tract (for example, a pleat-like portion) that is difficult to observe from one direction from a plurality of directions.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. In the image display device according to the second embodiment described above, the time difference ΔT between the images P _n and Q _m is set for each part of the subject based on the default data of the time difference ΔT preset for each part in the subject. However, in the image display device according to the third embodiment, the default data of the time difference ΔT can be updated by the GUI.

  FIG. 19 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the third embodiment of the present invention. FIG. 20 is a schematic diagram schematically illustrating one specific example of various GUIs displayed on the display unit of the image display apparatus according to the third embodiment. As illustrated in FIG. 19, the image display device 34 includes a control unit 36 instead of the control unit 26 of the image display device 24 according to the second embodiment. The control unit 36 includes a display control unit 36a instead of the display control unit 26a of the control unit 26 of the image display device 24 described above. As shown in FIG. 20, a save icon 134, which is a GUI for updating the default data 15c in units of frames, is further formed in the window W1 displayed on the display unit 12. Other configurations are the same as those of the second embodiment, and the same components are denoted by the same reference numerals.

  The in-subject information acquisition system using the image display device 34 according to the third embodiment of the present invention is replaced with the image display device 4 of the in-subject information acquisition system according to the first embodiment illustrated in FIG. This is realized by having the image display device 34.

The control unit 36 has substantially the same function as the control unit 26 of the image display device 24 according to the second embodiment described above. In this case, the control unit 36 partially overwrites the default data 15c with the time difference data reset by the data setting area 131 or the time sliders 132 and 133 in units of frames, and updates the default data 15c in units of frames. When the update instruction information is input from the input unit 11 by the click operation of the save icon 134, the control unit 36 performs the update process of the default data 15c each time. Such a control unit 36 reads the time difference data for each part reset by the updated default data 15c as necessary, and based on the read time difference data after the resetting, the images P _n and Q _m are read. A time difference ΔT is set for each part of the subject 1.

The display control unit 36a has substantially the same function as the display control unit 26a of the image display device 24 according to the second embodiment described above. In this case, the display control unit 36a calculates the time difference ΔT between the images P _n and Q _m in the synchronous display mode based on the updated default data 15c partially reset (updated) in units of frames. Set for each part or frame. In the synchronous display mode, the display control unit 36a sequentially synchronizes the image images P _n and Q _m having the time difference ΔT set for each part or each frame based on the updated default data 15c to the display areas 101 and 102, respectively. Control the display.

Next, the operation of the control unit 36 for partially updating the default data 15c will be described by exemplifying a case where the small intestine time difference ΔT3 is partially updated to the time difference ΔT5. FIG. 21 is a schematic diagram for explaining the operation of the control unit 36 that partially updates the default data 15c. In FIG. 21, first, time sliders 132 and 133 indicate the respective temporal positions of the small intestine images P _n and Q _m displayed in the current display areas 101 and 102, respectively. In this case, the interval between the time sliders 132 and 133 corresponds to the small intestine time difference ΔT3 based on the default data 15c before update. In this state, the display control unit 36a sets the time difference ΔT3.

Here, when changing the time difference ΔT3 image Q _m on the time difference ΔT5 for the image P _n which is currently displayed on the display area 101 (resetting), the time slider 133 is moved by the drag operation using the input unit 11 Then, an interval corresponding to the time difference ΔT5 is formed with the time slider 132. Further, the input unit 11 inputs the update instruction information to the control unit 36 when the save icon 134 is clicked. Based on the update instruction information, the control unit 36 partially overwrites the time difference ΔT5 corresponding to the current interval between the time sliders 132 and 133 as time difference data of the small intestine in the default data 15c. In this case, the time difference ΔT3 between the images P _n and Q _m currently displayed in the display areas 101 and 102 is replaced with the time difference ΔT5. As a result, the default data 15c is updated to data obtained by partially resetting the time difference between the images P _n and Q _m of the desired frame number in the small intestine image group from ΔT3 to ΔT5, as shown in FIG. The

  By repeatedly performing such update processing of the default data 15c, the control unit 36 can partially update the default data 15c for one or more desired frames of the first image group PG1 or the second image group PG2. . In this case, the display control unit 36a partially re-establishes the time difference ΔT (for example, the time differences ΔT1, ΔT2, ΔT3, ΔT4) set for each part of the subject 1 on a frame basis based on the updated default data 15c. Set.

  The time difference ΔT can be reset by directly inputting a numerical value into the data setting area 131 using the input unit 11. In this case, the time sliders 132 and 133 move so as to form an interval corresponding to the time difference ΔT input to the data setting area 131.

Next, the small intestine time difference ΔT3 in the default data 15c shown in FIG. 16 is partially reset to the time difference ΔT5, and the large intestine time difference ΔT4 is partially reset to the time difference ΔT6. An operation of the control unit 36 that performs control for synchronously displaying the images P _n and Q _m having the time difference ΔT based on the updated default data 15c in the display areas 101 and 102 will be described in detail. FIG. 22 is a schematic diagram for explaining a specific example of the operation of the control unit 36 for sequentially displaying the images P _n and Q _m having the time difference ΔT based on the updated default data 15c in the display areas 101 and 102 sequentially. FIG.

  In FIG. 22, the time difference ΔT3 between the images of the small intestine image groups B3 and C3 is partially updated to the time difference ΔT5 (> ΔT3) in accordance with the peristaltic movement of the subject 1 in the small intestine. Specifically, the time difference ΔT3 is updated to a time difference ΔT5 in a portion corresponding to a frame period in which the capsule endoscope 2 is stagnant in the small intestine in the small intestine image groups B3 and C3. Further, the time difference ΔT4 between the images of the large intestine image groups B4 and C4 is partially reset to the time difference ΔT6 (> ΔT4) in accordance with the peristaltic movement of the large intestine of the subject 1. Specifically, the time difference ΔT4 is updated to a time difference ΔT6 in a portion corresponding to a frame period in which the capsule endoscope 2 is stagnant in the large intestine in the large intestine image groups B4 and C4.

  The control unit 36 performs a processing procedure substantially similar to steps S201 to S212 described above. In this case, in step S209, the control unit 36 determines whether there is a change in the time difference ΔT based on the updated default data 15c. When the control unit 36 determines that there is a change in the time difference ΔT, the display control unit 36a calculates the frame number m based on the time difference data of the changed time difference ΔT (for example, the time difference ΔT reset in units of frames). On the other hand, when the control unit 36 determines that there is no change in the time difference ΔT, the display control unit 36a updates the frame number m as described above (for example, adds +1).

  Specifically, when the images of the image groups B3 and C3 obtained by imaging the small intestine of the subject 1 are synchronously displayed, the control unit 36 maintains the updated image of the frame number n at the time difference ΔT3 or the time difference ΔT5. If so, it is determined that there is no change in the time difference ΔT. In this case, the display control unit 36a updates the frame number m as in step S209 described above. On the other hand, when the image of the updated frame number n is reset from the time difference ΔT3 to the time difference ΔT5, the control unit 36 determines that the time difference ΔT has been changed. In this case, the display control unit 36a calculates the frame number m based on the time difference data of the time difference ΔT5 based on the updated default data 15c. Similarly, the control unit 36 determines that there is a change in the time difference ΔT when the image of the updated frame number n has been set back from the time difference ΔT5 to the time difference ΔT3. In this case, the display control unit 36a calculates the frame number m based on the time difference data of the time difference ΔT3 based on the updated default data 15c.

Such a display control unit 36a displays the images P _n and Q _m having the original time difference ΔT3 in the image group captured while the capsule endoscope 2 moves in the small intestine among the image groups B3 and C3. An image P _n having a reset time difference ΔT5 in the image group captured while the capsule endoscope 2 is stagnant in the small intestine among the image groups B3 and C3 is controlled to display in synchronization with the display areas 101 and 102. , Q _m are controlled to be displayed synchronously in the display areas 101, 102.

  When the control unit 36 synchronously displays the images of the image groups B4 and C4 in which the large intestine of the subject 1 is captured, the updated image of the frame number n is set and maintained at the time difference ΔT4 or the time difference ΔT6. If so, it is determined that the time difference ΔT has not changed. In this case, the display control unit 36a updates the frame number m as in step S209 described above. On the other hand, when the image of the updated frame number n is reset from the time difference ΔT4 to the time difference ΔT6, the control unit 36 determines that the time difference ΔT has been changed. In this case, the display control unit 36a calculates the frame number m based on the time difference data of the time difference ΔT6 based on the updated default data 15c. Similarly, the control unit 36 determines that there is a change in the time difference ΔT when the updated image of the frame number n is set to the time difference ΔT4 from the time difference ΔT6. In this case, the display control unit 36a calculates the frame number m based on the time difference data of the time difference ΔT4 based on the updated default data 15c.

Such a display control unit 36a displays the images P _n and Q _m having the original time difference ΔT4 in the image group captured while the capsule endoscope 2 moves in the large intestine among the image groups B4 and C4. An image P _n having a reset time difference ΔT6 in the image group captured while the capsule endoscope 2 is stagnant in the large intestine of the image groups B4 and C4 is controlled to display in synchronization with the display areas 101 and 102. , Q _m are controlled to be displayed synchronously in the display areas 101, 102.

  The image display device 34 having the control unit 36 as described above can switch the setting of the time difference ΔT partially according to the peristaltic motion of the subject 1, and the capsule endoscope 2 is in a stagnation state in the digestive tract. Even in the case of an image group of an organ (for example, stomach, small intestine, large intestine, etc.) that repeatedly moves, images in which subjects that are common to each other are imaged can be reliably displayed synchronously on the display regions 101 and 102.

  As described above, the third embodiment of the present invention has the same configuration as that of the second embodiment described above, and further updates (resets) the default data of the time difference ΔT using the GUI. The first image having the time difference ΔT set based on the updated default data and the second image are sequentially displayed in synchronization with each display area of the display unit, and the first image and the first image are displayed. And a second image obtained by capturing an image of a subject common to the display area are sequentially displayed in synchronization with each display area. Therefore, it is possible to further switch the setting of the time difference ΔT corresponding to an image group captured while the multi-lens capsule endoscope moves in the digestive tract or an image group captured while stagnating in the digestive tract. As a result, an image group of organs (for example, stomach, small intestine, large intestine, etc.) that enjoys the operational effects of the above-described second embodiment and in which the multi-eye capsule endoscope repeats a stagnant state and a moving state in the digestive tract. Even so, it is possible to realize an image display device that can reliably and synchronously display images obtained by capturing subjects that are common to each other in each display area of the display unit.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described. In the image display device according to the fourth embodiment, a plurality of thumbnail images additionally displayed in the sub-image display area 140 are associated in a desired combination.

  FIG. 23 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the fourth embodiment of the present invention. FIG. 24 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on the display unit of the image display apparatus according to the fourth embodiment. As shown in FIG. 23, the image display device 44 includes a control unit 46 instead of the control unit 36 of the image display device 34 according to the third embodiment described above. The control unit 46 has a configuration in which an association processing unit 46e is added to the control unit 36 of the image display device 34 described above. As shown in FIG. 24, an association icon 121, which is a GUI for associating a plurality of thumbnail images displayed in the sub-image display area 140 with a desired combination, is further formed in the window W1 displayed on the display unit 12. Is done. Other configurations are the same as those of the third embodiment, and the same components are denoted by the same reference numerals.

  The in-subject information acquisition system using the image display device 44 according to the fourth embodiment of the present invention is replaced with the image display device 4 of the in-subject information acquisition system according to the first embodiment illustrated in FIG. This is realized by having the image display device 44.

  The control unit 46 has the same function as the control unit 36 of the image display device 34 according to the third embodiment described above, and further has an association function for associating a plurality of thumbnail images in a desired combination. Such a control unit 46 further includes an association processing unit 46e as described above.

  The association processing unit 46e performs association processing for associating a plurality of thumbnail images displayed in the sub-image display area 140 with a desired combination. Specifically, the association processing unit 46e associates a desired thumbnail image group selected from a plurality of thumbnail images displayed in the sub-image display area 140 based on the instruction information input by the input unit 11. . In this case, the control unit 46 displays an index indicating the thumbnail image group associated by the association processing unit 46e, for example, a line L (see FIG. 24) connecting the associated thumbnail images in the window W1. I do.

  Next, the operation of the control unit 46 when associating a plurality of thumbnail images with a desired combination will be described. FIG. 25 is a flowchart illustrating a processing procedure of the control unit 46 when associating a plurality of thumbnail images with a desired combination.

  In FIG. 25, first, the control unit 46 determines whether or not a desired thumbnail image is designated from among a plurality of thumbnail images displayed in the sub-image display area 140 (step S301). Specifically, when the desired thumbnail image is clicked from among a plurality of thumbnail images displayed in the sub-image display area 140, the input unit 11 designates the desired thumbnail image as one of the desired combinations. Instruction information to be input to the control unit 46. If such instruction information is not input by the input unit 11, the control unit 46 determines that a desired thumbnail image is not specified (No in step S301), and repeats step S301. That is, the control unit 46 repeats this step S301 until a desired thumbnail image is designated from the sub-image display area 140.

  On the other hand, when such instruction information is input by the input unit 11, the control unit 46 determines that a desired thumbnail image has been specified (step S301, Yes), and based on the input instruction information, the sub-image. A desired thumbnail image designated from the display area 140 is selected (step S302).

  Next, the control unit 46 determines whether another thumbnail image is designated from among the plurality of thumbnail images displayed in the sub-image display area 140 (Step S303). Specifically, when another thumbnail image is further clicked from among the plurality of thumbnail images displayed in the sub-image display area 140, the input unit 11 selects another thumbnail image as a further combination of a desired combination. The instruction information to be additionally specified is input to the control unit 46. If such additional instruction information is not input by the input unit 11, the control unit 46 determines that another thumbnail image is not specified (No at Step S303), and repeats Step S303. That is, the control unit 46 repeats this step S303 until another thumbnail image is additionally specified from the sub-image display area 140.

  On the other hand, when such additional instruction information is input by the input unit 11, the control unit 46 determines that another thumbnail image has been additionally specified (Yes in step S303), and adds the additional instruction information to the input additional instruction information. Based on this, a desired thumbnail image additionally designated from the sub-image display area 140 (that is, another thumbnail image different from the desired thumbnail image selected in step S302 described above) is additionally selected (step S304).

  Next, the control unit 46 associates the two thumbnail images selected as described above (step S305). In this case, the association processing unit 46e associates the thumbnail image selected in step S302 with another thumbnail image additionally selected in step 304. In this way, the association processing unit 46e associates a plurality of thumbnail images displayed in the sub-image display area 140 with a desired combination. Note that the control unit 46 stores the desired combination of thumbnail images associated by the association processing unit 46e in the storage unit 15, and stores and manages the stored desired combination as one of the combinations of thumbnail images.

  Thereafter, the control unit 46 causes the display unit 12 to display an index indicating such association between desired thumbnail images (step S306). Specifically, the control unit 46 performs control to display a line connecting desired thumbnail images associated by the association processing unit 46e as an association index.

  Here, the association of the thumbnail images will be specifically described with reference to FIG. As shown in FIG. 24, a plurality of thumbnail images SP1 to SP6 are displayed in the sub-image display area 140. Of the plurality of thumbnail images, thumbnail images SP1, SP2, SP3 and SP5 are obtained by reducing images selected from the image group displayed in the display area 101, and thumbnail images SP4 and SP6 are displayed. An image selected from the image group displayed in the area 102 is reduced.

  First, the input unit 11 inputs instruction information for designating the thumbnail image SP5 to the control unit 46 by a click operation of the thumbnail image SP5. In this case, the control unit 46 selects the designated thumbnail image SP5 as the first thumbnail image forming a desired combination. Next, the input unit 11 inputs instruction information for additionally specifying the thumbnail image SP6 to the control unit 46 by a click operation on the thumbnail image SP6. In this case, the control unit 46 additionally selects the additional designated thumbnail image SP6 as the remaining thumbnail images forming a desired combination.

  As described above, when the control unit 46 selects a desired combination of thumbnail images SP5 and SP6 from the plurality of thumbnail images SP1 to SP6, the association processing unit 46e associates the two thumbnail images SP5 and SP6. In addition, the control unit 46 causes the display unit 12 to display the line L connecting the thumbnail image SP5 and the thumbnail image SP6 associated by the association processing unit 46e as an association index.

  By visually recognizing such a line L, the user can easily grasp that the thumbnail images SP5 and SP6 are associated with each other. In this case, the associated thumbnail images SP5 and SP6 are, for example, thumbnail images in which subjects that are common to each other are captured, or thumbnail images in which characteristic portions such as a lesioned part and a bleeding part are captured.

Further, when the instruction information is input from the input unit 11 by clicking one of the thumbnail images SP5 and SP6 associated in this way, the control unit 46 corresponds to the thumbnail image SP5 based on the instruction information. causes display on the image P _n display area 101 that displays the image Q _m corresponding to the thumbnail image SP6 in the display area 102. The image display device 44 having such a control unit 46 designates (specifically, clicks) one of the associated thumbnail images, so that a plurality of characteristic parts such as a lesioned part or a bleeding part are displayed. Images captured from the direction can be easily displayed in the display areas 101 and 102.

  As described above, the fourth embodiment of the present invention has the configuration of the third embodiment described above, and further associates a plurality of thumbnail images displayed in the sub-image display area in a desired combination. The index indicating the association of the desired thumbnail image is displayed. Therefore, it is possible to realize an image display device that can enjoy the above-described effects of Embodiment 3 and that can easily grasp the combination of thumbnail images that are related to each other from among a plurality of thumbnail images.

  By using the image display apparatus according to the fourth embodiment of the present invention, images in which characteristic portions such as a lesioned part or a bleeding part are imaged can be easily searched from among multidirectional image groups of the subject. It is possible to easily and synchronously display images obtained by capturing such characteristic parts from a plurality of directions in the display areas of the display unit.

(Embodiment 5)
Next, a fifth embodiment of the present invention will be described. In the image display apparatus according to the fifth embodiment, the image P _n as described above, in addition to the synchronous display function of Q _m, further, the image P _n, the display operation of Q _m are so as to perform differently in the normal display mode .

FIG. 26 is a block diagram schematically illustrating a configuration example of an image display apparatus according to the fifth embodiment of the present invention. FIG. 27 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on the display unit of the image display apparatus according to the fifth embodiment. As shown in FIG. 26, the image display device 54 includes a control unit 56 instead of the control unit 46 of the image display device 44 according to the above-described fourth embodiment. The control unit 56 includes a display control unit 56a instead of the display control unit 36a of the control unit 46 of the image display device 44 described above. As shown in FIG. 27, a window W1 displayed on the display unit 12 includes a landmark icon 122, which is a GUI for characterizing the image P _n displayed on the display area 101, and a display area 102. a landmark icons 123 is a GUI for performing characterization of image Q _m displaying is further formed. In the fifth embodiment, in the normal display mode, the selection state of the display area 101 can be switched by a click operation of the display area 101, and the image display operation of the display area 101 is enabled in the selection state. . Further, the selection state of the display area 102 can be switched by a click operation on the display area 102, and the image display operation of the display area 102 is enabled when the selection state is selected. Other configurations are the same as those of the fourth embodiment, and the same components are denoted by the same reference numerals.

  The in-subject information acquisition system using the image display device 54 according to the fifth embodiment of the present invention is replaced with the image display device 4 of the in-subject information acquisition system according to the first embodiment illustrated in FIG. This is realized by having the image display device 54.

The control unit 56 has substantially the same function as the control unit 46 of the image display device 44 according to the above-described fourth embodiment. In this case, in the normal display mode, the control unit 56 selects either valid or invalid of the image display operation for the display area 101 for displaying the image P _n and displays for displaying the image Q _m. For the area 102, either valid or invalid of the image display operation is selected.

  The display control unit 56a has substantially the same function as the display control unit 36a of the image display device 44 according to the fourth embodiment described above. In this case, the display control unit 56a can perform image display control of the display areas 101 and 102 of the main image display area 100 separately. Specifically, when the display area 101 is set to the selected state by a click operation of the display area 101 using the input unit 11 in the normal display mode, the display control unit 56a displays the selected display area 101 in the selected state. When the image display operation is enabled and the display area 101 is set to the non-selected state by clicking the display area 101 again using the input unit 11, the image display operation of the non-selected display area 101 is disabled. To. In this case, the display area 101 functions as a setting GUI for setting a selected state or a non-selected state by a click operation using the input unit 11.

  Similarly, when the display area 102 is set to the selected state by the click operation of the display area 102 using the input unit 11 in the normal display mode, the display control unit 56a displays the selected display area 102 in the selected state. When the image display operation is enabled and the display area 102 is set to the non-selected state by clicking the display area 102 again using the input unit 11, the image display operation of the non-selected display area 102 is disabled. To. In this case, the display area 102 functions as a setting GUI for setting a selected state or a non-selected state by a click operation using the input unit 11.

Further, the display control unit 56a displays, for example, a landmark M1 that characterizes the desired image P _n displayed in the display area 101 based on the instruction information input from the input unit 11 by clicking the landmark icon 122. Control to display around the area 101 is performed. In this case, the landmark icon 122 functions as a setting GUI for setting the landmark M1 for characterizing the desired image _Pn . Such a landmark icon 122 is effective when the display area 101 is set to a selected state (that is, an image display operation is enabled), and the display area 101 is not selected (that is, an image display operation is disabled). It is invalid when set to (Status).

Further, the display control unit 56a based on the instruction information input from the input unit 11 by the click operation of the landmark icons 123, displays the landmark M2 characterizing a desired image Q _m are for example displayed in the display area 102 Control to display around the area 102 is performed. In this case, landmark icons 123 functions as a setting GUI for setting the landmark M2 for characterizing the desired image Q _m. Such a landmark icon 123 is effective when the display area 102 is set to a selected state (that is, an image display operation is enabled), and the display area 102 is not selected (that is, the image display operation is disabled). It is invalid when set to (Status).

The images P _n and Q _m characterized by the landmarks M1 and M2 may be, for example, images of the stomach or the duodenum, or a characteristic part such as a lesioned part or a bleeding part is imaged. It may be an image.

Next, the operation of the control unit 56 that performs control to display the images P _n and Q _m in the display areas 101 and 102 in the selected state in the normal display mode will be described. FIG. 28 is a flowchart for explaining the processing procedure of the control unit 56 for displaying the images P _n and Q _m in the display areas 101 and 102 in the selected state in the normal display mode.

  In FIG. 28, first, the control unit 56 selects the normal display mode set by the re-clicking operation on the synchronization icon 130 described above as the image display mode (step S401). In this case, the display control unit 56a selects the normal display mode from the plurality of image display modes based on the setting information input from the input unit 11 by clicking again on the synchronization icon 130.

  Next, the control unit 56 initializes both the frame number n of the first image group PG1 and the frame number m of the second image group PG2 (step S402). In this case, the display control unit 56a initializes the frame number n of the display processing target image in the first image group PG1 (for example, n = 0). In addition, the display control unit 56a initializes the frame number m of the display processing target image in the second image group PG2 (for example, sets m = 0).

Thereafter, the control unit 56 determines whether or not an image display instruction corresponding to any of the display operation icon groups 110 has been issued, in substantially the same manner as in step S205 described above (step S403). Specifically, when the display instruction information corresponding to any of the display operation icon groups 110 is not input from the input unit 11, the control unit 56 determines that there is no image display instruction for the images P _n and Q _m (step S403). , No), this step S403 is repeated. That is, the control unit 56 repeats this step S403 until such display instruction information is input by the input unit 11.

On the other hand, when such display instruction information is input from the input unit 11, the control unit 56 determines that there is an image display instruction for the images P _n and Q _m based on the input display instruction information (step S403, Yes). ), It is determined whether or not the display area 101 (first display area) for displaying the image P _n is set to the selected state (step S404). Specifically, the display area 101 sets a selection state when a click operation is performed by the input unit 11, and sets a non-selection state when a click operation is performed again by the input unit 11. That is, when the selection state setting information is input from the input unit 11 by one click operation on the display area 101, the control unit 56 determines that the display area 101 is in the selected state and repeats the display area 101 again. When setting information in a non-selected state is input from the input unit 11 by a click operation, it is determined that the display area 101 is not in a selected state (that is, in a non-selected state).

If the display control unit 56a determines that the display area 101 is in the selected state (step S404, Yes), the display control unit 56a validates the image display operation on the display area 101 and based on the display instruction information input by the input unit 11. Then, the image P _n of the current frame number n is displayed in the display area 101 (step S405). In this case, the display control unit 56a reads the image P _n of the current frame number n (n = 0, 1, 2, 3,...) From the first image group PG1 stored in the storage unit 15 and obtains it. Control is performed to display the obtained image P _n in the display area 101.

  The current frame number n in step S405 is the frame number n (= 0) initialized in step S402 described above or the frame number n updated in step S406 described later.

Thereafter, the control unit 56a updates the frame number n of the first image group PG1 in the same manner as in step S207 described above (step S406). In this case, the display control unit 56a updates (for example, adds +1) the frame number n of the first image group PG1 in order to read from the storage unit 15 the image _Pn displayed in the display area 101 in the next step S405.

Next, the control unit 56, the display area 102 (second display area) for displaying the image Q _m to determine whether it is set to the selected state (step S407). Specifically, the display area 102 sets a selection state when a click operation is performed by the input unit 11, and sets a non-selection state when a click operation is performed again by the input unit 11. That is, when the selection state setting information is input from the input unit 11 by one click operation on the display area 102, the control unit 56 determines that the display area 102 is in the selected state and repeats the display area 102 again. When setting information in a non-selected state is input from the input unit 11 by a click operation, it is determined that the display area 102 is not in a selected state (that is, is in a non-selected state).

If the display control unit 56a determines that the display area 102 is in the selected state (step S407, Yes), the display control unit 56a validates the image display operation on the display area 102 and based on the display instruction information input by the input unit 11. Then, the image Q _m of the current frame number m is displayed in the display area 102 (step S408). In this case, the display control unit 56a reads the image Q _m of the current frame number m from the second image group PG2 stored in the storage unit 15 (m = 0,1,2,3, ...) , to give Control is performed to display the obtained image Q _m in the display area 102.

  The current frame number m in step S408 is the frame number m (= 0) initialized in step S402 described above or the frame number m updated in step S409 described later.

Thereafter, the control unit 56a updates the frame number m of the second image group PG2 similarly to step S209 described above (step S409). In this case, the display control unit 56a updates the frame number m of second image group PG2 to read the image Q _m to be displayed in the display area 102 in step S408 in the next from the storage unit 15 (e.g., adds +1).

Next, the control unit 56 determines whether or not there has been a pause instruction for the control for displaying the images P _n and Q _m in the display areas 101 and 102 in the selected state (step S410). Specifically, the control unit 56 displays the display instruction information corresponding to any of the frame playback icon 112, the cue icon 113, the reverse frame playback icon 115, and the reverse cue icon 116 in the above-described step S403. If it is input from, it is determined that there is a pause instruction (step S410, Yes). In this case, the control unit 56 returns to step S403 described above and repeats the processing procedure after step S403.

  On the other hand, when the display instruction information corresponding to the reproduction icon 111 or the reverse reproduction icon 114 is input from the input unit 11 in step S403 described above, the control unit 56 determines that there is no pause instruction (No in step S410). In this case, the control unit 56 determines whether or not the image display processing for the display areas 101 and 102 in the selected state in the normal display mode has been completed (step S411).

  Specifically, when the frame number n updated in step S406 described above is equal to or greater than the number of frames of the first image group PG1, the control unit 56 determines that the image display processing of the display area 101 in the selected state has been completed. (Step S411, Yes), the image display processing of the display area 101 is completed. In addition, when the frame number m updated in step S409 described above is equal to or greater than the number of frames of the second image group PG2, the control unit 56 determines that the image display processing of the display region 102 in the selected state has been completed (step S411). , Yes), the image display processing of the display area 102 is completed.

  On the other hand, when the frame number n updated in step S406 described above is less than the number of frames of the first image group PG1, the control unit 56 determines that the image display process of the display area 101 in the selected state has not been completed ( In step S411, No), the process returns to step S404 described above. In addition, when the frame number m updated in step S409 described above is less than the number of frames of the second image group PG2, the control unit 56 determines that the image display processing of the display area 102 in the selected state has not been completed ( In step S411, No), the process returns to step S404 described above. Thereafter, the control unit 56 repeats the processing procedure after step S404 described above.

  In step S404 described above, when the display control unit 56a determines that the display area 101 is not in the selected state (No in step S404), the processing procedure in steps S405 and S406 described above is skipped and the process proceeds to step S407. . Then, the control part 56 repeats the process sequence after this step S407. In step S407 described above, if the display control unit 56a determines that the display area 102 is not selected (step S407, No), the processing procedure of steps S408 and S409 described above is skipped and the process proceeds to step S410. . Then, the control part 56 repeats the process sequence after this step S410.

Next, the operation of the control unit 56 that performs control to display the images P _n and Q _m in the display areas 101 and 102 in the selected state in the normal display mode will be specifically described. FIG. 29 is a schematic diagram for explaining the operation of the control unit 56 that controls the image display processing when both the display areas 101 and 102 are set to the selected state in the normal display mode. FIG. 30 is a schematic diagram for explaining the operation of the control unit 56 that controls individual image display processing when only the display area 101 is set to the selected state in the normal display mode. FIG. 31 is a schematic diagram for explaining the operation of the control unit 56 that controls individual image display processing when only the display area 102 is set to the selected state in the normal display mode.

As shown in FIG. 29, when both the display areas 101 and 102 are set to the selected state, the control unit 56 enables the image display operation for both the display areas 101 and 102 in the selected state, and displays the display operation icon group 110. The display processing of the images P _n and Q _m is controlled based on the display instruction information corresponding to any of the above. Specifically, the display control unit 56a highlights the selected display area 101 (first display area) to indicate that it is in the selected state, and displays the first image group PG1 in the selected display area 101. Images P _n (n = 0, 1, 2, 3,...) Are sequentially displayed. In this case, for example, images P ₀ , P ₁ , P ₂ , and P ₃ are sequentially displayed in the selected display area 101 under the control of the display control unit 56a.

Further, the display control unit 56a highlights the selected display area 102 (second display area) to indicate that it is in the selected state, and displays the image Q of the second image group PG2 in the selected display area 102. _m (m = 0, 1, 2, 3,...) are sequentially displayed. In this case, for example, the images Q ₀ , Q ₁ , Q ₂ , Q ₃ are displayed in the selected state in synchronization with the above-described images P ₀ , P ₁ , P ₂ , P ₃ by the control of the display control unit 56a. The images are sequentially displayed in the area 102.

Thereafter, when only the display area 101 is set to the selected state, the control unit 56 enables only the image display operation for the display area 101 in the selected state as shown in FIG. The display processing of the image P _n is individually controlled based on the display instruction information corresponding to the above. Specifically, the display control unit 56a highlights only the display area 101 in the selected state to indicate that it is in the selected state, and only the image _Pn of the first image group PG1 is displayed in the display area 101 in the selected state. Are displayed sequentially. In this case, for example, images P ₄ , P ₅ , P ₆ , P ₇ , and P ₈ are sequentially displayed in the selected display area 101 under the control of the display control unit 56a.

Here, the control unit 56 invalidates the image display operation with respect to the display area 102 set to the non-selected state, and puts the display area 102 in the non-selected state into a pause state or an image non-display state of the image display processing. In this case, the display control unit 56a performs control to display an image (for example, the image Q ₃ ) displayed in the display area 102 immediately before being set to the non-selected state in a paused state. Alternatively, the display control unit 56a may perform control to erase the image of the display area 102 in the non-selected state, and put the display area 102 in the non-selected state in the image non-display state.

Thereafter, when only the display area 102 is set to the selected state, the control unit 56 enables only the image display operation for the display area 102 in the selected state as shown in FIG. individually controlling the display process of the image Q _m on the basis of the crab corresponding display instruction information. Specifically, the display control unit 56a, as well as indicating a selected state only the display area 102 in the selected state highlighting, in the display area 102 of such selected only the image Q _m of the second image group PG2 Are displayed sequentially. In this case, for example, images Q ₄ , Q ₅ , Q ₆ , Q ₇ , and Q ₈ are sequentially displayed in the selected display area 102 under the control of the display control unit 56a.

Here, the control unit 56 invalidates the image display operation for the display area 101 set in the non-selected state, and puts the display area 101 in the non-selected state into a pause state or an image non-display state of the image display processing. In this case, the display control unit 56a performs control to display the image (for example, the image Q ₈ ) displayed in the display area 101 immediately before being set to the non-selected state in the pause state. Alternatively, the display control unit 56a may perform control to delete the image of the display area 101 in the non-selected state, and put the display area 101 in the non-selected state into the image non-display state.

In the image display device 54 according to the fifth embodiment, when the capture unit 120 is clicked by the input unit 11, the selected state is selected from the display areas 101 and 102 of the main image display area 100. A thumbnail image of the image displayed in the displayed area is created, and the created thumbnail image is additionally displayed in the sub-image display area 140. In this case, the image processing unit 26b, based on the instruction information input from the input unit 11 by the click operation of the capture icon 120, the thumbnail image of the image displayed in the selected display region of the display regions 101 and 102. Create That is, if the display area 101 is set to the selected state, the image processing unit 26b creates a thumbnail image of the image P _n displayed in the selected display area 101, and sets the display area 102 to the selected state. If so, a thumbnail image of the image Q _m displayed in the selected display area 102 is created. If both the display areas 101 and 102 are set to the selected state, the selected display area 101 Each thumbnail image of the images P _n and Q _m displayed on the screen 102 is created.

  As described above, the fifth embodiment of the present invention has the configuration of the fourth embodiment described above, and further enables or disables the image display operation for a plurality of display areas formed in the display unit. Individually set and sequentially display images included in a desired image group among a plurality of image groups in a subject imaged by an image sensor group mounted on a multi-lens capsule endoscope in an effective display area Configured to do. For this reason, an image display device that can enjoy the effects of the fourth embodiment described above and can sequentially display each image included in the desired image group in the display area while stopping the display processing of the unnecessary image group is realized. be able to.

  By using the image display device according to the fifth exemplary embodiment of the present invention, the user is not confused by an unnecessary image group among a plurality of image groups captured by the imaging element group of the multi-lens capsule endoscope. In addition, it is possible to concentrate the consciousness on the desired image group, and as a result, it is possible to easily observe the image in the subject.

  In the first to fifth embodiments of the present invention, the time sliders 132 and 133 are moved along the common time scale TS. However, the present invention is not limited to this, and the first image group PG1 and the second image group PG2 Two time scales each indicating the length of each time may be formed at positions close to each other, and the time sliders 132 and 133 may be moved on the two time scales. Specifically, for example, as shown in FIG. 32, in the vicinity of the sub-image display area 140, a time scale TS1 indicating the time length of the first image group PG1 and the time length of the second image group PG2 are displayed. May be formed side by side, the time slider 132 may be moved on the time scale TS1, and the time slider 133 may be moved on the time scale TS2.

  In the first to fifth embodiments of the present invention, the time difference data is directly input to the data setting area 131 by operating the input unit 11. However, the present invention is not limited to this. For example, as shown in FIG. A numerical value increase / decrease icon 135 for increasing / decreasing time difference data (numerical data) in the area 131 may be formed, and the time difference data in the data setting area 131 may be adjusted using the numerical value increase / decrease icon 135. Alternatively, the input unit 11 may have a jog dial, and the time difference data in the data setting area 131 may be increased or decreased by operating the jog dial of the input unit 11.

  Further, in the first to fifth embodiments of the present invention, the time sliders 132 and 133 move on the same path along the time scale TS. However, the present invention is not limited to this, and the time sliders 132 and 133 are not limited to the time scale TS. You may make it move on mutually different paths along. Specifically, for example, as shown in FIG. 33, the time slider 132 may move on the upper path of the time scale TS, and the time slider 133 may move on the lower path of the time scale TS.

In the first to fifth embodiments of the present invention, the thumbnail images of the images P _n and Q _m displayed in the display areas 101 and 102 are additionally displayed in the common sub-image display area 140. The present invention is not limited to this, and a plurality of sub-image display areas may be formed, and the thumbnail image of the image P _{n and} the thumbnail image of the image Q _m may be classified and additionally displayed in each of the plurality of sub-image display areas. More specifically, as shown in FIG. 34, a plurality of sub-image display area 140a, 140b is formed, and additionally displays the thumbnail images of the images P _n in the sub-image display area 140a, a thumbnail image of the image Q _m Additional display may be performed in the sub-image display area 140b. In this case, the line L indicating the association between the thumbnail image of the image P _{n and} the thumbnail image of the image Q _m is formed so as to connect the associated thumbnail images.

  Furthermore, in Embodiments 1 to 5 of the present invention, the time scale TS is formed in the area between the display operation icon group 110 and the sub-image display area 140. However, the present invention is not limited to this, and the first image group PG1. And two time scales indicating the respective time lengths of the second image group PG2 are formed in the vicinity of the display areas 101 and 102, and the time sliders 132 and 133 move on the two time scales, respectively. You may do it. Specifically, for example, as shown in FIG. 35, a time scale TS1 is formed near the lower side of the display area 101 so that the time slider 132 moves on the time scale TS1, and the display area 102 A time scale TS2 may be formed near the lower side, and the time slider 133 may be moved on the time scale TS2.

In the first to fifth embodiments of the present invention, the time difference ΔT between the imaging times of the images P _n and Q _m displayed synchronously in the display areas 101 and 102 in the synchronous display mode is set. The frame number difference between the images P _n and Q _m may be set by the GUI instead of the time difference ΔT. Specifically, for example, as shown in FIG. 36, the data setting area 131 and the time sliders 132 and 133 are formed as a setting GUI for the frame number difference between the images P _n and Q _m and are input to the data setting area 131. The frame number difference may be set as the frame number difference between the images P _n and Q _m that are synchronously displayed in the display areas 101 and 102 in the synchronous display mode. Further, the time sliders 132 and 133 are used in the same manner as in the case of setting the time difference ΔT described above, and the frame number difference between the images P _n and Q _{m to be} displayed synchronously in the display areas 101 and 102 in the synchronous display mode is set. May be.

  Furthermore, as shown in FIG. 36, the frame number difference in the data setting area 131 may be increased or decreased using a numerical value increase / decrease icon 135. Alternatively, the input unit 11 may have a jog dial, and the frame number difference in the data setting area 131 may be increased or decreased by operating the jog dial of the input unit 11.

In addition to the setting GUI for the data setting area 131 or the time sliders 132 and 133, the default data 15c described above is the default data in which the frame number difference between the images P _n and Q _m is preset for each part of the subject 1. Instead, the frame number difference between the images P _n and Q _m may be set for each part of the subject 1 based on the default data of the frame number difference. In this case, the default data of the frame number difference may be partially updated on a frame basis using a setting GUI such as the data setting area 131 or the time sliders 132 and 133.

When the frame number difference between the images P _n and Q _m in the synchronous display mode is set as described above, the control unit of the image display device according to the present invention has the image P _n having the frame number difference in the synchronous display mode. , Q _m are controlled to be displayed synchronously in the display areas 101, 102. Also in this case, as in the case of the time difference ΔT described above, images obtained by imaging the same subject common to each other from a plurality of directions can be synchronously displayed on the display areas 101 and 102.

  In the first to fifth embodiments of the present invention, each image of the first image group PG1 and the second image group PG2 captured by the two image sensors 2a and 2b mounted on the multi-lens capsule endoscope 2 are used. However, the present invention is not limited to this, and three or more image groups captured by three or more image sensors mounted on a multi-lens capsule endoscope are acquired. Then, the images included in two of the three or more image groups may be displayed in the display areas 101 and 102, respectively. Further, three or more display areas for displaying images in the subject are formed, and each image included in each of the three or more image groups captured by the three or more imaging elements mounted on the multi-lens capsule endoscope is displayed. Each may be displayed in three or more display areas.

  Furthermore, in Embodiments 1 to 5 of the present invention, when a single capture icon click operation is performed, a thumbnail image of an image displayed in the display area in which the image display operation is valid is displayed as a sub-image. Although it was additionally displayed in the area, not limited to this, when a capture icon is formed for each display area and the capture icon is clicked, it is displayed in the display area corresponding to the clicked capture icon. The thumbnail image of the selected image may be additionally displayed in the sub-image display area.

  In the fourth and fifth embodiments of the present invention, two desired thumbnail images displayed in the sub-image display area are associated with each other. However, the present invention is not limited to this and is displayed in the sub-image display area. Three or more thumbnail images among a plurality of thumbnail images may be associated with each other. In this case, the index (for example, line L) indicating the association of the thumbnail images is formed so as to connect the three or more thumbnail images thus associated with each other.

  Furthermore, in the fourth and fifth embodiments of the present invention, a line connecting the associated thumbnail images is formed as an index indicating the association between the desired thumbnail images. The index indicating the association may be a desired mark such as a symbol, a letter, a number, or a figure. In this case, the same kind of mark may be attached to each of the plurality of associated thumbnail images.

1 is a schematic diagram schematically illustrating a configuration example of an in-subject information acquisition system including an image display device according to a first embodiment of the present invention; 1 is a block diagram schematically showing a configuration example of an image display apparatus according to a first embodiment of the present invention. FIG. 3 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on a display unit of the image display apparatus according to the first embodiment; It is a schematic diagram for demonstrating the setting procedure of the time difference using a data setting area or a time slider. It is a flowchart explaining the process sequence of the control part which displays synchronously the images which have the time difference set using GUI on each display area. It is a schematic diagram for demonstrating one specific example of operation | movement of the control part which displays synchronously the images which have the set time difference in each display area sequentially. It is a schematic diagram for demonstrating the relationship between the images synchronously displayed on each display area in synchronous display mode. It is a schematic diagram which shows one specific example of the window which displays the setting GUI for attaching a facility logo to the desired position in a report. It is a schematic diagram which shows one specific example of the window which displays the setting GUI for changing the insertion setting of the manufacturer logo in the report. It is a schematic diagram which shows an example of the window which displays the setting GUI for setting the predetermined data described in a report. It is a schematic diagram which shows one specific example of the window which displays GUI for producing the report of a subject. It is a schematic diagram which shows one specific example of the window which displays GUI for outputting a still image file or a moving image file to a desired drive. It is a schematic diagram which shows one specific example of the window which displays GUI for outputting a report file to a desired drive. It is a schematic diagram which shows one specific example of the window which displays the setting GUI for changing the setting of the user authority of the image display apparatus concerning this invention. It is a block diagram which shows typically one structural example of the image display apparatus concerning Embodiment 2 of this invention. It is a schematic diagram which shows one specific example of the default data of the time difference set for every site | part of the subject. It is a flowchart explaining the process sequence of the control part which displays the images which have a time difference based on default data synchronously on each display area. It is a schematic diagram for demonstrating one specific example of operation | movement of the control part which displays sequentially the images which have the time difference for every part based on default data on each display area synchronously. It is a block diagram which shows typically the example of 1 structure of the image display apparatus concerning Embodiment 3 of this invention. FIG. 10 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on a display unit of an image display apparatus according to a third embodiment; It is a schematic diagram for demonstrating operation | movement of the control part which updates default data partially. It is a schematic diagram for demonstrating one specific example of operation | movement of the control part which displays synchronously the images which have a time difference based on the updated default data in each display area sequentially. It is a block diagram which shows typically the example of 1 structure of the image display apparatus concerning Embodiment 4 of this invention. FIG. 10 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on a display unit of an image display apparatus according to a fourth embodiment; It is a flowchart explaining the process sequence of the control part at the time of associating a some thumbnail image with a desired combination. It is a block diagram which shows typically one structural example of the image display apparatus concerning Embodiment 5 of this invention. FIG. 10 is a schematic diagram schematically illustrating a specific example of various GUIs displayed on a display unit of an image display apparatus according to a fifth embodiment; It is a flowchart explaining the process sequence of the control part which displays an image on each display area of a selection state in normal display mode. It is a schematic diagram explaining operation | movement of the control part which controls the image display process when each display area is set to the selection state in normal display mode. It is a schematic diagram explaining operation | movement of the control part which controls the separate image display process when only one display area is set to a selection state in normal display mode. It is a schematic diagram explaining operation | movement of the control part which controls the separate image display process when only the other display area is set to the selection state in normal display mode. It is a schematic diagram which shows the modification 1 of various GUI displayed on a display part. It is a schematic diagram which shows the modification 2 of various GUI displayed on a display part. It is a schematic diagram which shows the modification 3 of various GUI displayed on a display part. It is a schematic diagram which shows the modification 4 of various GUI displayed on a display part. It is a schematic diagram which shows the modification 5 of various GUI displayed on a display part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Subject 2 Capsule endoscope 2a, 2b Image pick-up element 3 Receiving device 3a-3h Receiving antenna 4, 24, 34, 44, 54 Image display device 5 Portable recording medium 11 Input part 12 Display part 13 Card I / F
14 Input / output I / F
15 storage unit 15a examination folder 15b management folder 15c default data 16, 26, 36, 46, 56 control unit 16a, 26a, 36a, 56a display control unit 16b, 26b image processing unit 16c report creation unit 16d image file creation unit 46e association Processing unit 100 Main image display area 101, 102 Display area 110, 247 Display operation icon group 111 Playback icon 112 Frame playback icon 113 Cue icon 114 Reverse playback icon 115 Reverse frame playback icon 116 Reverse frame search icon 120 Capture icon 121 Association icon 122, 123 Landmark icon 130 Synchronization icon 131 Data setting area 132, 133 Time slider 134 Save icon 135 Value increase / decrease icon 140 Sub-image Display area 141 Scroll bar 150 Close icon 201, 244, 250 Drive setting section 202 File display area 203 Logo display area 204 Logo position setting section 205 Clear icon 206, 211, 225, 252, 263 OK icon 207, 212, 226, 253 , 264 Cancel icon 210 Check box 220 Doctor name text box 221 Facility name text box 222 Address text box 223 Telephone number text box 224 Email address text box 230 Doctor name setting unit 231 Facility name setting unit 232 Address setting unit 233 Phone number setting unit 234 Email address setting part 235 Diagnostic information text box 236 Save icon 237, 245 Export icon 2 40 Still image file display area 241 Moving image file display area 242 Output file display area 243 Additional icon 246 Image display area 251 Capacity display area 261 User authority display area 262 Check box group A1 Patient information A2, A3 images A4, A5 Antenna layout B1 to B4, C1 -C4 image group E lesion K cursor L lines M1, M2 landmark PG1 first image group PG2 second image group _{P n, Q m, P 0} ~P 8, Q 0 ~Q 8 image R Format TS, TS1, TS2 Time scale SP1-SP6 Thumbnail image W1-W8 Window

Claims (10)

Display means for displaying each image included in each of the first and second image groups of the plurality of image groups in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope;
A first image included in the first image group and a second image that is an image included in the second image group and captured by a subject common to the first image are displayed on the display unit. Setting means for setting a synchronous display mode for synchronous display in each display area;
Storage means for storing default data in which a time difference between the imaging time of the first image and the imaging time of the second image is set for each part in the subject;
When the synchronous display mode is set by the setting means, the time difference is switched for each part in the subject based on the default data, and the time difference set for each part in the subject is included. Control means for controlling to display the first image and the second image in synchronization with each display area of the display means;
An image display device comprising: The image display apparatus according to claim 1, wherein the setting unit can change the time difference. Display means for displaying each image included in each of the first and second image groups of the plurality of image groups in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope;
A first image included in the first image group and a second image that is an image included in the second image group and captured by a subject common to the first image are displayed on the display unit. Setting means for setting a synchronous display mode for synchronous display in each display area;
Storage means for storing default data in which a difference in frame number between the first image and the second image is set for each part in the subject;
When the synchronous display mode is set by the setting means, the difference between the frame numbers is switched for each part in the subject based on the default data, and the set for each part in the subject Control means for performing control to synchronously display the first image and the second image having a frame number difference in each display area of the display means;
An image display device comprising: The image display device according to claim 3, wherein the setting unit can change the difference between the frame numbers. The display means further displays a first reduced image corresponding to the first image and a second reduced image corresponding to the second image;
The image display device according to claim 1, wherein the setting unit sets an association between the first reduced image and the second reduced image. The image display apparatus according to claim 5, wherein the display unit displays an index indicating an association between the first reduced image and the second reduced image. The display means includes a first time slider indicating a temporal position of an image included in the first image group and a second time slider indicating a temporal position of an image included in the second image group. And
The first time slider and the second time slider are one of the setting means for setting the time difference or the frame number difference between the first image and the second image. The image display device according to claim 1. The said 2nd image is what image | photographed the subject common to the said 1st image from the imaging direction different from the said 1st image, The Claim 1 characterized by the above-mentioned. Image display device. The setting means is independent of a display mode for displaying images included in the first image group in time series and a display mode for displaying images included in the second image group in time series. The image display device according to claim 1, wherein the image display device is set. The respective images included in the first and second image groups of the plurality of image groups in the subject imaged by the imaging element group mounted on the multi-lens capsule endoscope are displayed, and the first Display means for displaying a first time slider indicating a temporal position of an image included in one image group and a second time slider indicating a temporal position of an image included in the second image group; ,
A first image included in the first image group and a second image that is an image included in the second image group and captured by a subject common to the first image are displayed on the display unit. A synchronous display mode for synchronous display in each display area is set, and the time difference between the imaging time of the first image and the imaging time of the second image or the frame numbers of the first image and the second image A setting means for setting the difference between
When the synchronous display mode is set by the setting means, control for synchronously displaying the first image and the second image having the time difference or the frame number difference in each display area of the display means Control means to perform;
With
The first time slider and the second time slider are one of the setting means for setting the time difference or the frame number difference between the first image and the second image. images display device according to.

Images