JP7528050B2 - Medical information processing device, medical information processing method, and program - Google Patents

Description

The present invention relates to a medical information processing device, a medical information processing method, and a program.

Conventionally, a radiography system is known that includes a radiation detection device that irradiates a subject with radiation (e.g., X-rays) and detects the intensity distribution of the radiation that has passed through the subject to capture a radiographic image of the object.

When conducting an examination using radiation (radiography), examination information including the area to be imaged, the imaging method, etc. is generally set by a doctor in each department. Then, radiation imaging is performed using a radiation imaging system based on the set examination information.

In recent years, AI (Artificial Intelligence) technology has been advancing for medical image diagnostic support. Radiography systems are equipped with image processing for diagnostic support, but doctors can obtain even more useful support by using image processing outside the radiography system.

The radiography system works in conjunction with an external image processing system by sending and receiving original and processed images, and can provide images for diagnosis that have been processed in a way that is not implemented in the radiography system. For example, Patent Document 1 discloses a configuration in which medical images are sent to a processing server and CAD processing is performed.

JP2004-295184

A captured image generated by a radiography system is used as the original image, and a processed image generated by an external system may be subject to restrictions different from those imposed on the captured image, such as not being reprocessed by the radiography system in order to preserve the processing effect. However, when the captured image and the processed image are displayed in a list, it may be difficult to distinguish between the captured image and the processed image at a glance.

In view of the above problems, one of the objectives of the present invention is to make it possible to distinguish between captured images and processed images.

In addition to the above-mentioned objective, the achievement of effects that are derived from the configurations shown in the detailed description of the invention described below and that cannot be obtained by conventional techniques can also be considered as another objective of the disclosure of this specification.

In order to achieve the object of the present invention, the medical information processing device of the present invention comprises a transmitting means for transmitting to an external system an original image, which is a medical image captured by an imaging device and is to be processed in the external system, an acquiring means for acquiring a processed image generated from the original image by processing in the external system, and a display control means for displaying thumbnails of the original image and thumbnails of the processed image on a display unit, wherein the display control means displays the thumbnail of the processed image in a display form different from that of the original image so that it is possible to identify that the processed image is an image processed in the external system, and when there are multiple processed images which have been subjected to different processing of the original image, displays thumbnails of the multiple processed images so that the processing content can be seen .

The present invention makes it possible to distinguish between captured images and processed images.

1 is a diagram showing an example of a schematic configuration of a medical information processing system including a medical information processing apparatus according to a first embodiment of the present invention. FIG. 2 is a diagram showing an example of a schematic configuration of an overall control unit shown in FIG. 1 . 3 is a diagram showing an example of an imaging method table stored in a storage unit shown in FIG. 2 . 3 is a diagram showing an example of an image table stored in a storage unit shown in FIG. 2 . FIG. 2 illustrates the first embodiment of the present invention and shows an example of a new examination input screen displayed on the display unit in FIG. 1 . FIG. 2 illustrates the first embodiment of the present invention and shows an example of a shooting screen displayed on the display unit in FIG. 1 . 5 is a flowchart showing an example of a processing procedure for registering a processed image as a medical information processing method by the medical information processing apparatus according to the first embodiment of the present invention. 5 is a flowchart showing an example of a processing procedure for displaying a processed image as a medical information processing method by the medical information processing apparatus according to the first embodiment of the present invention.

Below, a preferred embodiment of the radiography system disclosed in this specification will be described in detail with reference to the attached drawings. However, the components described in this embodiment are merely examples, and the technical scope of the radiography system disclosed in this specification is determined by the scope of the claims, and is not limited by the individual embodiments below. In addition, the disclosure of this specification is not limited to the following embodiments, and various modifications (including organic combinations of each embodiment) are possible based on the spirit of the disclosure of this specification, and are not excluded from the scope of the disclosure of this specification. In other words, all configurations combining the embodiments and their modifications described below are included in the embodiments disclosed in this specification. Note that, although the following description is given using a radiography system as an example, the modality for imaging the subject may be other medical imaging devices such as an MRI device, an X-ray CT device, a three-dimensional ultrasound imaging device, a photoacoustic tomography device, a PET/SPECT device, or an OCT device. In other words, the series of processes related to this embodiment can be realized by a medical information processing system including various medical imaging devices and a medical information processing device, and may be applied not only to radiographic images but also to other medical images. Additionally, images in this disclosure include not only images displayed on a display unit, but also images stored as image data in a database or memory unit, and images being transmitted and received.

First Embodiment
<Configuration of Radiation Imaging System>
A first embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of a radiation imaging system according to the first embodiment. As shown in Fig. 1, the radiation imaging system according to this embodiment includes a radiation imaging apparatus 1 and a Hospital Information System (HIS) 11 that manages the progress of an examination.

The radiography system of this embodiment also includes a RIS (Radiology Information System) 12 that transmits examination orders to the radiography device 1. The radiography system of this embodiment is further connected to a PACS (Picture Archiving and Communication Systems) 13 that manages radiographic images, a printer 14 that prints out the radiographic images, and an external processing device 17 that processes the radiographic images.

HIS11 is a hospital management system, and includes a server that manages accounting information. When performing radiography, the operator inputs examination instructions from a terminal (input unit) of HIS11. HIS11 then transmits the request information to the radiology department of the hospital that is the requestee for the radiography. This request information is called an examination order. An examination order includes the name of the requesting department, an examination ID, examination items, and patient information (subject information) regarding the subject (subject).

When the RIS 12 receives an examination order, the radiology department adds imaging information related to the radiography (such as imaging area information, imaging direction information, and procedure information) to the examination order as an imaging protocol and transmits it to the radiography device 1. The radiography device 1 performs radiography according to the received examination order. The radiography device 1 acquires the captured radiographic image, generates examination information that associates the radiographic image with the examination order, and outputs it together with the radiographic image.

PACS13 is a server whose main purpose is image management. A high-definition monitor connected to PACS13 is used to carry out inspection of radiation images, detailed post-processing, and diagnostic work. In this way, radiation images acquired by radiation imaging device 1 are transmitted to PACS13.

In addition, the implementation information of the examination in the radiography device 1 (such as the image ID and the imaging date and time) is transmitted to the HIS 11. The implementation information transmitted to the HIS 11 is used not only for the progress management of the examination, but also for post-examination accounting processing.

The external processing device 17 is a device that performs image processing, etc. on radiation images. It performs diagnostic support processing using AI (Artificial Intelligence) technology, and transmits the generated processed image to devices such as the radiation imaging device 1 and PACS 13. The radiation imaging device 1 presents the processed image received from the external processing device together with the captured image (the original image before processing in the external system), and provides processing that is not built into the radiation imaging device 1.

The radiographic imaging device 1, HIS 11, RIS 12, PACS 13, printer 14, and external processing device 17 are connected via a network 15, which may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network).

Each of these devices includes one or more computers. The computer includes, for example, a main control means such as a CPU, and a storage means such as a ROM (Read Only Memory) or a RAM (Random Access Memory). The computer may also include a communication means such as a network card, and input/output means such as a keyboard, a display, and a touch panel. Each of these components is electrically connected by a bus or the like, and is controlled by the main control means executing a program stored in the storage means.

As shown in FIG. 1, a radiography device 1 for performing radiography is installed in the radiography room 100. Also installed in the radiography room 100 are a radiation generation device control unit 4 for generating radiation, a radiation detector 7 for capturing a radiographic image by detecting radiation that has passed through the subject 10, and an imaging table 6.

The radiography device 1 includes a display unit 2 that displays radiographic images and various information, an operation unit 3 that is operated by an operator, and a control unit 5 that controls each component.

The radiation generating device control unit 4 sets the radiation imaging conditions in the radiation generating unit 8 and controls the radiation generating unit 8. The radiation generating unit 8 functions as a radiation source that generates radiation. The radiation generating unit 8 is realized, for example, by a radiation tube, and irradiates radiation toward the subject 10 (for example, a specific part of the subject).

The radiation generating unit 8 can irradiate radiation to a desired irradiation range. A radiation-shielding aperture (not shown) is installed on the irradiation surface of the radiation generating unit 8. The operator can adjust the irradiation range of the radiation irradiated from the radiation generating unit 8 by controlling the radiation-shielding aperture.

The radiation imaging system includes a radiation detector 7 that detects radiation emitted from a radiation generating unit 8. The radiation detector 7 detects radiation that has passed through the subject 10 and outputs image data corresponding to the radiation. The image data can be referred to as a radiation image.

Specifically, the radiation detector 7 detects the radiation that has passed through the subject 10 as an electric charge equivalent to the amount of transmitted radiation. For example, the radiation detector 7 may use a direct conversion sensor such as a-Se that converts radiation into an electric charge directly, or an indirect sensor that uses a scintillator such as CsI and a photoelectric conversion element such as a-Si.

The radiation detector 7 generates image data by A/D conversion of the detected charges and stores the image data in a storage unit (not shown). The radiation detector 7 can add image information (image ID, shooting date and time, and image data transfer status) to the image data and transfer the image data together with the image data to the radiation imaging device 1.

The display unit 2 is realized, for example, by a liquid crystal display, and displays various information to an operator (for example, a radiologist or a doctor). The operation unit 3 is composed of, for example, a mouse and operation buttons, and inputs various instructions from the operator to each component. The display unit 2 and operation unit 3 may be realized as an integrated touch panel.

The control unit 5 of the radiation imaging device 1 is connected to the radiation detector 7 via a wireless LAN. Image data, control signals, and the like are transmitted and received between the control unit 5 and the radiation detector 7. That is, image data stored in the radiation detector 7 by radiation imaging is output (transferred) to the control unit 5 via the wireless LAN.

<Explanation of the Radiography System>
The radiation imaging system of the present invention will be described in detail with reference to Fig. 2. The radiation imaging apparatus 1 includes a control unit 5 that performs image processing on a radiation image output from a radiation detector 7 to generate an image. The control unit 5 has an application function that operates on a computer. The control unit 5 controls the operation of the radiation detector 7, outputs a radiation image to the display unit 2, and outputs a graphical user interface (GUI). In other words, the control unit 5 corresponds to an example of a display control means that displays thumbnails of a medical image and thumbnails of a processed image on the display unit. The control unit 5 also functions as a receiving means that receives instructions for image editing of the medical image displayed on the display unit, and can perform image editing such as cutting out and annotation based on instructions from an operator.

The control unit 5 includes an imaging control unit 21 that controls imaging of the radiation detector 7, an image processing unit 22 that performs image processing of the radiation image obtained by imaging, and a storage unit 23 that stores various information such as the radiation image output from the radiation detector 7, the examination order, the imaging protocol, and the imaging method. The control unit 5 also includes an examination management unit 24 that manages examination information in which the radiation image and the examination order are associated, and an input/output unit 27 that outputs the generated image object to the outside or inputs it from the outside.

The memory unit 23 stores the examination information, imaging protocol, imaging method, radiographic images output from the radiation detector 7, and various information required for examination management managed by the examination management unit 24. The memory unit 23 also stores the imaging protocol associated with the examination order together with identification information that identifies the imaging protocol.

Figure 3 is a diagram showing an example of a shooting method and external processing table stored in the storage unit 23 shown in Figure 2. The shooting method table shown in Figure 3 is a table that assigns a shooting method ID to each shooting method and stores setting values such as the name and whether external processing is enabled. The external processing table is a table that assigns an external processing ID and associates it with the shooting method specified by the shooting method ID.

Figure 4 shows an example of an image table that stores captured images and processed images generated by an external system, along with their image information. An ID is stored for each image, and the source of the image is stored along with a series ID and a capture method ID, and in the case of a processed image, the processing details performed by the external system are also stored.

The examination management unit 24 manages the imaging protocol in which the imaging method, imaging conditions, image processing conditions, etc. are defined and associated with the examination order. For example, when the examination information is generated by the radiation imaging device 1, the examination management unit 24 can associate the subject information and the imaging protocol input from the operation unit 3 to create new examination information. On the other hand, when an examination is requested from the RIS 12, the examination management unit 24 extracts the imaging protocol stored in the memory unit 23 using the identification information of the imaging protocol associated with the received examination order. The extracted imaging protocol is associated with the examination order to create new examination information. The newly created examination information is stored in the memory unit 23. In addition, the examination management unit 24 associates the photographed image with the processed image using the additional information associated with the processed image and the image information of the photographed image. Here, the examination management unit 24 associates, for example, the image information of the photographed image that is the source of the processed image to the processed image, or rewrites the additional information of the processed image to the image information of the photographed image. That is, the image information of the captured image is compared with the supplementary information of the processed image, and if there is information that is lacking in the supplementary information compared to the image information, the image information may be used to supplement the information, or the supplementary information itself may be rewritten as image information. The created information is stored in the storage unit 23.

The imaging control unit 21 transmits a transfer request signal to the radiation detector 7 requesting the transfer of radiographic images stored in the radiation detector 7, and receives the radiographic images from the radiation detector 7. The imaging control unit 21 manages the received radiographic images together with radiation detector information related to the radiation detector 7. The imaging control unit 21 also associates the radiographic images with the examination information and imaging protocol managed by the examination management unit 24.

The image processing unit 22 performs image processing on the radiation image using the imaging protocol and image information obtained from the imaging control unit 21. The radiation image that has been image-processed here is displayed on the display unit 2, or is output to the outside via the input/output unit 27. The image processing unit 22 performs image processing to adjust the image itself, such as brightness and contrast. Furthermore, the image processing unit 22 can also perform processing such as clipping and annotation on the adjusted radiation image.

The input/output unit 27 receives input of examination orders from the RIS 13 and processed images from the external processing device 17. It also outputs radiographic images to external devices such as the PACS 13, the printer 14, and the external processing device 17, and outputs examination implementation information to the HIS 11. In other words, the input/output unit 27 corresponds to an example of a transmission means for transmitting the original image to be processed to an external system.

The above is an explanation of an example of the configuration of a radiography system according to one embodiment of the present invention. Note that the configuration shown in FIG. 1 is merely an example and can be modified as appropriate. For example, in FIG. 1, various devices are connected to the radiography device 1 via a network 15, but the radiography device 1 does not necessarily need to be connected to such devices. Diagnostic images may be output to a portable medium such as a DVD and input to various devices via the portable medium. In addition, this network 15 may be configured as a wired network, or partly configured as a wireless signal transmission path.

<Shooting process>
Here, a processing procedure for capturing a radiographic image will be described along the flow of an examination using the radiography system shown in FIG.

First, patient information and examination information are input to the radiography device 1 based on an examination request form or an examination request from the RIS 12. The patient information includes the patient's name, patient ID, etc., and the examination information includes imaging information that specifies the content of the imaging to be performed on the patient.

Under the control of the display control unit 16, the radiographic imaging device 1 displays a new examination input screen as shown in FIG. 5 on the display unit 2. As shown in FIG. 5(a), the new examination input screen includes a patient information input area 101, a patient information confirmation button 102, and a requested examination list 103. The new examination input screen also includes a patient information display area 104, an imaging information display area 105, an imaging information input button 106, and a start examination button 107.

The requested examination list 103 lists the examinations received from the RIS 12. When any examination is selected from the requested examination list 103, the patient information display area 104 displays patient information (patient ID, patient name, date of birth, etc.) corresponding to the selected patient, as shown in FIG. 5(b). The imaging information display area 105 displays the examination ID, and the imaging information corresponding to the examination ID is displayed in the area immediately below. The imaging information is received from the RIS 12, as described above. In the example of FIG. 5, imaging method buttons 109 (chest front button 109a, chest side button 109b) corresponding to the imaging information are arranged. By pressing the imaging information input button 106, the imaging information input area 108 is displayed as shown in FIG. 5(c), and an imaging method can be added. In the example of FIG. 5(c), multiple imaging method selection buttons 114 are displayed in the imaging information input area 108, and an imaging method can be added by selecting one of them. The added imaging method is displayed alongside the chest front button 109a and chest side button 109b in the imaging information display area 105. Each imaging method is associated with an imaging method ID.

After checking the patient information and imaging information, the operator presses the examination start button 107. This confirms the examination to be performed. In response to pressing the examination start button 107, the radiation imaging device 1 displays an imaging screen as shown in FIG. 6 on the display unit 2. The imaging screen is a screen used during imaging.

The imaging screen is basically configured to have the same display areas as the new examination input screen described in FIG. 5. The newly added display areas include an image display area 110, a message area 111, an image processing setting area 112, and an examination end button 113, as shown in FIG. 6.

When the imaging screen is displayed, the imaging method button 109a located at the top of the imaging information display area 105 is selected by default. In response to this, the control unit 5 of the radiation imaging device 1 transmits the imaging conditions (tube voltage, tube current, exposure time, etc.) set in correspondence with the imaging method button (imaging method) to the radiation generation control unit 4. The control unit 5 then controls the radiation detector 7 in accordance with the imaging conditions to prepare for imaging.

When preparations are complete, the radiation imaging device 1 transitions to a state in which imaging is possible. At this time, a "Ready message" indicating that imaging is possible is displayed in the message area 111.

The operator then checks the imaging method, sets up the imaging, and positions the patient. When the series of imaging preparations is complete, the operator refers to the message area 111 to confirm that imaging is possible, and then presses the radiation irradiation switch (not shown). The radiation imaging device 1 then causes the radiation generator 8 to irradiate radiation toward the subject (a specific part of the patient), and the radiation detector 7 to detect the radiation that has passed through the subject. This allows a radiation image to be captured.

When the imaging is completed, the control unit 5 of the radiation imaging device 1 acquires the captured image from the radiation detector 7 and performs image processing on the acquired captured image based on predetermined image processing conditions. The predetermined image processing conditions are predefined according to the imaging method.

When image processing is completed, the radiation imaging device 1 displays the processed captured image in the image display area 110. In addition, a thumbnail 114 is created in the imaging method button 109. If the operator wishes to change the contrast, etc. of the captured image, he or she operates the contrast, brightness, etc. buttons provided in the image processing setting area 112.

Similarly, if the operator wishes to change the crop area of the output image, he or she operates the crop button 122 and crop frame 126, etc. to specify the desired crop area. If a character string that serves as diagnostic information is to be added, the operator operates the annotation button 123, etc. to overlay a character string as shown in annotation 127 on the image. If the orientation of the image is not suitable for diagnosis, the operator performs a geometric transformation using the rotate button 120, invert button 121, etc. As described above, the operator can perform additional image editing on the captured image displayed in the image display area 110.

When it is desired to use image processing in the external processing device 17, the external processing button 130 is pressed. For the imaging method, whether external processing is enabled, the request destination for external processing when enabled, and the contents of external processing are set in advance. Alternatively, the control unit 5 may set whether to enable transmission of medical images to the external processing system. If there are multiple external processing systems, whether to enable transmission of medical images for each of the multiple external processing systems may be set, or whether to enable transmission all at once may be set. For example, when an image of the chest front button 109a is displayed in the image display area 110, the external processing button 130 is enabled according to the setting of whether to enable external processing for the imaging method corresponding to the chest front button 109a.

When the external processing button 130 is pressed, the radiographic image displayed in the image display area 110 is sent to the external processing device 17. That is, when the transmission of the medical image is enabled, the image to be processed can be sent to the external processing system. When there are multiple external processing systems, the medical image is sent to one of the multiple external processing systems that is set to make a processing request in advance. The external processing device 17 to be the destination is determined according to the request destination set for the imaging method corresponding to the chest front button 109a. The radiographic image to be sent is accompanied by an image ID for identifying itself and information indicating the processing content to be performed by the external processing device 17. That is, the medical image is sent accompanied by information regarding the processing content to be performed on the medical image, and the external processing system performs processing based on the transmitted processing content. In an operation in which image processing in the external processing device 17 is always used, the external processing device 17 may be configured to send the image when the captured image is generated during imaging, without pressing the external processing button 130. That is, the original image to be processed in the external processing system may be sent to the external processing system at the timing when the original image is generated, or the image may be sent to the external processing system upon receipt of the operator's pressing of the external processing button. The shooting method button 109 is controlled to indicate that a processing request has been made, for example, by a thumbnail 114c.

The examination order received from RIS 12 includes imaging information. By specifying an imaging method for which external processing is set to be enabled, it is also possible to configure HIS 11 or RIS 12 to request image generation by external processing.

When a processed image is received from the external processing device 17, it is associated with the captured image using the captured image ID, which is the processing source associated with the processed image. That is, the examination management unit 24 can search for the original image of the process from the storage unit using the additional information of the processed image as association information for associating the original image with the processed image, and associate the extracted original image with the processed image. Alternatively, information about the processed image, such as the captured image ID, may be received in a communication separate from the reception of the processed image. That is, the examination management unit 24 can search for the original image of the process from the storage unit using association information of the processed image sent in a communication separate from the processed image, and associate the extracted original image with the processed image. The associated processed image is displayed as a thumbnail in the same shooting method button 109a as the captured image. That is, the control unit 5 corresponds to an example of a display control means that displays the thumbnail of the original image and the thumbnail of the processed image on the display unit based on the association. Also, it corresponds to an example of a display control means that displays the thumbnail of the original image and the thumbnail of the processed image superimposed on an object indicating the shooting protocol when the original image was shot. The form in which the processing request is implemented as in thumbnail 114c at the time of the processing request is changed to a form in which a reduced image is displayed as in thumbnail 114b. An icon indicating that the image is a processed image generated by the external processing device 17, the external processing device that processed it, and the processing content are displayed on the thumbnail. In other words, the thumbnail of the processed image can be displayed in a different display form from the thumbnail of the original image before processing so that it can be identified as an image processed in an external processing system. When the thumbnail portion is pressed, the processed image is displayed in the image display area 110. If reprocessing of the processed image is not required in the radiation imaging device 1, operations for processing and manipulating the image such as rotation 120, inversion 121, cutout 122, annotation 123, and image processing setting area 112 can be disabled. Alternatively, when image editing of the processed image is instructed, a warning may be displayed to the effect that the image is an image for which processing is restricted.

When the imaging method button 109b is selected for the next imaging, the control unit 5 controls the radiation detector 7 according to the imaging conditions to prepare for imaging. Alternatively, image confirmation for the imaging selected by the imaging method button 109a may be completed when the imaging method button 109b is selected and radiation is irradiated.

The operator repeats the above-mentioned procedure to perform imaging for all imaging methods in the imaging information display area 105. When all imaging is completed, the operator presses the examination end button 113. This ends the series of examinations. The control unit 5 of the radiation imaging device 1 assigns the examination information, imaging conditions, etc. as supplementary information, and outputs the image object to, for example, the PACS 13, the printer 14, or the ROM of the device itself. Here, for the processed image, whether to output to the management server in advance can be set for each imaging method, for example, as in the imaging method table of FIG. 3, and only the processed image of the imaging method for which output is enabled is output. In other words, the processed image is output to the image management server based on the setting of whether to enable output of the processed image to the image management server. Examination implementation information notifying the end of the examination is transmitted to the HIS 11. The identifier of the processed image received before the end of the examination is included in the examination implementation information as an object within the examination.

The radiography device 1 displays the new examination input screen again.

It is also conceivable that the processed image may be received from the external processing device 17 after the examination is completed. In this case, first, the association is performed in the same way as during the examination. Then, the received processed image is output according to the settings in the shooting method table, in the same way as when the examination is completed. That is, if the examination including the shooting of the original image has not been completed when the processed image is acquired, the processed image can be output to the image management server when the examination is completed, or if the examination has been completed, the processed image can be output to the image management server at the time the processed image is acquired. Alternatively, if an examination including the shooting of the original image is displayed on the display unit when the processed image is acquired, the processed image can be output to the image management server based on an output instruction, or if the examination is not displayed on the display unit, the processed image can be output to the image management server at the time the processed image is acquired.

<Registration of processed images>
FIG. 7 is a flowchart showing an example of a processing procedure of a processed image registration process as a medical information processing method by the medical information processing apparatus 10 according to the first embodiment of the present invention. The description will be given with reference to the photographing screen shown in FIG. 6. First, when the operator presses the external processing button 130, the image object being displayed is output to an external system. Then, the external system completes the processing, and the processed image generated in step S101 is received. The received processed image is accompanied by an image ID of the processing source, and in step S102, image information of the photographed image is searched from the image table using the image ID as a key. If image information is not extracted (step S103/No), the process of the flowchart in FIG. 7 ends. If image information is extracted (step S103/Yes), the process proceeds to step S104. In step S104, the processed image is associated with the same series as the photographed image. The series ID from the photographed image information searched in step S102 is used as the series ID of the processed image. In step S105, it is generated as processed image information. The image received in step S101 is also accompanied by an ID that identifies the processed image itself. In step S106, the image table is searched using the identification ID of the processed image, and it is determined whether information of the same processed image is stored. If it is determined that the information exists (step S106/Yes), in step S108, it is updated with the information generated in step S105. If it is determined that the information exists (step S106/No), in step S107, the information generated in step S105 is added. That is, the processing in steps S106 to S108 corresponds to a processing in which, if it is determined that the association information of the first processed image that has already been associated with the original image and the association information of the newly acquired second processed image are the same, the association information of the first processed image is updated with the association information of the second processed image, and, if it is determined that they are different, new association information of the second processed image is created.

<Display processing of processed image>
8 is a flowchart showing an example of a processing procedure for displaying a processed image on a screen as a medical information processing method by the medical information processing apparatus 10 according to the first embodiment of the present invention. The description will be given with reference to the photographing screen shown in FIG.

First, in step S201, the target image information is obtained from the image table. The source attribute of the image information is referenced, and if the source is not an external system (step S202/No), the process proceeds to step S208. If the source is an external system (step S202/Yes), the process proceeds to the subsequent external processing icon determination process. First, in step S203, an image type icon is determined. Since it was determined in step S202 that the source is an external system, an icon indicating that the image type is an external system is determined.

Next, the source information of the image information acquired in step S201 is referenced, and if it is not possible to identify which external system it is (step S204/No), the process proceeds to step S208. If the external system can be identified (step S204/Yes), the process proceeds to step S205, where an external system icon is determined. An icon representing the characteristics of the external system is used as the external system icon.

Next, the processing content of the image information acquired in step S201 is referenced, and if the processing content cannot be identified (step S206/No), the process proceeds to step S208. If the processing content can be identified (step S206/Yes), a processing icon is determined. An icon representing the processing content applied is used as the processing icon.

After the external processing icon determination process is completed, the process proceeds to step S208, where a thumbnail is created and displayed on the screen. For example, the icon 115 is displayed superimposed on the thumbnail image, as in the thumbnail 114b in the shooting method button 109a. Note that the display is not limited to the above superimposed display, and may be composite display or parallel display. Also, although the image type icon, external system icon, and processing icon have been described as being distinguished, they may be combined into one icon. Note that the display indicating the above information may be text data, or may be a frame surrounding the thumbnail that emphasizes the thumbnail of the processed image compared to the thumbnail of the original image. In other words, it is sufficient if the object is such that the thumbnail of the processed image and the thumbnail of the original image can be distinguished. Also, the text data may express the difference in information by changing the font, character size, or character color. In other words, an object indicating that the processed image is an image processed in an external system is displayed, and the thumbnail of the processed image and the object indicating that the processed image is an image processed in an external system can be displayed in any of the display forms of superimposed display, parallel display, and composite display. Also, an object indicating the external system that processed the processed image based on information about the external system can be displayed, and a thumbnail of the processed image and an object indicating the external system that processed the processed image can be displayed in any of the display forms of superimposed display, parallel display, and composite display. Also, an object indicating the processing content applied to the processed image can be displayed, and a thumbnail of the processed image and an object indicating the processing content applied to the processed image can be displayed in any of the display forms of superimposed display, parallel display, and composite display. Furthermore, an object indicating that the original image is an image before being processed in the external system can be displayed, and a thumbnail of the original image and the object can be displayed in any of the display forms of superimposed display, parallel display, and composite display. In other words, it is sufficient if the thumbnail of the processed image can be displayed in a different display form from the thumbnail of the original image so that it can be identified that the processed image is an image processed in an external system.

According to the above, it is possible to distinguish between captured images and processed images. Furthermore, even if the processing that the operator can perform differs depending on the image, it is possible to distinguish between captured images and processed images, thereby improving the efficiency of operation. Furthermore, by displaying an object indicating the external system that processed the processed image on the display unit, it is possible to easily know which external system processed the processed image without referring to the additional information. Furthermore, by displaying an object indicating the processing content applied to the processed image on the display unit, it is possible to easily know the processing content applied to the processed image without referring to the additional information. Furthermore, since the captured image and the processed image are automatically associated, and there is no need to associate them manually, it is possible to improve the efficiency of operation.

Other Embodiments
The disclosure of this specification can also be realized by a process in which a program for realizing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program, or by a circuit for realizing one or more functions.

The processor or circuitry may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field programmable gateway (FPGA). The processor or circuitry may also include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

The radiography control device in each of the above-mentioned embodiments may be realized as a single device, or multiple devices may be combined so as to be able to communicate with each other and execute the above-mentioned processing, and either form is included in the embodiments of the present invention. The above-mentioned processing may be executed by a common server device or server group. The multiple devices constituting the radiography control device and the radiography control system need only be able to communicate at a predetermined communication rate, and do not need to be located in the same facility or the same country.

The embodiments disclosed in this specification include a form in which a software program that realizes the functions of the above-mentioned embodiments is supplied to a system or device, and the computer of the system or device reads and executes the code of the supplied program.

Therefore, the program code installed on a computer to realize the processing according to the embodiment by the computer is itself one embodiment of the present invention. Also, based on instructions contained in the program read by the computer, an OS or the like running on the computer may perform some or all of the actual processing, and the functions of the above-mentioned embodiments may also be realized by this processing.

REFERENCE SIGNS LIST 1 Radiation imaging device 2 Display unit 3 Operation unit 4 Radiation generation device control unit 5 Control unit 6 Radiation imaging stand 7 Radiation detector 8 Radiation generation unit 10 Subject 11 HIS
12 RIS
13. PACS
14 Printer 15 Network 16 Display control unit 17 External processing device

Claims (22)

a transmitting means for transmitting to the external system an original image, which is a medical image captured by an imaging device and is to be processed in the external system;
an acquisition means for acquiring a processed image generated from the original image by processing in the external system;
a display control means for displaying a thumbnail of the original image and a thumbnail of the processed image on a display unit;
Equipped with
The display control means displays a thumbnail of the processed image in a different display format from a thumbnail of the original image so that it is possible to identify that the processed image is an image processed in the external system, and when there are multiple processed images in which different processing has been applied to the original image, displays thumbnails of the multiple processed images so that the processing content can be understood . The medical information processing device according to claim 1, characterized in that the display control means displays an object indicating that the processed image is an image processed in the external system, and displays a thumbnail of the processed image and the object in any one of the following display formats: superimposed display, parallel display, or composite display. The acquiring means acquires information regarding the external system that has processed the processed image,
The medical information processing device according to claim 1 or 2, characterized in that the display control means displays an object indicating the external system that processed the processed image based on information about the external system, and displays a thumbnail of the processed image and the object in any one of a superimposed display, a parallel display, and a composite display. The acquiring means acquires information regarding the processing content applied to the processed image,
The medical information processing device according to any one of claims 1 to 3, characterized in that the display control means displays an object indicating the processing content applied to the processed image, and displays a thumbnail of the processed image and the object in any one of the following display forms: superimposed display, parallel display, or composite display. The medical information processing device according to any one of claims 1 to 4, characterized in that the display control means displays the thumbnail of the processed image in an emphasized manner compared to the thumbnail of the original image. The medical information processing device according to any one of claims 1 to 5, characterized in that the display control means displays an object indicating that the original image is an image before being processed in the external system, and displays a thumbnail of the original image and the object in any one of the following display formats: superimposed display, parallel display, and composite display. further comprising an association means for associating the original image with the processed image;
3 . The medical image processing apparatus according to claim 1 , wherein the display control means displays a thumbnail of the original image and a thumbnail of the processed image on a display unit based on the association. The medical information processing device according to claim 7, characterized in that the display control means displays a thumbnail of the original image and a thumbnail of the processed image superimposed on an object indicating the imaging protocol used when the original image was captured. Further comprising a storage means for storing the medical image,
The acquiring means acquires supplementary information of the processed image,
The medical information processing device according to claim 7 or 8, characterized in that the associating means searches for the original image from the storage means using the supplementary information as associating information, and associates the original image extracted by the search with the processed image. Further comprising a storage means for storing the medical image,
The acquisition means acquires the processed image and association information of the processed image,
The medical information processing device according to claim 7 or 8, characterized in that the associating means searches the storage means for the original image using information contained in the associating information, and associates the original image extracted by the search with the processed image. The medical information processing device according to claim 9 or 10, characterized in that the associating means searches the storage means for the original image using an identifier included in the associating information, and associates the original image extracted by the search with the processed image. The medical image processing device further includes a setting unit for setting whether or not to enable transmission of the medical image to the external system.
12. The medical image processing apparatus according to claim 1, wherein the transmission means transmits the original image to the external system when transmission of the medical image is enabled by the setting means. The medical information processing device according to any one of claims 1 to 12, characterized in that, when there are multiple external systems, the transmission means transmits the medical image to one of the multiple external systems that is set in advance to make a processing request. The transmission means transmits information regarding a processing content to be applied to the medical image together with the original image;
The medical image processing device according to claim 1 , wherein the acquisition means acquires the processed image generated by processing in the external system based on the processing content transmitted by the transmission means. The medical information processing device according to any one of claims 1 to 14, characterized in that the transmission means transmits the original image to the external system at the timing when the original image is generated. The medical image editing system further includes a receiving unit for receiving an instruction for image editing of the medical image from an operator.
The medical information processing device according to any one of claims 1 to 15, characterized in that the reception means restricts instructions for image editing of the processed image, or requests the display control means to display a warning when an instruction for image editing of the processed image is received. The medical information processing device according to any one of claims 7 to 11, characterized in that the associating means updates the association information of the first processed image with the association information of the second processed image when it is determined that the association information of the first processed image that has already been associated with the original image and the association information of the newly acquired second processed image are the same, and creates new association information for the second processed image when it is determined that they are different. The medical information processing device according to any one of claims 1 to 17, further comprising an output means for outputting the processed image to the image management server based on a setting for enabling or disabling output of the processed image to the image management server. The medical information processing device according to claim 18, characterized in that the output means outputs the processed image to the image management server when the examination including the capture of the original image is completed if the examination including the capture of the original image has not been completed when the acquisition means acquires the processed image, and outputs the processed image to the image management server at the time the processed image is acquired by the acquisition means if the examination has been completed. The medical information processing device according to claim 18, characterized in that the output means outputs the processed image to the image management server based on an output instruction if an examination including the capture of the original image is displayed on the display unit when the acquisition means acquires the processed image, and outputs the processed image to the image management server at the time the processed image is acquired by the acquisition means if the examination is not displayed on the display unit. a transmitting step of transmitting, to the external system, an original image which is a medical image captured by an imaging device and is to be processed in the external system;
acquiring a processed image generated from the original image by processing in the external system;
a display control step of displaying a thumbnail of the original image and a thumbnail of the processed image on a display unit;
Equipped with
The medical information processing method is characterized in that the display control step displays a thumbnail of the processed image in a display format different from that of the thumbnail of the original image so that it is possible to identify that the processed image is an image processed in the external system, and when there are multiple processed images in which different processing has been applied to the original image, thumbnails of the multiple processed images are displayed so that the processing content can be understood . A program for causing a computer to function as each of the means of a medical information processing device according to any one of claims 1 to 20.

Images