JP5677807B2 - Medical image display apparatus and method and program thereof - Google Patents

Description

  The present invention relates to a function for a doctor to interpret a medical image of a subject imaged by a medical image diagnostic apparatus and to easily input an interpretation result of the medical image into an interpretation report.

  The medical image diagnostic apparatus captures a medical image of a subject including an X-ray CT apparatus, an MRI apparatus, and an ultrasonic apparatus. The doctor confirms the presence of an abnormal part such as a lesion in the medical image displayed on the display device, and creates an interpretation report regarding the presence / absence of the abnormal part and the state of the abnormal part.

  A method for creating an interpretation report is disclosed in Patent Document 1, for example. Patent Document 1 generates link data including image specifying information for specifying medical image data to be linked in bundle image data in response to a link operation of medical image data in the interpretation report. The link data is embedded in the interpretation report, and the medical image data specified by the image specifying information in the bundle image data is extracted from the bundle image data in response to a request operation for the linked medical image. It is described that a technique for extracting medical image data from image data based on a link can be provided by displaying the extracted medical image data.

JP 2008-257544 A

  However, in Patent Document 1, a medical image diagnostic apparatus including a medical image display apparatus and a report creation terminal are separately prepared, each connected to a network, and the medical image display apparatus itself has a function of inputting an interpretation report. Absent.

  In recent years, high-function mobile phones that can be connected to the Internet at high speed, such as personal computers, and mobile terminals for reading e-books have been sold, and there is a need for doctors to have a function of displaying medical images on mobile terminals. Yes, the development of that function has begun.

  A mobile terminal can be interpreted wherever a doctor is in an area where radio waves can be received, but a useful user interface technology has been established to record the results of interpretation using a mobile terminal as a diagnostic report. The current situation is not.

  Therefore, an object of the present invention is to provide a medical image display apparatus equipped with a simple input function of an interpretation report.

  Another object of the present invention is to provide a medical image display method equipped with a simple input function for an interpretation report.

  Still another object of the present invention is to provide a medical image display program equipped with a simple input function for an interpretation report.

  In order to achieve the above object, the present invention displays a medical image, inputs at least one region of interest in the displayed medical image, presence / absence of abnormal findings and an abnormal state for the region of interest, and the input The diagnostic report information on the presence or absence of abnormal findings and abnormal states is generated, and the diagnostic report information is displayed on the region of interest in a semi-transparent manner and superimposed on the medical image.

  Specific configurations are shown in the following sections.

  (1) The medical image display device of the present invention inputs an image display unit for displaying a medical image, at least one region of interest in the displayed medical image, presence / absence of abnormal findings and an abnormal state for the region of interest. An input unit, a generation unit that generates diagnostic report information on the presence / absence of the input abnormal findings and an abnormal state, and the image display by superimposing the diagnostic report information on the region of interest in a translucent manner with the medical image A display control unit to be displayed on the unit.

  (2) The medical image display method of the present invention includes a step of displaying a medical image, a step of inputting at least one region of interest in the displayed medical image, presence / absence of abnormal findings, and an abnormal state for the region of interest. A step of generating diagnostic report information on the presence / absence of the input abnormal findings and an abnormal state, and displaying the diagnostic report information on the region of interest in a translucent manner with the medical image on the image display unit Steps.

  (3) The medical image program of the present invention includes a step of displaying a medical image, a step of inputting at least one region of interest in the displayed medical image, the presence / absence of an abnormal finding in the region of interest, and an abnormal state; The step of generating diagnostic report information on the presence / absence of the input abnormal findings and the state of abnormality, and the step of displaying the diagnostic report information on the region of interest in a translucent manner with the medical image displayed on the image display unit To the medical image apparatus.

  According to the above configuration, it is possible to input and display diagnostic report information superimposed on the medical image even with only the medical image display device, and the diagnostic report information is displayed in a translucent manner so that the original medical image can be displayed. Since the information is not impaired, it is possible to provide a medical image display apparatus equipped with a simple input function of an interpretation report, a method thereof, and a program.

  ADVANTAGE OF THE INVENTION According to this invention, the medical image display apparatus carrying the simple input function of an interpretation report can be provided.

  Also, it is possible to provide a medical image display method equipped with a simple input function of an interpretation report.

  Furthermore, it is possible to provide a medical image display program equipped with a simple input function for an interpretation report.

The figure which shows the hardware constitutions of the medical image display apparatus of this invention 1 is a flowchart of Embodiment 1 of the present invention. FIG. 3 is a diagram showing a display example of step 201 in FIG. FIG. 3 is a diagram showing a display example of step 202 in FIG. FIG. 3 is a diagram showing a display example of step 203 in FIG. FIG. 3 is a diagram showing a display example of step 204 in FIG. FIG. 3 is a diagram showing a display example of step 205 in FIG. FIG. 3 is a diagram showing a display example of step 206 in FIG. FIG. 3 is a diagram showing a display example of step 207 in FIG. FIG. 3 is a diagram showing a display example of step 208 in FIG. FIG. 3 is a diagram showing a display example of step 209 in FIG. 10 is a flowchart of Embodiment 2 of the present invention. FIG. 5 is a diagram showing a display example of step 40A in FIG. FIG. 5 is a diagram showing a display example of step 40B in FIG. FIG. 5 is a diagram showing a display example of step 40C in FIG. 10 is a flowchart of Embodiment 2 of the present invention. FIG. 7 is a diagram showing a display example of step 60A in FIG. FIG. 7 is a view showing a display example of step 60B in FIG. FIG. 7 is a diagram showing a display example of step 60C in FIG.

  Preferred embodiments of a medical image display apparatus according to the present invention will be described below with reference to the accompanying drawings. In the following description and the accompanying drawings, the same reference numerals are given to the constituent elements having the same functional configuration, and redundant description will be omitted.

  FIG. 1 is a diagram showing a hardware configuration of the medical image display apparatus 1. As shown in FIG.

  The medical image display device 1 includes a CPU (Central Processing Unit) 2, a main memory 3, a storage device 4, a display memory 5, a display unit 6, a controller 7 connected to a mouse 8, a keyboard 9, and a network adapter 10 including a system bus 11 is configured so as to be able to send and receive signals. The medical image display device 1 is connected to a medical image photographing device 13 and a medical image database 14 via a local area network (LAN) 12 so as to be able to send and receive signals. Here, “to enable signal transmission / reception” indicates a state in which signals can be transmitted / received to each other or from one to the other, regardless of whether they are electrically or optically wired or wireless.

  The CPU 2 is a device that controls the operation of each component of the medical image display device 1. The CPU 2 loads a program stored in the storage device 4 and data necessary for program execution into the main memory 3 and executes it.

  The main memory 3 stores programs executed by the CPU 2 and the progress of arithmetic processing.

  The storage device 4 is a device that stores medical image data captured by the medical image capturing device 13, and is specifically a hard disk or the like. The storage device 4 may be a device that exchanges data with a portable recording medium such as a flexible disk, an optical (magnetic) disk, a ZIP memory, or a USB memory.

  The medical image data is acquired from the medical image photographing device 13 or the medical image database 14 via the LAN 12. The storage device 4 stores a program executed by the CPU 2 and data necessary for program execution.

  The display memory 5 temporarily stores display data for displaying medical image data, annotation information described later, and the like on the display unit 6.

  The display unit 6 is configured by a device such as a liquid crystal display or a CRT (Cathode Ray Tube), and displays medical image data.

  The controller 7 detects the rotary encoder of the mouse 8 and outputs the position of the cursor of the mouse 8 on the display unit 6 to the CPU 2.

  The mouse 8 and the keyboard 9 are operation devices for an operator to give an operation instruction to the medical image display device 1. The mouse 8 may be another pointing device such as a trackpad or a trackball. Moreover, the touch panel which an operator operates by directly touching a screen with a finger may be sufficient.

  The network adapter 10 is a device for connecting the medical image display apparatus 1 to a network 12 such as a LAN, a telephone line, and the Internet, and is specifically a router or a hub.

  The medical imaging apparatus 13 is an apparatus that acquires medical image information such as a tomographic image of a subject, such as an MRI apparatus, an X-ray CT apparatus, an ultrasonic diagnostic apparatus, a scintillation camera apparatus, a PET apparatus, or a SPECT apparatus.

  The medical image database 14 is a database system that stores medical image information captured by the medical image capturing device 13.

  Next, an example of the process from the image display of the medical image diagnostic apparatus to the display of the created simple report will be described in the first embodiment.

  FIG. 2 is a flowchart showing the process of the first embodiment of the present invention, and FIGS. 3A to 3I are views showing display examples in the respective steps of FIG. Hereinafter, each step of FIG. 2 will be described.

(Step S201)
As shown in FIG. 3A, the CPU 2 displays a medical image obtained from the medical image capturing device 13 via the LAN 12 on the display unit 6. Here, the medical image will be described by taking an X-ray CT image 20 including the lung of the subject as an example.

(Step S202)
An operator such as a doctor inputs an operation mode of “interpretation report input” to the mouse 8 or the keyboard 9 as shown in FIG. 3B. As the operation mode, “interpretation report input”, “etc” and the like can be displayed by pull-down menus, and the operation mode can be selected by input from the mouse 8. The pull-down menu is a method of selecting an item from the menu on the operation screen. When you place the mouse cursor on the menu title and click the button, the list of selection items hangs down. This is the display method.

  CPU 2 receives an input from mouse 8 or an input from keyboard 9 and shifts to an operation mode of “interpretation report input”.

(Step S203)
As shown in FIG. 3C, the CPU 2 displays on the display unit 6 that the operation mode has shifted to the “interpretation report input” operation mode. Specifically, a message that “interpretation report input mode is in operation” is displayed on the display unit 6.

(Step S204)
As shown in FIG. 3D, the operator uses the mouse as a region of interest 21 that is a part of the X-ray CT image 20 displayed on the display screen of the display unit 6 such as a lesioned part or a part requiring diagnosis. Enter using 8 or keyboard 9.

  The CPU 2 receives an input from the mouse 8 or an input from the keyboard 9, and sets the address of the region of interest 21 in the display memory 5 in which the X-ray CT image 20 corresponding to the display screen is stored. Further, the CPU 2 sets a translucent area so that it becomes an input area for the interpretation report with respect to the address of the area of interest 21.

(Step S205)
As shown in FIG. 3E, the CPU 2 displays a translucent region of interest 21 on the display unit 6 so as to be superimposed on the X-ray CT image 20.

(Step S206)
As shown in FIG. 3F, the operator inputs a simple item of the interpretation report into the displayed region of interest 21 using the mouse 8 or the keyboard 9. As shown in the figure, when the size of the region of interest 21 is so small that it is not suitable for inputting a simple item of an interpretation report, the CPU 2 may provide a balloon 22 for input.

  The simple items of the interpretation report are annotation information of medical images including the presence / absence of abnormal findings and abnormal states. Annotation information means the presence or absence of abnormal findings and abnormal states, as well as a variety of diagnostic information about medical images such as past illnesses and treatment histories, but the annotation information here includes `` absence of abnormal findings '' and `` abnormal state '' This will be described as a representative example. The presence / absence of an abnormal finding indicates whether or not there is an abnormal part such as a lesioned part in the interpretation target area in which the region of interest is set. The abnormality state indicates what kind of abnormality has occurred when there is an abnormality depending on whether or not there is an abnormal finding. The presence or absence of abnormal findings is indicated by a check mark on the radio button “Yes” or “No”. Abnormal status can be displayed in the pull-down menu such as “Glass shade”. The abnormal state can be selected by input from the mouse 8 or input from the keyboard 9. A radio button is a type of GUI widget that is used to select one of the predefined choices. When one button is pressed, the other pressed buttons are not pressed. To return, only one button is always pressed.

  The CPU 2 receives an input from the mouse 8 or an input from the keyboard 9 and stores the presence / absence of abnormal findings and the abnormal state in the display memory 5 corresponding to the region of interest. Here, specifically, “present” and “glazed shading” are respectively selected.

  The “rubbing glass shadow” indicates a faint initial shadow of lung cancer, and this imaging diagnosis is used for early detection of lung cancer.

(Step S207)
As shown in FIG. 3G, the CPU 2 superimposes and displays the balloon 22 of the region of interest 21 in which the abnormal findings “exist” and “frying glass shadow” are written on the X-ray CT image 20 on the display unit 6. Then, the abnormal findings “exist” and “shaded glass shadow” are stored in the storage device 4 together with the X-ray CT image 20.

(Step S208)
As shown in FIG. 3H, the operator checks whether there is a region of interest with an abnormal finding in another part of the medical image displayed on the display unit 6, and determines whether there is a region of interest with an abnormal finding. Input using the keyboard 9. Specifically, as shown in the figure, “Is there a next region of interest? (Y / N)” is displayed in the area 23 on the display screen, and the “Y” or “N” key on the keyboard 9 is displayed. Enter one of the following.

  CPU2 receives the input from keyboard 9, and inputs "Y" indicates "there is a region of interest with the next abnormal finding", and "N" indicates whether the "region of interest with the next abnormal finding is not found" judge.

  As a result of the determination, if there is a region of interest with an abnormal finding, the process proceeds to step S204, and if there is no region of interest with an abnormal finding, a confirmation message for ending the operation mode of “interpretation report input” is generated.

(Step S209)
As shown in FIG. 3I, the CPU 2 displays a confirmation message on the end of the operation mode of “interpretation report input” on the display unit 6. Specifically, “Do you want to end interpretation report? (Y / N) is displayed in area 24 on the display screen.

  The operator uses the keyboard 9 to enter “Y” to end “Interpret the interpretation report” or “N” to cancel the completion, in response to the confirmation message for “Interpret the interpretation report”. To do.

  The CPU 2 receives input from the keyboard 9 and determines whether or not the “interpretation report input” can be ended.

  If the input from the keyboard 9 is “Y”, the “interpretation report input” is terminated. If the input from the keyboard 9 is “N”, the “interpretation report input” is not terminated, and the process proceeds to step S203. The operation mode of “Interpretation Report Input” will be continued.

  According to the first embodiment described above, the display unit 6 displays a medical image, and the medical image on which the mouse 8 or the keyboard 9 is displayed has at least one region of interest, the presence or absence of abnormal findings in the region of interest, and abnormalities. The state is input, the CPU 2 generates diagnostic report information on the presence or absence of the input abnormal findings and abnormal states, and the display unit 6 superimposes the diagnostic report information on the region of interest in a translucent manner with the medical image. Therefore, even if only the medical image display device is used, it is possible to input and display diagnostic report information superimposed on the medical image, and the diagnostic report information is displayed semi-transparently so that the original information of the medical image is displayed. Therefore, it is possible to provide a medical image display apparatus equipped with a simple input function of an interpretation report, a method thereof, and a program.

  In addition, the unique effect of the first embodiment is that the interpretation target portion of the medical image is clarified by the region of interest, so that it can be easily understood which portion of the medical image the interpretation target portion is a report.

  Next, in the second embodiment, an example of a process until the report output after the simple report display process described in the first embodiment will be described.

  FIG. 4 is a flowchart showing the processing of the second embodiment of the present invention, and FIGS. 5A to 5C are diagrams showing examples of display in each step of FIG. Hereinafter, each step of FIG. 4 will be described.

(Steps S401 to S409)
Steps S401 to S409 are the same as steps S201 to S209 of the first embodiment, and thus description thereof is omitted.

(Step S40A)
As shown in FIG. 5A, the operator inputs a “report output format” using the mouse 8 or the keyboard 9. In the report output format, when there are a plurality of diagnostic items in one medical image, the display area of the diagnostic item character information and the medical image can be arbitrarily set. Here, there is illustrated a case where there are a plurality of diagnosis items in which the right lung of the subject has an abnormal finding and the symmetrical position of the left lung has no abnormal finding. In addition, the character information of the diagnostic item is information that the user wants to see first when the diagnostic report is used, and is set as the display area 25. In addition, the medical image refers to which position has an abnormal finding, and is set as a display area 26.

(Step S40B)
As shown in FIG. 5B, the CPU 2 receives an input from the mouse 8 or an input from the keyboard 9, and sets the “report output format” in the display memory 5. In this case, the “report output format” is such that the diagnostic item display area 25 is arranged at the top of the screen and the medical image display area 26 is arranged at the bottom of the screen. In addition, CPU2 attaches severity information to the diagnosis item and displays it at the top of the list of multiple diagnosis information, for example, quick histological examination of benign / malignant, such as rubbing glass shadows suspected of early lung cancer As described above, a plurality of lists of diagnostic information may be sorted according to the severity information.

(Step S40C)
As shown in FIG. 5C, the CPU 2 displays diagnostic items and medical images (X-ray CT images 20) on the display unit 6 according to the diagnostic item display area 25 and the medical image display area 26 stored in the display memory 5. To do.

  Further, when priority is given to the display order of medical images such as comparative interpretation, the display order of a plurality of medical images to be compared may be displayed at the upper level (for example, the upper area of the screen).

  According to the second embodiment described above, the display unit 6 displays a medical image, and the medical image on which the mouse 8 or the keyboard 9 is displayed has at least one region of interest, the presence / absence of abnormal findings in the region of interest, The state is input, the CPU 2 generates diagnostic report information on the presence or absence of the input abnormal findings and abnormal states, and the display unit 6 superimposes the diagnostic report information on the region of interest in a translucent manner with the medical image. Therefore, even if only the medical image display device is used, it is possible to input and display diagnostic report information superimposed on the medical image, and the diagnostic report information is displayed semi-transparently so that the original information of the medical image is displayed. Therefore, it is possible to provide a medical image display apparatus equipped with a simple input function of an interpretation report, a method thereof, and a program.

  In addition, the unique effect of Example 2 is that diagnostic items are displayed at a higher position on the screen than medical images, and in particular, when a plurality of diagnostic items are sorted by severity, the examination of the subject is simplified. Workflow.

  Next, in the third embodiment, an example of a process until the interpretation result display of another interpreting doctor after the display process of the simple report described in the first embodiment will be described.

  FIG. 6 is a flowchart showing the processing of the third embodiment of the present invention, and FIGS. 7A to 7C are diagrams showing display examples in the respective steps of FIG. Hereinafter, each step of FIG. 6 will be described.

(Steps S601 to S609)
Steps S601 to S609 are the same as steps S201 to S209 of the first embodiment, and thus description thereof is omitted.

(Step S60A)
As shown in FIG. 7A, the operator inputs the “doctor name” using the mouse 8 or the keyboard 9. The doctor name may be input to the area 27 using the keyboard 9, or the doctor name may be selected with the mouse 8 in the pull-down menu described in the first embodiment. Here, the former method using the keyboard 9 is illustrated, and the doctor name is entered as A doctor.

(Step S60B)
As shown in FIG. 7B, the CPU 2 receives an input from the keyboard 9 and transmits a medical image and a diagnosis result to a portable terminal owned by the doctor A of the inputted doctor name. Further, the CPU 2 displays “data being transferred to the doctor A” in the lower right area of the display unit 6 during data transmission.

(Step S60C)
The doctor A uses the mobile terminal owned by himself / herself, for example, interprets the image according to the procedures of S201 to S209 in the first embodiment, and returns the interpretation result from the mobile terminal to the medical image display apparatus.

  As shown in FIG. 7C, the CPU 2 displays the return result from the doctor A on the display unit 6. Here, although the doctor who requested the interpretation of Dr. A and the opinion of Dr. A coincided with the shading glass shadow, the diagnosis of Dr. A did not match “interstitial pneumonia”. Further, the CPU 2 displays the “doctor's diagnosis result” in the lower right area of the display unit 6 during data transmission.

  According to Example 3 described above, the display unit 6 displays a medical image, and the medical image on which the mouse 8 or the keyboard 9 is displayed has at least one region of interest, whether there is an abnormal finding in the region of interest, and whether there is an abnormality. The state is input, the CPU 2 generates diagnostic report information on the presence or absence of the input abnormal findings and abnormal states, and the display unit 6 superimposes the diagnostic report information on the region of interest in a translucent manner with the medical image. Therefore, even if only the medical image display device is used, it is possible to input and display diagnostic report information superimposed on the medical image, and the diagnostic report information is displayed semi-transparently so that the original information of the medical image is displayed. Therefore, it is possible to provide a medical image display apparatus equipped with a simple input function of an interpretation report, a method thereof, and a program.

  Further, as a specific effect of the third embodiment, the interpretation results of a plurality of doctors can be inquired with a simple operation.

  As mentioned above, although various Example was described about this invention, this invention is not limited to these, Various modifications can be applied. For example, the medical image display apparatus may be a portable terminal. In that case, it is desirable to take security measures such as SSL (Secure Socket Layer) in order to use an Internet line instead of a LAN.

  2 CPU, 6 display, 8 mouse, 9 keyboard

Claims (6)

An image display unit for displaying a medical image; at least one region of interest in the displayed medical image; presence / absence of an abnormal finding in the region of interest; an input unit for inputting an abnormal state; and the presence / absence of the input abnormal finding , possess a generating unit that generates a diagnostic report information of the abnormal state, a display control unit for displaying on the image display unit of the diagnostic report information by superimposing the translucent so the medical image on the region of interest, the ,
The medical image display device , wherein the generation unit generates a balloon used for inputting the diagnostic report information when the size of the region of interest is not suitable for inputting the diagnostic report information . The generation unit generates a display format according to a display order of the plurality of diagnosis report information sorted in order of severity of each diagnosis report information when there is a plurality of diagnosis report information in one medical image. The medical image display apparatus according to claim 1 . A step of displaying a medical image; a step of inputting at least one region of interest in the displayed medical image; presence / absence of an abnormal finding of the region of interest; an abnormal state; and the presence / absence of the input abnormal finding see containing and generating a diagnostic report status information, and step of the diagnostic report information overlap with translucently the medical image on the ROI display, a
The generating step generates a balloon used for inputting the diagnostic report information when the size of the region of interest is not suitable for inputting the diagnostic report information . The generating step generates a display format according to the display order of the plurality of diagnosis report information sorted in order of severity of each diagnosis report information when there is a plurality of diagnosis report information in one medical image. The medical image display method according to claim 3, wherein: A step of displaying a medical image; a step of inputting at least one region of interest in the displayed medical image; presence / absence of an abnormal finding of the region of interest; an abnormal state; and the presence / absence of the input abnormal finding Generating a diagnostic report information of a state; and causing the medical imaging apparatus to execute a step of superimposing and displaying the diagnostic report information on the region of interest in a translucent manner with the medical image ;
The generating step generates a balloon used for inputting the diagnostic report information when the size of the region of interest is not suitable for inputting the diagnostic report information . The generating step generates a display format according to the display order of the plurality of diagnosis report information sorted in order of severity of each diagnosis report information when there is a plurality of diagnosis report information in one medical image. The medical image display program according to claim 5, wherein:

Images