JP2004357803A - Medical image processing system and medical image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a medical image processing system capable of easily comparing a prepared schema and a fetched lesion image. <P>SOLUTION: The medical image processing system for processing medical image information with a computer is provided with: a display for displaying a schema for medical use; a write means for writing plotting data and text data to the schema displayed on the display; an instruction means for instructing the angle of rotating an image to be displayed on the display; and an image processing means for performing a coordinate transformation processing in which the schema including a plotted figure written according to the rotation angle designated by the instruction means is rotated and further performing the coordinate transformation processing in which the text data is only translated without rotation. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a medical image processing method and a medical image processing system for storing and managing an electronic file such as image information obtained by a medical device.
[0002]
[Prior art]
In recent years, in the medical field, computerization and computerization have advanced, and medical records have been digitized to share information through a network or the like. In such a background, it is necessary to capture an image of the affected part photographed by the photographing device or to create a sketch (hereinafter, referred to as a schematic diagram) that simply depicts the state of the affected part in an electronic medical chart, a diagnostic report, or the like. A medical image processing system is provided. As a means for creating a schema diagram on an electronic medical record, a method of creating a schema using a mouse, a tablet, a pen tablet, or the like is known. Such a schema diagram is often accompanied by a doctor's comment or the like, so that a comment or the like can be added to the digitized schema diagram by text input (see Patent Document 1).
[Patent Document 1]
JP-A-2002-304467 [0003]
[Problems to be solved by the invention]
In such a schematic diagram, a doctor takes a picture while looking at the state of the affected part, so that the positional relationship of the affected part may be different from the actual situation in some cases. For example, in a case where the state of the fundus of a patient's eye is represented by a schematic diagram, a doctor observes the fundus using an indirect mirror in order to widen the observation field of view. Since the fundus image observed by the inverting mirror is an inverted image, it is upside down and left and right with respect to the actual fundus. In the case where a comment or the like is attached to the schema diagram observed and drawn in such a state, the comment is attached to the inverted fundus image. Such a schematic diagram is often photographed by a photographing device such as a fundus camera, and is often compared with a captured fundus image. Since the affected part image (fundus image) photographed by the fundus camera or the like is not an inverted image but a direct image, it is difficult to compare with a previously created schema diagram. In addition, it is possible to compare the digitized schema diagram with the photographed fundus image by inverting it vertically and horizontally, but at this time, the comments attached to the schema diagram are also inverted, and the characters are inverted. It will be inconvenient.
An object of the present invention is to provide a medical image processing system capable of easily comparing a created schematic diagram with a captured diseased part image in view of the above-mentioned problems of the related art.
[0004]
[Means for Solving the Problems]
In order to solve the above problems, the present invention is characterized by having the following configuration.
(1) In a medical image processing system for processing medical image information by a computer, a display for displaying a medical schematic diagram, a writing unit for writing drawing data and text data to the schema diagram displayed on the display, Instructing means for instructing an angle to rotate an image to be displayed on the display, and image processing means for performing coordinate conversion processing by rotating a schema diagram including the written drawing according to the rotation angle by the instructing means, Image processing means for performing coordinate conversion processing of only parallel movement without rotating text data.
(2) The image processing means of (1) performs a process of translating the text data to the coordinates where the text data moves in accordance with the instruction of the rotation angle.
(3) The medical image processing system according to (1) includes a capturing unit for capturing a captured image of the affected part corresponding to the schema diagram, and a display that displays the captured image together with the rotated schematic diagram on the same screen of the display. And control means.
(4) In a medical image processing program for processing medical image information by a computer, means for displaying a medical schematic diagram on a display, and drawing and text data are written and pasted on the schematic diagram displayed on the display. Pasting means, instructing means for instructing an angle of rotation of an image to be displayed on the display, and image processing for performing coordinate transformation processing in which a schema diagram including the written drawing data is rotated in accordance with an instruction signal of the instructing means Means for causing the computer to execute image processing means for performing a coordinate transformation process of only the parallel movement without rotating the text data.
[0005]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
<System basic configuration>
FIG. 1 is a diagram showing a configuration of a medical image processing system that manages and processes medical information such as measurement information and image information obtained by medical equipment. In this embodiment, an ophthalmologic device will be described as a medical device.
[0006]
Reference numeral 1 denotes a personal computer (hereinafter, referred to as a personal computer). The personal computer 1 has an arithmetic control unit 2, an information storage / reproducing unit (non-volatile memory) 3 composed of a hard disk drive, a RAM 4 (Random Access Memory), and a video for inputting image data from the outside to the personal computer 1. An input unit 5 composed of a capture and a communication unit 40 for exchanging data with an external personal computer are provided. The information storage / reproduction unit 3, the RAM 4, the input unit 5, and the communication unit 40 are each connected to the arithmetic control unit 2.
[0007]
The information recording / reproducing unit 3 stores medical information processing software (program) 10 described later. By starting (executing) the medical information processing software 10 on a personal computer, the medical image processing system can be used. It is possible.
In the information storage / reproduction unit 3, folders (patient folders 12a and 12b) are created for each patient, and image data for each patient is stored in this folder. When an image is captured without specifying a patient, the image data is stored in the Queue folder 11. The information recording / reproducing unit 3 can use, for example, a DVD drive or a flexible disk drive in addition to the hard disk drive.
[0008]
The fundus camera 20 and the slit lamp 30 are connected to the input unit 5. The fundus camera 20 and the slit lamp 30 are provided with an image pickup means such as a CCD camera or a digital camera (not shown) for photographing (for capturing an image), and image data picked up by the respective image pickup means is input through the input unit 5. It is taken into the personal computer 1.
The communication unit 40 is provided with a modem and a LAN board, and can perform mutual communication with another personal computer 1 ′ using the Internet 41 or the LAN 42 (Local Area Network).
[0009]
Reference numeral 13 denotes a printer for outputting a captured image or the like to a sheet. Reference numeral 15 denotes a display, and a general-purpose display such as an LCD monitor or a CRT monitor can be used. Reference numeral 16 denotes an operation unit for instructing the operation of the personal computer 1 and the activated medical information processing software 10. The operation unit 16 includes a keyboard 16a and a mouse 16b.
[0010]
<Medical information processing software configuration>
When the medical information processing software 10 is activated, the arithmetic control unit 2 reads the medical information processing software 10 from the information recording / reproducing unit 3 and makes it reside in the RAM 4. This medical information processing software 10 is roughly composed of five work screens. Each of the operation screens is shown in FIGS.
[0011]
(Patient list display screen)
When the medical information processing software 10 starts, a patient list display screen is first displayed on the display 15 as shown in FIG. This screen is a main screen, and a list of registered patients, a patient search, a new patient reception (registration), and the like can be performed on this screen. One column of registered patients is displayed in the display column 50 in the order of patient 50a, patient 50b,....
Folders are created in the information recording / reproducing section 3 for registered patients. In the present embodiment, a patient folder 12a is created for the patient 50a, and a patient folder 12b is created for the patient 50b.
[0012]
On the right side of the screen, a group of buttons 51 for searching for registered patients, a registration button 52 for performing new registration, and a disclosure button 53 for viewing individual patient information in detail are arranged in a column. In order to use these buttons, the cursor mark 110 displayed on the display 15 is moved to a position above the buttons using the mouse 16b. After that, it can be used by clicking a button (not shown) provided on the mouse 16b.
[0013]
A shortcut button group 100 is set at the bottom of the screen, and twelve shortcut buttons 100a to 100l can be used. The shortcut buttons 100a to 100l correspond to operations assigned to function keys (F1 to F12) (not shown) mounted on the keyboard 16a.
[0014]
Shortcut buttons set in this embodiment include a button 100a for moving to the main screen, a button 100b for displaying a patient list, a button 100c for capturing an image from the fundus camera 20, and an image capturing from the slit lamp 30. , A button 100e for displaying all of the image data stored in the Queue folder 11 in a thumbnail (Thumbnail) format, and a button 100f for outputting the selected image data to the printer 13. The remaining buttons 100g to 100l are not set in this embodiment.
A menu bar 54 is displayed at the top of the screen. The menu bar 54 has items of file, patient, measurement, setting, and help. Main functions (switching of display screens and the like) can be selected and used from the menu bar 54 as well.
[0015]
(Registration screen)
FIG. 3 is a screen for displaying new registration of a patient or registered patient information. This registration screen can be displayed by using the registration button 52 and the disclosure button 53 shown in FIG. At the left end of the registration screen, icons summarizing medical images such as image data and measurement data acquired up to the present are displayed in a hierarchical format (tree view 85) so that the stored contents and status can be grasped visually. Has become.
[0016]
New registration of a patient is performed on the patient data registration screen 60. The input items of the patient data include "name", "furigana", "sex", "date of birth", "code", "first consultation date", "address", "telephone number" and the like. Reference numeral 61 denotes an OK button for registration, and reference numeral 62 denotes a cancel button for canceling registration. Further, by performing new registration, patient folders are created (stored) in the information recording / reproducing unit 3 by the number of registrations.
[0017]
At the lower left of the screen, a report button 63, a finding button 64, and an input template button 65 are displayed. The report button 63 is a button for integrating various image data and finding data of a certain patient into one in HTML format to create report data. The finding button 64 is used when creating a schematic diagram. Details of the creation of the schema diagram will be described later. The input template button 65 is used when manually inputting patient measurement data and the like.
[0018]
(Image capture screen)
FIG. 4 is an image capture screen for capturing image data of a patient's eye captured by the fundus camera 20 and the slit lamp 30 into the personal computer 1.
Reference numeral 70 denotes a main image box on which the latest captured image is displayed in a large size. Reference numeral 71 denotes a thumbnail display box, and the captured images are sequentially displayed as thumbnail images 70a and 70b. When a plurality of thumbnail images are displayed in the thumbnail display box 71, when one of them is selected, the selected thumbnail image is enlarged and displayed in the main image box 70.
Reference numeral 73 denotes a group of setting buttons for setting optometry data for an image to be captured. In the setting button group, an optometry date, designation of left and right eyes, and selection of an image format shooting mode can be selected and set.
[0019]
The patient's eyes are captured from the ophthalmic apparatus (the fundus camera 20 and the slit lamp 30) by clicking the capture button 74. The image capturing operation can be performed not only by using the capturing button 74 but also by a joystick, foot switch, or the like (not shown) provided in the ophthalmologic apparatus. Reference numeral 75 denotes an end button for ending the image capture and returning to the previous work screen.
[0020]
(Schema diagram creation screen)
FIG. 5 is a screen for creating a schematic diagram. This schema diagram creation screen can be displayed by using (clicking) the above-mentioned finding button 64.
Reference numeral 90 denotes a plurality of templates prepared in advance to create a predetermined schema diagram. As the template 90 in the present embodiment, for example, an inverted fundus template 90a, 90b, an eyeball sectional view template, a free input template, a face template, a slit sectional view template, and the like are prepared. The inversion fundus model 90a is a schematic representation of an inversion of the right fundus of the patient's eye, and a schematic diagram of the optic disc, macula, blood vessels, and the like is drawn in the inversion image in advance in this model. ing. The inversion fundus model 90b is a schematic representation of an inversion of the left fundus of the patient's eye. These templates 90 can be enlarged and displayed as creation templates 200 on the creation screen 91 by selecting them with the cursor mark 110.
[0021]
At the top of the creation screen 91, tool buttons for creating a schema diagram are prepared (displayed). Reference numeral 92 denotes a clear button for canceling all created schema diagrams and returning to the template state, and reference numeral 93 denotes a save button for saving the created schema diagrams as finding data (schema diagram data). Reference numeral 94 denotes a drawing button group for drawing straight lines, curves, squares, circles, ellipses, and the like on the creation template 200 displayed on the creation screen 91, and 95 denotes a comment on the creation template 200 as text data. Is a text input button for filling in the text. In addition, an erasing button 96 for erasing each of the drawing data and text data added on the creation template 200, a hatching button 97 for creating a hatch on the creation template 200, a line type A line type change button 98 for changing the color, a color button for selecting and changing the color, and the like are provided.
[0022]
(Image save screen)
FIG. 6 shows an image storage screen for displaying image data stored in the patient folder.
On the left side of the screen, various data stored in the patient folder are displayed in a hierarchical format (tree view 85) in date order or item order (fundus image, slit image, finding, etc.).
By selecting an icon displayed in the tree view 85, image data corresponding to the icon is displayed on the display screen 80 as a thumbnail image.
In addition, various buttons are selected from a plurality of buttons set on a date selection toolbar 81 for selecting a date to be displayed, a type selection toolbar 82 for selecting a type of image to be displayed, and a control toolbar 83 for specifying display conditions such as left and right eyes. Thus, a thumbnail image displayed on the display screen 80 can be selected. Reference numeral 84 denotes an enlarged display button for enlarging and displaying a thumbnail image arbitrarily selected from the displayed thumbnail images. The multi button 84a of the enlarged display button 84 is for displaying the selected thumbnail images at one time, and the single button 84b is for displaying the selected thumbnail images one by one in order.
[0023]
The operation of the medical image processing system having the above configuration will be described. In this embodiment, an operation of creating a schematic diagram of the fundus image of the patient's eye, an operation of capturing the fundus image from the fundus camera 20, and a comparison operation between the schematic diagram and the fundus image will be described.
[0024]
The medical information processing software 10 is started. After selecting a registered patient on the main screen shown in FIG. 2 (here, the patient 50a is selected), the disclosure button 53 is clicked to display the patient data screen shown in FIG. Next, in order to create a schematic diagram of the fundus of the right eye of the patient, the finding button 64 is clicked to display a schematic diagram creation screen shown in FIG. In addition, an inverted image fundus template 90 a is selected using the cursor mark 110, and an inverted image fundus schema model is displayed on the display screen 91.
[0025]
The doctor has an indirect mirror and a condenser lens (not shown), and observes the fundus of the patient's eye (here, the right eye) that has mydriasis in advance with a mydriatic. Since an indirect mirror is used for observing the fundus, the fundus image to be observed is an inverted image. The doctor observes the inverted fundus image, and uses the tool buttons such as the drawing button group 94 to display the state of the patient's fundus on the creation template 200 (inverted fundus template) on the creation template 200. To draw. The drawing on the creation template 200 can be freely drawn by moving the cursor mark 110 on the creation template 200 using the mouse 16b.
[0026]
By performing such operations, a schema of the fundus of the patient's eye (inverted image) is created. In this embodiment, as shown in FIG. 5, a schematic diagram 201 of an affected part is drawn as drawing data on a creation template 200. To add a comment to the affected part schematic diagram 200, click the text input button 95 with the cursor mark 110, and then specify the start and end points of the leader line on the creation template 200 with the cursor mark 110. (Click the button of the mouse 16b). When the end point of the leader line is designated, a dialog (not shown) for inputting a comment appears on the display screen shown in FIG. When a comment is input to this dialog box and determined, a comment 202 is displayed as text data at one end of the leader line.
[0027]
When such a work is performed and the schema diagram is completed, the save button 93 is clicked, and the creation template 200 to which the drawing data and the text data are added is saved as finding data (schema diagram data) in the patient folder 12a. . The saved finding data is displayed in a tree view 85 shown in FIG.
[0028]
Next, the button 100c is clicked to display the image capturing screen shown in FIG. 4, and an image capturing operation from the fundus camera 20 and the slit lamp 30 is performed.
In the image capturing operation, the setting button group 73 is used to select and set optometry data such as an optometry date (shooting date), designation of right and left eyes, an image format, and a photographic mode. In the case of the fundus camera 20, the patient is seated in front of the fundus camera 20, and the fundus camera 20 is operated to match the patient's eye. When the position adjustment between the patient's eye and the fundus camera 20 is completed, the capture button 74 is clicked to capture the fundus image into the personal computer 1. The captured image data is stored in the patient folder 12a and displayed in the main image box 70. At the same time, it is displayed in the thumbnail display box 71 as a thumbnail-format image. When the necessary fundus image has been captured, the end button 75 is clicked to return to the previous work screen (here, the main screen), and the image capture work ends.
[0029]
Next, when the user wants to compare the image data (fundus image) stored in the patient folder 12a with the corresponding schema diagram, the user selects the desired image icon from the tree view 85 displayed on the left side of the screen on the main screen. The image storage screen shown in FIG. 6 is displayed. Here, by selecting “today” from the date selection toolbar 81 and selecting “fundus (color)” and “findings” from the type selection toolbar 82, the fundus images 88a and 88b taken today and the schema diagram 89a are thumbnailed. The image is displayed on the display screen 80 at one time. From a plurality of thumbnail images displayed on the display screen 80, a schema diagram 89a and a fundus image 88a corresponding to the schema diagram 89a are selected, a multi-button 84a of an enlargement display button 84 is selected, and only two images are enlarged. Display.
[0030]
When the multi button 84a is used, the selected fundus image 88a and the schema diagram 89a are displayed in parallel on the display screen as an enlarged image as shown in FIG. Since the schematic diagram 89a schematically shows the inverted image of the fundus which appears in the fundus image 88a, the figure is inverted (rotated 180 degrees) in the vertical and horizontal directions with respect to the direct image of the fundus image 88a. ing. Therefore, it is difficult to compare the two as they are, so the schema diagram 89a is selected by the cursor mark 110, and the schema diagram 89a is rotated by 180 ° using the inversion button 120 provided at the top of the display screen.
[0031]
FIG. 8 is a diagram showing a processing method of text data and drawing data when the schema diagram 89a is rotated 180 °, and FIG. 9 is a flowchart showing a flow of a processing method when the schema diagram 89 is rotated 180 °. is there.
The arithmetic control unit 2 reads the creation template data (the creation template 200) from the schema diagram 89a, and writes the drawing data (the affected part schematic diagram 201 and the leader line) and the text data written on the creation template 200. (Comment 202) is read. Further, the arithmetic control unit 2 detects the coordinate positions of the drawing data and the text data written on the creation template 200 when each data is read. After detecting the coordinate positions of the drawing data and the text data, the arithmetic control unit 2 rotates the creation template data 180 ° about the image center of the creation template 200 as an axis. Further, the arithmetic control unit 2 calculates a coordinate position when the image is rotated by 180 ° around the image center of the creation template 200 from the coordinate positions of the detected drawing data and text data.
[0032]
The arithmetic control unit 2 performs a coordinate conversion process of moving the drawing data to the calculated coordinate position after the rotation by 180 ° in a state where the drawing data is vertically and horizontally inverted. After the coordinate conversion processing of the drawing data, the drawing data is pasted on the creation template 200 'rotated by 180 degrees as shown in FIG. 8, and displayed as a diseased part schematic diagram 201' (solid line portion). Further, the arithmetic and control unit 2 performs a coordinate conversion process of translating the text data in parallel to the calculated coordinate position after the 180 ° rotation without inverting the image vertically and horizontally. After the coordinate conversion processing of the text data, the text data is pasted on the creation template 200 'and displayed as a comment 202'.
[0033]
By performing the above-described image processing, the arithmetic control unit 2 creates a schema diagram 89a ′ rotated by 180 ° as shown in FIG. 10, and displays it in parallel with the fundus image 88a. As described above, the entire schema image is inverted, and the text data (comment 202 ′) attached to the schema image is only translated without being inverted, so that the fundus image 88a photographed as a direct image can be obtained. It is possible to easily compare the schema image 89a 'with the comment. If the user wants to return the schema image 89a 'to the original state, the user can click the reverse button 120 again.
[0034]
In the above embodiment, the created schematic diagram is rotated by 180 °. However, the present invention is not limited to this, and the schematic diagram can be rotated by 90 ° or any other rotation angle. Even in such a case, the drawing data may be rotated at the set rotation angle together with the schematic diagram template data, and the text data may be moved to the rotated coordinate position by parallel movement. When the schema diagram is rotated at a predetermined angle other than 180 °, the leader line formed in the schema diagram can be re-created in accordance with the coordinate position of the moved text data.
Further, in the above embodiment, the medical information processing in the ophthalmology field has been described. However, the present invention is not limited to this, and the present invention is applicable to a case where the rotation angle between an image captured in the medical field and a created schema image does not match. Can be applied.
[0035]
【The invention's effect】
As described above, according to the present invention, it is possible to easily compare the created schematic diagram with the photographed affected part image (image).
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of a medical image processing system according to an embodiment.
FIG. 2 is a diagram showing a patient list display screen according to the embodiment.
FIG. 3 is a diagram showing a patient registration screen according to the embodiment.
FIG. 4 is a diagram showing an image capturing screen of a patient's eye in the present embodiment.
FIG. 5 is a diagram showing a screen for creating a shama diagram.
FIG. 6 is a diagram showing an image storage screen for displaying image data stored in a patient folder.
FIG. 7 is a diagram showing a screen for displaying a captured image and a schema diagram in parallel.
FIG. 8 is a diagram illustrating an image processing method when a schema diagram is rotated by 180 °.
FIG. 9 is a flowchart showing the flow of a processing method for rotating a schema diagram by 180 °.
FIG. 10 is a diagram showing a screen for displaying a captured image and a schema diagram rotated by 180 ° in parallel.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Personal computer 2 Operation control part 3 Information storage / reproduction part 5 Input part 10 Medical information processing software 15 Display 88a Fundus image 89a Schematic diagram 110 Cursor mark 120 Reverse button

Claims (4)

In a medical image processing system that processes medical image information with a computer, a display that displays a medical schematic diagram, writing means for writing drawing data and text data to the schema diagram displayed on the display, Instructing means for instructing an angle of rotation of an image to be displayed, and image processing means for performing coordinate conversion processing by rotating a schema diagram including the written drawing according to the rotation angle by the instructing means, wherein the text data is A medical image processing system comprising: an image processing unit that performs a coordinate conversion process of only translation without rotating. 2. The medical image processing system according to claim 1, wherein the image processing means performs a process of translating the text data to a coordinate at which the text data moves according to an instruction of the rotation angle. 2. The medical image processing system according to claim 1, further comprising: a capturing unit configured to capture a captured image of the affected part corresponding to the schematic diagram; and a display control unit configured to display the captured image on the same screen of the display together with the rotated schematic diagram. , A medical image processing system. In a medical image processing program for processing medical image information by a computer, means for displaying a medical schematic diagram on a display, and pasting means for writing and pasting drawing data and text data on the schema diagram displayed on the display Instruction means for instructing an angle of rotation of an image to be displayed on the display; and image processing means for performing coordinate conversion processing by rotating a schema diagram including the written drawing data in accordance with an instruction signal from the instruction means. A medical image processing program for causing a computer to execute an image processing means for performing a coordinate conversion process of only the parallel movement without rotating the text data.

Images