JP6968950B2 - Information processing equipment, information processing methods and programs - Google Patents

Description

Disclosure techniques relate to information processing devices, information processing methods and programs.

It is known that an image display area is divided into a plurality of areas and an image is displayed in each of the plurality of areas in order to display a plurality of images to be compared side by side. Further, in order to display an image in a plurality of areas, a thumbnail or an icon displayed on the display unit is dragged and dropped to each area. As a method of displaying an image in a desired area by a simple operation, a window for specifying the display position of the image is displayed near the dragged thumbnail, and the display position of the image is determined by the drop position on this window. Is known (Patent Document 1). According to this technology, it is not necessary to drag the thumbnail to the area where the image is actually displayed, and the image associated with the thumbnail can be easily displayed.

Japanese Patent No. 5362307

However, since the display position of the image is determined by the position where the thumbnail is dropped, there is a problem that the user is required to perform detailed operations. Further, the specification of how to divide the display area must be performed separately from the drag and drop operation, which is complicated.

The disclosed technique has been made in view of such a situation, and one of the purposes is to divide the display area and display an image at a desired position in the divided area by a simple operation.

Not limited to the above-mentioned purpose, it is also an action and effect derived by each configuration shown in the embodiment for carrying out the invention described later, and it is also another purpose of the present invention to exert an action and effect which cannot be obtained by the conventional technique. It can be positioned as one.

As one means for achieving the above object, the disclosed information processing apparatus divides the display area of the display unit into two minutes based on the direction of the flick operation or the drag operation with respect to the thumbnail or icon displayed on the display unit. divided into 1, a the split formed by the area in a region different from the position in the display unit ended the flick operation or the drag operation was the subject of the flick operation or the drag operation A mode that allows the display of the image associated with the thumbnail or the icon, and
The display area of the display unit is divided into quarters based on the direction of the flick operation or the drag operation with respect to the thumbnail or the icon displayed on the display unit, and the area is formed by the division. , Displaying an image associated with the thumbnail or icon that is the target of the flick operation or the drag operation in a region different from the position on the display unit where the flick operation or the drag operation is completed. It has a mode that allows it.

According to the disclosed technique, it is possible to divide a display area and display an image at a desired position in the divided area by a simple operation.

(A) is a figure which shows an example of the whole structure of the material display device. (B) is a diagram for explaining an example of the function of the material display device. It is a figure which shows an example of the screen composition of the document display device. It is a figure which shows an example of the display area selection UI. It is a figure which shows an example (left and right two divisions) of a document display area. It is a figure which shows an example (upper and lower two divisions) of a document display area. It is a figure which shows an example (up, down, left and right 4 divisions) of a document display area. It is a figure which shows an example of the flow (left and right two divisions) which selects a document display area. It is a figure which shows an example of the flow (up, down, left and right 4 divisions) which selects a document display area. It is a flowchart for demonstrating an example of a document display process. It is a flowchart for demonstrating an example of operation direction detection processing. It is a figure which shows the display example of the display area selection UI (material can be displayed only by dividing into two left and right). It is a figure which shows the display example of the display area selection UI (material can be displayed only by dividing into upper and lower parts). It is a figure which shows the display example of the display area selection UI (material can be displayed only on the right side). It is a figure which shows the display example of the display area selection UI (material can be displayed only on the lower side). It is a figure which shows an example of the display area selection UI.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings, based on its preferred embodiments. The configuration shown in the following embodiments is only an example, and the present invention is not limited to the following examples.

Further, in the following embodiment, a medical material display device that handles medical images and medical documents is used as an example, but the present invention can be applied to images and documents in fields other than medical treatment.

<Embodiment 1>
FIG. 1A shows the overall configuration of the material display device (information processing device) in the present embodiment. The document display device 1 includes a UI (User Interface) device 101, a CPU (Central Processing Unit) 102, a RAM (Random Access Memory) 103, a communication IF (Inter Face) 104, a UI display unit 105, a program storage area 106, and data. A storage area 107 is provided.

The UI device 101 is a device that accepts input from a user such as a doctor who operates the document display device 1 and outputs a signal corresponding to the operation of the user to the UI device 101. For example, the UI device 101 is composed of a mouse and / or a keyboard. Further, the UI device 101 may be configured by a touch sensor or the like that detects a position or the like touched by an object such as a finger on the display screen of the UI display unit 105. That is, the UI device 101 is used to input the user's instruction to the material display device 1.

The CPU 102 can perform various controls, calculations, and UI displays in the material display device 1 by interpreting and executing the program read from the program storage area 106 into the RAM 103 by the CPU 102. That is, when the CPU 102 executes the program, the material display device 1 functions as various means for executing each process shown in the flowchart described later. The functions realized by the CPU 102 executing the program will be described later with reference to FIG. 1 (b).

The RAM 103 is used as a working memory required for the operation of the CPU 102.

The communication IF 104 is connected to the in-hospital network, and is a communication interface used when acquiring materials from a PACS (Picture Archiving and Communication System) server, a file server, or the like in the hospital. That is, when the CPU 102 acquires a medical image such as an X-ray image from a PACS server or the like, the medical image is acquired via the communication IF 104.

The UI display unit 105 is an LED (Light Emitting Diode), a liquid crystal panel, or the like that displays the state of the device or the processing content.

Further, the material display device 1 includes a program storage area 106 and a data storage area 107. Specifically, the program storage area 106 and the data storage area 107 are realized by using a hard disk or a flash memory. For example, the program storage area is realized by a ROM (Read Only Memory), and the data storage area 107 is realized by an HDD (Hard Disk Drive). However, the program storage area 106 and the data storage area 107 are not limited to a specific storage medium.

In the material display device 1, for example, materials to be displayed on the UI display unit 105 such as images and documents are stored in the data storage area 107. The material to be displayed may be stored in a PACS server, a file server, or the like in the hospital, and the CPU 102 may acquire the material from various servers via the communication IF 104.

Next, an example of the function of the CPU 102 will be described with reference to FIG. 1 (b).

The CPU 102 functions as each means shown in FIG. 1 (b) by executing the program stored in the program storage area 106. Specifically, the CPU 103 functions as a detection means 112, a division means 122, a determination means 132, and a display control means 142.

The CPU 102 and the program storage area 106 included in the material display device 1 may be one or a plurality. That is, when at least one processing device (CPU) and at least one storage device (ROM) are connected, and at least one processing device executes a program stored in at least one storage device. The document display device 1 functions as each of the above means.

The detection means 112 detects an operation on the material display device 1 by the user. More specifically, the detection means 112 detects the operation direction of the flick operation and the drag operation performed by using the UI device 101 for an object such as a thumbnail or an icon displayed on the UI display unit 105. Here, the flick operation means that when the UI device 101 is composed of a touch sensor, the finger or the like is swiftly moved over a predetermined distance in a state where the touch sensor detects the contact of the finger or the like, and then the finger or the like is directly moved. Is an operation to separate from the touch sensor. That is, the flick operation is an operation of swiftly tracing the touch panel (touch sensor) as if it were flicked with a finger or the like. After detecting the touch-down, the detecting means 112 detects that the finger or the like has moved at a predetermined distance or more and at a predetermined speed or more, and then detects the touch-up as it is, and determines that the flick has been performed. That is, the detecting means 112 detects the flick operation based on the signal output from the UI device 101 depending on the presence or absence of contact with the UI device 101 such as a finger. The detecting means 112 can detect the direction of the flick operation based on the change in the output from the UI device 101 with the movement of the finger or the like. Further, the detection means 112 can detect that a long press has occurred when a signal indicating that a finger or the like is in contact with the UI device 101 is output from the UI device 101 for a predetermined time or longer. Note that touchdown means contact of a finger or the like with the touch panel, and touchup means that the finger or the like is released from the touch panel.

When the UI device 101 is composed of a mouse, the detection means detects drag based on the signal output from the UI device 101 by pressing a button provided on the mouse and the signal output from the UI device 101 by moving the mouse. do. Further, after the drag detection, the detection means 112 can detect the drop based on the signal output from the UI device 101 (or the stop of the signal by pressing the button) by releasing the pressing of the button provided on the mouse. Further, the detecting means 112 can detect the direction of the drag operation based on the signal output from the UI device 101 by moving the mouse. That is, the detection means 112 corresponds to an example of the detection means for detecting the operation direction of the flick operation or the drag operation on the object displayed on the display unit. The method of detecting the operation direction of the flick operation or the drag operation will be described later with reference to FIG.

The dividing means 122 divides an area (image display area) in which an image is displayed in the UI display unit 105 based on the detection result of the detecting means 112. Here, the image is an image associated with an object such as a thumbnail or an icon. Examples of images include X-ray images, CT images and the like. Specifically, the dividing means 122 divides the image display area in the UI display unit 105 based on the operation direction of the flick operation or the drag operation detected by the detecting means 112. For example, the method of dividing the image display area differs depending on the operation direction detected by the detection means 112. As an example, when the operation direction is the vertical direction, the dividing means 122 divides the image display area into two vertically. Further, for example, when the operation direction is the left-right direction, the dividing means 122 divides the image display area into two left and right. That is, the dividing means 122 corresponds to an example of the dividing means that divides the display area of the display unit into a plurality of areas based on the operation direction detected by the detecting means. The relationship between the operation direction and the method of division is not limited to the above example, and may be another relationship.

The determining means 132 determines in which area of the divided image display areas in the UI display unit 105 the image is displayed based on the detection result of the detecting means 112. Specifically, the determining means 132 determines the image display area on the UI display unit 105 based on the operation direction of the flick operation or the drag operation detected by the detecting means 112. That is, the determination means 132 determines the display position of the image in the image display area based on the operation direction detected by the detection means 112. That is, the determination means 132 corresponds to an example of the determination means for determining the region to display the image associated with the object among the plurality of regions based on the operation direction detected by the detection means. For example, the display position of the image in the image display area differs depending on the operation direction detected by the detection means 112. As an example, when the operation direction is upward, the upper area of the image display area divided into upper and lower parts by the dividing means 122 is determined as the image display position. Further, for example, when the operation direction is the left direction, the left area of the image display area divided into left and right by the dividing means 122 is determined as the image display position. The relationship between the operation direction and the display position of the image is not limited to the above example, and may be another relationship.

For example, when an image is already displayed in the image display area and the detection means 112 detects that the operation direction is the left direction, the display position of the already displayed image is moved to the left or right. It is on the right side of the divided image display area. Then, the determination means 132 determines the display position of the image corresponding to the object on which the flick operation or the like is performed as the left side of the image display area divided into two.

The display control means 142 causes the image to be displayed at the position determined by the determination means 132. Specifically, the display control means 142 controls the UI display unit 105 to display an image at a position determined by the determination means 132. That is, the display control means 142 corresponds to an example of the display control means for displaying the image associated with the object in the area determined by the determination means.

Further, the display control means 142 may cause the UI display unit 105 to display a line or a dotted line indicating the boundary of the area divided by the division means 122. The display control unit 142 reads the image associated with the object to be operated from the data storage area 107 and displays it on the UI display unit 105. That is, a table showing the correspondence between the object and the image is stored in the data storage area 107, and the display control means 142 can acquire the image corresponding to the object to be operated based on the table. It has become. Although the image is described as an example of the object to be associated with the object, document data such as an electronic medical record or a questionnaire may be associated with the object. Hereinafter, images and document data may be collectively referred to as materials.

Next, the configuration of the screen displayed on the UI display unit 105 of the material display device 1 will be described with reference to FIG. The UI displayed on the UI display unit 105 includes a material display space 11 including an object display area 10 and a material display area 12. Objects (symbol images) such as thumbnails or icons are displayed in a matrix in the object display area 10. Here, the symbol image includes a thumbnail representing the material, an image or an icon indicating the material name. Further, in the object display area 10, the vertical axis indicates the type of material, and the horizontal axis indicates the inspection date and time. Specifically, the vertical axis shows the type of the modality from which the image was acquired or the type of the document data. Further, the horizontal axis indicates the date and time when the image was taken or the date and time when the document data was created. The information indicated by the vertical axis and the horizontal axis is not limited to the form shown in FIG. 2, and may be reversed, for example. In this embodiment, the symbol images are displayed in a matrix, but a display form in which each material is simply displayed in a list may be used.

Inside the material display space 11 of FIG. 2, a material display area 12 exists. An image or document data associated with the symbol image is displayed in the document display area 11. Specifically, the display control means 142 displays the image or document data associated with the symbol image selected by the user using the UI device 101 in the material display area 12.

Next, an example of the UI used when displaying the material in the material display area 12 by flicking or the like will be described with reference to FIG. FIG. 3 shows the display area selection UI 14. The display area selection UI 14 is displayed by the display control means 142, for example, when an arbitrary symbol image 15 on the document list 10 is selected (pressed and held) for a predetermined time or longer by a user instruction 13 such as a finger or a mouse cursor. NS. The details of the display area selection UI 14 are shown in FIG. As shown in FIG. 15, the display area selection UI 14 shows a division pattern of the material display space 11 and where the material is displayed when the division pattern is selected. That is, the display area selection UI 14 is displayed for each operation direction by the display control means when the detection means detects that the object is selected by the user, and the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. It corresponds to an example of a display showing the division result of the area of the display unit by the division means when the operation is performed. In the example shown in FIG. 15, when the flick operation is performed in the vertical direction, the material display space 11 is divided into upper and lower parts. Further, when the flick operation is performed in the left-right direction, the material display space 11 is divided into two in the left-right direction. Further, it is shown that the material display space 11 is divided into four parts vertically and horizontally when the flick operation is performed in the diagonal direction. Further, the black circle in FIG. 15 indicates the display position of the material in the divided area. That is, this black circle corresponds to an example of a display indicating an area for displaying an image determined by the determining means when a flick operation or a drag operation is performed. For example, when the flick operation is performed in the upward direction, the material associated with the symbol image 15 that is the target of the flick operation is displayed in the upper area of the upper and lower divided areas.

In the example shown in FIG. 15, the area is divided corresponding to the flick operation in eight directions, but the region is not limited to this. For example, it may be a specification that does not correspond to a flick in an oblique direction but corresponds to a flick operation in four directions of up, down, left, and right. Further, in FIG. 15, the black circle indicates the display position of the material in the divided area, but this may not be displayed.

FIG. 4 shows the display screen of the UI display unit 105 after the flick operation is performed to the right from the state of FIG. Since the flick operation is performed in the right direction, the material display space 11 is divided into left and right two parts into the material display areas 12 (A) and 12 (B). Further, since the flick operation is performed in the right direction, the material associated with the symbol image 15 to be flicked is displayed in the right area among the areas divided into left and right. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flick direction in the divided area. In the example shown in FIG. 4, since new material is displayed in the right area of the area divided into left and right by the flick operation, the area other than the right area (that is, the left area) is displayed before the flick operation. The displayed material will be displayed.

FIG. 5 shows the display screen of the UI display unit 105 after the flick operation is performed downward from the state of FIG. Since the flick operation is performed downward, the material display space 11 is divided into upper and lower parts into upper and lower parts, 12 (C) and 12 (D). Further, since the flick operation is performed in the downward direction, the material associated with the symbol image 15 to be flicked is displayed in the lower area of the upper and lower divided areas. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flick direction in the divided area. In the example shown in FIG. 5, new material is displayed in the lower area of the upper and lower areas divided by the flick operation, so that the area other than the lower area (that is, the upper area) is displayed before the flick operation. The displayed material will be displayed.

FIG. 6 shows the display screen of the UI display unit 105 after the flick operation is performed in the lower left direction from the state of FIG. Since the flick operation is performed in the lower left direction, the material display space 11 is divided into four parts, up, down, left, and right, in the material display areas 12 (E) to 12 (H). Further, since the flick operation is performed in the lower left direction, the material associated with the symbol image 15 to be flicked is displayed in the lower left area among the areas divided into upper, lower, left, and right. The material already displayed in the material display space 11 at the stage of FIG. 3 is displayed in an area other than the display position determined based on the flick direction in the divided area. In the example shown in FIG. 5, new material is displayed in the lower left area of the area divided vertically and horizontally by the flick operation, so that the area other than the lower left area (for example, the upper left area) is before the flick operation. The materials displayed in will be displayed.

Next, the operation of the document display device 1 will be described with reference to the flowchart shown in FIG. Further, in explaining the flowchart shown in FIG. 9, FIGS. 7 and 8 showing an example of a display screen of the UI display unit 105 will be referred to.

First, in S100, the display control means 142 causes the UI display unit 105 to display a symbol image relating to a predetermined patient in a matrix. That is, in S100, the symbol image 15 is displayed in a matrix in the object area 10 of FIG. The predetermined patient is designated by inputting a patient ID or the like via the UI device 101. For example, the display control unit 142 searches the data storage area 107 for a material having the patient ID based on the input patient ID, and displays the material as the symbol image 15 in the object area 10.

Next, in S101, the detection means 112 determines whether or not an operation has been performed on the symbol image 15 via the UI device 101. If no operation has been performed on the symbol image 15, the determination of S101 is performed again. On the other hand, when the detecting means 112 detects an operation on the symbol image 15, the detecting means 112 determines whether the detected operation is a click operation or a tap operation. When the detection means 112 determines that the operation is a tap operation or a click operation, the display control means 142 acquires the material associated with the symbol image from the data storage area 107 and displays the material in the material display space 11. (S103). On the other hand, when the operation for the symbol image 15 detected by the detection means 112 is other than the tap operation and the click operation, the detection means 112 determines that the long press or flick operation has been performed. Then, in S104, the display control means 142 causes the UI display unit 105 to display the display area selection UI 14 as shown in FIG. Specifically, the display control means 142 displays the display area selection UI 14 centering on the symbol image 15 that is the target of the long press or flick operation. The display position of the display area selection UI 14 is not limited to the above, and may be displayed at another position. 7 (a) and 7 (b) show an example of the screen transition by S104. When the user presses and holds on the symbol image 15 as shown in FIG. 7A or FIG. 8A, the display control means 142 displays the display area selection UI 14 as shown in FIG. 7B or FIG. 8B. Will be done. Here, if the flick operation or the drag operation is performed before the detection means 112 determines that the press and hold is performed, the display control means 114 may display the display area selection UI 14 immediately after the detection of the flick operation or the like. Further, the display area selection UI 14 may not be displayed.

Next, in S105, the detection means 112 determines an operation direction such as a flick operation by the user. The determination of the operation direction, that is, the detection of the operation direction will be described in detail with reference to the flowchart of FIG.

When the operation direction detection process starts (S200), in S201, the detection means 112 sets the touch-down coordinate B and the touch-up coordinate E on the display area of the UI display unit 105 based on the output of the UI device 101. get. When a pointing device such as a mouse is used as the UI device, the coordinates of the mouse cursor position when the mouse button is pressed correspond to the coordinates touched down. In addition, the coordinates of the position of the mouse cursor when the mouse button is released correspond to the coordinates touched up.

The detection means 112 calculates the operation direction vector D as D ← E · B using the coordinates B and the coordinates E.

In S202, the detection means 112 determines whether the operation direction vector D calculated in S201 is 0 or equal to or less than a predetermined threshold value (sufficiently small). When it is determined that the operation direction vector D is 0 or equal to or less than a predetermined threshold value, the process proceeds to S203, the detection means 112 determines that the detection means is a click or a tap, and the process ends (S204). Here, for example, the processing of S102 is performed based on the determination result of S203.

If it is determined that the operation direction vector D is not 0 or not equal to or less than a predetermined threshold value, the process proceeds to S205. In S205, the detection means 112 calculates the angle θ [rad] formed by the operation direction vector D and the x-axis of the display area. Note that θ can be expressed as θ = atan2 (y, x) [where −π <θ≤π]. Here, the atan2 (y, x) function is an arctangent function that calculates the angle θ between the vector D (x, y) and the x-axis.

Next, in S206, the detection means 112 determines the operation direction such as a user's flick operation according to the range of θ, and ends the process (S207). Specifically, in S206, the detection means 112 determines that the operation direction is the lower left direction if − (7/8) π <θ ≦ − (5/8) π, and − (5/8) π <θ ≦. If − (3/8) π, it is determined to be in the downward direction, and if − (3/8) π <θ ≦ − (1/8) π, it is determined to be in the lower right direction. Further, the detection means 112 determines that the operation direction is the right direction if − (1/8) π <θ≤ (1/8) π, and (1/8) π <θ≤ (3/8) π. If, it is determined to be in the upper right direction, and if (3/8) π <θ≤ (5/8) π, it is determined to be in the upward direction. Further, the detection means 112 determines that the operation direction is the upper left direction if (5/8) π <θ≤ (7/8) π, and (7/8) π <θ≤π or −π <θ≤ If − (7/8) π, it is determined to be in the left direction.

Returning to the description of the flowchart of FIG. 9, the processing after S105 will be described.

If the operation direction is determined to be left or right in S105, the operation direction is determined to be S106, and if the operation direction is determined to be upward or downward, the operation direction is determined to be S107. If it is determined that this is the case, the process proceeds to S108. In S106, the dividing means 122 divides the material display space 11 into two left and right, and in S107, the dividing means 122 divides the material display space 11 into two vertically. Further, in S108, the dividing means 122 divides the material display space 11 into four parts vertically and horizontally.

When the operation direction is to the left, the process proceeds to S109 after S106, and in S109, the determination means 132 sets the display position of the material associated with the symbol image based on the operation direction with the material display area 12 (A) shown in FIG. decide. Then, the display control means 142 focuses on the material display area 12 (A). As an example of the focus, the frame of the area determined by the determination means 132 may be highlighted by displaying it in a color different from the frame of the other area. When the operation direction is to the right, the process proceeds to S110 after S106, and in S110, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (B). ). Then, the display control means 142 focuses on the material display area 12 (B).

When the operation direction is upward, the process proceeds to S111 after S107, and in S111, the determination means 132 sets the display position of the material associated with the symbol image based on the operation direction with the material display area 12 (C) shown in FIG. decide. Then, the display control means 142 focuses on the material display area 12 (C). Further, when the operation direction is downward, the process proceeds to S112 after S107, and in S112, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (D). ). Then, the display control means 142 focuses on the material display area 12 (D).

Further, when the operation direction is the upper left direction, the process proceeds to S113 after S108, and in S113, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (E). ). Then, the display control means 142 focuses on the material display area 12 (E). Further, when the operation direction is the lower left direction, the process proceeds to S114 after S108, and in S114, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (F). ). Then, the display control means 142 focuses on the material display area 12 (F). Further, when the operation direction is the upper right direction, the process proceeds to S115 after S108, and in S115, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (G). ). Then, the display control means 142 focuses on the material display area 12 (G). Further, when the operation direction is the lower right direction, the process proceeds to S116 after S108, and in S116, the determination means 132 indicates the display position of the material associated with the symbol image based on the operation direction in the material display area 12 (FIG. 6). H) is determined. Then, the display control means 142 focuses on the material display area 12 (H).

In S117, the display control means 142 acquires and displays the material associated with the symbol image in the area (focused area) determined in S109-116 from the data storage area 107. For example, when passing through S110, the display screen shown in FIG. 7C is displayed on the UI display unit 105. Further, when passing through S114, the display screen shown in FIG. 8C is displayed on the UI display unit 105. That is, the dividing means divides the area of the display unit into different modes for the plurality of different operating directions, and the determining means sets the area for displaying the image in the different plurality of operating directions as different areas. There is.

In order to make it easier for the user to recognize the flick direction when flicking, the portion corresponding to the flick direction on the display area selection UI 14 may be highlighted.

In the present embodiment, the display area selection UI 14 is used to present the user to the correspondence between the display area of the material and each operation direction, but the display area selection UI 14 may not be displayed. Also, instead of the visual UI, an auditory UI such as changing the tone of the operation sound according to the user's operation direction, and a tactile UI such as changing the vibration pattern according to the user's operation direction are used. You may use it. Further, in the above embodiment, the case of the flick operation has been mainly described, but the present invention is not limited to this, and may be applied to other operation methods such as a drag operation.

According to the above embodiment, the display area can be divided and the image can be displayed by one flick operation. That is, the display area can be divided and the image can be displayed at a desired position in the divided area by a simple operation. Therefore, it is possible to reduce the operation load of the user. Further, since the display area selection UI 14 shows the layout of the display area after flicking, it is possible to perform the flick operation after grasping the display form after flicking. Therefore, it is possible to prevent the display form from being different from the user's intention.

<Embodiment 2>
In the second embodiment, as shown in FIGS. 11 and 12, the display area selection UI 14 is changed to the display area selection UI 14 (a) and 14 (b) according to the screen size, and the display area selection UI 14 is divided into two left and right or top and bottom. It is also possible to make it possible to display only in two divisions.

As an example of limiting the display so that it can be displayed only in two divisions on the left and right as shown in FIG. 11, there is a case where the screen size is horizontally long and arranged vertically in two rows as shown in FIG. 11 to make it difficult to see. For example, the display control means 142 displays the display area selection UI 14 based on the aspect ratio of the display area including the object display area 10 and the material display space 11 displayed on the UI display unit 105 as the display area selection UI 14 (a). Change to. For example, the display control means 142 changes the display area selection UI 14 to the display area selection UI 14 (a) when the horizontal length is larger than a predetermined value with respect to the vertical length of the display area. That is, the display control means 142 displays the size of the display area of the display unit as the display showing the division result of the display area by the division means when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. Change based on. In the case of FIG. 11, even if the flick operation is performed in a direction other than the left-right direction, the region is not divided by the dividing means 122.

Further, as an example of limiting the display so that it can be displayed only by dividing it into upper and lower parts as shown in FIG. 12, there is a case where the screen size is vertically long and arranged in two rows horizontally as shown in FIG. 12, which makes it difficult to see. For example, the display control means 142 displays the display area selection UI 14 based on the aspect ratio of the display area including the object display area 10 and the material display space 11 displayed on the UI display unit 105 as the display area selection UI 14 (b). Change to. For example, the display control means 142 changes the display area selection UI 14 to the display area selection UI 14 (a) when the vertical length is larger than a predetermined value with respect to the horizontal length of the display area. In the case of FIG. 11, even if the flick operation is performed in a direction other than the vertical direction, the region is not divided by the dividing means 122.

According to the present embodiment, in addition to the effect in the first embodiment, the area can be divided according to the characteristics of the size of the display area. Therefore, it is possible to prevent the display from being difficult for the user to see when the image is displayed by dividing the area.

<Embodiment 3>
In the third embodiment, as shown in FIGS. 13 and 14, the display area selection UI 14 is changed to the display area selection UI 14 (c) or 14 (d) according to the attributes of the display target material. It is also possible to display the flick operation only on the right side or only on the lower side.

As an example of limiting the display so that it can be displayed only on the right side as shown in FIG. 13, for the purpose of preventing the material from being mistaken, the material of the patient of the currently displayed material and the material of another patient are displayed only on the right side. For example. Specifically, the display control means 142 acquires the patient identification information associated with the image currently displayed in the material display space 11 from the data storage area 107. Similarly, the display control means 142 also acquires the patient identification information of the material corresponding to the symbol image that is the target of the flick operation. Then, the display control means 142 compares the patient identification information of the material corresponding to the symbol image targeted for the flick operation with the patient identification information associated with the image currently displayed in the material display space 11. .. As a result of comparison, if they are different, the display control means 142 changes the display area selection UI 14 as shown in FIG. 13 (c). Normally, the information of the patient of interest is displayed on the left and the information of other patients for reference is often displayed on the right, so it is possible to prevent the user from feeling uncomfortable by doing the above. Become.

Another example is that materials with the latest inspection date and time are displayed only on the right side. Specifically, the display control means 142 acquires the shooting date and time associated with the image currently displayed in the material display space 11 from the data storage area 107. Similarly, the display control means 142 also acquires the shooting date and time of the material corresponding to the symbol image that is the target of the flick operation. Then, the display control means 142 compares the shooting date and time of the material corresponding to the symbol image targeted for the flick operation with the shooting date and time associated with the image currently displayed in the material display space 11. As a result of the comparison, if the shooting date and time of the material corresponding to the symbol image targeted for the flick operation is newer, the display control means 142 uses the display area selection UI 14 of the display area selection UI 14 (c) shown in FIG. To change. Normally, new materials are displayed on the right side, so it is possible to prevent the user from feeling uncomfortable by doing the above.

In the above example, the material corresponding to the symbol image targeted for the flick operation is displayed on the right side of the divided area, but the present invention is not limited to this, and the material is divided by the user. It may be displayed on the left side of the area.

Next, as an example of limiting the display so that it can be displayed only on the lower side as shown in FIG. 14, the image of the abdomen is displayed only on the lower side of the image of the chest, reflecting the actual positional relationship of the parts of the image. An example is to prevent it from being done. At this time, if the site is a DICOM image, it can be acquired from the Body Part Examined tag. As for the positional relationship between the parts, for example, information such as a table defined as head, chest, upper limbs, spine, abdomen, pelvis, and lower limbs is stored in the data storage area 107 in order from the top, and this is referred to. To do. Specifically, the display control means 142 acquires the part information associated with the image currently displayed in the material display space 11 from the data storage area 107. Similarly, the display control means 142 also acquires the part information of the material corresponding to the symbol image that is the target of the flick operation. Then, the display control means 142 uses the above table to determine the part of the material corresponding to the symbol image that is the target of the flick operation and the part associated with the image currently displayed in the material display space 11. compare. As a result of the comparison, the part of the material corresponding to the symbol image that is the target of the flick operation is located below the part associated with the image currently displayed in the material display space 11 due to the human body structure. In the case of a part, the following processing is performed. For example, the display control means 142 changes the display area selection UI 14 as shown in FIG. 14 as the display area selection UI 14 (d). In addition, the part of the material corresponding to the symbol image that is the target of the flick operation is located above the part associated with the image currently displayed in the material display space 11 due to the human body structure. In the case, the following processing is performed. For example, the display control means 142 may change the display area selection UI 14 to a UI for displaying the upper side of the divided area.

As described above, in the third embodiment, the display control means 142 displays on the object a display showing the division result of the area of the display unit by the division means when the flick operation or the drag operation is performed before the flick operation or the drag operation is performed. The change is made based on either the shooting date and time of the associated image, the shooting site, or the identification information that identifies the subject of the image.

As another example, the CT image may be displayed only under the simple X-ray by reflecting the general display order of the modality of the image.

According to this embodiment, in addition to the effect in the first embodiment, it is possible to provide a more intuitive display to the user.

<Other embodiments>
Although examples of embodiments have been described in detail above, the present invention can be implemented as, for example, a system, an apparatus, a method, a program, a recording medium (storage medium), or the like. Specifically, it may be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, an image pickup device, a web application, etc.), or may be applied to a device consisting of one device. good.

Needless to say, the object of the present invention is achieved by doing the following. That is, a recording medium (or storage medium) in which a program code (computer program) of software that realizes the functions of the above-described embodiment is recorded is supplied to the system or device. Needless to say, the storage medium is a computer-readable storage medium. Then, the computer (or CPU or MPU) of the system or device reads and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium realizes the function of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

1 Document display device 112 Detection means 122 Dividing means 132 Determining means 142 Display control means

Claims (8)

The display area of the display unit is divided into halves based on the direction of the flick operation or the drag operation with respect to the thumbnail or icon displayed on the display unit, and the area formed by the division is described above. the area different from the position in the display section ended flick operation or the drag operation, allows to display the image associated with the thumbnail or the icon was the subject of the flick operation or the drag operation Mode and
The display area of the display unit is divided into quarters based on the direction of the flick operation or the drag operation with respect to the thumbnail or the icon displayed on the display unit, and the area is formed by the division. , Displaying an image associated with the thumbnail or icon that is the target of the flick operation or the drag operation in a region different from the position on the display unit where the flick operation or the drag operation is completed. An information processing device with an acceptable mode. The position according to claim 1, wherein the position where the image associated with the thumbnail or the icon is displayed is determined based on the direction of the flick operation or the drag operation with respect to the thumbnail or the icon. Information processing device. The position where the image associated with the thumbnail or the icon is displayed is the direction vector of the flick operation or the direction of the drag operation regardless of the position in the display unit where the thumbnail or the icon is displayed. The information processing apparatus according to claim 2, wherein the information processing apparatus is determined only based on a vector. Before Flick Misao Sakuma et drag operation is completed, according to claim 2, wherein the information indicating the division result of the display area, wherein the display according to the direction of direction or the drag operation of the flick operation Or the information processing apparatus according to 3. When the flick operation or the drag operation is performed on the thumbnail or the icon, the image associated with the thumbnail or the icon targeted by the flick operation or the drag operation is displayed on the display unit. The feature is that the image associated with the thumbnail or icon that is the target of the flick operation or the drag operation is focused on the area displayed on the display unit and displayed on the display unit. The information processing apparatus according to claim 4. When the first image is already displayed on the display unit, a flick operation or a drag operation is performed on the thumbnail or icon displayed on the display unit, which is not associated with the first image. If you get it,
Areas that are divided based on the direction of the flick operation or the drag operation and are determined based on the direction are associated with the thumbnail or icon that is the target of the flick operation or the drag operation. Display the image that is
An area divided based on the direction of the flick operation or the drag operation, and an area in which an image associated with the thumbnail or icon targeted by the previous flick operation or the drag operation is displayed. The information processing apparatus according to any one of claims 2 to 5, wherein the information processing apparatus indicating the first image is displayed in different regions. The display area of the display unit is divided into halves based on the direction of the flick operation or the drag operation direction for the thumbnail or icon displayed on the display unit, and the area formed by the division is the flick. operation or the area different from the position at the end with said display portion of the drag operation, allows to display the image associated with the thumbnail or the icon was the subject of the flick operation or the drag operation Mode and
The display area of the display unit is divided into quarters based on the direction of the flick operation or the drag operation with respect to the thumbnail or icon displayed on the display unit, and the area formed by the division . in a region different from the position in the display unit ended the flick operation or the drag operation, that display the image associated with the thumbnail or the icon was the subject of the flick operation or the drag operation An information processing method that includes an acceptable mode. A program that causes a computer to execute the information processing method according to claim 7.

Images