JP2022063129A - Processor device and operation method thereof - Google Patents

Abstract

To provide a processor device and a method of operating the processor device in which the screen can be easily seen regardless of the size of the display, when the position information of the lesion found during examination and information other than medical images such as the position information in the body of the endoscope are displayed, in addition to the medical image.SOLUTION: A processor device installed in a medical device and connected to a display acquires output performance information including at least one of the inch size, resolution, and aspect ratio of the display, determines the number and type of a sub screen on the basis of the output performance information, and generates an inspection image display screen including a main screen for displaying an inspection image and a sub screen for displaying information other than the inspection image.SELECTED DRAWING: Figure 24

Description

The present invention relates to a processor device for displaying a screen according to the output performance of the output device and a method for operating the processor device.

In recent years, with the technological innovation of monitors and displays, the definition of output devices has been increasing. Furthermore, in the medical field where high-definition images input from medical devices such as endoscopes are advancing due to technological advances in such output devices, output is performed in accordance with the high-definition images input. Technology is being developed that allows the display method to be selected on the device side as well.

In Patent Document 1, a technique for displaying a medical image by selecting a display method template according to the resolution of the medical image input to the processor device from a plurality of display method templates according to the resolution and aspect ratio of the output device. Is described.

Japanese Unexamined Patent Publication No. 2009-11257

In recent years, in addition to increasing the definition of output devices, the screen size has been increasing. For this reason, there are increasing cases where more information is displayed on the output device. However, in the medical field, the appropriate inch size of the output device and the information displayed will vary depending on the environment in which it is used.

For example, the display used in a large endoscopy room and the display used outside the operating room for multiple doctors to observe surgery are relatively large inch-sized displays that can be hung on the wall. Is selected and a lot of information is displayed. In this case, for example, in addition to the medical image acquired by the endoscope, information other than the medical image such as the position information of the lesion found during the examination and the position information in the body of the endoscope is included in the medical image. In addition, it is displayed.

On the other hand, displays installed in carts for carrying medical equipment and displays used in small hospitals are relatively small inch-sized due to the load capacity of the cart and the narrowness of the endoscope room. Is selected. When displaying a lot of other information in addition to high-definition medical images such as 4K on a small-sized display, the screen displaying each information becomes too small and it becomes hard to see. Further, even on a large-sized display, displaying an excessive amount of information makes the screen rather complicated and makes it difficult to see.

The present invention is concerned with the size of the display when displaying information other than the medical image such as the position information of the lesion found during the examination and the position information in the body of the endoscope in addition to the medical image. Instead, it is an object of the present invention to provide a processor device capable of making the screen easy to see and a method of operating the processor device.

The processor device of the present invention is a processor device connected to a display and including a processor, and the processor acquires an inspection image and displays a main screen for displaying the inspection image and a screen different from the main screen, and the main screen is displayed. Generates an inspection image display screen with a sub-screen that is displayed at a different position from the above, and acquires output performance information that includes at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen. However, it is a processor device that determines the number and type of sub-screens based on the output performance information.

The type of the sub screen preferably includes at least one or more of the still image related to the inspection image, the position information of the region of interest, the insertion shape image, the treatment tool appearance position information, and the incidental character information. The incidental character information preferably includes at least one or more of the patient information, the surgeon information, and the switch assignment information.

When the processor acquires only inch size as output performance information, the first inch size is larger than the second inch size, the display is the second inch size, and the display is the first inch size. It is preferable to reduce the number of sub-screens. The processor acquires only the resolution as output performance information, and when the first resolution is higher than the second resolution and the display is the second resolution, the sub-screen is larger than when the display is the first resolution. It is preferable to reduce the number. The processor obtains inch size and resolution as output performance information, and when the first inch size is larger than the second inch size and the first resolution is higher than the second resolution, the output performance information is the second. If the output performance information includes the 1-inch size and the 2nd resolution, the 2nd inch size and the 1st resolution, or the 2nd inch size and the 2nd resolution, the output performance information includes the 1st resolution and the 1st resolution. It is preferable to reduce the number of sub-screens as compared to the case where the 1-inch size is included.

When the processor displays a still image related to the inspection image on the sub screen, the first inch size is larger than the second inch size and the first resolution is higher than the second resolution, and the output performance information is displayed. The output performance information includes the first resolution when the first inch size and the second resolution are included, when the second inch size and the first resolution are included, or when the second inch size and the second resolution are included. And it is preferable to reduce the number of still images displayed on the sub screen as compared with the case where the first inch size is included.

The processor calculates the standard output condition based on the inspection image, and if the inch size of the display is smaller than the standard output condition, it is preferable to reduce the number of sub-screens. The processor preferably sets an upper limit on the number of subscreens. The processor preferably determines the type of subscreen according to the subscreen display priority. It is preferable that the sub screen display priority can be set. In the inspection image display screen, it is preferable that the arrangement of the sub screens can be changed. It is preferable that the processor determines the font size on the inspection image display screen based on the output performance information. It is preferable that the processor can select whether to display the incidental character information on a part other than the inspection image on the main screen or on the sub screen.

The method of operating the processor device of the present invention is connected to a display, and in the method of operating the processor device including the processor, the processor acquires an inspection image and displays a main screen for displaying the inspection image and a screen different from the main screen. An output that includes at least one of the inch size, resolution, and aspect ratio of a display that generates an inspection image display screen with a sub-screen that is displayed in a different position than the main screen and displays the inspection image display screen. Acquire performance information and determine the number and type of sub-screens based on the output performance information.

According to the present invention, in addition to the medical image, the size of the display is used when displaying information other than the medical image such as the position information of the lesion found during the examination and the position information in the body of the endoscope. Regardless of the above, it is possible to provide a processor device that can make the screen easy to see and a method of operating the processor device.

It is a block diagram which shows the endoscope system including an endoscope, a light source device, a processor device, a first display, and a UI. It is a block diagram which shows the detailed functional relation of a processor and a 1st display. It is a block diagram which shows the endoscope system including an endoscope, a light source device, a processor device, a second display, and a UI. It is a block diagram which shows the function of the number setting part of the sub-screen in the display setting part, the type setting part of a sub-screen, and the layout setting part. It is a table which shows the number setting table of a subscreen when the output performance information is only an inch size. It is a table which shows the number setting table of the number of subscreens when the output performance information is only a resolution. It is a table which shows the number setting table of the sub-screen when the output performance information is inch size and resolution. It is a block diagram which shows the output performance information acquisition part when the standard output condition calculation part is provided. It is a table which shows the specific example which determines the number of subscreens when calculating a standard output condition. It is a table which shows the still image display number setting table. It is an image diagram which shows the sub-screen display priority setting table displayed on the sub-screen display priority setting screen. It is an image diagram which shows the 1st layout setting screen. It is an image diagram which shows the template of the layout which the screen is divided into two on the left and right. It is an image diagram which shows the template of the layout which the screen is divided into two in the upper and lower parts. It is an image diagram which shows the template of the layout which the screen is divided into 2 on the left and right, and the screen on the right is further divided into 2 on the top and bottom. It is an image diagram which shows the template of the layout which the screen is divided into 3 in the vertical direction. Number of sub-screens When the number of sub-screens determined by the setting unit is 3, the lower screen of the screen that is further divided into two horizontally and the right side of the screen divided into two left and right is divided into two vertically. It is an image diagram which shows the template of a layout. Number of sub screens When the number of sub screens determined by the setting unit is 3, the layout is such that the right side of the screen divided into two left and right is further divided into two horizontally and the upper screen of the screen is divided vertically into two. It is an image diagram which shows the template of. Number of sub-screens When the number of sub-screens determined by the setting unit is 4, the layout is such that the right side of the screen divided into two left and right is further divided into three horizontally and the center screen of the screen is divided vertically into two. It is an image diagram which shows the template of. Number of sub-screens When the number of sub-screens determined by the setting unit is 4, the lower screen of the screen that is further divided into two horizontally and the right side of the screen divided into two left and right is divided into three vertically. It is an image diagram which shows the template of a layout. It is an image diagram which shows the layout creation screen when one layout section is newly created. It is an image diagram which shows the layout creation screen when four layout sections are newly created. It is an image diagram which shows the 2nd layout setting screen. It is an image diagram which shows the inspection image display screen when the number of sub-screens is four. It is an image diagram which shows the inspection image display screen when the number of sub-screens is 2. It is a flowchart explaining the function of the processor apparatus in 1st Embodiment. FIG. 3 is a block diagram showing an ultrasonic imaging system including an ultrasonic probe, a processor device, a first display, and a UI. FIG. 3 is a block diagram showing an ultrasonic imaging system including an ultrasonic probe, a processor device, a second display, and a UI. It is a flowchart explaining the function of the processor apparatus in 2nd Embodiment. It is a block diagram which shows the radiation imaging system which comprises the radiation imaging apparatus, the radiation irradiation apparatus, the processor apparatus, the first display and UI. It is a block diagram which shows the radiation imaging system which comprises the radiation imaging apparatus, the radiation irradiation apparatus, the processor apparatus, the second display and UI. FIG. 3 is a block diagram showing a radiation imaging system including an electronic cassette, a radiation irradiation device, a processor device, a first display, and a UI. It is a flowchart explaining the function of the processor apparatus in 3rd Embodiment.

[First Embodiment]
In the first embodiment, the case where the processor device 20 is provided in the endoscope system 10 will be described.

As shown in FIG. 1, the endoscope system 10 includes an endoscope 12, a light source device 13, a processor device 20, a first display 21, and a UI (User InterFace) 23. The endoscope 12 is connected to the light source device 13 and is connected to the processor device 20. The processor device 20 is connected to the first display 21 and the UI 23.

The first display 21 outputs and displays an inspection image display screen described later. The UI 23 has a keyboard, a mouse, a touch pad, a microphone, and the like, and has a function of accepting input operations such as function settings.

The endoscope 12 obtains a normal light image having a natural hue by illuminating the observation target with normal light such as white light and taking an image. Further, the endoscope 12 illuminates the observation target with special light having a wavelength band different from that of normal light and takes an image to obtain a special light image in which a specific structure is emphasized. In the first embodiment, the term "inspection image" simply refers to an endoscopic image, a normal optical image and / or a special optical image.

The light source device 13 includes a light source unit. The light source unit has a plurality of semiconductor light sources, each of which is turned on or off, and when the light source unit is turned on, the light emission amount of each semiconductor light source is controlled to emit illumination light for illuminating the observation target.

The processor device 20 receives information from an output device such as the first display 21 and generates an inspection image display screen including a main screen that mainly displays an inspection image and a sub screen that mainly displays information other than the inspection image. , Display the inspection image display screen on the output device.

As shown in FIG. 2, the processor device 20 includes an inspection image acquisition unit 14, a position information acquisition unit 15, a still image acquisition unit 16, an insertion state acquisition unit 17, a treatment tool appearance position information acquisition unit 18, a central control unit 30, and output performance. It has an information acquisition unit 40, a display setting unit 50, and a display screen generation unit 60.

In the processor device 20, the central control unit 30 configured by the image control processor operates the program in the program memory, so that the inspection image acquisition unit 14, the position information acquisition unit 15, and the still image acquisition unit 16 are operated. The functions of the insertion state acquisition unit 17, the treatment tool appearance position information acquisition unit 18, the output performance information acquisition unit 40, the display setting unit 50, and the display screen generation unit 60 are realized.

The inspection image acquisition unit 14 performs image processing on the inspection image which is an image signal acquired by the endoscope 12. The inspection image is displayed on the main screen of the inspection image display screen. The display setting unit 50, which will be described later, may display the inspection image on the main screen and the sub screen. In this case, for example, the normal light image is displayed on the main screen and the special light image is displayed on the sub screen. The inspection image acquisition unit 14 transmits the inspection image to the display setting unit 50.

The position information acquisition unit 15 acquires the position information of the region of interest. The region of interest is an region having a feature amount within a specific range such as a lesion found in an examination image. Specifically, the detection position of the tip of the endoscope at the time when the inspection image in which the region of interest is detected is obtained is acquired as the position information of the region of interest. The position information acquisition unit 15 transmits the position information of the region of interest to the display setting unit 50.

The still image acquisition unit 16 acquires a still image to be observed when a signal related to a still image acquisition instruction is transmitted. The still image acquisition unit 16 transmits the still image to the display setting unit 50.

The insertion state acquisition unit 17 acquires the insertion state information of the endoscope 12 being inserted into the lumen. Specifically, the insertion state information is acquired based on the insertion length of the endoscope insertion portion into the lumen. Further, the inserted shape information is converted into an inserted shape image and displayed by the display screen generation unit 60, which will be described later. The insertion state acquisition unit 17 transmits the insertion state information to the display setting unit 50.

The treatment tool appearance position information acquisition unit 18 acquires the treatment tool appearance position information which is information predicting at which position in the inspection image the treatment tool used in the endoscopic surgery appears. The treatment tool appearance position information acquisition unit 18 transmits the treatment tool appearance position information to the display setting unit 50.

The display setting unit 50 has acquired the inspection image acquired by the inspection image acquisition unit 14, the position information of the region of interest acquired by the position information acquisition unit 15, the still image acquired by the still image acquisition unit 16, and the insertion state acquisition unit 17. At least one or more of the insertion state information, the treatment tool appearance position information acquired by the treatment tool appearance position information acquisition unit 18, and the incidental character information is acquired. The information acquired by the display setting unit 50 is not limited to this.

As the incidental character information, the display setting unit 50 acquires at least one or more of the patient information, the surgeon information, and the switch assignment information.

Patient information includes, but is not limited to, the patient number, name, age, date of birth, gender, etc. of the patient undergoing examination or surgery. The surgeon information is information such as a doctor's number and a name of a doctor who performs an examination or an operation. The switch assignment information is information in which the operation of a medical device such as an endoscope 12 is assigned to the UI 23. For example, it is information related to the function of the switch attached to the endoscope 12, such as an instruction to acquire a still image to the switch 1, switching between normal light and special light to the switch 2, and assigning a screen zoom function to the switch 3. The incidental character information is not limited to the above. In addition, the incidental character information may be acquired from an external device such as patient information or a system for managing the surgeon.

The display setting unit 50 includes an inspection image acquisition unit 14, a position information acquisition unit 15, a still image acquisition unit 16, an insertion state acquisition unit 17, and a treatment tool appearance position information acquisition unit 18, which includes a main screen and a sub screen. Settings for generating an inspection image display screen are made from the information displayed on the image display screen and the output performance information received from the output performance information acquisition unit 40.

The output performance information acquisition unit 40 acquires the output performance information of the output device. The output device is the first display 21 in the example of FIG. 1, but as shown in FIG. 3, the output device may be a second display 22 having an inch size and / or a resolution (unit: pixel) different from that of the first display 21.

The difference between the first display 21 and the second display 22 is, for example, as follows. The first display 21 has a large inch size and is used in a scene where a plurality of doctors or the like observe surgery outside a large endoscope room or operating room. On the other hand, the second display 22 has a small inch size and is used by being installed in a cart on which medical equipment is carried.

The output performance information is the inch size, resolution, aspect ratio, etc. of the display connected to the processor device 20 as the output device. The output performance information acquisition unit 40 acquires information of at least one of the inch size, resolution, and aspect ratio of the display. The output performance information acquisition unit 40 transmits the output performance information to the display setting unit 50. In the present embodiment, as a specific example, a case where the first display 21 (FIG. 1) or the second display 22 (FIG. 3) is connected to the processor device will be described.

As shown in FIG. 4, the display setting unit 50 includes a sub-screen number setting unit 51, a sub-screen type setting unit 52, and a layout setting unit 53.

The number setting unit 51 of the sub screens determines the number and types of sub screens based on the output performance information. The function of the number setting unit 51 of the sub screen will be described below with specific examples.

When the output performance information acquired by the output performance information acquisition unit 40 is only inch size, the number of sub screens is determined based only on the inch size by referring to the number setting table of the sub screens as shown in FIG. Determine the number of.

A specific example will be described. The inch size of the first display 21 is defined as the first inch size, and the inch size of the second display 22 is defined as the second inch size. Further, the first inch size is larger than the second inch size, for example, the first inch size is 50 inches and the second inch size is 24 inches. When the output performance information acquired by the output performance information acquisition unit 40 is the first inch size, refer to the number setting table of the sub screens shown in FIG. 5, set the number of sub screens to 4, and display this information in the display screen generation unit. Send to 60.

On the other hand, when the output performance information acquired by the output performance information acquisition unit 40 is the second inch size, the number setting table of the sub screens shown in FIG. 5 is referred to, the number of sub screens is set to 2, and this information is displayed on the display screen. It is transmitted to the generation unit 60.

With the above configuration, the number of sub-screens can be determined according to the inch size of the display. When the display connected to the processor device 20 is small as in the above specific example, it is possible to reduce the number of sub-screens that are information other than inspection images and present a screen with higher visibility to the user. can.

If you want to reduce the number of sub screens, also reduce the types of sub screens. When the number of sub screens is reduced, it is preferable to reduce the types of sub screens according to the sub screen display priority described later.

Another example will be described. When the output performance information acquired by the output performance information acquisition unit 40 is only the resolution, the number of sub screens is determined based only on the resolution by referring to the number setting table of the sub screens as shown in FIG. To determine.

A specific example will be described. The resolution of the first display 21 is the first resolution, and the resolution of the second display 22 is the second resolution. Further, the first resolution is higher than the second resolution, for example, the first resolution is 3840 × 2160 and the second resolution is 720 × 480. When the output performance information acquired by the output performance information acquisition unit 40 has the first resolution, the number of sub screens shown in FIG. 6 is referred to, the number of sub screens is set to 4, and this information is displayed in the display screen generation unit 60. Send to.

On the other hand, when the output performance information acquired by the output performance information acquisition unit 40 has the second resolution, the number setting table of the sub screens shown in FIG. 6 is referred to, the number of sub screens is set to 2, and this information is generated as a display screen. It is transmitted to the unit 60.

With the above configuration, the number of sub screens can be determined according to the resolution of the display. When the resolution of the display connected to the processor device 20 is small as in the above specific example, the number of sub-screens that are information other than the inspection image should be reduced, and a screen with higher visibility should be presented to the user. Can be done.

Another example will be described. When the output performance information acquired by the output performance information acquisition unit 40 is inch size and resolution, the number of sub screens is determined based on the inch size and resolution by referring to the number setting table of sub screens as shown in FIG. Determine the number of sub-screens.

A specific example will be described. For example, the first inch size is 50 inches, the second inch size is 24 inches, the first resolution is 3840 × 2160, and the second resolution is 720 × 480. When the output performance information of the first display 21 or the second display 22 is the first inch size and the first resolution, the number of sub screens is set to 4 by referring to the number setting table of the sub screens shown in FIG. This information is transmitted to the display screen generation unit 60.

On the other hand, when the output performance information of the first display 21 or the second display 22 is the first inch size and the second resolution, the second inch size and the first resolution, or the second. In any case of inch size and second resolution, the number of sub screens shown in FIG. 7 is referred to, the number of sub screens is set to 2, and this information is displayed in the display screen generation unit 60. Send to.

With the above configuration, the number of sub-screens can be determined by the combination of inch size and resolution of the display. When the inch size or resolution of the display connected to the processor device 20 is small as in the above specific example, the number of sub-screens that are information other than the inspection image is reduced to provide a screen with higher visibility for the user. Can be presented. Further, when the inch size of the display is large and the resolution is low, displaying many low-resolution sub-screens hinders the user's visibility. In this case, it is preferable to reduce the number of sub-screens. Further, the aspect ratio of the output device may be acquired and the number of sub screens may be changed.

Further, the number setting unit 51 of the sub screen may set an upper limit on the number of sub screens. This limit may be set automatically or by the user. With the above configuration, when the inch size or resolution of the display connected to the processor device 20 is large, the number of sub screens does not become too large, thereby preventing the screen from becoming complicated and aimed at the user. It is possible to present a screen with higher visibility.

As shown in FIG. 8, the output performance information acquisition unit 40 is provided with a standard output condition calculation unit 40a, and the inspection image acquired by the inspection image acquisition unit 14 is transmitted to the output performance information acquisition unit 40 to obtain the resolution of the inspection image. The standard output condition may be calculated based on the above, and the number of sub-screens according to the standard output condition may be set in advance. In this case, when the inch size of the display connected to the processor device 20 is smaller than the standard output condition, it is preferable to reduce the number of sub screens rather than the number of sub screens determined based on the standard output condition. When the inch size of the display is larger than the standard output condition, the number of sub screens may be increased from the number of sub screens determined based on the standard output condition.

A specific example of determining the number of sub-screens when calculating the standard output condition is shown. For example, when the resolution of the inspection image is 1920 × 1080, the standard output condition calculation unit 40a calculates the standard output condition as an inch size of 30 to 40 inches. At this time, the number of sub screens when the display is within the range of the standard output condition is set to 4. When the number of sub-screens is determined based on the standard output condition in this way and the output performance information acquisition unit 40 acquires the inch size of the display, the table as shown in FIG. 9 is referred to.

For example, when the inch size of the display is 40 inches, the number of sub screens is not changed and is set to 4. On the other hand, when the inch size of the display is 20 inches, the number of sub screens is reduced to 2. If the inch size of the display is 50 inches, the number of sub screens is increased to 5. When the number of sub screens is determined in this way, information on the number of sub screens is transmitted to the display screen generation unit 60. The standard output condition may be set automatically or may be set by the user. With the above configuration, the number of sub-screens can be determined by the inch size of the display according to specific standard output conditions.

When the display setting unit 50 acquires the still image, the still image is displayed on the sub screen. In this case, the number setting unit 51 of the sub screen may determine the number of still images to be displayed on the sub screen.

For example, when the output performance information acquired by the output performance information acquisition unit 40 is inch size and resolution, it is displayed on the sub screen with reference to the still image display number setting table as shown in FIG. 10 based on the inch size and resolution. Determine the number of still images to do.

A specific example will be described. For example, the first inch size is 50 inches, the second inch size is 24 inches, the first resolution is 3840 × 2160, and the second resolution is 720 × 480. When the output performance information of the first display 21 or the second display 22 is the first inch size and the first resolution, the still image display number setting table shown in FIG. 10 is referred to, and the still image is displayed on the sub screen. The number of images is set to 4, and this information is transmitted to the display screen generation unit 60.

On the other hand, when the output performance information of the first display 21 or the second display 22 is the first inch size and the second resolution, the second inch size and the first resolution, or the second. In any case of inch size and second resolution, refer to the still image display number setting table shown in FIG. 10, set the number of still images to be displayed on the sub screen to 2, and use this information. It is transmitted to the display screen generation unit 60. With the above configuration, the number of still images to be displayed on the sub screen can be determined by the combination of the inch size and the resolution of the display. When the inch size or resolution of the display connected to the processor device 20 is small as in the above specific example, the number of still images displayed on the sub screen is reduced to present a screen with higher visibility to the user. can do.

The type of the sub screen to be displayed on the inspection image display screen is determined by the sub screen type setting unit 52 of the display setting unit 50 according to the information acquired by the display setting unit 50 and the sub screen display priority. Specifically, the information acquired by the display setting unit 50 is displayed as a sub screen according to the sub screen display priority setting table of the sub screen display priority setting screen 52a as shown in FIG.

The user can select in advance the type of the sub screen to be displayed on the sub screen in the sub screen display priority setting table of the sub screen display priority setting screen 52a as shown in FIG. The information or image (type of sub-screen) related to the type of sub-screen that can be selected is at least one of the still image related to the inspection image, the position information of the region of interest, the inserted shape image, the treatment tool appearance position information, and the incidental character information. The above is the above, and the present invention is not limited to this.

In the sub-screen display priority setting table, the type of sub-screen to be displayed with priority can be replaced by, for example, selecting and moving the hamburger icon (three-line icon) 52b. The method of changing the sub screen display priority is not limited to this. For example, you may set up a form to enter the priority next to the item. With the above configuration, the type of sub screen can be determined. By setting the priority of the type of sub screen to be displayed on the sub screen, the user can select the item of the sub screen that he / she wants to display with priority.

The layout of the sub screen to be displayed on the inspection image display screen is determined by the layout set by the user in the layout setting unit 53 of the display setting unit 50.

Specifically, first, the main / sub screen layout allocation setting button 53b according to the number of sub screens is selected from the first layout setting screen 53a as shown in FIG. 12, and the layout as shown in FIGS. 13 to 20 is selected. The main / sub screen layout assignment screen that presents the template of is displayed, and the user can set in which position of each section the main screen and the sub screen are displayed on the layout template. In addition, it is possible to set the position to display the sub screen having a high sub screen display priority.

The display setting unit 50 sets the display of the inspection image display screen according to the number of sub screens determined by the number setting unit 51 of the sub screen and the main / sub screen layout allocation setting preset by the user, and sets the display setting. Such information is transmitted to the display screen generation unit 60.

Hereinafter, a specific example of the main / sub screen layout allocation setting using the layout template will be described.

Number of sub screens When the number of sub screens determined by the setting unit is 1, the layout template shown in FIG. 13 or FIG. 14 is displayed on the main / sub screen layout allocation screen.

FIG. 13 is a layout template in which the screen is divided into two parts on the left and right. Here, the left section is referred to as the layout first section 53e, and the right section is referred to as the layout second section 53f. In this case, it is possible to select whether the layout first section 53e or the layout second section 53f is the main screen or the sub screen. In the specific example of FIG. 13, the layout first section 53e is used as the main screen, and the layout second section 53f is used as the sub screen.

In the specific example of FIG. 13, the screen is evenly divided on the left and right, but the size of the layout first section 53e and the layout second section 53f is, for example, the screen that divides the sections on the layout template. It can be set arbitrarily by selecting and moving it above. The change in the size of the section on the layout template is also common to the following specific examples.

Further, it is preferable that the size of the sub screen to be displayed can be set to be constant even if the sub screen is changed. For example, when the same type of sub-screen is displayed on the first display 21 and the second display 22 having different inch sizes, the sub-screens of the same type are made to have the same size even if the number of sub-screens is changed. It may be set.

FIG. 14 is a template of a layout in which the screen is divided into upper and lower parts. Here, the upper section is referred to as the layout first section 53e, and the lower section is referred to as the layout second section 53f. Also in this case, it is possible to select whether the layout first section 53e or the layout second section 53f is the main screen or the sub screen. In the specific example of FIG. 14, the layout first section 53e is used as the main screen, and the layout second section 53f is used as the sub screen.

Number of sub screens When the number of sub screens determined by the setting unit 51 is 2, the layout template as shown in FIGS. 15 and 16 is displayed on the main / sub screen layout allocation screen.

FIG. 15 is a layout template in which the screen is divided into two left and right, and the screen on the right side is further divided into two vertically. Here, the left section is the layout first section 53e, the upper right section is the layout second section 53f, and the lower right section is the layout third section 53g. In this case, it is possible to select which of the layout first section 53e, the layout second section 53f, and the layout third section 53g is used as the main screen or the sub screen. In the specific example of FIG. 15, the layout first section 53e is the main screen, the layout second section 53f is the sub screen (sub screen 1) that displays the items of the sub screen having the highest display priority, and the layout third section 53g. Is a sub screen (sub screen 2) that displays the items of the sub screen having the second highest sub screen display priority.

FIG. 16 is a layout template in which the screen is vertically divided into three parts. Here, from the left side, the layout first section 53e, the layout second section 53f, and the layout third section 53g are used. The layout first section 53e occupies twice the area of the layout second section 53f and the layout third section 53g. Also in this case, it is possible to select which of the layout first section 53e, the layout second section 53f, and the layout third section 53g is used as the main screen or the sub screen. In the specific example of FIG. 16, the layout first section 53e is the main screen, the layout second section 53f is the sub screen (sub screen 1) that displays the items of the sub screen having the highest display priority, and the layout third section 53g. Is a sub screen (sub screen 2) that displays the items of the sub screen having the second highest sub screen display priority.

The method of dividing the layout first section 53e, the layout second section 53f, and the layout third section 53g is not limited to this. For example, the layout template of FIG. 15 or FIG. 16 may be divided horizontally inverted. Further, when the output performance information includes the aspect ratio, a recommended template may be presented to the user.

Further, even when the number of layout sections increases, the layout setting unit 53 may automatically create a layout template and display it on the main / sub screen layout allocation screen.

For example, when the number of sub-screens determined by the number setting unit of the sub-screens is 3, the layout first section 53e, the layout second section 53f, the layout third section 53g, and the layout fourth as shown in FIGS. 17 and 18. A layout template containing the section 53h is displayed.

Number of sub-screens When the number of sub-screens determined by the setting unit 51 is 4, the layout includes the first layout section 53e, the layout second section 53f, the layout third section 53g, the layout fourth section 53h, and the layout fifth section 53i. Templates for layouts such as those in FIGS. 19 and 20 are displayed. Also in the specific examples shown in FIGS. 17 to 20, the user can arbitrarily set the allocation of the main screen and the sub screen and the size of the sub screen. When the main / sub screen layout allocation setting is completed, it is preferable that the setting can be saved by selecting the setting end button (not shown). With the above configuration, the main screen and the sub screen can be arranged in any arrangement of the user.

The template of the layout created by the user may be displayed on the main / sub screen layout assignment setting screen. On the first layout setting screen 53a, the layout creation screen 53j shown in FIGS. 21 and 22 is displayed by selecting the layout creation button 53c. On the layout creation screen 53j, any layout template of the user can be created. In the specific example of newly creating one layout section shown in FIG. 21, the layout creation second section 53m is created by dragging the layout creation first section 53k in the direction of the arrow 53l via the UI23. be able to.

In the specific example of newly creating the four layout sections of FIG. 22, similarly, by dragging the layout creation first section 53k in the direction of the arrow 53l via the UI 23, the layout creation second section 53m, The layout creation third section 53n, the layout creation fourth section 53о, and the layout creation fifth section 53p can be created. The method of creating a layout is not limited to this. When the layout creation is completed, the setting can be saved and the screen can be returned to the first layout setting screen 53a by selecting the save button 53q. With the above configuration, it is possible to create a template of any format of the user.

On the first layout setting screen 53a, the second layout setting screen 53s as shown in FIG. 23 can be displayed by selecting the incidental character information setting button 53d. On the second layout setting screen 53s, it is possible to select whether to display the incidental character information on a portion other than the inspection image on the main screen or on the sub screen. A display example 53t of incidental character information is shown on the second layout setting screen 53s, and by selecting the radio button 53u, it is possible to select whether to display the incidental character information on the main screen or the sub screen. The setting method for displaying the incidental character information on either the main screen or the sub screen is not limited to this. Further, when the inch size becomes less than a certain value, the display of the incidental character information may be changed from the sub screen to the main screen.

Further, on the second layout setting screen 53s, the font size of the incidental character information to be displayed on the inspection image display screen can be set. The font size can be set by inputting a number in the font size input form 53v. The font size setting method is not limited to this. For example, it may be set by a pull-down menu. With the above configuration, the font size can be kept constant even if the inch size of the display changes, and the visibility of the character information can be improved.

The font size may be determined based on output performance information such as the inch size of the display. In the specific example of FIG. 23, the font size in each display can be set by inputting a number in the font size input form 53v for each display such as the first display 21 and the second display 22.

The display screen generation unit 60 generates an inspection image display screen according to the settings of the display setting unit 50 and displays it on an output device (for example, the first display 21 or the second display 22).

A specific example of the inspection image display screen 70 will be described with reference to FIGS. 24 and 25. FIG. 24 shows a specific example of the case where the first display 21 has an inch size of 50 inches and the number of sub screens is four. FIG. 25 shows a specific example of the case where the second display 22 has an inch size of 24 inches and the number of sub screens is 2. Further, in the specific examples shown in FIGS. 24 and 25, the order of the sub-screen display priority is the insertion shape image image, the still image, the special light image, and the incidental character information. Further, when the inch size becomes 25 inches or less, the display of the incidental character information is set to be changed from the sub screen to the main screen.

In the inspection image display screen 70 of the first display 21 shown in FIG. 24, the inspection image is on the main screen 71, the inserted shape image image is on the sub screen first section 72, and the still image is on the sub screen second section 73. The image is displayed in the third section 74 of the sub screen, and the incidental character information is displayed in the fourth section 75 of the sub screen. On the other hand, in the inspection image display screen 70 of the second display 22 shown in FIG. 25, the inspection image is displayed on the main screen 71, the inserted shape image image is displayed on the sub screen first section 72, and the still image is displayed on the sub screen second section 73. Will be done. As described above, the processor device 20 determines the number and types of sub-screens on the inspection image display screen 70.

It is preferable that the user can change the arrangement of the sub screen while the inspection image display screen 70 is displayed. Specifically, for example, the arrangement of sub-screens can be changed by dragging and dropping from one sub-screen section to another sub-screen section via UI23. The method of changing the arrangement of the sub screens is not limited to this. With the above configuration, the arrangement of sub screens can be customized even during examination or surgery.

Further, it is preferable that the user can change the number and / or type of the sub screens while the inspection image display screen 70 is displayed. Specifically, for example, the number and / or type of sub screens can be changed by voice input via UI23. Further, the first display 21 and the second display 22 may be provided with a switch (not shown) capable of changing the number and / or the number of sub screens. With the above configuration, the number and / or type of sub-screens can be customized even during examination or surgery.

A series of flow in which the processor device 20 receives the inspection image and the sub-screen display information other than the inspection image and displays the inspection image display screen 70 on the output device in the first embodiment will be described with reference to FIG. 26. First, the processor device 20 acquires an endoscope image which is an inspection image and information for sub-screen display which is information other than the inspection image (step S101). Next, the processor device 20 acquires output performance information from the output device (for example, the first display 21 and the second display 22) (step S102). In addition, step S101 and step S102 are in no particular order. Next, the number and types of sub screens are determined according to the settings of the display setting unit 50 (step S103), and the display screen generation unit 60 generates an inspection image display screen and displays it on the output device (step S104).

[Second Embodiment]
In the second embodiment, the case where the processor device 20 is provided in the ultrasonic imaging system 200 will be described.

As shown in FIG. 27 or FIG. 28, the processor device 20 of the second embodiment is connected to the ultrasonic probe 201, UI23, the first display 21 or the second display 22.

The ultrasonic probe 201 transmits ultrasonic waves to the subject and receives the reflected wave signal from the subject. The inspection image acquisition unit 14 of the processor device 20 receives the ultrasonic image signal generated by the reflected wave signal. The inspection image acquisition unit 14 performs image processing on the ultrasonic image signal to generate an inspection image. The inspection image is transmitted to the display setting unit 50.

A position sensor is attached to the ultrasonic probe 201. In the second embodiment, the position information acquisition unit 15 acquires the position information of the ultrasonic probe 201. The position information is transmitted to the display setting unit 50.

In the second embodiment, the still image acquisition unit 16 acquires a still image of an ultrasonic image when a still image acquisition signal is emitted. The still image is transmitted to the display setting unit 50.

In the second embodiment, the processor device 20 may not include the insertion state acquisition unit 17 and the treatment tool appearance position information acquisition unit 18. This is because they are configured to obtain information peculiar to the endoscope.

In the second embodiment, the information received by the display setting unit 50 includes an inspection image, position information of the ultrasonic probe 201, a still image, and incidental character information. It is not limited to this. Specific examples of the information included in the incidental character information are common to the first embodiment.

Since the functions of the output performance information acquisition unit 40, the display setting unit 50, and the display screen generation unit 60 of the processor device 20 are the same as those of the first embodiment except for the parts related to the insertion state information and the treatment tool appearance position information. , Omitted.

A series of flow in which the processor device 20 receives the inspection image and the sub-screen display information other than the inspection image and displays the inspection image display screen 70 on the output device in the second embodiment will be described with reference to FIG. 29. First, the processor device 20 acquires an ultrasonic image which is an inspection image and information for sub-screen display (step S201). Next, the processor device 20 acquires output performance information from the output device (for example, the first display 21 and the second display 22) (step S202). In addition, step S201 and step S202 are in no particular order. Next, the number and types of sub screens are determined according to the settings of the display setting unit 50 (step S203), and the display screen generation unit 60 generates the inspection image display screen 70 and displays it on the output device (step S204). In the second embodiment, the information acquired by the processor device 20 as the sub-screen display information is only partially different, and the series of flows is the same as that in the first embodiment.

[Third Embodiment]
In the third embodiment, the case where the processor device 20 is provided in the radiation imaging system 300 will be described.

As shown in FIG. 30 or FIG. 31, the processor device 20 of the second embodiment is connected to a radiation imaging device 301, a radiation irradiation device 302, a UI 23, a first display 21 or a second display 22.

The radiation imaging apparatus 301 includes a radiation detector inside the housing. The radiation irradiation device 302 includes a radiation source and a radiation source control device that controls the radiation source. The radiation detector of the radiation imaging apparatus 301 is emitted from the radiation beam irradiating apparatus 302 and generates an electric charge according to the dose of the radiation transmitted through the subject. A radiation image signal is transmitted to the inspection image acquisition unit 14 of the processor device 20 based on the amount of charge generated by the radiation detector.

As shown in FIG. 32, the radiation imaging system 300 may include an electronic cassette 303 equipped with a radiation detector instead of the radiation imaging device 301. The electronic cassette 303 acquires a radiographic image signal in the same manner as the radiographic imaging apparatus 301 in synchronization with the irradiation of radiation from a radiation source. As a synchronization method, there is a method of performing communication for controlling the irradiation timing between the electronic cassette and the radiation irradiation device wirelessly connected. When the electronic cassette 303 has an irradiation start detection function that automatically detects the start of irradiation, the irradiation timing is controlled by using the irradiation start detection function.

In the third embodiment, the inspection image acquisition unit 14 receives a radiographic image signal from the radiographic image capturing apparatus 301 or the electronic cassette 303, and generates an inspection image which is a radiographic image. The inspection image is transmitted to the display setting unit 50.

In the third embodiment, the still image acquisition unit 16 acquires a still image of a radiation image when a still image acquisition signal is emitted. The still image is transmitted to the display setting unit 50.

In the third embodiment, the processor device 20 may not include the position information acquisition unit 15, the insertion state acquisition unit 17, and the treatment tool appearance position information acquisition unit 18.

In the third embodiment, the information received by the display setting unit 50 of the processor device 20 includes an inspection image, a still image, incidental character information, and the like. It is not limited to this. Specific examples of the information included in the incidental character information are common to the first embodiment.

The functions of the output performance information acquisition unit 40, the display setting unit 50, and the display screen generation unit 60 of the processor device 20 are the first embodiment and the first embodiment except for the parts related to the position information, the insertion state information, and the treatment tool appearance position information. Since it is common to the two embodiments, it is omitted.

A series of flow in which the processor device 20 receives the inspection image and the sub-screen display information other than the inspection image and displays the inspection image display screen 70 on the output device in the third embodiment will be described with reference to FIG. 33. First, the processor device 20 acquires a radiation image which is an inspection image and information for sub-screen display (step S301). Next, the processor device 20 acquires output performance information from the output device (for example, the first display 21 and the second display 22) (step S302). In addition, step S301 and step S302 are in no particular order. Next, the number and types of sub screens are determined according to the settings of the display setting unit 50 (step S303), and the display screen generation unit 60 generates the inspection image display screen 70 and displays it on the output device (step S304). In the third embodiment, the information acquired by the processor device 20 as the sub-screen display information is only partially different from the first embodiment and the second embodiment, and the series of flows is the first embodiment and the second embodiment. Is common with.

In the above embodiment, the processor device of the present invention is applied to a medical device that acquires an endoscope image, an ultrasonic image, and a radiographic image as an inspection image, but a capsule endoscope or the like is used. The present invention also applies to various endoscopic systems and various medical devices that acquire CT (Computed Tomography) images, MRI (Magnetic Resonance Imaging) images, pathological images, PET (Positron Emission Tomography) images, and the like. It is possible to apply the processor device of.

In the above embodiment, the central control unit 30, the inspection image acquisition unit 14, the position information acquisition unit 15, the still image acquisition unit 16, the insertion state acquisition unit 17, the treatment tool appearance position information acquisition unit 18, the output performance information acquisition unit 40, The hardware-like structure of the processing unit that executes various processes such as the display setting unit 50 and the display screen generation unit 60 is various processors as shown below. For various processors, the circuit configuration is changed after manufacturing CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), etc., which are general-purpose processors that execute software (programs) and function as various processing units. It includes a programmable logic device (PLD), which is a possible processor, a dedicated electric circuit, which is a processor having a circuit configuration specially designed for executing various processes, and the like.

One processing unit may be composed of one of these various processors, and may be composed of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of a CPU and an FPGA). You may. Further, a plurality of processing units may be configured by one processor. As an example of configuring a plurality of processing units with one processor, first, as represented by a computer such as a client or a server, one processor is configured by a combination of one or more CPUs and software. There is a form in which this processor functions as a plurality of processing units. Secondly, as typified by System On Chip (SoC), there is a form of using a processor that realizes the functions of the entire system including a plurality of processing units with one IC (Integrated Circuit) chip. be. As described above, the various processing units are configured by using one or more of the above-mentioned various processors as a hardware-like structure.

Further, the hardware-like structure of these various processors is, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined. The hardware structure of the storage unit is a storage device such as an HDD (hard disk drive) or SSD (solid state drive).

10 Endoscope system 12 Endoscope 13 Light source device 14 Inspection image acquisition unit 15 Position information acquisition unit 16 Still image acquisition unit 17 Insertion state acquisition unit 18 Treatment tool appearance position information acquisition unit 20 Processor device 21 First display 22 Second Display 23 UI
30 Central control unit 40 Output performance information acquisition unit 40a Standard output condition calculation unit 50 Display setting unit 51 Number of sub screens Setting unit 52 Sub screen type setting unit 52a Sub screen display priority setting screen 52b Hamburger icon 53 Layout setting unit 53a 1st layout setting screen 53b Main / sub screen Layout assignment setting button 53c Layout creation button 53d Ancillary character information setting button 53e Layout 1st section 53f Layout 2nd section 53g Layout 3rd section 53h Layout 4th section 53i Layout 5th section 53j Layout creation screen 53k Layout creation 1st section 53l Arrow 53m Layout creation 2nd section 53n Layout creation 3rd section 53о Layout creation 4th section 53p Layout creation 5th section 53q Save button 53s 2nd layout setting screen 53t Ancillary character information Display example 53u Radio button 53v Font size input form 60 Display screen generator 70 Inspection image display screen 71 Main screen 72 Sub screen 1st section 73 Sub screen 2nd section 74 Sub screen 3rd section 75 Sub screen 4th section 200 Ultrasonic Imaging system 201 Ultrasonic probe 300 Radiation imaging system 301 Radiation imaging device 302 Radiation beam irradiation device 303 Electronic cassette

Claims (15)

A processor device that is connected to a display and contains a processor.
The processor
Get the inspection image,
An inspection image display screen including a main screen for displaying the inspection image and a sub screen for displaying a screen different from the main screen and displayed at a position different from the main screen is generated.
Obtain output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen.
A processor device that determines the number and type of sub-screens based on the output performance information. The processor device according to claim 1, wherein the type of the sub-screen includes at least one of a still image related to the inspection image, a position information of a region of interest, an inserted shape image, a treatment tool appearance position information, and ancillary character information. .. The processor device according to claim 2, wherein the incidental character information includes at least one of patient information, operator information, and switch assignment information. The processor acquires only the inch size as the output performance information.
Claims 1 to 3 reduce the number of sub-screens when the first inch size is larger than the second inch size and the display is the second inch size than when the display is the first inch size. The processor device according to any one. The processor acquires only the resolution as the output performance information.
One of claims 1 to 4, wherein when the first resolution is higher than the second resolution and the display is the second resolution, the number of the sub-screens is reduced as compared with the case where the display is the first resolution. The processor device described in. The processor acquires the inch size and the resolution as the output performance information.
When the 1st inch size is larger than the 2nd inch size and the 1st resolution is higher than the 2nd resolution
Either the output performance information includes the first inch size and the second resolution, the second inch size and the first resolution are included, or the second inch size and the second resolution are included. The processor device according to any one of claims 1 to 3, wherein the number of sub-screens is reduced as compared with the case where the output performance information includes the first resolution and the first inch size. When the processor displays a still image related to the inspection image on the sub screen, the processor
The second when the first inch size is larger than the second inch size and the first resolution is higher than the second resolution and the output performance information includes the first inch size and the second resolution. When the output performance information includes the first resolution and the first inch size in either the case where the inch size and the first resolution are included, or the case where the second inch size and the second resolution are included. The processor device according to any one of claims 1 to 3, wherein the number of still images displayed on the sub screen is reduced. The processor calculates standard output conditions based on the inspection image and
The processor device according to any one of claims 1 to 5, wherein when the inch size of the display is smaller than the standard output condition, the number of sub screens is reduced. The processor device according to any one of claims 1 to 8, wherein the processor is an upper limit on the number of sub-screens. The processor device according to any one of claims 1 to 9, wherein the processor determines the type of the sub-screen to be displayed on the display according to the sub-screen display priority. The processor device according to claim 10, wherein the sub-screen display priority can be set. The processor device according to any one of claims 1 to 5, wherein the arrangement of the sub screens can be changed on the inspection image display screen. The processor device according to any one of claims 1 to 5, wherein the processor determines a font size on the inspection image display screen based on the output performance information. The processor device according to claim 2 or 3, wherein the processor can select whether to display the incidental character information on a portion other than the inspection image of the main screen or on the sub screen. In the way a processor device, including a processor, is connected to a display and operates.
The processor
Get the inspection image,
An inspection image display screen including a main screen for displaying the inspection image and a sub screen for displaying a screen different from the main screen and displayed at a position different from the main screen is generated.
Obtain output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen.
A method of operating a processor device that determines the number and types of sub-screens based on the output performance information.

Images