JP2014045239A - Medical support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for a medical support system capable of facilitating the selection of controlled units.SOLUTION: A medical support system 100 includes: a system controller 50 for controlling multiple controlled units; an imaging apparatus 21 for capturing an area where the multiple controlled units are arranged; and an operation panel 37 for displaying an image captured by the imaging apparatus 21 and receiving the selection of the controlled units. The system controller 50 identifies the respective images of the multiple controlled units within an image captured by the imaging apparatus 21, and causes the operation panel 37 to display icons for the selection of each one of the multiple controlled units in association with the images of the controlled units on an image on the basis of the identification result.

Description

  The present invention relates to a medical support system including a system controller that controls a plurality of devices.

  In the medical field, a medical support system including a system controller that controls a plurality of devices is conventionally known. In such a medical support system, by operating an operation panel connected to the system controller, it is possible to change the setting of any device in the system (hereinafter referred to as a controlled device) via the system controller. .

  By the way, in the medical support system, when a controlled device is selected from the operation panel, the controlled device is generally specified by the name of the controlled device displayed on the operation panel. For this reason, when there are a large number of controlled devices, it is difficult to identify the controlled devices and it is not easy to select them.

  A technique related to such a technical problem is disclosed in Patent Document 1, for example. Japanese Patent Application Laid-Open No. 2004-133867 discloses a technique for photographing a room where a controlled device is arranged with an imaging device and selecting the controlled device on the captured image.

JP 2004-356803 A

However, the technique disclosed in Patent Document 1 has various problems. For example, in the technique disclosed in Patent Document 1, when controlled devices and devices that are not controlled are mixed in the system, it is difficult to determine which device is the controlled device from the image. Further, in order to associate the controlled device in the image with the actual controlled device, it is necessary to prepare in advance coordinate information indicating in which region in the image each controlled device exists.
In view of the above circumstances, an object of the present invention is to provide a medical support system technology that can easily select a controlled device.

  A first aspect of the present invention displays a system controller that controls a plurality of controlled devices, an imaging device that captures an area in which the controlled devices are disposed, and an image captured by the imaging device. And an operation display unit that accepts selection of a controlled device, wherein the system controller is configured to each of the plurality of controlled devices in an image in which the plurality of controlled devices photographed by the imaging device are captured. A device identification unit for identifying an image of the image, and an operation for associating an icon for selecting each of the plurality of controlled devices with the image of the controlled device on the image based on the identification result by the device identification unit. A medical support system including a display control unit to be displayed on a display unit is provided.

  According to a second aspect of the present invention, in the medical support system according to the first aspect, the device identification unit identifies each of the plurality of controlled devices from the image captured by the imaging device. Provided is a medical support system that detects information and identifies each image of the plurality of controlled devices based on the identification information.

  According to a third aspect of the present invention, in the medical support system according to the first aspect or the second aspect, the system controller is connected to the plurality of controlled devices via an icon displayed on the operation display unit. When an image signal output device and a monitor included are selected, a medical support system is provided that displays an image based on the image signal output from the selected image signal output device on the selected monitor.

  According to a fourth aspect of the present invention, in the medical support system according to the first aspect or the second aspect, the display control unit selects a controlled device via an icon displayed on the operation display unit. Then, the medical assistance system which displays the setting screen of the selected controlled apparatus on the said operation display part is provided.

  According to a fifth aspect of the present invention, in the medical support system according to any one of the first to fourth aspects, the second imaging that further images an operator who selects a controlled device. And an operation detection unit that detects the operation of the operator from an image captured by the second imaging device, and the display control unit is based on the operation of the operator detected by the operation detection unit. When the cursor displayed on the operation display unit is moved and the cursor overlaps the image of the controlled device on the image captured by the imaging device, the controlled device corresponding to the image of the controlled device is displayed. Provided is a medical support system in which an icon for selection is displayed on the display control unit in association with an image of the controlled device.

  According to a sixth aspect of the present invention, in the medical support system according to any one of the first to fourth aspects, the second imaging that further images an operator who selects a controlled device. And an operation detection unit that detects the operation of the operator from an image captured by the second imaging device, and the display control unit is based on the operation of the operator detected by the operation detection unit. Medical support that moves the cursor displayed on the operation display unit and changes the state of the icon when the cursor is over an icon for selecting a controlled device on the image captured by the imaging device Provide a system.

  ADVANTAGE OF THE INVENTION According to this invention, the technique of the medical assistance system which can select a to-be-controlled apparatus easily can be provided.

It is a figure which shows the whole structure of the medical assistance system which concerns on Example 1 of this invention. It is a figure for demonstrating the main components of the medical assistance system which concerns on Example 1 of this invention. It is a figure which shows the hardware constitutions of the system controller contained in the medical assistance system which concerns on Example 1 of this invention. It is the figure which illustrated the main screen displayed on the operation panel of the medical assistance system concerning Example 1 of the present invention. It is a flowchart of a process of the medical assistance system which concerns on Example 1 of this invention in monitor mode. It is the figure which illustrated the image which the imaging device contained in the medical assistance system which concerns on Example 1 of this invention image | photographed. It is the figure which illustrated the screen displayed on the operation panel of the medical assistance system which concerns on Example 1 of this invention in monitor mode. It is the figure which illustrated another screen displayed on the operation panel of the medical assistance system which concerns on Example 1 of this invention in monitor mode. It is a figure which shows the relationship between the name of the controlled apparatus of the medical assistance system which concerns on Example 1 of this invention, and identification information. It is the figure which illustrated the screen displayed on the operation panel of the medical assistance system which concerns on Example 1 of this invention in operation mode. It is a flowchart of a process of the medical assistance system which concerns on Example 2 of this invention in monitor mode. It is the figure which illustrated the screen displayed on the operation panel of the medical assistance system which concerns on Example 2 of this invention in monitor mode. It is the figure which illustrated another screen displayed on the operation panel of the medical assistance system which concerns on Example 2 of this invention in monitor mode. It is the figure which illustrated another screen displayed on the operation panel of the medical assistance system concerning Example 2 of the present invention in monitor mode. It is the figure which illustrated another screen displayed on the operation panel of the medical assistance system concerning Example 2 of the present invention in monitor mode. It is a figure for demonstrating the main components of the medical assistance system which concerns on Example 3 of this invention. It is the figure which illustrated the screen displayed on the operation panel of the medical assistance system which concerns on Example 3 of this invention in operation mode. It is the figure which illustrated another screen displayed on the operation panel of the medical assistance system which concerns on Example 3 of this invention in operation mode. It is the figure which illustrated the screen displayed on the operation panel of the modification of the medical assistance system which concerns on Example 3 of this invention in operation mode. It is the figure which illustrated another screen displayed on the operation panel of the modification of the medical assistance system which concerns on Example 3 of this invention in operation mode.

  FIG. 1 is an overall configuration diagram of a medical support system according to the present embodiment. A medical support system 100 illustrated in FIG. 1 includes a system controller 50 that controls a plurality of controlled devices, an imaging device 21 that captures an operating room where a plurality of controlled devices are disposed, and an imaging device. 21 includes an operation panel 37 that displays an image captured in 21 and receives an operation by an operator, and a plurality of controlled devices controlled by the system controller 50.

  The system controller 50 installed in the rack 30 includes an insufflation apparatus 31, a light source device 32, two processors (processor 33 and processor 34) connected to the endoscope, and an electric knife. The apparatus 35, the display panel 36, and the operation panel 37 are controlled. In addition, the system controller 50 includes a patient bed 10 on which the patient lies, ceiling lighting (ceiling lighting 11 and ceiling lighting 12), operating lights suspended from the ceiling (operating lights 13 and 14), and hanging from the ceiling. A plurality of monitors (monitor 15, monitor 16, monitor 17) that display the lowered medical image and equipment permanently installed in the operating room such as the imaging device 21 are also controlled as controlled devices.

  The imaging device 21 is an imaging device that images the operating room. As will be described in detail later, an image captured by the imaging device 21 is displayed on the operation panel 37 for selecting a controlled device using the image. .

  The operation panel 37 is, for example, a touch panel display in which a liquid crystal display and a touch panel sensor arranged on the liquid crystal display are integrated. The controlled device connected to the system controller 50 can be controlled by operating the operation panel 37 on which an image captured by the imaging device 21 or a GUI screen is displayed. In other words, the operation panel 37 is an operation display unit that serves as an operation unit and a display unit of the medical support system 100. The operation panel 37 is operated by a nurse or the like in a non-sterile area, and is not normally operated directly by the operator.

  Although FIG. 1 illustrates the medical support system 100 provided in the operating room where endoscopic surgery is performed, the use of the medical support system 100 is not limited to endoscopic surgery, It may be used for examination. In addition, the medical support system 100 may be provided outside the operating room such as an examination room. The medical support system 100 may further include various devices and equipment not shown in FIG. The medical support system 100 may include, for example, an operative field camera that observes the operative field, a video recorder that stores images generated by the processor 33 and the processor 34, and these may be controlled by the system controller 50. . In addition, the medical support system 100 may include a plurality of imaging devices 21 arranged at different positions. In this case, any imaging device may be selected from the plurality of imaging devices 21 and used.

FIG. 2 is a diagram for explaining the main components of the medical support system according to the present embodiment. FIG. 3 is a diagram illustrating a hardware configuration of a system controller included in the medical support system according to the present embodiment. Hereinafter, the imaging device 21, the operation panel 37, and the system controller 50, which are the main components of the medical support system 100, will be described in detail with reference to FIGS.
The imaging device 21 is configured to output image data of a captured image to the system controller 50.

  The operation panel 37 includes a display unit 38 and a sensor unit 39. The display unit 38 is, for example, a liquid crystal display, receives screen data from the system controller 50, and displays a screen based on the received screen data. The sensor unit 39 is a touch panel sensor arranged on the liquid crystal display, detects contact with the display unit 38 on which the screen is displayed, and outputs a contact signal to the system controller 50.

  The system controller 50 includes a device identification unit 51, a storage unit 52, a display control unit 53, and a device control unit 54. The device identification unit 51 and the display control unit 53 receive image data from the imaging device 21, and the device control unit 54 receives a signal from the operation panel 37.

  The device identification unit 51 analyzes the image data generated by the imaging device 21, that is, the image data in which a plurality of controlled devices that have taken an operating room are shown, and each of the plurality of controlled devices in the image is analyzed. It is configured to identify the image. More specifically, the device identification unit 51 detects identification information given in advance to each of a plurality of controlled devices from an image captured by the imaging device 21, and uses the identification information to identify a plurality of controlled devices. Identify each image. The identification information is information for specifying the controlled device, and is attached in, for example, a barcode format. The identification information is desirably provided within the field of view of the imaging device 21 so that it can be detected from the image.

  For example, identification information of the controlled device is stored in the storage unit 52 in association with the name of the controlled device. In addition, a program for operating the system controller 50 and other various data necessary for executing the program are also stored.

  The display control unit 53 controls the display of the operation panel 37 based on the operating room image data transmitted from the imaging device 21 and the information regarding the identification result of the controlled device transmitted from the device identification unit 51. It is configured. More specifically, the display control unit 53 displays the icon of the controlled device on the image captured by the imaging device 21 for selecting each of the plurality of controlled devices based on the identification result by the device identifying unit 51. The image is displayed on the operation panel 37 in association with the image.

  The device control unit 54 is configured to control the controlled device based on the contact signal transmitted from the operation panel 37. More specifically, the selected controlled device is controlled by specifying the selected controlled device from the data regarding the contact position included in the contact signal, and transmitting the device control signal to the specified controlled device. .

  Each of the device identification unit 51, the storage unit 52, the display control unit 53, and the device control unit 54 of the system controller 50 illustrated in FIG. 2 is a functional block that focuses on the main functions of the system controller 50. The hardware configuration of the system controller 50 is shown in FIG. The system controller 50 includes a CPU 50a, a RAM 50b, a ROM 50c, an input I / F 50d, an output I / F 50e, and an HDD 50f. To realize. That is, the ROM 50c is a computer-readable recording medium that records a program.

  FIG. 4 is a diagram illustrating a main screen displayed on the operation panel of the medical support system according to the present embodiment. FIG. 5 is a flowchart of the process of the medical support system according to the present embodiment in the monitor mode. FIG. 6 is a diagram illustrating an image captured by the imaging device included in the medical support system according to the present embodiment. 7A and 7B are diagrams illustrating screens displayed on the operation panel of the medical support system according to the present embodiment in the monitor mode. FIG. 8 is a diagram illustrating the relationship between the name of the controlled device and the identification information of the medical support system according to the present embodiment. FIG. 9 is a diagram illustrating a screen displayed on the operation panel of the medical support system according to the present embodiment in the operation mode. Hereinafter, the process of the medical support system 100 according to the present embodiment will be described with reference to FIGS. 4 to 9.

  When the system controller 50 is activated and the program is executed, a main screen 60 including a monitor button 61 and an operation button 62 as shown in FIG. 4 is displayed on the operation panel 37, for example. When the monitor button 61 is pressed, a monitor mode for changing the setting relating to the output source of the image displayed on the monitor is started, and the process shown in FIG. 5 is executed. On the other hand, when the operation button 62 is pressed, an operation mode for changing the setting of each controlled device is started.

  First, the monitor mode will be described. When the monitor mode is started, the system controller 50 (device identification unit 51), from the operating room image taken by the imaging device 21 shown in FIG. 6, a processor (processor 33, processor 34) that is an image signal output device. The identification information previously attached to is detected. Then, using the detected identification information as a key, the data shown in FIG. 8 described in the storage unit 52 is searched to acquire the name of the processor corresponding to the identification information, thereby identifying the image of each processor (step) S1). The information related to the identification result includes, for example, a combination of the processor image coordinates and the processor name in the operating room image.

  Thereafter, the system controller 50 (display control unit 53) generates the GUI screen 63 shown in FIG. 7A based on the operating room image captured by the imaging device 21 and the information related to the identification result, and displays the GUI screen 63 on the operation panel 37. (Step S3). The screen 63 is a screen in which icons (icons 33a and 34a) for selecting each of the processors (processor 33 and processor 34) which are image signal output devices are combined on the operating room image. Each icon is associated with the image of the processor by a lead line from the image of the processor, so that it is possible to intuitively understand which processor is an icon for selecting each icon. . A main button 64 provided on the screen 63 is a button for returning to the main screen 60.

  The system controller 50 that displays on the operation panel 37 a screen 63 in which icons for selecting a processor are combined is monitored by a signal from the operation panel 37, thereby touching the icon, that is, the output source of the image signal. The selection of the processor to be selected is monitored (step S5). When the selection of the processor by the touch operation is detected, the identification information preliminarily attached to the monitor (monitor 15, monitor 16, monitor 17) is detected from the image of the operating room, and each monitor is detected by the same method as in step S1. Are identified (step S7).

  Furthermore, the system controller 50 generates the GUI screen 65 shown in FIG. 7B based on the operating room image and the information related to the identification result, and displays it on the operation panel 37 (step S9). The screen 65 is a screen in which icons (icon 15a, icon 16a, icon 17a) for selecting each of the monitors (monitor 15, monitor 16, monitor 17) are combined on the operating room image. Each icon is associated with the monitor by being displayed on the image of the monitor, so that it is possible to intuitively grasp which monitor is the icon for selecting each icon.

  The system controller 50 that displays on the operation panel 37 the screen 65 in which icons for selecting a monitor are displayed is monitored by monitoring the signal from the operation panel 37, and is selected in step S5. The selection of the monitor to be the output destination of the image signal from the processor is monitored (step S11). When the selection of the monitor by the touch operation is detected, a control signal requesting to change the setting of the output source is transmitted to the selected monitor (step S13). The monitor that has received the control signal sets the output source processor to the processor selected in step S5.

  As described above, in the monitor mode of the medical support system 100, the system controller 50 causes the operation panel 37 to display a screen in which an image of the controlled device and an icon for selecting the controlled device are associated with each other. When the processor and the monitor are selected via the icon displayed on the operation panel 37, the controlled device is configured to display an image based on the image signal output from the selected processor on the selected monitor. To control.

  Although FIG. 4 shows an example in which a monitor is selected after selecting a processor, the processor may be selected after selecting a monitor. In this case, an image in which an icon for selecting a monitor is first combined is displayed on the operation panel 37, and an image in which an icon for selecting a processor is combined is displayed after selecting the monitor. Further, an image obtained by combining both an icon for selecting a processor and an icon for selecting a monitor may be displayed to select the processor and the monitor. In that case, it is desirable that the selected state can be visually grasped by changing the color of the icon of the previously selected controlled device.

  Next, the operation mode will be described. When the operation mode is started, the system controller 50 (device identification unit 51) detects identification information previously attached to the controlled device from the operating room image captured by the imaging device 21 shown in FIG. . Then, the image of each controlled device is obtained by searching the data shown in FIG. 8 stored in the storage unit 52 using the detected identification information as a key and acquiring the name of the controlled device corresponding to the identification information. Identify. Note that the operation mode is not limited to the processor and the monitor, but is different from the monitor mode in that identification information of as many controlled devices as possible is detected from the image to identify the controlled devices.

  Thereafter, the system controller 50 (display control unit 53) generates the GUI screen 66 shown in FIG. 9 based on the operating room image captured by the imaging device 21 and the information related to the identification result, and displays the GUI screen 66 on the operation panel 37. . The screen 66 has icons (icons 10a, 11a, 12a, 13a, 14a, 15a, 16a, 17a, 31a, 32a, 33a, 34a, and 35a) for selecting each controlled device on the operating room image. ).

  The icons 31a to 35a are icons for selecting controlled devices installed in the rack 30, and are associated with images of controlled devices by lead lines from the images of the corresponding controlled devices. The icons 15a to 17a are icons for selecting a monitor, and are associated with the monitor by being displayed on the monitor image. As a result, it is possible to intuitively understand which controlled device each icon is for selecting.

  The icons 10 a to 14 a are icons for selecting controlled devices for which identification information has not been detected from images captured by the imaging device 21. In the medical support system 100, when there is a controlled device that is not within the field of view of the imaging device 21 or a controlled device that is blocked by an operator or the like and cannot detect identification information, this corresponds to the icon 10a to the icon 14a. Displays an icon with the name of the controlled device. Thereby, it is possible to select all controlled devices from the operation panel 37.

  The system controller 50 that displays on the operation panel 37 a screen 66 in which icons for selecting controlled devices are displayed is monitored by a signal from the operation panel 37 to change the touch operation on the icon, that is, the setting. Monitor the selection of controlled devices. When selection of the controlled device by the touch operation is detected, a setting screen for changing the setting of the selected controlled device is displayed on the operation panel 37. The setting screen may be displayed on the operation panel 37 in a two-screen display format in which the setting screen and the screen 66 are displayed in parallel.

  As described above, in the operation mode of the medical support system 100, the system controller 50 causes the operation panel 37 to display a screen in which an image of the controlled device and an icon for selecting the controlled device are associated with each other. When a controlled device is selected via an icon displayed on the operation panel 37, the operation panel 37 operates to display a setting screen of the selected controlled device.

  As described above, in the medical support system 100 according to the present embodiment, since the icon for selecting the controlled device is visually associated with the image of the controlled device, which controlled device is selected by each icon. It is possible to intuitively grasp whether the icon is for use. For this reason, according to the medical assistance system 100, a controlled apparatus can be selected easily.

  In the medical support system 100, the system controller 50 identifies the controlled device by detecting the identification information attached to the controlled device from the image. For this reason, it is not necessary to prepare in advance information such as in which area of the image captured by the imaging device 21 the controlled device exists. Accordingly, it is possible to cope with a change in the shooting range by the imaging device 21 and movement of the controlled device.

  In addition to the icon for selecting the controlled device, the medical support system 100 may display, for example, an icon indicating that a failure such as a communication error has occurred in association with the image of the controlled device. When an icon is selected, an error message may be displayed. An icon indicating that a failure has occurred can be combined with an image in the same manner as the icon for selecting a controlled device.

  FIG. 10 is a flowchart of the process of the medical support system according to the present embodiment in the monitor mode. 11A to 11D are diagrams illustrating screens displayed on the operation panel of the medical support system according to the present embodiment in the monitor mode. The configuration of the medical support system according to the present embodiment is the same as that of the medical support system 100 shown in FIGS.

  The medical support system according to the present embodiment is different from the medical support system 100 according to the first embodiment in that identification of the controlled device that cannot detect the identification information using the object recognition technology is attempted. Other points are the same as those of the medical support system 100. Therefore, hereinafter, the control device identification processing using the object recognition technology will be described in detail with reference to FIGS. 10, 11A, and 11B, taking the processing in the monitor mode as an example.

  First, when the monitor mode is started, as shown in FIG. 10, the system controller 50 (device identification unit 51) is attached in advance to the processor (processor 33, processor 34) from the operating room image shown in FIG. Identification information is detected, and an image of each processor is identified (step S21). Thereafter, the system controller 50 (the display control unit 53) operates a screen in which an icon for selecting a processor is combined with an image of the operating room based on the operating room image captured by the imaging device 21 and information related to the identification result. It is displayed on the panel 37 (step S23). Then, the processor selection is monitored (step S25). When the selection of the processor by the touch operation is detected, the system controller 50 (device identification unit 51) detects the identification information previously attached to the monitor from the operating room image, and identifies the image of each monitor (step S27). ). The above processing is the same as the processing from step S1 to step S7 in FIG.

  Next, the system controller 50 (device identification unit 51) determines whether or not all monitors have been identified by the identification information (step S29). This process is determined based on, for example, whether or not all monitors stored in the storage unit 52 have been searched using the identification information as a key.

  Here, among the identification information (identification information 15id, identification information 16id, and identification information 17id) of the three monitors shown in FIG. 11A, the identification information 16id and the monitor 17 that are attached to the monitor 16 in step S27 are attached. It is assumed that the identification information 17id could be detected, but the identification information 15id attached to the monitor 15 could not be detected.

  In such a case, the system controller 50 (device identification unit 51) further detects the monitor based on the external features such as the shape of the monitor using the object recognition technique (step S31).

  Thereafter, the system controller 50 generates a screen in which icons for selecting a monitor are combined based on the operating room image and information on the identification result, and displays the screen on the operation panel 37 (step S33). However, as shown in FIG. 11B, the monitor number (“1”, “2”) is displayed on the icon (icon 16a, icon 17a) of the monitor that has successfully detected the identification information, whereas For example, a “?” Mark is displayed instead of the monitor number on the monitor icon (icon 15a) that has failed to detect the identification information and has been recognized as a monitor by object recognition.

  The system controller 50 that displays on the operation panel 37 a screen in which icons for selecting a monitor are displayed is monitored (step S35). When the selection of the monitor by the touch operation is detected, the system controller 50 further selects the selected monitor. It is determined whether or not the monitor is an identified monitor (step S37).

  When the identified monitor is selected, the system controller 50 transmits a control signal for requesting a setting change to set the output source as the processor selected in step S25 to the monitor selected in step S35 (step S45). ), The process is terminated.

  On the other hand, when a monitor that has not been identified is selected, as shown in FIG. 11C, a window 70 listing candidates for identification information of the selected monitor is displayed on the screen (step S39). At this time, the identification information of the already identified monitor and the other identification information are displayed separately. FIG. 11C shows an example in which they are distinguished and displayed by color coding. The identification information of the already identified monitor may not be displayed on the window 70.

  The system controller 50 displaying the window 70 listing the identification information candidates for the monitor monitors the selection of the identification information listed in the window 70 (step S41). When the selection of the identification information by the touch operation is detected, the system controller 50 identifies the selected monitor as the monitor specified by the selected identification information and displays the monitor number on the icon as shown in FIG. 11D. (Step S43). Then, it returns to step S35 and repeats the process mentioned above.

  Also in the medical support system according to the present embodiment, similarly to the medical support system 100 according to the first embodiment, the controlled device is easily selected via an icon visually associated with the image of the controlled device. be able to. Further, in the medical support system according to the present embodiment, even when there is a controlled device that cannot detect identification information from an image, the controlled device identified by specifying the controlled device using object recognition technology is used. The controlled device can be identified by causing the operator to select identification information. For this reason, it is possible to easily select more controlled devices than the medical support system 100 according to the first embodiment.

  Although FIG. 10 shows an example in which the object recognition technology is used for monitor identification, the object recognition technology may be used for processor identification. The object recognition technology is not limited to the monitor mode, and may be used in the operation mode. For controlled devices that cannot be detected even by the object recognition technique, an icon with the name of the controlled device may be displayed as in the first embodiment.

  FIG. 12 is a diagram for explaining main components of the medical support system according to the present embodiment. 13A and 13B are diagrams illustrating screens displayed on the operation panel of the medical support system according to the present embodiment in the operation mode.

  The medical support system 200 according to the present embodiment is different from the medical support system 100 according to the first embodiment in that a controlled device is selected in a non-contact manner via an icon displayed on the operation panel 37. For this reason, as shown in FIG. 12, the medical support system 200 includes an imaging device 22 that is a second imaging device that captures an operator who selects a controlled device, and further captures an image within the system controller 50. An operation detection unit 55 that detects the operation of the operator from the image captured by the apparatus 22 is included. Other configurations are the same as those of the medical support system 100.

  In the medical support system 200, as shown in FIG. 13A, the system controller 50 causes the operation panel 37 to display a screen 71 in which the cursor 80 is combined with the operating room image in addition to the icon for selecting the controlled device. The cursor 80 moves based on the operator's motion (so-called gesture motion) detected by the motion detector 55. When the cursor 80 overlaps an icon for selecting a controlled device, as shown in FIG. The state of the icon where 80 overlaps changes. Then, the operator can select a controlled device corresponding to the icon by performing a predetermined operation of the operator while the cursor 80 is overlaid on the icon.

  Therefore, the medical support system 200 according to the present embodiment also facilitates the controlled device via the icon visually associated with the image of the controlled device, similarly to the medical support system 100 according to the first embodiment. Can be selected. Furthermore, in the medical support system 200, the controlled device can be selected without touching the operation panel 37 that is generally arranged in the non-sterile area. For this reason, the surgeon himself can directly change the setting of the controlled device without going through a nurse in the non-sterile area. Further, in the medical support system 200, since the state of the icon on which the cursor 80 is overlapped changes, it is possible to suppress the occurrence of a situation in which a controlled device different from the controlled device to be selected is erroneously selected.

  14A and 14B are diagrams exemplifying screens displayed on the operation panel of a modified example of the medical support system according to the present embodiment in the operation mode. As illustrated in FIG. 14A, the medical support system 200 may be modified so that an icon for selecting the controlled device is not displayed until the cursor 80 overlaps the image of the controlled device. 14B, when the cursor 80 overlaps the image of the controlled device, an icon for selecting the controlled device corresponding to the image of the controlled device on which the cursor 80 overlaps is displayed. It may be modified so as to be displayed on the operation panel 37 in association with the above image.

  By deforming the medical support system 200 in this way, a large number of icons are not displayed on the screen even when there are many controlled devices. For this reason, it is possible to further suppress the occurrence of a situation in which a controlled device different from the controlled device to be selected is erroneously selected.

  The system controller 50 may perform various controls other than the cursor movement based on the operation of the operator detected by the motion detection unit 55. For example, the imaging magnification may be changed by rotating the imaging device 21 or using a zoom function.

  The embodiments described above are specific examples for facilitating the understanding of the invention, and the present invention is not limited to these embodiments. The medical support system according to each embodiment can be variously modified and changed without departing from the concept of the present invention defined by the claims.

DESCRIPTION OF SYMBOLS 100, 200 ... Medical assistance system 10 ... Patient bed 11, 12 ... Ceiling illumination 13, 14 ... Surgical light 15, 16, 17 ... Monitor 10a, 11a, 12a, 13a, 14a , 15a, 16a, 17a, 31a, 32a, 33a, 34a, 35a ... Icons 15id, 16id, 17id ... Identification information 21, 22 ... Imaging device 30 ... Rack 31 ... Insufflation device 32 ... Light source device 33, 34 ... Processor 35 ... Electric knife device 36 ... Display panel 37 ... Operation panel 38 ... Display unit 39 ... Sensor unit 50 ... System controller DESCRIPTION OF SYMBOLS 51 ... Device identification part 52 ... Memory | storage part 53 ... Display control part 54 ... Equipment control part 55 ... Operation | movement detection part 50a ... CPU
50b ... RAM
50c ... ROM
50d ... Input I / F
50e ... Output I / F
50f HDD
60 ... Main screen 61 ... Monitor button 62 ... Operation buttons 63, 65, 66, 71, 72, 73, 74 ... Screen 64 ... Main button 70 ... Window 80 ... cursor

Claims (6)

A system controller for controlling a plurality of controlled devices;
An imaging device that captures an area in which the plurality of controlled devices are arranged;
An operation display unit that displays an image captured by the imaging device and receives selection of a controlled device;
The system controller is
A device identifying unit for identifying each image of the plurality of controlled devices in an image in which the plurality of controlled devices photographed by the imaging device is shown;
A display control unit that displays an icon for selecting each of the plurality of controlled devices on the operation display unit in association with an image of the controlled device on the image, based on the identification result by the device identification unit; A medical support system comprising: The medical support system according to claim 1,
The device identification unit detects identification information attached to each of the plurality of controlled devices from the image captured by the imaging device, and uses the identification information to display each image of the plurality of controlled devices. A medical support system characterized by identifying. The medical support system according to claim 1 or 2,
When the image signal output device and the monitor included in the plurality of controlled devices are selected via the icon displayed on the operation display unit, the system controller outputs the selected image signal output device. A medical support system, wherein an image based on an image signal is displayed on a selected monitor. The medical support system according to claim 1 or 2,
When the controlled device is selected via the icon displayed on the operation display unit, the display control unit displays a setting screen of the selected controlled device on the operation display unit. Support system. The medical support system according to any one of claims 1 to 4, further comprising:
The second imaging device for photographing an operator who selects a controlled device;
An operation detection unit that detects the operation of the operator from an image captured by the second imaging device;
The display control unit
Move the cursor displayed on the operation display unit based on the operation of the operator detected by the operation detection unit,
When the cursor overlaps the image of the controlled device on the image captured by the imaging device, an icon for selecting the controlled device corresponding to the image of the controlled device is associated with the image of the controlled device. A medical support system, wherein the display control unit displays the medical support system. The medical support system according to any one of claims 1 to 4, further comprising:
The second imaging device for photographing an operator who selects a controlled device;
An operation detection unit that detects the operation of the operator from an image captured by the second imaging device;
The display control unit
Move the cursor displayed on the operation display unit based on the operation of the operator detected by the operation detection unit,
A medical support system, wherein the state of the icon is changed when the cursor overlaps an icon for selecting a controlled device on the image captured by the imaging device.