JP2021069033A - Video recording system, video recording method, and video recording program - Google Patents

Abstract

To provide a video recording system capable of providing biological information in which an abnormality occurs and video information and audio information synchronized with the biological information to be used for medical determination.SOLUTION: A video recording system 1 includes: a patient terminal 10 that transmits biometric information acquired from a measurement device; and a management server 20 that receives and stores the biometric information. The patient terminal or the management server has a determination unit 14 and 24 that determines an abnormality in the biometric information. The patient terminal includes: a built-in camera 15 that captures patient images; an external camera 17, and a microphone 18; a recording unit 13 that, when it is determined that there is an abnormality in the biometric information, records video information and audio information until first recording time T passes from an abnormality occurrence point of time; and a communication unit 12 that transmits the video information and the audio information as well as a time stamp which synchronizes the video information and the audio information with the biometric information, to the management server. The management server includes a storage unit 23 that stores the received video information and the received audio information, and the time stamp.SELECTED DRAWING: Figure 2

Description

The present invention relates to a video recording system, a video recording method, and a video recording program, and more particularly to a video recording system, a video recording method, and a video recording program that record a patient's condition as video information and audio information for medical treatment.

In recent years, in the medical field, the field of telemedicine using communication devices and the like has been put into practical use. Telemedicine is a medical worker such as a doctor or a nurse who observes and inspects the patient's condition from a physically distant place (referred to here as a telemedicine center) using a medical worker's terminal. , To make a diagnosis. Telemedicine also includes interviews conducted by the medical staff and the patient through two-way communication while facing each other through the screen of the terminal.

Generally, a videophone system (also called a video call system) is used for face-to-face two-way communication. However, in the case of a patient whose ADL (Activities of daily living) is not necessarily high, such as a home medical patient, it is possible that the patient becomes so severe or serious that the patient cannot respond. In recent years, a system has been developed that advocates "patient watching" and "elderly watching" in anticipation of situations that require such emergency support. However, it is difficult to predict when an emergency assistance will be needed, and it is important to observe the patient in an emergency assistance situation. However, it is hard to say that the functions of the video call system can be used effectively in a timely manner.
The video and audio of the patient at the moment when the factor of emergency support occurs is already lost video and audio in the past despite its importance, so it is necessary for medical judgment. However, there were cases where they could not be utilized.
Patent Document 1 proposes a system that captures a patient's state as a live image and displays biological information synchronized with the image.

Japanese Unexamined Patent Publication No. 2013-169793

In the system described in Patent Document 1, although the live video and the biological information are synchronized, the reproduction of the video information and the audio information synchronized with the evidence such as the alert timing of the biological information, which is useful for diagnosis, is considered. It has not been.

The present invention has been made in view of the above problems, and provides biological information (vital signs) in which an abnormality has occurred and video information and audio information synchronized with the biological information for use in medical judgment. It is an object of the present invention to provide a video recording system, a video recording method, and a video recording program capable of the above.

The subject is a video recording system including a patient terminal for transmitting the biological information acquired from a measuring device for measuring the biological information of a patient, and a management server for receiving and storing the biological information from the patient terminal. The patient terminal or the management server has a determination unit for determining an abnormality in the biological information, and the patient terminal has a video recording means for recording the state of the patient as video information, and the above. When the voice recording means for recording the state of the patient as voice information and the determination unit determines that the biological information is abnormal, the video recording means and the voice recording means start from the time when the abnormality occurs. Until one recording time elapses, the recording unit that records the video information and the audio information, the video information and the audio information, and the time stamp that synchronizes the video information and the audio information with the biometric information. The management server is solved by a video recording system including a first communication unit that transmits to the management server, and the management server includes a storage unit that stores the video information, the voice information, and the time stamp received from the patient terminal. Will be done.

Further, the subject is a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of the patient and recording the state of the patient as video information, and recording the state of the patient as audio information. A video recording method using a patient terminal having a voice recording means and a management server that receives and stores the biological information from the patient terminal, wherein the patient terminal or the management server is the living body. An abnormality determination step for determining an abnormality in information, and when the patient terminal or the management server determines that there is an abnormality in the biometric information, the abnormality is determined by the video recording means and the voice recording means of the patient terminal. The post-abnormal information recording step of recording the video information and the audio information from the time of the occurrence of the abnormality to the elapse of the first recording time, the video information and the audio information recorded by the patient terminal, and the living body. An information transmission step of transmitting information and a time stamp for synchronizing the video information and the audio information to the management server, and the video information, the audio information, and the time received by the management server from the patient terminal. It is solved by a video recording method including an information storage step of storing a stamp.

Further, the subject is a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of the patient and recording the state of the patient as video information, and recording the state of the patient as voice information. A video recording program executed as a program by a patient terminal having a voice recording means and a management server that receives and stores the biological information from the patient terminal, and is the patient terminal or the management server. However, when the abnormality determination step for determining the abnormality of the biological information and the patient terminal or the management server determine that the biological information is abnormal, the video recording means and the audio recording of the patient terminal The post-abnormality information recording step of recording the video information and the audio information from the time when the abnormality occurs until the first recording time elapses by means, and the video information and the audio information recorded by the patient terminal. An information transmission step of transmitting the biometric information, the video information, and a time stamp for synchronizing the audio information to the management server, and the video information and the audio received by the management server from the patient terminal. It is solved by a video recording program that includes an information storage step of storing information and the time stamp.

In the video recording system, video recording method, and video recording program of the present invention configured as described above, when it is determined that there is an abnormality in the biological information, the video information and audio are recorded from the time when the abnormality occurs until the first recording time elapses. The information is recorded, the recorded video information and audio information are transmitted to the management server together with the time stamp, and they are stored in the management server. The medical staff can use the biometric information of the patient and the video / audio information synchronized with the biometric information for medical judgment.

Further, to describe a suitable configuration for the video recording system of the present invention, the recording unit of the patient terminal continuously records the video information and the voice information by the video recording means and the voice recording means. When the determination unit determines that the biological information is abnormal, the video information and the audio information recorded before the second recording time from the time when the abnormality occurs are saved without being erased, and the first communication is performed. The unit transmits the video information and the audio information stored from before the second recording time to the time when the abnormality occurs to the management server together with the time stamp, and the storage unit of the management server is transmitted from the patient terminal. It is preferable to store the video information and the audio information recorded from the time before the second recording time received to the time when the abnormality occurs.
By storing the video information and audio information recorded before the second recording time from the time of the abnormality occurrence in the management server, the medical staff can check the condition of the patient immediately before the abnormality occurs and treat them. It can be used for accurate judgment.

Further, to describe a suitable configuration for the video recording system of the present invention, it is preferable that the first recording time and the second recording time are set according to the type of abnormality in the biological information.
By setting the first recording time and the second recording time according to the type of abnormality in the biological information, the medical staff can observe the patient more finely.

Further, to describe a suitable configuration for the video recording system of the present invention, the video recording means of the patient terminal may be composed of a plurality of cameras having different angles of view.
By using a plurality of cameras with different angles of view, the patient can be recorded from various viewpoints, and the medical staff can observe the patient more finely.

Further, to describe a suitable configuration for the video recording system of the present invention, the management server and a terminal for a medical worker who connects to the patient terminal via communication are further provided, and the management server is for the medical worker. When a reproduction request is received from the terminal via the communication, the control unit that searches the biological information, the video information, the audio information, and the time stamp stored in the storage unit based on the reproduction request. A second communication unit that transmits the biological information, the video information, the audio information, and the time stamp, which are the results of the search by the control unit, to the medical worker terminal. Synchronizes the biometric information, the video information, the audio information, and the third communication unit that receives the biometric information, the video information, the audio information, and the time stamp from the management server, and the biometric information and the video information received from the management server by the time stamp. It is preferable to include a display unit for displaying the information, and an audio output unit for synchronizing the audio information received from the management server with the biometric information displayed on the display unit by the time stamp.

With the above configuration, the medical worker can view the video information and the audio information synchronized with the biological information by using the medical worker terminal. By viewing the video information and audio information synchronized with the biological information, the medical staff can use them for medical judgment.

Further, to describe a suitable configuration for the video recording system of the present invention, the reproduction request may be a reproduction time desired by the medical staff.
With the above configuration, the medical staff can confirm the state of the patient when an abnormality has occurred in the past by video information and audio information.

Further, to describe a suitable configuration for the video recording system of the present invention, the reproduction request is a specific record selected by a medical worker from the history of abnormalities of biological information that has occurred in the past, and is the above-mentioned management server. The control unit may search for the biological information, the video information, the audio information, and the time stamp stored in the storage unit based on the time at which the abnormality occurs in the selected specific recording.
With the above configuration, the medical staff can select a specific record from the history of the biological information in which the abnormality has occurred, and can view the biological information and the video information / audio information synchronized with the biological information. .. It becomes easier to view video information and audio information synchronized with biological information, and medical staff can make medical decisions in a short time.

According to the video recording system, the video recording method, and the video recording program of the present invention, the video information and the audio information synchronized with the biological information in which the abnormality has occurred are stored in the management server. Therefore, for example, a medical worker can use the video information / audio information stored in the management server for medical judgment by referring to the video information / audio information stored in the management server in synchronization with the biometric information.

It is a conceptual diagram which shows the structure of the video recording system which concerns on one Embodiment of this invention. It is a block diagram which shows the basic structure of each apparatus constituting the video recording system which concerns on one Embodiment of this invention. It is a flow chart which shows the process of recording video information and audio information. It is a diagram which shows the recording time of the video information / audio information to be recorded when an abnormality occurs. It is a figure which shows the setting contents for each type of abnormality. It is a diagram which shows the recording time of the video information / audio information to be recorded when two abnormalities occur. It is a block diagram for parallel processing of a video call and recording of video information / audio information. It is a flow chart which shows the process which displays the biological information, the video information, and the audio information in synchronization with each other using the video recording system. It is a schematic diagram which shows the display part and the voice output part of a doctor's terminal.

Hereinafter, one embodiment of the present invention (hereinafter, the present embodiment) will be described. It should be noted that the embodiments described below are merely examples for facilitating the understanding of the present invention, and do not limit the present invention. That is, the present invention can be modified and improved without deviating from the gist thereof, and it goes without saying that the present invention includes an equivalent thereof.
Further, although the video recording system and the video recording method according to the present invention will be described in the following description, the video recording method may be implemented as a program that can be executed by a computer, or the program may be read by a computer. Needless to say, recording may be performed on a possible recording medium.

The video recording system 1 according to the present embodiment will be described with reference to FIGS. 1 and 2. The video recording system 1 is composed of a patient terminal 10, a management server 20 that stores video information and audio information captured and recorded by the patient terminal 10, and a communication line 3 that connects them. The patient terminal 10 and the management server 20 can send and receive data to and from each other via the communication line 3.
Although the Internet is assumed as the communication line 3, the video recording system 1 may be constructed on an intranet provided in the hospital.

The video recording system 1 is also a part of a telemedicine system for a medical worker to perform remote medical care, and a doctor terminal 30 (medical worker terminal) can be connected to a communication line 3. By transmitting the biometric information and the reproduction request of the video information and the audio information synchronized with the biometric information from the doctor terminal 30 to the management server 20, the management server 20 transmits the stored biometric information to the video information and the audio. It can be displayed on the doctor's terminal 30 in synchronization with the information. In the remote medical care system and the video recording system 1, the patient terminal 10 and the doctor terminal 30 are not limited to one, but a plurality of them are prepared, and a plurality of patients and doctors use their respective terminals. , A case where one patient terminal 10 and a doctor terminal 30 are used will be described.

The patient terminal 10, the management server 20, and the doctor's terminal 30 may be dedicated devices, and a dedicated application is installed on a general-purpose information terminal such as a personal computer, a mobile phone, a smartphone, or a tablet terminal capable of communicating. It may be realized by doing.
Further, the management server 20 and the doctor terminal 30 may be constructed on the intranet in the telemedicine center and connected to the patient terminal 10 on the Internet via a gateway. The network configuration is shown in FIG. It is not limited to.

The patient terminal 10 includes a plurality of measuring instruments 40, a built-in camera 15 that captures an image of the patient 5, an external camera (external camera 17) having a different angle of view from the built-in camera 15, and the patient 5. A microphone 18 for recording audio is connected. The built-in camera 15 and the external camera 17 are provided as video recording means, and the microphone 18 is provided as audio recording means. Although an external microphone 18 is used in the present embodiment, a microphone built in the patient terminal 10 may be used as a voice recording means. Further, by connecting the built-in camera 15 and the external camera 17 having a different angle of view, it is possible to record the image information of the patient 5 in a range different from the shooting range of the built-in camera 15. For example, the built-in camera 15 can photograph the patient's face, and the external camera 17 can photograph the whole body of the patient. The plurality of measuring instruments 40 connected to the patient terminal 10 are devices for acquiring biological information of the patient and environmental information around the patient.

The measuring instrument 40 includes a sensor built in the patient terminal 10 and a sensor separated from the patient terminal 10 and arranged around the patient. As the separated sensor, there are a type that comes into contact with the human body such as a chair and a bed, and a type that can be directly attached to each part of the human body to detect biological information. The measuring instrument 40 also includes a sensor that measures environmental information around the patient such as temperature and humidity.

Biological information is information that quantitatively indicates the movements of organs constituting the human body such as blood pressure, pulse, and brain waves. Biological information measuring instruments include, for example, a thermometer, a pulse rate monitor, a sweat meter, etc. provided in the gripped portion of the patient terminal 10. In addition, a blood flow meter, an electric wave meter, an eye movement sensor, an electrocardiogram, a vibration gyro, an acceleration sensor, a skin temperature sensor, a body motion acceleration sensor, a skin conductivity sensor, a pulse meter, and a blood pressure are attached to a part of the patient's body. There are meters, breathing sensors, pupil diameter sensors, tilt sensors, blood oxygen saturation sensors, etc. The measuring instrument 40 provided on a chair, bed, or the like includes a thermography, a weight scale, and a respirator, and extracts pulse, respiration, and weight based on a change in pressure.
The built-in camera 15 and the external camera 17 may be treated as measurement sensors, for example, human movements, changes in facial expressions, eye movements, etc. may be extracted from captured images, and the extracted results may be recorded as biological information. Further, the patient's condition may be extracted from the voice data collected by the microphone 18 and recorded as biological information.

Devices that measure environmental information include thermometers, barometers, altimeters, brightness meters that measure the brightness (brightness) around the patient, gas sensors that measure odors, GPS (Global Positioning System) that measures position information, etc. There is. The measured environmental information may be transmitted to the patient terminal 10 together with the biological information via a wired or wireless communication means, and may be temporarily stored in the recording unit 13 of the patient terminal 10.

The patient terminal 10 is a communicable mobile phone, smartphone, tablet terminal or the like used by the patient as described above. The patient terminal 10 may be a combination of a notebook computer having a communication function and a digital camera. The patient terminal 10 is connected to the measuring device 40 by wire or wirelessly, and is configured to acquire the measured biological information and transmit it to the management server 20.

The patient terminal 10 records the acquired biological information, video information, and audio information with the control unit 11, the communication unit 12 for connecting and communicating with the management server 20 and the doctor terminal 30 via the communication line 3. A recording unit 13 and a determination unit 14 for determining a patient's abnormality from measured biological information and the like are provided. Further, as described above, the patient terminal 10 includes a built-in camera 15 that captures the patient 5, a display unit 16 that displays acquired biological information, environmental information, images, video images, and the like, and an external device that captures the patient. The external camera 17 is provided, a microphone 18 for recording the patient's voice, and a voice output unit 19 for reproducing the voice transmitted from the doctor's terminal 30. Further, in the video recording system 1, the communication unit 12 is provided as the first communication unit.
The patient terminal 10 acquires biological information from the measuring instrument 40 via the communication unit 12, and transmits the acquired biological information to the management server 20. Further, as will be described in detail later, the patient terminal 10 transmits the recorded video information and audio information to the management server 20 via the communication unit 12. At the time of transmission, the communication unit 12 of the patient terminal 10 adds information (hereinafter, time stamp) for associating the biological information with the video information / audio information on the time axis and transmits the information to the management server 20.

Specifically, the patient terminal 10 includes a volatile storage unit (not shown) such as a CPU (Central Processing Unit) and a RAM (Random Access Memory), a non-volatile storage unit (recording unit 13) such as a hard disk or a flash memory, and the like. It has a network interface and the like (communication unit 12) connected to the communication network. The CPU corresponds to the control unit 11, and the control unit 11 controls the communication unit 12, the recording unit 13, the determination unit 14, the built-in camera 15, the display unit 16, the external camera 17, the microphone 18, and the voice output unit 19. The determination unit 14 may be implemented by an application executed by the control unit 11.

The management server 20 is a computer that stores biological information, video information / audio information, and time stamps that are daily received from a plurality of patient terminals 10 and manages the information. The management server 20 is also connected to the doctor terminal 30 via the communication line 3, and receives the biometric information, video information / audio information, and time stamp of the patient 5 from the doctor terminal 30 in response to a request from the doctor terminal 30. Send to 30.

The management server 20 includes a control unit 21, a communication unit 22 for transmitting and receiving data to and from the patient terminal 10 and the doctor terminal 30. Further, it includes a storage unit 23 that stores biological information, video information / audio information, and a time stamp received from the patient terminal 10, a determination unit 24 that determines an abnormality in the patient's biological information, and an input unit 25.
The input unit 25 is a numeric keypad, a keyboard, a touch panel, or a mouse, and is provided for an administrator to extract and edit data from the storage unit 23.

Specifically, the management server 20 includes a volatile storage unit (not shown) such as a CPU and RAM, and a non-volatile storage unit (storage unit 23) such as a hard disk and flash memory, and is a network for connecting to the communication line 3. It has an interface (communication unit 22) and the like. The control unit 21 controls the communication unit 22, the storage unit 23, the determination unit 24, and the like.
Further, in the video recording system 1, the communication unit 22 is provided as a second communication unit.
As described above, the storage unit 23 stores the biological information, the video information / audio information, and the time stamp received from the patient terminal 10. In addition to the information, patient data including a patient ID and a facial photograph is stored in advance, and each information is managed by a table. Data such as biometric information stored in the management server 20 is managed by the administrator, and for example, when the patient ID or the like is changed, the data is corrected by the administrator.

As described above, the doctor terminal 30 is a communicable terminal used by medical professionals such as doctors and nurses, and in the present embodiment, it is a laptop computer or desktop capable of recording / outputting a communication function and video / video / audio. Realized by a personal computer. The doctor terminal 30 may be a mobile phone, a smartphone, a tablet terminal, or the like.
There are usually a plurality of doctor terminals 30, each of which is connected to a communication line 3. The connection means for connecting to the communication line 3 may be wired or wireless.

The doctor terminal 30 is composed of a control unit 31, a communication unit 32, a camera 35, a display unit 36, and a voice output unit 37. The communication unit 32 communicates with the patient terminal 10 and the management server 20. The display unit 36 is a monitoring device for the doctor to confirm the information stored in the management server 20 and the state of the patient. The voice output unit 37 is a speaker that outputs the voice received from the management server 20. Further, in the video recording system 1, the communication unit 32 is provided as a third communication unit.
Specifically, the doctor's terminal 30 includes a volatile storage unit (not shown) such as a CPU and RAM, and a non-volatile storage unit (not shown) such as a hard disk and a flash memory, and is a network for connecting to the communication line 3. It has an interface (communication unit 32). The control unit 31 is a CPU and controls the communication unit 32, the camera 35, the display unit 36, and the voice output unit 37.

A video recording process (video recording method) using the video recording system 1 will be described with reference to FIG. The video recording system 1 determines an abnormality in the biological information of the patient 5, and records video information and audio information based on the determination result.

The patient terminal 10 acquires biological information (measurement data, vital data) from the measuring device 40, receives video information from the built-in camera 15 and the external camera 17, and receives voice information from the microphone 18 as a voice recording means for the patient. Recording is performed in the recording unit 13 of the terminal 10 (S101: information recording step before an abnormality occurs). In the video recording system 1 according to the present embodiment, biological information is constantly measured by the measuring device 40. In addition, video information and audio information are continuously recorded at the same time as biological information. The patient terminal 10 may transmit only the acquired biological information to the management server 20.

The patient terminal 10 constantly analyzes the biological information by the determination unit 14 and determines whether or not there is an abnormality in the biological information (S102: abnormality determination step). Judgment as to whether or not there is an abnormality in the biological information is performed by comparing a preset threshold value with the measured value of the biological information.
As a method for determining whether or not there is an abnormality, a method for determining an abnormality from the characteristics of a waveform such as an electrocardiogram waveform may be used in addition to the determination method using a threshold value. In addition, environmental information such as temperature and humidity around the patient may be used to determine whether or not there is an abnormality in the biological information.

When the patient terminal 10 transmits the biometric information to the management server 20, the determination unit 24 of the management server 20 may perform the abnormality determination of the biometric information. When the management server 20 performs the abnormality determination, the abnormality is determined by a more complicated determination method, for example, the characteristics of the waveform such as the electrocardiogram waveform, or the abnormality is determined by learning AI (Artificial Intelligence). Can be done.

When the determination unit 14 determines that there is no abnormality in the biological information (No in S102), the video information / audio information recorded before the predetermined time from the determination time is deleted from the recording unit 13 (S103: Information erasure step). Pre-recording using a so-called ring buffer is performed for video information and audio information before an abnormality occurs. By using the ring buffer, unnecessary video information and audio information are erased from the recording unit 13, and the capacity of the recording unit 13 is not overwhelmed. Therefore, it is possible to prevent the video information / audio information from being unable to be recorded due to insufficient capacity. The time set as the ring buffer of the pre-record may be determined according to the recordable capacity of the recording unit 13 of the patient terminal 10. The preset time for erasing is, for example, the recording time S before the occurrence of an abnormality, which will be described later. Pre-recording is performed in time-division multi-channel as many as the number of built-in cameras 15 and external cameras 17 connected to the patient terminal 10. After erasing the video information / audio information, the recording unit 13 of the patient terminal 10 returns to step S101 and continues recording the biological information and the video information / audio information. Then, the determination unit 14 determines whether or not there is an abnormality in the acquired biological information.

A case where the determination unit 14 determines that there is an abnormality in the biological information (Yes in S102) in the abnormality determination step S102 will be described with reference to FIG. FIG. 4 is a diagram showing whether or not the air video information / audio information is recorded with the time t as the horizontal axis, and the recorded time is shown by a solid line and the recorded time is shown by a broken line.
When the determination unit 14 determines that there is an abnormality in the biological information, the recording unit 13 records a preset recording time (recording time T after the abnormality occurs, first recording) from the time when the abnormality occurs (the time when the abnormality occurs P). Time), video information and audio information after the occurrence of the abnormality are recorded together with the biological body information (S104: Information recording step after the occurrence of the abnormality). Further, the recording unit 13 outputs the video information / audio information to the recording unit 13 without erasing the video information / audio information recorded before the abnormality occurrence recording time S (second recording time) from the abnormality occurrence time point P. save.

Then, the video information / audio information recorded during the recording time T after the abnormality occurrence occurs from the abnormality occurrence time point P, and the video information / audio information recorded before the abnormality occurrence recording time S from the abnormality occurrence time point P. Are merged. By merging, the recording of video information and audio information in the period K before and after the occurrence of the abnormality is completed.

Next, the communication unit 12 of the patient terminal 10 transmits the video information / audio information recorded in the period K before and after the occurrence of the abnormality to the management server 20. The communication unit 12 of the patient terminal 10 also simultaneously transmits a time stamp that synchronizes the biological information with the video information / audio information during the period K (S105: information transmission step).

The management server 20 receives biological information, video information / audio information, and a time stamp from the patient terminal 10 and then stores the information in the storage unit 23 of the management server 20 (S106: information storage step). The biometric information stored by the management server 20 is a state in which the stored biometric information and the video information / audio information can be synchronized with each other by using a time stamp in response to a reproduction request from the doctor terminal 30. It can be transmitted to 30.

The length of time for recording video information and audio information before and after the occurrence of an abnormality (recording time S before the occurrence of an abnormality, recording time T after the occurrence of an abnormality) can be arbitrarily set, and the lengths are the same. It may be set or may be set to different lengths. If the video information / audio information before the abnormality occurrence time P is unnecessary, the recording time S before the abnormality occurrence is set to 0 minutes, and the communication unit 12 records the video information / audio after the abnormality occurrence time point P. The information is transmitted to the management server 20. Depending on the patient's condition and the type of biological information to be measured, it may not be necessary to record the voice information, and it may be possible to select whether or not to record the voice information depending on the setting.

The lengths of the recording time S before the occurrence of an abnormality and the recording time T after the occurrence of an abnormality can be individually set according to the type of abnormality (difference in measurement items, difference in criteria for determining an abnormality, etc.). , The setting can also be set for each patient.

The video information to be recorded may be photographed by using the built-in camera 15 built in the patient terminal 10, or may be photographed by using an external camera 17 connected to the patient terminal 10 wirelessly or by wire. Good. For example, when observing the complexion of a patient, the image is taken with the built-in camera 15 of the patient terminal 10 arranged near the patient's face, and when the whole view is to be observed including the whole body of the patient, the image is taken with the external camera 17. It can be used properly. Further, when the patient terminal 10 is provided with a plurality of built-in cameras 15 having different angles of view, or when a plurality of external cameras 17 are installed, they may be used depending on the purpose.

Further, the image resolution or the audio sampling frequency may be set according to the type of abnormality so as not to unnecessarily increase the amount of data stored in the memory, the hard disk, or the like or the amount of data communication. If it is desired to record the general condition of the patient depending on the type of abnormality, the video information taken by the external camera 17 is recorded at a relatively low resolution. Further, when it is desired to record the facial expression of the patient, the video information may be recorded at a relatively high resolution by using the built-in camera 15.

FIG. 4 shows a specific example of the setting contents according to the type of abnormality. Record R1 shows the case where the abnormal type is "disturbance of heartbeat". Since it is necessary to take a picture of the whole body of the patient in order to see the disorder of the heartbeat, it is set to use an external camera 17 provided to take a picture of the whole body as a video recording means. Further, since observation for a relatively long time is required, the recording time S before the occurrence of an abnormality is set to "10 minutes", and the recording time T after the occurrence of an abnormality is set to "5 minutes". Since recording is performed for a relatively long time, the resolution level is set to SD image quality (720 px × 480 px) and the sampling frequency is set to 24 kHz, thereby reducing the amount of data to be stored.

The record R2 shows the case where "SpO2 (arterial oxygen saturation)" is measured as an abnormal type, and the built-in camera 15 is set to be used as a video recording means for recording the complexion of the patient. Since the recording time may be relatively short, the recording time S before the occurrence of an abnormality is set to "5 minutes" and the recording time T after the occurrence of an abnormality is set to "1 minute". The resolution level is set to HD image quality (1280 px × 720 px), and the sampling frequency is set to 48 kHz to record with relatively high image quality and high sound quality.
The settings of the records R1 and R2 are stored in the patient terminal 10. Further, it may be stored in the management server 20 as patient data 23a. It can be set according to the needs of the patient or doctor, which enables detailed patient observation.

Further, when the patient 5 is measured by using a plurality of types of measuring instruments 40, an abnormality determination of different biological information may be further generated during recording of video information / audio information. For example, as shown in FIG. 6, the same video recording means, for example, the built-in camera 15, is used while recording the video information / audio information at the time when the first abnormality of the biological information is determined (the time when the abnormality occurs P1). When it is set to be used, another abnormality of biometric information may be determined at a later time point (abnormality occurrence time point P2). In such a case, the end of the video recording time is adjusted to the recording end time of the abnormality determined later. The video information / audio information is transmitted to the management server 20 after the recording end time of the abnormality determined later, and at this time, the video information / audio information having the length of the period K3 in which the two abnormalities are recorded is time stamped. Will be sent with. In addition, the data of the time when the abnormality occurred is also transmitted.

When playing back on the doctor's terminal 30, the management server 20 causes the doctor's terminal 30 to play back the video information / audio information according to the recording disclosure time and the recording end time set according to each abnormality at the time of playback. Send to. That is, when the abnormality occurrence time point P1 is selected by the medical staff, the video information / audio information of the length of the period K1 including the recording time S1 before the abnormality occurrence and the recording time T1 after the abnormality occurrence is output, and the abnormality occurrence occurs. When the time point P2 is selected, the video information / audio information having the length of the period K2, which is the sum of the recording time S2 before the occurrence of the abnormality and the recording time T2 after the occurrence of the abnormality, is output. Compared with the case where the video information / audio information is stored separately, the duplicate video information / audio information stored in the management server 20 can be reduced.

As described above, the video recording system 1 of the present embodiment is a part of a telemedicine system capable of diagnosing a patient by a doctor in a remote place. Therefore, it may be necessary to start a video call with the doctor terminal 30 while the patient terminal 10 is recording video information / audio information. Therefore, in the video recording system 1 of the present embodiment, as shown in FIG. 7, the video information / audio information 42 recorded by the built-in camera 15 and the microphone 18 is stored as data so that one of the processes is not put on hold. It is configured to be temporarily held in the buffer 43. Using the video information / audio information 42 held in the data buffer 43, the recording unit 13 records the information on the hard disk or the memory (recording device 44). Further, the communication unit 12 transmits the video information / audio information 42 held in the data buffer 43 to the doctor terminal 30 for a video call. By using the data buffer 43, the recording unit 13 and the communication unit 12 operate independently, and two processes can be executed in parallel. Therefore, it is possible to prevent one of the processes from being put on hold.

Next, a method of synchronizing and displaying biological information and video information / audio information using a doctor's terminal 30 will be described with reference to FIGS. 8 and 9. In the video recording system 1, as described above, the management server 20 records the biological information recorded by the patient terminal 10 in the past and the video recorded in a state in which the biological information is synchronized or synchronized with the biological information on the time axis. Information / audio information is stored. The biological information and the video information / audio information can be referred to at any time from the doctor's terminal 30 via the communication line 3. By referring to the video information and audio information synchronized with the biological information, the medical staff can make a more appropriate judgment when an abnormality occurs in the patient.

In the video recording system 1 of the present embodiment, in order to realize this, the management server 20 stores the biometric information and the management time stamp included in the video information / audio information or newly added. .. The management server 20 searches for and collates a management time stamp in response to a request from the doctor terminal 30, and synchronizes the video information / voice information with the biometric information to display the video / voice information. Send to 30.

The display of the video information / audio information is started by specifying an arbitrary time by the medical staff, or the abnormality determination result (vital sign) of the biological information displayed on the doctor's terminal 30 is displayed in chronological order. This is done by selecting the displayed alert history. When the alert history is used as the display start point of the video / audio information, as described above, since the video / audio information is recorded for a certain period before and after the judgment time, the time offset, that is, the display start point Can be shifted back and forth by an arbitrary amount of time.

A process of displaying video information / audio information on the doctor's terminal 30 will be described with reference to FIG. First, the medical staff uses the doctor's terminal 30 to input the playback time of the video information / audio information of the patient 5 who wants to play back as a playback request, or refer to the alert history displayed on the screen. Specify the abnormality judgment result (vital sign) that you want to display. The management server 20 receives a reproduction request from the doctor terminal 30 (S201).
The management server 20 (more specifically, the control unit 21) has a management time included in or added to the biometric information and the video information / audio information based on the reproduction request received from the doctor terminal 30. The stamp is searched and collated (S202). When the doctor specifies a specific record among the abnormality judgment results, the time stamp is searched and collated based on the time when the abnormality judgment result is recorded.

The management server 20 transmits the biometric information that is the search result, the video information / audio information synchronized with the biometric information, and the time stamp to the doctor terminal 30 (S203). The doctor terminal 30 synchronizes the received biometric information and the video information with a time stamp and displays it on the display unit 36, and synchronizes the biometric information and the audio information with the time stamp to the audio output unit 37. Output (S204).

FIG. 9 shows an output image displayed on the doctor's terminal 30. The time of reproduction (reproduction time) is indicated on the upper part 36a of the screen of the display unit 36. The captured video information is reproduced in the central portion 36b of the screen, and the measured biological information (electrocardiogram, SpO2) is shown in the lower portion 36c of the screen. In addition, voice information is output to the voice output unit 37 of the doctor terminal 30. Biological information, video information, and audio information are displayed or output synchronously on the time axis based on the time stamp. A medical worker using the doctor's terminal 30 adjusts the playback time by selecting the play button 36d, the pause button 36e, the rewind button 36f, and the fast forward button 36g provided on the right side of the screen. Can be done.

The medical staff talks with the patient 5 using a separate video call system to check the current situation of the patient 5 with a live image and to view the image of the patient 5 taken when an abnormality is found in the biological information. It can be referred to and more appropriate medical judgment can be made.
Further, since the management server 20 stores video information and audio information only for the recording time set before and after the time of the biometric information in which the abnormality is determined, and does not record information unnecessary for medical judgment, the management server 20 is used. It does not overwhelm the storage capacity of 20. Further, since unnecessary information is not transmitted from the management server 20, the medical staff can easily find the video information / audio information necessary for the medical judgment, and can see the photographed state of the patient 5 in a short time. The screen layout of the display unit 36 is an example, and may be different from the layout shown in FIG.

The video recording system and the video recording method according to the present embodiment have been described above with reference to the drawings. Further, in the above embodiment, the doctor terminal 30 has been described as a terminal used by a doctor or a nurse, but the user of the doctor terminal 30 is used not only by a terminal used by a doctor or a nurse but also by a care worker. It may be a terminal used by a nursing care provider or a terminal used by a health care provider.

1 Video recording system 3 Communication line 5 Patient 10 Patient terminal 11 Control unit 12 Communication unit (first communication unit)
13 Recording unit 14 Judgment unit 15 Built-in camera 16 Display unit 17 External camera 18 Microphone 19 Audio output unit 20 Management server 21 Control unit 22 Communication unit (second communication unit)
23 Storage unit 24 Judgment unit 25 Input unit 30 Doctor's terminal (medical worker's terminal)
31 Control unit 32 Communication unit (third communication unit)
35 Camera 36 Display 36a Upper screen 36b Central screen 36c Lower screen 36d Play button 36e Pause button 36f Rewind button 37 Audio output unit 40 Measuring instrument 42 Video information / audio information 43 Data buffer 44 Recording device P, P1, P2 Time of occurrence of abnormality T, T1, T2 Recording time after occurrence of abnormality (first recording time)
S, S1, S2 Recording time before abnormality occurrence (second recording time)
K, K1, K2, K3 Period R1, R2 records

The task is to connect a patient terminal that transmits the biological information acquired from a measuring device that measures the biological information of the patient to the patient terminal by a communication line , and the patient terminal to the patient terminal via the communication line. A video recording system including a management server that receives and stores biometric information, wherein the patient terminal or the management server has a determination unit that determines an abnormality in the biometric information, and the patient terminal is , The video recording means for recording the state of the patient as video information, the voice recording means for recording the state of the patient as voice information, and the video recording when the determination unit determines that the biological information is abnormal. A recording unit that records the video information and the audio information, the video information, the audio information, and the video information from the time when the abnormality occurs until the first recording time elapses by the means and the audio recording means. The management server includes a first communication unit that transmits the voice information and the time stamp for synchronizing the biometric information to the management server, and the management server receives the information from the patient terminal via the communication line. A storage unit for storing the video information, the voice information, and the time stamp is provided , and the recording unit of the patient terminal continuously records the video information and the voice information by the video recording means and the voice recording means. When the determination unit determines that there is an abnormality in the biological information, the video information and the audio information recorded before the second recording time from the time when the abnormality occurs are saved without being erased, and the above-mentioned The first communication unit transmits the video information and the audio information stored from before the second recording time to the time when the abnormality occurs to the management server together with the time stamp, and the storage unit of the management server is the patient. The problem is solved by a video recording system characterized by storing the video information, the audio information, and the time stamp recorded from before the second recording time to the time when the abnormality occurs, which is received from the terminal via the communication line. To.

Further, the subject is a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of the patient and recording the state of the patient as video information, and recording the state of the patient as voice information. A video recording method using a patient terminal having a voice recording means and a management server connected to the patient terminal by a communication line and receiving and storing the biometric information from the patient terminal via the communication line. The patient terminal or the management server continuously records the video information and the audio information in an abnormality determination step for determining an abnormality in the biological information, and the patient terminal continuously records the video information and the audio information for the patient. When the terminal or the management server determines that there is an abnormality in the biometric information, an abnormality occurs in which the video information and the audio information recorded before the second recording time from the time when the abnormality occurs are saved without being erased. Pre-information recording step and
When the patient terminal or the management server determines that there is an abnormality in the biometric information, by the image recording means and said audio recording means of the patient terminal, from the abnormality occurrence time point elapsed first recording time The post-abnormality information recording step of recording the video information and the audio information, the patient terminal synchronizes the recorded video information and the audio information with the biological information, the video information, and the audio information. An information transmission step of transmitting a time stamp to the management server, and an information storage step of storing the video information, the audio information, and the time stamp received by the management server from the patient terminal via the communication line. It is solved by a video recording method characterized by including.

Further, the subject is a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of the patient and recording the state of the patient as video information, and recording the state of the patient as voice information. It is executed as a program by a patient terminal having a voice recording means and a management server connected to the patient terminal by a communication line and receiving and storing the biometric information from the patient terminal via the communication line. In the video recording program, the patient terminal or the management server continuously records the video information and the audio information in an abnormality determination step for determining an abnormality in the biometric information, and the patient terminal continuously records the video information and the audio information. When the patient terminal or the management server determines that there is an abnormality in the biological information, the video information and the audio information recorded before the second recording time from the time when the abnormality occurs are not deleted. abnormality before information recording step of storing, when the patient terminal or the management server determines that there is an abnormality in the biometric information, by the image recording means and said audio recording means of the patient terminal, the abnormality The post-abnormality information recording step of recording the video information and the audio information from the time of occurrence until the first recording time elapses, the video information and the audio information recorded by the patient terminal, the biometric information, and the biometric information. The information transmission step of transmitting the video information and the time stamp for synchronizing the audio information to the management server, and the video information and the audio information received by the management server from the patient terminal via the communication line. It is solved by a video recording program including an information storage step for storing the time stamp.

Further, by storing video information and audio information recorded before the second recording time from abnormality occurring point to the management server, the medical practitioner can check the status of the patient immediately before the abnormality occurs, They can be used for clinical judgment.

Claims (9)

A patient terminal that transmits the biological information acquired from a measuring device that measures the patient's biological information, and a terminal for the patient.
A video recording system including a management server that receives and stores the biological information from the patient terminal.
The patient terminal or the management server has a determination unit for determining an abnormality in the biometric information.
The patient terminal is
A video recording means for recording the state of the patient as video information,
A voice recording means for recording the state of the patient as voice information,
When the determination unit determines that the biological information has an abnormality, the video information and the audio recording means use the video recording means and the audio recording means from the time when the abnormality occurs until the first recording time elapses. A recording unit that records
It includes a first communication unit that transmits the video information and the audio information, and a time stamp for synchronizing the video information and the audio information with the biometric information to the management server.
The management server is a video recording system including a storage unit that stores the video information, the audio information, and the time stamp received from the patient terminal. The recording unit of the patient terminal continuously records the video information and the audio information by the video recording means and the audio recording means, and the determination unit determines that the biological information is abnormal. In this case, the video information and the audio information recorded before the second recording time from the time when the abnormality occurs are saved without being erased.
The first communication unit transmits the video information and the audio information stored from before the second recording time to the time when the abnormality occurs to the management server together with the time stamp.
According to claim 1, the storage unit of the management server stores the video information and the audio information recorded from before the second recording time received from the patient terminal to the time when the abnormality occurs. The video recording system described. The video recording system according to claim 2, wherein the first recording time and the second recording time are set according to the type of abnormality in the biological information. The video recording system according to any one of claims 1 to 3, wherein the video recording means of the patient terminal is composed of a plurality of cameras having different angles of view. Further provided with a medical worker terminal that connects to the management server and the patient terminal via communication.
The management server
When a reproduction request is received from the medical worker terminal via the communication, the biological information, the video information, the audio information, and the time stamp stored in the storage unit are stored based on the reproduction request. The control unit to search and
A second communication unit that transmits the biological information, the video information, the audio information, and the time stamp, which are the results of the search by the control unit, to the medical worker terminal.
The medical worker terminal is
A third communication unit that receives the biological information, the video information, the audio information, and the time stamp from the management server.
A display unit that displays the biological information and the video information received from the management server in synchronization with each other by the time stamp.
Claims 1 to 4, wherein the voice information received from the management server is provided with a voice output unit that synchronizes and outputs the biometric information displayed on the display unit with the time stamp. The video recording system according to any one item. The video recording system according to claim 5, wherein the reproduction request is a reproduction time that the medical staff desires to reproduce. The reproduction request is a specific record selected by a medical professional from a history of abnormalities in biological information that have occurred in the past.
The control unit of the management server searches for the biological information, the video information, the audio information, and the time stamp stored in the storage unit based on the time when the abnormality occurs in the selected specific recording. The video recording system according to claim 5, wherein the video recording system is characterized by the above. It has a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of a patient and recording the state of the patient as video information, and a voice recording means for recording the state of the patient as voice information. A video recording method using a patient terminal and a management server that receives and stores the biological information from the patient terminal.
An abnormality determination step in which the patient terminal or the management server determines an abnormality in the biological information,
When the patient terminal or the management server determines that there is an abnormality in the biological information, the first recording time from the time when the abnormality occurs by the video recording means and the voice recording means of the patient terminal. An information recording step after an abnormality occurs in which the video information and the audio information are recorded until the elapse has passed.
An information transmission step in which the patient terminal transmits the recorded video information and voice information to the management server with a time stamp for synchronizing the biometric information with the video information and voice information.
A video recording method comprising the management server including an information storage step of storing the video information, the audio information, and the time stamp received from the patient terminal. It has a video recording means for transmitting the biological information acquired from a measuring device for measuring the biological information of a patient and recording the state of the patient as video information, and a voice recording means for recording the state of the patient as voice information. A video recording program executed as a program by a patient terminal and a management server that receives and stores the biological information from the patient terminal.
An abnormality determination step in which the patient terminal or the management server determines an abnormality in the biological information,
When the patient terminal or the management server determines that there is an abnormality in the biological information, the first recording time from the time when the abnormality occurs by the video recording means and the voice recording means of the patient terminal. An information recording step after an abnormality occurs in which the video information and the audio information are recorded until the elapse has passed.
An information transmission step in which the patient terminal transmits the recorded video information and voice information to the management server with a time stamp for synchronizing the biometric information with the video information and voice information.
A video recording program, wherein the management server includes an information storage step of storing the video information, the audio information, and the time stamp received from the patient terminal.

Images