JP7521251B2 - Monitoring and control device and monitoring and control system - Google Patents

Description

This disclosure relates to a surveillance control device and surveillance control system that uses surveillance cameras to monitor entrances and exits.

Patent Document 1 discloses technology related to a security monitoring system. The monitoring system of this technology includes exit and entrance cameras placed at the exit and entrance of a structure, a detector that detects people entering and exiting, an image recording system that stores images from the entrance and exit cameras, and a computer vision system that analyzes the recorded images sent from the image recording system. The computer vision system analyzes the recorded images to determine whether the person exiting and the person entering are the same person.

Special Publication No. 2004-516557

In a system that records image data from multiple video cameras, such as the image recording system of Patent Document 1, the video cameras can be connected to each of the multiple input channels of the recording device, allowing the image data from each video camera to be recorded simultaneously. Here, existing recording devices that record image data from surveillance cameras may have a limited number of input channels. When considering reconstructing a surveillance system that uses multiple surveillance cameras using such existing recording devices, it is possible that the number of available input channels of the recording device will be insufficient for the number of surveillance cameras. In such cases, it is necessary to efficiently record image data from multiple surveillance cameras using the limited input channels of the recording device.

The present disclosure has been made to solve the problems described above, and aims to provide a surveillance control device and surveillance control system capable of outputting image data from multiple surveillance cameras from a single output channel.

The surveillance control device disclosed herein comprises an input unit having multiple input channels and accepting input of multiple pieces of imaging data captured by each of multiple surveillance cameras, an image analysis unit performing image analysis of the multiple pieces of imaging data to extract facial image data including a human facial image from the multiple pieces of imaging data, and an output unit having a single output channel and outputting the facial image data to a recording device, wherein the multiple pieces of imaging data are data captured of a surveillance area including entrances and exits of a structure, and further comprises a detection device that detects the approach of a person to the surveillance area, and the image analysis unit is configured to start image analysis of the multiple pieces of imaging data when the detection device detects the approach of a person .

In addition, the monitoring and control system of the present disclosure comprises a plurality of surveillance cameras that capture images of the entrance and exit areas of a structure, a recording device that records the inputted imaging data, and a monitoring and control device interposed between the multiple surveillance cameras and the recording device, and the monitoring and control device comprises an input unit having multiple input channels and accepting input of a plurality of imaging data captured by each of the multiple surveillance cameras, an image analysis unit that performs image analysis of the plurality of imaging data to extract facial image data including a human facial image from the plurality of imaging data, an output unit having a single output channel and outputting the facial image data to the recording device, and a detection device that detects the approach of a person to the monitored area, and the image analysis unit is configured to start image analysis of the plurality of imaging data when the detection device detects the approach of a person .

The monitoring control device disclosed herein receives multiple pieces of imaging data from multiple input channels. The monitoring control device then extracts facial image data including a human facial image from the multiple pieces of imaging data, and outputs the extracted facial image data from a single output channel to a recording device. This makes it possible to output image data from multiple surveillance cameras from a single output channel.

The monitoring and control system of the present disclosure also includes multiple monitoring cameras that capture images of the entrance and exit areas of a structure, a recording device that records the input image data, and the above-mentioned monitoring and control device. With this configuration, it is possible to provide a system that outputs image data from multiple monitoring cameras to the recording device from a single output channel.

1 is a diagram illustrating an example of a configuration of a monitoring and control system according to an embodiment; FIG. 2 is a functional block diagram for explaining functions of a monitoring control device. 4 is a time chart showing an example of real-time output processing performed by the monitoring control device. 4 is a time chart showing an example of a delay output process performed by the monitoring control device. FIG. 2 is a diagram illustrating an example of hardware resources of a monitoring and control device. FIG. 11 is a diagram illustrating another example of hardware resources of a monitoring and control device.

The following describes the embodiment with reference to the drawings. Note that elements common to each drawing are given the same reference numerals and duplicated explanations are omitted.

Embodiment
1. Configuration of the embodiment 1-1. Configuration of the monitoring control system FIG. 1 is a diagram showing an example of the configuration of a monitoring control system according to the present embodiment. The monitoring control system 100 is a system for monitoring the entrance and exit of people through an entrance and exit 30 of a structure. The entrance and exit 30 includes a door that separates an outside 32 of the structure from an inside 34. In the following description, the outside 32 side of the entrance and exit 30 is also called the "entrance side," and the inside 34 side of the entrance and exit 30 is also called the "exit side." The monitoring control system 100 includes a plurality of monitoring cameras 2 and 4 that capture images of a monitoring area including the entrance and exit 30 of the structure from different positions, a passive sensor 6, a monitoring control device 10, and a recording device 20.

The multiple surveillance cameras 2, 4 include an entrance surveillance camera 2 attached to the ceiling on the entrance side of the entrance/exit 30, and an exit surveillance camera 4 attached to the ceiling on the exit side of the entrance/exit 30. Hereinafter, when there is no need to distinguish between these cameras, they will simply be referred to as "surveillance cameras 2, 4."

The entrance monitoring camera 2 is a camera for monitoring people entering and exiting from the entrance side of the entrance/exit 30. The entrance monitoring camera 2 is attached, for example, to the ceiling on the entrance side. The monitoring area captured by the entrance monitoring camera 2 includes the entrance/exit 30 and its surrounding area outside the room 32.

The exit monitoring camera 4 is a camera for monitoring people entering and exiting from the exit side of the entrance/exit 30. The exit monitoring camera 4 is attached, for example, to the ceiling on the exit side. The monitoring area captured by the exit monitoring camera 4 includes the entrance/exit 30 and its surrounding area in the room 34.

The surveillance cameras 2 and 4 are each connected to the surveillance control device 10. The connection may be wired or wireless. The image data captured by the surveillance cameras 2 and 4 is output to the surveillance control device 10.

The passive sensor 6 is a detection device for detecting the approach of a person to the entrance/exit 30. In the example configuration of the monitoring and control system 100 shown in FIG. 1, the passive sensor 6 is attached to the ceiling on both the entrance side and the exit side. The ON/OFF detection signal detected by the passive sensor 6 is output to the monitoring and control device 10.

The monitoring control device 10 is a device that outputs imaging data input from multiple monitoring cameras 2, 4 to a recording device 20. The monitoring control device 10 has multiple input channels and a single output channel. The multiple monitoring cameras 2, 4 are each connected to the multiple input channels, and the recording device 20 is connected to the single output channel. In this way, the monitoring control device 10 is interposed between the multiple monitoring cameras 2, 4 and the recording device 20 to control the input and output of imaging data. The functions of the monitoring control device 10 will be described in detail later.

The recording device 20 is a storage device that records the imaging data input from the monitoring control device 10. The recording device 20 is, for example, a non-volatile or volatile semiconductor memory such as a flash memory, or a magnetic disk. The above-mentioned monitoring control device 10 is connected to an input channel of the recording device 20. There is no limit to the number of input channels that the recording device 20 has. However, in the monitoring control system 100 of this embodiment, it is assumed that there is only one input channel that can be used for connection to the monitoring control device 10.

1-2. Configuration of the monitoring control device Fig. 2 is a functional block diagram for explaining the functions of the monitoring control device. As shown in this figure, the monitoring control device 10 has, as its functions, an input unit 102, an image analysis unit 104, a time information addition unit 106, a camera information addition unit 108, a storage unit 110, and an output unit 112.

The input unit 102 is a functional block for accepting input of multiple pieces of image data captured by each of the multiple surveillance cameras 2 and 4. The input unit 102 has multiple input channels. The multiple surveillance cameras 2 and 4 are connected to each of the multiple input channels.

The memory unit 110 is a functional block for temporarily storing various data processed by the monitoring control device 10. The functions of the memory unit 110 are realized by a storage device such as a RAM or HDD. The memory unit 110 temporarily stores the imaging data input from the input unit 102. In response to a request from the image analysis unit 104, the memory unit 110 outputs the stored imaging data to the image analysis unit 104.

The image analysis unit 104 is a functional block for performing image analysis of the imaging data input from the storage unit 110. The image analysis unit 104 uses a known image analysis method to extract imaging data that includes a human face image from the input imaging data. In the following description, imaging data that includes this face image is referred to as "face image data." The image analysis unit 104 stores the extracted face image data in the storage unit 110.

The time information addition unit 106 is a functional block for adding time information to face image data. The time information addition unit 106 adds the capture time of the face image data to the image.

The camera information adding unit 108 is a functional block for adding camera identification information to face image data. The camera information adding unit 108 adds, to the image, camera identification information corresponding to the security camera that captured the face image data.

The output unit 112 is a functional block for outputting facial image data to the recording device 20. The output unit 112 has a single output channel. The output unit 112 normally outputs the facial image data stored in the memory unit 110 in real time. This form of output processing is hereinafter referred to as "real-time output processing". In addition, for example, facial image data from the exit monitoring camera 4 may be extracted while facial image data extracted from the entrance monitoring camera 2 is being output in real time. In this case, the output unit 112 outputs the facial image data from the exit monitoring camera 4 in sequence after the output of the currently output facial image data from the entrance monitoring camera 2 has ended. This form of output processing is hereinafter referred to as "delay output processing". The operation of these output processes will be described in detail below.

2. Output processing operation of face image data using the monitoring control device Next, a description will be given of an output processing operation of face image data using the monitoring control device 10. The output processing performed by the monitoring control device 10 can be in the form of real-time output processing or delayed output processing.

3 is a time chart showing an example of real-time output processing performed by the monitoring control device 10. Here, an example is shown in which a person moving from the outdoor side to the indoor side of the entrance/exit 30 is monitored. First, when the monitoring control device 10 receives an ON signal from the passive sensor 6 at time t1, the image analysis unit 104 starts image analysis processing of the image data V1 input from the entrance monitoring camera 2 and the image data V2 input from the exit monitoring camera 4.

If the image analysis unit 104 recognizes a facial image of a person at the entrance/exit 30 from the imaging data V1 captured from outside the room during the period from time t2 to time t3, the image analysis unit 104 extracts the imaging data including the facial image as facial image data V1f. The time information addition unit 106 adds the imaging time of the facial image data V1f to the image. In addition, the camera information addition unit 108 adds camera identification information corresponding to the entrance monitoring camera 2 that captured the facial image data V1f to the image. The output unit 112 outputs the extracted facial image data V1f to the recording device 20 in real time during the period from time t2 to time t3.

In addition, during the period from time t4 to time t5, if the image analysis unit 104 recognizes a facial image of a person at the entrance/exit 30 from the imaging data V2 captured from the inside of the room, the image analysis unit 104 extracts the imaging data including the facial image as facial image data V2f. During the period from time t4 to time t5, the output unit 112 outputs the extracted facial image data V2f to the recording device 20 in real time. After that, when the monitoring control device 10 receives an OFF signal from the passive sensor 6 at time t6, the image analysis unit 104 stops the image analysis process of the imaging data.

In this way, the real-time output process performed by the monitoring control device 10 makes it possible to extract only face image data from the image data captured by the multiple monitoring cameras 2 and 4 and output it to the recording device 20 from a single output channel. This makes it possible to record the image data from the multiple monitoring cameras 2 and 4 on the recording device 20 even if the number of available input channels on the recording device 20 is limited.

In addition, the real-time output process performed by the monitoring control device 10 outputs only the facial image data required for monitoring, effectively reducing the recording capacity of the recording device 20. In addition, since unnecessary imaging data is not recorded, efficiency can be improved when viewing recorded images.

In addition, with real-time output processing, the capture time and camera identification information are added to the facial image data. This makes it possible to easily check the capture time and camera identification information when viewing the facial image data.

4 is a time chart showing an example of the delay output process performed by the monitoring control device 10. Here, an example is shown in which a person moving from the outdoor side to the indoor side of the entrance/exit 30 is monitored. First, when the monitoring control device 10 receives an ON signal from the passive sensor 6 at time t1, the image analysis unit 104 starts image analysis processing of the image data V1 input from the entrance monitoring camera 2 and the image data V2 input from the exit monitoring camera 4.

If the image analysis unit 104 recognizes a facial image of a person at the entrance/exit 30 from the imaging data V1 captured from outside the room during the period from time t2 to time t4, the image analysis unit 104 extracts the imaging data including the facial image as facial image data V1f. The time information addition unit 106 adds the imaging time of the facial image data V1f to the image. In addition, the camera information addition unit 108 adds camera identification information corresponding to the entrance monitoring camera 2 that captured the facial image data V1f to the image. The output unit 112 performs real-time output processing on the extracted facial image data V1f during the period from time t2 to time t4.

If the image analysis unit 104 recognizes a facial image of a person at the entrance/exit 30 from the imaging data V2 captured from inside the room at time t3 during the period when real-time output processing is being performed on the facial image data V1f, the image analysis unit 104 extracts the imaging data including the facial image as facial image data V2f. The time information addition unit 106 adds the imaging time of the facial image data V2f to the image. In addition, the camera information addition unit 108 adds camera identification information for identifying the exit monitoring camera 4 that captured the facial image data V2f to the image.

Here, while the real-time output process for the facial image data V1f is being executed, the facial image data V2f cannot be output. Therefore, the output unit 112 executes a delayed output process that delays the start of output of the facial image data V2f until the real-time output process for the facial image data V1f is completed. Specifically, the output unit 112 outputs the extracted facial image data V2f to the recording device 20 during the period from time t4, when the real-time output process for the facial image data V1f is completed, to the subsequent time t6. After that, when the monitoring control device 10 receives an OFF signal from the passive sensor 6 at time t7, the image analysis unit 104 stops the image analysis process of the captured image data.

In this way, the delayed output process performed by the monitoring control device 10 makes it possible to output the facial image data to the recording device 20 in sequence from a single output channel, even if multiple facial image data are extracted at the same time. This makes it possible to record the image data of multiple monitoring cameras 2, 4 in the recording device 20, even if the number of available input channels of the recording device 20 is limited.

In addition, the delayed output process performed by the monitoring control device 10 outputs only the facial image data required for monitoring, effectively reducing the recording capacity of the recording device 20. In addition, because unnecessary imaging data is not recorded, efficiency can be improved when viewing recorded images.

In addition, the delayed output process adds the capture time and camera identification information to the facial image data. This makes it possible to accurately grasp the actual capture time and camera identification information even if the output time is delayed by the delayed output process.

3. Modifications of the embodiment The monitoring and control device of the embodiment may be modified as follows.

3-1. Configuration of the monitoring control device The time information adding unit 106 and the camera information adding unit 108 are not essential functions of the monitoring control device 10 of this embodiment. Therefore, the monitoring control device 10 does not necessarily have to include the functions of the time information adding unit 106 and the camera information adding unit 108.

3-2. Configuration of Multiple Surveillance Cameras There are no limitations on the structure and arrangement of the surveillance cameras as long as they are capable of capturing images of people's faces. In other words, the surveillance cameras may be, for example, intercom-type cameras mounted on a wall.

3-3. Configuration of Passive Sensor The passive sensor 6 is not an essential component of the monitoring and control system 100 of this embodiment. That is, the monitoring and control device of the monitoring and control system 100 may constantly execute the analysis process of the captured image data. In addition, when the monitoring and control system 100 includes the passive sensor 6, there is no limitation on the arrangement and number of the passive sensor 6. For example, the passive sensor 6 may be built into the monitoring camera.

In this embodiment, a passive sensor 6 is described as an example of a detection device for detecting the approach of a person to the entrance/exit 30. However, the detection device may be, for example, a card reader installed on the wall surface of the entrance/exit 30, as long as it is configured to detect the approach of a person to the entrance/exit 30. In this case, whether or not a person is approaching the entrance/exit 30 can be determined based on whether or not a card is read by the card reader.

3-4. Monitoring control device In this embodiment, the input unit 102, the image analysis unit 104, the time information addition unit 106, the camera information addition unit 108, the storage unit 110, and the output unit 112 indicate functions possessed by the monitoring control device 10. FIG. 5 is a diagram showing an example of hardware resources of the monitoring control device 10. The monitoring control device 10 includes a processing circuit 120 including, for example, a processor 122 and a memory 124 as hardware resources. The functions possessed by the storage unit 110 are realized by the memory 124. The memory 124 is, for example, a semiconductor memory. The monitoring control device 10 realizes the functions of each unit shown in the input unit 102, the image analysis unit 104, the time information addition unit 106, the camera information addition unit 108, the storage unit 110, and the output unit 112 by executing a program stored in the memory 124 by the processor 122.

Figure 6 is a diagram showing another example of hardware resources of the monitoring control device 10. In the example shown in Figure 6, the monitoring control device 10 includes a processing circuit 130 including, for example, a processor 132, a memory 134, and dedicated hardware 136. Figure 6 shows an example in which some of the functions of the monitoring control device 10 are realized by the dedicated hardware 136. All of the functions of the monitoring control device 10 may be realized by the dedicated hardware 136. As the dedicated hardware 136, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these can be used.

2 Entrance monitoring camera, 4 Exit monitoring camera, 6 Passive sensor, 10 Monitoring control device, 20 Recording device, 30 Entrance/exit, 32 Outside, 34 Inside, 100 Monitoring control system, 102 Input unit, 104 Image analysis unit, 106 Time information addition unit, 108 Camera information addition unit, 110 Storage unit, 112 Output unit, 120 Processing circuit, 122 Processor, 124 Memory, 130 Processing circuit, 132 Processor, 134 Memory, 136 Dedicated hardware

Claims (7)

an input unit having a plurality of input channels and configured to receive input of a plurality of pieces of image data captured by a plurality of surveillance cameras;
an image analysis unit that performs image analysis of the plurality of pieces of imaging data to extract face image data including a human face image from the plurality of pieces of imaging data;
an output unit having a single output channel and outputting the face image data to a recording device ;
The plurality of pieces of imaging data are data obtained by imaging a monitoring area including an entrance and exit of a structure,
A detection device that detects the approach of a person to the monitoring area is further provided,
The image analysis unit of the monitoring control device is configured to start image analysis of the multiple pieces of imaging data when the detection device detects the approach of a person. The monitoring and control device according to claim 1, wherein the output unit is configured to output the facial image data in real time. The monitoring and control device according to claim 1, wherein when multiple pieces of face image data are extracted by the image analysis unit at the same time, the output unit is configured to output the multiple pieces of face image data in sequence. The monitoring control device according to any one of claims 1 to 3, further comprising a time information adding unit that adds the imaging time to the image of the facial image data. The monitoring control device according to any one of claims 1 to 4, further comprising a camera information adding unit that adds information identifying the monitoring camera used to capture the image of the facial image data. A plurality of surveillance cameras that capture images of a surveillance area including an entrance and exit of a structure from different positions;
a recording device for recording the input image data;
a monitoring control device interposed between the plurality of monitoring cameras and the recording device,
The monitoring and control device includes:
an input unit having a plurality of input channels and configured to receive input of a plurality of pieces of image data captured by each of the plurality of surveillance cameras;
an image analysis unit that performs image analysis of the plurality of pieces of imaging data to extract face image data including a human face image from the plurality of pieces of imaging data;
an output unit having a single output channel and outputting the face image data to the recording device;
A detection device that detects the approach of a person to the monitoring area ,
The image analysis unit is configured to start image analysis of the multiple image data when the detection device detects the approach of a person. The plurality of surveillance cameras include
An entrance monitoring camera disposed on the entrance side of the entrance;
An exit monitoring camera disposed on the exit side of the entrance;
The monitoring and control system according to claim 6 .

Images