KR102164802B1 - The surveillance camera with passive detectors and active detectors - Google Patents

Abstract

The present invention relates to a monitoring camera having a passive detector and an active detector, wherein the passive detector collecting a visible light image and an infrared ray image and detecting ultraviolet light and the active detector detecting an object are integrated into a single monitoring camera to be installed at a plurality of sections to be monitored. The infrared ray image collected by each monitoring camera and the result of detecting the ultraviolet light and the object, are reflected into the collected visible light image to generate a blending image to be provided. Therefore, according to the monitoring camera with the passive detector and the active detector, fire outbreak, flame outbreak, emergence of a new object or the combination thereof in the section to be monitored can be efficiently monitored with only a single blending image. To this end, the present invention comprises: a passive detector; an active detector; and a blending image generating unit.

Description

Surveillance camera with passive and active detectors {THE SURVEILLANCE CAMERA WITH PASSIVE DETECTORS AND ACTIVE DETECTORS}

The present invention relates to a surveillance camera having a passive detector and an active detector, and more specifically, a passive detector for collecting visible and infrared images and detecting ultraviolet rays and an active detector for detecting objects are integrated into one surveillance camera. , By installing in a plurality of surveillance target areas, by generating and providing a blending image reflecting the collected infrared image, the ultraviolet ray and the object detection result in the collected visible light image by each of the surveillance cameras, only one blending image The present invention relates to a surveillance camera having a passive detector and an active detector for efficiently monitoring the occurrence of fire, spark, appearance of a new object, or a combination thereof in the monitoring target area.

As the public's interest in safety is focused due to recent disasters such as fire accidents or increased crime, surveillance using CCTV (closed circuit television) that can be easily installed and applied in various places such as buildings, subways, schools, apartments, etc. The necessity of the system is increasingly emerging.

In the surveillance system using such a conventional CCTV, a plurality of security personnel who constantly monitor a plurality of images received in real time from a plurality of CCTVs installed in the surveillance target area must be present at all times. When the number is expanded, the efficiency is significantly deteriorated. In particular, when a fire occurs in the subject area to be monitored, rapid detection and response are slow.

In order to solve this problem, recently, a plurality of sensors such as a flame detection sensor, a temperature sensor, etc., as well as a CCTV are installed in the area to be monitored, and the image received from the CCTV and the sensor data received from the sensors are integrated and analyzed. As a result, an intelligent fire monitoring system that automatically detects the occurrence of fire has been developed and commercialized.

However, in the conventional intelligent fire monitoring system, the CCTV and each of the sensors are independently driven and individually transmit images and sensor data, so that only the occurrence of a fire can be known, and it is useful to track the cause of the fire. There is a limitation, and in order to transmit and receive the sensor data, it is necessary to establish a separate network for transmitting and receiving sensor data such as a Ubiquitous Sensor Network (USN).

Accordingly, in the present invention, a passive detector for collecting visible and infrared images and detecting ultraviolet rays and an active detector for detecting an object are integrated, and the collected visible light images are applied to the collected visible light images through surveillance cameras respectively installed in a plurality of areas to be monitored. By blending and providing the collected infrared image, ultraviolet detection result, object detection result, or a combination thereof, the monitoring target including fire occurrence, flame generation, appearance of suspicious objects, or combinations thereof through one blended image By enabling efficient monitoring of the area, it is possible to quickly respond to the occurrence of a fire and to quickly identify the detected object, and accurately determine the cause of the fire such as the area where the fire occurred and the ignition point based on the blending image. I would like to propose a way to be able to grasp and track it.

Next, the prior art existing in the technical field of the present invention will be briefly described, and then the technical matters that the present invention intends to achieve differentiated from the prior art will be described.

First, Korean Patent Registration No. 1073076 (2011.10.06.) relates to a fire monitoring system and method using a composite camera, in a composite camera including a visible light camera for taking a visible light image and an infrared camera for taking an infrared image, the The present invention relates to a fire monitoring system and method using a composite camera that analyzes a temperature value detected in a captured infrared image to determine whether a fire has occurred, and then transmits the visible light image and the infrared image to a manager terminal according to the determination result.

That is, the prior art is to detect a fire with an infrared image and transmit the detection result to the administrator terminal.

In contrast, the present invention, in a surveillance camera installed in a plurality of surveillance target areas, collects visible and infrared images, detects ultraviolet rays and detects objects, and detects the collected infrared images, ultraviolet rays, and objects. By generating a blending image that reflects the result or a combination thereof on the collected visible light image and providing it to the control server, it is possible to efficiently monitor the area to be monitored through one blending image. Does not describe or suggest such technical features of the present invention.

In addition, Korean Patent Registration No. 1741107 (2017.05.23) relates to a fire monitoring method and apparatus using CCTV, and constitutes a CCTV including a general camera module for photographing general images and a thermal image camera module for photographing thermal images. And, by receiving the thermal image, which is the captured general image, from the CCTV, winding either flame or smoke from the general image, and obtaining temperature distribution information from the thermal image, a fire occurs in the area where the CCTV is installed. It relates to a fire monitoring method and apparatus using CCTV to determine whether or not it occurred.

The prior art is to detect the occurrence of fire by intensively processing images transmitted by a plurality of CCTVs installed in a plurality of areas at the center, and as in the present invention, a visible light sensor, an infrared sensor, and an ultraviolet ray It is not a combination of a passive detector composed of a sensor and an active detector composed of an object detection sensor for object detection, and the visible light image, infrared image, and ultraviolet detection results collected and detected by the passive detector, and the detection result of the active detector. It does not generate a blended image by blending the object detection result into a single image, and through the blended image, it is possible to efficiently monitor the area to be monitored, including fire, flame, object detection, or a combination thereof. There is also no description of a method for enabling the prior art to have clear differences from the technical features proposed by the present invention.

The present invention was created to solve the above problems, and monitors a plurality of surveillance cameras including a passive detector including a visible light sensor, an infrared sensor, and an ultraviolet sensor, and an active detector that detects an object through a laser pulse. A passive detector and an active type that are arranged in the target area and provided by generating and providing a blended image reflecting the output results of the passive and active detectors from each of the surveillance cameras, so that a single blended image can effectively monitor the area to be monitored. An object thereof is to provide a surveillance camera provided with a detector.

In addition, the present invention makes it possible to efficiently monitor the occurrence of fire, spark, and sudden appearance of objects in the surveillance area through the blending image, and provide rapid response to the occurrence of fire, spark, and the emerged object. Another object of the present invention is to provide a surveillance camera having a passive detector and an active detector capable of accurately grasping and tracking the cause of the occurrence of fire and sparks while performing.

In addition, in the present invention, when it is detected that a fire has occurred in a corresponding monitoring target area using the collected infrared images by each of the surveillance cameras, or a flame is detected in the corresponding monitoring target area based on the result of detecting the ultraviolet rays Providing a surveillance camera equipped with a passive detector and an active detector that allows the load for detecting fire and flame to be distributed to each surveillance camera by generating the blended image only and providing it to the control server. It has another purpose.

In addition, the present invention, the surveillance camera, by simultaneously collecting the visible light image, infrared image, and ultraviolet detection results of the surveillance target area through the passive detector, a temperature value exceeding a preset value in the collected infrared image When there is an infrared detection region having an infrared ray, the temperature value rapidly increases, the infrared ray detection region is expanded, or the occurrence of a flame is detected as a result of the ultraviolet ray detection, the collected infrared image and the collected visible light image By providing the ultraviolet ray detection result as a single blending image, a surveillance camera equipped with a passive detector and an active detector enables rapid response to fire and spark occurrence and visually grasping and tracking the cause of the fire occurrence. To provide is another purpose.

In addition, the present invention provides the blended image to the control server so that the blended image can be transmitted and received through an existing network for transmitting and receiving an image without establishing a separate network for transmitting and receiving sensor data. Another object is to provide a surveillance camera having a passive detector and an active detector.

In addition, the present invention makes it possible to easily implement a surveillance camera having the passive detector and the active detector as a conventional CCTV, so that the blended image can be transmitted and received through a network for transmitting and receiving CCTV images, Another object is to provide a surveillance camera equipped with a passive detector and an active detector that can be efficiently applied even in an area where no infrastructure for monitoring is established.

A surveillance camera having a passive detector and an active detector according to an embodiment of the present invention includes a visible light sensor that collects a visible light image of an area to be monitored, and an infrared image by detecting infrared rays and ultraviolet rays emitted from the area to be monitored, respectively. A passive detector composed of an infrared sensor and an ultraviolet sensor to collect, an object that detects an object in the monitoring target area by using a laser pulse of a specific wavelength band, and collects a scanning image of the monitoring target area including the detected object An active detector composed of a detection sensor and a blended image that reflects the infrared detection result, ultraviolet detection result, object detection result, or a combination thereof to the collected visible light image is generated and provided. It characterized in that it comprises a blending image generator to monitor the occurrence of fire, the occurrence of a spark, the appearance of a new object, or a combination thereof.

In addition, the visible light sensor, the infrared sensor, the ultraviolet sensor, and the object detection sensor are synchronized with the direction and angle of view, and each sensor array constituting the visible light sensor, the infrared sensor, the ultraviolet sensor, and the object detection sensor has a scale of each sensor array. It is characterized in that the synchronization to cover the same area for the monitoring target area according to the ratio of.

In addition, the surveillance camera, from the collected infrared image, an infrared detection area cutout unit for cutting out at least one infrared detection area for the sensed infrared light, ultraviolet rays for the energy distribution of the ultraviolet wavelength detected by the ultraviolet sensor An ultraviolet energy distribution image generator for generating an energy distribution image, an ultraviolet sensing region cutout for cutting out at least one ultraviolet sensing region from the generated ultraviolet energy distribution image, and the at least one detected from the collected scanning image Further comprising an object detection area cutout for cutting out the area of the object, wherein the blending image generation unit corresponds to the collected visible light image by the cut-out infrared detection area, ultraviolet light detection area, object area, or a combination thereof The blended image is generated by blending in a specific region.

In addition, the blending image generator may include a temperature value exceeding a preset threshold value, or extending with a temperature value exceeding the preset threshold value, or wherein the temperature value is a preset threshold value. When it increases above the value, it is detected that a fire has occurred in the monitoring target area, and when the ultraviolet detection area has a preset energy value range, it is detected that a flame has occurred in the monitoring target area, and the fire or When it is detected that the flame has occurred, the information on the fire or flame occurrence is overlaid on the generated blending image, and further comprising providing the blending image together with a notification sound for the fire or flame occurrence. do.

In addition, the blending is performed by calculating a median value for each pixel value for a specific area of a visible light image and a pixel value for the cut-out infrared detection area, the UV detection area, and the object area, and the calculated intermediate value It is characterized in that it is performed by applying a value as a pixel value for a specific area of the visible light image.

In addition, the monitoring method through a surveillance camera equipped with a passive detector and an active detector according to an embodiment of the present invention includes a visible light image and an infrared image of a monitoring target area through a visible light sensor, an infrared sensor, and an ultraviolet sensor constituting the passive detector. Collecting and detecting ultraviolet rays emitted from the monitoring target area, detecting an object in the monitoring target area using a laser pulse of a specific wavelength through an object detection sensor constituting an active detector, and including the detected object Collecting the scanning image for the monitoring target area and generating and providing a blended image reflecting the collected infrared image, ultraviolet detection result, object detection result, or a combination thereof on the collected visible light image And a blending image generation step of monitoring the occurrence of fire, occurrence of sparks, appearance of new objects, or a combination thereof in the monitoring target area with only the image.

In addition, the monitoring method includes: an infrared detection region cutout step of cutting out at least one infrared ray detection region for infrared radiation detected by being emitted from the monitoring target region from the collected infrared image, and the ultraviolet ray detected by the ultraviolet sensor. An ultraviolet energy distribution image generation step of generating an ultraviolet energy distribution image for energy distribution, an ultraviolet detection region cutout step of cutting out at least one ultraviolet ray detection region from the generated ultraviolet energy distribution image, and the collected scanning image An object detection area cut-out step of cutting out the area of at least one detected object, wherein the blending image generation step includes the cut-out infrared detection area, ultraviolet light detection area, object area, or a combination thereof. The blended image is generated by blending in a specific region corresponding to the collected visible light image.

In addition, in the step of generating the blending image, the infrared detection region has a temperature value exceeding a preset threshold value, or is extended with a temperature value exceeding the preset threshold value, or the temperature value is preset. When it increases above the threshold value, it is detected that a fire has occurred in the monitoring target area, and when the ultraviolet detection area has a preset energy value range, it is detected that a flame has occurred in the monitoring target area, and the fire Or when it is detected that the flame has occurred, overlaying the information on the fire or the occurrence of the flame on the generated blending image, and providing the blending image together with a notification sound for the fire or flame occurrence. To do.

As described above, the surveillance camera having a passive detector and an active detector of the present invention includes a plurality of surveillance cameras including a passive detector that collects visible and infrared images and detects ultraviolet rays and an active detector that detects an object. Each installed in the monitoring target area generates and provides a blended image that combines the collected visible and infrared images, the result of detecting the ultraviolet rays, and the object, so that only one blending image is used in the monitoring target area. The effect of efficiently performing monitoring including the occurrence of fire, occurrence of sparks, occurrence of suspicious objects, or combinations of these, enabling rapid response to the occurrence of fire, occurrence of sparks, occurrence of objects, or combinations thereof There is.

In addition, the present invention has the effect of being able to accurately identify and track the cause of the occurrence of the fire or the occurrence of the flame through the blending image when the occurrence of a fire or flame is detected in the monitoring target area.

1 is a view illustrating a surveillance camera having a passive detector and an active detector according to an embodiment of the present invention.
2 is a diagram illustrating a method of generating a blended image through a surveillance camera having a passive detector and an active detector according to an embodiment of the present invention.
3 is a diagram illustrating a blending image according to an embodiment of the present invention.
4 is a block diagram showing the configuration of a surveillance camera including a passive detector and an active detector according to an embodiment of the present invention.
5 is a flowchart illustrating a monitoring process for a surveillance target area through a surveillance camera equipped with a passive detector and an active detector according to an embodiment of the present invention.

Hereinafter, preferred embodiments of a surveillance camera having a passive detector and an active detector of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals in each drawing indicate the same member. In addition, specific structural or functional descriptions of the embodiments of the present invention are exemplified only for the purpose of describing the embodiments according to the present invention, and unless otherwise defined, all terms used herein including technical or scientific terms They have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this specification. It is desirable not to.

1 is a view illustrating a surveillance camera having a passive detector and an active detector according to an embodiment of the present invention.

As shown in FIG. 1, a surveillance camera (hereinafter referred to as a surveillance camera) 100 having a passive detector and an active detector according to an embodiment of the present invention is provided in a building, school, hospital, government office, public place, etc. It is installed in the same multiple areas to be monitored to monitor the occurrence of fires and sparks in real time in the area to be monitored, or to monitor the appearance of new objects.

On the other hand, the passive detector and the active detector are classified according to the subject that emits a specific light source, and when receiving and processing a light source radiated from the outside, they become a passive detector. When the light source is received and processed, it becomes an active detector.

In addition, the passive detector is composed of an image sensor array composed of a charge couple device (CCD) or a complementary metal oxide semiconductor (CMOS), and is composed of a visible light sensor and a thermal infrared temperature sensor array to collect a visible light image of the area to be monitored. It is composed of an infrared sensor that collects infrared images of the monitoring target area and an ultraviolet sensor array, and includes an ultraviolet sensor that detects the occurrence of a spark such as a spark by detecting ultraviolet rays in the monitoring target area.

In addition, the active detector is composed of a photodiode array, emits a laser pulse of a specific wavelength band, receives a reflected pulse signal reflected from a specific object and returns, detects an object in the monitoring target area, and includes the detected object. Thus, it is composed of an object detection sensor (eg, lidar) that generates a scanning image of the area to be monitored.

In addition, the surveillance camera 100 generates a blended image by integrating the collected visible light image, infrared image, and ultraviolet detection result through the passive detector and the detection result of the object through the active detector, and generates the By providing a blended image to the control server 200, the monitoring target area is monitored through a single blending image, including the occurrence of a fire, a spark, the appearance of a new object, or a combination thereof. To be able to perform efficiently.

On the other hand, when the surveillance camera 100 detects that a fire has occurred in the surveillance target area using the infrared image, or when it is detected that a flame has occurred in the surveillance target area using the ultraviolet detection result, the generation The information on the occurrence of fire or flame is overlaid on one blending image in text format, and the generated blending image is provided to the control server 200 along with a notification sound for the occurrence of fire or flame, and the fire The occurrence or occurrence of a spark can be immediately recognized.

This does not allow the control server 200 to centrally collect the visible light image, the infrared image, and the ultraviolet detection result to detect the occurrence of fire and flame, but to detect the occurrence of fire and There is an effect of distributing the load of the control server 200 by providing a blended image reflecting the flame occurrence detection to the control server 200.

The blended image may be blended with the visible light image by cutting out an infrared detection area, which is an area of interest, from an infrared image based on the collected visible light image, or an area of interest (i.e., UV energy distribution area) is cut out and blended with the visible light image, or the area of the detected object is cut out from the scanning image and blended with the visible light image, or a combination thereof is performed.

At this time, the direction, field of view (FOV), collection time, and detection time of the visible light sensor, infrared sensor, ultraviolet sensor, and object detection sensor are synchronized with each other so that a visible light image of the monitoring target area in the same direction and range, Infrared image, ultraviolet detection and object detection, and also the image sensor array of the visible light sensor and the thermal infrared sensor array of the infrared sensor, the ultraviolet sensor array of the ultraviolet sensor and the photodiode sensor array of the object detection sensor, Synchronized to cover the same range of the area to be monitored based on the image sensor array according to the ratio of the size of each array.

For example, when the size of the image sensor array is 1024 x 1024 and the thermal infrared sensor array is 512 x 512, the ratio between the image sensor array and the thermal infrared sensor array is 2:1, so that the thermal infrared sensor One unit sensor constituting the array corresponds to two unit sensors constituting the image sensor array, so that the image sensor array and the thermal infrared sensor array are synchronized to cover the same range. This is applied in the same manner as the ultraviolet sensor array and photodiode sensor array.

Therefore, it is easy to know where a specific part of the infrared image, the scanning image, and the ultraviolet energy distribution image is located in the visible light image.

Meanwhile, the infrared camera detects infrared rays emitted from objects or objects located in the monitoring target area through the thermal infrared temperature array sensor, and calculates a temperature value according to the wavelength of the detected infrared rays. Infrared images of the temperature distribution of are collected.

In addition, the ultraviolet sensor detects ultraviolet rays radiated from the monitoring target area, and the surveillance camera 100 generates an ultraviolet energy distribution image obtained by imaging the energy distribution of ultraviolet wavelengths detected by the ultraviolet sensor, An ultraviolet detection region is cut out from the ultraviolet energy distribution image and blended into the visible light image, thereby generating the blended image.

At this time, the ultraviolet sensor is implemented to detect the occurrence of flame in the monitored area by using a characteristic combustion characteristic that emits a large amount of radiant energy in the ultraviolet region of 180 nm to 260 nm when a flame is initially generated, such as a spark. In this case, the surveillance camera 100 cuts out an area having an energy distribution within a preset range from the generated ultraviolet energy distribution image and blends it with the visible light image, thereby generating the blended image, It is possible to visually and immediately recognize the occurrence of a flame through the generated blending image.

In addition, the object detection sensor is for detecting an object in the monitoring target area and collecting a scanning image for a monitoring target area including the detected object, and the monitoring camera 100 includes the The area of the detected object is cut out and blended into a specific area of the visible light image corresponding to the cut-out area to generate the blended image.

In addition, the surveillance camera 100 is provided with identification information (ID) and location information to be distinguished from other surveillance cameras 100, respectively, and identification information and location information given to one side of the generated blending image By overlaying together and providing it to the customs server 200, it is possible to quickly know the location of the fire.

As described above, the surveillance camera 100 of the present invention is provided by integrating a passive detector and an active detector, and collects visible light images and infrared images of the surveillance target area through the passive detector and the active detector. At the same time, ultraviolet detection and object detection are performed, and the collected infrared image, the ultraviolet ray detection result of detecting the ultraviolet ray, the object detection result of detecting the object, or a combination thereof are blended to the collected visible light image. , Infrared image, ultraviolet detection result, object detection result, or a blended image in which a combination thereof is integrated is generated and provided to the control server 200, so that the monitoring target area can be efficiently monitored through one blending image.

2 is a diagram illustrating a method of generating a blended image through a surveillance camera having a passive detector and an active detector according to an embodiment of the present invention.

As shown in FIG. 2, the surveillance camera 100 having a passive detector and an active detector according to an embodiment of the present invention detects an infrared detection area from an infrared image collected through an infrared sensor constituting the passive detector. Cut-out or cut-out the ultraviolet ray detection area from the ultraviolet energy distribution image generated based on the result of sensing ultraviolet light through the ultraviolet sensor constituting the passive detector, or detect an object by an object detection sensor constituting the active detector The object region is cut out from the generated scanning image, or a combination thereof is performed to generate a blended image for the object region.

On the other hand, the directions and angles of view of the passive detector and the active detector are synchronized, and each sensor array for the visible light sensor, the infrared sensor and the ultraviolet sensor constituting the passive detector and the object detection sensor constituting the active detector is As described above, it is synchronized to cover the same range of the monitoring target area according to the ratio of the

In addition, when the cut-out infrared region exceeds a preset temperature value, the temperature value continuously increases, or extends beyond the preset temperature value, the surveillance camera 100 It detects that a fire has occurred in the area, and performs a notification of the fire occurrence along with the blending image.

In addition, when the ultraviolet detection region cut-out from the ultraviolet energy distribution image has a preset energy range, it detects that a flame has occurred in the monitoring target region, and a notification of the flame occurrence is performed together with the blending image.

The notification is performed by overlaying text on the occurrence of fire or spark on the blended image, or by transmitting an acoustic signal for the occurrence of fire or spark.

Since the temperature value is calculated through the infrared sensor, the monitoring camera 100 detects the occurrence of a fire using the calculated temperature value, and the infrared detection area is cut out for each frame constituting the infrared image. do.

Meanwhile, the ultraviolet energy distribution image is generated based on the wavelength range of ultraviolet rays detected by the ultraviolet sensor, and the surveillance camera 100 cuts out an ultraviolet ray detection region from the generated ultraviolet energy distribution image, and the The cut-out ultraviolet ray sensing region is blended into a specific region corresponding to the collected visible light image.

In addition, the surveillance camera 100 cuts out the area of the detected object from the scanning image collected for the object detected through the object detection sensor, and the cut-out area corresponds to the visible light image. Blend in a specific area.

At this time, since the visible light image, the infrared image, the ultraviolet energy distribution image, and the scanning image are already synchronized according to the synchronization described above, the infrared detection region cut out from the infrared image and the ultraviolet ray cut out from the ultraviolet energy distribution image By blending the cut-out infrared detection area, the ultraviolet detection area, and the area of the object, or a combination thereof, at a specific location of the visible light image corresponding to the location of the detection area and the area of the specific object cut out from the scanning image. , To generate the blending image.

In addition, a background of the blended image is set as a visible light image, and each of the cutout regions is set as a foreground of the blended image.

In addition, in the blending, the cutout calculates a pixel value for each region and an intermediate value for each pixel value of the visible light image corresponding thereto, so that the cutout region in the blended image is displayed. This is done by applying the median value calculated above.

Through this, each cut-out region blended with the visible light image is displayed in a semi-transparent state, so that it is possible to immediately recognize which object or object the infrared sensing region or the ultraviolet sensing region has occurred, and the object It is also possible to immediately recognize whether the area of is an object or an object.

3 is a diagram illustrating a blending image according to an embodiment of the present invention.

As shown in FIG. 3, the surveillance camera 100 according to an embodiment of the present invention includes an infrared detection area in an infrared image collected through an infrared sensor, and an ultraviolet energy distribution generated based on the ultraviolet detection result through the ultraviolet sensor. Detection including the infrared detection, ultraviolet detection, object detection, or a combination thereof by blending the ultraviolet detection area of the image and the object detection area of the scanning image collected through the object detection sensor into the visible light image collected through the visible light sensor. One blending image reflecting the result is generated.

In addition, in the case of the visible light sensor and the infrared sensor, when the frame rate and the photographing time are synchronized, each frame of the visible light image corresponding to the infrared detection region cut out for each frame of the infrared image is blended. In addition, when the frame rates are different, the blending may be performed by selecting a plurality of specific frames of visible light images according to a ratio of the frame rate.

In addition, the surveillance camera 100 selects a plurality of specific frames (eg, odd frames or even frames) constituting the visible light image to the ultraviolet detection region cut out from the ultraviolet energy distribution image, and the cut-out ultraviolet rays Blend the sensing area.

In this case, the surveillance camera 100 performs the blending by replacing the cut-out ultraviolet ray detection region with a pixel value (eg, green, etc.) set in advance according to the energy value, or By increasing the luminance value of the corresponding pixel at a constant rate according to the value, a spark occurs in the area to be monitored or the ultraviolet ray detection result can be visually recognized immediately.

That is, the surveillance camera 100 increases the brightness of each pixel of the ultraviolet detection region blended in the selected plurality of specific frames, thereby having a flickering effect on the ultraviolet detection region when the blended image is displayed. By doing so, it is possible to maximize the visibility for the ultraviolet detection.

In addition, the surveillance camera 100 collects and stores a visible light image and an infrared image for a preset time, and when a fire or flame occurrence is detected in the target area according to the infrared image and ultraviolet detection result , By generating and providing the blending image including the visible light image and the infrared image stored before the detected time, the user can analyze and track the cause of the fire more accurately by analyzing the blending image before the occurrence of fire or flame. To be able to.

In addition, the surveillance camera 100 cuts out an object detection region for the detected specific object from the scanning image based on the scanning image collected through the object detection sensor, and creates a plurality of specific frames constituting the visible light image. By selecting, the blended image is generated by blending in a specific area of the selected frame corresponding to the cut-out object detection area.

That is, the surveillance camera 100 blends the infrared detection area, the ultraviolet detection area, and the object detection area with a visible light image to provide a single blended image, so that a user can generate a fire in the detection target area with only one blended image. , The occurrence of a spark, the appearance of a new object, or a combination thereof is immediately recognized and coped with, and the cause of the fire or spark can be accurately identified and traced.

In addition, the surveillance camera 100 provides by overlaying location information and identification information of the surveillance camera 100 on one side of the generated blended image.

4 is a block diagram showing the configuration of a surveillance camera including a passive detector and an active detector according to an embodiment of the present invention.

As shown in FIG. 4, a surveillance camera 100 having a passive detector and an active detector according to an embodiment of the present invention includes a visible light sensor 110 for collecting visible light images for a surveillance target area, and the surveillance target An infrared sensor 120 that collects an infrared image of an area, a passive detector including an ultraviolet sensor 130 that detects ultraviolet rays generated in the area to be monitored, and detects the object in the area to be monitored. An object detection sensor 140 that collects a scanning image for the area to be monitored including, an infrared detection area cutout unit 150 that cuts out an infrared detection area from the collected infrared image, and energy distribution of the detected ultraviolet rays An ultraviolet energy distribution image generating unit 160 for generating an image, an ultraviolet sensing region cutout 170 for cutting out an ultraviolet sensing region from the generated ultraviolet energy distribution image, and the detected object from the collected scanning image. An object detection area cutout unit 180 that cuts out an object detection area, which is an area, and the cut-out infrared detection area, ultraviolet detection area, object detection area, or a combination thereof are blended with the collected visible light image to produce a blended image. It is configured to include a blending image generating unit 180 to generate.

In addition, the visible light sensor 100 is configured to include an image sensor array, and performs a function of collecting a visible light image for a corresponding monitoring target area.

In addition, the infrared sensor 120 is configured to include a thermal infrared temperature sensor array, detects infrared rays emitted from the monitoring target area, calculates a temperature value according to the detected infrared wavelength, and calculates a temperature for the monitoring target area. It performs the function of collecting infrared images representing distribution.

In addition, the ultraviolet sensor 130 is configured as an ultraviolet sensor array and performs a function of detecting ultraviolet rays emitted from the monitoring target area.

In addition, the object detection sensor 140 composed of the active detector is composed of a lidar including a photodiode sensor array, and emits a laser pulse of a specific wavelength to the area to be monitored, and is reflected by the object. It receives a pulse signal to detect an object in a corresponding monitoring target area, and performs a function of collecting a scanning image of the monitoring target area including the detected object.

Meanwhile, the visible light sensor, the infrared sensor, the ultraviolet sensor, and the object detection sensor (i.e., the lidar) have a direction and a view angle synchronized with each other, and each sensor constituting the visible light sensor, the infrared sensor, the ultraviolet sensor, and the lidar As described above, the array is synchronized to cover the same area of the monitoring target area according to a proportion of its size.

Through this, the infrared sensing region cut out from the infrared image, the ultraviolet sensing region cut out from the generated ultraviolet energy distribution image, and the object sensing region cut out from the scanning image are located at any position of the visible light image. It can be easily known.

On the other hand, the administrator (user) of the control server 200 that has received the blending image checks the blending image, and if the blended regions are not correctly blended, the user may select the control server 200 ), a control signal for synchronizing the direction, angle of view, and each of the sensor arrays of the infrared sensor, ultraviolet sensor, and object detection sensor based on an object (ie, a fixed object) appearing in the visible light image through the surveillance camera ( 200), so that each of the blended regions can be blended to the correct position of the visible light image.

In addition, the infrared sensing region cutout unit 150 supports a function of cutting out at least one infrared sensing region in which infrared rays are detected from the collected infrared image and providing the cut-out to the blending image generating unit 190.

In addition, the ultraviolet energy distribution image generation unit 160, when ultraviolet rays are sensed through the ultraviolet sensor 130, generates an ultraviolet energy distribution image according to the wavelength of ultraviolet rays detected by the ultraviolet sensor 130. Perform.

In addition, the ultraviolet sensing region cutout unit 170 cuts out at least one ultraviolet sensing region from the generated ultraviolet energy distribution image and provides the cutout to the blended image generating unit 190. In this case, as described above, the cut-out ultraviolet ray sensing region is replaced with a pixel value set in advance according to the range of the energy value.

In addition, the object detection area cutout unit 180 cuts out an object detection area for the area of the detected object from the scanning image collected by detecting a specific object by the object detection sensor 140, and the blended image It performs a function provided to the generation unit 190.

In addition, the blending image generation unit 190 blends the cut-out infrared detection region, ultraviolet ray detection region, object detection region, or a combination thereof into the collected visible light image, so that infrared ray, ultraviolet ray, object, or a combination thereof A single blending image reflecting the detected result is generated and provided to the control server 200.

On the other hand, the blending image generating unit 190, based on the cut-out infrared detection region and the cut-out ultraviolet ray detection region, when it is detected that a fire has occurred in a corresponding monitoring target area or that a flame has occurred, The generated blended image is overlaid on whether a fire or flame is generated with text, and a notification sound for the fire or flame is provided together with the blended image.

That is, when it is detected that a fire or flame has occurred, the blending image generating unit 190 overlays the information on which the fire or flame has occurred on the blended image and provides a notification sound for the occurrence of the fire or flame. , It enables the control server 200 to immediately respond to the occurrence of fire or flame.

In this case, the blending image generation unit 190, the temperature value of the cut-out infrared detection region exceeds a preset threshold value, or the infrared detection region exceeding the threshold value is expanded, or the infrared detection region It is detected that a fire has occurred in the area to be monitored when the temperature value of is rapidly increased above a preset threshold.

In addition, the blendy image generation unit 190, when the cut-out ultraviolet detection region has a preset energy value range (that is, the energy value for ultraviolet rays in the 180 nm to 260 nm wavelength band) in the monitoring target area. It detects that it has occurred in a flame such as a spark.

That is, the blending image generation unit 190 generates and provides one blended image including the infrared detection region, the ultraviolet detection region, and the ultraviolet detection region, and the object detection region or a combination thereof, Through the blending video, it is possible to visually and immediately recognize the occurrence of fire, spark, or the appearance of an object, and accurately analyze and track the cause of the occurrence of fire or spark, or accurately identify the identity of a new object that suddenly appeared. To be able to grasp.

In addition, the blending image generator 190, when blending the ultraviolet sensing region and the sensing region of an object, selects and blends a plurality of specific frames constituting the visible light image, thereby detecting ultraviolet rays and blending reflecting object sensing results. Create an image.

In addition, the blending image generator 190, when generating the blending image, overlays the location information and identification information given to the surveillance camera 100 on one side of the generated blending image as described above. .

On the other hand, the control server 190, when the blending image is received from the plurality of surveillance cameras 100, monitors the area to be monitored based on the blending image, and the blended image for the occurrence of fire or flame When information is overlaid or a notification sound for fire or flame occurrence is received along with the blending image, emergency broadcast and the received blending image are transmitted to the user terminal 300 or fire response organization to quickly respond to this And a function of outputting the blended image as a multi-view to a display for monitoring.

In addition, the control server 200 performs a function of receiving and storing the blended image in real time from a plurality of surveillance cameras 100.

In addition, the control server 200 is a fixed object appearing in a visible light image (that is, the background of the blending) when each of the blended cut-out regions in the received blending image is not blended at an exact position. By adjusting the direction and angle of view of the infrared sensor, ultraviolet sensor, and object detection sensor based on, and generating a control signal for synchronizing the sensor array of each sensor and providing it to the monitoring camera 100, the blending is accurately So that it can be done.

In addition, when a blending image in which the fire or flame occurrence is detected is received from the surveillance camera 100, the control server 200 may preferentially enlarge and output the blended image on the display.

In addition, the emergency broadcasting is performed by notifying the occurrence of a fire through speakers, displays, or a combination thereof respectively installed in the monitoring target area, or notifying the occurrence of the fire through interlocking with an existing sound broadcasting system. I can.

In addition, the control server 200 pans and tilts each of the surveillance cameras 100 installed in each of the monitoring target areas through a user's manipulation, including a manager of the control server 200. , Including zoom-in and zoom-out, functions to remotely control the surveillance camera 100 are supported.

5 is a flowchart illustrating a monitoring process for a surveillance target area through a surveillance camera equipped with a passive detector and an active detector according to an embodiment of the present invention.

As shown in FIG. 5, the monitoring, including fire detection, flame detection, or the appearance of an object in a monitoring target area through a monitoring camera 100 having a passive detector and an active detector according to an embodiment of the present invention In the procedure of monitoring a target area, first, the surveillance camera 100 performs a visible light image collection step and an infrared image collection step of collecting a visible light image and an infrared image on the surveillance target area (S110).

The visible light image and the infrared image are collected through a visible light sensor and an infrared sensor constituting the passive detector of the surveillance camera 100.

Next, the surveillance camera 100 detects ultraviolet rays generated in the monitoring target area through an ultraviolet sensor, which is another sensor constituting the passive detector, and generates an ultraviolet energy distribution image according to the detection result. The ultraviolet distribution image generation step is performed (S120).

Meanwhile, as shown in FIG. 5, a visible light image collection step of collecting a visible light image and an infrared image, step S110, which is an infrared image collection step of collecting an infrared image, and a step of detecting the ultraviolet rays to generate an ultraviolet energy distribution image Although it is shown that step S120 is sequentially performed, step S110 and step S120 are performed simultaneously, and it is natural that step S120 is performed in real time.

Next, the surveillance camera 100 transmits a laser pulse of a specific wavelength to the area to be monitored through the object detection sensor 140 constituting the active detector, and receives a reflected pulse signal that is reflected and returned, thereby monitoring the An object detection step of collecting a scanning image of the monitoring target area including the detected object by detecting an object located in the target area is performed (S130).

Meanwhile, as described above, the object detection sensor 140 for detecting the object and collecting the scanning image is composed of a lidar.

In addition, the object detection step is performed in real time under the control of the control server 200 or performed in a preset time period (eg, at night).

Next, the surveillance camera 100 cuts out an infrared detection region from the collected infrared image, an ultraviolet detection region from the generated ultraviolet energy distribution image, and an object detection region or a combination thereof from the scanning image, By blending the visible light image, a blending image generation step of generating a blended image and providing the blended image is performed (S140).

In other words, the surveillance camera 100 includes: an infrared detection region cutout step of cutting out an infrared detection region from the infrared image, an ultraviolet detection region cutout step of cutting out an ultraviolet ray detection region from the ultraviolet energy distribution image, the A blending image by performing an object detection region cutout step of cutting out an object detection region from the scanning image, and blending the cut-out infrared detection region, ultraviolet ray detection region, object detection region, or a combination thereof with the collected visible light image It is to perform the step of generating a blended image that generates and provides.

On the other hand, during the blending, in the step of generating the blending image, it is detected that a fire has occurred in the monitoring target area based on the infrared detection area, or that a flame has been detected in the monitoring target area based on the ultraviolet detection area. In this case, information about this (that is, text on the occurrence of fire or flame) is overlaid on the blending image, and a notification sound for the fire or flame is provided along with the generated blending image as described above.

At this time, the monitoring camera 100, wherein the infrared detection region exceeds a preset threshold, the infrared detection region is expanded, or the temperature value of the infrared detection region rapidly increases above a preset threshold. In this case, it is detected that the fire has occurred, and when the ultraviolet detection area has an energy value within a preset range, it is detected that a flame has occurred in the monitoring target area.

Meanwhile, since the method of generating the blended image has been described with reference to FIGS. 2 and 3, further detailed description will be omitted.

Thereafter, the control server 200 receiving the blending image performs monitoring on the plurality of areas to be monitored based on the blending image, and when the blending image includes information on the occurrence of fire or flame, It judges that a fire or flame has occurred in the area to be monitored, performs an immediate emergency broadcast, and provides the received blended image to fire response organizations and users to quickly respond, and at the same time, using the blended image to respond to fire. Let the cause be identified and traceable

As described above, the surveillance camera including the passive detector and the active detector of the present invention detects infrared detection, ultraviolet detection, object detection, or a combination thereof in a monitoring target area in real time through the passive detector and the active detector. By generating a blended image incorporating the detected result, and providing it, it is possible to visually and immediately grasp the occurrence of fire, spark, or the appearance of suspicious objects, thereby efficiently monitoring the area to be monitored. By making it possible to do so, there is an effect of promoting the safety of the monitoring target area.

In the above, a preferred embodiment according to the present invention has been described above, but the technical idea of the present invention is not limited thereto, and each component of the present invention is changed or modified within the technical scope of the present invention to achieve the same object and effect. Can be.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications may be implemented by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: Surveillance camera with passive detector and active detector
110: visible light sensor 120: infrared sensor
130: ultraviolet sensor 140: object detection sensor
150: infrared detection area cutout unit 160: ultraviolet energy distribution image generation unit
170: UV detection area cut-out part 180: Object detection area cut-out part
190: blending image generator

Claims (10)

A passive detector comprising a visible light sensor for collecting a visible light image, an infrared sensor for collecting an infrared image by detecting infrared rays, and an ultraviolet sensor for detecting ultraviolet rays for the area to be monitored;
An active detector comprising an object detection sensor configured to detect an object in the monitoring target area through a laser pulse of a specific wavelength and collect a scanning image of the monitoring target area including the detected object; And
The collection of the infrared detection region cut out from the collected infrared image, the ultraviolet detection region cut out from the ultraviolet energy distribution image generated according to the ultraviolet detection result, the region of the object cut out from the scanning image, or a combination thereof Includes; a blending image generator for generating and providing a blended image blended with one visible light image,
The blending image generator,
When the infrared detection region has a temperature value exceeding a preset threshold value, extends with a temperature value exceeding the threshold value, or increases above the threshold value, the monitoring target Detect the occurrence of fire in the area,
When the ultraviolet detection area has a preset energy value range, it detects the occurrence of flame in the monitoring target area,
When the occurrence of fire or flame is detected, information on the occurrence of fire or flame is overlaid on the generated blending image, and a notification sound for the detected fire occurrence or flame is provided together with the overlayed blending image. A surveillance camera equipped with a passive detector and an active detector characterized by. The method according to claim 1,
The visible light sensor, infrared sensor, ultraviolet sensor, and object detection sensor,
The direction and angle of view are synchronized,
Each sensor array constituting the visible light sensor, infrared sensor, ultraviolet sensor, and object detection sensor,
A surveillance camera having a passive detector and an active detector, characterized in that synchronizing to cover the same area for the surveillance target area according to a ratio to the size of each sensor array. The method according to claim 1,
The surveillance camera,
An infrared detection area cutout unit for cutting out at least one infrared detection area according to the infrared detection result from the collected infrared image;
An ultraviolet energy distribution image generator that generates an ultraviolet energy distribution image for ultraviolet rays detected by the ultraviolet sensor;
An ultraviolet detection region cut-out unit for cutting out at least one ultraviolet ray detection region according to the ultraviolet detection result from the generated ultraviolet energy distribution image; And
An object detection area cut-out unit that cuts out an area of the at least one object detected from the collected scanning image; and
The blending image generator,
The passive detector and the active detector, characterized in that the cut-out infrared detection area, the ultraviolet detection area, the object area, or a combination thereof are respectively blended into a specific area corresponding to the collected visible light image to generate the blended image A surveillance camera equipped with. delete The method of claim 3,
The blending,
Each pixel value for the cut-out infrared detection area, ultraviolet light detection area, and object area, and a specific area of the collected visible light image corresponding to the cut-out infrared detection area, ultraviolet light detection area, and object area. A surveillance camera having a passive detector and an active detector, characterized in that it is performed by calculating an intermediate value for each pixel value for each and applying the calculated intermediate value as a pixel value for a specific region of the visible light image. . Collecting a visible light image and an infrared image of the area to be monitored through a visible light sensor, an infrared sensor, and an ultraviolet sensor constituting the passive detector, and detecting ultraviolet light;
Detecting an object in the monitoring target area using a laser pulse of a specific wavelength through an object detection sensor constituting an active detector, and collecting a scanning image of the monitoring target area including the detected object; And
The collection of the infrared detection region cut out from the collected infrared image, the ultraviolet detection region cut out from the ultraviolet energy distribution image generated according to the ultraviolet detection result, the region of the object cut out from the scanning image, or a combination thereof Including; a blending image generating step of generating and providing a blended image blended with one visible light image,
The step of generating the blending image,
When the infrared detection area has a temperature value exceeding a preset threshold value, extends with a temperature value exceeding the threshold value, or increases above the threshold value, the monitoring target area Detect the occurrence of fire in
When the ultraviolet detection area has a preset energy value range, it detects the occurrence of flame in the monitoring target area,
When the occurrence of fire or flame is detected, information on the occurrence of fire or flame is overlaid on the generated blending image, and a notification sound for the detected fire occurrence or flame is provided together with the overlayed blending image. A monitoring method through a surveillance camera equipped with a passive detector and an active detector characterized by. The method of claim 6,
The visible light sensor, infrared sensor, ultraviolet sensor, and object detection sensor,
The direction and angle of view are synchronized,
Each sensor array constituting the visible light sensor, infrared sensor, ultraviolet sensor, and object detection sensor,
A monitoring method through a surveillance camera having a passive detector and an active detector, characterized in that synchronization is performed to cover the same area for the area to be monitored according to a ratio to the size of each sensor array. The method of claim 6,
The monitoring method,
An infrared detection region cut-out step of cutting out at least one infrared ray detection region for infrared radiation detected by being emitted from the monitoring target region from the collected infrared image;
An ultraviolet energy distribution image generating step of generating an ultraviolet energy distribution image for ultraviolet rays sensed through the ultraviolet sensor;
An ultraviolet detection region cutout step of cutting out at least one ultraviolet ray detection region from the generated ultraviolet energy distribution image; And
An object detection region cutout step of cutting out the region of the at least one object detected from the collected scanning image; further comprising,
The step of generating the blending image,
The passive detector and the active detector, characterized in that the cut-out infrared detection area, the ultraviolet detection area, the object area, or a combination thereof are respectively blended into a specific area corresponding to the collected visible light image to generate the blended image Surveillance method through a surveillance camera equipped with. delete The method of claim 8,
The blending,
Each pixel value of the cut-out infrared detection area, ultraviolet detection area, and object area, and a specific area of the collected visible light image corresponding to the cut-out infrared detection area, UV detection area, and object area Monitoring with a passive detector and an active detector, characterized in that it is performed by calculating the median value for each pixel value for, and applying the calculated median value as a pixel value for a specific region of the visible light image. Surveillance method through camera.

Images