KR102118345B1 - System for Providing Realtiime Trenches Security Guard Service by using Drone in Field - Google Patents

Abstract

The present invention provides a system for providing a real-time three-dimensional guard service in a field using a drone. The system comprises: a guard drone (110) having a camera mounted thereon; a drone controller (120) to control the guard drone (110) and transmit image information or drone flight information or fuselage state information in real time via a communication module; a field guard mobile communication terminal (130) to receive the image information; a GIS server (140) to provide integrated geographic information; and an image control server (150) to provide a monitoring control service. Image information of a guard field is shared by a drone control agent, a guard field agent, and a guard integrated control room to three-dimensionally identify a guard situation in real time to provide an organic three-dimensional guard service. A plurality of guard drones deployed for field guard are simultaneously flight-controlled in the guard integrated control room. Image information is converted into a three-dimensional image to be provided to three-dimensionally identify the guard field.

Description

System for Providing Realtiime Trenches Security Guard Service by using Drone in Field}

The present invention relates to a real-time on-site three-dimensional security service providing system using a drone, and more specifically, to monitor the security scene's video information in real-time three-dimensionally by sharing the video information of the security field with a drone control agent and a security field agent and the integrated security control room. The present invention relates to a system for providing a real-time three-dimensional security service using a drone that can simultaneously control flight of multiple security drones to be put into field security at the security control control room.

As is well known, drones are used for high-speed shooting for simple hobby or professional video production.

On the other hand, prior art has been disclosed to apply the drone technology to the security service or autonomous crime, the conventional Korean Patent Registration No. 1700395 for the security drone and a mobile security system using the same, as shown in FIG. 50) a signal detection unit for detecting the location of the subject 10 wearing the wearer, a photographing unit for generating a photographed image by photographing the subject 10, and detecting a dangerous situation of the subject 10 and performing a situation action function To control the flight of the drone 100 by maintaining the reference distance range with the target action unit and the target person 10, the drone 100 to the target action distance range up to the target action distance range in response to the danger situation detection It includes a flight control unit to approach, to detect the obstacle to control the flight of the drone 100, and monitor while moving the subject.

However, the drone 100 is made to fly according to the movement of the subject 10 by the signal strength of the signaling device 50, and the video is sent to the guardian terminal 200n, the police server 200a, and the emergency rescue server 200b. As a simple configuration to transmit, it is not suitable for VIP security to which high security and high security level are applied, and it is necessary to make the security situation in real time three-dimensional grasping by the drone control agent and security field agent and the security control control room. Drone technology that can simultaneously control flight is required.

Korean Registered Patent Publication No. 1700395 (Drone for security and mobile security system using the same, 2017.02.13) Korean Registered Patent Publication No. 1813102 (Security Service Provision System, 2017.12.28) Korean Registered Patent Publication No. 1802669 (Autonomous crime prevention system using drone, 2017.11.28)

The technical problem to be achieved by the idea of the present invention is to share the video information of a security scene in a drone control agent and a security guard field agent and a security integrated control room so that the security situation can be grasped in real-time and put into the field security in the security integrated control room. The purpose of the present invention is to provide a real-time on-site stereoscopic security service providing system using drones, which can simultaneously control multiple security drones.

In order to achieve the above object, the present invention is equipped with an optical camera, a thermal imaging camera, a GPS, a gyroscope, and an altitude measurement sensor, and at least two or more security drones flying over the security area over the security scene; Adjust the flight of the guard drone at the scene of the security guard, video information of the guard drone, the latitude and the altitude and speed of the guard drone, the flight direction, the drone flight information of the flight distance and the home distance, and the remaining battery capacity of the guard drone. A drone controller that receives the gas status information of the satellite reception strength and transmits the image information, the drone flight information, and the gas status information in real time through a communication module; A field security mobile communication terminal that receives and monitors the video information from the drone controller; GIS server that provides map-based integrated geographic information of the adjacent areas of the security field; And it is formed at a remote site from the security scene, in conjunction with the integrated geographic information provided from the GIS server, the image information transmitted from the drone controller and the drone flight information and the aircraft state information, and analyze the security object or the security scene Including the drone flight information on the video information and the integrated geographic information, the flight route information of the security guard drone and the control service for monitoring the aircraft status information, including a drone integrated video control server; including, the video of the security scene Information is shared between the on-site security mobile communication terminal and the drone integrated video control server to identify the security scene in real time, and the drone integrated video control server controls flight of the multiple security drones by using the drone. Provide a system for providing three-dimensional security services.

Here, the airspace information of the security guard drone, and the weather and wind direction or wind speed and humidity and temperature and the sunrise or sunset and the drone flight environment information of the geomagnetic field are transmitted to the drone controller and the drone integrated video control server. , It may further include a flight environment information providing server.

In addition, the drone integrated video control server, based on the geographic features of the security scene by the integrated geographic information provided from the GIS server, and the flight airspace information provided by the flight environment information providing server and the drone flight environment information Alternatively, the flight path of the security guard drone may be set to generate autonomous flight information and transmitted to the security guard drone through the drone controller to perform autonomous flight.

In addition, the drone integrated video control server, in the event of an emergency of the security scene, can provide warning information to the security scene through the speaker or warning lights of the security drone put into the security scene.

In addition, the drone integrated video control server provides unique identification information of text and color identification information for each of the plurality of security drones, and the drone flight information and flight path information for each security drone overlapping on the integrated geographic information. The aircraft status information and the image information may be separately displayed and provided.

In addition, the drone integrated video control server categorizes the video information, the drone flight information, the aircraft status information, and the flight path and stores them in a DB or stores them in a cloud through a network and analyzes them using big data technology. By doing so, it is possible to extract useful information for the security service or use it for security education.

Also, the drone integrated video control server catalogs the video information and stores it in the DB, transmits the list to the field security mobile communication terminal, and the drone integrated video control server or the field security mobile communication terminal comprises the The corresponding image information can be searched through a list and the retrieved image information can be enlarged or reduced and displayed.

In addition, the security drone and the drone controller wirelessly transmit and receive information to each other through a communication protocol of WiFi, OcuSync 2 or Lightbridge 2, select the communication protocol according to the drone flight information and the aircraft state information, and the drone controller And the field security mobile communication terminal and the drone integrated video control server can wirelessly transmit and receive information through 5G or LTE.

In addition, the video information, the drone flight information, the flight route information, and the aircraft status information from the drone controller to the drone integrated video control server or the field security mobile communication terminal may be encrypted and transmitted by a mobile VPN. .

In addition, the drone controller according to the number of the security drones that are input to the security scene may share and share the image information, the drone flight information, and the gas state information with each other.

In addition, the security drone is equipped with a stereo camera additionally to generate video information of the security scene, and the drone controller or the integrated video control server of the drone can convert the video information into 3D stereoscopic images and provide it.

In addition, the security drone may autonomously fly by tracking the security object by continuously tracking the security object by tracking the position by the location tracking module or by identifying the object by the object identification module.

According to the present invention, it is possible to provide an organic and three-dimensional security service by real-time three-dimensional grasping of the security situation by sharing the video information of the security scene in a drone control agent and a security field on-site agent and the security integrated control room. At the same time, multiple security drones that are put into field security are simultaneously controlled, and image information is converted into 3D stereoscopic images to provide a three-dimensional identification of the security scene.

In addition, by multi-displaying video information, drone flight information, and aircraft status information, and sharing specific information about the security scene in real time, it is possible to enhance the ability of field security personnel to respond to the field, and to be encrypted by security solutions. It can be transmitted to ensure stable control of the drone's flight control and prevent hacking of transmitted information.

Furthermore, by analyzing stored image information, drone flight information, aircraft status information, and flight path using big data technology, extract useful information for the security service or use it for security training, and field security personnel follow the security object tracking. It has the effect of reducing the burden on the task of the control personnel and enabling the security service to efficiently operate the security resources.

1 shows a conventional security drone and a mobile security system using the same.
2 shows a schematic configuration diagram of a real-time on-site stereoscopic security service providing system using a drone according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating an information transmission configuration diagram of a real-time three-dimensional security service providing system using the drone of FIG. 2.
FIG. 4 illustrates a photo of a security drone and a drone controller of a real-time three-dimensional security service providing system using the drone of FIG. 2.
FIG. 5 exemplifies video control by a drone integrated video control server using a field real-time stereoscopic security service providing system using the drone of FIG. 2.
6 and 7 illustrate the UI by the flight environment information providing server of the field real-time stereoscopic security service providing system using the drone of FIG. 2.

Hereinafter, embodiments of the present invention having the above-described features will be described in more detail with reference to the accompanying drawings.

2 shows a schematic configuration diagram of a real-time on-site stereoscopic security service providing system using a drone according to an embodiment of the present invention, and FIG. 3 shows information on a real-time on-site stereoscopic security service providing system using the drone of FIG. 2 The configuration diagram is illustrated, and FIG. 4 illustrates a photo of a security drone and a drone controller of a field real-time stereoscopic security service providing system using the drone of FIG. 2, and FIG. 5 shows a real-time stereoscopic field using the drone of FIG. The video control by the drone integrated video control server by the security service providing system is exemplified, and FIGS. 6 and 7 illustrate the UI by the flight environment information providing server of the field real-time stereoscopic security service providing system using the drone of FIG. It is an example.

2 to 7, the on-site real-time three-dimensional security service providing system using a drone according to the present invention, as a whole, a security drone 110 equipped with a camera and a security drone 110 are adjusted and a communication module is provided. A drone controller 120 that transmits image information or drone flight information or aircraft status information in real time, a field security mobile communication terminal 130 that receives image information, and a GIS server 140 that provides integrated geographic information, Consisting of a video control server 150 that provides monitoring and control services, the video information of the security field is shared by the field security mobile communication terminal 130 and the drone integrated video control server 150 to grasp the security situation in three dimensions in real time. And, the main purpose is to control the number of security drones 110 by the drone integrated video control server 150.

First, the guard drone 110 is composed of at least two or more, as shown in Figures 2 and 4 (a), the optical camera 111, the thermal imaging camera 112, GPS 113 and 3 axis Equipped with a gyroscope 114 and an altitude measurement sensor 115, the security area over the security field is manually adjusted by the drone controller 120 at a ground level (AGL:Above Ground Level) 50m or a drone integrated video control server ( By flying along the autonomous flight path set by the waypoint by 150, it is possible to realize an invisible guard so that noise caused by a drone flight is not recognized by a security object (VIP) or a security scene.

On the other hand, the security drone 110 is equipped with a stereo camera 118 additionally to generate video information of the security scene, and the drone controller 120 or the drone integrated video control server 150 converts the video information into 3D stereoscopic images. By providing, it is possible to make the security scene grasp in three dimensions.

Next, the drone controller 120 provides FPV (First Person View), and as shown in FIGS. 2 and 4 (b), controls the flight of the security drone 110 at the security scene, and the optical camera ( 111) and the image information taken by the thermal imaging camera 112, the latitude and speed, flight direction, flight distance and home distance by the GPS 113 or the 3-axis gyroscope 114 or the altitude measurement sensor 115 ( Home Point-Aircraft: Distance between drone and drone controller) and high-level drone flight information, and battery level (%) of light drone 110, satellite recognition number, satellite reception strength, average voltage (V) and cell (cell) ) Receives gas state information of number and voltage per cell.

In addition, through a communication module (not shown), video information, drone flight information, and aircraft status information are transmitted to the field security mobile communication terminal 130 and the drone integrated video control server 150 through the streaming server 125 in real time. Or directly to the drone integrated video control server 150 including a streaming function.

Here, the 5.8 GHz band may be used to transmit image information between the drone 110 and the drone controller 120, and the 2.4 GHz band may be used to transmit drone adjustment signal information, drone flight information, and aircraft state information.

In addition, the security guard drone 110 and the drone controller 120 wirelessly transmit and receive information through the communication protocol of WiFi, OcuSync 2 or Lightbridge 2, and automatically select the optimal communication protocol according to the drone flight information and aircraft status information. To send and receive.

On the other hand, the drone controller 120, the field security mobile communication terminal 130 and the drone integrated video control server 150 may transmit and receive information to each other wirelessly through 5G or LTE.

In addition, the guard drone 110 and the drone controller 120 may maintain a steering distance of about 1Km, display the steering distance through the drone controller 120, and may provide a departure warning when the steering distance exceeds 1Km.

In addition, the corresponding drone controller 120 according to the number of guard drones 110 inputted to the guard site allows multi-display and sharing of video information, drone flight information, and aircraft status information with each other, thereby real-time detailed information about the guard field. By sharing, it is possible to enhance the ability of field security personnel to cope with the field.

Next, the field security mobile communication terminal 130 may receive the video information from the drone controller 120 or the drone integrated video control server 150 to enable the field security personnel to monitor in real time at the security scene.

Next, the GIS (Geographic Information System) server 140 provides the map-based integrated geographic information for the geographic features in the adjacent area of the security scene to the drone integrated video control server 150.

Next, the drone integrated video control server 150 is formed at a remote site from the security scene and interlocks with the integrated geographic information provided from the GIS server 140.

On the other hand, it is configured to communicate with the drone controller 120 and the field guard mobile communication terminal 130 through the streaming server 125, or the drone integrated video control server 150 may be configured to include the function of the streaming server 125. You can.

That is, the drone integrated video control server 150 analyzes the video information, the drone flight information, and the aircraft state information transmitted from the drone controller 120, as shown in FIG. It can display and provide drone flight information, flight route information, and aircraft status information on drone image information and integrated geographic information.

Here, the drone integrated video control server 150 assigns and distinguishes the unique identification information of the text and the unique identification information of the color for each of the plurality of security drones 110, and the drone flight information for each security drone overlapping on the integrated geographic information. Flight path information, aircraft status information, and image information can be classified and provided by providing a milty display.

Next, the flight environment information providing server 160, as shown in Figures 6 and 7, the flight airspace information of the security guard drone 110, and the weather and wind direction or wind and humidity and temperature and sunrise at the guard site Alternatively, sunset and geomagnetic drone flight environment information may be transmitted to the drone controller 120 and the drone integrated video control server 150 through a user interface (UI).

For example, referring to (a) of FIG. 6, the flight airspace information includes a drone safety flight area, an ultralight flight device flight area, a pilot project area, a flight prohibition area, a control area, a flight restriction area, a danger area, a military operation area, and a training area. Provided in color and control zones, and referring to FIGS. 6B and 7, the drone flight environment information includes weather and wind direction or wind and humidity and temperature and sunrise or sunset and geomagnetic observation index or forecast index. Provides

Here, the light drone 110 is capable of flying above 5° below zero on a clear day, so it is necessary to secure drone flight environment information of weather and temperature.

On the other hand, the drone integrated video control server 150, the geographic information of the security scene by the integrated geographic information provided from the GIS server 140, and the above-described flight airspace information provided from the flight environment information providing server 160 Based on the drone flight environment information, the flight path of the guard drone 110 may be set to generate autonomous flight information and transmitted to the guard drone 110 through the drone controller 120 to perform autonomous flight.

In addition, the drone integrated video control server 150, in the event of an emergency of the security scene, to provide warning information to the security scene through the speaker 116 or warning lights 117 of the security drone 110 that is put into the security scene. On the other hand, it is possible for the field security personnel to quickly recognize and respond.

Meanwhile, the drone integrated video control server 150 may categorize video information, drone flight information, aircraft status information, and flight paths and store them in a DB (not shown) or in a cloud (not shown) through a network. .

Subsequently, the drone integrated video control server 150 may analyze stored video information, drone flight information, aircraft status information, and flight path using big data technology to extract useful information for the security service or use it for security education. .

In addition, the drone integrated video control server 150 catalogs the video information and stores it in a DB, transmits the list to the field security mobile communication terminal 130, and the drone integrated video control server 150 or the field security mobile communication terminal. The 130 may inquire the corresponding image information through the list and enlarge or reduce the displayed image information to provide it.

In addition, due to the nature of the security, the video information from the drone controller 120 to the drone integrated video control server 150 or the field security mobile communication terminal 130, the drone flight information, the flight route information, and the aircraft status information are the mobile VPN (Virtual Private Network). ) It can be encrypted and transmitted by a security solution, so that the drone's flight control rights can be secured and hacking of transmission information can be blocked.

In addition, the security drone 110 tracks the location of the security object by the location tracking module 119a, or identifies the object by the object identification module 119b, and continuously follows the security object to autonomously fly and drone controller. It is possible to efficiently operate the security service for the security service by reducing the burden on the task of the field security personnel operating the (120) or the control personnel operating the drone integrated video control server (150).

Therefore, by constructing a real-time on-site stereoscopic security service providing system using the drone as described above, the video information of the security scene is shared by the drone control agent and the on-site security agent and the security integrated control room to grasp the security situation in real-time in three dimensions. By providing an organic and three-dimensional security service, the integrated security control room simultaneously controls multiple security drones for field security, converts and provides image information into 3D stereoscopic images to identify the security scene in three dimensions. It is possible to enhance the ability of field security personnel to respond to the field by multi-displaying video information, drone flight information and aircraft status information, and sharing specific information about the security field in real time, and is encrypted by a security solution. By transmitting, it secures the flight control right of the drone, blocks hacking of the transmission information, and analyzes the stored image information, drone flight information, aircraft status information, and flight path using big data technology to provide useful information for the security service. It can be extracted or used for escort education, and it is possible to efficiently operate the escort service through the escort service by reducing the burden on the field escort and control personnel by following the escort.

The configurations shown in the embodiments and drawings described in this specification are only the most preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, and various equivalents can be substituted at the time of the application. It should be understood that there may be water and variations.

110: guard drone 111: optical camera
112: thermal imaging camera 113: GPS
114: gyroscope 115: altitude measurement sensor
116: speaker 117: warning lights
118: stereo camera 119a: location tracking module
119b: object identification module 120: drone controller
125: streaming server
130: on-site security mobile communication terminal 140: GIS
150: drone integrated video control server 160: flight environment information providing server

Claims (12)

At least two security drones flying over the security field over the security scene by installing an optical camera, a thermal imaging camera, a GPS, a gyroscope, and an altitude sensor; Adjust the flight of the guard drone at the scene of the security guard, video information of the guard drone, the latitude and the altitude and speed of the guard drone, the flight direction, the drone flight information of the flight distance and the home distance, and the remaining battery capacity of the guard drone. A drone controller that receives the gas condition information of the satellite reception strength and transmits the image information, the drone flight information, and the gas condition information in real time through a communication module; A field security mobile communication terminal that receives and monitors the video information from the drone controller; GIS server that provides map-based integrated geographic information of the adjacent area of the security field; And it is formed at a remote site from the security scene, in conjunction with the integrated geographic information provided from the GIS server, the image information transmitted from the drone controller, and the drone flight information and the aircraft state information is analyzed, the security object or the security scene Including the drone flight information on the image information and the integrated geographic information, flight route information of the security guard drone and a control service for monitoring the aircraft status information, including a drone integrated video control server; including, the video of the security scene The information is shared between the on-site security mobile communication terminal and the drone integrated video control server to grasp the security scene in real time, and the drone integrated video control server controls the multiple security drones in flight,
The guard drone and the drone controller maintain a steering distance of about 1Km, and display a steering distance through the drone controller, and provide a departure warning when the steering distance exceeds 1Km,
The drone controller according to the number of the security drones to be put into the security scene to mutually share the video information, the drone flight information, and the aircraft state information by multi-displaying,
The security drone tracks the location of the security object by the location tracking module, or identifies the object by the object identification module, and continuously follows the security object to autonomously fly, real-time stereoscopic security using a drone Service provision system.
According to claim 1,
A flight that transmits flight airspace information of the security guard drone and weather and wind direction or wind speed and humidity and temperature and sunrise or sunset and geomagnetic drone flight environment information to the drone controller and the drone integrated video control server at a security guard site. A real-time on-site stereoscopic security service providing system using a drone, further comprising an environment information providing server.
According to claim 2,
The drone integrated video control server, based on the geographic feature information of the security scene by the integrated geographic information provided from the GIS server, and the flight airspace information and the drone flight environment information provided from the flight environment information providing server, A field real-time stereoscopic security service providing system using a drone, characterized in that the flight path of the security drone is set to generate autonomous flight information and transmitted to the security drone through the drone controller to perform autonomous flight.
According to claim 3,
The drone integrated video control server, in the event of an emergency of a security scene, provides a warning information to the security scene through the speaker or warning lights of the security drone put into the security scene, real-time on-site stereo using a drone Security service provision system.
According to claim 1,
The drone integrated video control server provides unique identification information of text and color identification information for each of the plurality of security drones, and the drone flight information, flight path information, and aircraft status of each security drone overlapping on the integrated geographic information. On-site real-time stereoscopic security service providing system using drone, characterized in that information and the image information are separately displayed and provided.
According to claim 3,
The drone integrated video control server categorizes the video information, the drone flight information, the aircraft status information, and the flight path and stores them in a DB or stores them in the cloud through a network, analyzes them using big data technology, and protects them. A real-time on-site stereoscopic security service providing system using drones, characterized by extracting useful information for services or using it for security education.
The method of claim 6,
The drone integrated video control server catalogs the video information and stores it in the DB, transmits the list to the field security mobile communication terminal,
The drone integrated video control server or the on-site security mobile communication terminal inquires the corresponding video information through the list and provides the displayed video information by expanding or reducing it, providing real-time stereoscopic security using a drone. Service provision system.
According to claim 1,
The guard drone and the drone controller wirelessly transmit and receive information to each other through a communication protocol of WiFi, OcuSync 2 or Lightbridge 2, and select the communication protocol according to the drone flight information and the aircraft status information,
The drone controller and the on-site security mobile communication terminal and the drone integrated video control server transmit and receive information through 5G or LTE to each other wirelessly, on-site real-time stereoscopic security service providing system using a drone.
According to claim 1,
The video information from the drone controller to the drone integrated video control server or the field security mobile communication terminal, the drone flight information, the flight route information, and the aircraft status information are encrypted and transmitted by a mobile VPN. , Real-time 3D security service providing system using drone.
delete According to claim 1,
The security drone is equipped with a stereo camera additionally to generate video information of the security scene, and the drone controller or the drone integrated video control server converts the video information into 3D stereoscopic images and provides them. A real-time three-dimensional security service provision system on site.
delete

Images