KR102105547B1 - System for pre-recognizing pedestrian - Google Patents

Abstract

As a preferred embodiment of the present invention, the illegal parking detection system includes a selection interface unit providing an interface for selecting or searching a specific area or a specific route; and illegality of at least one specific area within the specific range or specific route selected or searched for It characterized in that it comprises a; information providing unit that the parking information is displayed as a list.

Description

System for pre-recognizing pedestrians

The present invention relates to a pedestrian detection system and method.

In recent years, safety accidents are frequently occurring due to the rapid increase of vehicles, and this is a significant threat to pedestrian safety. In particular, in a blind spot or a right turn corner, where pedestrians are difficult to detect, it may be impossible to see pedestrians, and thus there is a high probability of accident.

10-2018-0017434 A 10-1814143 B1

In a preferred embodiment of the present invention, it is intended to provide an apparatus for effectively detecting illegal parking without cost, using a facility such as a power pole or a street light that has already been installed. In a preferred embodiment of the present invention, it is intended to collect traffic data of a private land to which traffic laws are difficult to apply and use it in a disaster situation. In a preferred embodiment of the present invention, in the event of an emergency, disaster, etc., the illegal parking stop detection device and system are used to prevent illegal parking in advance, and even in the event of an illegal parking, the vehicle is quickly identified and countered. do.

As a preferred embodiment of the present invention, the pedestrian pre-sensing system is disposed on a power pole, a traffic light, or a street light that is pre-installed in a blind spot to photograph the blind spot and detect and identify an object in the captured image; A safety beacon which is disposed on the power pole, a traffic light, or a street light to display the state of the blind spot before a driver enters the blind spot; and when a person or animal is identified in the CCTV, activates the safety beacon in a first color. And a control unit for activating the safety beacon in a second color when an object is not detected in the CCTV.

Preferably, the blind spot is characterized by including a right turn corner section.

As a preferred embodiment of the present invention, a speaker is further disposed on the power pole, a traffic light, or a street light, and when the safety beacon is activated in a first color, the controller automatically activates the speaker to guide that the vehicle is entering. It is characterized by.

As a preferred embodiment of the present invention, the control unit and the safety beacon are characterized by performing short-range wireless communication using a Low Power Wide Area (LPWA) protocol.

As a preferred embodiment of the present invention, the control unit is attached to the first position of the power pole or the street light, and the power is supplied from the control unit using a power line that supplies power to the power pole or the street light. It is characterized in that the power is supplied to the safety beacon and the CCTV in the third position by wire, the second position is higher than the first position, and the third position is higher than the second position.

As a preferred embodiment of the present invention, the CCTV is plural and the first CCTV photographs the first direction of the blind spot, the second CCTV photographs the second direction of the blind spot, and the person in the first direction Alternatively, when an animal is identified, the front part of the safety beacon is activated in a first color in the second direction, and when a vehicle is identified in the second direction, a logo projector mounted on the rear part of the safety beacon in the first direction It is characterized by projecting a message indicating that the vehicle is coming.

In a preferred embodiment of the present invention, in an area such as a blind area or a right turn corner, where a pedestrian may not be seen, the driver is guided to reduce the driving speed by notifying the presence of the pedestrian before the driver recognizes the presence of the pedestrian. It works. In a preferred embodiment of the present invention, there is an effect of reducing the probability of an accident by recognizing the presence of the pedestrian before the driver sees the pedestrian.

1 is a preferred embodiment of the present invention, showing a configuration diagram of an illegal parking detection system.
2 is a preferred embodiment of the present invention, and shows an example of an illegal parking stop detecting device implemented in a power pole.
3 is a preferred embodiment of the present invention, showing an example of implementing an illegal parking stop detection system on a private property.
4 to 5 is an exemplary embodiment of the present invention, and shows an example of checking whether illegal parking is detected in the terminal and controlling illegal parking.
6 is a preferred embodiment of the present invention, and shows an example of a first mode that intuitively displays whether illegal parking is detected in a specific area or a specific route.
7 is a preferred embodiment of the present invention, a second mode that provides an interface for controlling information installed in a specific area where illegal parking occurs in detail and displays information on whether illegal parking has occurred in at least one specific area. Shows an example.
FIG. 8 is a preferred embodiment of the present invention, showing an example of a third mode in which illegal parking is detected in real time and displayed on a map, and an example of guiding a new route when the illegal parking is not resolved.
9 is another preferred embodiment of the present invention, showing an example of a device installed in a blind area to provide pedestrian information.
10 (a) to (b) and FIGS. 11 (a) to 11 (b) are another preferred embodiment of the present invention, in which a driver obtains pedestrian information before entering a blind spot to control driving speed. An example is shown.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. Prior to this, the terms or words used in the present specification and claims should not be construed as being limited to ordinary or lexical meanings, and the inventor appropriately explains the concept of terms to explain his or her invention in the best way. Based on the principle that it can be defined, it should be interpreted as meanings and concepts consistent with the technical spirit of the present invention.

Therefore, the configuration shown in the embodiments and drawings described in this specification is only one of the most preferred embodiments of the present invention and does not represent all of the technical spirit of the present invention, and various equivalents that can replace them at the time of this application It should be understood that there may be water and variations.

1 to 3 is a preferred embodiment of the present invention, showing the configuration of the illegal parking detection system.

As a preferred embodiment of the present invention, when an illegal parking stop occurs in a specific area, the illegal parking stop detection system may guide the driver who performed the illegal parking and report to the disaster management center 180.

As a preferred embodiment of the present invention, if the illegal parking stop detection system detects in advance that an illegal parking has occurred in the course of the driving of the fire truck due to the occurrence of a fire or disaster, the illegal parking stop detection system is firstly guided to the driver who has performed the illegal parking. Secondly, the illegal state of illegal parking is notified to the manager terminal 160 in real time, and if the problem of illegal parking is not resolved within a certain time, a report is made to the disaster management center 180.

In addition, in a preferred embodiment of the present invention, a specific area in which an illegal parking problem has occurred is displayed in real time in a route to be driven by a fire engine, and there is a specific area in which an illegal parking problem is not solved before the fire truck enters by driving in the corresponding route. In this case, a new route without an illegal parking problem can be suggested to the fire truck. 8 for an example of this.

Referring to Figure 1, the illegal parking detection system includes an illegal parking detection device 100, a terminal 160, an external server 170 and a disaster management center 180.

The terminal 160 includes a mobile phone, a PC, a laptop, a tablet, a smart TV, a smart phone, a smart watch, a handheld device, a wearable device, a robot, etc., and receives data through communication with the illegal parking detection device 100 And refers to all devices capable of displaying and controlling the illegal parking detection device 100. The administrator may control at least one illegal parking stop detecting device 100 through the terminal 160, communicates with the external server 170, and if the illegal parking situation in a specific area is not resolved, the disaster management center You can contact 180.

The external server 170 stores and processes the data received from the at least one illegal parking detection device 100 and provides information to the terminal 160. The disaster management center 180 includes a fire department, a public institution, a government office, etc., and may further include a private institution.

The illegal parking detection device 100 includes a power supply unit 101, a control unit 110, a CCTV 130, and a logo projector 140, and may further include a speaker 150. The control unit 110 may include a communication unit 120.

In a preferred embodiment of the present invention further includes a calculation control unit 112. The operation control unit 112 is implemented to recognize an object in a captured image captured by CCTV, classify and process the processed information to the control unit 110.

In one preferred embodiment of the present invention, the operation control unit 112 may be implemented to update software or algorithms related to object recognition, object detection, etc. by being connected to an external database or a web server. In addition, in a preferred embodiment of the present invention, even when there is no function such as object detection, object recognition, object identification, etc. in CCTV, the function of detecting, recognizing, and identifying an object from an image captured by CCTV through the operation control unit 112 is provided. Can be done.

The power supply unit 101 uses a power line of a power pole or a street light. The communication unit 120 performs short-range wireless communication using a low power wide area (LPWA) protocol. The communication unit 120 performs short-range wireless communication using the LPWA protocol with the CCTV 130, the logo projector 140, the speaker 150, the terminal 160, and the server 170.

Referring to FIG. 2, the control unit 210 of the illegal parking detection device receives power using a power line supplying power to a power pole or a street light 200, CCTV 230, logo projector 240, and speaker ( 250) is supplied with power by wire.

As a preferred embodiment of the present invention, the CCTV 230 can rotate 360 degrees left and right, supports RTSP and MJPEG, and also supports automatic learning and object identification through deep learning. The CCTV 230 identifies a car, a bus, a truck, a vehicle, a person, an animal, and the like in the captured image, and functions such as reutering and tracking of moving objects are supported. The CCTV 230 may also use an IR-integrated IP camera.

CCTV 230 also, when a vehicle is detected in a specific area, through the control unit 210, the vehicle's movement path in the specific area, the time the vehicle stays in real time, the administrator terminal (Fig. 1, 160) or an external server ( 1, 170). The moving path of the vehicle includes traffic data information such as straight driving of the vehicle, right turning of the vehicle, and left turning of the vehicle.

As a preferred embodiment of the present invention, the logo projector 240 can adjust 360 degrees up, down, left, and right, and project guide messages on the floor in a specific area at a time or interval set by the controller 210 at night or in real time. You can. Examples of informational messages include "Attention to Pedestrian Vehicles", "No Parking Zones", "Emergency Vehicle Passage", "Concentration on Unauthorized Speculation", "Safe return home! Safe-Pocheon City. Pocheon Police Station. The guide message can be modified in various ways.

As a preferred embodiment of the present invention, the speaker 250 is capable of adjusting up and down, left and right angles, and performs voice guidance informing of illegal parking when an illegal parking occurs in a specific area.

As a preferred embodiment of the present invention, the control unit 210 may additionally include a power supply, and is disposed in a first position capable of A / S and equipment inspection. The CCTV 230, the logo projector 240, and the speaker 250 may be disposed at a second location that people cannot reach through the support arm 220, as an example shown in FIG. 2. However, this is only an embodiment of the present invention, and the CCTV 230, the logo projector 240, and the speaker 250 may be variously arranged at various locations that are not easily accessible by people. The second position is a higher position than the first position.

3 is a preferred embodiment of the present invention, showing an example of illegal parking stop detection device installed on a private land.

Referring to Figure 3, an example of a method for performing illegal parking detection is described below. As a preferred embodiment of the present invention, the control unit 310 is disposed at the first position of the pole 300, and the support arm is installed at the second position 301. An example in which two CCTVs 330 and 331 and two logo projectors 340 and 341 are disposed on the support arm 301, and the speaker 350 is disposed in another third position is illustrated. The configuration shown in FIG. 3 is only an embodiment of the present invention, and can be modified by disposing at least one CCTV, at least one logo projector, and at least one speaker.

[First Example]

As a first embodiment of the present invention with reference to FIG. 3, one CCTV 330 and one logo projector 340 are installed on the support arm 301, and the speaker 350 is disposed in the third position. Assume and explain.

The first CCTV 330 photographs a specific area and detects and identifies an object in the captured image. When the object identified in the first CCTV 330 is the vehicle 350, the control unit 310 activates the logo projector 340 or the speaker 350. The control unit 310 may automatically activate the logo projector 340 or the speaker 350 when the vehicle is initially identified in the CCTV and stays in a specific area for a predetermined time or more.

When the logo projector 340 is activated, a guide message may be transmitted to a nearby area where the vehicle 350 identified in CCTV is located or to a front window of the vehicle. In this case, the logo ejector 340 may display a guide message such as “prohibition of illegal parking” or “no parking” during the time that the corresponding vehicle 350 remains or for 30 seconds, 1 minute, etc. You can project on the front window.

When the speaker 350 is also activated, it performs voice guidance indicating that it is illegal parking.

As a preferred embodiment of the present invention, the control unit 310 is a vehicle in the CCTV 330 when the vehicle 350 is continuously detected in the CCTV 330 even after the logo projector 340 or the speaker 350 is activated. The first identified time information and location information of the identified vehicle are provided to the manager terminals (FIGS. 1 and 160). 4 to 5 for an example of receiving illegal parking information from the manager terminal.

[Second Example]

As a second embodiment of the present invention with reference to FIG. 3, a plurality of CCTVs 330 and a plurality of CCTVs 330 are installed by installing a support arm 301 on a pole or a street lamp that is pre-installed in a bent area, a right turn corner section, a square area, etc. It is possible to install a number of logo projector 340. If necessary, a plurality of speakers 350 can also be arranged.

A description will be given based on an example in which two CCTVs 330 and 331 and two logo projectors 340 and 341 are installed on the support arm 301, and the speaker 350 is disposed in the third position.

The first CCTV 330 photographs a specific area in the first direction, and the second CCTV 331 photographs a specific area in the second direction. The first logoprojector 340 projects a guide message to a specific area in the first direction, and the second logoprojector 341 projects a guide message to a specific area in the second direction.

When the vehicle 350 enters in the first direction and the pedestrian 360 enters in the second direction, the control unit 310 detects the vehicle 350 in the first CCTV 330, and then displays the second logo. By activating the projector 341, a guide message 'initiating a vehicle' may be projected. In addition, when the pedestrian 360 is detected by the second CCTV 360, the control unit 310 may activate the first logo projector 340 to project the information message “There is a pedestrian” to the vehicle 350. The control unit 310 may also automatically activate the speaker 350 when the vehicle 350 is detected by the first CCTV 350 to start a voice guidance saying that the vehicle is entering.

4 to 5 is an exemplary embodiment of the present invention, and shows an example of checking whether illegal parking is detected in the terminal and controlling illegal parking.

The terminal includes a selection interface unit (401, 402, 510), information providing unit (430, 530).

The selection interface units 401, 402, and 510 provide an interface for selecting or searching for a specific area or a specific route. 4 shows an example of the selection interface units 401 and 402 for selecting a specific region or a specific route by clicking a map map, and FIG. 5 shows a selection interface unit 510 for searching for a specific region or a specific route through a search. ) Is shown.

The information providing units 430 and 530 display illegal parking information of at least one specific area within a specific range or a specific path selected or searched through the selection interface units 401, 402, and 510 as a list. As a preferred embodiment of the present invention, the information providing units 430 and 530 may display a list of illegal parking information in a first mode, a second mode, or a third mode.

As a preferred embodiment of the present invention, the first mode intuitively displays a list of illegal parking information in at least one specific area. 6 illustrates an embodiment of the first mode. The first mode intuitively displays the illegal parking stop list 620 of n specific zones in a specific range or a specific path selected or using a selection interface unit.

The first mode provides the region information of the illegal parking stops among the n specific areas and the time information 610 of the illegal parking stops at the top. Then, the illegal parking situation of n specific areas is intuitively displayed. In an exemplary embodiment of the present invention, an alarm interface 630 is supported to intuitively display an illegal parking situation. By changing the color and brightness of the alarm interfaces 630 and 631, the illegal parking situation can be intuitively displayed. For example, when an illegal parking stop occurs, the color of the alarm interface 631 may be displayed in red, and when there is no illegal parking, the color of the alarm interface 630 may be displayed in green.

The first mode can also provide a reference 611 of the sort order indicating n specific zones. In this case, the criteria may be in the order of distance from the driver's current location, in the order of the estimated time required to resolve the illegal parking in the event of illegal parking.

The first mode also supports interfaces 640a and 640b for switching to the second mode. When the interface 640a is switched from the first mode to the second mode in FIG. 6, the second mode 721a may be activated as illustrated in FIG. 7. In addition, when the switching interface 740a is pressed in the second mode, it may be switched back to the first mode.

As another preferred embodiment of the present invention, the second mode provides detailed information on whether illegal parking has occurred in each of at least one specific area, and provides an interface for controlling facilities installed in the specific area where illegal parking has occurred. do. 4, 5, and 7 for an embodiment of the second mode.

For convenience of explanation, referring to FIG. 7, when the first interface is activated, the second mode 721a presses the switching interface 740a according to the user's selection, and details of the specific zone and the specific zone Interface to activate or deactivate illegal parking management system is supported.

The second mode 721a activates or deactivates the logo projector or activates or deactivates the first interface units 725 and 726 that set the logo projector's activation or deactivation time, and sets the speaker's activation or deactivation time. Fire station 527, a public agency 527, or an external agency that includes the second interface unit 723, 724, and includes information about a vehicle located in a specific area where illegal parking has occurred, such as the embodiment shown in FIG. The third interface units 526 and 527 provided to at least one of 526 may be further included.

Referring to one embodiment of FIG. 5, if the illegal parking is not resolved after the logo projector or the speaker is activated through the first interface unit 524 or the second interface unit 523, the third interface unit ( 526, 527) to be automatically activated. The terminal may further support a control board interface 522 for controlling the control unit 110 installed in the illegal parking device (FIGS. 1 and 100).

Referring to FIG. 7, the second mode 721a may further provide image information 722 of a specific area. In this case, the video information 722 uses an image taken in advance to identify a specific area or CCTV of the illegal parking detection device 722b installed in an area adjacent to the illegal parking detection device 722a installed in the specific area. You can use the video provided in real time.

As another embodiment of the present invention, the third mode intuitively displays in real time information on whether illegal parking has occurred in each of at least one specific area on the map map, and displays the illegal parking areas 820 and 830. The reporting interfaces 821 and 831 may be further supported. 4 and 8 for an embodiment of the third mode.

In the case of an emergency vehicle or a fire engine, an illegal parking area may be identified in advance on a driving route in which driving is to be performed using the third mode.

In a preferred embodiment of the present invention, referring to FIG. 8, when a specific route is selected (801, 802) through a selection interface unit in an emergency vehicle or a fire truck, a specific area where illegal parking occurs within a specific route can be intuitively displayed. (810a, 810b). In addition, in order to eliminate illegal parking, interfaces 821 and 831 that can be reported immediately may be further supported.

In a preferred embodiment of the present invention, referring to FIG. 8, it can be confirmed whether illegal parking has occurred or resolved in real time in an emergency vehicle or a fire engine. In a preferred embodiment of the present invention, the terminal may further include a driving route setting unit (not shown) to reset the driving route based on real-time illegal parking information identified through the third mode. For example, if the illegal parking of the illegal parking points 820 and 830 is not resolved while the fire truck is operating at the departure (801) point, the terminal may generate a new road (840) where illegal parking has not occurred through the driving route setting unit. , 850).

As a preferred embodiment of the present invention, the information providing unit of the terminal may provide illegal parking information in a mixed form of the first mode, the second mode, and the third mode as shown in FIG. 4.

As another preferred embodiment of the present invention, the information providing unit of the terminal may provide illegal parking information in a mixed form of the first mode and the second mode as shown in FIG. 5.

9 is another preferred embodiment of the present invention, showing an example of a device installed in a blind area to provide pedestrian information.

As a preferred embodiment of the present invention, the device for providing pedestrian information includes a control unit 910, a CCTV 930, and a safety beacon 940, and may further include a speaker as needed.

The CCTV 930 is disposed on a power pole, a traffic light, or a street light to photograph a blind spot and detect an object within the captured image. The safety beacon 940 may be disposed on a power pole, a traffic light, or a street light to indicate whether there is a pedestrian in the blind spot before the driver enters the blind spot.

The controller 910 may activate the safety beacon 940 in a first color when a person or animal is identified in CCTV, and activate the safety beacon 950 in a second color when an object is not detected in CCTV. The first color may be red, and the second color may be yellow.

10 (a) to 10 (b) show an example of a case in which a pedestrian is not detected in a blind spot as a preferred embodiment of the present invention. It shows a case where a pedestrian is not detected while the pedestrian pre-detection system is installed in the right turn corner.

Since the vehicle 1010 is going straight in the first direction S1050, the driver of the vehicle 1010 advances information on whether a pedestrian is present in the right-hand corner, that is, in the second direction S1060, as shown in FIG. 10 (b). Unknown to.

When a pedestrian is not detected in the pedestrian pre-sensing system as shown in FIG. 10 (a), the safety beacon 1040a shown in FIG. 10 (b) maintains the second color. For example, it is displayed in yellow to help the driver know in advance that there is no pedestrian in the right turn corner direction (S1060).

11 (a) to 11 (b) show an example of a case in which a pedestrian is detected in a blind spot as a preferred embodiment of the present invention. It shows a case where a pedestrian is detected in a state in which a pedestrian pre-detection system is installed in a right turn corner.

When the pedestrian 1000 is detected in the blind spot (S1030) photographed in the CCTV 1030 constituting the pedestrian pre-detection system as shown in FIG. 11 (a), the pedestrian detection system is a safety beacon 1040b as shown in FIG. Safety beacon 1040b even when the vehicle 1010 driver is driving in the first direction (S1050) to activate the first color, so that the pedestrian 1000 existing in the second direction (S1060) is not visible to the naked eye. It can be determined in advance that the pedestrian 1000 exists in the second direction S1070. After the pedestrian detection system further includes a speaker, the controller activates the safety beacon 1040b as the first color. At the same time, by activating the speaker, it may be implemented to guide the pedestrian 1000 to the vehicle 1010 entering.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is usually in the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. Of course, various modifications can be made by those having knowledge of, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (6)

A plurality of CCTVs, which are disposed on a power pole, a traffic light, or a street light that is pre-installed in a blind spot to photograph the blind spot and detect and identify an object within the captured image;
A speaker installed in a power pole, a traffic light, or a street light that is pre-installed in a blind spot;
A safety beacon disposed on the power pole, a traffic light, or a street light to display the state of the blind spot before a driver enters the blind spot; and
Includes a control unit for activating the safety beacon in a first color when a person or animal is identified in the CCTV and activating the safety beacon in a second color when an object is not detected in the CCTV.
The control unit is attached to the first position of the pre-installed power pole, traffic light, or street light to enable A / S and equipment inspection of the control unit, and the control unit uses the power line to supply power to the power pole or street light. Supplied and supplied power to the safety beacon in the second position, the plurality of CCTVs in the third position that people cannot easily reach, the second position is higher than the first position, and the second is greater than the second position. 3 position is high,
Among the plurality of CCTVs
The first CCTV photographs the first direction of the blind spot,
The second CCTV photographs the second direction of the blind spot,
Each of the first CCTV and the second CCTV can be rotated 360 degrees left and right,
When a person or an animal is identified in the first direction, the front portion of the safety beacon is activated with a first color in the second direction,
When a vehicle is identified in the second direction, the logo projector mounted on the rear portion of the safety beacon projects a message informing that the vehicle is coming in the first direction, and the logo projector can rotate 360 degrees left and right. ,
The first CCTV and the second CCTV
When a vehicle is identified in the second CCTV, the vehicle's movement path including traffic data information such as straight driving of the vehicle, right-hand driving of the vehicle, and left-hand driving of the vehicle is transmitted to the manager terminal through the control unit in real time. , The manager terminal is a pedestrian detection system, characterized in that the control board interface for controlling the control unit is supported to control the control unit. The method of claim 1, wherein the blind spot
Pedestrian pre-detection system comprising a right turn corner section. According to claim 1,
When the controller activates the safety beacon in a first color, the pedestrian pre-sensing system is characterized in that the speaker is automatically activated to guide that the vehicle is entering. According to claim 1,
The control unit and the safety beacon is a pedestrian pre-sensing system, characterized in that for performing short-range wireless communication using the LPWA (Low Power Wide Area) protocol. delete delete

Images