KR20220071514A - Walking signal control device through image-based object recognition and surrounding environment detection - Google Patents

Abstract

Provided is technology that can ensure safety at crosswalks. A walking signal control device using image-based object recognition and surrounding environment detection according to an embodiment of the present invention includes: a first imaging unit; a second imaging means; a data analysis unit; a walking signal control unit; a walking signal guidance unit; and a vehicle guidance unit.

Description

A device for controlling a walking signal through image-based object recognition and surrounding environment detection

The present invention relates to a technology for controlling a walking signal through image recognition around a crosswalk and sensing the surrounding environment. Specifically, it recognizes a pedestrian without a blind spot based on an image taken around the crosswalk, and in addition It relates to a technology that enables walking signals and guidance by adapting to changes in the walking environment based on environmental information such as traffic conditions.

In general, a crosswalk may be understood as a concept of a safety sign that is displayed on a road through which a vehicle passes, so that a pedestrian can safely cross the road.

On the other hand, these crosswalks are equipped with pedestrian traffic lights to guide the pedestrian side by guiding the walking signal and the walking prohibition signal. It has occurred frequently around crosswalks.

Accordingly, in order to reduce pedestrian accidents in the vicinity of crosswalks, Korean Patent No. 10-1567894 (voice guidance system for crosswalks) transmits an infrared signal or laser signal to the crosswalk to detect the entrance of the pedestrian, and Disclosed is a technology for raising awareness of pedestrians by allowing warning guidance according to the distance between a stop line and a pedestrian to be performed by voice.

However, since the laser, etc. in the prior art described above detects the entry of a pedestrian in line unit, it is only possible to simply check whether a pedestrian has entered, so there is a limitation in that it is difficult to analyze the pedestrian's behavior accurately and in detail. Since it is provided only as an auditory means, there is also a limitation that high-level gait guidance cannot be performed.

In particular, if the negligence of the driver of a vehicle driving through the crosswalk is not resolved because the guidance at such a crosswalk is focused only on pedestrians, the risk of a safety accident for pedestrians is very high. need is pointed out.

Meanwhile, in recent years, prevention of pedestrian accidents for children has been pointed out as a major issue, and a number of legislations are being made for this purpose, but this is a reality that is limited only in child protection areas. In fact, it is pointed out that there is a need for a technology that can respond to the presence of pedestrians, such as children or the elderly, which are subject to attention by reflecting the characteristics of pedestrians in various areas except for children's protection zones.

Accordingly, the present invention enables not only pedestrians at crosswalks but also notification of pedestrians in crosswalks for pedestrians and vehicles in consideration of the vehicle driving environment, thereby ensuring safety in crosswalks through the attention of both pedestrians and vehicles The purpose is to provide technology that can be used.

In addition, the present invention effectively detects an object of caution, such as a child, on a crosswalk except for a child protection zone, and in response, enables different guidance and traffic environment control in the same crosswalk, thereby providing effective protection for each pedestrian in various places Another purpose is to provide possible technologies.

In order to achieve the above objects, the apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing according to an embodiment of the present invention is installed around the crosswalk to photograph the area near the crosswalk. Way; a second photographing means for photographing an image of a roadway near a crosswalk; The complexity of pedestrians and patterns of pedestrians for each crosswalk are analyzed using the images taken from the first photographing means, and the speed of vehicles near the crosswalk and the roadway near the crosswalk using the images photographed from the second photographing means a data analysis unit that analyzes the complexity of and generating a first control command for controlling the walking signal according to the complexity of the pedestrian analyzed by the data analysis unit, the pattern of the pedestrian, and the complexity of the roadway near the crosswalk, and transmits it to the signal controller for controlling the walking signal of the crosswalk By doing so, the walking signal control unit to control the walking signal according to the complexity of the pedestrian and the pattern of the pedestrian; A walking signal that outputs guide information about walking to the pedestrian side through the guide information output module installed near the crosswalk according to the pedestrian complexity analyzed by the data analysis unit, the pattern of the pedestrian, and the control state of the walking signal of the crosswalk guide; And according to the pedestrian complexity analyzed by the data analysis unit, the pattern of the pedestrian, the speed of the vehicle near the crosswalk, and the complexity of the roadway, the pedestrian in the vehicle located near the crosswalk through the signal transmitting means installed near the crosswalk It characterized in that it includes; a vehicle guide unit to guide the alarm information according to the walking of the.

The signal transmitting means outputs an audio or video signal including the alarm information and is installed to face the traveling direction of the vehicle. Alarm output means for recognizing the walking state; And installed in the vicinity of the crosswalk to broadcast the alarm signal including the alarm information to the surroundings, so that the communication means of the vehicle traveling near the crosswalk can receive the alarm signal, the vehicle driving in the vicinity of the crosswalk an alarm signal transmitting means for controlling an audio or video output means inside the vehicle to output the alarm information upon receiving the alarm information; It is preferable to include at least one of

The data analysis unit, by performing an analysis of the number of pedestrians in the control area of the plane unit where the image is captured by the first shooting means, the entry point for each pedestrian, and the direction of travel at the entry location point of the pedestrian, It is desirable to analyze pedestrian complexity and pedestrian patterns.

The walking signal control unit determines the lighting priority of the walking signals for a plurality of crosswalks based on the number of pedestrians, the entry point for each pedestrian, and the traveling direction at the entry location point for each pedestrian, and the priority order is high. It is preferable to control the lighting of the walking signal, which cannot be turned on at the same time, so that the walking signal is turned on as shown.

The walking signal control unit, based on the number of pedestrians, the entry point for each pedestrian, the direction of travel at the entry point of the pedestrian, and the complexity of the roadway toward the crosswalk, the number of pedestrians toward the crosswalk compared to the crosswalk When the ratio of the complexity of the headed roadway is less than a preset threshold value, it is preferable to control so that the pedestrian signal of the crosswalk is turned on.

The walking signal guide unit, as the signal information collected from the signal controller, further collects information about the remaining time until the lit walking signal is changed to a walking prohibition signal when the lighting information on the walking signal is collected, When the remaining time collected by ' is less than a preset threshold time, it is preferable to change the guide information provided to the pedestrian crossing the crosswalk into guide information to guide that the end of the walking signal is imminent. do.

The data analysis unit, based on the image photographed from the first photographing means and the pre-stored area near the crosswalk and the distance information of the first photographing means, the pedestrian in the crosswalk using the image photographed from the first photographing means It is preferable to generate significant pedestrian identification information as information included in the information on the pattern of the pedestrian as information predicting the height of the pedestrian.

When it is determined that a pedestrian less than a predetermined threshold height is present in the significant pedestrian identification information, the vehicle guide unit preferably guides by including pedestrian attention information and speed limit warning information in the alarm information.

The data analysis unit, when receiving a signal notifying that the alarm information includes pedestrian attention information and speed limit warning information from the vehicle guide unit is guided, the speed of the vehicle is determined regardless of the speed limit of the vehicle near the crosswalk It is preferable to determine whether a speed corresponding to the speed limit warning information exceeds a preset threshold speed limit, and to determine a vehicle exceeding the critical speed limit speed as an illegal vehicle.

Preferably, when the illegal vehicle is detected, the data analysis unit transmits number information and speed information of the illegal vehicle to a control server of a law enforcement agency.

According to the present invention, the image taken from the first photographing means for photographing the area where the pedestrian is located near the crosswalk on a per-plane basis and the second photographing means for photographing the area where the roadway near the crosswalk is located on a surface-by-plane basis Based on this, image analysis on the pedestrian side and image analysis on the vehicle side are simultaneously performed, and based on this, not only signal control, but also guide information for pedestrians and alarm information for vehicles are generated and guided to pedestrians and vehicles, respectively. do. In particular, through visual/audio guidance for roads and crosswalks, both pedestrians and vehicles are guided to walk in the crosswalk at the same time.

According to the present invention, there is an effect of maximizing the effect of preventing traffic accidents by simultaneously providing guidance to both sides of the pedestrian and the vehicle so that the driver and the pedestrian of the vehicle pay attention on the crosswalk at the same time.

In particular, even if it is not a child protection area, it immediately determines whether a child is walking through image analysis and immediately changes the crosswalk area to the same driving environment as that of the child protection area, thereby ensuring complete safety for pedestrians. there is

1 is a block diagram of an apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing according to an embodiment of the present invention;
2 is a view for explaining a traffic environment to which each embodiment of the present invention is applied.
3 is a view for explaining the performance of the functions of the data analysis unit and the gait signal control unit according to the implementation of each embodiment of the present invention.
4 and 5 are diagrams for explaining the performance of the function of the walking signal guide according to the implementation of each embodiment of the present invention.
6 to 8 are views for explaining the performance of the function of the vehicle guide according to the implementation of each embodiment of the present invention.

Hereinafter, various embodiments and/or aspects are disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be recognized by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of various methods may be employed in the principles of the various aspects, and the descriptions set forth are intended to include all such aspects and their equivalents.

As used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. may not be construed as an advantage or advantage in any aspect or design described above over other aspects or designs. .

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. should be understood as not

Also, terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are those commonly understood by those of ordinary skill in the art to which the present invention belongs. have the same meaning. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in an embodiment of the present invention, an ideal or excessively formal meaning is not interpreted as

On the other hand, in the following description, although some components are omitted, or excessively enlarged or reduced in order to explain the function of each component of the present invention, the matters described in the drawings are the technical features and rights of the present invention. It will be understood that the scope is not limited.

In addition, in the following description, a plurality of drawings will be simultaneously referenced and described in order to describe one technical feature or component constituting the invention.

1 is a block diagram of an apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing according to each embodiment of the present invention, FIG. 2 is a diagram for explaining a traffic environment to which each embodiment of the present invention is applied; 3 is a view for explaining the performance of the functions of the data analysis unit and the gait signal controller according to the implementation of each embodiment of the present invention, FIGS. 4 and 5 illustrate the functional performance of the gait signal guide according to the implementation of each embodiment of the present invention 6 to 8 are diagrams for explaining the performance of the function of the vehicle guide according to the implementation of each embodiment of the present invention.

When described with reference to the above drawings, the apparatus 10 (hereinafter referred to as the apparatus of the present invention) for controlling a walking signal through image-based object recognition and surrounding environment sensing according to each embodiment of the present invention is a first photographing means (15), the second photographing unit 16, the data analysis unit 11, the walking signal control unit 12, the walking signal guide unit 13 and the vehicle guide unit 14 are characterized in that it includes.

In the apparatus 10 of the present invention, the first photographing means 15 and the second photographing means 16 will be described as performing a function of photographing an image and transmitting the image to the data analysis unit 11, but the first photographing means (15) and the second photographing means 16 may refer to an image photographing apparatus having the same specification and/or an apparatus generating data obtained by analyzing an image photographing result.

By including the first photographing means 15 and the second photographing means 16 , the device 10 of the present invention can perform its function in the environment shown in FIGS. 1 and 2 . Referring to FIG. 2 , a plurality of vehicle signals 80 , 81 , 82 , 83 , 84 may be installed at an intersection or a road in one direction to control the movement of the vehicle. In this case, the vehicle may be guided to stop or move based on the stop line 110 or the like.

Meanwhile, a plurality of crosswalks 100 may exist, and a plurality of walking signals 60 to 67 may be installed in the crosswalk 100 as shown in FIG. 2 to guide pedestrians. Meanwhile, guide information output modules 30 , 31 , 32 installed near the crosswalk 100 , where guide information is output by the walking signal guide unit 13 to be described later, are also installed to provide visual or auditory walking guidance information to pedestrians. can provide Meanwhile, the alarm information may be provided to the vehicle through the signal transmitting means 40 , 41 , 42 , etc. from which the alarm information is output by the vehicle guide unit 14 , either visually or audible or through a data signal.

In such an environment, the first photographing means 15 is installed around the crosswalk as shown in FIG. 3 and performs a function of photographing the areas 1000a, 1000b, 1000c, and 1000d near the crosswalk. Preferably, in order to perform the function of the present invention, the above-described areas 1000a, 1000b, 1000c, and 1000d are photographed on a plane-by-plane basis, and the corresponding photographed image is transmitted to the data analysis unit 11 . Filming of a plane-unit area is not a function of hardware such as a sensor that simply detects whether a pedestrian or the like passes through a boundary line of a line unit, but means taking an image of a plane-unit such as a camera.

Meanwhile, the second photographing means 16 performs a function of photographing an image of the road area 1100a near the crosswalk as shown in FIG. 3 and the like. The second photographing means 16 has the same specifications as the above-described first photographing means 15 , and may be configured as an image photographing apparatus that also performs photographing of a surface unit area.

The first photographing means 15 and the second photographing means 16 may preferably be an ultra-low illuminance camera installed with an infrared dimmer. At this time, the above-described ultra-low light camera, for example, in a very dark environment with only starlight or no light, irradiates infrared rays, and the CCD (Charge-Coupled Device) images the infrared rays that have been reflected on the object, so that the illuminance and It will be understood as a concept of a camera that allows a sensitivity-corrected captured image to be acquired.

According to this, by the data analysis unit 11 to be described later, unlike the conventional line-based object recognition using a laser sensor, etc., the above-described ultra-low illuminance camera performs surface-based object (pedestrian) recognition. As it becomes possible, event detection is performed for the entry location point of the pedestrian or vehicle within the control area and the direction of travel of the pedestrian or vehicle at the above-described entry location point, so that the crosswalk the pedestrian intends to use It has the effect of enabling a more detailed analysis of the behavior of pedestrians and vehicles as it is possible to understand the recognition or clearly determine whether the vehicle is moving toward a crosswalk.

In particular, in the present invention, as shown in FIG. 3 and the like, intersection areas 1000a, 1000b, 1000c, 1000d provided with two or more crosswalks included in the shooting range (radius) of the first shooting means 15 can be set as the control area. As there is, it is not only free to set the control area, but also analyzes the behavior of pedestrians for two or more crosswalks can be performed simultaneously.

The data analysis unit 11 analyzes the complexity of pedestrians and patterns of pedestrians for each crosswalk by using the image photographed from the first photographing means 15 , and crosses using the image photographed from the second photographing means 16 . It performs the function of analyzing the speed of nearby vehicles and the complexity of the roadway near the crosswalk.

Specifically, the data analysis unit 11 analyzes the images taken from each of the photographing means 15 and 16, but the convolutional neural network (CNN), which is the technology most used for vision, and the boundary for object extraction of images obtained from the camera By utilizing the box (grid) concept and various algorithms such as YOLO (You Only Look Once) and SSD, the function of recognizing multiple objects in an image can be performed.

Of course, as described above, when each of the photographing means 15 and 16 transmits a plurality of analysis results for the recognized object, including the function of performing the above-described object recognition function, the data analysis unit 11 transmits the analysis result may perform a function of generating a result for analyzing the above-described pedestrian complexity, pedestrian pattern, vehicle speed, road complexity, and the like.

In the present invention, the pedestrian complexity is determined by the recognition of a plurality of pedestrians and movement vector analysis through movement analysis for each image frame of the recognized pedestrian object. It is a concept that includes information such as the number of pedestrians located in an area to be judged to walk through or moving toward a crosswalk, and whether the above-mentioned number of pedestrians is concentrated in which crosswalk if there are multiple crosswalks. The pedestrian pattern is a concept including the above-described movement direction of the pedestrian.

The speed of the vehicle is information derived by identifying the moving direction and speed of the vehicle through the analysis of the motion vector through the motion analysis for each image frame of the recognized vehicle object. The complexity of the roadway refers to information derived through counting of the number of each identified vehicle.

Examples of these are shown in FIG. 3 and the like. If the above-described recognized object is analyzed for each of the regions 1000a, 1000b, 1000c, and 1000d, the vectors V1, V2, and V3 of each object may be analyzed. At this time, a pattern of pedestrians is identified according to the analyzed vector, and by determining whether or not pedestrians are concentrated based on the vector, the complexity of pedestrians for each crosswalk or area can be calculated.

Meanwhile, in the roadway area 1100a, vehicles heading toward or away from the crosswalk are recognized through analysis of the vectors V4 and V5 of the vehicle, and the speed of the vehicle and the complexity of the roadway can be calculated from this.

Returning to the description of FIG. 1 again, the walking signal controller 12 is a first for controlling the walking signal according to the complexity of the pedestrian analyzed by the data analysis unit 11, the pattern of the pedestrian, and the complexity of the roadway near the crosswalk. By generating a control command and transmitting it to the signal controller 20 that controls the walking signal 60 of the crosswalk, it performs a function of controlling the walking signal 60 according to the complexity of nearby pedestrians and the pattern of pedestrians.

In the present invention, the signal controller 20 performs a function of controlling the vehicle signal 80 or the walking signal 60 according to the control flow of a general traffic signal. The general traffic signal control flow means that traffic signals are sequentially controlled according to the lighting order of each traffic signal.

Accordingly, the walking signal controller 12 preferably controls specific signal lighting according to the pedestrian complexity, the pedestrian pattern and the complexity of the roadway during the function of the signal controller 20 according to the general traffic signal control flow described above. It will be understood that by generating and transmitting the above-described first control command to the signal controller 20 when necessary, the function of allowing the first control command to be applied preferentially to a control signal by a general traffic flow is performed.

That is, specifically, the walking signal control unit 12 determines the lighting priority of the walking signals for a plurality of crosswalks based on the number of pedestrians, the entry point for each pedestrian, and the proceeding direction at the entry point for each pedestrian, It is preferable to control the lighting of the walking signals, which cannot be turned on at the same time, so that the walking signals are turned on in the order of increasing the priority. That is, when the lighting priority is generated while each signal is controlled by the general traffic flow, a first control command is first generated and transmitted to the signal controller 20, and the signal controller 20 receiving the first control command The first control command is applied prior to the control signal by the general traffic flow.

In this case, since it means controlling traffic signals in a specific situation, it may be understood that the first control command of the walking signal controller 12 is generated in a special case. That is, the walking signal controller 12 determines the number of pedestrians, the entry point for each pedestrian, the direction of travel at the entry point of the pedestrian, and the complexity of the roadway toward the crosswalk. When the ratio of the complexity of the roadway toward is less than a preset threshold value (for example, 30%), it is preferable to control the pedestrian signal of the crosswalk to be turned on regardless of the general traffic flow. At this time, it can be understood that the pedestrian signal of the crosswalk having the smallest corresponding value has the highest priority of lighting the above-mentioned signal.

On the other hand, the walking signal guide unit 13 uses the guide information output module 30 installed near the crosswalk according to the pedestrian complexity analyzed by the data analysis unit 11, the pedestrian pattern, and the control state of the pedestrian signal of the crosswalk. It performs a function of outputting guide information for walking to the pedestrian side through the

In the present invention, the guide information output module 30 is, for example, near the crosswalk 100 as shown in FIG. 2, preferably an LED output means installed on the floor among the areas where pedestrians enter the crosswalk 100 ( 31) and an audio output means 32 such as a speaker.

It is preferable that the guide information output through the guide information output module 30 by the walking signal guide unit 13 specifically include information for guiding pedestrians on walking. For example, as shown in FIGS. 4 and 5 , when the green light of the walking signal 60 is turned on and it is determined that walking is possible, the LED output means 31, etc. Information guiding the pedestrian that walking is possible through the crosswalk 100 may be output. On the other hand, when the red light is turned on in the walking signal 60 so that the pedestrian should not walk, the LED output means 31 or the like tells the pedestrian to “stop” as shown in FIG. 5 and walk through the crosswalk 100. Information guiding not to do it may be output.

In addition, if a pedestrian is already crossing through the crosswalk 100 or the walking signal changes to a red light after a short time, the pedestrian can cross quickly, or the pedestrian has not yet crossed and the current walking signal is a green light, but it is changed to a red light soon It is necessary to induce pedestrians not to cross through the crosswalk.

That is, the walking signal guide 13 is the signal information collected from the signal controller 20, and when the lighting information for the walking signal is collected, the remaining time information until the lit walking signal is changed to the walking prohibition signal is displayed. To further collect, when the remaining time collected in real time remains less than a preset threshold time, the guidance information provided to the pedestrian crossing the crosswalk is changed to information to inform that the end of the walking signal is imminent It is preferable to do so.

The vehicle guide unit 14, according to the pedestrian complexity analyzed by the data analysis unit 11, the pedestrian pattern, the speed of the vehicle in the vicinity of the crosswalk, and the complexity of the roadway, the signal transmitting means 40, 50), it functions to guide the alarm information according to the pedestrian's walking to a vehicle located near the crosswalk.

In this case, the guidance to the vehicle may be performed in two ways. That is, strong visual or auditory guidance is provided to the driver in the vehicle from the outside, or the driver is provided with visual or auditory guidance from the inside through a speaker or screen output device inside the vehicle.

The former may be enabled by the above-described visual or audible information output module near the crosswalk, and the latter transmits the above-mentioned alarm information for guidance to the communication module of the vehicle through a wireless network, and transmits the visual or auditory information inside the vehicle. This can be done through signal processing so that the corresponding information is output regardless of the information currently output to the enemy information output means.

In order to implement both embodiments, the signal transmitting means in the present invention may include an alarm outputting means 40 and an alarm signal transmitting means 50 as shown in FIG. 1 and the like. As the alarm output means 40 may be implemented as an example such as the external visual output means 41 and 42 or a speaker (not shown) shown in FIG. 2, an audio or video signal including alarm information is output and the vehicle It will be understood as a concept including a device installed to face the direction of travel and allowing the driver of a vehicle driving toward the crosswalk to check the alarm information to recognize the walking state of the pedestrian in the crosswalk.

That is, as shown in FIG. 6 , the above-described alarm information, that is, alarm information indicating that a pedestrian is walking through the crosswalk in front, is output through the visual output means 41 such as an electric signboard. Considering the above-described embodiment, the second photographing means 16 is preferably installed at the same position as the visual output means 41, so that more efficient vehicle analysis and identification is possible.

On the other hand, the alarm signal transmitting means 50 transmits a force signal to a vehicle passing nearby so that the alarm information is outputted through the vehicle's internal output means. That is, as shown in FIG. 7, it is installed near the crosswalk to broadcast the alarm signal including the alarm information to the surroundings, so that the communication means of the vehicle 71 driving near the crosswalk can receive the alarm signal. , performs a function of controlling the voice or image output means inside the vehicle to output the alarm information 51 when the vehicle driving near the crosswalk receives the alarm information.

Of course, as shown in FIG. 7 , the alarm output means such as the time output means 41 installed together with the second photographing means 16 and the above-described alarm signal transmission means are implemented together, so that the driver can make an alarm through an external electronic signboard, etc. It can be implemented so that the alarm information can be recognized from the inside while simultaneously recognizing the information.

On the other hand, in the present invention, an object in the area of the crosswalk 100 is recognized through image analysis, and in this case, the size of the object can also be analyzed. At this time, since the object is a pedestrian, if the size, that is, the height of the pedestrian is analyzed, the height of the pedestrian can be analyzed, and the pattern of the pedestrian can be roughly predicted based on the analyzed height of the pedestrian.

As shown in FIG. 8, the data analysis unit 11 is based on the image taken from the first photographing means 15 and the pre-stored area near the crosswalk and the distance information of the first photographing means 15, The height of the pedestrian in the crosswalk may be predicted by using the image photographed from the first photographing means 15 .

In this case, when the pedestrian's height (L1) is less than or equal to the preset critical height (Lt, for example, 140), the possibility that the pedestrian is a child is very high, so special attention is required for this, and in this case, information about the pedestrian's pattern Significant pedestrian identification information indicating that the corresponding pedestrian should be taken into account may be generated and transmitted to the vehicle guide unit 14 .

In this case, the vehicle guide 14 informs the vehicle that pedestrians of the relevant category should be extra careful, regardless of whether the area is a child protection zone, so that protection for children can be achieved regardless of the child protection zone. can That is, when it is determined that a pedestrian less than a predetermined threshold height exists in the significant pedestrian identification information, the pedestrian attention information and speed limit warning information are added to the alarm information output through the visual output means 41 as shown in FIG. 8 . It is preferable to include and guide.

That is, when each embodiment of the present invention is implemented, regardless of whether the area where the crosswalk is installed is a child protection zone, if children are present, special attention is called to it, so that traffic safety for children is secured.

In order to enforce this effect, in the present invention, the data analysis unit 11 receives a signal from the vehicle guide unit 14 indicating that pedestrian attention information and speed limit warning information are included in the alarm information. Regardless of the speed limit of the vehicle near the crosswalk, it is determined whether the speed of the vehicle exceeds a preset critical speed limit, which is the speed corresponding to the speed limit warning information, can That is, the second photographing means 16 functions as a photographing device for speeding of a vehicle in the child protection zone at this time.

In this case, in order to be able to provide legal enforcement, the data analysis unit 11, when an illegal vehicle is detected, transfers number information and speed information of the illegal vehicle to a control server of a judicial institution (not shown, for example, traffic enforcement) server) can be sent.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, those skilled in the art will understand that various modifications and variations are possible from the above description. Terms such as "include", "comprise" or "have" described above mean that a component without a particularly opposing description may be embedded, so it does not exclude other components but includes other components It should be construed as being able to include more. In addition, the protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (10)

A first photographing means installed around the crosswalk to photograph the area near the crosswalk;
a second photographing means for photographing an image of a roadway near a crosswalk;
The complexity of pedestrians and patterns of pedestrians for each crosswalk are analyzed using the images taken from the first photographing means, and the speed of vehicles near the crosswalk and the roadway near the crosswalk using the images photographed from the second photographing means a data analysis unit that analyzes the complexity of and
By generating a first control command for controlling the walking signal according to the complexity of the pedestrian analyzed by the data analysis unit, the pattern of the pedestrian and the complexity of the roadway near the crosswalk, and transmitting it to the signal controller for controlling the walking signal of the crosswalk , a walking signal controller to control the walking signal according to the complexity of nearby pedestrians and the pattern of pedestrians;
A walking signal that outputs guide information about walking to the pedestrian side through the guide information output module installed near the crosswalk according to the pedestrian complexity analyzed by the data analysis unit, the pattern of the pedestrian, and the control state of the walking signal of the crosswalk guide; and
According to the complexity of the pedestrian analyzed by the data analysis unit, the pattern of the pedestrian, the speed of the vehicle near the crosswalk, and the complexity of the roadway, through the signal transmitting means installed near the crosswalk, the pedestrian's A gait signal control device through image-based object recognition and surrounding environment sensing, comprising: a vehicle guide to guide alarm information according to walking.
According to claim 1,
The signal transmitting means,
The audio or video signal including the alarm information is output and installed to face the direction of the vehicle, so that the driver of the vehicle driving toward the crosswalk can recognize the walking state of the pedestrian in the crosswalk by checking the alarm information Alarm output means to enable; and
Installed near the crosswalk to broadcast the alarm signal including the alarm information to the surroundings, so that the communication means of the vehicle driving near the crosswalk can receive the alarm signal, the vehicle driving near the crosswalk an alarm signal transmitting means for controlling an audio or video output means inside the vehicle to output the alarm information upon receiving the alarm information; An apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing, comprising at least one of.
According to claim 1,
The data analysis unit,
The first photographing means analyzes the number of pedestrians in the control area of the plane unit where the image is captured, the entry point for each pedestrian, and the direction of travel at the entry point of the pedestrian, thereby determining the complexity of the pedestrian and the pedestrian. An apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing, characterized in that it analyzes the pattern of
4. The method of claim 3,
The walking signal control unit,
To determine the lighting priority of the walking signals for a plurality of crosswalks based on the number of pedestrians, the entry point for each pedestrian, and the direction of progress at the entry point for each pedestrian, and to light the walking signals in the order of priority A device for controlling a walking signal through image-based object recognition and surrounding environment sensing, characterized in that it controls the lighting of a walking signal that cannot be turned on at the same time.
4. The method of claim 3,
The walking signal control unit,
Based on the number of pedestrians, the entry point for each pedestrian, the direction of travel at the entry point of the pedestrian, and the complexity of the roadway toward the crosswalk, the ratio of the complexity of the roadway toward the crosswalk to the number of pedestrians heading for the crosswalk When it is less than this preset threshold value, the apparatus for controlling a walking signal through image-based object recognition and surrounding environment detection, characterized in that the pedestrian signal of the crosswalk is controlled to be turned on.
According to claim 1,
The walking signal guide unit,
As the signal information collected from the signal controller, when the lighting information for the walking signal is collected, information about the remaining time until the lighted walking signal is changed to the walking prohibition signal is further collected,
When the remaining time collected in real time remains less than a preset threshold time, the guide information provided to the pedestrian crossing the crosswalk is changed to guide information to guide that the end of the walking signal is imminent. A device for controlling a walking signal through image-based object recognition and surrounding environment detection.
According to claim 1,
The data analysis unit,
Based on the image photographed from the first photographing means and the pre-stored area near the crosswalk and the distance information of the first photographing means, the height of the pedestrian in the crosswalk was predicted using the image photographed from the first photographing means. An apparatus for controlling a walking signal through image-based object recognition and surrounding environment sensing, characterized in that it generates significant pedestrian identification information as information included in the information on the pedestrian pattern as information.
8. The method of claim 7,
The vehicle guide unit,
Image-based object recognition and surroundings, characterized in that when it is determined that a pedestrian less than a preset threshold height exists in the pedestrian identification information to be noted, the alarm information includes pedestrian attention information and speed limit warning information to guide A walking signal control device through environmental sensing.
9. The method of claim 8,
The data analysis unit,
When a signal is received from the vehicle guide to inform that the alarm information includes pedestrian caution information and speed limit warning information, the speed of the vehicle is displayed in the speed limit warning information regardless of the speed limit of the vehicle near the crosswalk. A device for controlling a walking signal through image-based object recognition and surrounding environment sensing, characterized in that it is determined whether the corresponding speed exceeds a preset threshold speed limit, and a vehicle exceeding the threshold speed limit speed is determined as an illegal vehicle.
10. The method of claim 9,
The data analysis unit,
When the illegal vehicle is detected, the apparatus for controlling a walking signal through image-based object recognition and surrounding environment detection, characterized in that the number information and speed information of the illegal vehicle are transmitted to a control server of a law enforcement agency.

Images