Summary of the invention
The problem that the present invention solves is, a kind of Image Acquisition and treating apparatus and method, vehicle monitoring and register system are provided, with realize image acquisition and handle in real time integrated, and simplify the structure of vehicle monitoring and register system with this, reduce the installation complexity of system.
For addressing the above problem, the invention provides a kind of Image Acquisition and treating apparatus, comprising:
Image-generating unit is used to absorb the video image in the area to be monitored, produces the corresponding simulating video flowing;
Analog digital converting unit is used for converting the analog video stream that described image-generating unit produces to digital video frequency flow;
The video trigger element is used to analyze the digital video frequency flow that described analog digital converting unit produces, and produces the video trigger pip when having detected vehicle;
Capture the unit, be used for after receiving trigger pip, the digital video frequency flow that produces from described analog digital converting unit obtains current video image, and described trigger pip comprises the video trigger pip of described video trigger element output;
Information acquisition unit is used for the video image that described candid photograph unit obtains is handled, and obtains the information of vehicles in the image.
Optionally, described video trigger element is gray scale, color and the edge texture at the video image of front and back frame when changing, and the different characteristic that detects at times in the video image detects whether vehicle is arranged.
Optionally, described video trigger element detected vehicle the time produce the video trigger pip and comprise: by day, output video trigger pip when the gray scale of black shade surpasses at the bottom of the car of setting the most black shadow thresholds in the video image; At night, output video trigger pip when the car light feature is arranged in the video image; At ambient lighting more weak dawn or dusk, output video trigger pip when the gray scale of black shade surpasses at the bottom of the corresponding car the most black shadow thresholds in the video image, the most black shadow thresholds is to judge it is dawn or dusk by the road surface brightness that detects in the video image at the bottom of the car of described correspondence, and selects to obtain corresponding to the most black shadow thresholds at the bottom of the car at dawn or dusk.
Optionally, described information acquisition unit comprises: car plate recognition unit and/or color recognition unit, the car plate recognition unit, be used for by car plate location, the identification of car plate color, Character segmentation and character recognition, the video image that described candid photograph unit is obtained carries out the identification of license board information, obtains license plate binary image, car plate color and the number-plate number; The color recognition unit is used for by being partitioned into area-of-interest, and versicolor pixel number in the color of pixel, the statistics area-of-interest is carried out the identification of body color with the video image that described candid photograph unit is obtained in the identification area-of-interest.
Optionally, described car plate recognition unit comprises:
The car plate positioning unit is used to analyze the video image that described candid photograph unit obtains, and orients the license plate area that meets vehicle license plate characteristic, it is split from video image, and convert the license plate binary image to;
Car plate color recognition unit is used to analyze the license plate area that described car plate positioning unit is located, and identifies the car plate color;
The Character segmentation unit is used for the license plate area of described car plate positioning unit location is divided into single character;
Character recognition unit is used for the character that the Character segmentation unit is cut apart is discerned respectively, forms the number-plate number.
Optionally, described color recognition unit comprises:
The Region Segmentation unit is used for being partitioned into area-of-interest from the video image that described candid photograph unit obtains, and described area-of-interest is meant that field color can be used for representing certain specific region of the vehicle body of whole body color;
The color determining unit is used for discerning the area-of-interest of cutting apart described Region Segmentation unit and selectes versicolor pixel number in the color of pixel, the statistics area-of-interest, obtains to describe the proper vector of field color, to determine the area-of-interest color.
Optionally, described area-of-interest is car protecgulum zone.
Optionally, the result of the car plate of the described car plate recognition unit of described Region Segmentation unit by using location determines the position of vehicle body in the video image that described candid photograph unit obtains, and the areal distribution according to vehicle body is partitioned into car protecgulum zone again.
Optionally, described color recognition unit also comprises: the shade recognition unit, be used for discerning the shade of the selected pixel of the area-of-interest cut apart described Region Segmentation unit, and the statistical pixel point is assigned to the number of dark color, light color, to determine the shade of area-of-interest.
Optionally, described selected pixel is on the direction in described area-of-interest, the pixel that fixed interval quantity is selected.
Optionally, described Image Acquisition and treating apparatus also comprise: the imaging control module, be used to be adjusted to the picture controlled variable, and described imaging controlled variable is used to control the image quality of described image-generating unit.
Optionally, described imaging control module comprises:
Background luminance control image-generating unit is used to obtain the digital video frequency flow that described AD conversion unit produces, and adjusts the shutter value by the background luminance of analyzing in every frame video image;
Car plate brilliance control image-generating unit is used for adjusting the shutter value by the car plate brightness of analyzing in the described video image when the video image that the candid photograph unit obtains has vehicle license plate characteristic.
Optionally, the background luminance in the analysis video image passed through of described background luminance control image-generating unit is adjusted the shutter value and is comprised: calculate road surface brightness by brightness histogram, select the shutter value corresponding to road surface brightness.
Optionally, the car plate brightness in the analysis video image passed through of described car plate brilliance control image-generating unit is adjusted the shutter value and is comprised: calculate car plate brightness by medium filtering, turn the shutter value in car plate brightness in limited time down on greater than normal range, in car plate brightness less than transferring big shutter value under the normal range in limited time.
Optionally, described candid photograph unit after receiving trigger pip, obtain current video image before, also export the light filling control signal, to open external light compensating apparatus.
Optionally, described trigger pip also comprises the hypervelocity trigger pip.
Optionally, described Image Acquisition and treating apparatus also comprise: the hypervelocity trigger element is used for producing described hypervelocity trigger pip when the Vehicle Speed that receives surpasses default speed limit.
Optionally, described image-generating unit comprises the ccd image sensor that 2,000,000 pixels are above.
For addressing the above problem, the present invention also provides a kind of Image Acquisition and disposal route, comprises the steps: to absorb the scene in the area to be monitored, produces the corresponding simulating video flowing; Convert described analog video stream to digital video frequency flow; Analyze described digital video frequency flow, detected vehicle by the time produce the video trigger pip; Under the triggering of trigger pip, obtain current video image from described digital video frequency flow, described trigger pip comprises the video trigger pip; The described video image that obtains is handled, obtained the information of vehicles in the image.
Optionally, the described information of vehicles that obtains in the image comprises: by car plate location, Character segmentation and character recognition, obtain license plate binary image, car plate color and the number-plate number.
Optionally, the described information of vehicles that obtains in the image comprises: by being partitioned into area-of-interest, versicolor pixel number in the color of pixel, the statistics area-of-interest in the identification area-of-interest is to determine body color.
Optionally, described Image Acquisition and disposal route also comprise: the imaging controlled variable of adjusting the image quality that is used to control described analog video stream.
Optionally, described Image Acquisition and disposal route also comprise: after trigger pip triggers, obtain current video image before, output light filling control signal.
Optionally, described trigger pip also comprises the hypervelocity trigger pip.Described Image Acquisition and disposal route also comprise: produce described hypervelocity trigger pip when the Vehicle Speed that receives surpasses default speed limit.
For addressing the above problem, the present invention also provides a kind of vehicle monitoring and register system, comprising:
At least one Flame Image Process and deriving means are used to absorb the scene in the area to be monitored, produce the corresponding simulating video flowing; Convert described analog video stream to digital video frequency flow; Analyze described digital video frequency flow, when having detected vehicle, produce the video trigger pip; After receiving trigger pip, obtain current video image from described digital video frequency flow, described trigger pip comprises the video trigger pip; The described video image that obtains is handled, obtained the information of vehicles in the image; The output result;
Storage and management devices are used to store the result of described Image Acquisition and treating apparatus output, and manage described Image Acquisition and treating apparatus.
Optionally, described vehicle monitoring and register system also comprise: communicator, be connected between described Image Acquisition and treating apparatus and storage and the management devices, be used for the result of described Image Acquisition and treating apparatus output is sent to described storage and management devices.
Optionally, described Image Acquisition and treating apparatus also are used to analyze the digital video frequency flow of described generation, adjust the imaging controlled variable of the image quality be used to control described analog video stream.
Optionally, described Image Acquisition and treating apparatus also are used for after receiving trigger pip, obtain current video image before, output light filling control signal.
Optionally, described vehicle monitoring and register system also comprise: light compensating apparatus, connect described Image Acquisition and treating apparatus, when described Image Acquisition and treating apparatus output light filling control signal, open, be used for the scene of described Image Acquisition and treating apparatus picked-up is carried out light filling.
Optionally, described vehicle monitoring and register system also comprise: speed measuring device, be used for the vehicle that enters the zone of testing the speed is detected, calculate the travel speed of vehicle when testing the speed the zone, and the Vehicle Speed that calculates to described Image Acquisition and treating apparatus output.
Optionally, described trigger pip also comprises the hypervelocity trigger pip, and described Image Acquisition and treating apparatus also are used for producing described hypervelocity trigger pip when the Vehicle Speed of described speed measuring device output surpasses default speed limit.
Optionally, the result of described Image Acquisition and treating apparatus output comprises the time that the video image, license plate binary image, the number-plate number, car plate color, body color and the vehicle that include vehicle passes through.
Optionally, the result of described Image Acquisition and treating apparatus output comprises: trigger time and the Vehicle Speed that the video image that includes over-speed vehicles that obtains, corresponding license plate binary image, the number-plate number, car plate color, body color, vehicle pass through by hypervelocity.
Compared with prior art, technique scheme is integrated in image acquisition and processing in Image Acquisition and the treating apparatus, promptly by image-generating unit picked-up scene, the video trigger element triggers the candid photograph unit and obtains the video image that includes vehicle, information acquisition unit is handled described video image to obtain information of vehicles, realize Embedded image acquisition and processing in real time, and realized the integrated of imaging and Flame Image Process.
Because Image Acquisition and treating apparatus are integrated with imaging and Flame Image Process, thereby have simplified the structure of system, reduced the installation complexity of system.
And, the collection of video image and processing are carried out in Image Acquisition and treating apparatus (front-end equipment), therefore reduced the transmission quantity of data between Image Acquisition and treating apparatus and storage and the management devices effectively, improved the transmission speed of data, also reduced performance requirement storage and management devices.
In addition, above-mentioned Image Acquisition and treating apparatus also have the following advantages:
(daytime, night, dawn, dusk) is fit to represent the feature of vehicle to judge whether that vehicle passes through the video trigger element under the different illumination conditions by detecting, thereby can detect the arrival of vehicle exactly, reduces the probability of false triggering with this.
Information acquisition unit also has the function of body color identification, and abundanter information of vehicles is provided.The area-of-interest that is used for body color identification can be a specific region of vehicle body, rather than complete vehicle body zone, so operand is little, fast operation; And being used to the pixel discerned in the area-of-interest can be the pixel that fixed interval quantity is selected, rather than all pixel in the area-of-interest, has so just further reduced operand, has improved arithmetic speed.
The imaging control module is for every frame video signal, and the image quality of the analog video stream of image-generating unit generation is adjusted in application background brightness in real time; When in the video image of capturing, vehicle license plate characteristic being arranged, use the image quality that the analog video stream of image-generating unit generation is adjusted in car plate brightness, make like this and capture the video image image quality height that the unit obtains, and license plate area is obvious in the image, helps improving the car plate identification of information acquisition unit and the accuracy that body color is discerned.
The hypervelocity trigger element is when Vehicle Speed surpasses default speed limit, produce the hypervelocity trigger pip, trigger the candid photograph unit with this and obtain the video image that includes over-speed vehicles, information acquisition unit is handled described video image to obtain information of vehicles, has so just realized obtaining in real time of candid photograph violating the regulations and vehicles peccancy information.
The imageing sensor of image-generating unit adopts high-resolution ccd sensor, the visual field cover width is greater than a track, not only can obtain high-resolution video image, and on each track, only need Image Acquisition of installation and treating apparatus promptly can guarantee the whole track of image pickup scope all standing, even under the situation of multilane, also have enough stack overlay areas between the Image Acquisition in each track and the treating apparatus.
Above-mentioned vehicle monitoring and register system also have the following advantages:
Light compensating apparatus carries out light filling to the scene of Image Acquisition and treating apparatus picked-up, with this video image that obtains high definition, avoided causing license plate area in the video image not obvious even all be capped the situation of (being complete white shape) far below the conditions such as illumination of car light direct projection because of intense light irradiation, ambient lighting change violent, night background illumination.
The combination of the imaging FEEDBACK CONTROL of light compensating apparatus and Image Acquisition and treating apparatus is used, can the high-resolution imaging of round-the-clock ground, the video image clarity height that makes the candid photograph of daytime and night, efficiently solve problems such as the reflective of vehicle front windshield and high light direct projection, guarantee that vehicle body, car plate and automobile front-row driver and conductor facial characteristics are all clear and legible.
Embodiment
The embodiment of the invention is absorbed scene by image-generating unit, and the video trigger element triggers the candid photograph unit and obtains the video image that includes vehicle, and information acquisition unit is handled described video image to obtain information of vehicles, has realized that thus imaging and Flame Image Process are integrated.Owing to realized Embedded image acquisition and handled in real time, and imaging and Flame Image Process is integrated, therefore simplified the structure of system, reduced the installation complexity of system.
Below in conjunction with drawings and Examples the specific embodiment of the invention is described in detail.The Image Acquisition of embodiment of the present invention and treating apparatus can be installed on the cross bar of traffic route top, are used for monitoring in real time vehicle current on the track.
Fig. 1 is the structural representation of an embodiment of Image Acquisition of the present invention and treating apparatus, shown in Image Acquisition and treating apparatus 1 comprise: image-generating unit 10, analog digital (A/D) converting unit 11, video trigger element 13, capture unit 14 and information acquisition unit 15.
Image-generating unit 10 is used to absorb the scene in the area to be monitored, produces the corresponding simulating video flowing.Image-generating unit 10 comprises optical lens and imageing sensor (not shown), optical lens focuses light rays on the imageing sensor, the scene light signal of image capture sensor area to be monitored (being the camera lens overlay area), and convert electric signal to, promptly export analog video stream corresponding to the video image of area to be monitored.Usually, therefore the visual field cover width of optical lens can guarantee the whole track of image pickup scope all standing greater than a track.
Described imageing sensor can be charge-coupled image sensor (CCD, Charge Coupled Device) sensor or complementary metal oxide semiconductor (CMOS) (CMOS, Complementary Metal OxideSemiconductor) sensor.
In the present embodiment, what imageing sensor adopted is the ccd sensor of high resolving power (for example 2,000,000 pixels or higher).At present, the imaging technique of CCD is very ripe, compares cmos sensor, and the imaging permeability of ccd sensor, acutance are all fine under same pixel, and color rendition, that exposure can guarantee is accurate substantially.Therefore, adopt high-resolution ccd sensor can obtain high-quality image.
A/D converting unit 11 is used for converting the analog video stream that image-generating unit 10 produces to digital video frequency flow.Wherein, digital video frequency flow is exported in the frame signal mode.Corresponding to the ccd sensor that imageing sensor adopts, the digital video frequency flow of A/D converting unit 11 outputs of present embodiment is the CCD frame signal.
Video trigger element 13 is used to analyze the digital video frequency flow that A/D converting unit 11 produces, detected vehicle by the time produce the video trigger pip.
In general, video trigger element 13 can be to analyze every frame of digital vision signal (video image), and whether the gradation of image, color and the edge texture that detect in the presumptive area change, if change, illustrated that vehicle arrives presumptive area, then produced the video trigger pip and exported.Perhaps, video trigger element 13 also can utilize the license plate area in the fast algorithm of locating license plate of vehicle Primary Location video image, in the license plate area of analysis Primary Location whether the feature of car plate is arranged, if vehicle license plate characteristic, then output video trigger pip are arranged.
In the present embodiment, video trigger element 13 is when changing (promptly have frame poor) at the gray scale of the video image of front and back frame, color and edge texture (vehicle license plate characteristic), whether detect different characteristic in the video image at times detects and has vehicle to pass through, and when having detected vehicle and passed through the output video trigger pip, comprise: by day, output video trigger pip when the gray scale of black shade surpasses the most black shadow thresholds at the bottom of the car of setting (have car at the bottom of shadow character) in the video image; At night, output video trigger pip when the car light feature is arranged in the video image; At ambient lighting more weak dawn or dusk, adaptive adjustment detected parameters, described detected parameters is predefined corresponding to the most black shadow thresholds at the bottom of the car at dawn or dusk, specifically, judge dawn or dusk by the road surface brightness that detects in the video image, and select corresponding to the most black shadow thresholds at the bottom of the car at dawn or dusk output video trigger pip during black shadow thresholds at the bottom of the gray scale of black shade surpasses the car of described selection in the video image according to judged result.
(daytime, night, dawn, dusk) is fit to represent the feature of vehicle to judge whether that vehicle passes through the video trigger element 13 of present embodiment under the different illumination conditions by detecting, thereby can detect the arrival of vehicle exactly, reduce the probability of false triggering with this.
In addition, Image Acquisition and treating apparatus 1 have video and trigger function, when detecting the vehicle triggering, obtain the video image that includes vehicle automatically, thereby do not need extra hardware wagon detector to trigger the candid photograph video image, go for being not suitable for installing the place of hardware wagon detector (for example ground induction coil detecting device).Therefore, the scope of application of the installation region of the Image Acquisition of the embodiment of the invention and treating apparatus is more extensive.
Capture unit 14, be used for after receiving trigger pip, the digital video frequency flow that produces from described A/D converting unit 11 obtains current video image, and the described trigger pip of Fig. 1 is the video trigger pip of described video trigger element 13 outputs.Capture unit 14 after the video trigger pip that receives 13 outputs of video trigger element, from the digital video frequency flow of A/D converting unit 11 outputs, obtain the digital video signal (being the CCD frame signal in the present embodiment) of present frame, the image that includes the vehicle that enters the area to be monitored in the video image that obtain this moment, and the digital video signal to present frame compresses, and is converted into the video image of specific format (for example jpeg form).
In addition, the trigger pip that candid photograph unit 14 receives can also comprise hypervelocity trigger pip (as shown in Figure 4), will be elaborated in the back.
Information acquisition unit 15 is used for the video image (digital video signal of present frame) that candid photograph unit 14 obtains is handled, and obtains the information of vehicles in the image.Information of vehicles can comprise the license board information of vehicle, as the number-plate number (comprising Chinese character, letter and number), car plate color and license plate binary image etc.; Information of vehicles can also comprise body color.Accordingly, information acquisition unit 15 can be to obtain the car plate recognition unit of license board information, also can be the color recognition unit that obtains body color information, perhaps, also can be to comprise car plate recognition unit and color recognition unit.
In addition, the information of vehicles that obtains of information acquisition unit 15 can also comprise and capturing the time, place etc. that unit 14 obtains video image (being that vehicle passes through).Usually, the time of obtaining video image is the current system time of Image Acquisition and treating apparatus, and the place is the place that the Image Acquisition of storing in advance and treating apparatus are installed.
Please refer to Fig. 2, information acquisition unit 15 shown in Figure 1 comprises car plate recognition unit 16 and color recognition unit 17.
Car plate recognition unit 16 is used for the video image that candid photograph unit 14 obtains is carried out the identification of license board information, promptly by car plate location, the identification of car plate color, Character segmentation and character recognition, obtains license plate binary image, car plate color and the number-plate number.
Color recognition unit 17, be used for the video image that candid photograph unit 14 obtains is carried out the identification of body color, promptly by being partitioned into area-of-interest, versicolor pixel number in the color of pixel, the statistics area-of-interest in the identification area-of-interest is to determine body color.
The car plate recognition unit 16 of present embodiment comprises: car plate positioning unit 160, car plate color recognition unit 161, Character segmentation unit 162 and character recognition unit 163.
Car plate positioning unit 160 is used to analyze and captures the video image that unit 14 obtains, and orients the license plate area that meets vehicle license plate characteristic, it is split from video image, and convert the license plate binary image to.The car plate location mainly comprises: the license plate area coarse positioning, define the position about car plate bound location and car plate.The license plate binary image is that the coloured image with license plate area converts gray level image to, is obtained by greyscale image transitions again.
Car plate color recognition unit 161 is used to analyze the license plate area that described car plate positioning unit 160 is located, and identifies the car plate color.
Character segmentation unit 162 is used for the license plate area of car plate positioning unit 160 location is divided into single character.Character segmentation generally adopts vertical projection method.
Character recognition unit 163 is used for the character that Character segmentation unit 162 is cut apart is discerned respectively, forms the number-plate number.Wherein, character recognition can application model be mated (Pattern Matching) technology, also can use visual identity (OCR, Optical Character Recognition) technology.
License plate recognition technology is well known to those skilled in the art, and promptly no longer car plate location, Character segmentation and character recognition is launched explanation at this.
The color recognition unit 17 of present embodiment comprises Region Segmentation unit 170, color determining unit 171 and shade recognition unit 172.
Region Segmentation unit 170 is used for being partitioned into area-of-interest from the video image that candid photograph unit 14 obtains.Wherein, area-of-interest can be by the vehicle body zone location, the complete vehicle body zone that from video image, is partitioned into, can be used for representing certain specific region of the vehicle body of whole body color and the area-of-interest of present embodiment is meant field color, the change color in the described zone is slow, the color basically identical of each pixel, even exist reflective, its color change also is uniformly, for example, and car protecgulum zone.
In the present embodiment, Region Segmentation unit 170 utilizes the result of the car plate location of car plate recognition unit 16, be the result of the license plate area location that obtains of the car plate positioning unit 160 of car plate recognition unit 16, the position of vehicle body in the video image that definite candid photograph unit 14 obtains, the areal distribution according to vehicle body is partitioned into car protecgulum zone again.Usually, car protecgulum regional center is consistent with the horizontal ordinate at license plate area center, and the car protecgulum zone that is partitioned into is the rectangular area, and the size of rectangular area can utilize visual experience to determine.Because therefore the result that the license plate area that has directly utilized car plate positioning unit 160 to obtain is located can be partitioned into car protecgulum zone fast.
Color determining unit 171, be used for versicolor pixel number in the color, statistics area-of-interest of the selected pixel of area-of-interest that identified region cutting unit 170 cuts apart, obtain to describe the proper vector of field color, to determine area-of-interest (vehicle body zone in other words) color.
Selected pixel can be a pixel all in the area-of-interest, and in the present embodiment, because the change color in the area-of-interest is slow, therefore, selected pixel can be (laterally or vertically) on the direction in area-of-interest, the pixel that fixed interval quantity is selected.
In the identification area-of-interest selected pixel color can (L represents lightness at Lab, a represents green to red, b represents blue to yellow) select the kernel function (gaussian kernel function or linear kernel function) of correspondence to carry out in the color space, the color of determining area-of-interest can be by described proper vector being utilized support vector machine (SVM, Support Vector Machine) Classification and Identification obtain.Because the color of Lab color space is similar to the perception of color with human eye near evenly distributing, and the aberration of Lab color space helps classifying with SVM also near Euclidean distance, therefore, guaranteed the precision of color identification.
Shade recognition unit 172, the shade that is used for the selected pixel of area-of-interest that identified region cutting unit 170 cuts apart, and the statistical pixel point be assigned to dark color, light color number, determine the shade in area-of-interest (vehicle body zone in other words) with this.Wherein, the shade of selected pixel adopts the threshold method (depth boundary) in HSV (Hue, Saturation, the Value) color space in the identification area-of-interest, determines that the shade of area-of-interest adopts the ballot method.
Need to prove, shade recognition unit 172 only is used for the color of vehicle body is carried out the classification of the depth two classes, that is to say, the simple information (dark or light color) of body color only is provided, therefore, in other embodiments, color recognition unit 17 also can not comprise shade recognition unit 172.
Because the area-of-interest in the present embodiment is a specific region of vehicle body, compares complete vehicle body zone, the color of identification pixel or the operand of the depth have reduced, and arithmetic speed has improved; And the pixel that is used to discern can be the pixel that fixed interval quantity is selected, rather than all pixel in the area-of-interest, has so just further reduced operand, has improved arithmetic speed.
Fig. 3 is the structural representation of another embodiment of Image Acquisition of the present invention and treating apparatus, shown in Image Acquisition and treating apparatus 2 comprise: image-generating unit 10, A/D converting unit 11, imaging control module 12, video trigger element 13, capture unit 24 and information acquisition unit 15.The part that only Fig. 3 is different from Fig. 1 is elaborated below.
Compared to Figure 1, Image Acquisition shown in Figure 3 and treating apparatus 2 also comprise imaging control module 12, are used to be adjusted to picture controlled variable (for example shutter value), and described imaging controlled variable is used to control the image quality of image-generating unit 10.In the present embodiment, imaging control module 12 is adjusted the shutter value by the brightness of specific region in the analysis video image, and wherein, the brightness of specific region comprises background luminance and car plate brightness.
The imaging control module 12 of present embodiment comprises background luminance control image-generating unit and car plate brilliance control image-generating unit.
Background luminance control image-generating unit, be used to obtain the digital video frequency flow that A/D converting unit 11 produces, adjust the shutter value by the background luminance of analyzing in every frame video image, comprising: calculate road surface brightness by brightness histogram, select shutter value corresponding to road surface brightness.Usually, road surface brightness is higher, selects less shutter value; Road surface brightness is lower, selects bigger shutter value.Adjusted shutter value is used to control the image quality of next frame video image.
Car plate brilliance control image-generating unit, be used for when the video image that candid photograph unit 24 obtains has vehicle license plate characteristic, adjust the shutter value by the car plate brightness of analyzing in the described video image that obtains, comprise: calculate car plate brightness by medium filtering, turn the shutter value in car plate brightness in limited time down on greater than normal range, less than transferring big shutter value under the normal range in limited time, and car plate brightness does not change the shutter value in normal range the time in car plate brightness.Do not have vehicle license plate characteristic in the video image that unit 24 obtains then do not adjust the shutter value if capture.Adjusted shutter value is used to control the image quality of next frame video image.
The imaging control module 12 of present embodiment is for every frame video image, and application background brilliance control image-generating unit is adjusted the image quality of the analog video stream of image-generating unit 10 generations in real time; When in the video image of capturing, vehicle license plate characteristic being arranged, use the image quality of car plate brilliance control next frame video image, capture the video image image quality height that unit 24 obtains like this, and license plate area is obvious in the image, helps improving the car plate identification of information acquisition unit 15 and the accuracy that body color is discerned.
In addition, compare with candid photograph unit 14 shown in Figure 1, candid photograph unit 24 shown in Figure 3 after receiving trigger pip (present embodiment is the video trigger pip of video trigger element 13 output), obtain current video image before, also export the light filling control signal, be used to open external light compensating apparatus.Light compensating apparatus is generally intelligent stroboscopic lamp, after stroboscopic lamp is opened, can carry out light filling to the scene of image-generating unit 10 picked-ups, with this video image that obtains high definition, avoided causing license plate area in the video image not obvious even all be capped the situation of (being complete white shape) far below the conditions such as illumination of car light direct projection because of intense light irradiation, ambient lighting change violent, night background illumination.
The Image Acquisition of the embodiment of the invention and treating apparatus can also comprise the hypervelocity trigger element, for example shown in Figure 4, compare with treating apparatus 2 with Image Acquisition shown in Figure 3, Image Acquisition shown in Figure 4 and treating apparatus 3 also comprise hypervelocity trigger element 18, and the trigger pip that candid photograph unit 34 receives also comprises the hypervelocity trigger pip of hypervelocity trigger element 18 outputs.
Hypervelocity trigger element 18 is used for when the Vehicle Speed that receives surpasses default speed limit, produces the hypervelocity trigger pip.The Image Acquisition of present embodiment and treating apparatus 3 can external speed measuring devices (for example radar trap), and the Vehicle Speed that hypervelocity trigger element 18 receives is recorded by speed measuring device.
Capture unit 34, be used for after the hypervelocity trigger pip of video trigger pip that receives 13 outputs of video trigger element or 18 outputs of hypervelocity trigger element, output light filling control signal is obtained current video image then.
Image Acquisition of the foregoing description and treating apparatus can adopt hardware and software in conjunction with realization, on hardware, (for example digital signal processor DSP, microcontroller MCU) is embedded in Image Acquisition and the treating apparatus with image-generating unit, analog digital converting unit and processor, promptly can be integrated on the same circuit board, realize the Highgrade integration of hardware circuit with this; On software, finish video triggering, imaging control, image candid photograph and information by processor and obtain, in the platform that adapts to high hardware integrated level, also realized the real-time and high speed processing of image, obtain information of vehicles accurately.
In the prior art Image Acquisition and handling carry out respectively (for example by analog video camera, image pick-up card finish image acquisition, by carrying out Flame Image Process in embedded integrated circuit board or the image processing apparatus), Image Acquisition of the foregoing description and treating apparatus are the requirement of satisfying high hardware integrated level, make the hardware circuit after integrating be simplified, and, be the platform that adapts to high hardware integrated level and high speed that realizes image and accurately processing, video triggering, imaging control, image are captured and the algorithm of technology for information acquisition has also obtained optimization.
Corresponding Image Acquisition and treating apparatus shown in Figure 1, an embodiment process flow diagram of Image Acquisition of the present invention and disposal route as shown in Figure 5, described method comprises:
Step S1, the scene in the picked-up area to be monitored produces the corresponding simulating video flowing;
Step S2 converts described analog video stream to digital video frequency flow;
Step S4 analyzes described digital video frequency flow, produces the video trigger pip when having detected vehicle;
Step S5 under the triggering of trigger pip, obtains current video image from described digital video frequency flow, and described trigger pip comprises the video trigger pip;
Step S8 handles the described video image that obtains, and obtains the information of vehicles in the image.
Wherein, step S4 is when changing (promptly have frame poor) at the gray scale of the video image of front and back frame, color and edge texture (vehicle license plate characteristic), whether detect different characteristic in the video image at times detects and has vehicle to pass through, comprise: by day, output video trigger pip when the gray scale of black shade surpasses the most black shadow thresholds at the bottom of the car of setting (have car at the bottom of shadow character) in the video image; At night, output video trigger pip when the car light feature is arranged in the video image; At ambient lighting more weak dawn or dusk, output video trigger pip when the gray scale of black shade surpasses at the bottom of the corresponding car the most black shadow thresholds in the video image, the most black shadow thresholds is to judge it is dawn or dusk by the road surface brightness that detects in the video image at the bottom of the car of described correspondence, and selects to obtain corresponding to the most black shadow thresholds at the bottom of the car at dawn or dusk.
The information of vehicles that obtains in the image of step S8 comprises: obtain license board information and/or body color information, wherein, obtaining license board information is by car plate location, the identification of car plate color, Character segmentation and character recognition, obtains license plate binary image, car plate color and the number-plate number; Obtain body color information and be by being partitioned into area-of-interest, versicolor pixel number in the color of pixel, the statistics area-of-interest in the identification area-of-interest is to determine body color.
Image Acquisition and treating apparatus corresponding shown in Figure 3, another embodiment process flow diagram of Image Acquisition of the present invention and disposal route as shown in Figure 6, compared to method shown in Figure 5, method shown in Figure 6 also comprises: adjust the step of the imaging controlled variable of the image quality be used for the analog video stream that controlled step S1 produces, described step comprises step S3 and S9.
Step S3, the background luminance of analyzing in every frame video image is adjusted to the picture controlled variable.Specifically, obtain described digital video frequency flow, and adjust the shutter value, comprising: calculate road surface brightness by brightness histogram, select shutter value corresponding to road surface brightness by the background luminance of analyzing in every frame video image.Usually, road surface brightness is higher, selects less shutter value; Road surface brightness is lower, selects bigger shutter value.
Step S9 when in the described video image that obtains vehicle license plate characteristic being arranged, is adjusted to the picture controlled variable by the car plate brightness of analyzing in the described video image, and described imaging controlled variable is the shutter value.Comprise: calculating car plate brightness by medium filtering, turn the shutter value in car plate brightness in limited time down on greater than normal range, is to transfer big shutter value in car plate brightness less than the normal range lower limit, and car plate brightness does not change the shutter value in normal range the time.
In addition, compare with the step S5 of method shown in Figure 5, among the step S5 ' of method shown in Figure 6, after trigger pip triggers, obtain current video image before, also export the light filling control signal.
The described trigger pip of above-mentioned steps S5 can also comprise the hypervelocity trigger pip, and described hypervelocity trigger pip is to produce when the Vehicle Speed that receives surpasses default speed limit.
Fig. 7 is the structural representation of an embodiment of vehicle monitoring of the present invention and register system, and as shown in the figure, vehicle monitoring and register system comprise: Image Acquisition and treating apparatus 1, communicator 6 and storage and management devices 7.
Image Acquisition and treating apparatus 1 are used to absorb the scene in the area to be monitored, produce the corresponding simulating video flowing; Convert described analog video stream to digital video frequency flow; Analyze described digital video frequency flow, output video trigger pip when having detected vehicle and pass through; After receiving trigger pip, obtain current video image from described digital video frequency flow, described trigger pip comprises the video trigger pip; The described video image that obtains is handled, obtained the information of vehicles in the image; The output result.
The concrete structure of the Image Acquisition of present embodiment and treating apparatus 1 as shown in Figure 1, in addition, Image Acquisition and treating apparatus 1 can also comprise imaging control module as shown in Figure 3.All have been described in detail in the above, in this no longer repeat specification.
The result of the Image Acquisition of present embodiment and treating apparatus 1 output comprises: include time that video image (video image with specific format after the compression), license plate binary image, the number-plate number, car plate color, body color and the vehicle of vehicle pass through etc.
Communicator 6 is connected between Image Acquisition and treating apparatus 1 and storage and the management devices 7, is used for the result of Image Acquisition and treating apparatus 1 output is sent to storage and management devices 7.In general, a storage can be connected a plurality of Image Acquisition and treating apparatus 1 with management devices 7, therefore between Image Acquisition and treating apparatus 1 and storage and management devices 7, need communicator 6 to transmit digital signal, communicator 6 can be a hub (Hub), and the result (digital signal) of a plurality of Image Acquisition and treating apparatus 1 output can be sent to storage and management devices 7 by communicator 6.If when a storage only is connected an Image Acquisition and treating apparatus 1 with management devices 5, can not need communicator 6 between Image Acquisition and treating apparatus 1 and storage and the management devices 7 and directly connection.
Storage and management devices 7 are used for memory image and obtain the result of exporting with treating apparatus 1, and manage connected Image Acquisition and treating apparatus 1.Storage and management devices 7 can be station terminal servers, and it can connect many application servers again, becomes the terminal between Image Acquisition and treating apparatus and the application server, realize the storage and the forwarding of data.
Because the processing of video image is carried out in Image Acquisition and treating apparatus 1 (front-end equipment), therefore reduced the transmission quantity of data effectively, and also reduced performance requirement storage and management devices 7 (for example terminal server).
Fig. 8 is the structural representation of another embodiment of vehicle monitoring of the present invention and register system, and as shown in the figure, vehicle monitoring and register system comprise: Image Acquisition and treating apparatus 2, light compensating apparatus 4, communicator 6 and storage and management devices 7.The part that only Fig. 8 is different from Fig. 7 is elaborated below.
The concrete structure of the Image Acquisition of present embodiment and treating apparatus 2 has been described in detail as shown in Figure 3 in the above, in this no longer repeat specification.
The result of the Image Acquisition of present embodiment and treating apparatus 2 outputs comprises: include time that video image (video image with specific format after the compression), license plate binary image, the number-plate number, car plate color, body color and the vehicle of vehicle pass through etc.
Light compensating apparatus 4 connects Image Acquisition and treating apparatus 2, opens when the candid photograph unit of Image Acquisition and treating apparatus 2 output light filling control signal, is used for the scene of image-generating unit picked-up is carried out light filling.Light compensating apparatus 4 can be a stroboscopic lamp, is installed in the next door of each Image Acquisition and treating apparatus 2.
The FEEDBACK CONTROL of Image Acquisition and treating apparatus 2 imaging control modules and the cooperation of light compensating apparatus 4, can the high-resolution imaging of round-the-clock ground, the video image clarity height that makes the candid photograph of daytime and night guarantees that vehicle body, car plate and automobile front-row personnel facial characteristics are all clear and legible.
Fig. 9 is the structural representation of another embodiment of vehicle monitoring of the present invention and register system, as shown in the figure, vehicle monitoring and register system comprise: Image Acquisition and treating apparatus 3, light compensating apparatus 4, speed measuring device 5, data communication equipment (DCE) 6 and storage and management devices 7.The part that only Fig. 9 is different from Fig. 8 is elaborated below.
The concrete structure of the Image Acquisition of present embodiment and treating apparatus 3 has been described in detail as shown in Figure 4 in the above, in this no longer repeat specification.
The result of the Image Acquisition of present embodiment and treating apparatus 3 outputs comprises: because of video triggers the time that the video image that includes vehicle (video image with specific format after the compression) that obtains, corresponding license plate binary image, the number-plate number, car plate color, body color and vehicle pass through; Perhaps, trigger time and the Vehicle Speed that the video image that includes over-speed vehicles obtain, corresponding license plate binary image, the number-plate number, car plate color, body color, vehicle pass through because of hypervelocity.
Speed measuring device 5 is used for the vehicle that enters the zone of testing the speed is detected, and calculates the travel speed of vehicle when testing the speed the zone, and the Vehicle Speed that calculates of output is to the hypervelocity trigger element of Image Acquisition and treating apparatus 3.Speed measuring device 5 can adopt radar sensor to test the speed, and radar sensor can be installed in the next door of each Image Acquisition and treating apparatus 2, adopts the radar sensor test not to be subject to the influence of ambient lighting, tests the speed accurately the precision height.
In addition, the vehicle monitoring of the embodiment of the invention and register system can also comprise overall view monitoring video camera and digital hard disc video recorder (not shown), the overall view monitoring video camera is installed on the track, be used for the scene on the real time shooting track, and the vision signal that produces is sent to digital hard disc video recorder by communication facilities, digital hard disc video recorder is stored the vision signal of overall view monitoring video camera output with digital signaling.
In sum, above-mentioned Image Acquisition and treating apparatus have the following advantages:
Image acquisition and processing are integrated in Image Acquisition and the treating apparatus, promptly by image-generating unit picked-up scene, the video trigger element triggers the candid photograph unit and obtains the video image that includes vehicle, information acquisition unit is handled described video image to obtain information of vehicles, realized Embedded image acquisition and in real time handle, and realized imaging and Flame Image Process integrated.
The imageing sensor of image-generating unit adopts high-resolution ccd sensor, the visual field cover width is greater than a track, not only can obtain high-resolution video image, and on each track, only need Image Acquisition of installation and treating apparatus promptly can guarantee the whole track of image pickup scope all standing, even under the situation of multilane, also have enough stack overlay areas between the Image Acquisition in each track and the treating apparatus.
(daytime, night, dawn, dusk) is fit to represent the feature of vehicle to judge whether that vehicle passes through the video trigger element under the different illumination conditions by detecting, thereby can detect the arrival of vehicle exactly, reduces the probability of false triggering with this.
Information acquisition unit also has the function of body color identification, and abundanter information of vehicles is provided.The area-of-interest that is used for body color identification can be a specific region of vehicle body, rather than complete vehicle body zone, so operand is little, fast operation; And being used to the pixel discerned in the area-of-interest can be the pixel that fixed interval quantity is selected, rather than all pixel in the area-of-interest, has so just further reduced operand, has improved arithmetic speed.
The imaging control module is for every frame video image, and the image quality of the analog video stream of image-generating unit generation is adjusted in application background brightness in real time; When in the video image of capturing, vehicle license plate characteristic being arranged, use the image quality that the analog video stream of image-generating unit generation is adjusted in car plate brightness, make like this and capture the video image image quality height that the unit obtains, and license plate area is obvious in the image, helps improving the car plate identification of information acquisition unit and the accuracy that body color is discerned.
The hypervelocity trigger element is when Vehicle Speed surpasses default speed limit, produce the hypervelocity trigger pip, trigger the candid photograph unit with this and obtain the video image that includes over-speed vehicles, information acquisition unit is handled described video image to obtain information of vehicles, has so just realized obtaining in real time of candid photograph violating the regulations and vehicles peccancy information.
Above-mentioned vehicle monitoring and register system have the following advantages:
Image acquisition and processing are integrated in Image Acquisition and the treating apparatus, and it is integrated to be about to imaging and Flame Image Process, thereby have simplified the structure of system, have reduced the installation complexity of system.
The collection of video image and processing are carried out in Image Acquisition and treating apparatus (front-end equipment), therefore reduced the transmission quantity of data between Image Acquisition and treating apparatus and storage and the management devices effectively, improved the transmission speed of data, and also reduced performance requirement storage and management devices.
Light compensating apparatus carries out light filling to the scene of Image Acquisition and treating apparatus picked-up, with this video image that obtains high definition, avoided causing license plate area in the video image not obvious even all be capped the situation of (being complete white shape) far below the conditions such as illumination of car light direct projection because of intense light irradiation, ambient lighting change violent, night background illumination.
The combination of the imaging FEEDBACK CONTROL of light compensating apparatus and Image Acquisition and treating apparatus is used, can the high-resolution imaging of round-the-clock ground, the video image clarity height that makes the candid photograph of daytime and night, efficiently solve problems such as the reflective of vehicle front windshield and high light direct projection, guarantee that vehicle body, car plate and automobile front-row driver and conductor facial characteristics are all clear and legible.
Though the present invention with preferred embodiment openly as above; but it is not to be used for limiting the present invention; any those skilled in the art without departing from the spirit and scope of the present invention; can make possible change and modification, so protection scope of the present invention should be as the criterion with the scope that claim of the present invention was defined.