Disclosure of Invention
In order to solve the problems, the invention provides a violation detection system based on license plate searching, which determines the position of a vehicle window based on the gray value distribution condition in a shot image, searches the license plate based on the position of the vehicle window to obtain a corresponding license plate sub-image, and executes character recognition on the license plate sub-image based on an OCR recognition mode to obtain and output a corresponding license plate number, thereby realizing the quick searching and recognition of the license plate of a violation vehicle.
More specifically, the present invention has at least the following four important points:
(1) the method comprises the steps of acquiring the position of a vehicle window of a vehicle running a red light through high-precision vehicle window identification, and acquiring a sub-image of a license plate in a shot image based on the position of the vehicle window of the vehicle and the position of a front vehicle window corresponding to the license plate in a reference vehicle body profile so as to facilitate identification and violation reporting;
(2) adding the deviation values of all pixel points in the image deviating from the gray average value of the pixel points to obtain a total deviation value, and dividing the total deviation value by the number of pixels of the image to obtain the deviation average value of the image, thereby providing a data basis for identifying the vehicle window by utilizing the characteristic that the gray values of the vehicle window are uniformly distributed;
(3) a plurality of sub-images formed by surrounding a plurality of contour lines in the image to be analyzed are used as a plurality of images to be recognized, so that the image recognition range is effectively narrowed;
(4) the method comprises the steps of obtaining a clearer three-dimensional image through adjusting an automatic focal length in the three-dimensional camera equipment, and converting the three-dimensional image into a two-dimensional image to be processed with a wide visual field based on a splicing mode of removing the duplicate of the same content so as to improve the effectiveness of subsequent processing of the image.
According to an aspect of the present invention, there is provided a license plate search based violation detection system, the system comprising:
the signal lamp control equipment is used for carrying out on-off control on a red signal lamp, a yellow signal lamp and a blue signal lamp at the position right in front of the traffic intersection, and is also used for outputting the color of the signal lamp displayed at the current time;
the violation detection starting equipment is connected with the signal lamp control equipment and used for controlling the stereo camera equipment to enter a starting state when the color of the signal lamp displayed at the received current time is red or yellow, and the violation detection starting equipment is also used for controlling the stereo camera equipment to enter a power saving state when the color of the signal lamp displayed at the received current time is blue;
the three-dimensional camera shooting equipment is arranged right in front of the traffic intersection, is connected with the violation detection starting equipment, comprises a camera sequence, parameter extraction equipment, motor control equipment and data output equipment and is used for three-dimensionally shooting the passing area of the traffic intersection;
the camera sequence comprises two cameras which are vertically arranged and are used for shooting respective visual field ranges so as to respectively obtain an upper visual field image and a lower visual field image;
the void filling device is connected with the data output device and used for receiving the passing area images, detecting each void in the passing area images, realizing filling operation of each void in the passing area images and obtaining and outputting filling processing images after the filling operation; filling each hole in the passing area image comprises the following steps: progressively determining the pixel value of each pixel point included in each cavity based on the pixel value of the pixel point beside each cavity;
and the contour line detection device is connected with the cavity filling device and used for receiving the filling processing image, detecting contour lines in the filling processing image to obtain a plurality of contour lines, and outputting a plurality of sub-images formed by enclosing the contour lines as sub-images to be processed.
Detailed Description
Embodiments of the license plate search based violation detection system of the present invention will be described in detail below with reference to the accompanying drawings.
The windows, i.e., car windows, are important components of the entire vehicle body and are designed to meet the requirements of lighting, ventilation and the field of vision of the driver and passengers in the vehicle. The car window has the following different installation positions according to the glass: front and rear air windows, side windows and doors and windows. The modeling structure and the quality of the vehicle window have great influence on the visual field of a driver, the comfort of passengers, the appearance, the aerodynamic characteristics and the like.
The window structure is usually a curved closed type, and is connected between a window frame and window glass of a vehicle body by a rubber sealing strip. The sealing strip has the functions of sealing and buffering, so that the windshield glass cannot be damaged when the window frame is deformed due to the stress of the vehicle body.
As for the design of the vehicle model, the position of the vehicle window relative to the license plate is fixed, and once the position of the vehicle window is fixed, the position of the license plate is also fixed, the recognition of the position of the vehicle window can be used for quickly positioning the license plate detection of the vehicle against the regulations, so that the search range is narrowed. However, such a solution is lacking in the prior art.
In order to overcome the defects, the invention builds a license plate search-based violation detection system, and can position and OCR (optical character recognition) the license plate position of the violation vehicle by referring to the position of the vehicle window, thereby improving the efficiency and speed of license plate recognition.
Fig. 1 is a field schematic diagram of a scene where a license plate search-based violation detection system is located according to an embodiment of the invention.
As shown in fig. 1, the scene where the violation detection system based on license plate search is located includes a stereo camera 1, an L-shaped vertical rod 2, a solar sailboard 3, a control box 4, a protective layer 5 and a ground 6.
The three-dimensional camera shooting device 1, a red signal lamp, a yellow signal lamp and a blue signal lamp are placed on the L-shaped vertical rod 2, the solar sailboard 3 is also arranged on the L-shaped vertical rod 2, the control box body 4 is located on the ground 6 and in the protective layer 5, and the control box body 4 comprises field control devices such as signal lamp control devices.
The violation detection system based on license plate search comprises the following equipment:
the signal lamp control equipment is used for carrying out on-off control on a red signal lamp, a yellow signal lamp and a blue signal lamp at the position right in front of the traffic intersection;
the signal lamp control equipment is also used for outputting the color of a signal lamp displayed at the current time.
Next, the specific structure of the license plate search based violation detection system of the present invention will be further described.
In the violation detection system based on license plate search, the method further comprises the following steps:
the violation detection starting equipment is connected with the signal lamp control equipment and is used for controlling the stereo camera equipment to enter a starting state when the color of the received signal lamp displayed at the current time is red or yellow;
the violation detection starting equipment is also used for controlling the stereo camera equipment to enter a power saving state when the color of the signal lamp displayed at the received current time is blue.
In the violation detection system based on license plate search, the method further comprises the following steps:
the three-dimensional camera shooting equipment is arranged right in front of the traffic intersection, is connected with the violation detection starting equipment, comprises a camera sequence, parameter extraction equipment, motor control equipment and data output equipment and is used for three-dimensionally shooting the passing area of the traffic intersection;
the camera sequence comprises two cameras which are vertically arranged and are used for shooting respective visual field ranges so as to respectively obtain an upper visual field image and a lower visual field image;
the parameter extraction equipment is respectively connected with the two cameras of the camera sequence and is used for receiving the upper view image and the lower view image, acquiring a central subimage in the upper view image, searching a similar subimage with matched content in the lower view image based on the central subimage, and taking the coordinate offset from a central pixel point in the central subimage to a central pixel point of the similar subimage as the parallax between the upper view image and the lower view image;
the motor control equipment is respectively connected with the camera sequence and the parameter extraction equipment, and is used for determining the distance between a main target shot in the upper view image or the lower view image and the camera sequence based on the parallax and driving a motor to realize the focal length adjustment of the two cameras based on the distance;
the data output equipment is connected with the motor control equipment and the camera sequence and is used for performing splicing processing of removing the duplicate of the same content on the upper view image and the lower view image which are respectively obtained by the two cameras after the motor control equipment finishes focal length adjustment so as to obtain and output a passing area image;
the void filling device is connected with the data output device and used for receiving the passing area images, detecting each void in the passing area images, realizing filling operation of each void in the passing area images and obtaining and outputting filling processing images after the filling operation; filling each hole in the passing area image comprises the following steps: progressively determining the pixel value of each pixel point included in each cavity based on the pixel value of the pixel point beside each cavity;
the contour line detection device is connected with the cavity filling device and used for receiving the filling processing image, detecting contour lines in the filling processing image to obtain a plurality of contour lines, and outputting a plurality of sub-images formed by the plurality of contour lines as to-be-processed sub-images;
the graying processing equipment is used for receiving the multiple sub images to be processed and respectively executing graying processing on the multiple sub images to be processed so as to obtain and output multiple graying sub images;
the average value extraction equipment is connected with the graying processing equipment and is used for receiving the multiple graying sub-images and determining the average gray value of each graying image based on the gray value of each pixel point in each graying sub-image;
the pixel number detection device is connected with the graying processing device and is used for receiving the graying sub-images and determining the total number of pixel points in each graying sub-image to be output as the pixel number of each graying sub-image;
a deviation analyzing device respectively connected to the average value extracting device and the pixel number detecting device, for receiving the average gray value of each grayed sub-image and the pixel number of each grayed sub-image, and performing the following processing for each grayed sub-image: determining a deviation value of the gray value of each pixel point in the grayed sub-image from the average gray value, wherein the deviation value is a numerical value which is more than or equal to zero, adding the deviation values of the pixel points in the grayed sub-image to obtain a total deviation value of the grayed sub-image, and dividing the total deviation value of the grayed sub-image by the number of pixels of the grayed sub-image to obtain a deviation average value of the grayed sub-image;
the vehicle window extraction device is connected with the deviation analysis device and used for receiving the deviation average value of each grayed sub-image, comparing the deviation average values of the grayed sub-images, and taking the grayed sub-image corresponding to the deviation average value with the minimum value in the deviation average values of the grayed sub-images as the vehicle window sub-image to be output;
the license plate searching device is respectively connected with the contour line detection device and the window extraction device, and is used for receiving the window sub-images and the filling processing images, searching the parts corresponding to the license plates in the filling processing images to be used as license plate sub-images to be output based on the relative positions of the window sub-images in the filling processing images and the positions of the front windows corresponding to the license plates in the reference vehicle body outline;
the license plate recognition equipment is connected with the license plate searching equipment and used for receiving the license plate sub-images and executing character recognition on the license plate sub-images based on an OCR recognition mode so as to obtain and output corresponding license plate numbers;
the violation information sending equipment is connected with the license plate recognition equipment and used for receiving the license plate number and sending the license plate number and the current time to a nearby traffic management operation server;
wherein the contour line detection device detecting the contour lines in the fill-up processed image to obtain a plurality of contour lines includes: and only including the contour line which has an included angle with the vertical direction or the horizontal direction less than or equal to a preset angle in the filling processing image in the obtained contour lines.
In the violation detection system based on license plate search:
the violation information sending device is one of time division duplex communication equipment, 3G communication equipment, CDMA communication equipment and GPRS communication equipment.
In the violation detection system based on license plate search, the method further comprises the following steps:
and the timing equipment is arranged on one side of the three-dimensional camera equipment and is used for outputting the current time.
In the violation detection system based on license plate search:
the timing device is connected with the violation information sending device and used for sending the current moment to the violation information sending device.
In the violation detection system based on license plate search:
the hole filling device comprises a data receiving unit, a hole detecting unit, a hole filling unit and a data output unit.
In the violation detection system based on license plate search:
the data receiving unit is connected with the data output equipment and used for receiving the passing area image;
the hole detection unit is connected with the data receiving unit and is used for detecting each hole in the passing area image;
the hole filling unit is connected with the hole detection unit and is used for filling each hole in the passing area image;
and the data output unit is connected with the hole filling unit and used for obtaining and outputting a filling processing image after filling operation.
In addition, time division duplexing is a duplexing method of a communication system for separating reception and transmission channels in a mobile communication system. Mobile communication is currently developing to the third generation, and china filed the third generation draft of mobile communication standards (TD-SCDMA) in 6 months 1997, and its features such as TDD mode and new technology of smart antenna are highly evaluated and become one of three main candidate standards. TDD mode has not been emphasized on the whole in FDD mode in first and second generation mobile communication systems. However, due to the need for new services and the development of new technologies, and many advantages of the TDD mode, the TDD mode will be increasingly emphasized.
The working principle of time division duplex is as follows: TDD is a duplex scheme of a communication system for separating a reception channel and a transmission channel (or uplink and downlink) in a mobile communication system. In the TDD mode mobile communication system, the receiving and transmitting are in different time slots of the same frequency channel, namely carrier, and the receiving and transmitting channels are separated by using the guaranteed time; in the FDD mode, the receiving and transmitting are performed on two separate symmetric frequency channels, and the receiving and transmitting channels are separated by a guaranteed frequency band.
The characteristics and communication benefits of mobile communication systems employing different duplex modes are different. The uplink and downlink channels in the TDD mode mobile communication system use the same frequency, and thus have reciprocity of the uplink and downlink channels, which brings many advantages to the TDD mode mobile communication system.
In TDD mode, the transmission of information in uplink and downlink can be performed on the same carrier frequency, i.e. the transmission of information in uplink and the transmission of information in downlink are realized by time division on the same carrier.
The violation detection system based on license plate search is adopted to solve the technical problem that the image recognition search range of the license plate of the violation vehicle in the prior art is too large, the position of the vehicle window in the shot image is obtained through the gray value distribution condition of the vehicle window, the position of the license plate is further determined, and the corresponding license plate number is determined based on the image part of the license plate, so that the image search range of the license plate is narrowed, and the technical problem is solved.
It is to be understood that while the present invention has been described in conjunction with the preferred embodiments thereof, it is not intended to limit the invention to those embodiments. It will be apparent to those skilled in the art from this disclosure that many changes and modifications can be made, or equivalents modified, in the embodiments of the invention without departing from the scope of the invention. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are still within the scope of the protection of the technical solution of the present invention, unless the contents of the technical solution of the present invention are departed.