[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN101916448A - Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern) - Google Patents

Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern) Download PDF

Info

Publication number
CN101916448A
CN101916448A CN 201010248283 CN201010248283A CN101916448A CN 101916448 A CN101916448 A CN 101916448A CN 201010248283 CN201010248283 CN 201010248283 CN 201010248283 A CN201010248283 A CN 201010248283A CN 101916448 A CN101916448 A CN 101916448A
Authority
CN
China
Prior art keywords
pixel
background
moving target
lbp
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010248283
Other languages
Chinese (zh)
Inventor
刘辉
强振平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
YUNNAN QINGMOU TECHNOLOGY CO LTD
Original Assignee
YUNNAN QINGMOU TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by YUNNAN QINGMOU TECHNOLOGY CO LTD filed Critical YUNNAN QINGMOU TECHNOLOGY CO LTD
Priority to CN 201010248283 priority Critical patent/CN101916448A/en
Publication of CN101916448A publication Critical patent/CN101916448A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

The invention discloses a moving object detecting method based on a Bayesian frame and an LBP (Local Binary Pattern), which relates to the technical field of intellectualized video monitoring. The method comprises the following steps of: 1. extracting a video frame in a video stream; 2. preprocessing the video frame and eliminating the interference of fine light ray change and other disturbance; 3. carrying out moving object detection based on a background model and the Bayesian frame; before detecting, filtering a pixel point with unchanged time difference and background difference and degrading color dimensionality in modeling, wherein the speed of the whole method is improved, and the background model comprises a color characteristic and a symbiotic color characteristic and can favorably detect a moving and static object in a video; and 4. removing a shadow, detecting the texture information of the obtained moving object area and the texture information of a background image corresponding area by utilizing an LBP descriptor and comparing the differences of the texture information for removing the shadow in moving object detection.

Description

A kind of moving target detecting method based on Bayesian frame and LBP
(1) technical field
The present invention relates to intelligent technical field of video monitoring, particularly a kind of moving target detecting method based on Bayesian frame and LBP.
(2) background technology
Whether the moving target in intelligent video monitoring system detects in real time, is a major subjects of processing of low layer computer vision and Digital Image Processing, mainly be to detect to have dynamic object to exist from the still image sequence that video camera is caught.Moving object detection is that target is cut apart the important prerequisite with extraction, tracking, behavior understanding and event recognition, also is the basis of video analysis and processing, video monitoring system robotization.Because the dynamic change that exists in the reality scene, as in the generation of illumination, weather, shade, catastrophic event and the background chaotic disturb have (the switch motion of the rocking of branch, door etc.), make that motion detection is the work of a difficulty.In recent years, many scientists were devoted to the research of moving target detecting method, and it mainly can be divided three classes: frame-to-frame differences point-score, background model method and optical flow method.
Wherein the basic thought of frame-to-frame differences point-score is: variation has necessarily taken place in the grey scale pixel value corresponding to the moving region in the sequence image, by being done, consecutive frame subtracts each other processing, and use appropriate threshold to judge the variation of gray-scale value, just can extract the moving region.The simplest frame-to-frame differences point-score also has and improvedly respectively adjacent three frames is got difference in twos, at last difference result is got three-frame difference method with computing.Because method of difference mainly is based on the method for time shaft filtering image is processed, therefore the variation to illumination is not very sensitive, and calculated amount is less, its shortcoming mainly is, can not well extract complete target, under the slower situation of target translational speed, detected moving target is inner can to produce very big cavity, translational speed is too fast, and the moving region again can be more a lot of greatly than actual motion target.
The background model method mainly is that the video image of current input and the background model of having set up are compared, and by judging the variation of grey scale pixel value, or cuts apart moving target in the information extraction prospects such as color value and statistic histogram.The background model method generally is divided into three steps: at first, each pixel in the image is carried out statistical modeling based on gray-scale value or color value; Then, the background image of present image and statistics is carried out change-detection based on thresholding, extract dynamic area with respect to the static background model.At last, background model is carried out adaptive renewal, in the hope of adapting to the variation of dynamic scene.Utilize present image and reference model image to compare based on the method for background model and detect the moving region, generally speaking, can detect all motion pixels, but the interference to incoming event in illumination variation or the scene is responsive especially, especially can't handle the caused shade of local illumination variation in the scene, usually detection is the part of moving target, follow-up target following is handled brought very big inconvenience.Method commonly used has the method based on parameter model and nonparametric model, as average background model method, intermediate value background model method, single Gaussian Background modelling, mixed Gauss model method, based on the background method of formation of kalman filtering theory and based on the method for Density Estimator etc.
Optical flow method mainly is to utilize space motion object to detect the moving region in the variation of the caused pixel displacement vector of the plane of delineation, and different objects can corresponding different motion vector districts.Optical flow method mainly be object in of the projection of three-dimensional velocity in two dimensional image plane, i.e. its calculating be the transient change of each pixel in the image, the overall optical flow field has comprised movable information and shape facility information.Motion detection based on optical flow computation is a transient change in the whole scene owing to what calculate, can detect independently moving target under the situation of priori, and can be used for the movement background occasion.But owing to noise, illumination in the scene, block and the existence of shade, make that the optical flow field that calculates is not very accurate, and the computing method more complicated of light stream, as no special hardware environment support, be difficult to real-time scene.
A kind of moving target detecting method involved in the present invention based on Bayesian frame and LBP, wherein the moving object detection of Bayesian frame refers at first set up the background model of video scene, adopt bayesian theory that background in the video scene or moving target are judged according to background model of setting up and real-time video information then, and the result who judges according to bayesian theory upgrade to background model; LBP is the abbreviation of English Local Binary Pattern, Chinese is the partial binary pattern, he itself is a kind of strong texture description method, it has the gray level rotational invariance, and to illumination-insensitive, adopt LBP to describe in the inventive method based on the detected motion target area texture of Bayesian frame, and and the background model texture that adopts LBP to describe compares judgement, elimination reaches effective moving object detection based on shade and erroneous judgement in the detected moving target of Bayesian frame.
The inventive method is that a kind of moving target detecting method based on Bayesian frame and LBP is divided into four steps: the first step, extract the video frame images in the video stream data; Second step, every frame video image is carried out pre-service, promptly smoothing processing reduces interference and other disturbances that light changes to reach; The 3rd step, set up background model, carry out moving object detection based on Bayesian frame, comprise the background modeling and the study renewal of video sequence, and based on background on the bayesian theory basis and moving object classification; The 4th step, detect the moving target obtain for the 3rd step and add LBP and describe, describe comparing judgement with the LBP of the background model of current foundation, eliminate based on shade and erroneous judgement in the detected moving target of Bayesian frame.
Can significantly reduce the shade of eliminating moving target itself when the light variation influences moving object detection with other disturbances by this method, increase the accuracy of moving object detection, guaranteed the validity of the follow-up moving object classification of moving object detection, motion target tracking etc.
(3) summary of the invention
The technical problem to be solved in the present invention is: 1) solve the influence problem of the variation of light in the video sequence to the moving object detection accuracy, promptly adopt pre-service to video sequence, disturbance in the smoothed video sequence and light change, and make that the moving object detection in the video sequence has robustness for trickle disturbance and light variation; 2) solution is based on the speed issue of the moving object detection of video sequence, promptly carry out change-detection earlier by video frame images on the one hand for the needs analysis, do not carrying out computings such as context update, motion detection for the zone that does not change, by demoting for color dimension grade in modeling process, this two aspect can improve the speed of whole moving object detection on the other hand; 3) influence of non-moving region interested in the solution moving object detection, such as the curtain of the branch that flickers, the water surface that ripples, computer screen, swing, the fan of rotation and staircase of operation or the like influence for moving object detection, the characteristic model that promptly comprises static background object and non-movement background object interested by foundation is eliminated the influence of non-movement background object interested to detecting when moving object detection; 4) the moving target shade is promptly rejected the dash area that detects in the moving target that obtains by comparing based on the difference of detected LBP descriptor of Bayesian frame and current background model LBP descriptor to the influence of moving object detection in the solution moving object detection.
A kind of moving target detecting method based on Bayesian frame and LBP of primary study of the present invention the objective of the invention is to realize by following four steps:
The first step is extracted the video frame images in the video stream data.
In second step, the pre-service of video frame images is promptly carried out smoothing processing to video frame images, specifically adopts the gaussian kernel of 5*5 to carry out smoothing processing.
The 3rd step, carry out moving object detection based on background model and Bayesian frame, concrete steps comprise: 1) the second step processed video two field picture is carried out change-detection, the pixel in the corresponding zone that does not change will be labeled as the background pixel point, and not need to carry out subsequent treatment; 2) pixel of the region of variation that detection is obtained is divided into background pixel point or moving target pixel according to Bayes rule; 3) denoising, merging moving target pixel are promptly to 2) detect the further denoising of moving target pixel, the merging processing that obtain, obtain complete moving target; 4) study of background model is upgraded.
The 4th step, carry out shadow removal to detecting the moving target that obtains in the 3rd step based on LBP, the motion target area texture that concrete relatively LBP description detection obtains and the texture of background model corresponding region, if texture is very approaching, then think motion target detection owing to shade causes, these pixels will be rejected from moving target.
The method in the 3rd step is refered in particular to:
1) change detecting method refers in particular to:
A) video frame images of handling through second step is carried out inter-frame difference and background difference, inter-frame difference refers in particular to the difference of current video two field picture and last video frame images, and the background subtraction branch refers in particular to the difference of current video frame figure and background model image;
B) the image employing least square mean value theorem (LMedS) of background difference is carried out self-adaption thresholding processing acquisition bianry image and represent whether each pixel in the current video two field picture exists variation with background image;
C) if inter-frame difference and background difference satisfy unconverted situation simultaneously, these pixels will be as the no change pixel, and be labeled as the background pixel point, do not carrying out follow-up background model renewal processing and moving object detection processing, remaining pixel is labeled as and has the pixel that changes, the pixel that these existence change will be as follow-up pending pixel, and this method will improve arithmetic speed greatly.
2) the moving target pixel detects, promptly detect the acquisition moving target to there being the pixel that changes, for existing the pixel that changes to add up its characteristic information and the corresponding characteristic information of background model is added up judgement according to the background model of current foundation and Bayes rule.
A) wherein feature, the background model feature of statistics are refered in particular to:
I. be labeled as the pixel of variation after handling for the no change pixel of inter-frame difference mark and background difference thresholding, use the RGB color feature vector v of current time t t=[r tg tb t] TAs feature,
And, the RGB color dimension of 256 kinds of grades is repartitioned by 64 gray shade scales in order to improve arithmetic speed;
Ii. the pixel that changes for the existence of inter-frame difference mark, the proper vector of using the symbiosis color be as feature, and the proper vector of so-called symbiosis color is refered in particular to the proper vector v that the RGB color of previous moment and current time constitutes jointly t=[r T-1g T-1b T-1r tg tb t] T, and in order to improve arithmetic speed, the RGB color dimension of 256 kinds of grades is repartitioned by 32 gray shade scales;
Iii. background model need comprise that each proper vector is at the distribution probability P at pixel s place (v except above proper vector t| s) and the conditional probability P (v that belongs to proper vector under the condition of background at pixel s t| b, s);
Iv. establish I=1 ..., N, it is P (v t| b, s) through the top n cylindricality in the histogram after the descending sort, for given M 1And M 2, as M 1=90%, M 2=10%, there is an Integer N 1Satisfy the condition of formula (1):
&Sigma; i = 1 N 1 P ( v t i | b , s ) > M 1 and &Sigma; i = 1 N 1 P ( v t i | f , s ) < M 2 - - - ( 1 )
Still be the proper vector of pixel of moving target type for no matter from background like this, can obtain a characteristic statistics form, be designated as
Figure BSA00000221533600044
I=1 ..., N 2(N 2>N 1), this form will be recorded in pixel s place, N during time t 2Individual important statistical information, every element of this statistical table just are made up of three shown in the following formula (2) parts:
S v t s , t , i = p v t , i = P ( v t i | s ) p vb t , i = P ( v t i | b , s ) v t i = [ a 1 i , . . . , a n i ] T - - - ( 2 )
B) Bayes judges the regular as follows of background and moving target:
I. establishing b is background, and f is a moving target, the proper vector v of ordering for s tPosterior probability formula be:
P ( C | v t , s ) = P ( v t | C , s ) P ( C | s ) P ( v t | s ) , C=b?or?f (3)
Ii. utilize Bayes decision rule, if proper vector satisfies following formula (4), then the pixel at this place can be considered to background:
P(b|v t,s)>P(f|v t,s) (4)
Iii. notice the proper vector relevant or belong to target context, or belong to moving target, promptly satisfy formula (5) with pixel s:
P(v t|s)=P(v t|b,s)·P(b|s)+P(v t|f,s)·P(f|s) (5)
Iv. formula (3) formula and formula (5) formula substitution formula (4) are obtained formula (6):
2P(v t|b,s)·P(b|s)>P(v t|s) (6)
V. can draw, by the proper vector in calculating probability P (b|s) and the background model at the distribution probability P at pixel s place (v t| s) and pixel s belong to the conditional probability P (v of proper vector under the condition of background t| b, s), just can be with proper vector V tBe categorized as moving target or background.
C) according to Bayes rule the pixel of having added up color characteristic and symbiosis color characteristic being detected the method that obtains the moving target pixel is:
I. with current proper vector v tPreceding N with background model characteristic statistics form 1Individual proper vector compares, and similar proper vector is added up, to obtain the characteristic probability of proper vector;
Ii. establish v t=[a 0..., a n] T,
Figure BSA00000221533600061
By in the formula (2)
Figure BSA00000221533600062
Obtain, then characteristic probability is as shown in the formula acquisition:
P ( b | s ) = p b s , t P ( v t | s ) = &Sigma; j &Element; M ( v t ) p v s , t , j P ( v t | b , s ) = &Sigma; j &Element; M ( v t ) P vb s , t , j - - - ( 7 )
M (v wherein t) expression
Figure BSA00000221533600064
In with v tThe feature set of coupling is defined as:
M ( v t ) = { k : &ForAll; m &Element; { 1 , . . . n } , | a m - a m k | &le; &delta; } - - - ( 8 )
Wherein δ represents vector distance, if
Figure BSA00000221533600066
In do not have element coupling v t, P (v t| s) and P (v t| b s) is set to 0;
Iii. with in the characteristic probability substitution formula (6) that calculates in (7), pixel s just has been divided into background pixel point or moving target pixel.
3) denoising, merge the moving target pixel: the moving target pixel that obtains corresponding 2), comprising some noise spots, and there is cavitation in motion target area, need further handle.
Concrete grammar is:
I. current processing video frames image is made up bianry image according to background pixel point and moving target pixel;
Ii. carry out twice morphology expansive working and eliminate cavity in the motion target area obtaining bianry image;
Iii. the bianry image after the last step being handled carries out three morphological erosion operations and eliminates noise spot;
Iv. the bianry image after the last step being handled carries out the unnecessary corrosion operation once of morphology expansive working compensation.
4) study of background model is upgraded, and the study of the background model in this method is upgraded and comprised two steps, and the first, finish the renewal of background model, the second, need finish the renewal of background image;
A) background model is upgraded and is divided into two classes, and the first kind is upgraded for the gradual change background model, and second class is upgraded for the sudden change background model, and concrete grammar is:
I. the detection of updating type, when the background sudden change took place, the new background characteristics after changing can become principal character immediately, from formula (1) and formula (5) as can be known, if satisfy following formula, then can detect the background of undergoing mutation at s point place, otherwise what take place is gradual change:
P ( f | s ) &Sigma; i = 1 N 1 P ( v t i | f , s ) > T - - - ( 9 )
Wherein, T is a percent value, determine by it when new feature is regarded as new background, when the value of T was big, system can be more stable, but the reaction to sudden change can be slowed down, yet, if T gets smaller value, the easier frequent updating background characteristics of system, in this patent method, adopt T=90%;
Ii. the method for gradual change situation update background module, proper vector v tBe used for to pixel t constantly pixel s belong to the characteristic of division vector of moving target or background, individual features color characteristic or symbiosis color characteristic upgrade by formula (10):
Figure BSA00000221533600072
I=1 ..., N 2, α 2Be learning rate, the speed of its controlling features study, if be judged as background at moment t pixel s,
Figure BSA00000221533600073
Otherwise, In formula (2)
Figure BSA00000221533600075
V in the set tDuring coupling
Figure BSA00000221533600076
When not matching
Figure BSA00000221533600077
Iii. the situation of suddenling change update background module method, for the proper vector of each pixel s, in case the sudden change background judge to occur with new at the s place, the feature of statistics is with following formula adjustment:
p b s , t + 1 = 1 - p b s , t p vb s , t + 1 , i = ( p v s , t , i - p b s , t &CenterDot; p vb s , t , i ) / p b s , t + 1 - - - ( 11 )
B) renewal of background image, the update method of background image also are divided into two classes according to the update method of background model, and promptly the first kind is upgraded for the gradual change background image, and second class is upgraded for the sudden change background image, and concrete grammar is:
I. under the situation for the gradual change update background module, background image with new method as shown in the formula:
B c(s,t+1)=(1-α 1)B c(s,t)+α 1I c(s,t) (12)
B cThe expression background image, wherein { r, g, b} represent RGB color model, I to c ∈ cThe expression current video frame, α 1Be the study undated parameter;
Ii. for the sudden change update background module situation under, background image with new method as shown in the formula:
B c(s,t+1)=I c(s,t),for?c=r,g,b (13)
The moving target that the 4th step promptly obtained detection carries out shadow removal based on LBP, specifically be the motion target area texture information that utilizes the LBP descriptor to detect to obtain and the texture information of background image corresponding region, because the texture information of shadow region and the texture information of background image are closely similar, relatively the difference of their texture information just can be rejected the shade in the moving object detection.
1) wherein the LBP method of describing texture information is refered in particular to:
Selected a certain pixel is a central point, with the radius R is step-length, Correlation Centre point and with its gray-scale value at a distance of the neighborhood point of R, central point threshold value as a comparison, obtain one group of description of representing the binary value of grey scale change in the radius R as grey scale change, and calculate its LBP value:
LBP P , R ( x c , y c ) = &Sigma; p = 0 p - 1 s ( g p - g c ) 2 p , s ( x ) = 1 x &GreaterEqual; 0 0 x < 0 - - - ( 14 )
Wherein, g cBe central point (x c, y c) gray-scale value, P is neighbours' number selected on the radius R, g pPut the gray-scale value of P for neighbours.The LBP operator is that the point set of symmetry on the circumference of R is neighbours usually with the radius, radius of a circle and neighbours count by user's decision, and the grey scale change of the local pixel of the big more description of radius is accurate more, but calculated amount also increases, all radiuses adopt 1 in this method, and it is 8 that neighbours count out.
2) concrete moving target shadow removal method is:
I. according to the moving target bianry image that obtains in the 3rd step, in current processing video frames image, calculate the LBP value of each pixel corresponding to each moving target pixel, be designated as F LBP
Ii. according to the moving target bianry image that obtains in the 3rd step, in the current background image, calculate the LBP value of each pixel corresponding to each moving target pixel, be designated as B LBP
Iii.F LBPWith B LBPBe a binary digit string, calculate the Hamming distance of these two binary digit strings;
Iv. judge by the Hamming distance of relatively acquisition and the size of threshold value whether pixel is shade:
Ham(F LBP,B LBP)<T 1 (15)
Wherein, Ham is the hamming distance function, T 1Be a threshold value, F in this granting LBPWith B LBPBe 8 bit word strings, get T 1Be 2, i.e. F LBPWith B LBPHamming distance detects the moving target pixel that obtains and background image for the pixel texture pixel less than 2 expressions, be judged as shade, and from the moving target pixel this pixel of rejecting, finally obtain the moving target of this algorithm.
The present invention has following technical characterictic:
1, the video image that need handle every frame of this method at first adopts the gaussian kernel of 5*5 to carry out smoothing processing, has eliminated because the interference that trickle light changes and other disturbances.
2, this method video frame images of needing to carry out moving object detection after to smoothing processing carries out change-detection earlier, to no longer carry out subsequent treatment to adopting inter-frame difference and background subtraction branch to detect the pixel that does not have variation, improve the arithmetic speed of entire method;
3, the background model feature of this method employing comprises color characteristic and symbiosis color characteristic, wherein color characteristic can be described the difference of current processing video frames and background image well, the symbiosis color characteristic is the difference of two frame video images of inter-frame difference pre-process and post-process well, so both the target of in the current video sequence, moving can well be detected, also the moving target of forbidding in the current video sequence can be detected well.
4, this method has been carried out further division for the color characteristic of background model employing and the color grade of symbiosis color characteristic, has reduced the color dimension, has improved the speed of algorithm.
5, the pixel of this method region of variation that detection is obtained carries out the division of background pixel point or moving target pixel according to Bayes rule.
6, this method detects the foundation Bayes rule and obtains the moving target pixel and carried out denoising and merged handling, and obtains more complete motion target area.
7, this method is classified to the renewal of background model feature, adopts gradual change to upgrade and two kinds of strategies of sudden change renewal, has satisfied the actual change situation of video scene.
8, this method is described texture information to moving target and the LBP that detection obtains at last, and the texture information of describing with the LBP of background compares, and as Shadows Processing, has rejected the shade in the moving object detection for the similar situation of texture information.
Compared with prior art, the invention has the advantages that:
1, this method has been carried out pre-service before video frame images is carried out moving object detection, has eliminated because the interference that trickle light changes and other disturbances by smoothing processing.
2, the image of this method after to smoothing processing carried out change detection, do not carry out subsequent treatment for the pixel that does not have conversion, when in addition the pixel that has variation being carried out feature extraction the color dimension has been carried out dimensionality reduction, these 2 speed that all improve entire method.
3, this law moving target that detection is obtained has carried out denoising, merging and has rejected Shadows Processing, makes whole moving object detection more accurate.
(4) description of drawings
Fig. 1 the present invention is a kind of processing procedure synoptic diagram of the moving target detecting method based on Bayesian frame and LBP.
Fig. 2 the present invention is a kind of process flow diagram of the moving target detecting method based on Bayesian frame and LBP.
(5) embodiment
Further describe below in conjunction with specific embodiments and the drawings:
Embodiment 1:
Figure 1 shows that the present invention is a kind of processing procedure synoptic diagram of the moving target detecting method based on Bayesian frame and LBP, the inventive method is at first extracted video frame images in the video stream data for video stream data; And video frame images carried out pre-service, promptly adopt the gaussian kernel of 5*5 to carry out interference and other disturbances that smoothing processing changes to eliminate trickle light to video frame images; Just level and smooth rear video two field picture is carried out carrying out moving object detection based on background model and Bayesian frame then, obtain preliminary moving target; The motion target area texture and the shadow-texture of background model corresponding region that adopt LBP describe to detect at last to obtain are rejected the shade in the moving object detection, the robustness of increase entire method.
Embodiment 2:
Fig. 2 is a kind of process flow diagram of the moving target detecting method based on Bayesian frame and LBP for the present invention, and concrete flow chart description is as follows:
1) at first extracting its every frame video image for the video flowing sequence handles.
2) video frame images carries out pre-service, promptly adopts the gaussian kernel of 5*5 to carry out interference and other disturbances that smoothing processing changes to eliminate trickle light to video frame images.
3) carry out moving object detection based on background model and Bayesian frame, specifically comprise:
A) change-detection, promptly the video frame images after level and smooth is carried out inter-frame difference and background difference simultaneously, if inter-frame difference and background difference satisfy unconverted situation simultaneously, these pixels will be as the no change pixel, and be labeled as the background pixel point, do not carrying out follow-up background model renewal processing and moving object detection processing, remaining pixel is labeled as and has the pixel that changes, the pixel that these existence change will be as follow-up pending pixel, and this method will improve arithmetic speed greatly.
B) the moving target pixel detects, promptly at first exist the pixel that changes to carry out symbiosis color characteristic statistics to inter-frame difference in the change-detection, change the statistics that the pixel that does not have variation in the while inter-frame difference carries out color characteristic to existing in the background difference, background model feature and the Bayes rule according to current foundation detects the acquisition moving target to the pixel of having added up color characteristic and symbiosis color characteristic then.
C) denoising, merging moving target pixel, promptly for the moving target pixel that obtains, because comprising some noise spots, and there is cavitation in motion target area, need further handle, adopt twice morphology expansive working in this method, and then carry out three morphological erosion operations, carry out a morphology expansive working at last and finish processing.
D) study of background model is upgraded, the study of background model is upgraded needs to upgrade current background model feature and background image, specifically at first judge updating type, promptly upgrade and suddenly change to upgrade to handle respectively making algorithm be more suitable for variation in actual environment for gradual change.
4) carry out shadow removal based on LBP, promptly because the texture information of the texture information of shadow region and background image is closely similar, method has strong texture description feature based on LBP texture description symbol, it has the gray level rotational invariance simultaneously, and to illumination-insensitive, the motion target area texture information that utilizes the LBP descriptor to detect like this to obtain and the texture information of background image corresponding region, relatively the difference of their texture information obtains complete moving target information at last to reject the shade in the moving object detection.

Claims (8)

1. the moving target detecting method based on Bayesian frame and LBP is characterized in that, described method specifically may further comprise the steps:
(1) extracts video frame images in the video stream data;
(2) pre-service of video frame images;
(3) carry out moving object detection based on background model and Bayesian frame;
(4) carry out shadow removal based on LBP.
2. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 1 is characterized in that, describedly video frame images is carried out pre-service comprises:
(1) adopt the gaussian kernel of 5*5 that the video frame images that extracts is carried out smoothing processing.
3. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 1 is characterized in that, describedly carries out moving object detection based on background model and Bayesian frame and may further comprise the steps:
(1) change-detection;
(2) the moving target pixel detects;
(3) denoising, merging moving target pixel;
(4) study of background model is upgraded.
4. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 3 is characterized in that, described change-detection concrete steps are:
(1) video frame images after the smoothing processing is carried out inter-frame difference and background difference;
(2) the image employing least square mean value theorem (LMedS) of background difference is carried out self-adaption thresholding processing acquisition bianry image and represent whether each pixel in the current video two field picture exists variation with background image;
(3) extract the pixel that has variation in the inter-frame difference by inter-frame difference, extract the pixel that has variation in the background difference but do not have conversion in the inter-frame difference by inter-frame difference and background difference.
5. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 3 is characterized in that, described moving target pixel detects concrete steps and is:
(1) the symbiosis color characteristic of the pixel that existence changes in the statistics inter-frame difference;
(2) add up the color characteristic that has variation in the background difference but do not have the pixel of conversion in the inter-frame difference;
(3), adopt Bayes rule to judge whether each pixel is the moving target pixel based on the characteristic information of each pixel of statistics and current background model information.
6. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 3 is characterized in that, described denoising, merging moving target pixel concrete steps are:
(1) current processing video frames image is made up bianry image according to background pixel point and moving target pixel;
(2) carry out twice morphology expansive working and eliminate cavity in the motion target area obtaining bianry image;
(3) bianry image after the processing of last step is carried out three morphological erosion operations and eliminate noise spot;
(4) bianry image after the processing of last step is carried out the unnecessary corrosion operation once of morphology expansive working compensation.
7. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 3 is characterized in that, the study of described background model is upgraded concrete steps and is:
(1) updating type is judged, promptly judges to belong to the gradual change renewal or belong to sudden change and upgrades;
(2) for gradual change situation update background module and background image;
(3) for sudden change situation update background module and background image.
8. a kind of moving target detecting method based on Bayesian frame and LBP according to claim 1 is characterized in that, describedly carries out the shadow removal concrete steps based on LBP and is:
(1) the moving target bianry image to having obtained is corresponding to the LBP value of calculating each pixel in the image of each moving target pixel after current processing video frames is level and smooth;
(2) the moving target bianry image to having obtained calculates the LBP value of each pixel in the current background image corresponding to each moving target pixel;
(3) two LBP values of above acquisition are calculated its Hamming distance;
(4) judge the Hamming distance and the size of threshold value calculate, rejecting direct-shadow image vegetarian refreshments.
CN 201010248283 2010-08-09 2010-08-09 Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern) Pending CN101916448A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010248283 CN101916448A (en) 2010-08-09 2010-08-09 Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010248283 CN101916448A (en) 2010-08-09 2010-08-09 Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern)

Publications (1)

Publication Number Publication Date
CN101916448A true CN101916448A (en) 2010-12-15

Family

ID=43323952

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010248283 Pending CN101916448A (en) 2010-08-09 2010-08-09 Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern)

Country Status (1)

Country Link
CN (1) CN101916448A (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102147861A (en) * 2011-05-17 2011-08-10 北京邮电大学 Moving target detection method for carrying out Bayes judgment based on color-texture dual characteristic vectors
CN102222339A (en) * 2011-06-17 2011-10-19 中国科学院自动化研究所 Multi-dimension background modeling method based on combination of textures and intensity characteristics
CN102568002A (en) * 2011-12-20 2012-07-11 福建省华大数码科技有限公司 Moving object detection algorithm based on fusion of texture pattern and movement pattern
CN102740107A (en) * 2011-04-11 2012-10-17 鸿富锦精密工业(深圳)有限公司 Damage monitoring system of image surveillance equipment and method
CN102915544A (en) * 2012-09-20 2013-02-06 武汉大学 Video image motion target extracting method based on pattern detection and color segmentation
CN103259964A (en) * 2012-11-21 2013-08-21 上海申瑞电网控制系统有限公司 Image signal filtering method of video dynamic target capture
CN103544693A (en) * 2013-04-11 2014-01-29 Tcl集团股份有限公司 Method and system for extracting foreground object
CN103778785A (en) * 2012-10-23 2014-05-07 南开大学 Vehicle tracking and detecting method based on parking lot environment video monitoring
CN103824307A (en) * 2012-11-16 2014-05-28 浙江大华技术股份有限公司 Method and device for determining invalid moving-object pixels
CN104320625A (en) * 2014-11-04 2015-01-28 无锡港湾网络科技有限公司 Intelligent video monitoring method and system for safe village
CN103246886B (en) * 2013-05-30 2016-06-15 四川农业大学 Based on the detection method of background and the crop pest of multiple features database
CN106056062A (en) * 2016-05-27 2016-10-26 东南大学 Vehicle detection method based on adaptive local characteristic background model
CN106355204A (en) * 2016-08-31 2017-01-25 武汉大学 Target tracking method based on Bayesian learning and incremental subspace learning
CN103632340B (en) * 2012-08-24 2017-11-24 原相科技股份有限公司 Object tracking device and its operating method
CN107845103A (en) * 2017-10-23 2018-03-27 广东美的制冷设备有限公司 Alarm method, device and computer-readable recording medium based on texture information
CN108871290A (en) * 2018-06-07 2018-11-23 华南理工大学 A kind of visible light dynamic positioning method based on optical flow method detection and Bayesian forecasting
CN109035295A (en) * 2018-06-25 2018-12-18 广州杰赛科技股份有限公司 Multi-object tracking method, device, computer equipment and storage medium
CN109214996A (en) * 2018-08-29 2019-01-15 深圳市元征科技股份有限公司 A kind of image processing method and device
CN110119730A (en) * 2019-06-03 2019-08-13 齐鲁工业大学 A kind of monitor video processing method, system, terminal and storage medium
CN110163149A (en) * 2019-05-21 2019-08-23 北京百卓网络技术有限公司 Acquisition methods, device and the storage medium of LBP feature
CN111383340A (en) * 2018-12-28 2020-07-07 成都皓图智能科技有限责任公司 Background filtering method, device and system based on 3D image
CN111724415A (en) * 2020-06-20 2020-09-29 马鞍山职业技术学院 Video image-based multi-target motion detection and tracking method in fixed scene
CN112637568A (en) * 2020-12-24 2021-04-09 中标慧安信息技术股份有限公司 Distributed security monitoring method and system based on multi-node edge computing equipment
CN113379006A (en) * 2021-08-16 2021-09-10 北京国电通网络技术有限公司 Image recognition method and device, electronic equipment and computer readable medium
CN114567778A (en) * 2022-04-24 2022-05-31 北京云中融信网络科技有限公司 Video coding method and system
CN115359094A (en) * 2022-09-05 2022-11-18 珠海安联锐视科技股份有限公司 Moving target detection method based on deep learning

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101674478A (en) * 2009-10-19 2010-03-17 浙江大学 Video super-resolution method based on compressed domain

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101674478A (en) * 2009-10-19 2010-03-17 浙江大学 Video super-resolution method based on compressed domain

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《中国数字医学》 20071031 苏松志等 医学步态分析中的复杂场景下运动目标检测技术 摘要,正文第29页第1栏最后1段至第31页第2栏最后1段,图1 1-8 第2卷, 第10期 *
《系统工程与电子技术》 20070630 张玲等 基于局部二元图的视频对象阴影检测方法 摘要、正文第974页第2栏最后1段至第977页第2栏第3段 1-8 第29卷, 第6期 *

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102740107A (en) * 2011-04-11 2012-10-17 鸿富锦精密工业(深圳)有限公司 Damage monitoring system of image surveillance equipment and method
CN102147861A (en) * 2011-05-17 2011-08-10 北京邮电大学 Moving target detection method for carrying out Bayes judgment based on color-texture dual characteristic vectors
CN102222339A (en) * 2011-06-17 2011-10-19 中国科学院自动化研究所 Multi-dimension background modeling method based on combination of textures and intensity characteristics
CN102222339B (en) * 2011-06-17 2013-03-20 中国科学院自动化研究所 Multi-dimension background modeling method based on combination of textures and intensity characteristics
CN102568002B (en) * 2011-12-20 2014-07-09 福建省华大数码科技有限公司 Moving object detection algorithm based on fusion of texture pattern and movement pattern
CN102568002A (en) * 2011-12-20 2012-07-11 福建省华大数码科技有限公司 Moving object detection algorithm based on fusion of texture pattern and movement pattern
CN103632340B (en) * 2012-08-24 2017-11-24 原相科技股份有限公司 Object tracking device and its operating method
CN102915544A (en) * 2012-09-20 2013-02-06 武汉大学 Video image motion target extracting method based on pattern detection and color segmentation
CN102915544B (en) * 2012-09-20 2015-04-15 武汉大学 Video image motion target extracting method based on pattern detection and color segmentation
CN103778785A (en) * 2012-10-23 2014-05-07 南开大学 Vehicle tracking and detecting method based on parking lot environment video monitoring
CN103824307A (en) * 2012-11-16 2014-05-28 浙江大华技术股份有限公司 Method and device for determining invalid moving-object pixels
CN103824307B (en) * 2012-11-16 2016-04-06 浙江大华技术股份有限公司 A kind of method and apparatus determining lost motion object pixel
CN103259964A (en) * 2012-11-21 2013-08-21 上海申瑞电网控制系统有限公司 Image signal filtering method of video dynamic target capture
CN103259964B (en) * 2012-11-21 2016-04-27 上海申瑞电网控制系统有限公司 The picture signal filtering method of video dynamic target capture
CN103544693A (en) * 2013-04-11 2014-01-29 Tcl集团股份有限公司 Method and system for extracting foreground object
CN103246886B (en) * 2013-05-30 2016-06-15 四川农业大学 Based on the detection method of background and the crop pest of multiple features database
CN104320625A (en) * 2014-11-04 2015-01-28 无锡港湾网络科技有限公司 Intelligent video monitoring method and system for safe village
CN106056062A (en) * 2016-05-27 2016-10-26 东南大学 Vehicle detection method based on adaptive local characteristic background model
CN106355204A (en) * 2016-08-31 2017-01-25 武汉大学 Target tracking method based on Bayesian learning and incremental subspace learning
CN106355204B (en) * 2016-08-31 2019-08-20 武汉大学 Method for tracking target based on Bayesian learning and increment sub-space learning
CN107845103A (en) * 2017-10-23 2018-03-27 广东美的制冷设备有限公司 Alarm method, device and computer-readable recording medium based on texture information
CN107845103B (en) * 2017-10-23 2022-03-11 广东美的制冷设备有限公司 Alarm method and device based on texture information and computer readable storage medium
CN108871290A (en) * 2018-06-07 2018-11-23 华南理工大学 A kind of visible light dynamic positioning method based on optical flow method detection and Bayesian forecasting
CN109035295A (en) * 2018-06-25 2018-12-18 广州杰赛科技股份有限公司 Multi-object tracking method, device, computer equipment and storage medium
CN109214996A (en) * 2018-08-29 2019-01-15 深圳市元征科技股份有限公司 A kind of image processing method and device
CN109214996B (en) * 2018-08-29 2021-11-12 深圳市元征科技股份有限公司 Image processing method and device
CN111383340A (en) * 2018-12-28 2020-07-07 成都皓图智能科技有限责任公司 Background filtering method, device and system based on 3D image
CN111383340B (en) * 2018-12-28 2023-10-17 成都皓图智能科技有限责任公司 Background filtering method, device and system based on 3D image
CN110163149A (en) * 2019-05-21 2019-08-23 北京百卓网络技术有限公司 Acquisition methods, device and the storage medium of LBP feature
CN110119730A (en) * 2019-06-03 2019-08-13 齐鲁工业大学 A kind of monitor video processing method, system, terminal and storage medium
CN111724415A (en) * 2020-06-20 2020-09-29 马鞍山职业技术学院 Video image-based multi-target motion detection and tracking method in fixed scene
CN112637568A (en) * 2020-12-24 2021-04-09 中标慧安信息技术股份有限公司 Distributed security monitoring method and system based on multi-node edge computing equipment
CN113379006B (en) * 2021-08-16 2021-11-02 北京国电通网络技术有限公司 Image recognition method and device, electronic equipment and computer readable medium
CN113379006A (en) * 2021-08-16 2021-09-10 北京国电通网络技术有限公司 Image recognition method and device, electronic equipment and computer readable medium
CN114567778A (en) * 2022-04-24 2022-05-31 北京云中融信网络科技有限公司 Video coding method and system
CN114567778B (en) * 2022-04-24 2022-07-05 北京云中融信网络科技有限公司 Video coding method and system
CN115359094A (en) * 2022-09-05 2022-11-18 珠海安联锐视科技股份有限公司 Moving target detection method based on deep learning

Similar Documents

Publication Publication Date Title
CN101916448A (en) Moving object detecting method based on Bayesian frame and LBP (Local Binary Pattern)
CN109766830B (en) Ship target identification system and method based on artificial intelligence image processing
CN102147861A (en) Moving target detection method for carrying out Bayes judgment based on color-texture dual characteristic vectors
CN106373146B (en) A kind of method for tracking target based on fuzzy learning
CN109919053A (en) A kind of deep learning vehicle parking detection method based on monitor video
CN104966305A (en) Foreground detection method based on motion vector division
CN112802054A (en) Mixed Gaussian model foreground detection method fusing image segmentation
CN114743152A (en) Automatic extraction method and system for video key frames of blast furnace burden surface
Tian et al. Multi-object tracking with inter-feedback between detection and tracking
Wang et al. Target detection algorithm based on gaussian mixture background subtraction model
CN111784744A (en) Automatic target detection and tracking method based on video monitoring
CN106056078A (en) Crowd density estimation method based on multi-feature regression ensemble learning
CN112164061A (en) Micro-gesture detection method beneficial to non-contact human-computer interaction
He et al. A Pedestrian Detection Method Using SVM and CNN Multistage Classification.
CN108241837B (en) Method and device for detecting remnants
CN107886524B (en) Method for identifying motion track of elevator door
Zhang et al. Pedestrian intrusion detection based on improved GMM and SVM
Lee et al. Robust detection of preceding vehicles in crowded traffic conditions
Huang et al. The precise recognition of moving object in complex background
El Baf et al. Fuzzy foreground detection for infrared videos
Sujatha et al. An innovative moving object detection and tracking system by using modified region growing algorithm
Cserni et al. Combining Classical and Neural Approaches for Image Segmentation
Alboqomi et al. Sky Pixel Detection in Outdoor Urban Scenes: U-Net with Transfer Learning.
CN112418105B (en) High maneuvering satellite time sequence remote sensing image moving ship target detection method based on difference method
Bhaskar et al. Background modeling using adaptive cluster density estimation for automatic human detection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20101215