CN106973321A - Determine the method and device of video cardton - Google Patents
Determine the method and device of video cardton Download PDFInfo
- Publication number
- CN106973321A CN106973321A CN201710207433.8A CN201710207433A CN106973321A CN 106973321 A CN106973321 A CN 106973321A CN 201710207433 A CN201710207433 A CN 201710207433A CN 106973321 A CN106973321 A CN 106973321A
- Authority
- CN
- China
- Prior art keywords
- video data
- data
- video
- frame
- acquisition time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000005538 encapsulation Methods 0.000 claims abstract description 29
- 238000004040 coloring Methods 0.000 claims description 86
- 230000008569 process Effects 0.000 abstract description 21
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 12
- 238000006243 chemical reaction Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000006854 communication Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 241001269238 Data Species 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000002789 Panax ginseng Nutrition 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4396—Processing of audio elementary streams by muting the audio signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a kind of method and device for determining video cardton, belong to multimedia technology field.This method includes：Video data is isolated from audio, video data；The image information of the reference picture prestored is encapsulated into video data, the video data after being encapsulated；During the video data after encapsulation is shown in designated area, view data, and the first acquisition time of recording image data are gathered；According to the first acquisition time of view data and view data, it is determined that the video played whether interim card.The present invention is by the way that the image information of reference picture is encapsulated into video data, and during video data is shown, the acquisition time of collection view data and recording image data, and then based on view data and acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, be determined by currently playing video data, determine that result is more accurate, real-time is stronger.
Description
Technical field
The present invention relates to multimedia technology field, more particularly to a kind of method and device for determining video cardton.
Background technology
Interim card is frequently problem in video display process, and after the video cardton of broadcasting, user will be unable to smoothness
Video is watched on ground, and this not only greatly affected the perception of user, and reduce viscosity of the user to live platform.In order to change
The perception of kind user, user is to the viscosity of live platform for increase, can be in video display process, it is thus necessary to determine that the video of broadcasting is
No interim card, and then the sending strategy of video data is adjusted in time.
Prior art is based primarily upon the audio and video buffer queue in Flash player modules, it is determined that whether the video played blocks
, specific determination process is：In video display process, whether the queue of detection audio and video buffer is empty, if audio and video buffer
Queue is sky, it is determined that the video cardton of broadcasting；If audio and video buffer queue is non-NULL, it is determined that the video of broadcasting does not block
.
During the present invention is realized, inventor has found that prior art at least has problems with：
Usual audio and video buffer queue not only can buffered video data, but also can buffered audio data, when audio frequency and video are slow
When depositing the uncached video data of a buffered audio data in queue, because audio and video buffer queue is non-NULL, prior art is determined
The non-interim card of video of broadcasting, and the video actually played interim card, therefore, the determination result of prior art is inaccurate.
The content of the invention
In order to solve problem of the prior art, the embodiments of the invention provide it is a kind of determine video data interim card method and
Device.The technical scheme is as follows：
On the one hand there is provided a kind of method for determining video data interim card, methods described includes：
When receiving audio, video data, video data is isolated from the audio, video data；
The image information of the reference picture prestored is encapsulated into the video data, the video counts after being encapsulated
According to；
Based on the player module bound with the first display module, the video data after the encapsulation is shown in designated area
During, view data is gathered, and record the first acquisition time of described image data；
According to the first acquisition time of described image data and described image data, it is determined that the video played whether interim card.
In another embodiment of the present invention, the image information by the reference picture prestored is encapsulated into described
In video data, before the video data after being encapsulated, methods described also includes：
Two frame reference pictures are encoded in advance, and the two field pictures include red reference picture and green reference picture；
Obtain the sequence parameter set and picture parameter set of the two field pictures；
Using the coded frame of the sequence parameter set, described image reference set and the two frames reference picture as described
The image information of reference picture.
In another embodiment of the present invention, the image information by the reference picture prestored is encapsulated into described
In video data, the video data after being encapsulated, including：
Determine the frame type of the video data；
If the frame type of the video data is video heads frame, by the sequence parameter set, described image parameter set
It is encapsulated into the video data, obtains the video data after the encapsulation；
If the frame type of the video data is video frame image, video data is being received according to the video data
Odd even attribute in sum, from the coded frame of the two frames reference picture, chooses target code frame, and by the target code
Frame is encapsulated into the video data, obtains the video data after the encapsulation.
In another embodiment of the present invention, it is described according to the video data received video data sum in
Odd even attribute, from the coded frame of the two frames reference picture, chooses target code frame, including：
If odd even attribute of the video data in video data sum has been received is odd number, by the red ginseng
The coded frame of image is examined as the target code frame；
If odd even attribute of the video data in video data sum has been received is even number, the green is joined
The coded frame of image is examined as the target code frame.
In another embodiment of the present invention, first collection according to described image data and described image data
Time, it is determined that play video whether interim card, including：
Obtain the first bitmap colouring information of described image data；
Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；
Judge whether the first bitmap colouring information and the second bitmap colouring information are identical；
If the first bitmap colouring information and the second bitmap colouring information are differed, it is determined that the video of broadcasting
Not interim card；
If the first bitmap colouring information is identical with the second bitmap colouring information, when judging first collection
Between difference between second acquisition time whether be more than specified threshold；
If the difference between first acquisition time and second acquisition time is less than the specified threshold, after
Continuous collection view data is judged；
If the difference between first acquisition time and second acquisition time is more than the specified threshold, really
Surely the video cardton played.
In another embodiment of the present invention, methods described also includes：
Voice data is isolated from the video data；
Based on the player module bound with the second display module, the video data is shown in viewing area and institute is played
State voice data；
During the video data after the encapsulation is shown in the designated area, based on the first display group
The Jing Yin playing audio data of player module of part binding.
On the other hand there is provided a kind of device for determining video data interim card, described device includes：
Data separating module, for when receiving audio, video data, video counts to be isolated from the audio, video data
According to；
Data package module, for the image information of the reference picture prestored to be encapsulated into the video data,
Video data after being encapsulated；
Data acquisition module, for based on the player module bound with the first display module, institute to be shown in designated area
During stating the video data after encapsulation, view data is gathered；
Logging modle, the first acquisition time for recording described image data；
Determining module, for the first acquisition time according to described image data and described image data, it is determined that play
Video whether interim card.
In another embodiment of the present invention, described device also includes：
Coding module, for encoding two frame reference pictures in advance, the two field pictures include red reference picture and green
Reference picture；
Acquisition module, sequence parameter set and picture parameter set for obtaining the two field pictures；By the sequential parameter
Collection, described image reference set and the two frames reference picture coded frame as the reference picture image information.
In another embodiment of the present invention, the data package module, the frame class for determining the video data
Type；When the frame type of the video data is video heads frame, the sequence parameter set, described image parameter set are encapsulated into institute
State in video data, obtain the video data after the encapsulation；When the frame type of the video data is video frame image, root
According to odd even attribute of the video data in video data sum has been received, from the coded frame of the two frames reference picture,
Target code frame is chosen, and the target code frame is encapsulated into the video data, the video counts after the encapsulation are obtained
According to.
In another embodiment of the present invention, the data package module, for being received when the video data
When odd even attribute in video data sum is odd number, the coded frame of the red reference picture is regard as the target code
Frame；When the video data is when the odd even attribute in having received video data sum is even number, by the green reference picture
Coded frame be used as the target code frame.
In another embodiment of the present invention, the determining module, the first bitmap for obtaining described image data
Colouring information；Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；Judge described
Whether one bitmap colouring information and the second bitmap colouring information are identical；When the first bitmap colouring information and described second
When bitmap colouring information is differed, it is determined that the video of broadcasting not interim card；When the first bitmap colouring information and described
When second bitmap colouring information is identical, judge whether the difference between first acquisition time and second acquisition time is big
In specified threshold；When the difference between first acquisition time and second acquisition time is less than the specified threshold,
Continue collection view data to be judged；When the difference between first acquisition time and second acquisition time is more than institute
When stating specified threshold, it is determined that the video cardton played.
In another embodiment of the present invention, described device also includes：
The data separating module, for isolating voice data from the video data；
Display module, for based on the player module bound with the second display module, being regarded in viewing area described in display
Frequency is according to simultaneously playing audio data；
Playing module, during the video data after the encapsulation is shown in the designated area, based on
The Jing Yin playing audio data of player module of the first display module binding.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：
By the way that the image information of reference picture is encapsulated into video data, and during video data is shown, adopt
Collect the acquisition time of view data and recording image data, and then based on view data and acquisition time, determine that video data is
No interim card.The process need not detect audio and video buffer queue, be determined by currently playing video data, determine result more
It is stronger for accurate, real-time.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, makes required in being described below to embodiment
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is a kind of method flow diagram for determination video cardton that one embodiment of the invention is provided；
Fig. 2 is a kind of method flow diagram for determination video cardton that another embodiment of the present invention is provided；
Fig. 3 is a kind of apparatus structure schematic diagram for determination video cardton that another embodiment of the present invention is provided；
Apparatus structure schematic diagram that Fig. 4 is that the embodiment of the present invention four is provided ....
Embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention
Formula is described in further detail.
The embodiments of the invention provide a kind of method for determining video cardton, referring to Fig. 1, side provided in an embodiment of the present invention
Method flow includes：
101st, when receiving audio, video data, video data is isolated from audio, video data.
102nd, the image information of the reference picture prestored is encapsulated into video data, the video counts after being encapsulated
According to.
103rd, based on the player module bound with the first display module, the video data after encapsulation is shown in designated area
During, gather view data, and the first acquisition time of recording image data.
104th, according to the first acquisition time of view data and view data, it is determined that play video whether interim card.
Method provided in an embodiment of the present invention, by the way that the image information of reference picture is encapsulated into video data, and
During showing video data, the acquisition time of collection view data and recording image data, and then based on view data and
Acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by currently playing video
Data are determined, and determine that result is more accurate, real-time is stronger.
In another embodiment of the present invention, the image information of the reference picture prestored is encapsulated into video data
In, before the video data after being encapsulated, method also includes：
Two frame reference pictures are encoded in advance, and the two field pictures include red reference picture and green reference picture；
Obtain the sequence parameter set and picture parameter set of two field pictures；
Believe the coded frame of sequence parameter set, image reference collection and two frame reference pictures as the image of reference picture
Breath.
In another embodiment of the present invention, the image information of the reference picture prestored is encapsulated into video data
In, the video data after being encapsulated, including：
Determine the frame type of video data；
If the frame type of video data is video heads frame, sequence parameter set, picture parameter set are encapsulated into video counts
In, the video data after being encapsulated；
If the frame type of video data is video frame image, according to video data in video data sum has been received
Odd even attribute, from the coded frame of two frame reference pictures, chooses target code frame, and target code frame is encapsulated into video data
In, the video data after being encapsulated.
In another embodiment of the present invention, belonged to according to odd even of the video data in video data sum has been received
Property, from the coded frame of two frame reference pictures, target code frame is chosen, including：
If odd even attribute of the video data in video data sum has been received is odd number, by red reference picture
Coded frame is used as target code frame；
If odd even attribute of the video data in video data sum has been received is even number, by green reference picture
Coded frame is used as target code frame.
In another embodiment of the present invention, according to the first acquisition time of view data and view data, it is determined that broadcasting
The video put whether interim card, including：
Obtain the first bitmap colouring information of view data；
Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；
Judge whether the first bitmap colouring information and the second bitmap colouring information are identical；
If the first bitmap colouring information and the second bitmap colouring information are differed, it is determined that the video of broadcasting not interim card；
If the first bitmap colouring information and the second bitmap colouring information are identical, the first acquisition time and the second collection are judged
Whether the difference between the time is more than specified threshold；
If the difference between the first acquisition time and the second acquisition time is less than specified threshold, continue to gather picture number
According to being judged；
If the difference between the first acquisition time and the second acquisition time is more than specified threshold, it is determined that the video of broadcasting
Interim card.
In another embodiment of the present invention, this method also includes：
Voice data is isolated from video data；
Based on the player module bound with the second display module, video data is shown in viewing area and audio number is played
According to；
During the video data after encapsulation is shown in designated area, based on the broadcasting bound with the first display module
The Jing Yin playing audio-fequency data of component.
Above-mentioned all optional technical schemes, can form the alternative embodiment of the present invention, herein no longer using any combination
Repeat one by one.
The embodiments of the invention provide a kind of method for determining video cardton, referring to Fig. 2, side provided in an embodiment of the present invention
Method flow includes：
201st, terminal prestores the image information of reference picture.
Wherein, terminal is the equipment with video playback capability, can be smart mobile phone, tablet personal computer, notebook computer
Deng the specific restriction of product type work of the embodiment of the present invention not to terminal.
In embodiments of the present invention, terminal obtain reference picture image information when, can using following steps 2011~
2013：
2011st, terminal encodes two frame reference pictures in advance.
Wherein, reference picture be the embodiment of the present invention in be used for detect play video whether the standard picture of interim card, should
Reference picture includes the size phase of red reference picture and green reference picture, the red reference picture and green reference picture
Together, in the embodiment of the present invention so that red reference picture and green reference picture is the images of 16*16 pixels as an example.
Terminal obtains the image of two frame 16*16 pixels in advance, and an image is whole red, is designated as Pred, another image
For full green, Pgreen is designated as.Terminal uses H264 to encode this two field pictures with intraframe coding method, and records image Pred volumes
The view data (coded frame of red reference picture) of code is Ired, and (green is with reference to figure for the view data of image Pgreen codings
The coded frame of picture) it is Igreen.
2012nd, terminal obtains the sequence parameter set and picture parameter set of two field pictures.
In the cataloged procedure to red reference picture and green reference picture, the sequence exported in terminal record cataloged procedure
Row parameter set and picture parameter set.Wherein, sequence parameter set includes the width and the high, ginseng for reflecting code capacity of reference picture
Number etc., the sequence parameter set can be designated as SPSa.Picture parameter set includes coded system of reference picture etc., the picture parameter set
PPSa can be designated as.
2013rd, terminal regard the coded frame of sequence parameter set, image reference collection and two frame reference pictures as reference picture
Image information.
Due to sequence parameter set, picture parameter set, the coded frame of red reference picture, green reference picture coded frame number
It is little according to amount, and the image information of reference picture will apply in subsequent process, thus terminal can by SPSa, PPSa, Ired,
Igreen is packed in the way of array constant and is compiled into Flash player, and respectively with SPSaname, PPSaname,
Iredname, Igreenname are indicated.
202nd, terminal is pre-created the first display module and the second display module.
Flash player in terminal creates two NetStream components with data generation mode, respectively NS1 and
NS2.Wherein, NS1 is as the first display module, for the video data that determines to play whether interim card, and by the audio number of output
According to volume be set to it is Jing Yin.NS2 is as the second display module, for normally showing video data and output voice data.
203rd, when receiving audio, video data, terminal isolates video data and voice data from audio, video data.
Under net cast scene, the Flash player in terminal uses TCP socket (TCP socket) component, base
Communicated in RTMP (Real Time Messaging Protocol, real-time messages host-host protocol) with streaming media server.
When receiving RTMP audio, video datas, terminal isolates audio RTMP data by RTMP protocol headers from audio, video data
Ran and video RTMP data Rvn.
After enabling the first display module of establishment, the second display module and reading and separate with the player module that it is bound
Voice data and video data, Flash player need to RTMP forms encapsulate voice data Ran and video data Rvn enter
Row format is changed.
The voice data Ran encapsulated for RTMP forms, the voice data that Flash player need to encapsulate RTMP forms
Ran is converted into the voice data Fan encapsulated with FLV forms.Enter row format conversion when, terminal by voice data Ran when
Between stamp, data length changed.During specific conversion, voice data Fan timestamp can be made to be equal to voice data Ran time
Stamp, voice data Fan data length are equal to voice data Ran data length.Wherein, n represents the voice data received
Number.When entering row format conversion, voice data Fan is also set stream ID (Identity, identity) by terminal.For the ease of note
Voice data Fan stream ID is set to 0 by record, the embodiment of the present invention.
The video data Rvn encapsulated for RTMP forms, the video data that Flash player need to encapsulate RTMP forms
Rvn is converted into the video data Fvn encapsulated with FLV forms.Enter row format conversion when, terminal by video data Rvn when
Between stamp, data length changed.During specific conversion, video data Fvn timestamp can be made to be equal to video data Rvn time
Stamp, video data Fvn data length are equal to video data Rvn data length.Wherein, n represents the video data received
Number.When entering row format conversion, video data Fvn is also set stream ID (Identity, identity) by terminal.For the ease of note
Video data Fvn stream ID is set to 0 by record, the embodiment of the present invention.
204th, terminal is shown video data and broadcast in viewing area based on the player module bound with the second display module
Put voice data.
Terminal calls the appendBytes of the second display module to export voice data Fan and video data Fvn, and is based on
The playback component (Video components) bound with the second display module, shows video data Fvn, and play sound in viewing area
Frequency is according to Fan.
205th, the image information of the reference picture prestored is encapsulated into video data by terminal, regarding after being encapsulated
Frequency evidence.
The image information of the reference picture prestored is encapsulated into video data by terminal, the video counts after being encapsulated
According to when, following steps 2051~2053 can be used：
2051st, terminal determines the frame type of video data.
Wherein, the frame type of video data includes video heads frame and video frame image.Based on being isolated in above-mentioned steps 203
Video RTMP data Rvn, terminal is according to RTMP agreements, it may be determined that go out the frame type of video data.
If the 2052, the frame type of video data is video heads frame, terminal encapsulates sequence parameter set, picture parameter set
Into video data, the video data after being encapsulated.
When the frame type of video data is video heads frame, terminal obtains sequence parameter set, figure in reference image information
The video heads frame data Fvnh that FLV forms are represented is packaged into as parameter set, and by SPSa, PPSa video heads frame data indicated,
And video heads frame data Fvnh is encapsulated into video data, the video data after being encapsulated.
In encapsulation process, terminal also changes timestamp and data length to video heads frame data Fvnh.Tool
When body is changed, video heads frame data Fvnh timestamp can be made to be equal to timestamp, the video heads frame number of the video data received
It is equal to the data length sum that SPSa, PPSa are indicated according to Fvnh data length.In encapsulation, terminal will also be video heads frame number
According to Fvnh, stream ID (Identity, identity) is set.For the ease of record, the embodiment of the present invention is by video heads frame data Fvnh stream
ID is set to 0.
If the 2053, the frame type of video data is video frame image, terminal is receiving video counts according to video data
According to the odd even attribute in sum, from the coded frame of two frame reference pictures, target code frame is chosen, and target code frame is encapsulated
Into video data, the video data after being encapsulated.
In embodiments of the present invention, when terminal often receives a video data, record video data has been received into all
Quantity, and based on the quantity for having received video data, judge that the video data being currently received is receiving video data sum
In odd even attribute.If for example, the sum for having received video data is 20, can determine that the video data being currently received
Odd even attribute in video data sum has been received is even number；If the sum for having received video data is 15, can be true
Odd even attribute of the video data being had been received by before settled in video data sum has been received is odd number.
When the frame type of video data is video frame image, because the video data is having been received by video data sum
In odd even attribute it is different, terminal is from the coded frame of two frame reference pictures, and selected target code frame is different.For regarding
Frequency is according to the odd even attribute in video data sum has been received, and terminal is according to video data in video data sum has been received
Odd even attribute, from the coded frame of two frame reference pictures, when choosing target code frame, including but not limited to the following two kinds feelings
Condition：
If the odd even attribute of the first situation, video data in video data sum has been received is odd number, terminal
It regard the coded frame of red reference picture as target code frame.
It is whole for the first situation, when video data is when the odd even attribute in having received video data sum is odd number
Red reference picture is packaged into the video data Fvnp that FLV forms are represented by end.In encapsulation, video data Fvnp timestamp
The data length of timestamp, video data Fvnp equal to the video data received is equal to the data of red reference picture sign
Length.
If second situation, odd even attribute of the video data in video data sum has been received are even number, terminal
It regard the coded frame of green reference picture as target code frame.
For second situation, when video data is when the odd even attribute in having received video data sum is even number, eventually
Green reference picture is packaged into the video data Fvnp that FLV forms are represented by end.In encapsulation, video data Fvnp timestamp
The data length of timestamp, video data Fvnp equal to the video data received is equal to the data of green reference picture sign
Length.
206th, terminal shows the video after encapsulation based on the player module bound with the first display module in designated area
Data and Jing Yin playing audio-fequency data.
Terminal calls the appendBytes of the first display module to export voice data Fan and video data Fvn, in order to anti-
The vocal clash of the player module output of the sound only played and the binding of the second display module, terminal calls the first display module
Output volume is set to Jing Yin by SoundTransform attributes.Based on the playback component (Video bound with the first display module
Component), terminal shows the video data Fvn after encapsulation, and playing audio-fequency data Fan in designated area.Wherein, designated area
Can be the region outside viewing area, to prevent the visual experience to user from interfering.
207th, during the display of the video data after display encapsulation, terminal collection view data, and record picture number
According to the first acquisition time.
In embodiments of the present invention, a timer is provided with the Flash player of terminal, based on set timing
Device, every preset duration, terminal will gather a view data, and record the first acquisition time of the view data.Wherein, in advance
If duration can be 20 milliseconds, 30 milliseconds etc., the embodiment of the present invention does not make specific limit to preset duration.What this was collected
At least include bitmap colouring information etc. in view data.For the ease of follow-up narration, the embodiment of the present invention is by the figure collected
As the bitmap colouring information of data is represented with Pcolor, the acquisition time of view data is represented with Ttemp.
It should be noted that in video display process, during terminal collection view data, the figure collected for first time
As data, if the color indicated by the bitmap colouring information of the view data is not red, need to continue to gather picture number
According to if the color indicated by the bitmap colouring information of the view data is red, using bitmap colouring information as red figure
As data are starting point, the view data collected is recorded and numbered.
208th, terminal is according to the first acquisition time of view data and view data, it is determined that whether the video data played blocks
.
Terminal according to the first acquisition time of view data and view data, it is determined that the video data played whether interim card
When, following steps 2081~2087 can be used：
2081st, terminal obtains the first bitmap colouring information of view data.
Based on the view data collected, terminal can obtain the first bitmap colouring information from the view data, and this first
Bitmap colouring information can be represented with Pcolor2.
2082nd, terminal obtains the second bitmap colouring information and the second acquisition time of the view data of last collection.
Second is obtained in the view data got based on the last time, the view data that terminal can be collected from the last time
Bitmap colouring information, and the second acquisition time of the view data of last time collection is obtained, the second bitmap colouring information can
Represented with Pcolor1, the second acquisition time is represented with Ttemp2.
2083rd, terminal judges whether the first bitmap colouring information and the second bitmap colouring information are identical.
First bitmap colouring information is compared by terminal with the second bitmap colouring information to be compared, and judges the first bitmap color
Whether information is identical with the second bitmap colouring information.If the color indicated by the first bitmap colouring information and the second bitmap color
It is identical, it is determined that the first bitmap colouring information is identical with the second bitmap colouring information, if for example, the first bitmap colouring information with
Color indicated by second bitmap colouring information is red, it is determined that the first bitmap colouring information and the second bitmap colouring information
It is identical；If the first bitmap colouring information is differed with the color indicated by the second bitmap color, it is determined that the first bitmap color
Information is differed with the second bitmap colouring information, if for example, the color indicated by the first bitmap colouring information is red,
Color indicated by two bitmap colouring informations is green, it is determined that the first bitmap colouring information and the second bitmap colouring information are not
It is identical.
If the 2084, the first bitmap colouring information and the second bitmap colouring information are differed, terminal determines that plays regards
Frequency not interim card.
When it is determined that the first bitmap colouring information and the second bitmap colouring information are differed, the figure gathered twice before and after illustrating
As data are from different video datas, the video of broadcasting not interim card now can determine that.
If the 2085, the first bitmap colouring information and the second bitmap colouring information are identical, terminal judges the first acquisition time
And whether the second difference between acquisition time is more than specified threshold.
When it is determined that when the first bitmap colouring information and identical the second bitmap colouring information, when terminal will also calculate first and gather
Between difference between Ttemp2 and the second acquisition time Ttemp1, and judge the first acquisition time Ttemp1 and the second acquisition time
Whether the difference between Ttemp2 is more than specified threshold.Wherein, specified threshold can be 200 milliseconds, 300 milliseconds etc..
If the 2086, the difference between the first acquisition time and the second acquisition time is less than specified threshold, terminal continues
Collection view data is judged.
When the difference between the first acquisition time Ttemp2 and the second acquisition time Ttemp1 is less than specified threshold, illustrate
One-frame video data does not finish playing in the acquisition time interval of two view data, that is to say the first bitmap colouring information and
Second bitmap colouring information is collected in same video data, thus needs continuation collection view data to be judged.
If the 2087, the difference between the first acquisition time and the second acquisition time is more than specified threshold, terminal is determined
The video cardton of broadcasting.
When the difference between the first acquisition time Ttemp2 and the second acquisition time Ttemp1 is more than specified threshold, illustrate
One-frame video data should finish playing in the acquisition time interval of two view data, but the first bitmap colouring information and
Two bitmap colouring informations are identical, now can determine that the video cardton of broadcasting.
It is determined that after video cardton, method provided in an embodiment of the present invention also by the interim card duration of minute book time interim card,
During physical record, the difference between the first acquisition time Ttemp2 and the second acquisition time Ttemp1 can be subtracted specified duration,
The duration that a length of one-frame video data needs are presented when specifying.
Terminal and streaming media server need not be modified using method provided in an embodiment of the present invention, due to first
The audio, video data that display module and the second display module are exported has identical timestamp, and it plays behavior unanimously, so
The normal play of video is maintained by the second display module, by the first display module detect video whether interim card, take into account
Systematic function.
It should be noted that above-mentioned steps 201~208 are with the playing process of one-frame video data, it is determined that play
Whether video due to that can include multi-frame video data in a video, thus needs to enter every frame video data exemplified by interim card
The determination process of row such as above-mentioned step 201~208, for the determination process of other video datas, with above-mentioned steps 201~208
Identical, referring specifically to above-mentioned steps 201~208, the embodiment of the present invention is repeated no more.
After the method provided using above-mentioned steps 201~208 every frame video data is determined, it can obtain every
Broadcasting situation of the frame video data in playing process, for the ease of improving the broadcasting experience of user, the embodiment of the present invention is provided
Method will also record in whole video display process, total interim card number of times, and total card section duration.During for total card section
It is long, it can be obtained by the way that the corresponding interim card duration of each interim card is added.
Method provided in an embodiment of the present invention, by the way that the image information of reference picture is encapsulated into video data, and
During showing video data, the acquisition time of collection view data and recording image data, and then based on view data and
Acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by currently playing video
Data are determined, and determine that result is more accurate, real-time is stronger.
Referring to Fig. 3, the embodiments of the invention provide a kind of device for determining video cardton, the device includes：
Data separating module 301, for when receiving audio, video data, video counts to be isolated from audio, video data
According to；
Data package module 302, for the image information of the reference picture prestored to be encapsulated into video data, is obtained
Video data after to encapsulation；
Data acquisition module 303, for based on the player module bound with the first display module, being shown in designated area
During video data after encapsulation, view data is gathered；
Logging modle 304, the first acquisition time for recording image data；
Determining module 305, for the first acquisition time according to view data and view data, it is determined that the video played is
No interim card.
In another embodiment of the present invention, the device also includes：
Coding module, for encoding two frame reference pictures in advance, the two field pictures include red reference picture and green is joined
Examine image；
Acquisition module, sequence parameter set and picture parameter set for obtaining two field pictures；Sequence parameter set, image are joined
Examine collection and two frame reference pictures coded frame as reference picture image information.
In another embodiment of the present invention, data package module, the frame type for determining video data；Work as video
When the frame type of data is video heads frame, sequence parameter set, picture parameter set are encapsulated into video data, after being encapsulated
Video data；When the frame type of video data is video frame image, according to video data in video data sum has been received
Odd even attribute, from the coded frame of two frame reference pictures, choose target code frame, and target code frame be encapsulated into video counts
In, the video data after being encapsulated.
In another embodiment of the present invention, data package module 302, for receiving video counts when video data
During according to the odd even attribute in sum for odd number, the coded frame of red reference picture is regard as target code frame；When video data exists
When the odd even attribute received in video data sum is even number, the coded frame of green reference picture is regard as target code frame.
In another embodiment of the present invention, determining module 305, the first bitmap color for obtaining view data is believed
Breath；Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；Judge the first bitmap color
Whether information and the second bitmap colouring information are identical；When the first bitmap colouring information and the second bitmap colouring information are differed,
Then determine the video not interim card played；When the first bitmap colouring information and identical the second bitmap colouring information, judge that first adopts
Whether the difference between collection time and the second acquisition time is more than specified threshold；When the first acquisition time and the second acquisition time it
Between difference be less than specified threshold when, continue gather view data judged；When the first acquisition time and the second acquisition time
Between difference be more than specified threshold when, it is determined that play video cardton.
In another embodiment of the present invention, the device also includes：
Data separating module 301, for isolating voice data from video data；
Display module, for based on the player module bound with the second display module, video counts to be shown in viewing area
According to simultaneously playing audio-fequency data；
Playing module, for shown in designated area encapsulation after video data during, based on first display
The Jing Yin playing audio-fequency data of player module of component binding.
In summary, device provided in an embodiment of the present invention, by the way that the image information of reference picture is encapsulated into video counts
In, and during video data is shown, the acquisition time of collection view data and recording image data, and then based on figure
As data and acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by currently broadcasting
The video data put is determined, and determines that result is more accurate, real-time is stronger.
, should it illustrates the structural representation of the terminal of the determination video cardton involved by the embodiment of the present invention referring to Fig. 4
Terminal can be used for the method for the determination video cardton provided in implementation above-described embodiment.Specifically：
Terminal 400 can include RF (Radio Frequency, radio frequency) circuit 110, include one or more meters
The memory 120 of calculation machine readable storage medium storing program for executing, input block 130, display unit 140, sensor 150, voicefrequency circuit 160,
WiFi (Wireless Fidelity, Wireless Fidelity) module 170, include one or the processing of more than one processing core
The part such as device 180 and power supply 190.It will be understood by those skilled in the art that the terminal structure shown in Fig. 4 is not constituted pair
The restriction of terminal, can include than illustrating more or less parts, either combine some parts or different part cloth
Put.Wherein：
RF circuits 110 can be used for receive and send messages or communication process in, the reception and transmission of signal, especially, by base station
After downlink information is received, transfer to one or more than one processor 180 is handled；In addition, being sent to up data are related to
Base station.Generally, RF circuits 110 include but is not limited to antenna, at least one amplifier, tuner, one or more oscillators, use
Family identity module (SIM) card, transceiver, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplex
Device etc..In addition, RF circuits 110 can also be communicated by radio communication with network and other equipment.The radio communication can make
With any communication standard or agreement, and including but not limited to GSM (Global System of Mobile communication, entirely
Ball mobile communcations system), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code
Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple
Access, WCDMA), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short
Messaging Service, Short Message Service) etc..
Memory 120 can be used for storage software program and module, and processor 180 is stored in memory 120 by operation
Software program and module, so as to perform various function application and data processing.Memory 120 can mainly include storage journey
Sequence area and storage data field, wherein, the application program (ratio that storing program area can be needed for storage program area, at least one function
Such as sound-playing function, image player function) etc.；Storage data field can be stored uses created number according to terminal 400
According to (such as voice data, phone directory etc.) etc..In addition, memory 120 can include high-speed random access memory, it can also wrap
Include nonvolatile memory, for example, at least one disk memory, flush memory device or other volatile solid-state parts.
Correspondingly, memory 120 can also include Memory Controller, to provide processor 180 and input block 130 to memory
120 access.
Input block 130 can be used for the numeral or character information for receiving input, and generation to be set with user and function
The relevant keyboard of control, mouse, action bars, optics or the input of trace ball signal.Specifically, input block 130 may include to touch
Sensitive surfaces 131 and other input equipments 132.Touch sensitive surface 131, also referred to as touch display screen or Trackpad, collect and use
(such as user is using any suitable objects such as finger, stylus or annex in touch-sensitive table for touch operation of the family on or near it
Operation on face 131 or near touch sensitive surface 131), and corresponding attachment means are driven according to formula set in advance.It is optional
, touch sensitive surface 131 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used
The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch
Touch information is received in detection means, and is converted into contact coordinate, then gives processor 180, and can reception processing device 180
The order sent simultaneously is performed.Furthermore, it is possible to using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves
Realize touch sensitive surface 131.Except touch sensitive surface 131, input block 130 can also include other input equipments 132.Specifically,
Other input equipments 132 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.),
One or more in trace ball, mouse, action bars etc..
Display unit 140 can be used for the information that is inputted by user of display or the information for being supplied to user and terminal 400
Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its any combination.
Display unit 140 may include display panel 141, optionally, can use LCD (Liquid Crystal Display, liquid crystal
Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display panel
141.Further, touch sensitive surface 131 can cover display panel 141, when touch sensitive surface 131 detects touching on or near it
Touch after operation, send processor 180 to determine the type of touch event, with type of the preprocessor 180 according to touch event
Corresponding visual output is provided on display panel 141.Although in Fig. 4, touch sensitive surface 131 and display panel 141 are conducts
Two independent parts are inputted and input function to realize, but in some embodiments it is possible to by touch sensitive surface 131 with showing
Panel 141 is integrated and realizes input and output function.
Terminal 400 may also include at least one sensor 150, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 141, and proximity transducer can close display when terminal 400 is moved in one's ear
Panel 141 and/or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally
Three axles) acceleration size, size and the direction of gravity are can detect that when static, available for identification mobile phone posture application (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；Extremely
The other sensors such as the gyroscope, barometer, hygrometer, thermometer, the infrared ray sensor that can also configure in terminal 400, herein
Repeat no more.
Voicefrequency circuit 160, loudspeaker 161, microphone 162 can provide the COBBAIF between user and terminal 400.Audio
Electric signal after the voice data received conversion can be transferred to loudspeaker 161, sound is converted to by loudspeaker 161 by circuit 160
Sound signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 162, after voicefrequency circuit 160 is received
Voice data is converted to, then after voice data output processor 180 is handled, through RF circuits 110 to be sent to such as another end
End, or voice data is exported to memory 120 so as to further processing.Voicefrequency circuit 160 is also possible that earphone jack,
To provide the communication of peripheral hardware earphone and terminal 400.
WiFi belongs to short range wireless transmission technology, and terminal 400 can help user's transceiver electronicses by WiFi module 170
Mail, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and accessed.Although Fig. 4 is shown
WiFi module 170, but it is understood that, it is simultaneously not belonging to must be configured into for terminal 400, can exist as needed completely
Do not change in the essential scope of invention and omit.
Processor 180 is the control centre of terminal 400, utilizes various interfaces and each portion of connection whole mobile phone
Point, by operation or perform and be stored in software program and/or module in memory 120, and call and be stored in memory 120
Interior data, perform the various functions and processing data of terminal 400, so as to carry out integral monitoring to mobile phone.Optionally, processor
180 may include one or more processing cores；Optionally, processor 180 can integrated application processor and modem processor,
Wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor mainly handles nothing
Line communicates.It is understood that above-mentioned modem processor can not also be integrated into processor 180.
Terminal 400 also includes the power supply 190 (such as battery) powered to all parts, it is preferred that power supply can pass through electricity
Management system and processor 180 are logically contiguous, so as to realize management charging, electric discharge and power consumption by power-supply management system
The functions such as management.Power supply 190 can also include one or more direct current or AC power, recharging system, power supply event
The random component such as barrier detection circuit, power supply changeover device or inverter, power supply status indicator.
Although not shown, terminal 400 can also include camera, bluetooth module etc., will not be repeated here.Specifically in this reality
Apply in example, the display unit of terminal 400 is touch-screen display, and terminal 400 also includes memory, and one or one
More than program, one of them or more than one program storage in memory, and be configured to by one or one with
Upper computing device.One or more than one program bag, which contains, to be used to perform the instruction for determining video cardton operation.
Terminal provided in an embodiment of the present invention, by the way that the image information of reference picture is encapsulated into video data, and
During showing video data, the acquisition time of collection view data and recording image data, and then based on view data and
Acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by currently playing video
Data are determined, and determine that result is more accurate, real-time is stronger.
The embodiment of the present invention additionally provides a kind of computer-readable recording medium, and the computer-readable recording medium can be
The computer-readable recording medium included in memory in above-described embodiment；Can also be individualism, without supplying eventually
Computer-readable recording medium in end.The computer-readable recording medium storage has one or more than one program, and this one
Individual or more than one program is used for performing the method for determining video cardton by one or more than one processor.
Computer-readable recording medium provided in an embodiment of the present invention, is regarded by the way that the image information of reference picture is encapsulated into
Frequency gathers the acquisition time of view data and recording image data, Jin Erji in, and during video data is shown
In view data and acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by work as
The video data of preceding broadcasting is determined, and determines that result is more accurate, real-time is stronger.
A kind of graphical user interface is provided in the embodiment of the present invention, the graphical user interface, which is used in, determines video cardton
In terminal, the execution determines that the terminal of video cardton includes touch-screen display, memory and for performing one or one
One or more than one processor of program above.
Graphical user interface provided in an embodiment of the present invention, by the way that the image information of reference picture is encapsulated into video data
In, and during video data is shown, the acquisition time of collection view data and recording image data, and then based on image
Data and acquisition time, determine video data whether interim card.The process need not detect audio and video buffer queue, by currently playing
Video data be determined, determine that result is more accurate, real-time is stronger.
It should be noted that：The device for the determination video cardton that above-described embodiment is provided it is determined that during video cardton, only with
The division progress of above-mentioned each functional module is for example, in practical application, as needed can distribute above-mentioned functions by not
Same functional module is completed, and will determine that the internal structure of the device of video cardton is divided into different functional modules, to complete
All or part of function described above.In addition, the device for the determination video cardton that above-described embodiment is provided is with determining video
The embodiment of the method for interim card belongs to same design, and it implements process and refers to embodiment of the method, repeats no more here.
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can be by hardware
To complete, the hardware of correlation can also be instructed to complete by program, described program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc. should be included in the scope of the protection.
Claims (12)
1. a kind of method for determining video cardton, it is characterised in that methods described includes：
When receiving audio, video data, video data is isolated from the audio, video data；
The image information of the reference picture prestored is encapsulated into the video data, the video data after being encapsulated；
Based on the player module bound with the first display module, the mistake of the video data after the encapsulation is shown in designated area
Cheng Zhong, gathers view data, and record the first acquisition time of described image data；
According to the first acquisition time of described image data and described image data, it is determined that the video played whether interim card.
2. according to the method described in claim 1, it is characterised in that the image information by the reference picture prestored is sealed
It is attached in the video data, before the video data after being encapsulated, methods described also includes：
Two frame reference pictures are encoded in advance, and the two field pictures include red reference picture and green reference picture；
Obtain the sequence parameter set and picture parameter set of the two field pictures；
It regard the coded frame of the sequence parameter set, described image reference set and the two frames reference picture as the reference
The image information of image.
3. method according to claim 2, it is characterised in that the image information by the reference picture prestored is sealed
It is attached in the video data, the video data after being encapsulated, including：
Determine the frame type of the video data；
If the frame type of the video data is video heads frame, the sequence parameter set, described image parameter set are encapsulated
Into the video data, the video data after the encapsulation is obtained；
If the frame type of the video data is video frame image, video data sum is being received according to the video data
In odd even attribute, from the coded frame of the two frames reference picture, choose target code frame, and by the target code frame seal
It is attached in the video data, obtains the video data after the encapsulation.
4. method according to claim 3, it is characterised in that described that video data is being received according to the video data
Odd even attribute in sum, from the coded frame of the two frames reference picture, chooses target code frame, including：
If odd even attribute of the video data in video data sum has been received is odd number, by the red with reference to figure
The coded frame of picture is used as the target code frame；
If odd even attribute of the video data in video data sum has been received is even number, by the green with reference to figure
The coded frame of picture is used as the target code frame.
5. according to the method described in claim 1, it is characterised in that described according to described image data and described image data
First acquisition time, it is determined that play video whether interim card, including：
Obtain the first bitmap colouring information of described image data；
Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；
Judge whether the first bitmap colouring information and the second bitmap colouring information are identical；
If the first bitmap colouring information and the second bitmap colouring information are differed, it is determined that the video of broadcasting does not block
；
If the first bitmap colouring information is identical with the second bitmap colouring information, judge first acquisition time and
Whether the difference between second acquisition time is more than specified threshold；
If the difference between first acquisition time and second acquisition time is less than the specified threshold, continue to adopt
Collection view data is judged；
If the difference between first acquisition time and second acquisition time is more than the specified threshold, it is determined that broadcast
The video cardton put.
6. method according to any one of claim 1 to 5, it is characterised in that methods described also includes：
Voice data is isolated from the video data；
Based on the player module bound with the second display module, the video data is shown in viewing area and the sound is played
Frequency evidence；
During the video data after the encapsulation is shown in the designated area, based on being tied up with first display module
The Jing Yin playing audio data of fixed player module.
7. a kind of device for determining video cardton, it is characterised in that described device includes：
Data separating module, for when receiving audio, video data, video data to be isolated from the audio, video data；
Data package module, for the image information of the reference picture prestored to be encapsulated into the video data, is obtained
Video data after encapsulation；
Data acquisition module, for based on the player module bound with the first display module, the envelope to be shown in designated area
During video data after dress, view data is gathered；
Logging modle, the first acquisition time for recording described image data；
Determining module, for the first acquisition time according to described image data and described image data, it is determined that the video played
Whether interim card.
8. device according to claim 7, it is characterised in that described device also includes：
Coding module, for encoding two frame reference pictures in advance, the two field pictures include red reference picture and green is referred to
Image；
Acquisition module, sequence parameter set and picture parameter set for obtaining the two field pictures；By the sequence parameter set, institute
The coded frame for stating image reference collection and the two frames reference picture is used as the image information of the reference picture.
9. device according to claim 8, it is characterised in that the data package module, for determining the video counts
According to frame type；When the frame type of the video data is video heads frame, by the sequence parameter set, described image parameter set
It is encapsulated into the video data, obtains the video data after the encapsulation；When the frame type of the video data is video figure
During as frame, according to odd even attribute of the video data in video data sum has been received, from the two frames reference picture
In coded frame, target code frame is chosen, and the target code frame is encapsulated into the video data, is obtained after the encapsulation
Video data.
10. device according to claim 9, it is characterised in that the data package module, for when the video data
When the odd even attribute in having received video data sum is odd number, the coded frame of the red reference picture is regard as the mesh
Mark coded frame；When the video data is when the odd even attribute in having received video data sum is even number, the green is joined
The coded frame of image is examined as the target code frame.
11. device according to claim 7, it is characterised in that the determining module, for obtaining described image data
First bitmap colouring information；Obtain the second bitmap colouring information and the second acquisition time of the view data of last collection；Sentence
Whether the disconnected first bitmap colouring information and the second bitmap colouring information are identical；When the first bitmap colouring information and
When the second bitmap colouring information is differed, it is determined that the video of broadcasting not interim card；When the first bitmap color letter
When breath is identical with the second bitmap colouring information, the difference between first acquisition time and second acquisition time is judged
Whether value is more than specified threshold；When the difference between first acquisition time and second acquisition time is less than described specify
During threshold value, continue collection view data and judged；Difference between first acquisition time and second acquisition time
When value is more than the specified threshold, it is determined that the video cardton played.
12. the device according to any one of claim 7 to 11, it is characterised in that described device also includes：
The data separating module, for isolating voice data from the video data；
Display module, for based on the player module bound with the second display module, the video counts to be shown in viewing area
According to simultaneously playing audio data；
Playing module, during the video data after the encapsulation is shown in the designated area, based on it is described
The Jing Yin playing audio data of player module of first display module binding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710207433.8A CN106973321B (en) | 2017-03-31 | 2017-03-31 | Determine the method and device of video cardton |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710207433.8A CN106973321B (en) | 2017-03-31 | 2017-03-31 | Determine the method and device of video cardton |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106973321A true CN106973321A (en) | 2017-07-21 |
| CN106973321B CN106973321B (en) | 2019-07-30 |
Family
ID=59335614
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710207433.8A Active CN106973321B (en) | 2017-03-31 | 2017-03-31 | Determine the method and device of video cardton |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106973321B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107509107A (en) * | 2017-09-20 | 2017-12-22 | 广州视源电子科技股份有限公司 | Method, device and equipment for detecting video playing fault and readable medium |
| CN107837089A (en) * | 2017-12-05 | 2018-03-27 | 清华大学 | A kind of video cardton limit value measurement method based on brain wave |
| CN110418170A (en) * | 2019-07-03 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Detection method and device, storage medium and electronic device |
| CN110475124A (en) * | 2019-09-06 | 2019-11-19 | 广州虎牙科技有限公司 | Video cardton detection method and device |
| CN111654756A (en) * | 2020-06-03 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Method, device and equipment for detecting stuck and readable storage medium |
| CN114245180A (en) * | 2022-01-04 | 2022-03-25 | 海信视像科技股份有限公司 | Display device, video data transmission method, and storage medium |
| CN114827593A (en) * | 2022-06-28 | 2022-07-29 | 武汉海微科技有限公司 | Video detection method, device and equipment based on vehicle-mounted display screen and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5680181A (en) * | 1995-10-20 | 1997-10-21 | Nippon Steel Corporation | Method and apparatus for efficient motion vector detection |
| CN104965773A (en) * | 2015-07-09 | 2015-10-07 | 网易（杭州）网络有限公司 | Terminal, jamming detection method, device as well as game jamming detection method and device |
| CN105553939A (en) * | 2015-12-07 | 2016-05-04 | 中国联合网络通信集团有限公司 | Method and device for determining blockage of streaming media |
| CN105761255A (en) * | 2016-02-04 | 2016-07-13 | 网易（杭州）网络有限公司 | Game frame stagnation test method and device |
| CN105872760A (en) * | 2015-12-02 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Video play monitoring method and device |
| CN105979332A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Video data detection method and device |
| CN106375755A (en) * | 2016-08-31 | 2017-02-01 | 福建省天奕网络科技有限公司 | Video data stalling detection method and system |
-
2017
- 2017-03-31 CN CN201710207433.8A patent/CN106973321B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5680181A (en) * | 1995-10-20 | 1997-10-21 | Nippon Steel Corporation | Method and apparatus for efficient motion vector detection |
| CN104965773A (en) * | 2015-07-09 | 2015-10-07 | 网易（杭州）网络有限公司 | Terminal, jamming detection method, device as well as game jamming detection method and device |
| CN105872760A (en) * | 2015-12-02 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Video play monitoring method and device |
| CN105979332A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Video data detection method and device |
| CN105553939A (en) * | 2015-12-07 | 2016-05-04 | 中国联合网络通信集团有限公司 | Method and device for determining blockage of streaming media |
| CN105761255A (en) * | 2016-02-04 | 2016-07-13 | 网易（杭州）网络有限公司 | Game frame stagnation test method and device |
| CN106375755A (en) * | 2016-08-31 | 2017-02-01 | 福建省天奕网络科技有限公司 | Video data stalling detection method and system |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107509107A (en) * | 2017-09-20 | 2017-12-22 | 广州视源电子科技股份有限公司 | Method, device and equipment for detecting video playing fault and readable medium |
| CN107509107B (en) * | 2017-09-20 | 2020-04-24 | 广州视源电子科技股份有限公司 | Method, device and equipment for detecting video playing fault and readable medium |
| CN107837089A (en) * | 2017-12-05 | 2018-03-27 | 清华大学 | A kind of video cardton limit value measurement method based on brain wave |
| CN107837089B (en) * | 2017-12-05 | 2018-11-23 | 清华大学 | A kind of video cardton limit value measurement method based on brain wave |
| CN110418170A (en) * | 2019-07-03 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Detection method and device, storage medium and electronic device |
| CN110418170B (en) * | 2019-07-03 | 2021-11-19 | 腾讯科技（深圳）有限公司 | Detection method and device, storage medium and electronic device |
| CN110475124A (en) * | 2019-09-06 | 2019-11-19 | 广州虎牙科技有限公司 | Video cardton detection method and device |
| CN110475124B (en) * | 2019-09-06 | 2021-10-08 | 广州虎牙科技有限公司 | Video jamming detection method and device |
| CN111654756A (en) * | 2020-06-03 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Method, device and equipment for detecting stuck and readable storage medium |
| CN114245180A (en) * | 2022-01-04 | 2022-03-25 | 海信视像科技股份有限公司 | Display device, video data transmission method, and storage medium |
| CN114827593A (en) * | 2022-06-28 | 2022-07-29 | 武汉海微科技有限公司 | Video detection method, device and equipment based on vehicle-mounted display screen and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106973321B (en) | 2019-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106973321A (en) | Determine the method and device of video cardton | |
| CN104519404B (en) | The player method and device of graphic interchange format file | |
| CN106127673B (en) | A kind of method for processing video frequency, device and computer equipment | |
| CN107438200A (en) | The method and apparatus of direct broadcasting room present displaying | |
| CN107682715A (en) | Video synchronization method and device | |
| CN103699309B (en) | A kind of method for recording of synchronization video, device and mobile terminal | |
| CN107613379A (en) | A kind of switching method of network connection, terminal and readable storage medium storing program for executing | |
| CN109271327A (en) | EMS memory management process and device | |
| CN106412702A (en) | Video clip interception method and device | |
| CN109817232A (en) | A kind of transmission method, terminal device and apparatus for processing audio | |
| CN107967322A (en) | Document classification display methods, mobile terminal and computer-readable recording medium | |
| CN104780401B (en) | The sending method and device of video data | |
| CN104036536A (en) | Generating method and apparatus of stop motion animation | |
| CN107105096A (en) | A kind of audio-frequency processing method, terminal and storage medium | |
| CN105094513A (en) | User avatar setting method and apparatus as well as electronic device | |
| CN105187692A (en) | Video recording method and device | |
| EP4310663A1 (en) | Method for adjusting screen projection display parameters | |
| CN103581762A (en) | Method, device and terminal equipment for playing network videos | |
| CN107396193A (en) | The method and apparatus of video playback | |
| US20230335081A1 (en) | Display Synchronization Method, Electronic Device, and Readable Storage Medium | |
| CN110636337B (en) | Video image intercepting method, device and system | |
| CN106527666A (en) | Control method of central processing unit and terminal equipment | |
| CN107659726A (en) | A kind of method, equipment and computer-readable recording medium for recovering end message | |
| CN104967770B (en) | Video capture method and device | |
| CN104796730B (en) | The methods, devices and systems of user at a slow speed in a kind of detection internet video live broadcasting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510660 Guangzhou City, Guangzhou, Guangdong, Whampoa Avenue, No. 315, self - made 1-17 Applicant after: Guangzhou KuGou Networks Co., Ltd. Address before: 510000 B1, building, No. 16, rhyme Road, Guangzhou, Guangdong, China 13F Applicant before: Guangzhou KuGou Networks Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |