CN105872697A - Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization - Google Patents
Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization Download PDFInfo
- Publication number
- CN105872697A CN105872697A CN201610195830.3A CN201610195830A CN105872697A CN 105872697 A CN105872697 A CN 105872697A CN 201610195830 A CN201610195830 A CN 201610195830A CN 105872697 A CN105872697 A CN 105872697A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- road
- road video
- broadcasting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000008569 process Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 20
- 238000003780 insertion Methods 0.000 claims description 12
- 230000037431 insertion Effects 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 abstract description 8
- 230000001360 synchronised effect Effects 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000011084 recovery Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 239000002609 medium Substances 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- VAYOSLLFUXYJDT-RDTXWAMCSA-N Lysergic acid diethylamide Chemical compound C1=CC(C=2[C@H](N(C)C[C@@H](C=2)C(=O)N(CC)CC)C2)=C3C2=CNC3=C1 VAYOSLLFUXYJDT-RDTXWAMCSA-N 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000013587 production medium Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a cloud program direction console and a continuous play method of the cloud program direction console based on audio/video synchronization. The method comprises following steps of inserting preset video frames so as to realize spliced play of one way of video and another way of video if the data reception of one way of video is interrupted, in the processes of receiving, splicing and playing multi-way videos by the cloud program direction console; inserting preset audio frames in a mode synchronous with the video frames so as to maintain audio play with synchronous voices and images; and continuing spliced play of the way of video and the other way of video according to the received data if the data reception of the way of video is recovered. Through application of the cloud program direction console and the continuous play method, after one way of the video is interrupted, the cloud program direction console can automatically recover the continuous play of the way of video under the condition that the network transmission condition is recovered to the normal; and the use experience of a user is improved.
Description
Technical field
The present embodiments relate to cloud instructor in broadcasting's technical field, particularly relate to a kind of cloud instructor in broadcasting's platform and based on audio frequency and video with
The continuous playing method of step.
Background technology
In traditional television program designing, for use fixed venue, fixed light class program (as TV column,
Sight is acute), the most all use multiple cameras to shoot, it is other that the program after so completing has multi-angle, many scapes
Feature, also show more comprehensively, more good-looking.
In such shooting, traditional instructor in broadcasting's platform receives each road video signal by holding wire, by TV programme
Producer operates cut bank, selects a road to export videocorder from multiple signals.Traditional instructor in broadcasting's platform is mainly by cutting
The equipment compositions such as zapping, intercom system, monitor and integration power supply system, not only structure operation is complicated, equipment cost
Costliness, and need the instructor in broadcasting of specialty to operate, for amateur television production media, it is practically impossible to
Task.
But the high speed development of new media tide lower network video, make again enterprise, group, individual for perfect in workmanshipization
The technical need of program grows with each passing day；Have benefited from the development of cloud computing technology so that on the Internet, the content of magnanimity is stored
And retrieval, also it being greatly accelerated the paces of new media development simultaneously, this has greatly promoted leads based on the cloud on cloud computing technology
Broadcast the birth of platform.
Based on new media cloud basis, cloud instructor in broadcasting's platform can help user's rapid deployment steady with plug and play simultaneously
Fixed, efficient voice and video instructor in broadcasting's scene, promotes work efficiency, reduces equipment and technology cost.
For traditional instructor in broadcasting's platform, the great advantage of cloud instructor in broadcasting's platform is that any place can portion any time
Administration uses, simultaneously can envoy's purpose scene more diversified.For the input of signal, cloud instructor in broadcasting's platform support switching is same
The live picture of video camera of individual place different angles, the live picture of video camera in different place；Simultaneously in order to simplify video acquisition
Equipment, cloud instructor in broadcasting's platform also supports that the signal from mobile phone terminal video acquisition inputs；
For outfan, video source can be switched over, scales by cloud instructor in broadcasting's platform beyond the clouds, superposition, audio mixing etc. process,
Can be widely applied for play live industry, online education industry, sports show industry, video entertainment interaction industry and video
Meeting industry etc..
After cloud instructor in broadcasting's platform receives multi-channel video signal, multiple signals are synthesized in a road signal, i.e. this road signal
The content composition on each Zheng Douyouge road, uses this road signal of player plays, can be simultaneously by multiple signals
Appearance presents to audience, picture as shown in Figure 1.And traditional instructor in broadcasting's platform monitor multiple signals time, need multiple display or
Need multiple player, because a player can only open a road signal a time.
But, network transmission instability or the situation of sender unit fault the most often occur, from
And cause a wherein road video data reception failure that cutout occurs；The picture of cutout Hou Gai road video will no longer be updated.Even if
In the case of network transmission state recovers normally, owing to not receiving data for a long time, player also will be considered that signal has terminated,
And make player close, thus this signal cannot be play again.Therefore instructor in broadcasting personnel want to continue viewing live TV stream, it is necessary to must restart
Player.For multiple signals being spliced into the cloud instructor in broadcasting of a road signal, the most increasingly complex in the case of cutout.Traditional
In instructor in broadcasting's platform, every road signal uses a player plays, when a road signal cutout, by analysis above, instructor in broadcasting personnel
The player that only need to restart this road can not affect the broadcasting on other roads.But each road is stitched together by cloud instructor in broadcasting, i.e. institute
Have picture to play actually used be a player, then when restarting player, the broadcasting on other roads receives the most simultaneously
Impact.Therefore, in the case of saving ample resources than traditional instructor in broadcasting, allow cloud instructor in broadcasting can certain road stop in the case of, no
Affect the broadcasting on other roads, and can automatically recover picture when open circuit has signal without restarting player, will be one
Individual bigger progress.
Summary of the invention
In view of this, it is an object of the invention to propose a kind of cloud instructor in broadcasting's platform and continued broadcasting side based on audio-visual synchronization thereof
Method, in order to, after a road video cutout, in the case of network status transmission recovers normally, automatically to recover the continuous of this road video
Broadcast, promote the experience of user.
Based on above-mentioned purpose, the continued broadcasting side based on audio-visual synchronization of a kind of cloud instructor in broadcasting's platform that the embodiment of the present invention provides
Method, including:
Cloud instructor in broadcasting's platform receive, splice and play multi-channel video during, if a road video data receiver interrupt, then:
Insert predetermined frame of video and continue the splicing broadcasting of this road video and other road video；And with same with described frame of video
The mode of step inserts the audio frequency broadcasting that predetermined audio frame synchronizes to maintain sound to draw；
If the data receiver of this road video recovers, then continue the spelling of this road video and other road video according to the data received
Connect broadcasting.
Further, the predetermined frame of video of described insertion continues the splicing of this road video and other road video and plays, and specifically wraps
Include:
Decode caching to the video of this road video and insert predetermined frame of video；
The content decoded by the video of this road video in caching is entered with the content in the video decoding caching of other road video
Row splicing；
Video playback is carried out according to splicing result.
Further, described to insert predetermined audio frame in the way of described video frame synchronization to maintain sound to draw Tong Bu sound
Frequency is play, and specifically includes:
When the video of this road video decodes caching insertion frame of video, cache to the audio decoder of this road video and insert m
Individual predetermined audio frame；
The content in audio decoder caching according to this road video, the audio frequency continuing this road video is play；
Wherein, m is that the frame of video frame per second according to this road video, the sample rate of audio frame are calculated.
Further, described predetermined frame of video particularly as follows:
Before the data receiver of this road video interrupts, the last frame frame of video received；Or blank screen frame.
Further, described predetermined audio frame is specially mute frame.
In the another aspect of the embodiment of the present invention, additionally provide a kind of cloud instructor in broadcasting's platform, including:
Cutout processing module, during being used for receiving, playing multi-channel video, if the data receiver of a road video interrupts, then
Predetermined frame of video is inserted for this road video；And to insert predetermined audio frame in the way of described video frame synchronization；
Playing module, the frame of video for inserting according to described cutout processing module continues this road video and other road video
Splicing play；And carry out audio frequency broadcasting according to the audio frame of described cutout processing module insertion；And the number at this road video
After receiving recovery, continue the splicing broadcasting of this road video and other road video according to the data received.
Further, if described cutout processing module is specifically for the data receiver interruption of a road video, Ze Xianggai road video
Video decoding caching insert predetermined frame of video；When the video of this road video decodes caching one frame of video of insertion, to
The audio decoder caching of this road video inserts m predetermined audio frame；Wherein, m is the frame per second according to described frame of video, audio frame
Sample rate calculate.
Further, described cloud instructor in broadcasting's platform also includes:
Data reception module, for receiving the data of multi-channel video；And for every road video, by this road video of reception
Video data is stored in the video decoding caching of this road video, the voice data of this road video received is stored in this road and regards
In the audio decoder caching of frequency.
Further, described playing module decodes specifically for the video that described cutout processing module is inserted into this road video
Frame of video in caching carries out splicing follow-up continued broadcasting with the frame of video in the video of other road video decoding caching and puts, and according to institute
The audio frequency stating audio decoder caching this road video of continuation that cutout processing module is inserted into this road video is play；And regard on this road
Frequency data receiver recover after, described data reception module is stored in this road video video decoding caching in frame of video with
Frame of video in the video decoding caching of other road video carries out splicing follow-up continued broadcasting and puts, and deposits according to described data reception module
The audio frame being stored in the audio decoder caching of this road video carries out the audio frequency of this road video and plays.
In the technical scheme of the embodiment of the present invention, due to insert after a road video cutout frame of video continue this road video and its
The splicing of its road video is play, and player can remain normal playing status, not will be considered that signal terminates and closes, and
And play out during cutout to maintain sound to draw the state synchronized in the way of keeping sound, audio video synchronization, the most so can protect
Continued broadcasting sound after card data receiver recovery, video are also to synchronize.
Further, the road video interrupted for data receiver, inserts pre-with the frame per second identical with standardization play frame rate
Fixed frame of video so that this road video can keep with other road video splicing, play synchronization.
Accompanying drawing explanation
Fig. 1 is the schematic diagram that cloud instructor in broadcasting's platform of prior art plays multi-channel video picture simultaneously；
Fig. 2 is that cloud instructor in broadcasting's stylobate of the embodiment of the present invention is in the continuous playing method flow chart of audio-visual synchronization；
Fig. 3 is cloud instructor in broadcasting's platform internal structure block diagram of the embodiment of the present invention；
Fig. 4 is the cutout processing module internal structure block diagram of the embodiment of the present invention.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, and reference
Accompanying drawing, the present invention is described in more detail.
Embodiments of the invention are described below in detail, and the example of described embodiment is shown in the drawings, the most from start to finish
Same or similar label represents same or similar element or has the element of same or like function.Below with reference to attached
The embodiment that figure describes is exemplary, is only used for explaining the present invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative used herein " ", "
Individual ", " described " and " being somebody's turn to do " may also comprise plural form.It is to be further understood that use in the description of the present invention arranges
Diction " including " refers to there is described feature, integer, step, operation, element and/or assembly, but it is not excluded that existence or adds
Other features one or more, integer, step, operation, element, assembly and/or their group.It should be understood that when we claim unit
Part is " connected " or during " coupled " to another element, and it can be directly connected or coupled to other elements, or can also exist
Intermediary element.Additionally, " connection " used herein or " coupling " can include wireless connections or wireless couple.Used herein arrange
Diction "and/or" includes that one or more list the whole of item or any cell being associated combines with whole.
It should be noted that the statement of all uses " first " and " second " is for distinguishing two in the embodiment of the present invention
The entity of individual same names non-equal or the parameter of non-equal, it is seen that " first " " second ", only for the convenience of statement, should not
Being interpreted as the restriction to the embodiment of the present invention, this is illustrated by subsequent embodiment the most one by one.
Thus, the present inventor is it is considered that after a road video cutout, continue to keep the broadcasting shape of this road video
State: insert frame of video in the way of sound, audio video synchronization and play out with audio frame；So, recover to normally receive when network condition
After sound, video data, continued broadcasting can be carried out according to the sound received, video data.Therefore, in technical scheme, cloud
Instructor in broadcasting's platform receives, plays during multi-channel video, if the data receiver of a road video interrupts, then insert predetermined frame of video and its
Its road video continues splicing and carries out the video playback of this road video；And by with described video frame synchronization in the way of insert predetermined
Audio frame, the audio frequency continuing this road video in the way of maintaining sound to draw synchronization is play；After the data receiver of this road video recovers,
Then can continue to splice the frame of video of this road video with the frame of video of other road video according to the video data received, with
Time according to receive voice data with sound draw the method for synchronization continue audio frequency, video playback.This road is continued after stopping due to video
The splicing of video and other road video is play, and player can remain normal playing status, not will be considered that signal terminates
And close, keep sound, the mode of audio video synchronization to play out to maintain sound to draw the state synchronized during cutout, the most simultaneously
Can ensure that the continued broadcasting sound after data receiver recovery, video are also to synchronize.
Describe the technical scheme of the embodiment of the present invention below in conjunction with the accompanying drawings in detail.
Based on above-mentioned thinking, cloud instructor in broadcasting's platform that the embodiment of the present invention provides is receiving and is playing the situation of multi-channel video
Under, for every road video, video data and voice data periodically through this road video of Network Capture cache；Cloud instructor in broadcasting
Platform when each playback period arrives, from the caching of each road video, obtain the identical sound of timestamp, video data is decoded,
Splicing, plays out according to splicing result.
Having no progeny in the abnormal data receiver causing a road video occurs in network status transmission, cloud instructor in broadcasting's platform is at playback period
During arrival, will be unable to obtain voice data or the video data of corresponding timestamp from the caching of this road video.In order to ensure
After network status transmission recovers normally, it is possible to this road video of continued broadcasting, cloud instructor in broadcasting's stylobate that the embodiment of the present invention provides is in audio frequency and video
The continuous playing method synchronized, flow process is as in figure 2 it is shown, comprise the steps:
Step S201: cloud instructor in broadcasting's platform detects that the data receiver of a road video interrupts.
When network status transmission occurs abnormal, cloud instructor in broadcasting's platform cannot receive the data of a road video from network and carry out
Storage；Thus, cloud instructor in broadcasting's platform, when playback period arrives, the most just cannot get audio or video from the caching of this road video
Data, now, cloud instructor in broadcasting's platform confirms that the data receiver this road video being detected interrupts.
Step S202: this road video that cloud instructor in broadcasting's platform interrupts for data receiver, inserts predetermined sound, frame of video continues
Sound, video playback.
In this step, cloud instructor in broadcasting's platform inserts predetermined frame of video for this road video that data receiver interrupts, and will insert
After the frame of video of Ru Gai road video and the frame of video of other road video are spliced, continue to carry out video according to splicing result
Play；
Further, also by insert in the way of described video frame synchronization predetermined audio frame by maintain sound draw Tong Bu in the way of continue
The audio frequency of Xu Gai road video is play.
Specifically, the video decoding caching of cloud instructor in broadcasting Tai Xianggai road video inserts predetermined frame of video；By this road video
Content in video decoding caching is spliced with the content in the video decoding caching of other road video, continues according to splicing result
The broadcasting of continuous video；Wherein, predetermined video can Shi Gai road video data receiver interrupt before, the last frame received regards
Frequently frame, it is also possible to be blank screen frame.That is, although now the data receiver of this road video has interrupted, but cloud instructor in broadcasting's platform still
So broadcasting this road video constantly, its picture broadcasted continuously is then some predetermined pictures, broadcasts last such as continuously
The picture of one frame frame of video.
And, cloud instructor in broadcasting's platform whenever to this road video video decode caching insert frame of video time, Hai Xianggai road video
Audio decoder caching inserts m predetermined audio frame；And the content in caching according to the audio decoder of this road video, to maintain sound
Draw the mode synchronized and continue the audio frequency broadcasting of this road video.
For ensureing the sound of this road video, audio video synchronization, number m of the audio frame of insertion is the frame of video according to this road video
Frame per second, the sample rate of audio frame are calculated, and specifically can be calculated according to equation below 1:
R × n-S × m≤α (formula 1)
Wherein, R represents a frame duration (1/ frame of video frame per second) of this road video, and S represents a frame duration (audio frequency of audio frame
One frame sampling is counted/sample rate), n is the number being currently inserted into frame of video, is typically inserted into frame of video, then a n=1；α is for setting
Definite value, those skilled in the art can rule of thumb or practical situation is set, so that the synchronization difference between sound, video
Within being confined to a smaller value.
It is true that frame of video frame per second R of this road video can be the frame per second that cloud instructor in broadcasting's platform receives the frame of video of this road video.
But, more preferably, it is contemplated that the frame per second of the frame of video that cloud instructor in broadcasting's platform receives each road video is often different, therefore, above-mentioned public affairs
R in formula can be standardization play frame rate.
In actual applications, multi-channel video is respectively derived from different video capture equipment, and these video capture equipment
The frame per second of output video frame often differs；So, when cloud instructor in broadcasting's platform receives the frame of video of each road video, frame per second also will not phase
With；If directly carrying out video playback according to the frame per second receiving frame of video, will appear from the situation that each video is out of step.
It is thus preferable to, cloud instructor in broadcasting's platform of the present invention is when each playback period arrives, respectively from each road video acquisition one
Frame video plays out, and therefore, the frame per second that cloud instructor in broadcasting's platform can be consistent plays the frame of video of each road video, namely achieves each
The unification of the play frame rate (the frame of video number i.e. play in the unit interval) of road video, herein by the broadcasting frame of this unification
Rate is referred to as standardization play frame rate.It is to say, above-mentioned playback period is corresponding with standardization play frame rate, both fall each other
Number.Cloud instructor in broadcasting's platform uses the splicing of standardization play frame rate to play each road video, so that step one is play in the splicing of each road video
Cause.
Cloud instructor in broadcasting's platform, can be according to wherein specifying when receiving the data of each road video and carry out each road video playback
The acceptance rate (video frame formats received in the unit interval) of the frame of video of one road video, i.e. specifies the received frame rate of a road video
Standardization play frame rate as currently playing video.It is to say, the reception frame of the frame of video according to the road video specified
Rate determines the standardization play frame rate of currently playing video.Such as, acquiescence the 0th road video be this road video specified, then with
The received frame rate of the frame of video of the 0th road video is as the standardization play frame rate of currently playing each road video.Or, on the 0th tunnel
In the case of the data receiver of video interrupts, can be using the 1st road video as the road video specified, with the video of the 1st road video
The received frame rate of frame is as the standardization play frame rate of currently playing each road video.
It is preferred that this step can first obtain the standardization play frame rate of currently playing video, then with described mark
The frame per second that standardization play frame rate is identical, the frame per second that standardization play frame rate described in Xiang Yiyu is identical inserts predetermined frame of video, will
The frame of video inserted and other road frame of video carry out splicing and maintain the broadcasting of video；On this basis, cloud instructor in broadcasting platform is whenever to this
When the video decoding caching of road video inserts frame of video, cache to the audio decoder of this road video and insert m predetermined audio frame；
And the content in caching according to the audio decoder of this road video, the audio frequency continuing this road video is play.
Step S203: after the data receiver of cloud instructor in broadcasting Tai Gai road video recovers, continues sound, video according to the data received
Play.
After the data receiver of this road video recovers, cloud instructor in broadcasting's platform can receive the sound of this road video, video from network
Data are also stored in caching；Thus, when playback period arrives, cloud instructor in broadcasting's platform can obtain sound, video data from caching
Continue to play.Now, in this way it is no longer necessary in caching, insert predetermined frame of video.
It is preferred that after the data receiver of this road video recovers, cloud instructor in broadcasting's platform can receive this road video from network
Sound, video data；And when each playback period arrives, a frame of video of this road video received is stored in video decoding
Caching；Cache it is to say, the frame of video of this road video received is stored in video decoding with standardization play frame rate.It
After, the frame of video in video decoding caching is decoded, and by the frame of video in video decoding caching and other road video
Frame of video plays out after splicing, and thus can proceed video playback according to the video data received.
Analogously, the audio frame of this road video received is stored in audio decoder with audio sample rate and delays by cloud instructor in broadcasting platform
Deposit.Now, in this way it is no longer necessary to insert predetermined audio frame toward caching；Afterwards, the audio frequency in audio decoder caching is decoded,
Play, thus can continue the audio frequency broadcasting of this road video according to the voice data received.
Continuing the splicing broadcasting of this road video and other road video due to video after stopping, player just can remain
Often broadcast state, not will be considered that signal terminates and closes, and broadcasts in the way of keeping sound, audio video synchronization during cutout
Put to maintain sound to draw the state synchronized, the most so can ensure that the continued broadcasting sound after data receiver recovery, video are also to synchronize.
Based on above-mentioned method, the internal structure of a kind of cloud instructor in broadcasting's platform that the embodiment of the present invention provides, as it is shown on figure 3, wrap
Include: cutout processing module 301, playing module 302.
Cutout processing module 301 is during the reception of cloud instructor in broadcasting's platform, playing multi-channel video, if the data of a road video connect
Receive and interrupt, then insert predetermined frame of video for this road video；And to insert predetermined sound in the way of described video frame synchronization
Frequently frame；
Playing module 302 continues this road video for the frame of video inserted according to cutout processing module 301 and regards with other road
The splicing of frequency is play；And carry out audio frequency broadcasting according to the audio frame of cutout processing module 301 insertion；And the number at this road video
After receiving recovery, continue the splicing broadcasting of this road video and other road video according to the data received.
Specifically, above-mentioned cutout processing module 301 is during the reception of cloud instructor in broadcasting's platform, playing multi-channel video, if a road regards
The data receiver of frequency interrupts, and the video decoding caching of Ze Xianggai road video inserts predetermined frame of video；Whenever regarding of this road video
When frequency decoding caching inserts a frame of video, cache to the audio decoder of this road video and insert m predetermined audio frame；Wherein, m
It is that the frame per second according to described frame of video, the sample rate of audio frame are calculated.
As shown in Figure 4, cutout processing module 301 includes such as lower unit: frame of video inserts unit 401,402.
Frame of video inserts the road video that unit 401 is used for interrupting for data receiver, decodes to the video of this road video
Caching inserts predetermined frame of video；
Audio frame inserts unit 402 and is used for when the video of this road video decodes caching one frame of video of insertion, to this
The audio decoder caching of road video inserts m predetermined audio frame；Wherein, m is the frame per second according to described frame of video, audio frame
Sample rate is calculated.
Further, cloud instructor in broadcasting's platform that the embodiment of the present invention provides can also include: data reception module 303.
Data reception module 303 is for receiving the data of multi-channel video；And for every road video, this road video that will receive
Video data be stored in the video decoding caching of this road video, the voice data of this road video received is stored in this road
In the audio decoder caching of video.
Thus, playing module 302 is specifically for for receiving the road video interrupted, inserting cutout processing module 301
The frame of video that video to this road video decodes in caching is spelled with the frame of video in the video decoding caching of other road video
Connect follow-up continued broadcasting to put, and be inserted into audio decoder caching this road video of continuation of this road video according to cutout processing module 301
Audio frequency is play；And after the data receiver of this road video recovers, data reception module 303 is stored in the video of this road video
Frame of video in decoding caching carries out splicing follow-up continued broadcasting with the frame of video in the video of other road video decoding caching and puts, and root
The audio frame being stored in the audio decoder caching of this road video according to data reception module 303 carries out the audio frequency of this road video and broadcasts
Put.
It is true that playing module 302 can in each playback period by video decoding caching in decoding data,
Play, i.e. with standardization play frame rate by the decoding data in video decoding caching, broadcasting；With audio sample rate by audio frequency
Data decoding in decoding caching, broadcasting.
In the technical scheme of the embodiment of the present invention, due to insert after a road video cutout frame of video continue this road video and its
The splicing of its road video is play, and player can remain normal playing status, not will be considered that signal terminates and closes, and
And play out during cutout to maintain sound to draw the state synchronized in the way of keeping sound, audio video synchronization, the most so can protect
Continued broadcasting sound after card data receiver recovery, video are also to synchronize.
Further, the road video interrupted for data receiver, inserts pre-with the frame per second identical with standardization play frame rate
Fixed frame of video so that this road video can keep with other road video splicing, play synchronization.
Those skilled in the art of the present technique are appreciated that the present invention includes relating to perform in operation described herein
One or more equipment.These equipment can be required purpose and specialized designs and manufacture, or can also include general
Known device in computer.These equipment have storage computer program within it, and these computer programs are optionally
Activate or reconstruct.Such computer program can be stored in equipment (such as, computer) computer-readable recording medium or be stored in
In being suitable to store e-command and be coupled to any kind of medium of bus respectively, described computer-readable medium include but not
Be limited to any kind of dish (including floppy disk, hard disk, CD, CD-ROM and magneto-optic disk), ROM (Read-Only Memory, only
Read memorizer), RAM (Random Access Memory, memorizer immediately), EPROM (Erasable Programmable
Read-Only Memory, Erarable Programmable Read only Memory), EEPROM (Electrically Erasable
Programmable Read-Only Memory, EEPROM), flash memory, magnetic card or light line card
Sheet.It is, computer-readable recording medium includes by equipment (such as, computer) with the form storage that can read or any Jie of transmission information
Matter.
Those skilled in the art of the present technique be appreciated that can with computer program instructions realize these structure charts and/or
The combination of the frame in each frame in block diagram and/or flow graph and these structure charts and/or block diagram and/or flow graph.This technology is led
Field technique personnel be appreciated that these computer program instructions can be supplied to general purpose computer, special purpose computer or other
The processor of programmable data processing method realizes, thus by computer or the process of other programmable data processing methods
Device performs the scheme specified in structure chart disclosed by the invention and/or block diagram and/or the frame of flow graph or multiple frame.
Those skilled in the art of the present technique be appreciated that the various operations discussed in the present invention, method, in flow process
Step, measure, scheme can be replaced, changed, combined or deleted.Further, there is discussed in the present invention each
Other steps in kind operation, method, flow process, measure, scheme can also be replaced, changed, reset, decomposed, combined or deleted.
Further, of the prior art have and the step in the various operations disclosed in the present invention, method, flow process, measure, scheme
Can also be replaced, changed, reset, decomposed, combined or deleted.
Those of ordinary skill in the field are it is understood that the discussion of any of the above embodiment is exemplary only, not
It is intended to imply that the scope of the present disclosure (including claim) is limited to these examples；Under the thinking of the present invention, above example
Or can also be combined between the technical characteristic in different embodiments, step can realize with random order, and exists such as
Other change of the many of the different aspect of the upper described present invention, in order to concisely they do not provide in details.Therefore, all
Within the spirit and principles in the present invention, any omission of being made, amendment, equivalent, improvement etc., should be included in the present invention's
Within protection domain.
Claims (11)
1. the continuous playing method based on audio-visual synchronization of cloud instructor in broadcasting's platform, it is characterised in that including:
Cloud instructor in broadcasting's platform receive, splice and play multi-channel video during, if a road video data receiver interrupt, then:
Insert predetermined frame of video and continue the splicing broadcasting of this road video and other road video；And with described video frame synchronization
Mode inserts the audio frequency broadcasting that predetermined audio frame synchronizes to maintain sound to draw；
If the data receiver of this road video recovers, then continue the splicing of this road video and other road video according to the data received and broadcast
Put.
Method the most according to claim 1, it is characterised in that the predetermined frame of video of described insertion continue this road video and its
The splicing of its road video is play, and specifically includes:
Decode caching to the video of this road video and insert predetermined frame of video；
The content decoded by the video of this road video in caching is spelled with the content in the video decoding caching of other road video
Connect；
Video playback is carried out according to splicing result.
Method the most according to claim 2, it is characterised in that described by with described video frame synchronization in the way of insert predetermined
Audio frame with maintain sound draw synchronize audio frequency play, specifically include:
When the video of this road video decodes caching insertion frame of video, cache insertion m to the audio decoder of this road video pre-
Fixed audio frame；
The content in audio decoder caching according to this road video, the audio frequency continuing this road video is play；
Wherein, m is that the frame of video frame per second according to this road video, the sample rate of audio frame are calculated.
4. according to the arbitrary described method of claim 1-3, it is characterised in that described predetermined frame of video particularly as follows:
Before the data receiver of this road video interrupts, the last frame frame of video received；Or blank screen frame.
5. according to the arbitrary described method of claim 1-3, it is characterised in that described predetermined audio frame is specially mute frame.
6. cloud instructor in broadcasting's platform, it is characterised in that including:
Cutout processing module, during being used for receiving, playing multi-channel video, if the data receiver of a road video interrupts, then for
This road video inserts predetermined frame of video；And to insert predetermined audio frame in the way of described video frame synchronization；
Playing module, the frame of video for inserting according to described cutout processing module continues the spelling of this road video and other road video
Connect broadcasting；And carry out audio frequency broadcasting according to the audio frame of described cutout processing module insertion；And connect in the data of this road video
Receive after recovering, continue the splicing broadcasting of this road video and other road video according to the data received.
Cloud instructor in broadcasting's platform the most according to claim 6, it is characterised in that
If described cutout processing module is interrupted specifically for the data receiver of a road video, the video decoding of Ze Xianggai road video is slow
Deposit and insert predetermined frame of video；When the video of this road video decodes caching one frame of video of insertion, to the sound of this road video
Frequency decoding caching inserts m predetermined audio frame；Wherein, m is the sample rate calculating of the frame per second according to described frame of video, audio frame
Out.
Cloud instructor in broadcasting's platform the most according to claim 7, it is characterised in that also include:
Data reception module, for receiving the data of multi-channel video；And for every road video, by the video of this road video of reception
Data are stored in the video decoding caching of this road video, and the voice data of this road video received is stored in this road video
In audio decoder caching.
Cloud instructor in broadcasting's platform the most according to claim 8, it is characterised in that
Described playing module decodes regarding in caching specifically for the video that described cutout processing module is inserted into this road video
Frequently the frame of video during frame caches with the decoding of the video of other road video carries out splicing follow-up continued broadcasting and puts, and processes according to described cutout
The audio frequency of audio decoder caching this road video of continuation that module is inserted into this road video is play；And connect in the data of this road video
Receive after recovering, described data reception module is stored in the frame of video in the video decoding caching of this road video and other road video
Video decoding caching in frame of video carry out splicing follow-up continued broadcasting and put, and be stored in this road according to described data reception module and regard
Audio frame in the audio decoder caching of frequency carries out the audio frequency of this road video and plays.
10. according to the arbitrary described method of claim 6-9, it is characterised in that described predetermined frame of video particularly as follows:
Before the data receiver of this road video interrupts, the last frame frame of video received；Or blank screen frame.
11. according to the arbitrary described method of claim 6-9, it is characterised in that described predetermined audio frame is specially mute frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195830.3A CN105872697A (en) | 2016-03-30 | 2016-03-30 | Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610195830.3A CN105872697A (en) | 2016-03-30 | 2016-03-30 | Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105872697A true CN105872697A (en) | 2016-08-17 |
Family
ID=56627611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610195830.3A Pending CN105872697A (en) | 2016-03-30 | 2016-03-30 | Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105872697A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714633A (en) * | 2017-10-26 | 2019-05-03 | 创盛视联数码科技（北京）有限公司 | The method of video playing |
| CN110072137A (en) * | 2019-04-26 | 2019-07-30 | 湖南琴岛网络传媒科技有限公司 | A kind of data transmission method and transmitting device of net cast |
| CN111741376A (en) * | 2020-07-31 | 2020-10-02 | 南斗六星系统集成有限公司 | Method for synchronizing audio and video lip sounds of multimedia file splicing |
| CN113038220A (en) * | 2019-12-25 | 2021-06-25 | 中国电信股份有限公司 | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium |
| CN114189710A (en) * | 2021-12-07 | 2022-03-15 | 中国电信股份有限公司 | Program guide processing method, program guide processing device, and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101500170A (en) * | 2008-01-28 | 2009-08-05 | 联发科技股份有限公司 | Method for compensating timing mismatch in a/v data stream |
| CN103248950A (en) * | 2013-04-28 | 2013-08-14 | 天脉聚源(北京)传媒科技有限公司 | System and method for customizing video frame rate |
| CN104363508A (en) * | 2014-11-21 | 2015-02-18 | 浙江宇视科技有限公司 | Image stitching method and device for preventing video rollback |
| CN104581407A (en) * | 2014-12-31 | 2015-04-29 | 北京奇艺世纪科技有限公司 | Video previewing method and device |
| US20150163379A1 (en) * | 2013-12-11 | 2015-06-11 | Cellco Partnership D/B/A Verizon Wireless | Time synchronization of video and data inside a mobile device |
| CN104834361A (en) * | 2015-04-10 | 2015-08-12 | 北京恒泰实达科技股份有限公司 | Visualized director system and method |
-
2016
- 2016-03-30 CN CN201610195830.3A patent/CN105872697A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101500170A (en) * | 2008-01-28 | 2009-08-05 | 联发科技股份有限公司 | Method for compensating timing mismatch in a/v data stream |
| CN103248950A (en) * | 2013-04-28 | 2013-08-14 | 天脉聚源(北京)传媒科技有限公司 | System and method for customizing video frame rate |
| US20150163379A1 (en) * | 2013-12-11 | 2015-06-11 | Cellco Partnership D/B/A Verizon Wireless | Time synchronization of video and data inside a mobile device |
| CN104363508A (en) * | 2014-11-21 | 2015-02-18 | 浙江宇视科技有限公司 | Image stitching method and device for preventing video rollback |
| CN104581407A (en) * | 2014-12-31 | 2015-04-29 | 北京奇艺世纪科技有限公司 | Video previewing method and device |
| CN104834361A (en) * | 2015-04-10 | 2015-08-12 | 北京恒泰实达科技股份有限公司 | Visualized director system and method |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714633A (en) * | 2017-10-26 | 2019-05-03 | 创盛视联数码科技（北京）有限公司 | The method of video playing |
| CN110072137A (en) * | 2019-04-26 | 2019-07-30 | 湖南琴岛网络传媒科技有限公司 | A kind of data transmission method and transmitting device of net cast |
| CN110072137B (en) * | 2019-04-26 | 2021-06-08 | 湖南琴岛网络传媒科技有限公司 | Data transmission method and device for live video |
| CN113038220A (en) * | 2019-12-25 | 2021-06-25 | 中国电信股份有限公司 | Program directing method, program directing system, program directing apparatus, and computer-readable storage medium |
| CN111741376A (en) * | 2020-07-31 | 2020-10-02 | 南斗六星系统集成有限公司 | Method for synchronizing audio and video lip sounds of multimedia file splicing |
| CN111741376B (en) * | 2020-07-31 | 2020-12-01 | 南斗六星系统集成有限公司 | Method for synchronizing audio and video lip sounds of multimedia file splicing |
| CN114189710A (en) * | 2021-12-07 | 2022-03-15 | 中国电信股份有限公司 | Program guide processing method, program guide processing device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105847862A (en) | Cloud program directing station and cutoff continued broadcasting method thereof | |
| CN109089127B (en) | Video splicing method, device, equipment and medium | |
| CN105872697A (en) | Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization | |
| KR101434204B1 (en) | System and method for synchronization of television signals associated with multiple broadcast networks | |
| CN103165156B (en) | Audio video synchronization Play System and video broadcasting method, CD | |
| EP2232856B1 (en) | Generating a combined video stream from multiple input video streams | |
| US8931024B2 (en) | Receiving apparatus and subtitle processing method | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| CN109089154A (en) | A kind of video extraction method, apparatus, equipment and medium | |
| US9788034B1 (en) | Systems and methods for processing a traffic log having an optional-promotion log entry | |
| CN103200461A (en) | Multiple-player-terminal synchronized playing system and playing method | |
| CN102113339B (en) | Digital broadcast reproduction device and digital broadcast reproduction method | |
| US11595731B2 (en) | Implementation method and system of real-time subtitle in live broadcast and device | |
| CN105141810B (en) | It is a kind of to support slow-motion multichannel presentation system and method in real time | |
| CN108989883A (en) | A kind of living broadcast advertisement method, apparatus, equipment and medium | |
| CN101594538A (en) | A kind of advertisement in digital television player method and system | |
| CN103475927A (en) | Online-video real-time speed change play method and system thereof | |
| CN107295355A (en) | A kind of audio frequency and video total system and method | |
| CN105979289A (en) | Video generation and play method and device | |
| CN108989855A (en) | A kind of advertisement cut-in method, device, equipment and medium | |
| CN108881938B (en) | Live broadcast video intelligent cutting method and device | |
| KR102131741B1 (en) | Synchronization method for image of multiple digital signages | |
| CN105847709A (en) | Cloud program directing station and multi-channel video stitching method | |
| CN106060573A (en) | Live broadcast method and device based on terminal screen content | |
| US10750208B2 (en) | Processing video and audio streaming data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |