CN107613409A - The processing method and processing device of multi-medium data - Google Patents
The processing method and processing device of multi-medium data Download PDFInfo
- Publication number
- CN107613409A CN107613409A CN201710892750.8A CN201710892750A CN107613409A CN 107613409 A CN107613409 A CN 107613409A CN 201710892750 A CN201710892750 A CN 201710892750A CN 107613409 A CN107613409 A CN 107613409A
- Authority
- CN
- China
- Prior art keywords
- medium data
- data bag
- bag
- medium
- ffmpeg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiments of the invention provide a kind of processing method and processing device of multi-medium data, this method includes：The multi-medium data bag using realtime transmission protocol RTP transmission is received, multi-medium data bag is decapsulated using jrtplib storehouses of increasing income, and the multi-medium data bag after decapsulation is cached to the data buffer zone being pre-created；When the packet in data buffer zone reaches specified quantity, the multi-medium data bag in data buffer zone is ranked up according to reproduction time according to the timestamp of packet；Multi-medium data bag is read from data buffer zone successively according to ranking results；The multi-medium data bag of reading is decoded using FFMPEG bank interfaces of increasing income；Call media player to play out decoded multi-medium data bag, or decoded multi-medium data bag is generated into media file.The present invention not only realizes efficient encoding-decoding efficiency, reduces data transfer implementation complexity, and can eliminate networking shake, improves the communication quality of multi-medium data.
Description
Technical field
The present invention relates to multi-medium data in broadband trunking communicating technology field, more particularly to a kind of broadband cluster communication
Processing method and processing device.
Background technology
With the fast development of the industries such as global public safety, government affairs, traffic, the energy, industry user is in traditional voice
It is extremely urgent for the demand of broadband wireless data business, multimedia cluster scheduling on the basis of cluster.LTE(Long Term
Evolution, Long Term Evolution) turn into the selection of wireless private network broadband technology with its technology and industrial advantage, based on LTE technologies
Broadband Clustering also turns into global radio private network development common recognition.China takes the lead in having carried out the broadband cluster B- based on LTE technologies
The standardization effort of TrunC (Broadband Trunking Communication, broadband cluster communication) technology, base oneself upon autonomous
Innovation, be closely connected sector application demand, and technology and industry development are rapid.Mono- stages of B-TrunC professional standard is being just at present
Formula is issued, and the head recommended as ITU (International Telecommunication Union, International Telecommunication Union)
The broadband cluster of individual PPDR (Public Protection and Disaster Relief, public protection and the disaster relief) connects in the air
Mouth standard.As Ministry of Industry and Information has issued wideband digital cluster private network frequency planning, B-TrunC obtains 1.4GHz and 1.8GHz frequency ranges
Policy support.B-TrunC systems have begun to be widely used in the industries such as public safety, government affairs, traffic, the energy at present.
At present, dispatching desk configures as inside control centre, Surveillance center, command and management center etc. in the cluster communication of broadband
Important component, multiple industry fields are had been applied in, in subway, electric power, harbour, hotel, public security, army, emergent etc.
Industry has many successful stories, has played efficient production capacity.But for the processing of multi-medium data, due to it
The characteristics of containing much information, prior art is in encoding-decoding efficiency, data transfer implementation complexity and communication of media data quality etc.
Aspect still needs to be further improved and enhanced.
The content of the invention
In view of the above problems, the processing method and processing device of multi-medium data proposed by the present invention, not only realize efficient
Encoding-decoding efficiency, data transfer implementation complexity is reduced, and networking shake can be eliminated, improve the communication matter of multi-medium data
Amount.
The first aspect of the present invention, there is provided a kind of processing method of multi-medium data, this method include:
The multi-medium data bag using RTP transmission is received, storehouse is increased income to the multimedia using jrtplib
Packet is decapsulated, and the multi-medium data bag after decapsulation is cached to the data buffer zone being pre-created；
When the packet in the data buffer zone reaches specified quantity, according to the timestamp of packet to the data
Multi-medium data bag in buffering area is ranked up according to reproduction time；
Multi-medium data bag is read from the data buffer zone successively according to ranking results；
The multi-medium data bag of reading is decoded using FFMPEG bank interfaces of increasing income；
Media player is called to play out decoded multi-medium data bag, or by decoded multi-medium data bag
Generate media file.
Wherein, methods described also includes：
Using FFMPEG increase income bank interface collection multi-medium data；
The multi-medium data of collection is encoded according to specified format using FFMPEG bank interfaces of increasing income；
The multi-medium data after coding is packaged into the multi-medium data bag using jrtplib storehouses of increasing income, and using real
When host-host protocol be sent to other network element devices.
Wherein, in the timestamp according to packet to the multi-medium data bag in the data buffer zone according to broadcasting
After time is ranked up, methods described also includes：
Determined whether according to ranking results in the presence of the multi-medium data bag lost；
If packet loss be present, insert silent sound bag in the position of packet loss and substituted.
Wherein, the data buffer zone being pre-created that the multi-medium data bag received is cached to includes：
The value of write pointer is calculated according to the timestamp for the multi-medium data bag being currently received and size of data；
Whether the multi-medium data bag for judging to be currently received is first multi-medium data bag；
If so, it is write pointer then to initialize read pointer, and it is more by what is be currently received according to the value of the write pointer calculated
Media data packet is stored in corresponding spatial cache；
Otherwise, it is determined that whether the timestamp of the multi-medium data bag being currently received is more than the last data read
The timestamp of bag；
If the timestamp for the multi-medium data bag being currently received is more than the timestamp of the last packet read, root
The multi-medium data bag being currently received is stored in corresponding spatial cache according to the value of the write pointer calculated, otherwise abandons this
Bag.
It is wherein, described that according to ranking results, reading multi-medium data bag includes from the data buffer zone successively：
According to ranking results, multi-medium data is read from the data buffer zone successively according to default timing cycle
Bag.
The second aspect of the present invention, there is provided a kind of processing method of multi-medium data, including：
Using FFMPEG increase income bank interface collection multi-medium data；
The multi-medium data of collection is encoded according to specified format using FFMPEG bank interfaces of increasing income；
The multi-medium data after coding is packaged into the multi-medium data bag using jrtplib storehouses of increasing income, and using real
When host-host protocol be sent to other network element devices.
Wherein, it is described using FFMPEG increase income bank interface collection multi-medium data include:
The timing of timer is set according to the transmission interval parameters of the multi-medium data；
According to the timing, the periodically invoked FFMPEG increase income bank interface collection multi-medium data.
The third aspect of the present invention, there is provided a kind of processing unit of multi-medium data, the device include：
Receiving module, for receiving the multi-medium data bag using realtime transmission protocol RTP transmission, opened using jrtplib
Source storehouse is decapsulated to the multi-medium data bag, and the multi-medium data bag after decapsulation is cached to the number being pre-created
According to buffering area；
Order module, for when the packet in the data buffer zone reaches specified quantity, according to packet when
Between stab the multi-medium data bag in the data buffer zone be ranked up according to reproduction time；
Module for reading and writing, for reading multi-medium data bag from the data buffer zone successively according to ranking results；
First coding/decoding module, for being decoded using FFMPEG bank interfaces of increasing income to the multi-medium data bag of reading；
Playing module, for calling media player to play out decoded multi-medium data bag, or by after decoding
Multi-medium data bag generation media file.
Wherein, described device also includes the first media collection module and the first sending module：
First media collection module, for using FFMPEG increase income bank interface collection multi-medium data；
First coding/decoding module, it is additionally operable to increase income more matchmakers of the bank interface according to specified format to collection using FFMPEG
Volume data is encoded；
First sending module, for using jrtplib increase income storehouse the multi-medium data after coding is packaged into it is described
Multi-medium data bag, and the multi-medium data bag is sent to by other network element devices using RTP.
Wherein, described device also includes：
Packet loss determination module, in the timestamp according to packet to the multimedia number in the data buffer zone
After being ranked up according to bag according to reproduction time, determined whether according to ranking results in the presence of the multi-medium data bag lost；
Add module, for when packet loss being present, inserting silent sound bag in the position of packet loss and being substituted.
The fourth aspect of the present invention, there is provided a kind of processing unit of multi-medium data, including：
Second media collection module, for using FFMPEG increase income bank interface collection multi-medium data；
Second coding/decoding module, for being increased income multi-medium data of the bank interface according to specified format to collection using FFMPEG
Encoded；
Second sending module, for the multi-medium data after coding to be packaged into more matchmakers using jrtplib storehouses of increasing income
Volume data bag, and other network element devices are sent to using RTP.
Wherein, second media collection module includes：
Timing submodule, for setting the timing of timer according to the transmission interval parameters of the multi-medium data；
Submodule is gathered, for according to the timing, periodically invoked FFMPEG bank interface collections of increasing income are more
Media data.
In addition, present invention also offers a kind of computer-readable recording medium, computer program is stored thereon with, the program
The step of as above first aspect methods described is realized when being executed by processor.
In addition, present invention also offers a kind of computer equipment, including memory, processor and storage are on a memory simultaneously
The computer program that can be run on a processor, as above first aspect methods described is realized during the computing device described program
The step of.
In addition, present invention also offers a kind of computer-readable recording medium, computer program is stored thereon with, the program
The step of as above second aspect methods described is realized when being executed by processor.
In addition, present invention also offers a kind of computer equipment, including memory, processor and storage are on a memory simultaneously
The computer program that can be run on a processor, as above first aspect methods described is realized during the computing device described program
The step of.
The processing method and processing device of multi-medium data provided in an embodiment of the present invention, by using increasing income, storehouse ffmpeg is carried out
Multi-medium data gathers and encoding and decoding, supports extensive video format and efficient encoding-decoding efficiency；Increased income storehouse using jrtplib
The transmission of multi-medium data bag is carried out, facilitates the transmitting-receiving of multi-medium data bag, reduces the complexity that transmission is realized；Receiving
During to multi-medium data bag, the multi-medium data bag reached is cached to using the data buffer zone being pre-created, and carry out out of order row
Sequence, networking shake can be eliminated, be effectively improved the communication quality of multi-medium data.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 is a kind of flow chart of the processing method of multi-medium data of the embodiment of the present invention；
Fig. 2 is the communication context schematic diagram of dispatching table system in the embodiment of the present invention；
Fig. 3 is the communication context schematic diagram of dispatching table system in another embodiment of the present invention；
Fig. 4 is the workflow diagram that media data sends thread in the embodiment of the present invention；
Fig. 5 is the workflow diagram of media data reception thread in the embodiment of the present invention；
Fig. 6 is the workflow diagram that media data plays thread in the embodiment of the present invention；
Fig. 7 is that buffering area writes the flow chart of data in video stabilization processing procedure in the embodiment of the present invention；
Fig. 8 is that buffering area reads the flow chart of data in video stabilization processing procedure in the embodiment of the present invention；
Fig. 9 is a kind of flow chart of the processing method of multi-medium data of another embodiment of the present invention；
Figure 10 is a kind of structural representation of the processing unit of multi-medium data in the embodiment of the present invention；
Figure 11 is a kind of structural representation of the processing unit of multi-medium data in another embodiment of the present invention；
Figure 12 is the schematic diagram of the computer equipment of the embodiment of the present invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific terminology), there is the general understanding identical meaning with the those of ordinary skill in art of the present invention.Should also
Understand, those terms defined in such as general dictionary, it should be understood that have with the context of prior art
The consistent meaning of meaning, and unless by specific definitions, otherwise will not be explained with the implication of idealization or overly formal.
It is an object of the present invention to provide one kind to be not only suitable for the private networks such as track traffic command dispatching system, is also applied for
The processing method of the multi-medium data of the private networks such as enterprises and institutions, to realize efficient encoding-decoding efficiency, it is real to reduce data transfer
Existing complexity, and networking shake can be eliminated, improve the communication quality of multi-medium data in the cluster communication of broadband.
Fig. 1 diagrammatically illustrates the flow chart of the processing method of the multi-medium data of one embodiment of the invention.Reference picture
1, the processing method of the multi-medium data of the embodiment of the present invention specifically includes following steps：
S11, the multi-medium data bag transmitted using RTP is received, storehouse is increased income to described more using jrtplib
Media data packet is decapsulated, and the multi-medium data bag after decapsulation is cached to the data buffer zone being pre-created.
Multi-medium data bag in the embodiment of the present invention can be video data and/or voice data, it is particularly applicable to reality
Border application scenarios.Wherein, jrtplib increase income storehouse be one with C Plus Plus realize RTP storehouses.
In practical application, dispatching desk (DC, Dispatch Console) receives other network elements or equipment by Ethernet
Multi-medium data bag, and the multi-medium data bag is decapsulated by jrtplib storehouses of increasing income.The present embodiment utilizes
Jrtplib increase income storehouse carry out multi-medium data bag RTP encapsulation send and RTP bags reception decapsulation, effectively facilitate more
The transmitting-receiving of media data packet, reduce the complexity that transmission is realized.
S12, when the packet in the data buffer zone reaches specified quantity, according to the timestamp of packet to described
Multi-medium data bag in data buffer zone is ranked up according to reproduction time.
S13, according to ranking results successively from the data buffer zone read multi-medium data bag.
S14, bank interface of being increased income using FFMPEG are decoded to the multi-medium data bag of reading.
In the present embodiment, in order to tackle more matchmakers caused by network transmission quality reason causes packet loss, out of order, time delay
The problem of volume data communication quality difference, the embodiment of the present invention additionally provides carries out stabilization handling process to multi-medium data.It is logical
Cross and be pre-created a data buffer zone, after caching a part of data received, subsequently to be utilized with fixed speed
FFMPEG bank interfaces of increasing income are decoded.Multi-medium data is successively ranked up according to the timestamp of RTP bags, to solve out of order ask
Topic, and then effectively reduce the influence of network jitter.
S15, media player is called to play out decoded multi-medium data bag, or by decoded multimedia number
Media file is generated according to bag.
In the present embodiment, using SDL (Simple DirectMedia Layer) bank interface of increasing income, decoded more matchmakers
Volume data bag is played out by SDL playback engines, or decoded multi-medium data bag is preserved into media file, is carried out
Preserve.
The processing method of multi-medium data provided in an embodiment of the present invention, dispatching desk is mainly realized using existing storehouse of increasing income
Video playback and transmission, while the processing of video bag stabilization is added, efficient encoding-decoding efficiency is not only realized, reduces data
Implementation complexity is transmitted, and networking shake can be eliminated, improves the communication quality of multi-medium data.Specifically, the present invention is real
The processing method of the multi-medium data of example offer is applied, storehouse ffmpeg carries out multi-medium data encoding and decoding by using increasing income, and supports
Extensive video format and efficient encoding-decoding efficiency；The transmission of multi-medium data bag is carried out using jrtplib storehouses of increasing income, it is convenient
The transmitting-receiving of multi-medium data bag, reduce the complexity that transmission is realized；When receiving multi-medium data bag, using advance wound
The data buffer zone built is cached to the multi-medium data bag reached, and carries out out-of-order sequence, can eliminate networking shake, effectively carry
The communication quality of multi-medium data in high broadband cluster communication.
In an alternate embodiment of the present invention where, dispatching desk (DC, Dispatch Console) can not only be realized pair
The stabilization processing of the multi-medium data bag received and high quality play, and also achieve the collection of efficient multi-medium data, compile
Code and transmission.It is as follows to implement flow：
Using FFMPEG increase income bank interface collection multi-medium data.In the embodiment of the present invention, multi-medium data collection utilizes
FFMPEG increase income bank interface realization.
The multi-medium data of collection is encoded according to specified format.In the embodiment of the present invention, multi-medium data compiles solution
Code is increased income bank interface also with FFMPEG, realizes coding or the decoding of multi-medium data, multi-medium data is such as carried out lattice
Sent after formula coding, or the multi-medium data received is decoded into the form of needs.
The multi-medium data after coding is packaged into the multi-medium data bag using jrtplib storehouses of increasing income, and using real
When host-host protocol be sent to other network element devices.In the embodiment of the present invention, increased income bank interface using jrtplib, realize multimedia
RTP encapsulation or the RTP decapsulation of packet, meanwhile, realize that UDP Socket or TCP Socket communicate, send or connect
Receive multi-medium data bag.
In actual applications, dispatching desk can not only receive other network elements or the multi-medium data of equipment by Ethernet
Bag, the playback engine for calling SDL to provide after decoding play out or preserved into media file, while can also be real
Collection, coding and the transmission of existing multi-medium data.Specifically, for video data, increased income storehouse acquisition camera using FFMPEG
Camera or video file video data, other network elements or equipment are issued by Ethernet after encoded, for example,
User equipment, it for details, reference can be made to Fig. 2；For voice data, using FFMPEG increase income storehouse collection microphone Microphone, raise one's voice
Device loudspeaker or audio file voice data, other network elements are issued by Ethernet after encoded or set
It is standby, for example, user equipment, for details, reference can be made to Fig. 3.
The processing method of multi-medium data provided in an embodiment of the present invention, dispatching desk is mainly realized using existing storehouse of increasing income
Collection, broadcasting and the transmission of video, while the processing of video bag stabilization is added, efficient encoding-decoding efficiency is not only realized,
Data transfer implementation complexity is reduced, and networking shake can be eliminated, improves the communication quality of multi-medium data.Specifically,
The processing method of multi-medium data provided in an embodiment of the present invention, by using increasing income, storehouse ffmpeg carries out multi-medium data collection
And encoding and decoding, support extensive video format and efficient encoding-decoding efficiency.
In embodiments of the present invention, the timestamp according to packet in step s 12 is in the data buffer zone
After multi-medium data bag is ranked up according to reproduction time, methods described is further comprising the steps of：
Determined whether according to ranking results in the presence of the multi-medium data bag lost, if packet loss be present, in the position of packet loss
Silent sound bag is inserted to be substituted.
In actual applications, because the timestamp increment of adjacent multi-medium data bag is fixed, therefore can be according to data
The timestamp of adjacent multi-medium data bag determines to whether there is packet loss between two multi-medium data bags in buffering area, or loses
Situations such as several bags.If it is determined that if result is packet loss be present, preserves a silent sound bag and replace, can so reach smooth
The effect of video is played, effectively reduces the influence of network jitter.
Dispatching desk DC systems send thread, media data reception thread, media data broadcasting line by creating media data
Transmission, reception and broadcastings of the Cheng Shixian to multi-medium datas such as video, audios.
Media data sends thread and is mainly used in controlling medium data acquisition, coding, transmission process.Specifically, it is exactly
Call medium data acquisition interface to collect media data, then calling media data encoding and decoding interface to press will thread cycle
The form asked is encoded, and finally calls media data transmission interface that code stream is sent.
As shown in figure 4, the workflow that media data sends thread is specific as follows：
Step 1：After the related initialization of program start completion, start and send thread, into step 2.
Step 2：Timer is started according to the data format of communicating requirement and corresponding transmission intercal, is timed to, starts to adjust
Media peripheral data is gathered with FFMPEG interfaces, into step 3.
Step 3：If not collecting data, return to step 2 starts next collection period timer.If collect matchmaker
Volume data then enters step 4.
Step 4：It is same to call FFMPEG interfaces to be encoded by the data format of communicating requirement, into step 5.
Step 5：The media data for completing coding, jrtplib interfaces are called to send encoding code stream, into step 6.
Step 6：Judge whether thread will stop, if it is, into step 7；If it is not, then return to step 2.
Step 7：Exit thread.
Media data reception thread is mainly used in controlling media data reception and media data stabilization processing procedure.Specifically
For, it is exactly that thread cycle calls media data transmission interface then it to be buffered in pre- to media data stream
If be ranked up in spatial cache corresponding to data buffer zone, packet loss judge, time delay judge etc. series of algorithms processing.
As shown in figure 5, the workflow of media data reception thread is specific as follows：
Step 1：After the related initialization of program start completion, start receiving thread, into step 2.
Step 2：This step starts constantly receiving data, if receiving data, into step 3.
Step 3：The media data received is carried out stabilization processing, into step 4.
Step 4：Judge whether thread will stop, if it is, into step 5；If it is not, then return to step 2.
Step 5：Exit thread.
Multi-medium data bag after treatment is got in media data broadcasting thread timing in data buffer zone, is called and is compiled
The form of decoding interface on request is decoded, and is finally called playback interface to carry out media data broadcasting or is preserved into matchmaker
Body file.
As shown in fig. 6, the workflow that media data plays thread is specific as follows：
Step 1：After the related initialization of program start completion, start and play thread, into step 2.
Step 2：According to the data format of communicating requirement and corresponding transmission intercal, start the timer for reading caching, this
Sample can control normal broadcasting speed, make broadcasting not by the fixing sound of network jitter, into step 3.
Step 3：Timer arrives, then into step 4, otherwise waits until time-out always.
Step 4：The data cached in data buffer zone are read, if reading failure, return to step 2 starts next reading
Take the timer in cycle；If read successfully, why into step 5.
Step 5：FFMPEG interfaces are called to carry out media data decoding, into step 6.
Step 6：SDL interface is called to carry out media play or preserve into media file, into step 7.
Step 7：Judge whether thread will stop, if it is, into step 8；If it is not, then return to step 2.
Step 8：Exit thread.
It is described that the multi-medium data bag received is cached to the data buffer zone tool being pre-created in the embodiment of the present invention
Body is realized by following steps：
The value of write pointer is calculated according to the timestamp for the multi-medium data bag being currently received and size of data.Actually should
In, after receiving multi-medium data bag, before data pack buffer is carried out, spatial cache corresponding to data buffer zone is first judged
Whether pile, if it is, abandoning this packet；If it is not, then according to the multi-medium data bag being currently received
The step of timestamp and size of data calculate WP value.Wherein, WP value points to some cache location of data buffer zone.
Whether the multi-medium data bag for judging to be currently received is first multi-medium data bag；If so, then initialization is read
Pointer is write pointer, and is delayed corresponding to according to the value of the write pointer calculated, the multi-medium data bag being currently received is stored in
Deposit space；Otherwise, it is determined that whether the timestamp of the multi-medium data bag being currently received is more than the last data read
The timestamp of bag；
If the timestamp for the multi-medium data bag being currently received is more than the timestamp of the last packet read, root
The multi-medium data bag being currently received is stored in corresponding spatial cache according to the value of the write pointer calculated, otherwise abandons this
Bag.
In a specific example, the incremental time of media data packet is set as a fixed value, such as 160, if first
The timestamp of individual packet is 160, then the timestamp of second packet is 320.And so on, the timestamp of each packet
All it is 160 integral multiple.If the size of spatial cache corresponding to data buffer zone, which is most multipotency, deposits 20 packets, then this 20
Position of the individual packet in internal memory is fixed, and corresponding position has a numbering, e.g., 0,1,2 ... 19, write pointer WP is just
It is this numbering.When receiving a packet, the value for realizing write pointer especially by following manner calculates：
If the timestamp of current data packet is 2560, write pointer WP corresponding to the packet:
WP=(2560/160) %20=16, wherein, % is mathematics modulo operation；
So, this packet should just be maintained at the cache location that WP is the data buffer zone pointed by 16.
If the timestamp of current data packet is 7200, write pointer WP corresponding to the packet:
WP=(7200/160) %20=5, wherein, % is mathematics modulo operation；
So, this packet should just be maintained at the cache location that WP is the data buffer zone pointed by 5.
As shown in fig. 7, the multi-medium data bag received is cached to what is be pre-created in video stabilization processing procedure
The flow of writing of data buffer zone is implemented as follows：
Step 1：A video data bag is received from receiving thread, into step 2.
Step 2：Before bag is put into caching, first judge whether spatial cache corresponding to data buffer zone has been piled, if
It is then to abandon this packet；If it is not, then into step 3.
Step 3：According to the timestamp and buffer storage length of the RTP inside video bag, write pointer WP value is calculated, the value refers to
To some position of spatial cache, into step 4.
Step 4：Judge whether it is first packet received, if it is, into step 5；If it is not, then enter
Enter step 6.
Step 5：Read pointer RP is initialized, its value is equal to WP, into step 7.
Step 6：If not first packet, then by the timestamp of the bag and the last packet read when
Between stab contrast, if it is less, thinking that this packet is belated out-of-date packet, then into step 8；It is if effective
Packet, then into step 7.
Step 7：Write pointer WP according to calculating is stored in packet in caching.
Step 8：Abandon this bag.
It is described to read multi-medium data bag from the data buffer zone successively according to ranking results in the embodiment of the present invention
Realized especially by following steps：According to ranking results, read successively from the data buffer zone according to default timing cycle
Take multi-medium data bag.
As shown in figure 8, read successively from the data buffer zone according to ranking results in video stabilization processing procedure
Multi-medium data bag is implemented as follows：
Step 1：A data are read from caching successively according to default timing cycle, into step 2.
Step 2：Before reading, first judge whether there are data in caching, if without data, into step 5；If number
According to then into step 3.
Step 3：Whether there are data in cache location according to where judging current read pointer RP, if it is not, into
Step 5；If so, then enter step 4.
Step 4：Set return value is successfully, to represent to read data success, subsequently into step 6.
Step 5：Set return value is failure, represents to read data failure, subsequently into step 7.
Step 6：Data in caching are read according to read pointer RP pointed locations, subsequently into step 7.
Step 7：Next read cycle read pointer RP value is calculated, is then back to reading result.
Compared with prior art, the processing method of multi-medium data provided in an embodiment of the present invention possesses following beneficial to effect
Fruit：
1. storehouse ffmpeg carries out video acquisition and encoding and decoding using increasing income, extensive video format and efficient compile is supported to solve
Code efficiency；
2. using jrtplib increase income storehouse carry out video bag RTP (Real-time Transport Protocol, in real time
Host-host protocol) encapsulation is sent and the reception of RTP bags, facilitates the transmitting-receiving of multi-medium data bag, reduce the complexity that transmission is realized
Degree；
3. the broadcasting for storehouse progress video of being increased income using SDL (Simple DirectMedia Layer), it is real to eliminate oneself
Existing video playback control；
4. video flowing receives, using the video bag of buffer arrival, and out-of-order sequence is carried out, then with fixed
Speed plays, and eliminates network jitter, improves video playing quality.
Fig. 9 diagrammatically illustrates the flow chart of the processing method of the multi-medium data of another embodiment of the present invention.Reference
Fig. 9, the processing method of the multi-medium data of the embodiment of the present invention specifically include following steps：
S21, bank interface collection multi-medium data of being increased income using FFMPEG；
S22, bank interface of being increased income using FFMPEG are encoded according to specified format to the multi-medium data of collection；
Multi-medium data after coding is packaged into the multi-medium data bag, and adopted by S23, storehouse of being increased income using jrtplib
Other network element devices are sent to RTP.
In embodiments of the present invention, in step S21 using FFMPEG increase income bank interface collection multi-medium data specifically may be used
Realized by step once：
The timing of timer is set according to the transmission interval parameters of the multi-medium data；
According to the timing, the periodically invoked FFMPEG increase income bank interface collection multi-medium data.
In actual applications, it is necessary to set timer according to the data format of communicating requirement and corresponding transmission interval parameters
Timing, start timer, timing arrives the multi-medium data for then starting to call FFMPEG interfaces to gather media peripheral hardware,
If not collecting data, start next collection period timer.Equally called if multi-medium data is collected
FFMPEG interfaces are encoded by the data format of communicating requirement, will be completed the multi-medium data of coding, are called jrtplib interfaces
Send encoding code stream.
The processing method of multi-medium data provided in an embodiment of the present invention, mainly using FFMPEG increase income bank interface realize tune
Collection and the coding of platform video are spent, and transmission is packaged to the multi-medium data after coding by using jrtplib storehouses of increasing income,
Extensive video format and efficient encoding-decoding efficiency can not only be supported, and facilitates the transmitting-receiving of multi-medium data bag, is dropped
The complexity that low transmission is realized.
For embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of combination of actions, but this area
Technical staff should know that the embodiment of the present invention is not limited by described sequence of movement, because implementing according to the present invention
Example, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art should also know, specification
Described in embodiment belong to preferred embodiment, necessary to the involved action not necessarily embodiment of the present invention.
Figure 10 diagrammatically illustrates the structural representation of the processing unit of the multi-medium data of one embodiment of the invention.Ginseng
According to Figure 10, the processing unit of the multi-medium data of the embodiment of the present invention includes receiving module 301, order module 302, module for reading and writing
303rd, the first coding/decoding module 304 and playing module 305, wherein：
Receiving module 301, for receiving the multi-medium data bag using realtime transmission protocol RTP transmission, utilize jrtplib
Storehouse of increasing income is decapsulated to the multi-medium data bag, and the multi-medium data bag after decapsulation is cached into what is be pre-created
Data buffer zone；
Order module 302, for when the packet in the data buffer zone reaches specified quantity, according to packet
Timestamp is ranked up to the multi-medium data bag in the data buffer zone according to reproduction time；
Module for reading and writing 303, for reading multi-medium data bag from the data buffer zone successively according to ranking results；
First coding/decoding module 304, for being solved using FFMPEG bank interfaces of increasing income to the multi-medium data bag of reading
Code；
Playing module 305, for calling media player to play out decoded multi-medium data bag, or will decoding
Multi-medium data bag generation media file afterwards.
In embodiments of the present invention, described device also includes the first media collection module and the first hair not shown in accompanying drawing
Module is sent, wherein：
First media collection module, for using FFMPEG increase income bank interface collection multi-medium data；
First coding/decoding module, it is additionally operable to increase income more matchmakers of the bank interface according to specified format to collection using FFMPEG
Volume data is encoded；
Accordingly, first sending module, for using jrtplib increase income storehouse by after coding multi-medium data encapsulate
The multi-medium data bag is sent to other network element devices into the multi-medium data bag, and using RTP.
In embodiments of the present invention, described device also includes the packet loss determination module and add module not shown in accompanying drawing,
Wherein：
The packet loss determination module, in the timestamp according to packet to more matchmakers in the data buffer zone
After volume data bag is ranked up according to reproduction time, determined whether according to ranking results in the presence of the multi-medium data bag lost；
The add module, for when packet loss being present, inserting silent sound bag in the position of packet loss and being substituted.
In an alternate embodiment of the present invention where, the receiving module 301, specifically it is additionally operable to realize at following stabilization
Reason：
The value of write pointer is calculated according to the timestamp for the multi-medium data bag being currently received and size of data；Judge current
Whether the multi-medium data bag received is first multi-medium data bag；If so, then initialization read pointer is write pointer, and root
The multi-medium data bag being currently received is stored in corresponding spatial cache according to the value of the write pointer calculated；Otherwise, it is determined that
Whether the timestamp of the multi-medium data bag being currently received is more than the timestamp of the last packet read；It is if current
The timestamp of the multi-medium data bag received is more than the timestamp of the last packet read, then writes finger according to what is calculated
The multi-medium data bag being currently received is stored in corresponding spatial cache by the value of pin, otherwise abandons this bag.
In an alternate embodiment of the present invention where, the module for reading and writing 303, specifically for according to ranking results, according to
Default timing cycle reads multi-medium data bag from the data buffer zone successively.
Figure 11 diagrammatically illustrates the structural representation of the processing unit of the multi-medium data of one embodiment of the invention.Ginseng
According to Figure 11, the processing unit of the multi-medium data of the embodiment of the present invention includes the second media collection module 401, the second encoding and decoding mould
The sending module 403 of block 402 and second, wherein：
Second media collection module 401, for using FFMPEG increase income bank interface collection multi-medium data；
Second coding/decoding module 402, for being increased income multimedia of the bank interface according to specified format to collection using FFMPEG
Data are encoded；
Second sending module 403, for using jrtplib increase income storehouse the multi-medium data after coding is packaged into it is described more
Media data packet, and other network element devices are sent to using RTP.
In embodiments of the present invention, second media collection module 401 further comprises timing submodule and collection
Module, wherein：Timing submodule, for according to the transmission interval parameters of the multi-medium data set timer timing when
Between；Submodule is gathered, for according to the timing, the periodically invoked FFMPEG increases income bank interface collection multimedia number
According to.
The processing unit of multi-medium data provided in an embodiment of the present invention, the second media collection module and the second encoding and decoding mould
Block realizes collection and the coding of dispatching desk video using FFMPEG bank interfaces of increasing income, and the second sending module is by using jrtplib
Storehouse of increasing income is packaged transmission to the multi-medium data after coding, and extensive video format and efficient compile can not only be supported to solve
Code efficiency, and the transmitting-receiving of multi-medium data bag is facilitated, reduce the complexity that transmission is realized.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Device embodiment described above is only schematical, wherein the unit illustrated as separating component can
To be or may not be physically separate, it can be as the part that unit is shown or may not be physics list
Member, you can with positioned at a place, or can also be distributed on multiple NEs.It can be selected according to the actual needs
In some or all of module realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creativeness
Work in the case of, you can to understand and implement.
The processing method and processing device of multi-medium data provided in an embodiment of the present invention, by using increasing income, storehouse ffmpeg is carried out
Multi-medium data gathers and encoding and decoding, supports extensive video format and efficient encoding-decoding efficiency；Increased income storehouse using jrtplib
The transmission of multi-medium data bag is carried out, facilitates the transmitting-receiving of multi-medium data bag, reduces the complexity that transmission is realized；Receiving
During to multi-medium data bag, the multi-medium data bag reached is cached to using the data buffer zone being pre-created, and carry out out of order row
Sequence, networking shake can be eliminated, be effectively improved the communication quality of multi-medium data in the cluster communication of broadband.
In addition, the embodiment of the present invention additionally provides a kind of computer-readable recording medium, computer program is stored thereon with,
The step of as above any embodiment methods described is realized when the program is executed by processor.
In the present embodiment, if module/unit that the processing unit of the multi-medium data integrates is with SFU software functional unit
Form realize and be used as independent production marketing or in use, can be stored in a computer read/write memory medium.
Based on such understanding, the present invention realizes all or part of flow in above-described embodiment method, can also pass through computer journey
Sequence instructs the hardware of correlation to complete, and described computer program can be stored in a computer-readable recording medium, the meter
Calculation machine program when being executed by processor, can be achieved above-mentioned each embodiment of the method the step of.Wherein, the computer program bag
Include computer program code, the computer program code can be source code form, object identification code form, executable file or
Some intermediate forms etc..The computer-readable medium can include：Any reality of the computer program code can be carried
Body or device, recording medium, USB flash disk, mobile hard disk, magnetic disc, CD, computer storage, read-only storage (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and
Software distribution medium etc..It should be noted that the content that the computer-readable medium includes can be according in jurisdiction
Legislation and the requirement of patent practice carry out appropriate increase and decrease, such as in some jurisdictions, according to legislation and patent practice, meter
Calculation machine computer-readable recording medium does not include electric carrier signal and telecommunication signal.
Figure 12 is the schematic diagram of computer equipment provided in an embodiment of the present invention.Computer provided in an embodiment of the present invention is set
It is standby, including memory, processor and storage are on a memory and the computer program that can run on a processor, the processor
The step in the processing method embodiment of multi-medium data described in any of the above-described embodiment is realized when performing the computer program,
Such as S11 shown in Fig. 1, multi-medium data bag using RTP transmission is received, storehouse is increased income to institute using jrtplib
State multi-medium data bag to be decapsulated, and the multi-medium data bag after decapsulation is cached to the data buffering being pre-created
Area.S12, when the packet in the data buffer zone reaches specified quantity, according to the timestamp of packet to the data
Multi-medium data bag in buffering area is ranked up according to reproduction time.S13, according to ranking results successively from the data buffering
Multi-medium data bag is read in area.S14, bank interface of being increased income using FFMPEG are decoded to the multi-medium data bag of reading.
S15, call media player to play out decoded multi-medium data bag, or decoded multi-medium data bag is generated
Media file.S21 for example shown in Fig. 9, bank interface collection multi-medium data of being increased income using FFMPEG again；S22, utilize FFMPEG
Bank interface of increasing income encodes according to specified format to the multi-medium data of collection；S23, storehouse of being increased income using jrtplib will encode
Multi-medium data afterwards is packaged into the multi-medium data bag, and is sent to other network element devices using RTP.Or
Person, each mould in the processing unit embodiment of above-mentioned each multi-medium data is realized described in the computing device during computer program
The function of block/unit, such as receiving module 301, order module 302, module for reading and writing 303, the first encoding and decoding mould shown in Figure 10
Block 304 and playing module 305.Again the second media collection module 401 for example shown in Figure 11, the second coding/decoding module 402 with
And second sending module 403.
Exemplary, the computer program can be divided into one or more module/units, one or more
Individual module/unit is stored in the memory, and by the computing device, to complete the present invention.It is one or more
Individual module/unit can be the series of computation machine programmed instruction section that can complete specific function, and the instruction segment is used to describe institute
State implementation procedure of the computer program in the processing unit of the multi-medium data.For example, the computer program can be by
It is divided into receiving module 301, order module 302, module for reading and writing 303, the first coding/decoding module 304 and playing module 305.Again
For example, the computer program can be divided into the second media collection module 401, the second coding/decoding module 402 and second
Sending module 403.
The computer equipment can be that the calculating such as desktop PC, notebook, palm PC and cloud server are set
It is standby.The computer equipment may include, but be not limited only to, processor, memory.It is it will be understood by those skilled in the art that described
Schematic diagram 12 is only the example of computer equipment, does not form the restriction to computer equipment, can be included more more than illustrating
Or less part, some parts or different parts are either combined, such as the computer equipment can also include input
Output equipment, network access equipment, bus etc..
The processor can be CPU (Central Processing Unit, CPU), can also be it
His general processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other PLDs, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng the processor is the control centre of the computer equipment, utilizes various interfaces and the whole computer equipment of connection
Various pieces.
The memory can be used for storing the computer program and/or module, and the processor is by running or performing
The computer program and/or module being stored in the memory, and the data being stored in memory are called, described in realization
The various functions of computer equipment.The memory can mainly include storing program area and storage data field, wherein, storage program
Area can storage program area, the application program (such as sound-playing function, image player function etc.) needed at least one function
Deng；Storage data field can store uses created data (such as voice data, phone directory etc.) etc. according to mobile phone.In addition,
Memory can include high-speed random access memory, can also include nonvolatile memory, such as hard disk, internal memory, grafting
Formula hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card), at least one disk memory, flush memory device or other volatile solid-state parts.
It will be appreciated by those of skill in the art that although some embodiments in this are included included by other embodiments
Some features rather than further feature, but the combination of the feature of different embodiments means to be within the scope of the present invention simultaneously
And form different embodiments.For example, in the following claims, the one of any of embodiment claimed all may be used
Used in a manner of in any combination.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that：It still may be used
To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (16)
- A kind of 1. processing method of multi-medium data, it is characterised in that including：The multi-medium data bag using RTP transmission is received, storehouse is increased income to the multi-medium data using jrtplib Bag is decapsulated, and the multi-medium data bag after decapsulation is cached to the data buffer zone being pre-created；When the packet in the data buffer zone reaches specified quantity, according to the timestamp of packet to the data buffering Multi-medium data bag in area is ranked up according to reproduction time；Multi-medium data bag is read from the data buffer zone successively according to ranking results；The multi-medium data bag of reading is decoded using FFMPEG bank interfaces of increasing income；Call media player to play out decoded multi-medium data bag, or decoded multi-medium data bag is generated Media file.
- 2. according to the method for claim 1, it is characterised in that methods described also includes：Using FFMPEG increase income bank interface collection multi-medium data；The multi-medium data of collection is encoded according to specified format using FFMPEG bank interfaces of increasing income；The multi-medium data after coding is packaged into the multi-medium data bag using jrtplib storehouses of increasing income, and using passing in real time Defeated agreement is sent to other network element devices.
- 3. according to the method for claim 1, it is characterised in that the data are delayed in the timestamp according to packet After the multi-medium data bag rushed in area is ranked up according to reproduction time, methods described also includes：Determined whether according to ranking results in the presence of the multi-medium data bag lost；If packet loss be present, insert silent sound bag in the position of packet loss and substituted.
- 4. according to the method described in claim any one of 1-3, it is characterised in that described to delay the multi-medium data bag received Being stored to the data buffer zone being pre-created includes：The value of write pointer is calculated according to the timestamp for the multi-medium data bag being currently received and size of data；Whether the multi-medium data bag for judging to be currently received is first multi-medium data bag；If so, then initialization read pointer is write pointer, and the multimedia that will be currently received according to the value of the write pointer calculated Packet is stored in corresponding spatial cache；Otherwise, it is determined that whether the timestamp of the multi-medium data bag being currently received is more than the last packet read Timestamp；If the timestamp for the multi-medium data bag being currently received is more than the timestamp of the last packet read, according to meter The multi-medium data bag being currently received is stored in corresponding spatial cache by the value of the write pointer calculated, otherwise abandons this bag.
- 5. according to the method described in claim any one of 1-3, it is characterised in that it is described according to ranking results successively from the number Include according to multi-medium data bag is read in buffering area：According to ranking results, multi-medium data bag is read from the data buffer zone successively according to default timing cycle.
- A kind of 6. processing method of multi-medium data, it is characterised in that including：Using FFMPEG increase income bank interface collection multi-medium data；The multi-medium data of collection is encoded according to specified format using FFMPEG bank interfaces of increasing income；The multi-medium data after coding is packaged into the multi-medium data bag using jrtplib storehouses of increasing income, and using passing in real time Defeated agreement is sent to other network element devices.
- 7. according to the method for claim 6, it is characterised in that it is described using FFMPEG increase income bank interface collection multimedia number According to including:The timing of timer is set according to the transmission interval parameters of the multi-medium data；According to the timing, the periodically invoked FFMPEG increase income bank interface collection multi-medium data.
- A kind of 8. processing unit of multi-medium data, it is characterised in that including：Receiving module, for receiving the multi-medium data bag using realtime transmission protocol RTP transmission, increased income storehouse using jrtplib The multi-medium data bag is decapsulated, and the multi-medium data bag after decapsulation is cached to the data being pre-created and delayed Rush area；Order module, for when the packet in the data buffer zone reaches specified quantity, according to the timestamp of packet Multi-medium data bag in the data buffer zone is ranked up according to reproduction time；Module for reading and writing, for reading multi-medium data bag from the data buffer zone successively according to ranking results；First coding/decoding module, for being decoded using FFMPEG bank interfaces of increasing income to the multi-medium data bag of reading；Playing module, for calling media player to play out decoded multi-medium data bag, or will be decoded more Media data packet generates media file.
- 9. device according to claim 8, it is characterised in that described device also includes the first media collection module and first Sending module：First media collection module, for using FFMPEG increase income bank interface collection multi-medium data；First coding/decoding module, it is additionally operable to increase income multimedia number of the bank interface according to specified format to collection using FFMPEG According to being encoded；First sending module, for the multi-medium data after coding to be packaged into more matchmakers using jrtplib storehouses of increasing income Volume data bag, and the multi-medium data bag is sent to by other network element devices using RTP.
- 10. device according to claim 8, it is characterised in that described device also includes：Packet loss determination module, in the timestamp according to packet to the multi-medium data bag in the data buffer zone After being ranked up according to reproduction time, determined whether according to ranking results in the presence of the multi-medium data bag lost；Add module, for when packet loss being present, inserting silent sound bag in the position of packet loss and being substituted.
- A kind of 11. processing unit of multi-medium data, it is characterised in that including：Second media collection module, for using FFMPEG increase income bank interface collection multi-medium data；Second coding/decoding module, for increasing income bank interface according to multi-medium data progress of the specified format to collection using FFMPEG Coding；Second sending module, for the multi-medium data after coding to be packaged into the multimedia number using jrtplib storehouses of increasing income Other network element devices are sent to according to bag, and using RTP.
- 12. device according to claim 11, it is characterised in that second media collection module includes:Timing submodule, for setting the timing of timer according to the transmission interval parameters of the multi-medium data；Submodule is gathered, for according to the timing, the periodically invoked FFMPEG increases income bank interface collection multimedia Data.
- 13. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is by processor Realized during execution such as the step of any one of claim 1-5 methods described.
- 14. a kind of computer equipment, including memory, processor and storage are on a memory and the meter that can run on a processor Calculation machine program, it is characterised in that realized during the computing device described program such as any one of claim 1-5 methods described Step.
- 15. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is by processor Realized during execution such as the step of any one of claim 6-7 methods described.
- 16. a kind of computer equipment, including memory, processor and storage are on a memory and the meter that can run on a processor Calculation machine program, it is characterised in that realized during the computing device described program such as any one of claim 6-7 methods described Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710892750.8A CN107613409A (en) | 2017-09-27 | 2017-09-27 | The processing method and processing device of multi-medium data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710892750.8A CN107613409A (en) | 2017-09-27 | 2017-09-27 | The processing method and processing device of multi-medium data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107613409A true CN107613409A (en) | 2018-01-19 |
Family
ID=61059138
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710892750.8A Withdrawn CN107613409A (en) | 2017-09-27 | 2017-09-27 | The processing method and processing device of multi-medium data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107613409A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769786A (en) * | 2018-05-25 | 2018-11-06 | 网宿科技股份有限公司 | A kind of method and apparatus of synthesis audio and video data streams |
| CN108900897A (en) * | 2018-07-09 | 2018-11-27 | 腾讯科技（深圳）有限公司 | A kind of multimedia data processing method, device and relevant device |
| CN108989824A (en) * | 2018-09-13 | 2018-12-11 | 北京知多星科技有限公司 | Video data restoration method, apparatus and video reduction apparatus |
| CN109885599A (en) * | 2019-02-22 | 2019-06-14 | 上海电气集团股份有限公司 | Real-time computing technique and system based on more equipment random ordering data |
| CN110659247A (en) * | 2018-06-13 | 2020-01-07 | 中国移动通信集团江西有限公司 | Method, device, equipment and medium for detecting continuity of call ticket file |
| CN112423018A (en) * | 2020-10-27 | 2021-02-26 | 深圳Tcl新技术有限公司 | Media file coding transmission method, device, equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090285217A1 (en) * | 2008-05-15 | 2009-11-19 | Verivue, Inc. | Statistical multiplexing of compressed video streams |
| CN102377985A (en) * | 2010-08-07 | 2012-03-14 | 浙江工业大学 | Media module of mobile video monitoring system |
| CN102932673A (en) * | 2011-08-11 | 2013-02-13 | 阿里巴巴集团控股有限公司 | Video signal and audio signal transmission and synthesis method, system and device |
| CN102932378A (en) * | 2012-11-28 | 2013-02-13 | 河海大学 | RTP (Real-time Transport Protocol)-based stream media transmission method in 3G network |
| CN103716318A (en) * | 2013-12-25 | 2014-04-09 | 杭州网新云视科技有限公司 | Method for improving display quality of virtual desktop by jointly using RFB coding and H.264 coding in cloud computing environment |
| CN105787463A (en) * | 2016-03-18 | 2016-07-20 | 哈尔滨工程大学 | Wi-Fi-based remote target tracking system and method |
-
2017
- 2017-09-27 CN CN201710892750.8A patent/CN107613409A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090285217A1 (en) * | 2008-05-15 | 2009-11-19 | Verivue, Inc. | Statistical multiplexing of compressed video streams |
| CN102377985A (en) * | 2010-08-07 | 2012-03-14 | 浙江工业大学 | Media module of mobile video monitoring system |
| CN102932673A (en) * | 2011-08-11 | 2013-02-13 | 阿里巴巴集团控股有限公司 | Video signal and audio signal transmission and synthesis method, system and device |
| CN102932378A (en) * | 2012-11-28 | 2013-02-13 | 河海大学 | RTP (Real-time Transport Protocol)-based stream media transmission method in 3G network |
| CN103716318A (en) * | 2013-12-25 | 2014-04-09 | 杭州网新云视科技有限公司 | Method for improving display quality of virtual desktop by jointly using RFB coding and H.264 coding in cloud computing environment |
| CN105787463A (en) * | 2016-03-18 | 2016-07-20 | 哈尔滨工程大学 | Wi-Fi-based remote target tracking system and method |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769786A (en) * | 2018-05-25 | 2018-11-06 | 网宿科技股份有限公司 | A kind of method and apparatus of synthesis audio and video data streams |
| WO2019223040A1 (en) * | 2018-05-25 | 2019-11-28 | 网宿科技股份有限公司 | Method and device for synthesizing audio and video data stream |
| CN108769786B (en) * | 2018-05-25 | 2020-12-29 | 网宿科技股份有限公司 | Method and device for synthesizing audio and video data streams |
| CN110659247A (en) * | 2018-06-13 | 2020-01-07 | 中国移动通信集团江西有限公司 | Method, device, equipment and medium for detecting continuity of call ticket file |
| CN108900897A (en) * | 2018-07-09 | 2018-11-27 | 腾讯科技（深圳）有限公司 | A kind of multimedia data processing method, device and relevant device |
| CN108900897B (en) * | 2018-07-09 | 2021-10-15 | 腾讯科技（深圳）有限公司 | Multimedia data processing method and device and related equipment |
| CN108989824A (en) * | 2018-09-13 | 2018-12-11 | 北京知多星科技有限公司 | Video data restoration method, apparatus and video reduction apparatus |
| CN109885599A (en) * | 2019-02-22 | 2019-06-14 | 上海电气集团股份有限公司 | Real-time computing technique and system based on more equipment random ordering data |
| CN112423018A (en) * | 2020-10-27 | 2021-02-26 | 深圳Tcl新技术有限公司 | Media file coding transmission method, device, equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107613409A (en) | The processing method and processing device of multi-medium data | |
| CN107135256A (en) | Bluetooth communication method, communicator, communication system and electronic equipment | |
| CN103888818B (en) | A kind of television program playing method, equipment and system | |
| TWI232658B (en) | Packet transmission method and system, base station, wireless LAN terminal, and wireless LAN system using the same | |
| CN106792262A (en) | Method of transmitting video data and device | |
| US7508815B2 (en) | Method and system for facilitating network troubleshooting | |
| CN103838552A (en) | System and method for processing multi-core parallel assembly line signals of 4G broadband communication system | |
| WO2001048980A1 (en) | Packet communication apparatus, packet communication method, and storage medium | |
| CN108200447A (en) | Live data transmission method, device, electronic equipment, server and storage medium | |
| CN104506287A (en) | Real-time sound communication method under TD-LTE (time division-long term evolution) emergency communication | |
| CN108877820B (en) | Audio data mixing method and device | |
| CN104917671A (en) | Mobile terminal based audio processing method and device | |
| CN100514955C (en) | Method for dynamically-controlling read time muttimedia data generation rate and its device | |
| CN111105778A (en) | Speech synthesis method, speech synthesis device, computing equipment and storage medium | |
| CN108738007B (en) | Audio transmission method, equipment and system | |
| CN109040777B (en) | A kind of Internet of Things broadcast audio transmission delay minishing method | |
| CN109688606A (en) | Data processing method, device, computer equipment and storage medium | |
| CN107430496A (en) | Frame is abandoned for long-range display | |
| CN105812439B (en) | A kind of audio frequency transmission method and device | |
| US20060203728A1 (en) | Method and system for transmission control protocol (TCP) traffic smoothing | |
| CN102833524B (en) | Control method for simultaneous picture recording on local audio and calling party audio | |
| US7668091B2 (en) | Program, storage medium, information transmission apparatus, and information transmission method | |
| WO2023217188A1 (en) | Livestream data transmission method, apparatus and system, device and medium | |
| CN109413492A (en) | Audio data reverberation processing method and system during a kind of live streaming | |
| CN111432384A (en) | Large data volume audio Bluetooth real-time transmission method for equipment with recording function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180119 |