CN110312159B - Signal receiving device, streaming media transmission system and streaming media transmission method - Google Patents
Signal receiving device, streaming media transmission system and streaming media transmission method Download PDFInfo
- Publication number
- CN110312159B CN110312159B CN201910439788.9A CN201910439788A CN110312159B CN 110312159 B CN110312159 B CN 110312159B CN 201910439788 A CN201910439788 A CN 201910439788A CN 110312159 B CN110312159 B CN 110312159B
- Authority
- CN
- China
- Prior art keywords
- played
- audio
- cache unit
- data
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 21
- 239000000872 buffer Substances 0.000 claims abstract description 116
- 238000004891 communication Methods 0.000 claims abstract description 82
- 230000003139 buffering effect Effects 0.000 abstract 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008054 signal transmission Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000004140 cleaning Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a signal receiving device, a streaming media transmission system and a streaming media transmission method, wherein the signal receiving device comprises a first communication module, a first buffer, a first HDMI interface and a first processor; the first processor comprises a first analysis module, a first clearing module and a first output module; the first buffer is used for buffering the audio to be played to a buffer unit and buffering the video to be played to the second buffer unit; the first analysis module is used for detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold value; if so, the first clearing module clears the first cache unit and the second cache unit; if not, sending the video to be played to the playing equipment electrically connected with the first HDMI interface of the signal receiving device.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a signal receiving apparatus, a streaming media transmission system, and a streaming media transmission method.
Background
The streaming media transmission technology transmits the content on one signal source device to another playing device for displaying and playing, for example: transmitting the video and audio played on the computer screen to the television for playing, transmitting and displaying the television screen to the television screen, and the like.
At present, the application is wider in places with content sharing requirements in the conference and education field, and because the streaming media transmission technology is influenced by time loss of actual networks and data processing, transmission delay can be generated in data transmission, and the delay shows that the playing progress at a data receiving end is slightly slower than that at a data sending end. If the network is affected by other factors such as signals to cause data jamming, the receiving progress of the data receiving end is far lower than the sending progress of the data sending end, after the signals are recovered to be normal, a large amount of audio and video data to be played are accumulated in a cache region of the data receiving end, the audio and video data of the receiving end and the sending end are asynchronous, the audio and video playing is asynchronous, and the user experience effect is reduced.
Disclosure of Invention
The invention mainly aims to provide a signal receiving device, a streaming media transmission system and a streaming media transmission method, and aims to solve the technical problem that data of an existing receiving end and an existing playing end are not synchronous.
In order to achieve the above object, the present invention provides a signal receiving apparatus, wherein the streaming media transmission system further includes a signal transmitting apparatus, the signal receiving apparatus is communicatively connected to the playing device through a transmission line, the signal transmitting apparatus is communicatively connected to the source device through a transmission line, and the signal receiving apparatus includes: the device comprises a first communication module, a first buffer, a first HDMI interface and a first processor;
the first processor comprises a first analysis module, a first clearing module and a first output module;
the first buffer acquires streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data;
the first buffer is also used for caching at least one data packet of the audio data to a first buffer unit of the first buffer as audio to be played and caching at least one data packet of the video data to a second buffer unit of the first buffer as video to be played;
the first analysis module is used for detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold value; if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, the first clearing module clears the first cache unit and the second cache unit;
if the storage amount of the audio to be played by the first cache unit is less than or equal to a first threshold value and the storage amount of the video to be played by the second cache unit is less than or equal to a second threshold value, the first output module controls the first cache unit to send the audio data to be played and controls the second cache unit to send the video data to be played to a playing device electrically connected with the first HDMI interface of the signal receiving device.
Preferably, the first communication module is a wireless communication module; the wireless communication frequency of the first communication module is 2.4GHz, 5.15-5.825 GHz or 60 GHz.
Preferably, the first output module includes a delay adjusting unit and an output control unit; the delay adjusting unit controls the first cache unit to send the audio to be played to the output control unit at a first time, and controls the second cache unit to send the audio to be played to the output control unit at a second time, wherein the first time is longer than the second time; and the output control unit outputs the audio to be played and the video to be played to a playing device electrically connected with the signal receiving device.
Preferably, the signal receiving device is further provided with an infrared receiver, and the infrared receiver is used for receiving an infrared remote control signal transmitted by the remote control device and converting the infrared remote control signal into an electric signal; the first processor transmits the electric signal to a first communication module so as to send the electric signal to a signal transmitting device through the first communication module.
In order to achieve the above object, the present invention further provides a streaming media transmission system, which includes a signal transmitting device and a signal receiving device, wherein the signal receiving device is in communication connection with the playing device through a transmission line, and the signal transmitting device is in communication connection with the information source device through a transmission line; the signal receiving apparatus includes: the device comprises a first communication module, a first buffer, a first HDMI interface and a first processor;
the first processor comprises a first analysis module, a first clearing module and a first output module;
the first buffer acquires streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data;
the first buffer is also used for caching at least one data packet of the audio data to a first buffer unit of the first buffer as audio to be played and caching at least one data packet of the video data to a second buffer unit of the first buffer as video to be played;
the first analysis module is used for detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold value; if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, the first clearing module clears the first cache unit and the second cache unit;
if the storage amount of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage amount of the video to be played in the second cache unit is less than or equal to a second threshold value, the first output module controls the first cache unit to send the audio data to be played and controls the second cache unit to send the video data to be played to a playing device electrically connected with the signal receiving device.
Preferably, the signal receiving device is further provided with an infrared receiver for receiving an infrared remote control signal of the remote control device and converting the infrared remote control signal into an electric signal; the first processor transmits the electric signal to a first communication module so as to send the electric signal to a signal transmitting device through the first communication module; the signal transmitting device comprises a second communication module, a second processor and an infrared transmitter; the second communication module receives the electric signal sent by the first communication module; the second processor restores the electric signal into an infrared remote control signal; and the infrared transmitter transmits the infrared remote control signal to the signal transmitting device so as to control the signal transmitting device to output corresponding streaming media data.
Preferably, the signal transmitting device further comprises a second buffer; the second processor comprises a second analysis module, a second clearing module and a second output module; the second buffer is used for acquiring streaming media data output from the source equipment, and the streaming media data comprises audio data and video data; the second buffer is also used for caching at least one data packet of the audio data to a third buffer unit of the second buffer as audio to be played and caching at least one data packet of the video data to a fourth buffer unit of the second buffer as video to be played; the second analysis module is used for detecting whether the storage capacity of the audio to be played in the third cache unit is greater than a third threshold value or whether the storage capacity of the video to be played in the fourth cache unit is greater than a fourth threshold value; if the storage capacity of the audio to be played in the third cache unit is greater than a third threshold value or the storage capacity of the video to be played in the fourth cache unit is greater than a fourth threshold value, the second clearing module clears the third cache unit and the fourth cache unit;
if the storage capacity of the audio to be played by the third cache unit is less than or equal to a third threshold value and the storage capacity of the video to be played by the fourth cache unit is less than or equal to a fourth threshold value, the second output module controls the second cache to send the streaming media data to the signal receiving device through the second communication module.
Preferably, the signal transmitting device further includes an encoding module, where the encoding module is configured to encode the video data output by the second buffer, and send the encoded video data to the signal receiving device through the second communication module;
the signal receiving device further comprises a decoding module, and the decoding module is used for decoding the video data to be played output by the second cache unit and outputting the decoded video data to the playing device.
In order to achieve the above object, the present invention further provides a streaming media transmission method, applied to a signal receiving apparatus, where the signal receiving apparatus is communicatively connected to a signal transmitting apparatus, and the method includes: acquiring streaming media data sent by a first communication module from the signal transmitting device, wherein the streaming media data comprises audio data and video data; caching at least one data packet of received audio data serving as audio to be played to a first cache unit, and caching at least one data packet of the video data serving as video to be played to a second cache unit; detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold; if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, emptying the first cache unit and the second cache unit; and if the storage capacity of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played in the second cache unit is less than or equal to a second threshold value, sending the audio to be played and the video to be played to a playing device electrically connected with the signal receiving device.
Preferably, the audio to be played is sent to the playing device at a first time, and the data packet to be played corresponding to the audio to be played is sent to the playing device at a second time, where the first time is greater than the second time.
Compared with the existing design, the invention provides a signal receiving device, a streaming media transmission system and a streaming media transmission method. The signal transmission system comprises a signal transmitting device and a signal receiving device which is in communication connection with the signal transmitting device, wherein the signal transmitting device is connected with the information source equipment and is used for transmitting the streaming media data output by the information source equipment to the signal receiving device, and the streaming media data comprises video data and audio data. The signal receiving device respectively stores the received audio data and video data in the first buffer unit and the second buffer unit, and respectively outputs the audio data and the video data to the playing device through the first buffer unit and the second buffer unit so as to play the streaming media data in the playing device.
When the audio data in the first cache unit exceeds a first threshold value or the video data in the second cache unit exceeds a second threshold value, the audio data in the first cache unit and the video data in the second cache unit are synchronously cleared, so that the synchronism of the audio data and the video data is ensured, and the problem that the signal receiving device is blocked when the streaming media data is played by the playing equipment due to the transmission delay of the streaming media data is effectively solved. Meanwhile, the audio data and the video data are respectively cached, the caching time delay of the audio data and the video data is respectively detected, and when the caching capacity of either the audio data or the video data exceeds a threshold value, the audio data in the first caching unit and the video data in the second caching unit are synchronously cleared, so that the output synchronism of the audio data output by the first caching unit and the video data output by the second caching unit is ensured, and the problem of time delay and pause of streaming media transmission is solved.
Furthermore, the time of the audio data output by the first buffer unit is controlled to be later than the time of the video data corresponding to the audio data, so that the problem that the audio and video data are not synchronous at the playing equipment end due to the fact that the decoding time of the audio data and the decoding time of the video data are not uniform can be solved.
Drawings
Fig. 1 is a block diagram of a streaming media transmission system according to a first embodiment of the present invention;
fig. 2 is a block diagram of a signal receiving apparatus and a playing device of a streaming media transmission system according to the present invention;
FIG. 3 is a block diagram of a first buffer of the signal receiving apparatus;
FIG. 4 is a unit frame diagram of a first output module of the first processor;
fig. 5 is a block diagram of a signal transmitting apparatus and a source device of a streaming media transmission system according to the present invention;
fig. 6 is a flowchart illustrating steps of a streaming media transmission method according to a second embodiment of the present invention;
fig. 7 is a block diagram of a signal receiving apparatus according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that the descriptions relating to "first", "second", etc. in the present invention are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicit indication of the amount of storage of the technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
The invention provides a signal receiving device, a streaming media transmission system and a streaming media transmission method. The signal transmission system comprises a signal transmitting device and a signal receiving device which is in communication connection with the signal transmitting device, wherein the signal transmitting device is connected with the information source equipment and is used for transmitting the streaming media data output by the information source equipment to the signal receiving device, and the streaming media data comprises video data and audio data. The signal receiving device respectively stores the received audio data and video data in the first buffer unit and the second buffer unit, and respectively outputs the audio data and the video data to the playing device through the first buffer unit and the second buffer unit so as to play the streaming media data in the playing device.
When the audio data in the first cache unit exceeds a first threshold value or the video data in the second cache unit exceeds a second threshold value, the audio data in the first cache unit and the video data in the second cache unit are synchronously cleared, so that the synchronism of the audio data and the video data is ensured, and the problem that the signal receiving device is blocked when the streaming media data is played by the playing equipment due to the transmission delay of the streaming media data is effectively solved. Meanwhile, the audio data and the video data are respectively cached, the caching time delay of the audio data and the video data is respectively detected, and when the caching capacity of either the audio data or the video data exceeds a threshold value, the audio data in the first caching unit and the video data in the second caching unit are synchronously cleared, so that the output synchronism of the audio data output by the first caching unit and the video data output by the second caching unit is ensured, and the problem of time delay and pause of streaming media transmission is solved.
Furthermore, the time of the audio data output by the first buffer unit is controlled to be later than the time of the video data corresponding to the audio data, so that the problem that the audio and video data are not synchronous at the playing equipment end due to the fact that the decoding time of the audio data and the decoding time of the video data are not uniform can be solved.
Referring to fig. 1, fig. 1 is a flow media transmission system 100 according to an embodiment of the present invention, the flow media transmission system 100 includes a signal receiving device 10 and a signal transmitting device 20. The signal receiving device 10 and the playing device 50 are connected in communication through a transmission line, so as to realize the transmission of signals between the signal receiving device 10 and the playing device 50. The signal transmitting apparatus 20 is communicatively connected to the source device 30 through a transmission line for receiving the streaming media data output by the source device 30 and transmitting the streaming media data to the signal receiving apparatus 10 through wireless communication, so that the signal receiving apparatus 10 outputs the streaming media data to the playing device 50 for playing. The streaming media data comprises video data and audio data, and the audio data and the video data are transmitted in the form of data packets when being transmitted, wherein the size of the data packets of the audio data and the size of the data packets of the video data can be set according to needs. Preferably, the data packet of the audio data is smaller than or equal to the audio to be played, and the data packet of the video data is smaller than or equal to the video to be played.
Preferably, the video data is high definition video data, i.e. the video data has a resolution of at least 480p and a frame rate of at least 24 fps.
Referring to fig. 2-4, in particular, the signal receiving apparatus 10 includes a first HDMI interface 102, a first buffer 106, a first communication module 103, and a first processor 104. The first processor 104 is electrically connected to the first HDMI interface 102, the first buffer 106, and the first communication module 103, so that the first HDMI interface 102, the first buffer 106, and the first communication module 103 cooperate with each other.
The first HDMI interface 102 is connected to the playback device 50 through a transmission line connection, so that the signal receiving apparatus 10 and the playback device 50 are communicatively connected, and the video signal received by the signal receiving apparatus 10 is output to the playback device 50, thereby playing the video signal on the playback device 50.
The first communication module 103 is preferably a wireless communication module for performing wireless communication connection with the signal transmitting device 20, and preferably, the wireless communication frequency of the first communication module is 2.4GHz, 5.15 to 5.825GHz, or 60 GHz.
The first processor 104 includes a first analysis module 1043, a first cleaning module 1044, and a first output module 1045.
The first buffer 106 is configured to obtain streaming media data sent by the first communication module 103 from the signal transmitting apparatus 20.
Specifically, the first buffer 106 includes a first buffer unit 1061 and a second buffer unit 1063, and the first buffer 106 is configured to buffer at least one data packet of the received audio data as the audio to be played to the first buffer unit 1061 of the first buffer, and buffer at least one data packet of the video data as the video to be played to the second buffer unit 1063 of the first buffer 106.
The first analysis module 1043 is configured to detect whether the storage amount of the audio to be played in the first cache unit 1061 is greater than a first threshold or whether the storage amount of the video to be played in the second cache unit 1063 is greater than a second threshold.
If the storage amount of the audio to be played in the first buffer unit 1061 is greater than a first threshold or the storage amount of the video to be played in the second buffer unit 1063 is greater than a second threshold, the first clearing module 1044 empties the first buffer unit 1061 and the second buffer unit 1063, so as to avoid data accumulation in any one of the first buffer unit 1061 or the second buffer unit 1063, and avoid asynchronous output of the audio data and the video data of the signal receiving apparatus 10.
If the storage amount of the audio to be played in the first buffer unit 1061 is less than or equal to the first threshold and the storage amount of the video to be played in the second buffer unit 1063 is less than or equal to the second threshold, the first output module 1045 controls the first buffer unit 1061 to send the audio to be played and controls the second buffer unit 1063 to send the video to be played to the playing device 50 electrically connected to the signal receiving apparatus 10, so that the playing device 50 plays the corresponding data packet and data packet with playing.
The first output module 1045 includes a delay adjusting unit 10451 and an output control unit 10453. The delay adjustment unit 10451 controls the first buffer unit 1061 to send the audio to be played to the output control unit 10453 at the first time t1, and controls the second buffer unit 1063 to send the audio to be played to the output control unit 10453 at the second time t2, where the first time t1 is greater than the second time t 2.
The output control unit 10453 outputs the audio to be played and the video to be played to the playback device 50 electrically connected to the signal reception apparatus 10, and the playback device 50 is electrically connected to the signal reception apparatus 10 through the HDMI interface 102.
The time of the audio data output by the first buffer unit is controlled to be later than the time of the video data corresponding to the audio data, so that the problem that the data is not synchronous at the playing equipment end due to the fact that the decoding time of the audio data and the decoding time of the video data are not uniform can be avoided.
Referring to fig. 5, the signal transmitting apparatus 20 includes a second communication module 201, a second processor 202, a second HDMI interface 203, and a second buffer 205. The second processor 202 is electrically connected to the second communication module 201 and the second HDMI interface 203 to control the second communication module 201 and the second HDMI interface 203 to work cooperatively.
The second communication module 201 is preferably a wireless communication module, and is configured to perform wireless communication connection with the signal receiving apparatus 10, so that the signal output by the signal source device 30 can be sent to the signal receiving apparatus 10 through wireless transmission, and the problem of space limitation of the wired transmission mode of the conventional signal source device and the conventional playing device is effectively solved.
The second HDMI interface 203 is connected to the source device 30 through a transmission line connection, so that the source device 30 and the signal transmission apparatus 20 are communicatively connected and can output a video signal to the signal transmission apparatus 20. The signal transmitting device 20 forwards the received video signal to the signal receiving device 10, so that the signal receiving device 10 outputs the video signal to the playing device 50, thereby playing the video signal.
The second buffer 205 is configured to receive the streaming media data sent by the source device 30, and send the streaming media data to the signal receiving apparatus 10 through the second communication module 201, so that the signal receiving apparatus 10 outputs the streaming media data to the playing device 50.
Referring to fig. 2 and 5 again, in some embodiments, the signal receiving apparatus 10 further includes an infrared receiver 105, and the infrared receiver 105 is configured to receive an infrared remote control signal transmitted by a remote control apparatus adapted to the source device 30 and convert the infrared remote control signal into an electrical signal, which is preferably a pulse electrical signal. Meanwhile, the first processor 104 controls the infrared receiver 105 to transmit the electrical signal converted from the infrared remote control signal to the first communication module 103, so as to transmit the electrical signal to the signal transmitting apparatus 20 through the first communication module 103, so that the signal transmitting apparatus 20 restores the electrical signal into the infrared remote control signal and transmits the infrared remote control signal to the source device 30, so that the source device 30 outputs corresponding streaming media data according to the infrared remote control signal.
The signal emitting device 20 further includes an infrared emitter 204 electrically connected to the second processor 202. The infrared transmitter 204 is configured to restore the electrical signal converted from the received infrared remote control signal sent by the remote control device to an infrared remote control signal, and transmit the infrared remote control signal to the source device 30, so as to control the source device 30 to output corresponding streaming media data according to the infrared remote control signal, thereby implementing remote switching control on the output signal of the source device 30.
In some embodiments, the streaming media data includes video data and audio data, the video data includes a plurality of packets, the data includes a plurality of packets, and the second buffer 205 includes a third buffer unit and a fourth buffer unit. The second buffer 205 buffers at least one packet of the received audio data as an audio to be played to the third buffer unit, and buffers at least one packet of the video data as a video to be played to the fourth buffer unit.
The second processor 202 further includes a second analysis module 2021, a second cleaning module 2022, and a second output module 2023. The second analysis module 2021 is configured to detect whether the storage amount of the audio to be played in the third cache unit is greater than a third threshold or whether the storage amount of the video to be played in the fourth cache unit is greater than a fourth threshold.
If the storage amount of the audio to be played in the third buffer unit is greater than the third threshold or the storage amount of the video to be played in the fourth buffer unit is greater than the fourth threshold, the second clearing module 2022 clears the data cached in the third buffer unit and the fourth buffer unit, that is, synchronously clears the audio data in the third buffer unit and the video data in the fourth buffer unit to ensure the synchronism of the audio data and the video data, so as to effectively solve the transmission delay of the streaming media data of the signal transmitting apparatus 20, and ensure that the streaming media data is synchronously transmitted to the signal receiving apparatus 10, so as to reduce the phenomenon that the audio signal and the video signal at the playing end are not synchronous.
If the storage amount of the audio to be played in the third buffer unit is less than or equal to the third threshold and the storage amount of the video to be played in the fourth buffer unit is less than or equal to the fourth threshold, the second output module 2023 controls the second buffer 205 to send the buffered streaming media data to the signal receiving apparatus 10 through the second communication module 201.
By arranging a buffer clearing mechanism of audio data and video data at both the signal transmitting device 20 and the signal receiving device 10, the audio and video synchronization of the streaming media transmission system can be better ensured.
In some embodiments, the signal transmitting apparatus 10 further includes an encoding module, which is configured to encode video data and/or audio data in the streaming media data output by the second buffer 205, and send the encoded audio and video data to the signal receiving apparatus 10 through the second communication module 201. The encoding standard of the video data may be h.261, h.263, or h.264, among others.
The signal receiving apparatus 10 further includes a decoding module, and the decoding module is configured to decode the audio data output by the first buffer unit 1061 of the first buffer 106 and/or decode the video data to be played output by the second buffer unit, and output the decoded audio and/or video data to the playing device.
Referring to fig. 6, fig. 6 is a streaming media transmission method provided in an embodiment of the present invention, the streaming media transmission method is applied to a signal receiving apparatus 10 of a streaming media transmission system 100, the streaming media transmission system 100 further includes a signal transmitting apparatus 20, the signal transmitting apparatus 20 is in communication connection with a corresponding playing device 50 through a transmission line, the signal transmitting apparatus 20 is in communication connection with a source device 30 through a transmission line, the signal receiving apparatus 10 is provided with a first communication module 103, and the streaming media transmission method includes steps S101 to S105:
step S101: and acquiring streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data.
The signal transmitting apparatus 20 is communicatively connected to the source device 30, the source device 30 outputs streaming media data to the signal transmitting apparatus 20, and the signal transmitting apparatus 20 transmits the streaming media data to the signal receiving apparatus 10 through the second communication module 201. The signal receiving apparatus 10 receives streaming media data sent by the second communication module 201 through the first communication module 103, where the streaming media data includes video data and audio data.
The first communication module 103 and the second communication module 201 are preferably wireless communication modules.
Step S102: and caching at least one data packet of the received audio data serving as an audio to be played to a first cache unit, and caching at least one data packet of the video data serving as a video to be played to a second cache unit.
The data comprises a plurality of data packets, the video data comprises a plurality of data packets, the signal receiving device 10 buffers at least one data packet of the received audio data as the audio to be played to a first buffer unit of a first buffer, and buffers at least one data packet of the video data as the video to be played to a second buffer unit of the first buffer
Step S103: and detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold.
Step S104: and if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, emptying the first cache unit and the second cache unit.
Step S105: and if the storage capacity of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played in the second cache unit is less than or equal to a second threshold value, sending the audio to be played and the video to be played to a playing device electrically connected with the signal receiving device.
Preferably, the signal receiving apparatus 10 controls the audio to be played to be sent to the playing device at a first time, and controls the data packet to be played corresponding to the audio to be played to be sent to the playing device at a second time, where the first time is greater than the second time.
Referring to fig. 7, in some embodiments, the invention further provides a signal receiving apparatus 10, which includes a first communication module 103, a first HDMI interface 102, a first memory 105, a first processor 104, and a first bus 106. The first communication module 103, the first HDMI interface 102, and the first memory 105 are connected to the first processor 104 through a first bus 106.
The first memory 105 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. The first memory 105 is used for storing a computer-readable streaming media transmission method program.
The first processor 104, which may be a Central Processing Unit (CPU), a controller, a microcontroller, a microprocessor or other data Processing chip, may call the program codes stored in the first memory 105 or process data to implement the following steps:
acquiring streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data;
caching at least one data packet of received audio data serving as audio to be played to a first cache unit, and caching at least one data packet of the video data serving as video to be played to a second cache unit;
detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold;
and if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, emptying the first cache unit and the second cache unit.
And if the storage capacity of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played in the second cache unit is less than or equal to a second threshold value, sending the audio to be played and the video to be played to a playing device electrically connected with the signal receiving device.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (8)
1. A signal receiving device is applied to a streaming media transmission system, and is characterized in that the streaming media transmission system further comprises a signal transmitting device, the signal receiving device is in communication connection with a playing device through a transmission line, the signal transmitting device is in communication connection with an information source device through the transmission line, and the signal receiving device comprises a first communication module, a first buffer, a first HDMI interface and a first processor;
the first processor comprises a first analysis module, a first clearing module and a first output module;
the first buffer acquires streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data, the resolution of the video data is at least 480p, and the frame rate is at least 24 fps;
the first buffer is also used for caching at least one data packet of the audio data to a first buffer unit of the first buffer as audio to be played and caching at least one data packet of the video data to a second buffer unit of the first buffer as video to be played;
the first analysis module is used for detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold value;
if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, the first clearing module clears the first cache unit and the second cache unit;
if the storage capacity of the audio to be played by the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played by the second cache unit is less than or equal to a second threshold value, the first output module controls the first cache unit to send the audio data to be played and controls the second cache unit to send the video data to be played to a playing device electrically connected with a first HDMI interface of the signal receiving device;
the first output module comprises a delay adjusting unit and an output control unit;
the delay adjusting unit controls the first cache unit to send the audio to be played to the output control unit at a first time, and controls the second cache unit to send the audio to be played to the output control unit at a second time, wherein the first time is longer than the second time;
and the output control unit outputs the audio data to be played and the video data to be played to a playing device electrically connected with the signal receiving device.
2. The signal receiving apparatus of claim 1, wherein: the first communication module is a wireless communication module;
the wireless communication frequency of the first communication module is 2.4GHz, 5.15-5.825 GHz or 60 GHz.
3. The signal receiving apparatus of claim 1, wherein: the signal receiving device is also provided with an infrared receiver, and the infrared receiver is used for receiving an infrared remote control signal transmitted by the remote control device and converting the infrared remote control signal into an electric signal;
the first processor transmits the electric signal to a first communication module so as to send the electric signal to a signal transmitting device through the first communication module.
4. A streaming media transmission system is characterized by comprising a signal transmitting device and a signal receiving device, wherein the signal receiving device is in communication connection with a playing device through a transmission line, and the signal transmitting device is in communication connection with a source device through the transmission line;
the signal receiving apparatus includes: the device comprises a first communication module, a first buffer, a first HDMI interface and a first processor;
the first processor comprises a first analysis module, a first clearing module and a first output module;
the first buffer is used for acquiring streaming media data which is received by the first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data, the resolution of the video data is at least 480p, and the frame rate is at least 24 fps;
the first buffer is also used for caching at least one data packet of the audio data to a first buffer unit of the first buffer as audio to be played and caching at least one data packet of the video data to a second buffer unit of the first buffer as video to be played;
the first analysis module is used for detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold value; if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, the first clearing module clears the first cache unit and the second cache unit;
if the storage capacity of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played in the second cache unit is less than or equal to a second threshold value, the first output module controls the first cache unit to send the audio data to be played and controls the second cache unit to send the video data to be played to a playing device electrically connected with the signal receiving device;
the first output module comprises a delay adjusting unit and an output control unit;
the delay adjusting unit controls the first cache unit to send the audio to be played to the output control unit at a first time, and controls the second cache unit to send the audio to be played to the output control unit at a second time, wherein the first time is longer than the second time;
and the output control unit outputs the audio data to be played and the video data to be played to a playing device electrically connected with the signal receiving device.
5. The streaming media transmission system of claim 4, wherein:
the signal receiving device is also provided with an infrared receiver which is used for receiving an infrared remote control signal of the remote control device and converting the infrared remote control signal into an electric signal;
the first processor transmits the electric signal to a first communication module so as to send the electric signal to a signal transmitting device through the first communication module;
the signal transmitting device comprises a second communication module, a second processor and an infrared transmitter;
the second communication module receives the electric signal sent by the first communication module;
the second processor restores the electric signal into an infrared remote control signal;
and the infrared transmitter transmits the infrared remote control signal to the signal transmitting device so as to control the signal transmitting device to output corresponding streaming media data.
6. The streaming media transmission system of claim 5, wherein: the signal transmitting device also comprises a second buffer;
the second processor comprises a second analysis module, a second clearing module and a second output module;
the second buffer is used for acquiring streaming media data output from the source equipment, and the streaming media data comprises audio data and video data;
the second buffer is also used for caching at least one data packet of the audio data to a third buffer unit of the second buffer as audio to be played and caching at least one data packet of the video data to a fourth buffer unit of the second buffer as video to be played;
the second analysis module is used for detecting whether the storage capacity of the audio to be played in the third cache unit is greater than a third threshold value or whether the storage capacity of the video to be played in the fourth cache unit is greater than a fourth threshold value; if the storage capacity of the audio to be played in the third cache unit is greater than a third threshold value or the storage capacity of the video to be played in the fourth cache unit is greater than a fourth threshold value, the second clearing module clears the third cache unit and the fourth cache unit;
if the storage capacity of the audio to be played by the third cache unit is less than or equal to a third threshold value and the storage capacity of the video to be played by the fourth cache unit is less than or equal to a fourth threshold value, the second output module controls the second cache to send the streaming media data to the signal receiving device through the second communication module.
7. The streaming media transmission system of claim 6, wherein: the signal transmitting device also comprises an encoding module, wherein the encoding module is used for encoding the video data output by the second buffer and sending the encoded video data to the signal receiving device through the second communication module;
the signal receiving device further comprises a decoding module, and the decoding module is used for decoding the video data to be played output by the second cache unit and outputting the decoded video data to the playing device.
8. A streaming media transmission method is applied to a signal receiving device, wherein the signal receiving device is connected with a signal transmitting device in a communication manner, and the method comprises the following steps:
acquiring streaming media data which is received by a first communication module and sent from the signal transmitting device, wherein the streaming media data comprises audio data and video data, the resolution of the video data is at least 480p, and the frame rate is at least 24 fps;
caching at least one data packet of received audio data serving as audio to be played to a first cache unit, and caching at least one data packet of the video data serving as video to be played to a second cache unit;
detecting whether the storage capacity of the audio to be played in the first cache unit is greater than a first threshold or whether the storage capacity of the video to be played in the second cache unit is greater than a second threshold;
if the storage capacity of the audio to be played in the first cache unit is greater than a first threshold value or the storage capacity of the video to be played in the second cache unit is greater than a second threshold value, emptying the first cache unit and the second cache unit;
if the storage capacity of the audio to be played in the first cache unit is less than or equal to a first threshold value and the storage capacity of the video to be played in the second cache unit is less than or equal to a second threshold value, sending the audio data to be played and the video data to be played to a playing device electrically connected with the signal receiving device;
the audio to be played is sent to the playing device at a first time, the data packet to be played corresponding to the audio to be played is sent to the playing device at a second time, and the first time is longer than the second time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910439788.9A CN110312159B (en) | 2019-05-24 | 2019-05-24 | Signal receiving device, streaming media transmission system and streaming media transmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910439788.9A CN110312159B (en) | 2019-05-24 | 2019-05-24 | Signal receiving device, streaming media transmission system and streaming media transmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110312159A CN110312159A (en) | 2019-10-08 |
| CN110312159B true CN110312159B (en) | 2022-03-11 |
Family
ID=68074968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910439788.9A Active CN110312159B (en) | 2019-05-24 | 2019-05-24 | Signal receiving device, streaming media transmission system and streaming media transmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110312159B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8843990B1 (en) * | 2002-04-25 | 2014-09-23 | Visible World, Inc. | System and method for optimized channel switching in digital television broadcasting |
| CN104113777A (en) * | 2014-08-01 | 2014-10-22 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| CN104780422A (en) * | 2014-01-13 | 2015-07-15 | 北京兆维电子(集团)有限责任公司 | Streaming media playing method and streaming media player |
| CN104869461A (en) * | 2015-05-22 | 2015-08-26 | 南京创维信息技术研究院有限公司 | Video data processing system and method |
| CN105611309A (en) * | 2015-12-22 | 2016-05-25 | 北京奇虎科技有限公司 | Video transmission method and device |
| CN105744334A (en) * | 2016-02-18 | 2016-07-06 | 海信集团有限公司 | Method and equipment for audio and video synchronization and synchronous playing |
| CN106792073A (en) * | 2016-12-29 | 2017-05-31 | 北京奇艺世纪科技有限公司 | Method, playback equipment and system that the audio, video data of striding equipment is synchronously played |
| CN107483976A (en) * | 2017-09-26 | 2017-12-15 | 武汉斗鱼网络科技有限公司 | Live management-control method, device and electronic equipment |
| CN107517400A (en) * | 2016-06-15 | 2017-12-26 | 成都鼎桥通信技术有限公司 | Flow media playing method and DST PLAYER |
| CN107770597A (en) * | 2017-09-28 | 2018-03-06 | 北京小鸟科技股份有限公司 | Audio and video synchronization method and device |
| CN108012177A (en) * | 2017-12-01 | 2018-05-08 | 晨星半导体股份有限公司 | The playback method of audio-video frequency playing system and the voice data being applied thereon |
| CN109587551A (en) * | 2017-09-29 | 2019-04-05 | 北京金山云网络技术有限公司 | A kind of judgment method, device, equipment and the storage medium of live streaming media Caton |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010076846A1 (en) * | 2008-12-29 | 2010-07-08 | パナソニック株式会社 | Recording medium, reproduction device, and integrated circuit |
-
2019
- 2019-05-24 CN CN201910439788.9A patent/CN110312159B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8843990B1 (en) * | 2002-04-25 | 2014-09-23 | Visible World, Inc. | System and method for optimized channel switching in digital television broadcasting |
| CN104780422A (en) * | 2014-01-13 | 2015-07-15 | 北京兆维电子(集团)有限责任公司 | Streaming media playing method and streaming media player |
| CN104113777A (en) * | 2014-08-01 | 2014-10-22 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| CN104869461A (en) * | 2015-05-22 | 2015-08-26 | 南京创维信息技术研究院有限公司 | Video data processing system and method |
| CN105611309A (en) * | 2015-12-22 | 2016-05-25 | 北京奇虎科技有限公司 | Video transmission method and device |
| CN105744334A (en) * | 2016-02-18 | 2016-07-06 | 海信集团有限公司 | Method and equipment for audio and video synchronization and synchronous playing |
| CN107517400A (en) * | 2016-06-15 | 2017-12-26 | 成都鼎桥通信技术有限公司 | Flow media playing method and DST PLAYER |
| CN106792073A (en) * | 2016-12-29 | 2017-05-31 | 北京奇艺世纪科技有限公司 | Method, playback equipment and system that the audio, video data of striding equipment is synchronously played |
| CN107483976A (en) * | 2017-09-26 | 2017-12-15 | 武汉斗鱼网络科技有限公司 | Live management-control method, device and electronic equipment |
| CN107770597A (en) * | 2017-09-28 | 2018-03-06 | 北京小鸟科技股份有限公司 | Audio and video synchronization method and device |
| CN109587551A (en) * | 2017-09-29 | 2019-04-05 | 北京金山云网络技术有限公司 | A kind of judgment method, device, equipment and the storage medium of live streaming media Caton |
| CN108012177A (en) * | 2017-12-01 | 2018-05-08 | 晨星半导体股份有限公司 | The playback method of audio-video frequency playing system and the voice data being applied thereon |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110312159A (en) | 2019-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1717935B (en) | I-picture insertion on request | |
| KR101330907B1 (en) | Method for reducing channel change times in a digital video apparatus | |
| JP2003046582A (en) | Video signal encoder, video signal decoder and video transmission system | |
| US8473992B2 (en) | Multichannel data transfer apparatus and its method | |
| JP2003069472A (en) | Reception terminal device and communication system | |
| JP2004529553A (en) | Adaptive bandwidth footprint matching for multiple compressed video streams in fixed bandwidth networks | |
| KR20070059053A (en) | Home network system with transmission error recovery | |
| JPH0888653A (en) | Method and apparatus for transmitting video bit stream | |
| KR20110124161A (en) | Method and apparatus for transmitting and receiving layered coded video | |
| EP2058968A1 (en) | Method and apparatus for FEC encoding and decoding | |
| CN104918123A (en) | Method and system for playback of motion video | |
| EP1679895A1 (en) | Medium signal transmission method, reception method, transmission/reception method, and device | |
| CN111866526B (en) | Live broadcast service processing method and device | |
| CN109862400B (en) | Streaming media transmission method, device and system | |
| US6061403A (en) | Computer program product for selectively reducing bandwidth of real-time video data | |
| CN110312159B (en) | Signal receiving device, streaming media transmission system and streaming media transmission method | |
| US20120154678A1 (en) | Receiving device, screen frame transmission system and method | |
| US8095955B2 (en) | Methods and systems for improving network response during channel change | |
| JP3351855B2 (en) | Coded transmission device | |
| JP4491918B2 (en) | Data distribution apparatus and method, data distribution system | |
| KR101583081B1 (en) | Simplified transmission method for a stream of signals between a transmitter and an electornic device | |
| CN201123043Y (en) | Household wireless multimedia game system | |
| CN110798713B (en) | Time-shifted television on-demand method, terminal, server and system | |
| EP2417766A1 (en) | Method and apparatus for asynchronous video transmission over a communication network | |
| CN115734004A (en) | Video processing method, device, system and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |