CN115802087B - Sound and picture synchronous processing method and related equipment thereof - Google Patents
Sound and picture synchronous processing method and related equipment thereof Download PDFInfo
- Publication number
- CN115802087B CN115802087B CN202211368593.8A CN202211368593A CN115802087B CN 115802087 B CN115802087 B CN 115802087B CN 202211368593 A CN202211368593 A CN 202211368593A CN 115802087 B CN115802087 B CN 115802087B
- Authority
- CN
- China
- Prior art keywords
- audio
- playing
- signal
- time point
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 17
- 230000005236 sound signal Effects 0.000 claims abstract description 132
- 238000000034 method Methods 0.000 claims abstract description 85
- 230000008569 process Effects 0.000 claims abstract description 58
- 230000015654 memory Effects 0.000 claims description 16
- 230000002085 persistent effect Effects 0.000 claims description 3
- 230000006403 short-term memory Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000000638 solvent extraction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 102100024044 Aprataxin Human genes 0.000 description 1
- 101000757586 Homo sapiens Aprataxin Proteins 0.000 description 1
- 101150036464 aptx gene Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the application discloses a sound and picture synchronous processing method which is applied to video and audio playing equipment with external audio playing equipment and comprises the following steps: sending a target sound signal playing instruction; playing the target sound signal through the internal audio playing structure, and sending out a first audio signal; playing the target sound signal through external audio playing equipment, and sending out a second audio signal; receiving a first audio signal and recording the receiving time as a first time point; receiving a second audio signal and recording the receiving time as a second time point; and performing audio-video synchronization adjustment based on the difference between the first time point and the second time point. By the method, the audio-video delay condition of the external audio playing device is adjusted, the consistency of audio signals and video signals output by the external audio playing device and the video-audio playing device in the using process is ensured, and the listening experience of a user is improved.
Description
Technical Field
The application belongs to the field of data processing, and particularly relates to a sound and picture synchronous processing method and related equipment thereof.
Background
Television (Television, TV) refers to a device that uses electronic technology to transmit moving picture and audio signals, i.e., a television receiver, and is also an important broadcasting and video communication tool. Television is used as a common audio-visual device, and the most common scene is to allow a user to watch and listen simultaneously by outputting images and sounds. Thus, the image and sound need to be output synchronously to give the user a better use experience.
When the television is used, the television can be matched with external audio playing equipment, such as HDMI audio output, optical fiber audio output, bluetooth audio output and the like, the audio of the television is output to the external audio equipment through different channels, and the corresponding audio is played by the external audio playing equipment.
However, after the processing of the external audio device, the time difference between the audio played by the external device and the image and audio played by the television itself becomes large. Taking bluetooth audio output as an example, when bluetooth audio is transmitted, audio is encoded first, then transmitted to a bluetooth audio playing device end through bluetooth, and then decoded and played. Due to these factors, the audio playing process of the bluetooth device generally generates a high delay, which causes the problem of asynchronous audio and video.
Disclosure of Invention
An embodiment of the present application provides a method for synchronously processing audio and video, where the method is applied to an audio and video playing device with an external audio playing device, and includes:
transmitting a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time;
Playing the target sound signal through the internal audio playing structure, and sending out a first audio signal;
playing the target sound signal through the external audio playing device, and sending out a second audio signal;
receiving the first audio signal and recording the receiving time as a first time point;
receiving the second audio signal and recording the receiving time as a second time point;
And carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point.
According to the audio and video synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the audio and video playing device is a television device.
According to the audio-visual synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the receiving the first audio signal includes:
receiving the first audio signal through a microphone;
The receiving the second audio signal includes:
the second audio signal is received by the microphone.
According to the method for processing synchronization of audio and video provided in the first aspect of the embodiment of the present application, optionally, the adjusting the synchronization of audio and video based on the difference between the first time point and the second time point includes:
Judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
If the difference value is larger than a preset value, carrying out the process of synchronous adjustment of the sound and the picture;
and if the difference value is smaller than or equal to the preset value, not performing the process of synchronous adjustment of the sound and the picture.
According to the audio-visual synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the audio-visual synchronization adjustment process includes:
And increasing the signal delay of the difference time length for the local signal processing process of the video and audio playing equipment, wherein the difference time length is equal to the difference value between the first time point and the second time point.
According to the method for processing synchronization of audio and video provided in the first aspect of the embodiment of the present application, optionally, the process of adjusting synchronization of audio and video includes:
and adjusting the audio decoding mode of the external audio playing device.
According to the audio and video synchronization processing method provided in the first aspect of the embodiment of the present application, optionally, the microphone is disposed on a control device of the audio and video playing device.
A second aspect of the present application provides a sound and picture synchronization processing device, where the device is used in association with a video and audio playing device including an external audio playing device, and the device includes:
The sending unit is used for sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time;
the first audio playing unit is used for playing the target sound signal through the internal audio playing structure and sending out a first audio signal;
The second audio playing unit is used for playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
a first receiving unit, configured to receive the first audio signal, and record a receiving time as a first time point;
A second receiving unit, configured to receive the second audio signal, and record a receiving time as a second time point;
and the adjusting unit is used for carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point.
Based on the audio and video synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the audio and video playing device is a television device.
Based on the audio-visual synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the first receiving unit is specifically configured to: receiving the first audio signal through a microphone;
the second receiving unit is specifically configured to: the second audio signal is received by the microphone.
Based on the audio-visual synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
Judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
If the difference value is larger than a preset value, carrying out the process of synchronous adjustment of the sound and the picture;
and if the difference value is smaller than or equal to the preset value, not performing the process of synchronous adjustment of the sound and the picture.
Based on the audio-visual synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
And increasing the signal delay of the difference time length for the local signal processing process of the video and audio playing equipment, wherein the difference time length is equal to the difference value between the first time point and the second time point.
Based on the audio-visual synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the adjusting unit is specifically configured to:
and adjusting the audio decoding mode of the external audio playing device.
Based on the audio and video synchronization processing device provided in the second aspect of the embodiment of the present application, optionally, the microphone is disposed on a control device of the audio and video playing device.
A third aspect of an embodiment of the present application provides an audio/video playing apparatus, including:
a processor, a memory, an internal audio playing structure, an external audio playing device;
the memory is a short-term memory or a persistent memory;
The processor is configured to communicate with the memory and control the internal audio playback structure and the external audio playback device on the audiovisual playback device to perform the instruction operations in the memory to perform the method according to any one of the first aspect of the embodiments of the application.
A fourth aspect of the embodiments of the present application provides a computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform a method according to any one of the first aspect of the embodiments of the present application.
From the above technical solutions, the embodiment of the present application has the following advantages: the embodiment of the application provides a sound and picture synchronous processing method, which is applied to a video and audio playing device with an external audio playing device and comprises the following steps: transmitting a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time; playing the target sound signal through the internal audio playing structure, and sending out a first audio signal; playing the target sound signal through the external audio playing device, and sending out a second audio signal; receiving the first audio signal and recording the receiving time as a first time point; receiving the second audio signal and recording the receiving time as a second time point; and carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point. By the method, the audio-video delay condition of the external audio playing device is adjusted, the consistency of audio signals and video signals output by the external audio playing device and the video-audio playing device in the using process is ensured, and the listening experience of a user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art. It is to be understood that the drawings provided in this section are for a better understanding of the present application only and are not to be construed as limiting the application.
FIG. 1 is a schematic flow chart of an embodiment of a method for processing audio and video synchronization according to the present application;
FIG. 2 is a schematic diagram of another embodiment of a method for processing audio and video synchronization according to the present application;
FIG. 3 is a schematic diagram of an embodiment of a method for synchronous processing of audio and video according to the present application;
fig. 4 is a schematic structural diagram of an embodiment of an audio/video playing device according to the present application.
Detailed Description
In order to better understand the solution of the present application, the following description of the solution of the embodiment of the present application will be clear and complete, and it is obvious that the described embodiment is only a part of the embodiment of the present application, not all the embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application. Meanwhile, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness of the description.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Television is used as a common audio-visual device, and the most common scene is to allow a user to watch and listen simultaneously by outputting images and sounds. Thus, the image and sound need to be output synchronously to give the user a better use experience. When the television is used, the television can be matched with external audio playing equipment, such as HDMI audio output, optical fiber audio output, bluetooth audio output and the like, the audio of the television is output to the external audio equipment through different channels, and the corresponding audio is played by the external audio playing equipment.
However, after the processing of the external audio device, the time difference between the audio played by the external device and the image and audio played by the television itself becomes large. Taking bluetooth audio output as an example, when bluetooth audio is transmitted, audio is encoded first, then transmitted to a bluetooth audio playing device end through bluetooth, and then decoded and played. Through the influence of these factors, a higher delay is usually generated, which is about 200 ms, and this delay effect can cause the user to feel more obvious on the phenomenon of asynchronous audio and video, and influence the use experience of the user, so as to solve this problem, the first aspect of the embodiment of the present application provides an audio and video synchronization processing method, referring to fig. 1, which includes: steps 101 to 106.
101. And sending a target sound signal playing instruction.
Specifically, before explaining the method, it is necessary to introduce the implementation environment of the scheme, and the scheme can be applied to any device with an audio-video playing function in the actual implementation process, and the particular device can be a television, a personal computer, an IPAD, a projector, a smart phone or other devices, or an audio-video playing device composed of the television and a set-top box together, and only the device is required to be a device which can be externally connected with an audio playing device and has the audio-video playing function, and the method is not limited in the specific application. The type of the external audio playing device connected to the audio-video playing device may also depend on the actual situation, such as bluetooth sound or bluetooth earphone, which is not limited herein.
In this step, the user can select to perform the audio-video passing processing procedure through the specific application or the interface provided by the audio-video playing device, so as to activate the sending procedure of the target sound signal playing instruction to the internal audio playing structure and the external audio playing device. The target sound signal playing instruction sent in the step is used for indicating the internal audio playing structure of the audio-visual playing device and the external audio playing device to play the target sound signal simultaneously, namely, indicating the device body and the external device to play a specific sound simultaneously, so as to simulate the audio-visual playing process under the general condition, so as to support judging whether the condition of asynchronous audio-visual is existed, and support the processing process of asynchronous audio-visual. The specific played target sound signal should be stored in association with the instruction, and the target sound signal should have a specific frequency and duration so as to facilitate the subsequent recognition process, and the specific form may be dependent on the actual situation, which is not limited herein.
102. And playing the target sound signal through the internal audio playing structure, and sending out a first audio signal.
Specifically, the target sound signal is played through the internal audio playing structure, a first audio signal is sent out, the internal audio playing structure is a loudspeaker or a loudspeaker and other structures of the audio-video playing equipment, when the target sound signal is played through the internal audio playing structure, additional data processing is not needed, the playing process can be directly carried out, and therefore the time difference between the sent first audio signal and the sent instruction is small. In addition, for the video and audio playing device, there is a higher consistency between the audio playing time and the video playing time, and it can be considered that there is no or little time difference. Taking a television apparatus as an example, in general, the delay criteria of images and sounds are controlled to be within 50 ms, so that it can be considered that the time when the first audio signal is emitted is the time when the picture is played.
103. And playing the target sound signal through an external audio playing device, and sending out a second audio signal.
Specifically, the target sound signal is played through the external audio playing device, and a second audio signal is sent out. The external audio playing device establishes data connection with the audio-video playing device in advance and has control relation, and when the audio-video playing device plays the audio signal in the media signal through the internal audio playing structure in the general working process, the electronic data of the audio signal is transmitted to the external audio playing device, and the external audio playing device synchronously plays the audio signal. However, the external audio playing device needs to encode the audio first in the playing process, then transmit the encoded audio to the external audio playing device side, and then decode the audio, which can generate unnecessary delay, and easily cause a larger gap between the audio signal played by the external audio playing device and the time point when the instruction is sent, so that a time gap exists between the second audio signal and the first audio signal.
104. Receiving a first audio signal and recording the receiving time as a first time point;
Specifically, a first audio signal is received, and a reception time is recorded as a first time point. In the actual implementation process, the method can be realized through an audio receiving device, specifically through a radio or a microphone, and in the actual implementation process, the audio receiving process can be realized through the microphone of the audio playing device, and the first time point of receiving the first audio signal is recorded so as to compare the time difference with the time when the second audio signal is sent out.
105. Receiving the second audio signal and recording the receiving time as a second time point;
specifically, the second audio signal is received and the receiving time is recorded as a second time point, and the receiving process of the second audio signal is similar to the receiving process of the first audio signal, which is not described herein in detail, it should be noted that there may be a superposition of the first audio signal and the second audio signal when the second audio signal is received, and at this time, the audio recognition process should be correspondingly processed so as to accurately recognize the second audio signal.
106. And performing audio-video synchronization adjustment based on the difference between the first time point and the second time point.
Specifically, the audio-video synchronization adjustment is performed based on the difference between the first time point and the second time point, specifically, if the difference between the first time point and the second time point is too large, the audio-video synchronization adjustment process can be performed, and if the difference is small, the process can be ended without performing corresponding adjustment.
For the situation that adjustment is needed, audio and video synchronization adjustment can be performed in different modes, for example, a certain delay can be set for audio and video processing and playing processes of audio and video playing equipment, so that the audio and video processing and playing processes are matched with processing time of external audio playing equipment, and further the processing effect of consistency of audio and video is achieved. In addition, the delay can be reduced by changing the audio decoding mode of the external audio playing device, and the specific mode can be determined according to the actual situation and is not limited herein.
It can be understood that after the process of adjusting the synchronization of the audio and the video, the processes from step 101 to step 105 may be performed again, so as to obtain the difference between the first time point and the second time point again, further determine whether the process of adjusting the synchronization of the audio and the video achieves the predetermined effect, and if not, adjust again, further ensure the processing effect.
From the above technical solutions, the embodiment of the present application has the following advantages: the embodiment of the application provides a sound and picture synchronous processing method, which is applied to a video and audio playing device with an external audio playing device and comprises the following steps: transmitting a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time; playing the target sound signal through the internal audio playing structure, and sending out a first audio signal; playing the target sound signal through the external audio playing device, and sending out a second audio signal; receiving the first audio signal and recording the receiving time as a first time point; receiving the second audio signal and recording the receiving time as a second time point; and carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point. By the method, the audio-video delay condition of the external audio playing device is adjusted, the consistency of audio signals and video signals output by the external audio playing device and the video-audio playing device in the using process is ensured, and the listening experience of a user is improved.
To facilitate the use of the method in a practical implementation, the present application also provides an alternative implementation of a more detailed embodiment, referring to fig. 2, an embodiment of the present application includes: steps 101-105.
201. And sending a target sound signal playing instruction.
Specifically, in this embodiment, the implementation main body is taken as a television device for illustration, and a user can control the television to enter a sound and picture adjustment process through a television remote controller in the process of using the television, so as to execute the method.
202. And playing the target sound signal through the internal audio playing structure, and sending out a first audio signal.
203. And playing the target sound signal through an external audio playing device, and sending out a second audio signal.
Specifically, steps 202 to 203 are similar to steps 102 to 103 in the corresponding embodiment of fig. 1, and reference is made to the foregoing for details, which are not repeated here.
204. The first audio signal is received through the microphone, and the receiving time is recorded as a first time point.
205. The second audio signal is received by the microphone and the time of reception is recorded as a second point in time.
Specifically, the steps 204 to 205 may be performed by a microphone disposed on the television apparatus, where the microphone for receiving sound may also be disposed on a remote controller corresponding to the television apparatus, or may be a separate apparatus having a data connection with the television apparatus, which may be specific to the actual situation, and is not limited herein.
206. And judging whether the difference between the first time point and the second time point is larger than a preset value.
Specifically, the difference between the first time point and the second time point is calculated, and the relation between the difference and a preset value is compared, wherein the preset value is preset by a worker and is used for representing the maximum duration of the acceptable audio-visual delay, the smaller the preset value is, the better the audio-visual synchronization effect is, but the higher the accuracy requirement on the adjustment process is, generally, the value can be set to be 50ms, the specific value setting can be determined according to the actual situation, and the limitation is not limited herein. If the difference between the first time point and the second time point is less than or equal to the preset value, the delay is in a reasonable range, step 207 is executed, and the sound-picture synchronization adjustment process is not performed. If the difference between the first time point and the second time point is greater than the preset value, step 208 is executed to perform the synchronization adjustment process.
207. And the sound and picture synchronization adjustment process is not performed.
Specifically, if the difference between the first time point and the second time point is smaller than or equal to the preset value, it is indicated that the amplitude of the sound-picture unsynchronization in the current environment is smaller, and the adjustment is not needed, so that the sound-picture synchronization adjustment process is not needed, and the process can be ended.
208. And performing a sound and picture synchronization adjustment process.
Specifically, the practical sound-picture synchronization adjustment process includes two modes, which are respectively described below:
(1) And increasing the signal delay of the difference time length for the local signal processing process of the video and audio playing equipment, wherein the difference time length is equal to the difference value between the first time point and the second time point.
The audio and video signals are output after the differential time length is passed in the processing process of the audio and video playing device, but the delay is not increased for the external audio playing device, so that the audio and video output by the audio and video playing device is consistent in time with the audio output by the external audio playing device in a mode of increasing the processing delay for the local signal processing process.
(2) And adjusting the audio decoding mode of the external audio playing device.
Specifically, in the practical implementation process, the external audio device may use some coding modes with better obtained audio effects and more complex processing, and this mode may have better obtained sound effects but higher delay, so it may be switched to some coding modes with general processing effects, but simpler and faster coding modes, for example. A common bluetooth audio coding format is SBC (Sub-band coding)/AAC (Advanced Audio Coding ), and a Low-delay bluetooth audio coding format is aptX LL (APTX Low Latency, low-delay lossless transmission technology)/LC 3 (Low-complexity communication codec)/LHDC (Low-LATENCY HI-Definition Audio Codec, low-delay high-resolution audio coding) may be converted from a conventional coding mode into a coding mode under a Low-delay class in an actual implementation process, so as to reduce delay of an external audio playing device in a playing process, thereby ensuring a sound-picture consistency effect.
The foregoing describes a sound and picture synchronization processing method provided by the present application, and in order to support implementation of the foregoing embodiments, the present application further provides a sound and picture synchronization processing device, where the device is used in association with a sound and picture playing device including an external sound playing device, referring to fig. 3, and one embodiment of the sound and picture synchronization processing device provided by the present application includes:
a transmitting unit 301, configured to transmit a target sound signal playing instruction, where the target sound signal playing instruction is used to instruct the internal audio playing structure of the audio-visual playing device and the external audio playing device to play a target sound signal at the same time;
a first audio playing unit 302, configured to play the target sound signal through the internal audio playing structure, and send out a first audio signal;
A second audio playing unit 303, configured to play the target sound signal through the external audio playing device, and send out a second audio signal;
a first receiving unit 304, configured to receive the first audio signal and record a receiving time as a first time point;
a second receiving unit 305, configured to receive the second audio signal and record a receiving time as a second time point;
and the adjusting unit 306 is configured to perform audio-video synchronization adjustment based on a difference between the first time point and the second time point.
Optionally, the video playing device is a television device.
Optionally, the first receiving unit is specifically configured to: receiving the first audio signal through a microphone;
the second receiving unit is specifically configured to: the second audio signal is received by the microphone.
Optionally, the adjusting unit is specifically configured to:
Judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
If the difference value is larger than a preset value, carrying out the process of synchronous adjustment of the sound and the picture;
and if the difference value is smaller than or equal to the preset value, not performing the process of synchronous adjustment of the sound and the picture.
Optionally, the adjusting unit is specifically configured to:
And increasing the signal delay of the difference time length for the local signal processing process of the video and audio playing equipment, wherein the difference time length is equal to the difference value between the first time point and the second time point.
Optionally, the adjusting unit is specifically configured to:
and adjusting the audio decoding mode of the external audio playing device.
Optionally, the microphone is disposed on a control device of the audio-visual playing device.
In this embodiment, the flow executed by each unit in the sound and picture synchronization processing device is similar to the flow of the method described in the embodiment corresponding to fig. 1, and will not be repeated here.
Fig. 4 is a schematic structural diagram of an audio/video playing device according to an embodiment of the present application, where the audio/video playing device 400 may include one or more processors 401 and a memory 402, and one or more application programs or data are stored in the memory 402.
In this embodiment, the specific functional module division in the processor 401 may be similar to the functional module division of each unit described in fig. 3, and will not be repeated here.
Wherein the memory 402 may be volatile storage or persistent storage. The program stored in the memory 402 may include one or more modules, each of which may include a series of instruction operations on the server. Still further, the processor 401 may be configured to communicate with the memory 402 and execute a series of instruction operations in the memory 402 on the audiovisual playback device 400.
The audio-visual playing device 400 further comprises an internal audio playing structure 403 and an external audio playing device 404; the internal audio playing structure 403 may be a speaker or a speaker, and the external audio playing device 404 may be an audio playing device controlled by the processor 401, such as a bluetooth speaker or a bluetooth earphone, which has a data connection with the audio playing device 400.
The processor 401 may execute the operations executed by the audio and video synchronization processing method in the embodiment shown in fig. 1 or fig. 2, and details thereof are not described herein.
The embodiment of the application also provides a computer storage medium for storing computer software instructions for the sound and picture synchronization processing method, which comprises a program designed for executing the sound and picture synchronization processing method.
The sound and picture synchronization processing method may be as described in the foregoing fig. 1 or fig. 2.
The embodiment of the application also provides a computer program product, which comprises computer software instructions, wherein the computer software instructions can be loaded by a processor to realize the flow of the audio-video synchronous processing method in any one of the figures 1 and 2.
In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., equivalent transformations of circuitry, partitioning of elements is merely one logical functional partitioning, and there may be additional partitioning aspects in actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not implemented. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, or alternatives falling within the spirit and principles of the invention.
Claims (10)
1. A sound and picture synchronization processing method, wherein the method is applied to a video and audio playing device with an external audio playing device, and comprises the following steps:
transmitting a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time;
Playing the target sound signal through the internal audio playing structure, and sending out a first audio signal;
playing the target sound signal through the external audio playing device, and sending out a second audio signal;
receiving the first audio signal and recording the receiving time as a first time point;
performing audio recognition on superposition of the first audio signal and the second audio signal, receiving the second audio signal, and recording the receiving time as a second time point;
And carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point.
2. The audio-visual synchronous processing method according to claim 1, wherein the audio-visual playing device is a television device.
3. The sound and picture synchronization processing method according to claim 1, wherein said receiving the first audio signal includes:
receiving the first audio signal through a microphone;
The receiving the second audio signal includes:
the second audio signal is received by the microphone.
4. The method of claim 1, wherein the performing the synchronization adjustment based on the difference between the first time point and the second time point comprises:
Judging whether the difference value between the first time point and the second time point is larger than a preset value or not;
If the difference value is larger than a preset value, carrying out the process of synchronous adjustment of the sound and the picture;
and if the difference value is smaller than or equal to the preset value, not performing the process of synchronous adjustment of the sound and the picture.
5. The sound and picture synchronization processing method according to claim 1, wherein the sound and picture synchronization adjustment process includes:
And increasing the signal delay of the difference time length for the local signal processing process of the video and audio playing equipment, wherein the difference time length is equal to the difference value between the first time point and the second time point.
6. The sound and picture synchronization processing method according to claim 1, wherein the sound and picture synchronization adjustment process includes:
and adjusting the audio decoding mode of the external audio playing device.
7. The sound and picture synchronization processing method according to claim 3, wherein the microphone is disposed on a control device of the audio/video playing device.
8. An audio-visual synchronization processing device, wherein the device is used in association with an audio-visual playing device comprising an external audio playing device, comprising:
The sending unit is used for sending a target sound signal playing instruction, wherein the target sound signal playing instruction is used for indicating an internal audio playing structure of the audio-video playing device and the external audio playing device to play a target sound signal at the same time;
the first audio playing unit is used for playing the target sound signal through the internal audio playing structure and sending out a first audio signal;
The second audio playing unit is used for playing the target sound signal through the external audio playing equipment and sending out a second audio signal;
a first receiving unit, configured to receive the first audio signal, and record a receiving time as a first time point;
A second receiving unit, configured to perform audio recognition on the superposition of the first audio signal and the second audio signal, receive the second audio signal, and record a receiving time as a second time point;
and the adjusting unit is used for carrying out sound and picture synchronization adjustment based on the difference value between the first time point and the second time point.
9. An audio/video playing apparatus, comprising:
a processor, a memory, an internal audio playing structure, an external audio playing device;
the memory is a short-term memory or a persistent memory;
The processor is configured to communicate with the memory, control the internal audio playback structure and the external audio playback device on the audiovisual playback device to perform the instruction operations in the memory to perform the method of any one of claims 1 to 7.
10. A computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211368593.8A CN115802087B (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211368593.8A CN115802087B (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115802087A CN115802087A (en) | 2023-03-14 |
| CN115802087B true CN115802087B (en) | 2024-11-01 |
Family
ID=85435204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211368593.8A Active CN115802087B (en) | 2022-11-03 | 2022-11-03 | Sound and picture synchronous processing method and related equipment thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115802087B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116389638B (en) * | 2023-03-31 | 2024-09-24 | 腾讯音乐娱乐科技（深圳）有限公司 | Method for determining audio signal processing time, terminal device and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107734378A (en) * | 2017-10-31 | 2018-02-23 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN111988647A (en) * | 2020-08-27 | 2020-11-24 | 广州视源电子科技股份有限公司 | Sound and picture synchronous adjusting method, device, equipment and medium |
| CN114615529A (en) * | 2022-02-25 | 2022-06-10 | 海信视像科技股份有限公司 | Display device, external device and audio playing method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103905878A (en) * | 2014-03-13 | 2014-07-02 | 北京奇艺世纪科技有限公司 | Video data and audio data synchronized playing method and device and equipment |
| CN111343620A (en) * | 2020-02-28 | 2020-06-26 | 捷开通讯(深圳)有限公司 | Multi-device audio playing correction method, device and terminal |
| CN111355995A (en) * | 2020-03-03 | 2020-06-30 | 北京字节跳动网络技术有限公司 | Method and device for determining sound delay time of Bluetooth device and terminal device |
-
2022
- 2022-11-03 CN CN202211368593.8A patent/CN115802087B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107734378A (en) * | 2017-10-31 | 2018-02-23 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN111988647A (en) * | 2020-08-27 | 2020-11-24 | 广州视源电子科技股份有限公司 | Sound and picture synchronous adjusting method, device, equipment and medium |
| CN114615529A (en) * | 2022-02-25 | 2022-06-10 | 海信视像科技股份有限公司 | Display device, external device and audio playing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115802087A (en) | 2023-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10178345B2 (en) | Apparatus, systems and methods for synchronization of multiple headsets | |
| US9788114B2 (en) | Acoustic device for streaming audio data | |
| RU2661775C2 (en) | Transmission of audio rendering signal in bitstream | |
| US8565458B2 (en) | Media player and adapter for providing audio data to hearing aid | |
| US10359991B2 (en) | Apparatus, systems and methods for audio content diagnostics | |
| US9736614B2 (en) | Augmenting existing acoustic profiles | |
| EP2887624B1 (en) | Smartphone bluetooth headset receiver | |
| US9876944B2 (en) | Apparatus, systems and methods for user controlled synchronization of presented video and audio streams | |
| US8446533B2 (en) | Television apparatus and method for controlling the same | |
| JP2015056905A (en) | Reachability of sound | |
| US8441577B2 (en) | Apparatus, systems and methods for synchronization of a video stream and an audio stream | |
| US11303689B2 (en) | Method and apparatus for updating streamed content | |
| CN112637732A (en) | Display device and audio signal playing method | |
| CN113038343A (en) | Audio output device and control method thereof | |
| CN115802087B (en) | Sound and picture synchronous processing method and related equipment thereof | |
| CN103716568A (en) | Television volume adjustment method and system | |
| WO2014105074A1 (en) | Method and apparatus for using contextual content augmentation to provide information on recent events in a media program | |
| CN113077799A (en) | Decoder arrangement with two audio links | |
| CN114915874B (en) | Audio processing method, device, equipment and medium | |
| US20110157308A1 (en) | Three-dimensional image reproducing apparatus | |
| CN103327364A (en) | Wireless transmission method and device for audio and video playing | |
| CN213693982U (en) | Audio-video system | |
| CN113422997B (en) | Method and device for playing audio data and readable storage medium | |
| KR20200080369A (en) | Display apparatus, method for controlling thereof and recording media thereof | |
| CN115767158A (en) | Synchronous playing method, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |