[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN111294783A - Audio data transmission method, device, chip and electronic equipment - Google Patents

Audio data transmission method, device, chip and electronic equipment Download PDF

Info

Publication number
CN111294783A
CN111294783A CN202010383066.9A CN202010383066A CN111294783A CN 111294783 A CN111294783 A CN 111294783A CN 202010383066 A CN202010383066 A CN 202010383066A CN 111294783 A CN111294783 A CN 111294783A
Authority
CN
China
Prior art keywords
audio data
link
transmission
isoc
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010383066.9A
Other languages
Chinese (zh)
Other versions
CN111294783B (en
Inventor
郭仕林
刘文毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Goodix Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Goodix Technology Co Ltd filed Critical Shenzhen Goodix Technology Co Ltd
Priority to CN202010383066.9A priority Critical patent/CN111294783B/en
Publication of CN111294783A publication Critical patent/CN111294783A/en
Application granted granted Critical
Publication of CN111294783B publication Critical patent/CN111294783B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/10—Flow control between communication endpoints
    • H04W28/14—Flow control between communication endpoints using intermediate storage
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W56/00—Synchronisation arrangements
    • H04W56/001—Synchronization between nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The embodiment of the application provides a method, a device, a chip and electronic equipment for audio data transmission, which can reduce the transmission delay of audio data. The method comprises the following steps: the first end receives target audio data sent by the third end through a Bluetooth link, wherein the target audio data is used for obtaining first audio data, and the first audio data is used for playing on the second end side; and the first end transmits the first audio data to the second end through a low-power-consumption synchronous LE ISOC link.

Description

Audio data transmission method, device, chip and electronic equipment
Technical Field
The embodiment of the application relates to the technical field of wireless communication, and in particular relates to a method, a device, a chip and an electronic device for audio data transmission.
Background
With the rapid development of mobile terminal technology and chip technology, the earphone market has been rapidly developed, especially the wireless earphone market. Among various Wireless earphone products, a True Wireless Stereo (TWS) earphone can realize stereo play of left and right channels, and provides a high-quality playing sound quality for a user while being convenient to wear, thereby gaining favor of consumers.
At present, a user has a high requirement on the time delay of the TWS headset, and therefore, how to reduce the transmission time delay of audio data at the headset end is an urgent problem to be solved.
Disclosure of Invention
The embodiment of the application provides a method, a device, a chip and electronic equipment for audio data transmission, which can reduce the transmission delay of audio data.
In a first aspect, a method for audio data transmission is provided, the method comprising: the first end receives target audio data sent by the third end through a Bluetooth link, wherein the target audio data is used for obtaining first audio data, and the first audio data is used for playing on the second end side; and the first end transmits the first audio data to the second end through a low-power-consumption synchronous LE ISOC link.
In some possible implementations, the method further includes: the first end obtains second audio data according to the target audio data; the first end determines the start-up point of the second audio data according to the original start-up point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT, wherein the original start-up point of the second audio data is the start-up point determined according to the Bluetooth audio transmission model agreement A2DP protocol;
the first end transmits the first audio data to the second end through a low-power synchronous LE ISOC link, including: and the first end transmits the first audio data to the second end through the LE ISOC link at the original play point of the second audio data.
In some possible implementations, the determining, by the first end, the start point of the second audio data according to the original start point of the second audio data, the transmission timeslot of the LE ISOC link, the transmission timeslot of the bluetooth link, and the refresh timeout FT includes:
the first end determines the play start point of the second audio data according to the original play start point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE asynchronous connectionless ACL link, the transmission time slot of the Bluetooth link and the refresh timeout FT;
the start point of the second audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein T is a start point of the second audio data, K is an original start point of the second audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
In some possible implementations, I =10 ms.
In some possible implementations, S =2.5 ms.
In some possible implementations, the method further includes: and the first end sends request information to the second end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
In some possible implementations, before establishing the LE ISOC link, the method further includes: the first end establishes the bluetooth link with the third end.
In some possible implementations, before the first end transmits the first audio data to the second end, the method further includes: the first end encodes the first audio data in a low complexity LC3 encoding format.
In some possible implementations, the method further includes: and the first end is switched to the second end, wherein the transmission of the first audio data is not stopped between the first end and the second end in the process of switching the first end to the second end.
In some possible implementations, a code rate at which the first end transmits the first audio data is 96 kbps.
In some possible implementations, the third terminal does not support a low power audio standard.
In a second aspect, a method of audio data transmission is provided, the method comprising: the second end receives first audio data sent by the first end through a low-power-consumption synchronous LE ISOC link, wherein the first audio data are used for being played at the second end side, the first audio data are audio data obtained by the first end according to target audio data sent by the third end, and the first end is connected with the third end through a Bluetooth link.
In some possible implementations, the first audio data is a part of audio data obtained by the first end decoding the target audio data.
In some possible implementations, the method further includes: and the second end determines the play start point of the first audio data according to the time point of receiving the first audio data or the time point of sending the first audio data by the first end, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT.
In some possible implementations, the determining, by the second end, the start point of the first audio data according to the time point of receiving the first audio data or the time point of sending the first audio data by the first end, the transmission timeslot of the LE ISOC link, the transmission timeslot of the bluetooth link, and the refresh timeout FT, includes: the second end determines a play start point of the first audio data according to a time point of receiving the first audio data or a time point of sending the first audio data by the first end, a transmission time slot of the LEISOC link, a transmission time slot of the LE asynchronous connectionless ACL link, a transmission time slot of the Bluetooth link and a refresh timeout FT;
the start point of the first audio data satisfies the formula:
T= K+S+（FT-1）*I
wherein T is a start point of the first audio data, K is a time point when the second end receives the first audio data or a time point when the first end sends the first audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
In some possible implementations, I =10 ms.
In some possible implementations, S =2.5 ms.
In some possible implementations, the method further includes: and the second end receives request information sent by the first end through the LEACL link, wherein the request information is used for requesting to establish the LE ISOC link.
In some possible implementations, the first audio data is audio data encoded using a low complexity LC3 encoding format.
In some possible implementations, the method further includes: and the second end is switched to be the first end, wherein the transmission of the first audio data is not stopped between the first end and the second end in the process of switching the second end to be the first end.
In some possible implementations, the third terminal does not support a low power audio standard.
In some possible implementations, the third terminal does not support a low power audio standard.
In a third aspect, an apparatus for audio data transmission is provided, where the apparatus is a first terminal, and is configured to perform the method in the first aspect or each implementation manner thereof.
In particular, the first end comprises functional modules for performing the methods of the first aspect or its implementations described above.
In a fourth aspect, an apparatus for audio data transmission is provided, where the apparatus is a second terminal, and is configured to perform the method in the second aspect or each implementation manner thereof.
In particular, the second end comprises functional modules for performing the method of the second aspect or its implementations described above.
In a fifth aspect, a chip is provided for performing the method for audio data transmission of the first aspect, and includes a memory and a processor;
the memory is coupled with the processor;
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory so as to enable the chip to execute the audio data transmission method of the first aspect.
In a sixth aspect, a chip is provided for performing the method of audio data transmission of the second aspect, which includes a memory and a processor;
the memory is coupled with the processor;
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory so as to enable the chip to execute the audio data transmission method of the second aspect.
In a seventh aspect, a computer-readable storage medium for storing a computer program is provided. Wherein the computer program, when executed by a processor, causes the processor to perform the first aspect or the method of any possible implementation of the first aspect.
In an eighth aspect, a computer-readable storage medium for storing a computer program is provided. Wherein the computer program, when executed by a processor, causes the processor to perform the second aspect or the method of any possible implementation of the second aspect.
In a ninth aspect, there is provided a computer program product comprising computer program instructions to cause a computer to perform the method of the first aspect or any possible implementation manner of the first aspect.
A tenth aspect provides a computer program product comprising computer program instructions to cause a computer to perform the method of the second aspect or any possible implementation of the second aspect.
In an eleventh aspect, an electronic device is provided, which includes: the master device of the third aspect or any possible implementation of the third aspect; the secondary device of the fourth aspect or any possible implementation manner of the fourth aspect;
the master device is connected with the master device through a Bluetooth link, at least one wireless communication link exists between the master device and the auxiliary device, and the at least one wireless communication link comprises a low-power LE ISOC link.
According to the technical scheme, the audio data is transmitted between the third end (such as the source device) and the first end (such as the main device) through the Bluetooth link, and the first end transmits the audio data to the second end (such as the auxiliary device) through the LE ISOC link, so that the delivery time of the audio data sent from the first end to the second end is accurate and predictable, and the second end can achieve synchronization without buffering the audio data in a large quantity, so that the time delay of audio data transmission can be reduced.
Drawings
Fig. 1 is a topological schematic diagram of a current bluetooth-based audio scheme.
Fig. 2 is a topological schematic diagram of another current bluetooth-based audio scheme.
Fig. 3 is a topological schematic diagram of yet another current bluetooth-based audio scheme.
Fig. 4 is a schematic flow chart of audio data transmission according to an embodiment of the present application.
Fig. 5 is a topological schematic diagram of an embodiment of the present application.
Fig. 6 is a slot allocation diagram of the BT link and the LE link according to an embodiment of the present application.
Fig. 7 is a flowchart of a target audio data transmission of an embodiment of the present application.
Fig. 8 is a schematic diagram of role switching between a master device and a slave device according to an embodiment of the present application.
Fig. 9 is a schematic block diagram of an apparatus for audio data transmission embodied by the present application.
Fig. 10 is a schematic block diagram of an apparatus for audio data transmission embodied by the present application.
Fig. 11 is a schematic block diagram of an electronic device of an embodiment of the present application.
Fig. 12 is a schematic block diagram of a chip of an embodiment of the present application.
Fig. 13 is a schematic block diagram of a chip of an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.
Currently, some earphones on the market have implemented wireless stereo transmission of bluetooth audio data, and do not have the constraint of cable while considering the quality of the audio data, and a typical topology is shown in fig. 1.
The topology shown in fig. 1 is composed of a primary earphone and a secondary earphone capable of freely switching between a master and a slave, where the primary earphone and the source device are directly connected through a Bluetooth (BT) link, for example, the source device may be a mobile phone, the primary earphone and the secondary earphone are connected through a Low Energy (LE) link, and the primary earphone may guide the secondary earphone to monitor the link between the primary earphone and the source device through the connection with the secondary earphone, so as to implement a communication topology with multiple bands, so that the primary earphone and the secondary earphone may receive audio data sent by the source device at the same time, thereby implementing a mechanism of one-generation multiple-reception. Thereafter, the main earphone and the sub-earphone deinterleave the audio data, so that the effect of wireless stereo sound can be exhibited.
Fig. 2 is a topological schematic diagram of another bluetooth-based audio scheme. It can be seen that the primary earpiece is directly connected to the source device, while the primary earpiece and the secondary earpiece are also connected. When the primary earpiece receives the audio data sent by the source device, the primary earpiece does not perform any processing on the received audio data, and may directly forward the audio data to the secondary earpiece through a BT link or a Low band transmission Technology (LBRT) link.
After the source device sends the audio data to the primary earphone, the primary earphone forwards the audio data to the secondary earphone, so that the time delay of the scheme is large, and the wireless bandwidth is seriously wasted. In addition, in the scheme, the starting points of the main earphone and the auxiliary earphone for playing the audio data are difficult to synchronize, and the listening feeling of a user is influenced.
Fig. 3 is a topological schematic diagram of another bluetooth audio scheme. In the scheme, the source equipment is simultaneously connected with the main earphone and the auxiliary earphone through the BT link, the source equipment can respectively transmit audio data to the main earphone and the auxiliary earphone, and simultaneously the main earphone and the auxiliary earphone can synchronously play the received audio data.
The bluetooth audio scheme has a large limitation on the source device, which must use a customized chip of the scheme and cannot be compatible with other bluetooth standard protocols.
Fig. 4 is a schematic flow chart of a method of audio data transmission according to an embodiment of the present application, where the method 100 of fig. 4 may be performed by a third end, a first end of a playing end of audio data, and a second end of the playing end of audio data, where the first end, the second end, and the third end may be chips or devices, and the first end, the second end, and the third end may be, for example, a master device, a slave device, and a source device, respectively, as mentioned above. The following describes embodiments of the present application by taking the first terminal, the second terminal, and the third terminal as an upper master device, a slave device, and a source device, respectively.
By way of example and not limitation, the source device may be a portable or mobile computing device such as a terminal device, a cell phone, a tablet, a laptop, a desktop, a gaming device, an in-vehicle electronic device, or a wearable smart device. The master device may be a bluetooth headset, hearing aid, bluetooth speaker, etc. that establishes a wireless communication link with the source device for audio data transmission. The slave device may be a bluetooth headset, a hearing aid, a bluetooth speaker, etc. that is not directly connected to the source device. Illustratively, the primary device may be a primary earpiece of the TWS earpieces and the secondary device may be a secondary earpiece of the TWS earpieces.
Fig. 5 is a possible topology diagram for which the method 100 is applicable. It can be seen that the source device and the master device are connected through a BT link, and the master device and the slave device are connected through a Low Energy, LE, synchronous (ISOC) link.
The source device may support an LE Audio (Audio) standard or may not support the LE Audio standard, that is, the embodiment of the present application may be compatible with an electronic device that does not support the LE Audio standard. Therefore, the method and the device for processing the source device can improve the compatibility of the source device.
The LE ISOC link may allow retransmission for a certain time, that is, if the primary device fails to transmit the audio data to the secondary device through the LE ISOC link, the primary device may retransmit the audio data. If the primary device and the secondary device are TWS headphones, since the distances between the two headphones are usually relatively close, the audio data transmission may have a high transmission success rate, for example, more than 90%, and the number of retransmissions may be 1.
The above-mentioned certain time may refer to a refresh Timeout (FT), and FT may be determined when the topology shown in fig. 5 is created, where FT takes a positive integer, for example, FT may be 1, 2, or 3, and FT may be in Interval. Preferably, FT = 1.
For convenience of description, in the embodiments of the present application, a link between a primary device and a secondary device is referred to as a first link. Optionally, the first link may comprise an LE ISOC link; alternatively, the first link may include an LE ISOC link and an LE Asynchronous Connectionless (ACL) link.
The LE ACL link is mainly used for transmitting control signaling, and the next control signaling can be sent only after receiving the response from the opposite end. The LE ISOC link may be mainly used as a transmission channel for audio data between the primary device and the secondary device, and may be used to ensure data transmission timing, data transmission synchronization, and playback synchronization.
In the embodiment of the present application, the total transmission slot of the BT link and the first link (i.e., the sum of the transmission slot of the BT link and the transmission slot of the first link) may be 10 ms. The embodiment of the present application uses 625 μ s as a transmission unit, i.e., one slot is 625 μ s. That is, the BT link and the first link may occupy 16 slots in total. Of course, in the embodiment of the present application, the total transmission time slot of the BT link and the first link may also be referred to as a communication Interval (Interval) or an ISOC Interval or a scheduling period.
Referring to fig. 6, a time slot may be understood as, for example: an interval between a time when the source device transmits audio data to the master device and a time when the master device transmits a response to the source device for the audio data. M identified in fig. 6 represents a data packet sent by the source device to the master device, which may include audio data, with the number following M representing the sequence number of this data packet and different sequence numbers representing different data packets. The Y mark indicates the response of the master to the packet sent by the source device, and is usually a null packet, and is only the response to the packet sent by the source device, and therefore, the sequence number of the response to the packet by the master is not emphasized in fig. 6.
The first link in fig. 6 includes an LE ISOC link and an LE ACL link, the sub ISOC1 is a time slot for the primary device to transmit audio data to the secondary device through the LE ISOC link for the first time, and the sub ISOC2 is a time slot for the primary device to retransmit the audio data through the LE ISOC link. It can be seen that the total transmission slot of the first link and the BT link is 10ms, occupying 16 slots.
Based on the LE Audio standard, when the code rate of transmitting Audio data to the secondary device through the LE ISOC link by the primary device is 124 kbps, the sound quality of the Audio data played by the primary device side and the secondary device side is the best. However, when the code rate for transmitting the audio data from the master device to the slave device is 124 kbps, the first link occupies more transmission slots, which may reach 3.75ms, for example. In this case, the transmission slot occupied by the BT link may be reduced, so that the bandwidth of the bluetooth link may not guarantee the transmission of the audio data between the source device and the master device, thereby affecting the transmission quality of the audio data. Therefore, the code rate for transmitting the audio data from the master device to the slave device in the embodiment of the present application is 124 kbps or less. In this case, when the transmission rate of the audio data transmitted between the main device and the sub-device is 96kbps, the quality of the audio data transmitted between the main device and the sub-device is the highest, that is, the sound quality of the audio data played on the main device side and the sub-device side is the best. Therefore, the transmission code rate of the audio data transmitted between the master device and the slave device is set to 96kbps in the embodiment of the present application. Thus, the tone quality experience of the user can be improved.
The transmission code rate of the audio Data transmitted between the master device and the slave device is 96kbps, which indicates that 12 (96 k/8=12 k) bytes (Byte) of audio Data can be transmitted between the master device and the slave device in one second, that is, 120 bytes (Byte) of audio Data can be transmitted in 10ms, and then the Protocol Data Unit (PDU) where the audio Data is located occupies 120+2+4=126 bytes. Wherein 2 is the Byte occupied by the header of the PDU, and 4 is the Byte occupied by the Message Integrity Check (MIC). Further, the Preamble (Preamble) occupies 2 bytes, the Access-Address (Access-Address) occupies 4 bytes, and the Cyclic Redundancy Check (CRC) occupies 3 bytes, which occupies 126+2+4+3=135 bytes.
The response (not shown in fig. 6) of the slave device to the PDU occupies 2 bytes, and further, the Preamble occupies 2 bytes, the Access-Address occupies 4 bytes, and the CRC occupies 3 bytes, which occupies 2+2+4+3=11 bytes.
The PDU sent by the master device to the slave device and the acknowledgement of the slave device to the PDU occupy 146 bytes, i.e. 146 x 8=1168 bits. Since it is a 2M physical layer (PHY), the transmission time of the PDU transmitted by the master device to the slave device and the response of the slave device to the PDU is 1168/2=584 μ s in total. Further, since one transmission and reception needs to be separated by 150 μ s, the single transmission time of the LE ISOC link may be 584+150 × 2=884 μ s.
As mentioned above, the LE ISOC link has a retransmission opportunity, and the maximum transmission time of the LE ISOC link may be 884 μ s × 2=1768 μ s. It should be understood that when the primary device sends audio data to the secondary device through the LE ISOC link, in most cases, the sending is successful at one time, and the retransmission opportunities are not much used, so that the optimal transmission time of the LE ISOC link may be 884 μ s.
The maximum transmission time of the LE ACL link may be 636 μ s, and the maximum transmission time of the first link may be 1768 μ s +636 μ s =2404 μ s. Based on this, the first link may occupy 4 slots, i.e., the transmission slot of the first link may be set to 2.5 ms.
Referring again to fig. 6, the BT link occupies 12 slots and the first link occupies 4 slots, i.e., the transmission slot of the first link is 2.5ms, which can ensure the quality of audio data transmitted through the BT link as well as through the first link.
It should be understood that fig. 6 is an example only and should not be construed as limiting the embodiments of the present application.
During audio data transmission, the master device needs to compromise two different links, namely the BT link with the source device and the first link with the slave device. In order to avoid the mutual influence of the two different links, the transmission time slots between the two links should be avoided from overlapping as much as possible. Referring again to fig. 6, it can be seen that the transmission slots of the BT link are the first 12 slots of the 16 slots, the transmission slot of the first link is the last 4 slots, and the transmission slot allocation for the BT link and the transmission slot allocation for the first link in fig. 6 avoid the transmission slot overlap between two different links.
That is, the master device does not communicate with the source device when communicating with the slave device. For example, the master device may turn off the transceiver communicating with the source device while the master device is communicating with the slave device. In this case, the source device may automatically retransmit the audio data without receiving a response from the master device after transmitting the audio data to the master device.
Referring again to fig. 6, the source device transmits an M7 packet to the master device in the transmission slot of the first link between the master device and the slave device, and the master device does not reply to the source device for the M7 packet because the master device is communicating with the slave device and not communicating with the source device in the transmission slot of the first link. The source device does not receive the reply from the master device, and the source device continues to send M7 packets to the master device.
Alternatively, the master device does not communicate with the slave device when communicating with the source device.
Taking a scenario in which the embodiment of the present application is applied to a TWS headset as an example, a construction process of the topology shown in fig. 5 is described in detail first.
Step 1: the sink devices are in a low power mode before joining the topology and wait to be woken up. After the sink device is awakened, for example, the earphone charging box is opened, a plurality of sink devices can be configured through other physical connections besides the bluetooth connection, so as to mutually bind the addresses of the opposite devices. For example, the plurality of sink devices includes a first device and a second device, and the first device and the second device may bind peer device addresses to each other.
Step 2: the first device is removed from the headset charging box and an LE broadcast is performed.
The time for the first device to perform LE broadcast is not specifically limited in this embodiment. For example, the embodiment of the present application may specify that the time for the first device to perform the LE broadcast is 1 ms. As another example, the time for the first device to perform the LE broadcast may be determined by the product form of the first device.
And step 3: after the first device performs LE broadcast, if a source device supporting an LE Audio (Audio) standard establishes a connection with the first device within a certain time, the first device executes an existing LE Audio scheme.
If no source device supporting the LE Audio standard attempts to establish a connection with the first device within a certain time, the first device may send a broadcast using the address bound in step 1.
Alternatively, the first device may broadcast continuously for 1.28 s.
Optionally, the first device may transmit a high duty cycle directional broadcast. Therefore, only the sink device which is bound with the device address of the first device is possible to establish connection with the first device, and the first device sends the high duty ratio broadcast, so that the time for establishing connection with other sink devices can be saved.
And 4, step 4: after the first device broadcasts, an LE Scan (Scan) is started to Scan other sink devices. If the first device scans that the sink device bound with the device address is broadcasting, for example, the sink device is a second device, the first device may establish an LE ACL link with the second device, where the first device is a primary device and the second device is a secondary device.
If the first device is scanned by other sink devices bound with the device address in the broadcasting process, for example, the first device is scanned by the second device, the first device establishes an LE ACL link with the second device, the first device is a secondary device, and the second device is a primary device.
The second device may be a device that ends broadcasting before the first device, for example, the second device may be a sink device that is taken out from the headset charging box first, that is, the second device may be a device that broadcasts before the first device broadcasts. Alternatively, the second device may be a device that broadcasts after or simultaneously with the first device, in which case the duration of the second device broadcast may be shorter than the duration of the first device broadcast.
And if the first device does not scan the sink device bound with the device address after the first device broadcasts and scans other sink devices, the first device is the main device.
And 5: the master device starts a pairing connection process of the BT and waits for the BT connection to be established with the source device supporting the BT.
If the first device does not scan the sink device bound with the device address, the first device may scan another sink device bound with the device address again while starting the BT pairing connection process, or may broadcast again.
Step 6: after the BT link is established between the source device and the primary device and the LE ACL link is established between the primary device and the secondary device, the primary device may send request information to the secondary device through the LE ACL link, where the request information is used to request the establishment of the LEISOC link. After the primary device and the secondary device negotiate, an LE ISOC link is established between the primary device and the secondary device.
It should be understood that steps 1-6 described above are merely exemplary building processes of the topology shown in fig. 5, and do not set any limit to the embodiments of the present application.
After the topology construction is completed, the implementation of the method 100 is described below. As shown in fig. 4, the method 100 may include at least some of the following.
At 110, the source device transmits target audio data to the master device over the BT link.
Accordingly, the master device may receive the target audio data transmitted by the source device through the BT link.
The target audio data may be used to obtain first audio data, and the first audio data is used to be played at the second end.
When the source device supports the LE Audio standard, the source device may encode the target Audio data in a Sub-band Coding (SBC) format, an Advanced Audio Coding (AAC) format, an LDAC Coding format, a Low Complexity (LC) 3 format, or other Coding formats.
When the source device does not support the LE Audio standard, the source device may encode the target Audio data in the SBC, AAC, or LDAC encoding format.
Thus, the embodiment of the present application has no special requirement for the source device, and if the source device supports the LE Audio standard, the LE Audio scheme or the scheme of the embodiment of the present application may be executed; if the source device does not support the LE Audio standard, the scheme of the embodiment of the present application may be executed.
After receiving the target audio data, the master device may decode the target audio data first. Specifically, the host device may decode the target audio data into Pulse Code Modulation (PCM) data that may be directly output to a Digital-to-Analog Converter (DAC) through other hardware units such as a Digital Signal Processor (DSP).
The main device decodes the target audio data, and can obtain second audio data besides the first audio data, wherein the second audio data is used for playing on the main device side.
It should be understood that the first audio data and the second audio data are both PCM data.
At 120, the primary device transmits first audio data to the secondary device over the LE ISOC link.
As an example, after the host device decodes the target audio data, it is not determined which audio data is played on the host device side and which audio data is played on the host device side for a while. At this time, the primary device may transmit all the decoded audio data to the secondary device through the LE ISOC link, that is, the primary device may transmit both the first audio data and the second audio data to the secondary device through the LE ISOC link.
As another example, the PCM data decoded by the host device is typically stereo, and at this time, the host device may de-interleave the PCM data, i.e., separate the left and right channels. The host device may then send the second audio data into the DAC buffer for playback, send the first audio data into the DSP or other hardware unit for encoding, and place the encoded first audio data into the send buffer of the LE ISOC link.
The main device does not need to send all decoded audio data to the auxiliary device, and only needs to send the audio data corresponding to the auxiliary device, so that the waste of wireless bandwidth can be avoided.
The audio data corresponding to the slave device may be understood as: if the slave device is a right earphone, the audio data corresponding to the slave device, that is, the first audio data, is the audio data output by the right channel.
Optionally, the master device may encode the first audio data in an LC3 encoding format.
Because the LC3 encoding format is the encoding format specially matched with the development of the LE ISOC link, the method has the advantages of low time delay, high tone quality, packet loss compensation and the like, so that the time delay of audio data transmission can be reduced, and the tone quality experience of a user can be improved. Further, since the compression rate of the LC3 encoding format is high, so that the size of the first audio data is 256 bytes, for example, the master device may compress the first audio data to 128 bytes, thereby further saving wireless bandwidth and further reducing power consumption.
Of course, the host device may encode the first audio data in an encoding format such as SBC, AAC, or LDAC.
Since the frame length of the LC3 encoding format is 10ms, the LC3 encoding format can be better matched when the total transmission slot of the first link and the BT link is 10 ms.
If only the main device is currently operating and the sub-device is not operating, for example, the power of the sub-device is exhausted or the user puts the sub-device back into the charging box, the main device may discard the first audio data, or the main device may play two channels simultaneously on the same speaker according to the application configuration.
After receiving the encoded first audio data, the slave device may decode the encoded first audio data through the DSP, and then send the decoded first audio data to the DAC buffer for playing.
If the primary device fails to successfully transmit the first audio data to the secondary device over the LE ISOC link, the primary device may retransmit the first audio data.
The method 100 is illustratively described below in conjunction with fig. 7.
As shown in fig. 7, the master device is a left earphone and the slave device is a right earphone. The source device transmits target audio data to the master device through the BT link, wherein the source device encodes the target audio data through the AAC encoding format. And after receiving the target audio data, the main equipment decodes the target audio data to obtain PCM data. Then, the main device deinterleaves the PCM data to obtain second audio data corresponding to the left channel (CH _ L) and first audio data corresponding to the right channel (CH _ R). The main device buffers the second audio data DAC to be played, encodes the first audio data in an LC3 encoding format, and then sends the encoded first audio data to the auxiliary device through the LE ISOC link. After receiving the encoded first audio data through the LE ISOC link, the slave device decodes the encoded first audio data, and sends the decoded PCM data (i.e., the first audio data) to the DAC buffer for playing.
After the audio data is transmitted, the master device starts playing the second audio data, and the slave device starts playing the first audio data.
Because stereo audio data are transmitted between the main device and the auxiliary device, if the audio data synchronization precision is not high, the problem of sound asynchronization of left and right channels can be caused, and the hearing experience of a user is seriously influenced.
After the slave device decodes the first audio data, the master device and the slave device may time-align the first audio data and the second audio data and start playing the first audio data and the second audio data at the same time. That is, the start point of the first audio data and the start point of the second audio data are the same.
Optionally, the primary device and the secondary device may time align the first audio data and the second audio data according to a synchronization time reference specified by the LE ISOC protocol.
Alternatively, the master device and the slave device may time-align the first audio data and the second audio data with reference to a time of any one of the master device and the slave device.
Optionally, the master device and the slave device may negotiate a synchronization time reference to time align the first audio data and the second audio data.
It should be noted that, in the embodiment of the present application, in addition to the clock synchronization between the master device and the slave device, the clock synchronization between the master device and the source device is also required. Optionally, the master device may perform clock calibration each time audio data is transmitted and received with reference to the source device, so as to avoid the problem of clock asynchronism between different devices.
Optionally, in the embodiment of the present application, an audio start-up operation and an audio synchronization operation may be performed by using a characteristic of synchronous transmission of an LE ISOC link, and real-time audio synchronization is performed in each time unit, so as to complete an accurate audio synchronization effect. Illustratively, the time units may be time slots.
The master device may determine the start point of the second audio data according to the original start point of the second audio data, the transmission timeslot of the first link, the transmission timeslot of the BT link, and the FT.
Wherein, the original broadcast point of the second audio data is the broadcast point determined according to the bluetooth audio transmission model agreement (A2 DP). Alternatively, the original start point of the second audio data may be related to the number of frames of the target audio data transmitted by the source device, for example, the original start point of the second audio data may be a time point after the source device transmits N frames of the target audio data to the master device. The determination of the original starting point of the second audio data may refer to the prior art, and the embodiments of the present application are not described in detail.
It should be noted that, assuming that the first link only includes the LE ISOC link, the transmission timeslot of the first link is the transmission timeslot of the LEISOC link.
Referring to fig. 6, if the first link includes an LE ISOC link and an LE ACL link, the transmission time slot of the first link may be the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link.
Optionally, the start point of the second audio data may satisfy the following formula:
T=K+S+（FT-1）*I
wherein, T is the start point of the second audio data, K is the original start point of the second audio data, S is the transmission time slot of the first link, and I is the transmission time slot of the Bluetooth link and the first link.
Alternatively, S may be equal to 2.5ms, as shown in fig. 6.
Alternatively, as shown in fig. 6, I may be equal to 10 ms.
According to the technical scheme, if S =2.5ms and FT =1, after the source device sends the target audio data to the master device, the master device and the slave device can play the first audio data and the second audio data 2.5ms after the source device sends the target audio data to the master device. In general, the transmission delay of the BT link is over 100ms, and only 2.5ms increase has little effect on the overall delay.
The master device may send the first audio data to the slave device at an original start point of the second audio data, and after receiving the first audio data, the slave device may determine the start point of the first audio data according to a time point of receiving the first audio data, a transmission timeslot of the first link, a transmission timeslot of the BT link, and FT.
Alternatively, the start point T of the first audio data may satisfy the following formula:
T=K+S+（FT-1）*I
alternatively, K may be a time point when the master device transmits the first audio data to the slave device. Illustratively, the master device may tell the slave device, via the LE ACL link, the point in time at which it sent the first audio data itself. Further exemplarily, in the embodiment of the present application, a time point when the primary device transmits the first audio data and a time point when the secondary device receives the first audio data may be the same, that is, in the embodiment, K may also be a time point when the secondary device receives the first audio data.
The technical scheme can realize synchronous playing of the first audio data and the second audio data.
It should be noted that the audio synchronization of the embodiment of the present application only relates to the synchronization between the master device and the slave device, and does not relate to the audio synchronization between the master device and the source device.
It should be further noted that, if the transmission delay between the master device and the slave device is small, the transmission delay between the master device and the slave device may be ignored, that is, in the embodiment of the present application, it may be considered that a time point when the master device sends the first audio data to the slave device is the same as a time point when the slave device receives the first audio data. If the transmission delay between the master device and the slave device is large, the slave device may arbitrarily select a time point between a time point when the master device transmits the first audio data to the slave device and a time point when the slave device receives the first audio data as K.
For an electronic device comprising a primary device and a secondary device, at least one of, but not limited to, the following conditions may occur: the user has collected the master device, such as by placing the master earpiece in the charging box; the power consumption of the main device is inconsistent with that of the auxiliary device, for example, the power consumption speed of the main device is high, and when the power consumption of the main device is too low, even if the power consumption of the auxiliary device is sufficient, the main device and the auxiliary device cannot be used by a user continuously.
Thus, the method 100 may further comprise: and performing role switching between the main equipment and the auxiliary equipment, namely switching the original main equipment into new auxiliary equipment and switching the original auxiliary equipment into new main equipment.
In the embodiment of the present application, in the process of role switching between the primary device and the secondary device, audio data transmission between the primary device and the secondary device through the LE ISOC link does not stop. For example, when the roles of the primary device and the secondary device are switched, the primary device may continue to transmit the first audio data to the secondary device through the LE ISOC link, and the secondary device may continue to receive the first audio data transmitted by the primary device through the LE ISOC link. It should be understood that the "audio data" in "the audio data transmission between the primary device and the secondary device through the LEISOC link does not stop" may be other audio data besides the first audio data, and this is not limited in this embodiment of the present application.
Thus, when the roles of the main device and the auxiliary device are switched, the continuous transmission of the audio data between the main device and the auxiliary device can be ensured.
During the role switching between the primary device and the secondary device, the primary device may transfer the BT link with the source device to the secondary device. Specifically, after acquiring the link parameters of the BT link with the source device, the master device may transmit first information to the slave device, where the first information includes the link parameters.
Optionally, the primary device may send the first information to the secondary device over the LE ACL link.
Alternatively, the link parameters may include, but are not limited to, time information, channel information, frequency hopping information, encryption information, access codes, and the like.
After receiving the link parameters, the slave device may attempt to perform communication transmission with the source device according to the link parameters. If the slave device has begun communicating with the source device, it indicates that the slave device has switched to the new master device.
Next, the slave device may transmit second information indicating that the slave device has switched to a new master device to the original master device. Optionally, the secondary device may send the second information to the original primary device through the LE ACL link. After receiving the second information, the original master device may disconnect the BT link with the source device and switch to a new slave device.
It can be seen that the slave device needs to switch to a new master device according to the link parameters between the master device and the source device. If the master device communicates with the source device after telling the link parameters to the slave device, the link parameters will change. In this way, it is not possible for the slave device to successfully communicate with the source device based on the received link parameters.
Therefore, before the master device acquires the link parameters and starts communication transmission between the slave device and the source device, the master device may stop communication transmission with the source device. Therefore, the communication transmission between the slave equipment and the source equipment can be ensured according to the received link parameters.
Optionally, before role switching between the primary device and the secondary device, the primary device may send, to the secondary device, switching request information through the LE ACL link, where the switching request information is used to request role switching between the primary device and the secondary device.
If the primary device receives the switching request confirmation information sent by the secondary device through the LE ACL link, and the switching request confirmation information is used for indicating that the secondary device approves the switching request of the primary device, the role switching between the primary device and the secondary device can be started.
If the primary device receives the switching request confirmation information sent by the secondary device through the LE ACL link, but the switching request confirmation information is used for indicating that the secondary device does not agree with the switching request of the primary device, or the primary device does not receive the switching request confirmation information sent by the secondary device within a preset time, the role switching between the primary device and the secondary device is not performed.
The preset time may be specified by a protocol, or may be specified by the master device and the slave device.
In the case where the role switching between the master device and the slave device is not successful, the master device may start communication transmission with the source device again, and may then resume the role switching between the master device and the slave device.
The failure of the role switch between the master device and the slave device may include the following cases:
(1) the secondary device does not agree with the switching request of the primary device;
(2) the auxiliary equipment agrees with the switching request of the main equipment, but the auxiliary equipment is not successfully switched to the new main equipment;
(3) the auxiliary equipment is successfully switched to the new main equipment, but the main equipment does not receive second information sent by the auxiliary equipment;
(4) the auxiliary equipment is successfully switched to new main equipment, and the main equipment receives the second information sent by the auxiliary equipment, but the main equipment is not successfully switched to the new auxiliary equipment;
(5) after the master device tells the link parameters of the slave device, the slave device is not switched to a new master device, and the master device communicates with the source device.
It should be understood that if the communication transmission between the master device and the source device is not performed for a long time, the BT link between the master device and the source device may be flushed, and therefore, if the master device does not successfully switch the roles of the slave device and the master device, the master device needs to start the communication transmission with the source device again.
Fig. 8 is a specific procedure for switching roles between the master device and the slave device.
Step 1: the method comprises the steps that a main device sends switching request information to an auxiliary device, and the switching request information is used for requesting role switching between the main device and the auxiliary device.
Step 2: the slave device transmits handover request acknowledgement information to the master device.
If the switching request confirmation information is used for indicating that the auxiliary equipment agrees with the switching request of the main equipment, the main equipment executes the following steps; and if the switching request information is used for indicating the auxiliary equipment to reject the switching request of the main equipment, ending the role switching process.
And step 3: the main device obtains the link parameters and determines the anchor point of role switching, and then the main device sends second information to the auxiliary device through the LE ACL link, wherein the second information is used for indicating the auxiliary device to start communication transmission with the source device according to the link parameters, namely informing the auxiliary device of role switching.
And 4, step 4: and the secondary equipment attempts communication transmission with the source equipment according to the link parameters.
And if the communication transmission between the auxiliary equipment and the source equipment is successful, namely the auxiliary equipment is switched to be the new main equipment, sending second information to the main equipment to inform the original auxiliary equipment that the auxiliary equipment is switched to be the new main equipment. For example, if the original slave device sends an Acknowledgement (ACK) to the original master device, the original master device executes step 5.
If the secondary device does not successfully communicate with the source device, for example, the secondary device sends a negative acknowledgement (NCK) to the primary device, the primary device performs step 6.
In steps 3 and 4, the original master device does not perform communication transmission with the source device.
And 5: and the original main equipment is switched into new auxiliary equipment according to the determined anchor point. Where an anchor point may be understood as a point in time where an action is agreed upon between two devices. For example, the anchor point in the embodiment of the present application may be a time point at which the original master device is switched to a new secondary device, where the time point is agreed between the original master device and the original secondary device.
By this, the role switching process between the master device and the slave device is completed.
Step 6: the main device carries out communication transmission with the source device through the BT link and carries out role switching with the auxiliary device again.
In the embodiment of the application, audio data is transmitted between the third end (such as a source device) and the first end (such as a master device) through the bluetooth link, and the first end transmits the audio data to the second end (such as a slave device) through the LE ISOC link, so that the delivery time of the audio data sent from the first end to the second end is accurate and predictable, and the second end can achieve synchronization without buffering the audio data in a large amount, thereby reducing the time delay of audio data transmission.
In the embodiment of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by the function and the inherent logic of the process, and should not constitute any limitation on the implementation process of the embodiment of the present application.
Moreover, in the present application, the technical features of the embodiments and/or the technical features of the embodiments may be arbitrarily combined with each other, and the technical solutions obtained after the combination also fall within the protection scope of the present application.
Having described the method of audio data transmission of the embodiments of the present application in detail, the apparatus of audio data transmission of the embodiments of the present application will be described below. It should be understood that the apparatus for audio data transmission in the embodiments of the present application may perform the method for audio data transmission in the embodiments of the present application, and have a function of performing the corresponding method.
Fig. 9 shows a schematic block diagram of an apparatus 200 for audio data transmission according to an embodiment of the present application. As shown in fig. 9, the apparatus 200 for audio data transmission may include:
the communication unit 210 is configured to receive, through the bluetooth link, target audio data sent by the third end, where the target audio data is used to obtain first audio data, and the first audio data is used to be played on the second end side.
The communication unit 210 is further configured to transmit the first audio data to the second end via the LE ISOC link.
Optionally, in this embodiment of the present application, as shown in fig. 9, the apparatus 200 further includes: the processing unit 220 is configured to obtain second audio data according to the target audio data; determining a play-starting point of the second audio data according to an original play-starting point of the second audio data, the transmission time slot of the first link, the transmission time slot of the Bluetooth link and FT, wherein the original play-starting point of the second audio data is the play-starting point determined according to the A2DP protocol;
the communication unit 210 is specifically configured to: the first audio data is transmitted to the second end over the LE ISOC link at the original start point of the second audio data.
Optionally, in this embodiment of the present application, the processing unit 220 is specifically configured to: determining an original play start point of the second audio data, a transmission time slot of an LE ISOC link, a transmission time slot of an LE ACL link, a transmission time slot of a Bluetooth link and FT;
the start point of the second audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein, T is the start point of the second audio data, K is the original start point of the second audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LEACL link, and I is the transmission time slot of the Bluetooth link, the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link.
Optionally, in the embodiment of the present application, I =10 ms.
Optionally, in the embodiment of the present application, S =2.5 ms.
Optionally, in this embodiment of the present application, the communication unit 210 is further configured to: and sending request information to the second end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
Optionally, in this embodiment of the present application, as shown in fig. 9, the apparatus 200 further includes a creating unit 230, where the creating unit 230 is configured to: establishing the Bluetooth link with a third terminal before establishing the LE ISOC link.
Optionally, in this embodiment of the present application, as shown in fig. 9, the apparatus 200 further includes: the encoding unit 240 is configured to encode the first audio data in an LC3 encoding format before the communication unit 210 transmits the first audio data to the second end.
Optionally, in this embodiment of the present application, as shown in fig. 9, the apparatus 200 further includes: and a switching unit 250 configured to switch to the second end, wherein during the switching of the switching unit 250 to the second end, the transmission of the first audio data is not stopped between the communication unit 210 and the second end.
Optionally, in this embodiment of the present application, the code rate for transmitting the first audio data by the communication unit 210 is 96 kbps.
Optionally, in this embodiment of the present application, the third terminal does not support the low power consumption audio standard.
It should be understood that the apparatus 200 for audio data transmission may correspond to the master device in the method 100, and the corresponding operations of the master device in the method 100 may be implemented, which are not described herein again for brevity.
It should also be understood that the connections between the various functional blocks shown in fig. 9 may be direct connections or indirect connections.
Fig. 10 shows a schematic block diagram of an apparatus 300 for audio data transmission according to an embodiment of the present application. As shown in fig. 10, the apparatus 300 for audio data transmission may include:
the communication unit 310 is configured to receive first audio data sent by the first end through the low-power LE ISOC link, where the first audio data is audio data obtained by the first end according to target audio data sent by the third end, and the first end is connected to the third end through a bluetooth link.
The playing unit 320 is used for playing the first audio data.
Optionally, in this embodiment of the application, the first audio data is a part of audio data obtained by decoding, by the first end, the target audio data.
Optionally, in this embodiment of the present application, as shown in fig. 10, the apparatus 300 further includes: the processing unit 330 is configured to determine an origination point of the first audio data according to a time point when the communication unit 310 receives the first audio data or a time point when the first end sends the first audio data, a transmission timeslot of the LE ISOC link, a transmission timeslot of the bluetooth link, and FT.
Optionally, in this embodiment of the present application, the processing unit 330 is specifically configured to: determining a play start point of the first audio data according to a time point when the communication unit 310 receives the first audio data or a time point when the first end sends the first audio data, a transmission time slot of an LE ISOC link, a transmission time slot of an LE ACL link, a transmission time slot of a Bluetooth link and FT;
the start point of the first audio data satisfies the formula:
T= K+S+（FT-1）*I
where, T is a start point of the first audio data, K is a time point when the communication unit 310 receives the first audio data or a time point when the first end sends the first audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
Optionally, in the embodiment of the present application, I =10 ms.
Optionally, in the embodiment of the present application, S =2.5 ms.
Optionally, in this embodiment of the present application, the communication unit 310 is further configured to: and receiving request information sent by the first end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
Optionally, in this embodiment of the present application, the first audio data is audio data encoded in an LC3 encoding format.
Optionally, in this embodiment of the present application, as shown in fig. 10, the apparatus 300 further includes: a switching unit 340, configured to switch to the first end, wherein during the switching of the switching unit 340 to the first end, transmission of the first audio data is not stopped between the first end and the communication unit 310.
Optionally, in this embodiment of the application, the code rate at which the communication unit 310 receives the first audio data is 96 kbps.
Optionally, in this embodiment of the present application, the third terminal does not support the low power consumption audio standard.
It should be understood that the apparatus 300 for audio data transmission may correspond to a secondary device in the method 100, and corresponding operations of the secondary device in the method 100 may be implemented, which are not described herein again for brevity.
It should also be understood that the connections between the various functional blocks shown in fig. 10 may be direct connections or indirect connections.
The embodiment of the application also provides the electronic equipment. As shown in fig. 11, the electronic device 400 may include a first end 410 and a second end 420. The first end 410 may correspond to a master device in the method 100, and may implement corresponding operations of the master device in the method 100, and the second end 420 may correspond to an auxiliary device in the method 100, and may implement corresponding operations of the auxiliary device in the method 100, which is not described herein again for brevity.
The embodiment of the present application further provides a chip 500, where the chip 500 includes a memory 510 and a processor 520;
the memory 510 is coupled to the processor 520;
a memory 510 for storing program instructions;
the processor 520 is configured to call the program instructions stored in the memory, so that the chip performs corresponding operations of the master device in the method 100 for transmitting audio data according to any of the embodiments.
The embodiment of the present application further provides a chip 600, where the chip 600 includes a memory 610 and a processor 620;
the memory 610 is coupled to the processor 620;
a memory 610 for storing program instructions;
the processor 620 is used for calling the program instructions stored in the memory so as to enable the chip to execute the corresponding operations of the slave device in the method 100 for transmitting audio data, which is proposed in any embodiment.
The specific implementation process and beneficial effects of the chip provided by the embodiment of the application are referred to above, and are not described herein again.
It is to be understood that the terminology used in the embodiments of the present application and the appended claims is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the present application. For example, as used in the examples of this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Those of ordinary skill in the art will appreciate that the elements of the examples described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described above generally in terms of their functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed system and apparatus may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present application.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially or partially contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (47)

1. A method of audio data transmission, the method comprising:
the first end receives target audio data sent by the third end through a Bluetooth link, wherein the target audio data is used for obtaining first audio data, and the first audio data is used for playing on the second end side;
and the first end transmits the first audio data to the second end through a low-power-consumption synchronous LE ISOC link.
2. The method of claim 1, further comprising:
the first end obtains second audio data according to the target audio data;
the first end determines the start-up point of the second audio data according to the original start-up point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT, wherein the original start-up point of the second audio data is the start-up point determined according to the Bluetooth audio transmission model agreement A2DP protocol;
the first end transmits the first audio data to the second end through a low-power synchronous LE ISOC link, including:
and the first end transmits the first audio data to the second end through the LE ISOC link at the original play point of the second audio data.
3. The method of claim 2, wherein the first end determining the origin point of the second audio data according to the original origin point of the second audio data, the transmission timeslot of the LE ISOC link, the transmission timeslot of the bluetooth link, and a refresh timeout FT, comprises:
the first end determines the play start point of the second audio data according to the original play start point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE asynchronous connectionless ACL link, the transmission time slot of the Bluetooth link and the refresh timeout FT;
the start point of the second audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein T is a start point of the second audio data, K is an original start point of the second audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
4. The method of claim 3, wherein I =10 ms.
5. The method according to claim 3 or 4, characterized in that S =2.5 ms.
6. The method according to claim 3 or 4, characterized in that the method further comprises:
and the first end sends request information to the second end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
7. The method of claim 6, wherein prior to establishing the LE ISOC link, the method further comprises:
the first end establishes the bluetooth link with the third end.
8. The method of any of claims 1-4, wherein prior to the first end transmitting the first audio data to the second end, the method further comprises:
the first end encodes the first audio data in a low complexity LC3 encoding format.
9. The method according to any one of claims 1 to 4, further comprising:
and the first end is switched to the second end, wherein the transmission of the first audio data is not stopped between the first end and the second end in the process of switching the first end to the second end.
10. The method according to any of claims 1 to 4, wherein the code rate for the first end to transmit the first audio data is 96 kbps.
11. The method of any of claims 1-4, wherein the third end does not support a low power audio standard.
12. A method of audio data transmission, the method comprising:
the second end receives first audio data sent by the first end through a low-power-consumption synchronous LE ISOC link, wherein the first audio data are used for being played at the second end side, the first audio data are audio data obtained by the first end according to target audio data sent by the third end, and the first end is connected with the third end through a Bluetooth link.
13. The method of claim 12, wherein the first audio data is a portion of audio data obtained by the first end decoding the target audio data.
14. The method according to claim 12 or 13, characterized in that the method further comprises:
and the second end determines the play start point of the first audio data according to the time point of receiving the first audio data or the time point of sending the first audio data by the first end, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT.
15. The method of claim 14, wherein the second peer determines the start point of the first audio data according to the time point of receiving the first audio data or the time point of sending the first audio data by the first peer, the transmission slot of the LE ISOC link, the transmission slot of the bluetooth link, and a refresh timeout FT, and comprises:
the second end determines a play start point of the first audio data according to a time point of receiving the first audio data or a time point of sending the first audio data by the first end, a transmission time slot of the LE ISOC link, a transmission time slot of the LE asynchronous connectionless ACL link, a transmission time slot of the Bluetooth link and a refresh timeout FT;
the start point of the first audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein T is a start point of the first audio data, K is a time point when the second end receives the first audio data or a time point when the first end sends the first audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
16. The method of claim 15, wherein I =10 ms.
17. The method of claim 15, wherein S =2.5 ms.
18. The method of claim 15, further comprising:
and the second end receives request information sent by the first end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
19. The method of claim 12 or 13, wherein the first audio data is audio data encoded using a low complexity LC3 encoding format.
20. The method according to claim 12 or 13, characterized in that the method further comprises:
and the second end is switched to be the first end, wherein the transmission of the first audio data is not stopped between the first end and the second end in the process of switching the second end to be the first end.
21. The method according to claim 12 or 13, wherein the code rate at which the second end receives the first audio data is 96 kbps.
22. The method of claim 12 or 13, wherein the third terminal does not support a low power audio standard.
23. An apparatus for audio data transmission, the apparatus being a first end, comprising:
the communication unit is used for receiving target audio data sent by a third end through a Bluetooth link, wherein the target audio data is used for obtaining first audio data, and the first audio data is used for playing on a second end side;
the communication unit is further configured to transmit the first audio data to the second end via a low power consumption synchronous LE ISOC link.
24. The apparatus of claim 23, further comprising a processing unit to:
obtaining second audio data according to the target audio data;
determining an origin play point of the second audio data according to the original play point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT, wherein the original play point of the second audio data is the play point determined according to the Bluetooth audio transmission model agreement A2DP protocol;
the communication unit is specifically configured to:
transmitting the first audio data to the second end over the LE ISOC link at an original start point of the second audio data.
25. The apparatus according to claim 24, wherein the processing unit is specifically configured to:
determining the play starting point of the second audio data according to the original play starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE asynchronous connectionless ACL link, the transmission time slot of the Bluetooth link and the refresh timeout FT;
the start point of the second audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein T is a start point of the second audio data, K is an original start point of the second audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link, and a transmission timeslot of the LE ACL link.
26. The apparatus of claim 25, wherein I =10 ms.
27. The apparatus according to claim 25 or 26, wherein S =2.5 ms.
28. The apparatus of claim 25 or 26, wherein the communication unit is further configured to:
and sending request information to the second end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
29. The apparatus of claim 28, further comprising a setup unit configured to:
establishing the Bluetooth link with the third terminal before establishing the LE ISOC link.
30. The apparatus of any one of claims 23 to 26, further comprising:
an encoding unit, configured to encode the first audio data in a low-complexity LC3 encoding format before the communication unit transmits the first audio data to the second end.
31. The apparatus of any one of claims 23 to 26, further comprising:
and the switching unit is used for switching to the second end, wherein the transmission of the first audio data is not stopped between the communication unit and the second end in the process of switching to the second end by the switching unit.
32. The apparatus according to any of claims 23-26, wherein the code rate for the communication unit to transmit the first audio data is 96 kbps.
33. The apparatus of any of claims 23-26, wherein the third terminal does not support a low power audio standard.
34. An apparatus for audio data transmission, the apparatus being a second terminal, comprising:
the communication unit is used for receiving first audio data sent by a first end through a low-power-consumption synchronous LE ISOC link, wherein the first audio data is audio data obtained by the first end according to target audio data sent by a third end, and the first end is connected with the third end through a Bluetooth link;
and the playing unit is used for playing the first audio data.
35. The apparatus of claim 34, wherein the first audio data is a portion of audio data decoded by the first end from the target audio data.
36. The apparatus of claim 34 or 35, further comprising:
and the processing unit is used for determining a play-starting point of the first audio data according to the time point when the communication unit receives the first audio data or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT.
37. The apparatus according to claim 36, wherein the processing unit is specifically configured to:
determining a play start point of the first audio data according to a time point when the communication unit receives the first audio data or a time point when the first end sends the first audio data, a transmission time slot of the LE ISOC link, a transmission time slot of the LE asynchronous connectionless ACL link, a transmission time slot of the Bluetooth link and a refresh timeout FT;
the start point of the first audio data satisfies the formula:
T=K+S+（FT-1）*I
wherein, T is a start point of the first audio data, K is a time point when the communication unit receives the first audio data or a time point when the first end sends the first audio data, S is a sum of a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link, and I is a sum of a transmission timeslot of the bluetooth link, a transmission timeslot of the LE ISOC link and a transmission timeslot of the LE ACL link.
38. The apparatus of claim 37, wherein I =10 ms.
39. The apparatus of claim 37, wherein S =2.5 ms.
40. The apparatus of claim 37, wherein the communication unit is further configured to:
and receiving request information sent by the first end through the LE ACL link, wherein the request information is used for requesting to establish the LE ISOC link.
41. The apparatus of claim 34 or 35, wherein the first audio data is audio data encoded using a low complexity LC3 encoding format.
42. The apparatus of claim 34 or 35, further comprising:
and the switching unit is used for switching to the first end, wherein the transmission of the first audio data between the first end and the communication unit is not stopped in the process of switching to the first end by the switching unit.
43. The apparatus according to claim 34 or 35, wherein the code rate at which the communication unit receives the first audio data is 96 kbps.
44. The apparatus of claim 34 or 35, wherein the third terminal does not support a low power audio standard.
45. A chip for implementing a method of audio data transmission, comprising a memory and a processor;
the memory is coupled with the processor;
the memory to store program instructions;
the processor is configured to call the program instructions stored in the memory, so that the chip executes the method for transmitting audio data according to any one of claims 1 to 11.
46. A chip for implementing a method of audio data transmission, comprising a memory and a processor;
the memory is coupled with the processor;
the memory to store program instructions;
the processor is configured to call the program instructions stored in the memory, so that the chip executes the method of audio data transmission according to any one of claims 12 to 22.
47. An electronic device, comprising:
a first end according to any one of claims 23 to 33;
a second end according to any one of claims 34 to 44;
the first end is connected with a third end through a Bluetooth link, and a low-power consumption synchronous LE ISOC link exists between the first end and the second end.
CN202010383066.9A 2020-05-08 2020-05-08 Audio data transmission method, device, chip and electronic equipment Active CN111294783B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010383066.9A CN111294783B (en) 2020-05-08 2020-05-08 Audio data transmission method, device, chip and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010383066.9A CN111294783B (en) 2020-05-08 2020-05-08 Audio data transmission method, device, chip and electronic equipment

Publications (2)

Publication Number Publication Date
CN111294783A true CN111294783A (en) 2020-06-16
CN111294783B CN111294783B (en) 2020-09-04

Family

ID=71028796

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010383066.9A Active CN111294783B (en) 2020-05-08 2020-05-08 Audio data transmission method, device, chip and electronic equipment

Country Status (1)

Country Link
CN (1) CN111294783B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112000308A (en) * 2020-09-10 2020-11-27 成都拟合未来科技有限公司 Double-track audio playing control method, system, terminal and medium
CN112135285A (en) * 2020-09-30 2020-12-25 深圳市烎潮科技有限公司 Real-time audio interaction method of multiple Bluetooth audio devices
CN112130616A (en) * 2020-09-28 2020-12-25 北京小米松果电子有限公司 Clock synchronization method, device and storage medium
CN112423053A (en) * 2020-11-06 2021-02-26 歌尔科技有限公司 Audio sharing method, system, remote controller and computer readable storage medium
CN113242546A (en) * 2021-06-25 2021-08-10 南京中感微电子有限公司 Audio forwarding method, device and storage medium
CN113347614A (en) * 2021-04-29 2021-09-03 深圳市亚昱科技有限公司 Audio processing apparatus, system and method
CN113472764A (en) * 2021-06-24 2021-10-01 深圳市亚昱科技有限公司 Electronic device and audio transmission method
WO2021223243A1 (en) * 2020-05-08 2021-11-11 深圳市汇顶科技股份有限公司 Audio data transmission method and apparatus, chip, and electronic device
WO2022134734A1 (en) * 2020-12-22 2022-06-30 Oppo广东移动通信有限公司 Wireless communication method and system
CN115226080A (en) * 2021-04-21 2022-10-21 Oppo广东移动通信有限公司 Audio data receiving and transmitting method, audio receiving device and audio transmitting device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107040874A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Method, device and the bluetooth equipment of blue-teeth data simultaneously operating
CN107040848A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Synchronization parameter transmission method, device and the equipment of AVDTP agreements
CN107124674A (en) * 2017-06-20 2017-09-01 歌尔科技有限公司 A kind of audio-frequency inputting method of bluetooth earphone, device and bluetooth earphone
CN108271095A (en) * 2017-12-20 2018-07-10 建荣半导体（深圳）有限公司 A kind of major and minor Bluetooth audio equipment and its synchronous playing system and method
CN110213691A (en) * 2019-06-26 2019-09-06 上海富芮坤微电子有限公司 A kind of synchronization mechanism of TWS audio transmission
US20190393932A1 (en) * 2018-06-25 2019-12-26 Mediatek Inc. Multi-in multi-out bluetooth module, and wireless device using the multi-in multi-out bluetooth module

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107040874A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Method, device and the bluetooth equipment of blue-teeth data simultaneously operating
CN107040848A (en) * 2017-03-07 2017-08-11 建荣半导体（深圳）有限公司 Synchronization parameter transmission method, device and the equipment of AVDTP agreements
CN107124674A (en) * 2017-06-20 2017-09-01 歌尔科技有限公司 A kind of audio-frequency inputting method of bluetooth earphone, device and bluetooth earphone
CN108271095A (en) * 2017-12-20 2018-07-10 建荣半导体（深圳）有限公司 A kind of major and minor Bluetooth audio equipment and its synchronous playing system and method
US20190393932A1 (en) * 2018-06-25 2019-12-26 Mediatek Inc. Multi-in multi-out bluetooth module, and wireless device using the multi-in multi-out bluetooth module
CN110213691A (en) * 2019-06-26 2019-09-06 上海富芮坤微电子有限公司 A kind of synchronization mechanism of TWS audio transmission

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
BLUETOOTH SIG: "Specification of the Bluetooth System Volume 1 Architecture, Mixing, and Conventions", 《BLUETOOTH CORE SPECIFICATION V5.2》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021223243A1 (en) * 2020-05-08 2021-11-11 深圳市汇顶科技股份有限公司 Audio data transmission method and apparatus, chip, and electronic device
CN112000308A (en) * 2020-09-10 2020-11-27 成都拟合未来科技有限公司 Double-track audio playing control method, system, terminal and medium
WO2022053079A3 (en) * 2020-09-10 2022-04-28 成都拟合未来科技有限公司 Dual-track audio playback control method and system, terminal, and medium
CN112130616A (en) * 2020-09-28 2020-12-25 北京小米松果电子有限公司 Clock synchronization method, device and storage medium
CN112135285A (en) * 2020-09-30 2020-12-25 深圳市烎潮科技有限公司 Real-time audio interaction method of multiple Bluetooth audio devices
CN112423053A (en) * 2020-11-06 2021-02-26 歌尔科技有限公司 Audio sharing method, system, remote controller and computer readable storage medium
CN112423053B (en) * 2020-11-06 2024-04-09 歌尔科技有限公司 Audio sharing method, system, remote controller and computer readable storage medium
WO2022134734A1 (en) * 2020-12-22 2022-06-30 Oppo广东移动通信有限公司 Wireless communication method and system
CN115226080A (en) * 2021-04-21 2022-10-21 Oppo广东移动通信有限公司 Audio data receiving and transmitting method, audio receiving device and audio transmitting device
CN113347614A (en) * 2021-04-29 2021-09-03 深圳市亚昱科技有限公司 Audio processing apparatus, system and method
CN113472764A (en) * 2021-06-24 2021-10-01 深圳市亚昱科技有限公司 Electronic device and audio transmission method
CN113472764B (en) * 2021-06-24 2024-03-08 深圳市亚昱科技有限公司 Electronic device and audio transmission method
CN113242546A (en) * 2021-06-25 2021-08-10 南京中感微电子有限公司 Audio forwarding method, device and storage medium

Also Published As

Publication number Publication date
CN111294783B (en) 2020-09-04

Similar Documents

Publication Publication Date Title
CN111294783B (en) Audio data transmission method, device, chip and electronic equipment
CN114982369A (en) Audio data transmission method, device, chip and electronic equipment
US10932043B2 (en) Wireless audio system and method for wirelessly communicating audio information using the same
TWI742369B (en) Method, apparatus, and comupter-readable medium for low-latency audio streaming with communication coexistence
US10412481B1 (en) Operation mode switch of wireless headphones
US20190104424A1 (en) Ultra-low latency audio over bluetooth
TWI513213B (en) Synchronization of multi-channel audio communicated over bluetooth low energy
US20150312858A1 (en) Method and apparatus for generating a bluetooth low energy data packet comprising audio payload data
TW200805901A (en) Method and system for optimized architecture for bluetooth streaming audio applications
CN112437369B (en) Audio data transmission method and system, TWS earphone pair, chip and medium
CN111869142B (en) Data transmission method, device, equipment, system and medium
CN112492449A (en) Wireless earphone receiver and wireless earphone
EP1701484A1 (en) Improved interoperability when content protection is used with an audio stream
EP3923608B1 (en) Data transmission method between tws bluetooth devices and tws bluetooth device therefor
CN110166988B (en) Wireless communication system and method thereof
TW202345560A (en) Wireless microphone synchronization for btoip tws earbuds
KR20080022073A (en) Wireless communication apparatus and method for multi voice communications on low-rate wireless personal area network
CN112218197B (en) Audio compensation method and wireless audio output device using same
EP4114036A1 (en) Method and system for transmitting audio data wirelessly
WO2022134734A1 (en) Wireless communication method and system
WO2024087219A1 (en) Audio data transmission method and apparatus, and chip, device and storage medium
US20230353920A1 (en) Wireless headset and audio device
CN114979900A (en) Wireless earphone and audio sharing method
TW202315430A (en) Bluetooth voice communication system and related computer program product for generating stereo voice effect
CN111385775A (en) Wireless transmission system and method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant