CN114827973B

CN114827973B - Binaural consistency control method, graphical interface, system and related device

Info

Publication number: CN114827973B
Application number: CN202210750483.1A
Authority: CN
Inventors: 索亚运
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-06-29
Filing date: 2022-06-29
Publication date: 2022-11-29
Anticipated expiration: 2042-06-29
Also published as: CN114827973A

Abstract

The application provides a binaural consistency control method, a graphical interface, a system and a related device. In the method, the time for triggering consistency detection is determined according to user operation or earphone states, under the condition of triggering consistency detection, the binaural information is respectively compared with target information or between the binaural information, and when the binaural information is the same as the target information or the binaural information is the same, the binaural information is determined not to need consistency adjustment; and when the information of any one of the ears and the ears is different from the target information or the information of the ears is different, controlling the information of the ears to be consistent. The target information is related information of the earphone determined according to user operation. In this way, a consistent binaural experience may be brought to the user.

Description

Binaural consistency control method, graphical interface, system and related device

Technical Field

The present application relates to the field of terminals, and in particular, to a binaural consistency control method, a graphical interface, a system, and a related apparatus.

Background

With the development of wireless communication technology, wireless headsets are also widely used. The wireless headset comprises two earphones, one of the two earphones (generally called a main ear) can establish wireless communication connection with the electronic equipment through a wireless communication protocol, and the two earphones (namely the main ear and an auxiliary ear) can also establish wireless communication connection through the wireless communication protocol. Or both earphones can establish wireless communication connection with the electronic equipment through a wireless communication protocol respectively. Based on the wireless communication connection, information interaction can be carried out between the electronic equipment and the wireless earphone and between ears, so that control over the ears is realized.

How to control the information of the two earphones to be synchronous, so as to bring consistency experience to users, is a problem to be solved urgently.

Disclosure of Invention

The application provides a binaural consistency control method, a graphical interface, a system and a related device. In the method, under the condition of trigger consistency detection, comparing the binaural information with target information or comparing the binaural information with the target information, and when the binaural information is the same as the target information or the binaural information is the same, determining that the binaural information does not need to be subjected to consistency adjustment; and when the information of any one of the ears and the ears is different from the target information or the information of the ears is different, controlling the information of the ears to be consistent. In this way, a consistent binaural experience may be brought to the user.

In a first aspect, the present application provides a binaural consistency control method, applied to a first headphone, the method including: the first earphone detects a first user operation, and the first user operation indicates target information; the first earphone acquires first information of the first earphone and second information of the second earphone; and under the condition that the first information and/or the second information are/is not consistent with the target information, the first earphone is controlled by the first earphone to update the first information into the target information, and/or the second earphone is controlled by the second earphone to update the second information into the target information.

After the method provided by the first aspect is implemented, the earphones can trigger consistency detection on the binaural information according to the detected user operation, and when the binaural information is inconsistent, the binaural information is adjusted to be consistent in time or adjusted to be consistent with target information corresponding to the user operation, so that the two earphones bring better consistency experience to the user.

In connection with the method provided by the first aspect, after the first headset detects the first user operation, the method further includes:

the first earphone determines corresponding trigger time according to the first user operation, wherein the trigger time is used for indicating the first earphone to acquire first information of the first earphone and second information of the second earphone when the trigger time is reached.

Therefore, the earphone can timely detect the problem of inconsistency of the binaural information, so that the inconsistent experience of a user is avoided being brought for a long time under the condition that the ears are inconsistent, and the phenomenon that the binaural information is detected and equipment resources are wasted under the condition that the ears are consistent is also avoided.

In a second aspect, the present application provides a binaural consistency control method, applied to a first headphone, the method comprising: the first earphone receives a first message, the first message indicates that the electronic equipment or the second earphone detects a first user operation, and the first user operation indicates target information; the first earphone acquires first information of the first earphone and second information of the second earphone; and under the condition that the first information and/or the second information are/is not consistent with the target information, the first earphone is controlled by the first earphone to update the first information into the target information, and/or the second earphone is controlled by the second earphone to update the second information into the target information.

After the method provided by the second aspect is implemented, the earphones can perform consistency detection on the binaural information according to the received operation of the user acting on other equipment, such as a mobile phone or another earphone, and when the binaural information is inconsistent, the binaural information is adjusted to be consistent in time, or the target information corresponding to the user operation is adjusted to be consistent, so that the two earphones bring better consistency experience to the user.

In connection with the method provided by the second aspect, after the first message is received by the first headset, the method further comprises: and the first earphone determines corresponding trigger time according to the first message, wherein the trigger time is used for indicating the first earphone to acquire the first information of the first earphone and the second information of the second earphone when the trigger time is reached.

Therefore, the earphone can timely detect the problem of inconsistent binaural information, so that inconsistent experience of a user for a long time is avoided under the condition that the ears are inconsistent, and detection of binaural information and waste of equipment resources are also avoided under the condition that the ears are consistent.

In a third aspect, the present application provides a binaural consistency control method, which is applied to a first headphone, and includes:

the first earpiece detects a first state that includes any one or more of: the first earphone and the second earphone are connected, the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed; the first earphone acquires first information of the first earphone and second information of the second earphone; and under the condition that the first information is inconsistent with the second information, the first earphone and the second earphone carry out information synchronization.

After the method provided by the third aspect is implemented, the earphones can trigger consistency detection on the binaural information according to the earphone states, and when the binaural information is inconsistent, the binaural information is adjusted to be consistent in time or adjusted to be consistent with target information corresponding to user operation, so that the two earphones bring better consistency experience to the user.

In combination with the method provided by the third aspect, after the first earpiece detects the first state, the method further comprises: and the first earphone determines corresponding trigger time according to the first state, wherein the trigger time is used for indicating the first earphone to acquire first information of the first earphone and second information of the second earphone when the trigger time is reached.

In combination with the method provided in the first, second or third aspect, the first information is any one or more of the following for the first headset: volume, operating mode, over-the-air OTA upgrade package, clock or pairing information; the second information is any one or more of the following of the second earphone: volume, mode of operation, OTA upgrade package, clock, or pairing information.

Therefore, by implementing the methods provided by the first, second and third aspects, the problem of inconsistency of multiple kinds of binaural information can be detected in time, and a comprehensive binaural consistency experience is brought to a user.

In a fourth aspect, the present application provides a binaural consistency control method, applied to a first headphone, the method including: the first earpiece detects a first state that includes any one or more of: the first earphone and the second earphone are connected, the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed; the first earphone receives a second message, and the second message indicates the electronic equipment to only obtain the electric quantity of the first earphone; the first earphone acquires the electric quantity of the second earphone; the first earphone sends the electric quantity of the second earphone to the electronic equipment, and the electric quantity of the first earphone and the electric quantity of the second earphone are displayed by the electronic equipment at the same time.

After the method provided by the fourth aspect is implemented, the earphones can trigger consistency detection on the electric quantity prompt information of the ears according to the earphone states, when the prompt information of the electric quantity of the ears is not synchronously displayed by the electronic equipment, the electronic equipment timely acquires the circuit of the earphone which is not displayed, then the electric quantity prompt information of the two earphones is synchronously displayed, and further more excellent consistency experience is brought to a user.

In combination with the method provided by the fourth aspect, after the first headset transmits the power of the second headset to the electronic device, the method further includes: the electronic equipment displays the electric quantity of the first earphone and the electric quantity of the second earphone on a negative screen or a main interface;

or after receiving the user operation, the electronic device displays the electric quantity of the first earphone and the electric quantity of the second earphone.

Therefore, the electronic equipment can display the electric quantity prompt information of the two earphones on various interfaces.

The method provided in connection with the fourth aspect, applied to a wireless audio system comprising: the first earphone, the second earphone and the electronic equipment; the first earpiece is for performing a method as described in any one of the first, second, third or fourth.

In a fifth aspect, the present application provides a binaural consistency control method, which is applied to a wireless audio system including: the device comprises a trigger detection module, a consistency detection module and a consistency adjustment module; the method comprises the following steps: the trigger detection module detects a first user operation, and determines corresponding trigger time according to the first user operation, wherein the first user operation indicates target information; the consistency detection module acquires first information of the first earphone and second information of the second earphone in the trigger time; under the condition that the first information and/or the second information are/is not consistent with the target information, the consistency detection module controls the consistency adjustment module to update the first information of the first earphone to the target information and/or update the second information of the second earphone to the target information; or, the trigger detection module detects a first state, and determines a corresponding trigger time according to the first state, where the first state includes any one or more of: establishing a connection between a first earphone and a second earphone, wherein the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed; the consistency detection module acquires first information of the first earphone and second information of the second earphone in the trigger time; and under the condition that the first information is inconsistent with the second information, the consistency detection module controls the consistency adjustment module to synchronize the information of the first earphone and the information of the second earphone.

After the method provided by the fifth aspect is implemented, the wireless audio system may trigger consistency detection on the binaural information according to user operation or an earphone state, and when the binaural information is inconsistent, the binaural information is adjusted to be consistent in time, or the target information corresponding to the user operation is adjusted to be consistent, so that the two earphones bring better consistent experience to the user.

In combination with the method provided by the fifth aspect, the wireless audio system comprises an electronic device, the first earpiece and the second earpiece; the trigger detection module, the consistency detection module and the consistency adjustment module can be arranged in the electronic equipment, the first earphone or the second earphone.

In this way, the module for achieving binaural consistency may be disposed in any device in the wireless audio system, including the electronic device, the first earpiece or the second earpiece, thereby improving the implementability of the scheme of the application.

The method provided in connection with the fifth aspect, the first user action includes any one or more of: the earphone volume adjusting device is used for adjusting the earphone volume, switching the earphone working mode, upgrading information through OTA or matching the earphone.

Therefore, the consistency detection of the binaural information can be triggered according to various operations of the user, and the user can control the earphone daily during the triggering operations without externally inputting the operation of triggering the consistency detection, so that the user can be provided with the non-perception consistency control experience.

With reference to the method provided by the fifth aspect, the trigger time is specifically a first time after the first user operation or the first state is detected; the first time is a default fixed time; or, the first time is the same as the time required for executing the service corresponding to the first user operation; alternatively, the first time corresponds to the first state.

In this way, the trigger time may be a default set fixed time (for example, the 5 th s after detecting the user operation/the headphone state), or may be determined according to the time required for executing different services corresponding to different user operations, or the trigger time may be determined according to different headphone states, so that a more appropriate and accurate trigger time may be obtained, which avoids bringing inconsistent experience to the user for a long time under the condition that the ears are inconsistent, and also avoids detecting the binaural information and wasting device resources under the condition that the ears are consistent.

With reference to the method provided by the fifth aspect, in a case that the trigger detection module determines the trigger time according to the detected first user operation, the first information is any one or more of the following items of the first headset: volume, operating mode, over-the-air OTA upgrade package, clock or pairing information; the second information is any one or more of the following of the second earphone: volume, operating mode, OTA upgrade package, clock or pairing information; under the condition that the trigger detection module determines the trigger time according to the detected first state, the first information is the electric quantity of the first earphone; the second information is the electric quantity of the second earphone.

Therefore, the problem of inconsistency of multiple kinds of binaural information can be detected in time, and comprehensive binaural consistency experience is brought to the user.

In a sixth aspect, the present application provides a chip for application to a headset, the headset comprising one or more processors for invoking computer instructions to cause the headset to perform the method as described in any one of the first to fourth aspects above.

In a seventh aspect, the present application provides a wireless audio system comprising: the earphone comprises a first earphone, a second earphone and electronic equipment; the first earpiece is for performing a method as described in any of the first to fourth aspects above.

In an eighth aspect, the present application provides a headset comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, the one or more memories for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the headset to perform the method as described in any of the first to fourth aspects above.

Drawings

Fig. 1A is a schematic diagram of a wireless audio system 10 according to an embodiment of the present application;

fig. 1B is a schematic diagram of a wireless audio system 20 according to an embodiment of the present application;

FIG. 1C is a schematic diagram of a wireless audio system 30 according to an embodiment of the present application;

fig. 2A is a schematic hardware structure diagram of an electronic device 100 according to an embodiment of the present disclosure;

fig. 2B is a schematic diagram of a software structure of the electronic device 100 according to an embodiment of the present disclosure;

fig. 2C is a schematic hardware structure diagram of the wireless audio device 200 according to an embodiment of the present disclosure;

fig. 2D is a schematic diagram of a software structure of the wireless audio device 200 according to an embodiment of the present application;

3A-3D are a set of schematic user interface diagrams provided by embodiments of the present application;

FIGS. 4A-4C are schematic diagrams of another set of user interfaces provided by embodiments of the present application;

fig. 5 is a flowchart of a binaural consistency control method according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described in detail and clearly with reference to the accompanying drawings. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; the "and/or" in the text is only an association relation describing the association object, and indicates that three relations may exist, for example, a and/or B may indicate: a exists alone, A and B exist simultaneously, and B exists alone.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.

Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The term "User Interface (UI)" in the following embodiments of the present application is a media interface for interaction and information exchange between an application program or an operating system and a user, and implements conversion between an internal form of information and a form acceptable to the user. The user interface is source code written by java, extensible markup language (XML) and other specific computer languages, and the interface source code is analyzed and rendered on the electronic device and finally presented as content which can be identified by the user. A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be a visual interface element such as text, an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. displayed in the display of the electronic device.

The wireless audio system comprises electronic equipment and wireless audio equipment, wherein the wireless audio equipment comprises two wireless earphones. In the process of using the two wireless earphones by a user, the two earphones of the left ear and the right ear are matched with each other, and the mutual matching means that the information of the two earphones needs to be synchronous. The information of The two earphones, including but not limited to volume, working mode, over The Air (OTA) upgrade package, clock, pairing information and The like of The two earphones should be synchronized, and The electric quantity prompt information of The two earphones should also be synchronized, so that good experience feeling of binaural consistency can be brought to a user.

Next, the wireless audio system, the electronic device, and the software and hardware of the wireless audio device according to the present application will be described in detail.

The consistency control method for the wireless earphones, provided by the application, is suitable for three wireless audio systems, and specifically comprises the following steps:

referring to fig. 1A, fig. 1A illustrates a wireless audio system 10 according to the present application.

As shown in fig. 1A, the wireless audio system 10 may include an electronic device 100, a wireless audio device 200. The wireless audio device 200 may include, among other things, an audio output device 201 (e.g., as a primary ear) and an audio output device 202 (e.g., as a secondary ear). Optionally, the wireless audio system 10 may further include an earphone box 203 (not shown in the figure).

Wherein, the electronic device 100 may be a terminal device that mounts iOS, android, microsoft, or other operating systems, such as a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) device, a Virtual Reality (VR) device, an Artificial Intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, and/or a smart city device, and the like. The present application does not impose any limitations on the specific type of electronic device 100.

The audio output device 201 and the audio output device 202 may be a left ear and a right ear of a pair of wireless earphones, which may be True Wireless Stereo (TWS) earphones. That is, there is no cable connection between the two wireless headsets, and communication can be performed specifically through the wireless communication connection 11, rather than through a wired communication connection. One of the two wireless headsets may serve only as a primary ear (e.g., audio output device 201) for communicating with the electronic device 100 via the wireless communication link 12. The audio output device as the main ear may be set by default, may be customized by a user, or may be dynamically switched according to the state of the earphone during use. The embodiments of the present application do not limit this. In the present application, the two wireless earphones included in the wireless audio device 200 are a first earphone and a second earphone, respectively, wherein the main ear may be referred to as the first earphone, and the accessory ear may be referred to as the second earphone; alternatively the primary ear may be referred to as the second earpiece and the accessory ear as the first earpiece.

In the wireless audio system 10, a wireless communication connection 12 is established between the electronic device 100 and the audio output device 201. A wireless communication connection 11 is established between the audio output device 201 and the audio output device 202. The wireless communication connection 12 may be a bluetooth connection, and the wireless communication connection 11 may be a bluetooth connection.

The wireless communication link 12 is used to transmit data, including audio data, control data and status data, between the electronic device 100 and the audio output device 201. Specifically, the electronic apparatus 100 may transmit audio data and control data to the audio output apparatus 201 through the wireless communication connection 12, the audio output apparatus 201 plays music according to the audio data, controls the audio output apparatus 201 to perform a corresponding event according to the control data, and transmits the control data and the audio data to the audio output apparatus 202 through the wireless communication connection 11. The audio output device 201 may also transmit the status information of the audio output device 201 and the status information of the audio output device 202 to the electronic device 100 through the wireless communication connection 12, and the status information of the audio output device 202 is transmitted by the audio output device 202 to the audio output device 201 through the wireless communication connection 11.

The wireless communication connection 11 is used for transmitting data between the audio output device 201 and the audio output device 202, including control data, audio data and status information of the audio output device 202. Specifically, the audio output device 201 can transmit control data and audio data, which were previously transmitted by the electronic device 100 to the audio output device 201 via the wireless communication connection 12, to the audio output device 202 via the wireless communication connection 11. The audio output device 202 may also transmit the status information of the audio output device 202 to the audio output device 201 through the wireless communication connection 11, and then the audio output device 201 transmits the status information of the audio output device 202 to the electronic device 100.

Take a specific interactive scenario as an example. When the audio output device 201 and the audio output device 202 are powered on, that is, after the audio output device 201 and the audio output device 202 are switched to the working state, the audio output device 201 and the audio output device 202 are paired through a wireless communication protocol, and if the pairing is successful, the wireless communication connection 11 is established. Also, the audio output device 201, which is in the main ear role of the audio output device 201 and the audio output device 202, can establish the wireless communication connection 12 with the electronic device 100. After that, the electronic device 100 and the main ear may exchange audio data, control data, etc. through the wireless communication connection 12, and after the audio output device 201 as the main ear receives the audio data and the control data transmitted by the electronic device 100, the audio output device 201 as the main ear may transmit the audio data and the control data to the audio output device 202 as the sub-ear through the wireless communication connection 11.

In the wireless audio system 10, the wireless communication connection 11 and the wireless communication connection 12 are usually kept connected for a long time, because the audio data used for interaction is not sporadic, the electronic device 100 needs to transmit an audio stream to the main ear through the wireless communication connection 12 for a long time, and after receiving the audio stream transmitted by the electronic device 100, the main ear forwards the audio stream to the sub-ear through the wireless communication connection 11. The wireless communication connection 11 and the wireless communication connection 12 are usually always kept connected, wherein the wireless communication connection 11 and the wireless communication connection 12 may be specifically SPP paths established by a Serial Port Profile (SPP).

Referring to fig. 1B, fig. 1B is another wireless audio system 20 provided herein.

As shown in fig. 1B, the wireless audio system 20 also includes the electronic device 100 and the wireless audio device 200, similar to the wireless audio system 10. The wireless audio device 200 may include, among other things, an audio output device 201 (e.g., as a primary ear) and an audio output device 202 (e.g., as a secondary ear). The wireless audio system 20 may further include an earphone box 203 (not shown in the figures).

The device configurations of the electronic device 100 and the wireless audio device 200 are similar to the wireless audio system 10, and are not described herein again.

What is different from the wireless audio system 10 described above is the connection between the devices and the data interaction process between the devices.

In the wireless audio system 20, a wireless communication connection 21 is established between the electronic device 100 and the audio output device 201. A wireless communication connection 22 is established between the audio output device 201 and the audio output device 202. The wireless communication connection 21 may be a bluetooth connection, and the wireless communication connection 22 is a channel for broadcast communication.

The wireless communication connection 21 is used to transmit data, including audio data, control data and status data, between the electronic device 100 and the audio output device 201. Specifically, the electronic apparatus 100 may transmit audio data and control data to the audio output apparatus 201 through the wireless communication connection 21, the audio output apparatus 201 plays music according to the audio data, controls the audio output apparatus 201 to perform a corresponding event according to the control data, and transmits the control data to the audio output apparatus 202 through the wireless communication connection 22. The audio output device 201 may also transmit the status information of the audio output device 201 and the status information of the audio output device 202 to the electronic device 100 through the wireless communication connection 21, the status information of the audio output device 202 being transmitted by the audio output device 202 to the audio output device 201 through the wireless communication connection 22.

The wireless communication connection 22 is used to transfer data between the audio output device 201 and the audio output device 202, including control data and status information of the audio output device 202. Specifically, the audio output device 201 may transmit control data to the audio output device 202 via the wireless communication connection 22, the control data being previously transmitted to the audio output device 201 by the electronic device 100 via the wireless communication connection 21. The audio output device 202 may also transmit the status information of the audio output device 202 to the audio output device 201 through the wireless communication connection 22, and then the audio output device 201 transmits the status information of the audio output device 202 to the electronic device 100.

Also unlike the wireless audio system 10 described above, the audio data in the audio output device 202 (i.e., the sub-ear) is specifically obtained by listening to the audio data exchanged between the electronic device 100 and the audio output device 201 (i.e., the main ear), and the audio output device 202 is obtained without establishing a connection similar to the wireless communication connection 21 with the electronic device 100 and without forwarding through the audio output device 202 during the listening process.

Take a specific interactive scenario as an example. When the audio output device 201 and the audio output device 202 are powered on, i.e. switched to an operating state, the main ear (e.g. the audio output device 201) of the two wireless earphones can establish the wireless communication connection 21 with the electronic device 100. The electronic device 100 and the main ear may interact audio data, control data, etc. via the wireless communication connection 21. Audio data for the sub-ear (e.g., audio output device 202) is obtained by listening to audio data exchanged between electronic device 100 and the main ear without the sub-ear having to establish a connection with electronic device 100 similar to wireless communication connection 21 during the listening process. When the control data is required to be interacted with, the main ear and the auxiliary ear can interact with the control data through the wireless communication connection 22, that is, the main ear and the auxiliary ear can interact with the control data through the wireless communication connection 22 without interacting with the audio data and the like.

In the wireless audio system 20, the wireless communication connection 21 is usually kept connected for a long time, and the wireless communication connection 22 may not be kept connected for a long time, because the audio data for interaction is not sporadic and the electronic device 100 needs to send the audio stream to the main ear for a long time, so the wireless communication connection 21 is usually kept connected at all times. However, the transmission of control data is sporadic and, in order to reduce the power consumption of the headset, the wireless communication connection 22 may be established only when the above-mentioned control information needs to be exchanged. The wireless communication connection 21 may be an SPP path established by a Serial Port Profile (SPP), and the wireless communication connection 22 may be established by a bluetooth broadcast.

Referring to fig. 1C, fig. 1C is a diagram of a wireless audio system 30 according to the present disclosure.

As shown in fig. 1C, the wireless audio system 30 also includes the electronic device 100 and the wireless audio device 200, similar to the wireless audio system 10. The wireless audio device 200 may include, among other things, an audio output device 201 and an audio output device 202. The wireless audio system 30 may further include an earphone box 203 (not shown in the drawings).

In the wireless audio system 30, a wireless communication connection 31 is established between the electronic device 100 and the audio output device 201, a wireless communication connection 32 is established between the electronic device 100 and the audio output device 202, and a wireless communication connection 33 is established between the audio output device 201 and the audio output device 202. The wireless communication connection 31 may be a bluetooth connection, the wireless communication connection 32 may be a bluetooth connection, and the wireless communication connection 33 may be a channel for broadcast communication.

The wireless communication connection 31 is used to transmit data, including audio data, control data and status data, between the electronic device 100 and the audio output device 201. Specifically, the electronic device 100 may send audio data and control data to the audio output device 201 through the wireless communication connection 31, and the audio output device 201 plays music according to the audio data and controls the audio output device 201 to execute corresponding events according to the control data. The audio output device 201 may also transmit status information of the audio output device 201 to the electronic device 100 via the wireless communication connection 31.

The wireless communication link 32 is used to transmit data, including audio data, control data, and status data, between the electronic device 100 and the audio output device 202. Specifically, the electronic device 100 may send audio data and control data to the audio output device 202 through the wireless communication connection 32, and the audio output device 202 plays music according to the audio data and controls the audio output device 202 to execute corresponding events according to the control data. The audio output device 202 may also send status information of the audio output device 202 to the electronic device 100 over the wireless communication connection 32.

The wireless communication connection 33 is used for transmitting data, including control data, between the audio output device 201 and the audio output device 202. In particular, in some cases, the primary and secondary ears may also interact control data via the wireless communication connection 33 when the audio output device 201 and the audio output device 202 need to align headphone information.

Also unlike the wireless audio system 10 described above, the audio data in the audio output device 202 (i.e., the sub-ear) is specifically acquired via the wireless communication connection 32 with the electronic device 100 and is acquired without being forwarded through the audio output device 202.

Take a specific interactive scenario as an example. When the audio output device 201 and the audio output device 202 are powered on, that is, switched to an operating state, the main ear (for example, the audio output device 201) of the two wireless earphones can establish a wireless communication connection 21 with the electronic device 100, and the electronic device 100 and the main ear can interact audio data, control data, and the like through the wireless communication connection 31. Similarly, the sub-ear (e.g., audio output device 202) may also establish a wireless communication link 32 with electronic device 100, and electronic device 100 and the sub-ear may interact with audio data and control data via wireless communication link 32. Furthermore, in some cases, the primary and secondary ears may also interact with control data via wireless communication connection 33 when alignment of control data is desired between the primary and secondary ears. That is, the primary ear and the secondary ear may interact with the electronic device 100 for audio data, control data via a wireless communication link 31 and a wireless communication link 32, respectively, and may also align the control data via a wireless communication link 33 between the primary ear and the secondary ear.

In wireless audio system 20, wireless communication connections 31 and 32 are typically always connected, and wireless communication connection 11 is typically always connected because it is not sporadic for interactive audio data, and electronic device 100 requires a long time to send audio streams to the primary and secondary ears, respectively. Whereas the wireless communication connection 33 may not always remain connected, since the control data for aligning the play/talk is sporadic, the wireless communication connection 33 may be established only when the above-mentioned control information needs to be interacted in order to reduce the headset power consumption. The wireless communication connection 31 and the wireless communication connection 32 may be specifically SPP paths established by a bluetooth Serial protocol (SPP), and the wireless communication connection 33 may be specifically established by a bluetooth broadcast.

In the embodiment of the present application, the audio data related to the three wireless audio systems includes, but is not limited to, music files, voice data, and the like.

In the embodiment of the present application, the control data related to the three wireless audio systems includes, but is not limited to: during audio playback or upon an incoming call for controlling the headset message. For example, in playing audio, information for controlling and adjusting volume, pausing/continuing playing, switching audio, and switching operating mode (noise reduction mode, night mode, etc.), or information for controlling and answering a call when a call is received again, or operations for controlling and adjusting volume, switching operating mode (noise reduction mode, night mode, etc.), and hanging up during a call; or, the OTA is also used for controlling OTA upgrading, clock calibration, pairing information updating, and information of acquiring electric quantity and the like. The specific type of the control data is not limited in the embodiments of the present application.

In the embodiment of the present application, the three wireless audio systems relate to states including, but not limited to, the power of the earphone.

In the embodiment of the present application, although the data interaction processes of the three wireless audio systems are different, the electronic device 100 or the wireless audio device 200 included in the three wireless audio systems may be provided with a trigger detection module, a consistency detection module, and a consistency adjustment module. The three modules can be arranged in the same equipment or respectively arranged in different equipment. The trigger detection module can determine consistency detection time according to user operation or earphone states, and sends an instruction to the consistency detection module according to the consistency detection time, wherein the instruction is used for triggering the consistency detection module to perform consistency detection on the binaural information at the consistency detection time, and if the consistency detection module detects that the binaural information is inconsistent, the consistency adjustment module is controlled to perform consistency adjustment on the binaural information; and if the binaural information is detected to be consistent, determining that the binaural information does not need to be subjected to consistency adjustment.

For the specific implementation method of the foregoing trigger detection module, the consistency detection module, and the consistency adjustment module for consistency control of ears, reference may be made to the description of the method flow in the following, which is not repeated herein.

However, since information interaction between the electronic device and the wireless audio device and information interaction between the wireless audio devices (between the two wireless earphones) both depend on the quality of wireless communication connection established between the two communication parties and the device software and hardware performance of the two communication parties, when any one of the two wireless earphones has a problem, information interaction fails, and further, the two wireless earphones cannot synchronously receive/transmit information, which may cause a problem of inconsistent binaural experience for a user.

Specifically, taking the wireless audio system 10/20 as an example, when the wireless audio device 201 receives the control data sent by the electronic device 100 through the wireless communication connection 12/21, the wireless audio device 201 needs to execute an event corresponding to the control data, and sends the control data to the wireless audio device 202 through the wireless communication connection 11/22 for controlling the wireless audio device 202 to execute the event corresponding to the control data, but when the quality of the wireless communication connection 12/21 is better and the quality of the wireless communication connection 11/22 is worse, the wireless audio device 201 may successfully receive the control data, and the wireless audio device 202 may not receive the control data. When the control data is specifically used for adjusting the volume, the wireless audio device 201 successfully adjusts the volume, but the wireless audio device 202 still maintains the volume before adjustment, thereby bringing a problem of inconsistent binaural volume experience to the user.

Taking the wireless audio system 30 as an example, when the electronic device 100 sends the control data to the wireless audio device 201 and the wireless audio device 202, if the quality of the wireless communication connection 31 is better and the quality of the wireless communication connection 32 is not good, the wireless audio device 201 will successfully receive the control data, and the wireless audio device 202 will not receive the control data. When the control data is specifically used for switching the working mode, the wireless audio device 201 is successfully switched, but the wireless audio device 202 still maintains the working mode before switching, so that the problem of inconsistent binaural working mode experience is brought to the user.

In order to solve the above problems, the present application provides a binaural consistency control method, a graphical interface, a system, and a related apparatus. In the method, a time at which the consistency detection is triggered is determined upon detection of a particular user operation or a particular state. After consistency detection is triggered, comparing the binaural information with target information respectively, and when the information of any one or two earphones in the ears is different from the target information, performing consistency adjustment on the binaural information; and when the binaural information is the same as the target earphone information, determining that the binaural information meets the consistency without adjustment. Or after triggering consistency detection, comparing the binaural information, and when the binaural information is different, performing consistency adjustment on the binaural information; and when the two-ear information is the same, determining that the two-ear information meets the consistency without adjustment.

Explanations about the specific user operation, the specific state, the binaural information, and the target information referred to in the embodiments of the present application are as follows:

the specific user action includes any one or more of: the earphone volume adjusting device is used for adjusting earphone volume, switching earphone working modes, upgrading OTA information or matching earphones. In the present application, the specific user operation may also be referred to as a first user operation.

The particular state includes any one or more of: the first earphone and the second earphone are connected, the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed. In this application, a specific state may also be referred to as a first state.

The binaural information refers to respective information in the two earphones, and specifically includes any one or more of the following: volume, operating mode, OTA upgrade package, clock, pairing information, and power, among others. The information of the first earphone of the two earphones can be referred to as first information, and the information of the second earphone of the two earphones can be referred to as second information.

The consistency of the binaural information includes any one or more of the following: and keeping the information except the electric quantity in the two earphones the same, or ensuring that the electric quantities of the two earphones are output by the electronic equipment at the same time.

The disparity of the binaural information includes any one or more of the following: the information except the electric quantity in the two earphones is different, or the electric quantities of the two earphones are not output by the electronic equipment at the same time.

The target information is information of the earphone determined according to the specific user operation, for example, target information such as a target volume, a target operating mode, a target OTA upgrade package, and target pairing information determined according to operations for adjusting volume, switching operating mode, upgrading OTA, and pairing ears input by the user.

Therefore, after the binaural consistency control method provided by the application is implemented, the problem that multiple binaural information are inconsistent can be detected in time, and the binaural information is subjected to consistency adjustment in time, so that better consistency experience is brought to a user.

Based on the foregoing description of the wireless audio system, the software and hardware architecture of the electronic device 100 and the software and hardware architecture of the wireless audio device 200 included in the wireless audio system will be described in detail.

Referring to fig. 2A, fig. 2A illustrates a hardware configuration diagram of the electronic device 100.

As shown in fig. 2A, the electronic device 100 may include: the mobile terminal comprises a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a display screen 191 and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be, among other things, a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of reading the instruction and executing the instruction.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments of the present application, an Application Processor (AP) included in the processor 110 of the electronic device 100 may implement Host in a bluetooth protocol framework, and a Bluetooth (BT) module included in the wireless communication module 160 of the electronic device 100 may implement controller in the bluetooth protocol framework, and communicate therebetween through HCI. I.e. the functions of the bluetooth protocol framework are distributed over two chips. The description of the bluetooth protocol framework can refer to the prior art and will not be repeated herein. In other embodiments, the electronic device 100 terminal Application Processor (AP) may implement Host and controller in the bluetooth protocol framework. That is, all functions of the bluetooth protocol framework are placed on one chip, that is, the host and the controller are placed on the same chip, and since the host and the controller are both on the same chip, there is no necessity for the physical HCI, and the host and the controller interact directly through the API.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus including a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of answering a call through a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit the audio signal to the wireless communication module 160 through the PCM interface, so as to implement the function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 with peripheral devices such as the display screen 191, the camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. The processor 110 and the display screen 191 communicate through a DSI interface to implement the display function of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 191, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It should be understood that the connection relationship between the modules illustrated in the embodiment of the present application is only an exemplary illustration, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display 191, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 191. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments of the present application, the electronic device 100 may establish a wireless communication connection with a wireless communication module (e.g., a bluetooth module) of the wireless audio device 200 through the above-mentioned wireless communication module (e.g., a bluetooth module), and transmit audio data, control data, and status data through the wireless communication connection.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device 100 implements display functions via the GPU, the display screen 191, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 191 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 191 is used to display images, videos, and the like. The display screen 191 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD). The display screen panel may also be made of organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniature, micro-leds, quantum dot light-emitting diodes (QLEDs), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 191, N being a positive integer greater than 1.

In some embodiments of the present application, the electronic device 100 exemplarily illustrated in fig. 2A described above may display the respective user interfaces described in fig. 3A to 3D, and fig. 4A to 4C in the following UI embodiments through the display screen 191. The electronic device 100 may detect a touch operation for each user interface through the touch sensor, and the processor 110 receives the touch operation transmitted by the touch sensor, analyzes an event corresponding to the touch operation, and controls a corresponding module to execute the corresponding event. For example, after the touch sensor detects an operation of clicking a music application icon shown in fig. 4A and applied to the display screen, the processor 110 receives the operation transmitted by the touch sensor, and may control the electronic device 100 to run a music application according to an event of running the music application corresponding to the operation, where the display screen 191 is controlled to display the user interface shown in fig. 4B during the running of the music application.

The internal memory 121 may include one or more Random Access Memories (RAMs) and one or more non-volatile memories (NVMs).

The random access memory may include static random-access memory (SRAM), dynamic random-access memory (DRAM), synchronous dynamic random-access memory (SDRAM), double data rate synchronous dynamic random-access memory (DDR SDRAM), such as fifth generation DDR SDRAM generally referred to as DDR5 SDRAM, and the like;

the nonvolatile memory may include a magnetic disk storage device, flash memory (flash memory).

The FLASH memory may include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operation principle, may include single-level cells (SLC), multi-level cells (MLC), three-level cells (TLC), four-level cells (QLC), etc. according to the level order of the memory cells, and may include universal FLASH memory (UFS), embedded multimedia memory cards (eMMC), etc. according to the storage specification.

The random access memory may be read and written directly by the processor 110, may be used to store executable programs (e.g., machine instructions) of an operating system or other programs in operation, and may also be used to store data of users and applications, etc.

The nonvolatile memory may also store executable programs, data of users and application programs, and the like, and may be loaded into the random access memory in advance for the processor 110 to directly read and write.

The external memory interface 120 may be used to connect an external nonvolatile memory to extend the storage capability of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are saved in an external nonvolatile memory.

In this embodiment, the memory of the electronic device 100 may be used to store an audio file, and when the electronic device 100 detects a file for playing the music, the electronic device 100 may read the corresponding audio file in the memory and call a player to play the audio file.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic apparatus 100 can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into a sound signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association) standard interface of the USA.

The sensor module 180 may include, but is not limited to: pressure sensors, gyroscope sensors, air pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity light sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, and the like.

The pressure sensor is used for sensing a pressure signal and converting the pressure signal into an electric signal. In some embodiments, the pressure sensor may be disposed on the display screen 191. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 191, the electronic apparatus 100 detects the intensity of the touch operation according to the pressure sensor. The electronic apparatus 100 may also calculate the touched position based on the detection signal of the pressure sensor. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

Touch sensors, also known as "touch panels". The touch sensor may be disposed on the display screen 191, and the touch sensor and the display screen 191 form a touch screen, which is also called a "touch screen". The touch sensor is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 191. In other embodiments, the touch sensor may be disposed on a surface of the electronic device 100 at a different location than the display screen 191.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 200 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 200.

In the embodiment of the present application, when the electronic device 100 detects an operation of a key 190, such as a volume key, by a user, in response to the operation, the electronic device 100 may send an event of turning up/down the volume corresponding to the operation to the wireless audio device 200 connected to the electronic device 100 through the wireless connection, so as to control the wireless audio device 200 to turn up/down the volume.

In an embodiment of the application, when controlling binaural coherence is performed by the electronic device 100, the processor 110 of the electronic device 100 may determine a time to trigger coherence detection based on a detected specific user operation or a specific state. After the time for triggering consistency detection is reached, acquiring binaural information based on wireless communication connection with the earphones, comparing the binaural information with target information respectively, and when the information of any one or two earphones in the ears is different from the target information, performing consistency adjustment on the binaural information, namely controlling the ears to perform information synchronization; and when the binaural information is the same as the target earphone information, determining that the binaural information meets the consistency without adjustment. Or comparing the binaural information after the time for triggering consistency detection is reached, and performing consistency adjustment on the binaural information when the binaural information is different, namely controlling the binaural to perform information synchronization; and when the two-ear information is the same, determining that the two-ear information meets the consistency without adjustment.

Specifically, when the binaural information is specifically the power amounts of the earphones, the electronic device 100 may detect that the power amounts of the two earphones are not synchronously displayed, obtain the earphone corresponding to the power amount of the earphone not displayed (for example, the wireless audio device 202 serving as the auxiliary ear), send the obtained power amount of the wireless audio device 202 to the wireless audio device 201 serving as the main ear based on the wireless communication connection with the wireless audio device 202, obtain the power amount of the wireless audio device 202 from the wireless audio device 202 based on the wireless connection with the wireless audio device 202, and send the obtained power amount of the wireless audio device 202 to the electronic device 100, so that the electronic device 100 synchronously displays the power amounts of the wireless audio device 201 and the wireless audio device 202.

The software system of the electronic device 100 may employ a hierarchical architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention uses an Android system with a hierarchical architecture as an example to exemplarily explain a software structure of the electronic device 100.

Referring to fig. 2B, fig. 2B illustrates a block diagram of a software structure of the electronic apparatus 100.

As shown in fig. 2B, the layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 2B, the application package may include bluetooth, music, phone, etc. applications.

The bluetooth application may provide the electronic device 100 with a bluetooth transmission service, for example, control the electronic device 100 to establish a bluetooth connection with the wireless audio device 200, and transmit audio data, call/play control data, and the like based on the bluetooth connection.

It is noted that when the method for controlling binaural consistency is performed by the electronic device 100, that is, when the trigger detection module, the consistency detection module, and the consistency adjustment module are disposed at the electronic device 100 side, the method is specifically disposed in the bluetooth application of the electronic device. Otherwise, the electronic device 100 does not include the trigger detection module, the consistency detection module, and the consistency adjustment module.

The trigger detection module can determine consistency detection time according to user operation or earphone states, and sends an instruction to the consistency detection module according to the consistency detection time, wherein the instruction is used for triggering the consistency detection module to perform consistency detection on the binaural information at the consistency detection time, and if the detected binaural information is inconsistent, the consistency adjustment module is controlled to perform consistency adjustment on the binaural information; and if the binaural information is detected to be consistent, determining that the binaural information does not need to be subjected to consistency adjustment. For the specific implementation method of the foregoing trigger detection module, the consistency detection module, and the consistency adjustment module for consistency control of ears, reference may be made to the description of the method flow in the following, which is not repeated herein.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

The application framework layer may include a bluetooth manager, a window manager, a content provider, a view system, a phone manager, an explorer, a notification manager, and the like.

The Bluetooth manager is used for controlling the lower Bluetooth drive to execute corresponding operation according to the instruction issued by the upper application. For example, the bluetooth manager may control, according to a consistency detection instruction issued by a consistency detection module of the bluetooth application, the lower bluetooth driver to execute a binaural information operation required for obtaining consistency detection according to the consistency detection instruction. For another example, the bluetooth manager may control the lower bluetooth driver to execute the operation for adjusting the binaural information according to the consistency adjustment instruction issued by the consistency adjustment module of the bluetooth application.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to notify download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.

The kernel layer is a layer between hardware and software. The inner core layer includes, but is not limited to: bluetooth drive, display driver, camera drive, audio drive, sensor drive.

The Bluetooth driver is used for receiving an instruction issued by the uploading Bluetooth manager and controlling the Bluetooth chip to execute corresponding operation according to the instruction. For example, after the bluetooth driver receives an instruction for acquiring the binaural information issued by the upload bluetooth manager, the bluetooth driver may control the bluetooth chip to send a request for acquiring the binaural information to the wireless audio device 200. For another example, after the bluetooth driver receives the instruction for adjusting the binaural information issued by the upload bluetooth manager, the bluetooth driver may control the bluetooth chip to send a command for adjusting the binaural information to the wireless audio device 200.

The following describes exemplary work flows of software and hardware of the electronic device 100 in connection with a scenario of playing music.

When the touch sensor receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, timestamp of the touch operation, and the like). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the example that the touch operation is a touch click operation, and the control corresponding to the click operation is to open the bluetooth application control, the bluetooth application calls an interface of the application framework layer, starts the bluetooth application, further starts the bluetooth drive by calling the kernel layer, establishes wireless communication connection with the wireless audio device 200 through the bluetooth chip, and transmits audio data, play/talk control information and the like based on the wireless communication connection.

Referring to fig. 2C, fig. 2C illustrates a block diagram of a hardware configuration of the wireless audio device 200.

As shown in fig. 2C, the wireless audio device 200 (201 and 202) includes: a processor 210, a communication module 220, an audio module 230, a sensor 240, and a memory 250, as well as a battery, magnetic components, etc., not shown.

It is to be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation to the wireless audio device 200. In other embodiments of the present application, the wireless audio device 200 may include more or fewer components than shown, or some components may be combined, or some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 210 may be the neural center and the command center of the wireless audio device 200. The processor 210 may couple the bluetooth module and the audio module, sensors in 201, 202. The processor may be responsible for reading the instructions in the memory, decoding the instructions, and executing the instructions to implement the wireless communication method provided by the present application.

The communication module 220 may include, but is not limited to: bluetooth module, WLAN module, etc. Wherein, the bluetooth module can be used for receiving or transmitting the bluetooth signal. The wireless audio device 200 may establish a bluetooth communication connection with the electronic device 100 through a bluetooth module and transmit a bluetooth signal to the electronic device 100 or receive a bluetooth signal transmitted by the electronic device 100 through the bluetooth communication connection.

The audio module 230 may be used to convert audio data into sound, and may be specifically an electro-acoustic transducer (electro-acoustic transducer).

The sensors 240 may include, but are not limited to: touch sensors, bone conduction sensors, etc., gyroscope sensors, magnetic sensors, acceleration sensors, temperature sensors, hall sensors, proximity light sensors, etc. Where the touch sensor may be used to sense a touch operation of a user input, which may be used, for example, to control the wireless audio output device 200 to increase/decrease the volume.

The memory 250 may store audio data, pairing information for wireless audio devices, OTA upgrade packages, and the like.

The battery may be used to power various components in the wireless audio device 200, such as a processor, audio module, sensor, bluetooth module, etc.

The magnetic component may have a magnetic material. The magnetic components in the wireless audio device 201 and the magnetic components in the wireless audio device 202 may exhibit opposite magnetic properties and thus attract each other. If the

wireless audio devices

201, 202 are in close proximity to each other, the magnetic components in the

wireless audio devices

201, 202 may attract each other to draw the

wireless audio devices

201, 202 together. The sensor may be used to detect whether the

wireless audio device

201, 202 are being snapped together. The sensor may be a hall sensor, a proximity light sensor, or the like. If the wireless audio device 201 and the wireless audio device 202 are attracted together, it can be said that the wireless audio device 201 and the wireless audio device 202 are in an attraction state; otherwise, the wireless audio device 201 and the wireless audio device 202 may be said to be in a separated state.

In the present embodiment, when controlling binaural coherence is performed by the wireless audio device 200, then the processor 210 of the wireless audio device 200 (e.g., the wireless audio device 201 as the primary ear) may determine the time at which coherence detection is triggered based on a particular detected user operation or a particular state. After the time for triggering consistency detection is reached, acquiring information of an auxiliary ear based on wireless communication connection between the auxiliary ear and the auxiliary ear, comparing the binaural information with target information respectively, and when the information of any one or two earphones in the ears is different from the target information, performing consistency adjustment on the binaural information, namely controlling the ears to perform information synchronization; and when the binaural information is the same as the target earphone information, determining that the binaural information meets the consistency without adjustment. Or comparing the binaural information after the time for triggering consistency detection is reached, and performing consistency adjustment on the binaural information when the binaural information is different, namely controlling the binaural to perform information synchronization; and when the two-ear information is the same, determining that the two-ear information meets the consistency without adjustment.

Specifically, when the binaural information is specifically the power of the earphone, the wireless audio device 201 may obtain the power of the earphone, which is not shown, from the electronic device 100 based on the wireless communication connection with the electronic device 100, and then the wireless audio device 201 may obtain the power of the wireless audio device 202, which is an auxiliary ear, and then transmit the obtained power of the wireless audio device 202 to the electronic device 100, so that the electronic device 100 displays the power of the wireless audio device 201 and the power of the wireless audio device 202 synchronously.

It is to be noted that, when the method for controlling binaural consistency is executed by the wireless audio device 200, that is, when the trigger detection module, the consistency detection module, and the consistency adjustment module described above are disposed at the wireless audio device 200 end, specific reference may be made to fig. 2D, where fig. 2D exemplarily illustrates a software structure block diagram of the wireless audio device 200.

As shown in fig. 2D, the wireless audio device 200 (201 and 202) includes, but is not limited to: the device comprises a trigger detection module, a consistency detection module and a consistency adjustment module.

The trigger detection module can determine the time for triggering consistency detection according to user operation or earphone state, and sends an instruction to the consistency detection module according to the time for triggering consistency detection, wherein the instruction is used for triggering the consistency detection module to perform consistency detection on the binaural information at the time for triggering consistency detection, and if the binaural information is detected to be inconsistent, the consistency adjustment module is controlled to perform consistency adjustment on the binaural information; and if the binaural information is detected to be consistent, determining that the binaural information does not need to be subjected to consistency adjustment. For the specific implementation method of the foregoing trigger detection module, the consistency detection module, and the consistency adjustment module for consistency control of ears, reference may be made to the description of the method flow in the following, which is not repeated herein.

Based on the above introduction of the wireless audio system to which the binaural consistency control method provided by the present application is applied and the software and hardware of the device included in the system, the binaural consistency control method provided by the present application is described below with reference to the UI embodiments of fig. 3A to 3D, taking the binaural information as the electric quantity prompt information as an example, and then with reference to the UI embodiments of fig. 4A to 4C, taking the binaural information as the volume information as an example.

Referring to fig. 3A, fig. 3A illustrates a desktop diagram of the electronic device 100.

As shown in fig. 3A, the electronic device 100 displays a desktop including: a status bar 311, a page indicator 312, a tray 313 with common application icons, and a plurality of other application icons. Wherein:

the status bar 311 may include: one or more signal strength indicators for mobile communication signals (which may also be referred to as cellular signals), such as signal strength indicator 311A, signal strength indicator 311B, one or more signal strength indicators for wireless fidelity (Wi-Fi) signals 311C, bluetooth status indicator 311D, battery status indicator 311E, time indicator 311F.

When the electronic device 100 is connected to the wireless audio device 200, a bluetooth status indicator 311D may be further displayed in the status bar 311, wherein the bluetooth status indicator 311D may be used to indicate that the electronic device 100 successfully turns on bluetooth and connects to the wireless audio device 200.

The page indicator 312 may be used to indicate the positional relationship of the currently displayed page with other pages. The user may slide the area of the other application icons from side to browse the application icons in the other pages.

The tray 313 having the common application icons may include a plurality of tray icons (e.g., a phone application icon, an information application icon, a browser application icon, and a camera application icon) that remain displayed when the page is switched. The application icon displayed on the tray 313 is optional, and the user may modify the application icon by himself or herself, which is not limited in this embodiment of the present application.

The other application icons may be a plurality of application icons (e.g., music application icon 314, weather application icon, application mall application icon, settings application icon, exercise health application icon, memo application icon, calendar application icon). Other application icons may be distributed across multiple pages, and page indicator 312 may also be used to indicate which page the user is currently browsing for applications in.

In some embodiments, the desktop illustrated in FIG. 3A may be the home screen interface. It is understood that fig. 3A merely illustrates one user interface of the electronic device 100, and should not be construed as a limitation to the embodiments of the present application.

Taking the wireless audio device 200 as an example of a pair of TWS earphones, when the user takes the pair of TWS earphones out of the earphone box and turns on the bluetooth function of the electronic device 100, the electronic device 100 establishes a wireless communication connection with the TWS earphones through the bluetooth module, and performs data transmission through the connection, and also displays information for prompting the user that the electronic device 100 is connected to the TWS earphones and power information of the TWS earphones.

Referring to fig. 3B-3D, fig. 3B-3D schematically illustrate user interfaces for displaying binaural charge information after the electronic device is connected to the TWS headset.

Referring to fig. 3B, fig. 3B illustrates a schematic view of a user interface of an electronic device displaying dyssynchrony for binaural information.

As shown in fig. 3B, when the electronic device 100 is connected to the TWS headset, the electronic device 100 may display a pop-up window 321, in which a series of image interface elements, such as a left ear headset icon 322A, a left ear headset icon 323A, and a headset box icon 324A, and a power reminder 322B and a headset box power reminder 324B corresponding to the left ear headset, are displayed in the pop-up window 321. Wherein, the left ear is defaulted as the main ear, and the right ear is defaulted as the auxiliary ear. The series of graphical interface elements may be used to represent the appearance of headphones, a headphone case, etc. to which the electronic device 100 is connected, as well as device state information such as the amount of power to the headphones, headphone case, etc. The appearance and presentation style of the device state information are both default settings or user-defined.

Optionally, the pop-up window 321 of the electronic device 100 may further display prompt information 325, a control 326 and a control 327 as shown in fig. 3B. The prompt information 325 may be used to display the name/model of the connected headset, the control 326 is used to close the display popup 321, and the control 327 is used to jump to a page for setting the bluetooth headset, where the page may be provided by a setting application or provided by a bluetooth APP.

It is understood that, in general, when the electronic device 100 is connected to the TWS headset, the electric quantity prompts corresponding to the two ear headsets are displayed, but the electronic device 100 does not display the prompt 323B in the pop-up window 321 shown in fig. 3B, because the electronic device 100 does not successfully receive the electric quantity corresponding to the right ear headset, and thus does not display the electric quantity prompt corresponding to the right ear headset.

It is understood that fig. 3B only illustrates an exemplary user interface diagram of an electronic device displaying unsynchronized binaural information by taking the binaural information as the electric quantity information of both ears as an example, in other embodiments of the present application, the binaural information further includes other information, such as background theme of both ears, and the like, which is not limited in this application.

In view of the three wireless audio systems mentioned above, the reason for the failure of the electronic device 100 to synchronously display the binaural power includes any of the following:

(1) Any one of the electronic device 100, the left ear headset or the right ear headset, which results in that the power information of the right ear headset cannot be successfully transmitted, forwarded or received;

(2) In the wireless audio system 10, the wireless communication connection 11 between the left ear (e.g., the wireless audio device 201) and the right ear (e.g., the wireless audio device 202) is poor, so that the left ear serving as the main ear cannot successfully receive the power information sent by the right ear serving as the auxiliary ear, and cannot forward the power information to the electronic device 100, and further the electronic device 100 cannot receive the power information of the right ear;

(3) In the wireless audio system 20, the wireless communication connection 22 between the left ear (e.g., the wireless audio device 201) and the right ear (e.g., the wireless audio device 202) is poor, so that the left ear as the main ear cannot successfully receive the power information transmitted by the right ear as the auxiliary ear, and further the electronic device 100 cannot receive the power information of the right ear;

(4) In the wireless audio system 30, the wireless communication connection 32 between the right ear (e.g., the wireless audio system 202) and the electronic device 100 is not good, and the electronic device 100 cannot receive the power information of the right ear.

In order to avoid the problem that the binaural information (specifically, binaural electric quantity) displayed at the end of the electronic device 100 is not synchronous, after the binaural consistency control method provided by the present application is adopted, when it is detected that the electronic device 100 establishes wireless connection with the TWS headset, the trigger detection module may determine the consistency detection time, where the consistency detection time is specifically determined according to a time length required by the electronic device 100 to acquire the binaural electric quantity information, for example, after the TWS headset is opened, the electronic device 100 establishes connection with the display electric quantity information, which generally requires 3s, the consistency detection time determined by the detection module is specifically 3s, after the electronic device 100 establishes connection with the TWS headset, the trigger detection module may control the consistency detection module to detect whether the current binaural information (specifically, binaural electric quantity) is synchronously displayed in the electronic device 100, and if the current binaural information is consistent; otherwise, the consistency detection module invokes consistency. The adjustment module controls the electronic device 100 to synchronously display the binaural information.

In an example, when the electronic device 100 acquires the power information of the right ear headphone again and synchronously displays the binaural power information, specifically, the newly acquired power information of the right ear may be displayed in a popup 321 in fig. 3B in an additional manner. With particular reference to fig. 3C.

As shown in fig. 3C, the electronic device 100 additionally displays an electric quantity prompt 323B corresponding to the right ear earphone in the pop-up window 321, so as to achieve synchronous display of electric quantity prompt information of both ears. In this case, it is necessary to ensure that the electronic apparatus 100 does not close the pop-up window 321 displayed before the power information of the right ear acquired by the electronic apparatus 100 is restored.

In another example, when the electronic device 100 acquires the power information of the right-ear earphone again and displays the binaural power information synchronously, specifically, a popup window similar to the popup window 321 in fig. 3B may be displayed again on the electronic device 100, where the content of the popup window is the same as that in fig. 3C, except that the popup window is another popup window that is displayed again after the electronic device automatically closes the popup window 321 or closes the popup window 321 in response to a user operation.

In another example, when the electronic device 100 acquires the power information of the right-ear earphone again and displays the binaural power information synchronously, the binaural power information may be specifically viewed in a negative one-screen mode. The electronic apparatus 100 may detect a sliding operation (e.g., a rightward sliding) by the user in the user interface as illustrated in fig. 3A, and in response to the sliding operation, the electronic apparatus 100 displays a negative one-screen interface.

Referring to FIG. 3D, FIG. 3D illustrates a negative one-screen interface of electronic device 100.

As shown in fig. 3D, the negative one-screen interface may include quick service controls 331 (e.g., swipe, pay code, mobile load, more, etc.), my device card 332, my express card 333, and sports health card 334, among others.

The my device card 332 displays appearances of earphones, earphone boxes and the like connected to the electronic device 100 and electric quantity information of the earphones and the earphone boxes, and can be used for a user to check device state information such as electric quantity of the earphones connected to the electronic device 100. Not limited to a negative one-screen interface, the user interface for the user to view device status information, such as power level of a headset connected to the electronic device 100, may also be other user interfaces, such as those provided by an application program dedicated to managing headsets.

It is understood that fig. 3D only illustrates a negative one-screen interface of the electronic device 100, and should not be construed as limiting the embodiments of the present application.

Referring to fig. 4A-4C, fig. 4A-4C exemplarily illustrate operation diagrams for controlling the volume of the TWS headset after the electronic device is connected to the TWS headset.

As shown in fig. 4A, when the electronic device 100 is running the music APP and playing music by connecting the TWS headset, the volume level displayed on the electronic device side is 341, and then the volume levels of the left and right earphones in the TWS headset are also 341.

If the user wants to adjust the volume at this time, the volume may be adjusted by acting on a volume key of the electronic device 100 or by acting on a volume adjustment control displayed in the display screen, or by acting on the operation of the TWS headset.

As shown in fig. 4B, when the electronic device 100 receives an operation for adjusting the volume input by the user, it determines that the target information (in this case, the target volume) is the volume level 342, and displays the adjusted target volume, that is, the volume level 342. Then, when the electronic device 100 controls the binaural volume according to the volume adjustment operation, if the adjustment is successful, the volumes of both the earphones are adjusted from the volume level 341 before the adjustment to the volume level 342, but of course, the volume of the left ear may be successfully adjusted to the level 342 due to the poor quality of the wireless communication connection between the ears or the failure of the software and hardware of both communication parties, and the volume of the sub-ear may not be successfully adjusted and the volume level 341 before the adjustment is maintained. I.e. it appears that the left ear did not successfully adjust the volume level to 342 as shown in fig. 4B, while the right ear still maintains the pre-adjustment level 341, where the left ear defaults to the primary ear and the right ear defaults to the secondary ear. This results in the TWS binaural information (specifically volume) being out of sync, thereby giving the user the problem of an inconsistent binaural volume experience.

In this embodiment of the application, when controlling the binaural volume according to the received volume adjustment operation, the electronic device 100 may specifically send an Audio/Video Remote Control Profile (ACRCP) instruction to the main ear to Control the main ear to adjust the volume, and the main ear forwards the ACRCP instruction to the sub-ear to Control the sub-ear to adjust the volume. For the ACRCP protocol specification, reference may be made to the prior art, which is not described herein again.

In view of the three wireless audio systems mentioned above, the reason why the binaural power cannot be adjusted synchronously includes any of the following:

(1) The method comprises the following steps that (1) software and hardware of any one of the electronic equipment 100, the left ear earphone or the right ear earphone are in failure, so that the volume adjusting information of the right ear earphone cannot be successfully sent, forwarded or received;

(2) In the wireless audio system 10, the wireless communication connection 11 between the left ear (e.g., the wireless audio device 201) and the right ear (e.g., the wireless audio device 202) is poor, resulting in that the left ear, which is the main ear, cannot successfully transmit the volume adjustment information of the right ear earphone to the right ear, which is the auxiliary ear, and further resulting in that only the left ear can successfully adjust the volume, but the right ear cannot successfully adjust the volume;

(3) In the wireless audio system 20, the wireless communication connection 22 between the left ear (e.g., the wireless audio device 201) and the right ear (e.g., the wireless audio device 202) is poor, resulting in the left ear as the main ear failing to successfully transmit the volume adjustment information of the right ear earphone to the right ear as the auxiliary ear, and further resulting in only the left ear successfully adjusting the volume, but the right ear failing to successfully adjust the volume;

(4) In the wireless audio system 30, the wireless communication connection 32 between the right ear (e.g., the wireless audio system 202) and the electronic device 100 is not good, which results in the electronic device 100 not being able to successfully transmit the volume adjustment information of the right ear earphone to the right ear as the sub-ear, which results in only the left ear being able to successfully adjust the volume, but the right ear being unable to successfully adjust the volume.

In order to avoid the problem that the binaural information (specifically, the electric quantity information of the two ears) is not synchronous, after the binaural consistency control method provided by the application is adopted, after the operation of adjusting the volume of the earphone is detected, the trigger detection module may determine consistency detection time, the consistency detection time is specifically determined according to the time length required by the acquisition of the volume adjustment information by the sub-ear, for example, the time required by the sub-ear to receive the volume adjustment information after the operation of adjusting the volume is input by a user is usually 3s, the consistency detection time determined by the detection module is specifically 3s, the waiting time is 3s after the operation of adjusting the volume is received by the user, the trigger detection module may control the consistency detection module to detect whether the current binaural information (specifically, the binaural volume) is synchronously adjusted to the same level or not when the operation of adjusting the volume is received by the user, and if the current binaural information is consistent; otherwise, the consistency detection module invokes consistency. The adjusting module controls the binaural volume to be adjusted to the same level.

As shown in fig. 4C, after binaural volume synchronization, the volume levels for both the left and right ears are 342, which makes a consistent binaural experience for the user.

Fig. 3A to 3D and fig. 4A to 4C above only take the binaural information as the earphone power and the binaural sound volume displayed by the electronic device, to illustrate UI embodiments for controlling the binaural information to be consistent when the disparity of the binaural information is detected.

Next, the binaural consistency control method provided in the present application is described in detail with reference to the method flow shown in fig. 5.

As shown in fig. 5, the binaural consistency control method includes the steps of:

stage 1 (S501-S502), consistency detection is triggered.

S501, the trigger detection module determines trigger time according to the detected specific user operation/specific state.

Specifically, when the trigger detection module detects a specific user operation/a specific state, the time for triggering consistency detection (referred to as trigger time for short) may be determined according to the specific user operation or the state of the headset.

The trigger detection module may be disposed in the electronic device 100 or the wireless audio device 200. The implementation method for detecting the operation of the specific user by the trigger detection module is as follows:

(1) When the trigger detection module is provided in the electronic device 100.

Taking the wireless audio system 10 as an example, the trigger detection module in the electronic device 100 may directly detect the specific user operation (in case the operation is directly applied to the electronic device), or may receive information (also referred to as a first message) indicating that the specific user operation is detected from the wireless audio device 201 (main ear) through the wireless communication connection 12 (in case the operation is directly applied to the headset). Similarly, when the first user operation (specific user operation) is directly detected by the electronic device 100, the wireless audio device 200 may also receive information (also referred to as a first message) indicating that the first user operation is detected from the electronic device 100 through the wireless communication connection 12. Taking the wireless audio system 20 as an example, the trigger detection module in the electronic device 100 may directly detect the specific user operation (if the operation is directly applied to the electronic device), or may receive information indicating that the specific user operation is detected from the wireless audio device 201 (main ear) through the wireless communication connection 21 (if the operation is directly applied to the headset). Taking the wireless audio system 30 as an example, the trigger detection module in the electronic device 100 may directly detect the specific user operation (if the operation is directly applied to the electronic device), or may receive information indicating that the specific user operation is detected from the wireless audio device 201/the wireless audio device 202 through the wireless communication connection 31/32 (if the operation is directly applied to the headset).

(2) When the trigger detection module is provided in the wireless audio device 200. The implementation method for detecting the specific state by the trigger detection module is as follows:

whether in wireless audio system 10, wireless audio system 20, or wireless audio system 30, the trigger detection module in wireless audio device 200 may directly detect the earpiece status.

Wherein the specific user operation includes but is not limited to: the user input is used for adjusting the volume, switching the working mode, upgrading the OTA, checking the electric quantity of the two earphones and the like. And the user operation may be performed in the electronic apparatus 100 or in the wireless audio apparatus 200 (either one of the two earphones). Therefore, when the user inputs and controls the operation of the earphone, the consistency detection of the binaural information can be triggered, and other triggering operations can be input in a wireless and additional mode. In the embodiment of the present application, the above-described specific user operation detected by the wireless audio device 200 may also be referred to as a first user operation. Wherein the specific state includes, but is not limited to: the ears are connected to the electronic equipment each time, the wireless connection quality between the ears is poor, the distance between the ears is long-distance/close, the wireless connection quality between the earphone and the electronic equipment is poor, and the like. In the embodiment of the present application, the specific state may also be referred to as a first state. Specifically, the quality of the wireless connection between two ears can be measured by a Received Signal Strength Indicator (RSSI), for example, when the RSSI is less than-80 db, the quality of the wireless connection between two ears is considered to be poor. Wherein the wireless connection between the ears is specifically the wireless communication connection 11 in the wireless audio system 10, the wireless communication connection 22 in the wireless audio system 20, or the wireless communication connection 33 in the wireless audio system 30 described above. The distance between two ears is specifically that when the distance between two ears is changed from close (first distance) to far (second distance), the second distance is greater than the first distance, and the difference between the second distance and the first distance is greater than a preset value. The distance between the two ears is close, specifically, when the distance between the two ears is changed from far (third distance) to near (fourth distance), the third distance is greater than the fourth distance, and the difference between the third distance and the fourth distance is greater than the preset value. Under the condition, the problem that the experience of two earphones is inconsistent when the user wears the earphones again and does not wear the earphones before due to the fact that the user inputs and adjusts the operation of the binaural information when wearing one earphone and carrying the electronic equipment to be far away from the other unworn earphone and the problem that the other unworn earphone cannot adjust the information timely according to the operation of the user can be avoided. The quality of the wireless connection between the headset and the electronic device may specifically be measured by a Received Signal Strength Indicator (RSSI), for example, when less than-80 db, the quality of the wireless connection between the headset and the electronic device is considered poor. Wherein the wireless connection between the headset and the electronic device is in particular the wireless communication connection 12 in the wireless audio system 10, the wireless communication connection 21 in the wireless audio system 20 or the wireless communication connection 31 and the wireless communication connection 32 in the wireless audio system 30 as described above.

The triggering time is the first time after the triggering module detects the operation of a specific user; the first event may be a fixed time set by default (for example, the 5 th s after detecting the user operation/headset state), or may be determined according to a time required for different services to be executed by different user operations, or the trigger time may be determined according to different headset states.

When the trigger time is determined according to the time required for executing different services corresponding to different user operations, for example, when the user operation is specifically an operation of adjusting the volume, since the time required for adjusting the current volume to the target volume to two ears is about a first value (for example, 3 s) after the user inputs the operation of adjusting the volume to the target volume to the electronic device 100 or after the user inputs the operation of adjusting the volume to the target volume to the TWS headset, respectively, the time required for triggering consistency detection is determined to be 4s after the detected operation of adjusting the volume; for another example, when the user operation is specifically an operation of switching the operation mode, since a time period required to set the current operation mode to the target operation mode to both ears is generally about a second value (for example, 4 s) after the user inputs the operation of switching the operation mode to the target operation mode to the electronic device 100 or after the user inputs the operation of adjusting the operation mode to the TWS headphone to the target operation mode, the time period for triggering the consistency detection is determined to be 5s after the detected operation of switching the operation mode. The other different user operations have corresponding trigger consistency detection time, and the corresponding relationship between the user operation and the trigger consistency detection time may be stored in the trigger detection module in advance, which is not described in detail herein.

When the trigger time is determined according to different headphone states, for example, when the headphone state is that both ears are connected to the electronic device each time, since the time required for the user to listen to audio by wearing the headphones after both ears are connected to the electronic device by transferring audio data to both ears is about a third value (e.g., 5 s), the time to trigger coincidence detection is determined to be 6s after each connection of the detected both ears to the electronic device. For example, when the earphone state is that the wireless communication connection quality between two ears is not good, since the time required to recover the wireless communication connection quality is usually about a fifth value (e.g., 1 s), it is determined that the time for triggering consistency detection is 2s after the earphone state is detected that the wireless communication connection between two ears is not good, corresponding trigger consistency detection times exist for other different earphone states, and the corresponding relationship between the user operation and the time for re-triggering consistency detection may be stored in the trigger detection module in advance, which is not described herein any more.

S502, the trigger detection module sends a consistency detection instruction to the consistency detection module at the trigger time.

Specifically, the trigger detection module sends a consistency detection instruction to the consistency detection module at the trigger time determined in step S501, where the consistency detection instruction is used to trigger the consistency detection module to perform consistency detection on binaural information.

The consistency detection instruction specifically comprises the following steps:

(1) When the trigger detection module determines the time for triggering consistency detection according to the user operation in step S501, the consistency detection instruction sent by the trigger detection module to the consistency detection module includes a type of binaural information corresponding to the user operation. Optionally, the consistency detection instruction further includes target information determined according to the user operation, and the target information is used as a judgment criterion of the consistency detection module in the following step S503.

For example, when the user operates to adjust the volume, the binaural information is specifically the binaural volume, and the target information is the adjusted target volume; for example, when the user operates to switch the working mode, the binaural information is specifically the binaural working mode, and the target information is the switched target working mode; for example, when the user operation is to upgrade the OTA, the binaural information is specifically the binaural OTA, and the target information is the upgraded target OTA; for example, when the user operates to view the electric quantity, the binaural information is specifically the binaural electric quantity, and the like.

(2) When the trigger detection module determines the time for triggering consistency detection according to the earphone status in step S501, the consistency detection instruction sent by the trigger detection module to the consistency detection module includes one or more kinds of binaural information.

For example, the binaural information may include any one or more of: binaural volume, binaural operating mode, binaural OTA, and binaural power, etc. Specifically, the consistency detection instruction may be determined to include binaural information corresponding to an operation with a higher frequency according to the frequency of adjusting the binaural volume, switching the binaural working mode, upgrading the binaural OTA, and checking the binaural volume. Optionally, the frequency of upgrading the binaural OTA is far lower than adjusting the binaural volume, switching the binaural working mode, and checking the binaural electric quantity, so that it is generally default, and in the case that the trigger detection module determines the time for triggering the consistency detection according to the state of the earphone, the consistency detection instruction sent by the trigger detection module to the consistency detection module only includes the binaural volume, the binaural working mode, and the binaural electric quantity.

In stage 2 (S503-S504), consistency check is performed.

And S503, the consistency detection module carries out consistency detection on the binaural information.

Specifically, after receiving the consistency detection instruction sent by the trigger detection module in step S502, the consistency detection module obtains corresponding information of the two earphones according to the type of the binaural information included in the consistency detection instruction, detects the information, and determines whether the binaural information is consistent. In the embodiment of the present application, the binaural information acquired by the audio device 200 is information of two earphones, and therefore the binaural information may also be referred to as: first information of the first earphone and second information of the second earphone. The method for judging whether the binaural information is consistent comprises the following steps: comparing the binaural information with target information (the precondition carried in the consistency detection instruction) respectively, if the binaural information is the same as the target information respectively, determining that the binaural information is consistent, otherwise, considering that the binaural information is inconsistent and executing a subsequent step S504; or comparing the binaural information, if the binaural information is different, determining that the binaural information is consistent, otherwise, determining that the binaural information is inconsistent, and executing the subsequent step S504. For the specific introduction of the target information, reference may be made to the foregoing description, and further description is omitted here.

The consistency detection module is specifically disposed in the electronic device 100 or the wireless audio device 200.

(1) When the consistency detection module is specifically arranged in the electronic device 100, a specific implementation method for acquiring the corresponding binaural information by the consistency detection module according to the binaural information included in the consistency detection instruction is as follows:

in a case where the coincidence detection instruction indicates detection of binaural power amount information.

In the wireless audio system 10, the wireless audio system 20, or the wireless audio system 30, the electronic device 100 may directly detect whether to output the power prompt information of the two earphones at the same time, that is, detect whether the electronic device 100 displays the power prompt information of the two earphones shown in fig. 3C or detect whether the electronic device 100 displays the power prompt information of the two earphones shown in fig. 3D, and determine that the binaural information is consistent when detecting that the binaural power prompt information is synchronously displayed; otherwise, the following step S504 is executed.

In case the conformance detection instruction indicates to detect binaural volume, binaural operating mode, and binaural OTA information.

Taking the wireless audio system 10 as an example, the electronic device 100 may obtain the current volume, operating mode and OTA information of the wireless audio device 201 and the wireless audio device 202 (the secondary ear) from the wireless audio device 201 (the primary ear) via the wireless communication connection 12, wherein the current volume, operating mode and OTA information of the wireless audio device 202 are obtained from the wireless audio device 202 by the wireless audio device 201 via the wireless communication connection 11.

Taking the wireless audio system 20 as an example, the electronic device 100 may obtain the current volume, operating mode and OTA information of the wireless audio device 201 and the wireless audio device 202 (the secondary ear) from the wireless audio device 201 (the primary ear) via the wireless communication connection 21, wherein the current volume, operating mode and OTA information of the wireless audio device 202 are obtained from the wireless audio device 202 by the wireless audio device 201 via the wireless communication connection 22.

Taking the wireless audio system 30 as an example, the electronic device 100 may obtain the current volume, operating mode and OTA information of the wireless audio device 201 from the wireless audio device 201 via the wireless communication connection 31, and may obtain the current volume, operating mode and OTA information of the wireless audio device 202 from the wireless audio device 202 via the wireless communication connection 32.

In particular, in the wireless audio system 10 and the wireless audio system 20, when the coincidence detection module of the electronic device 100 acquires the volume of the sub-ear, the binaural operating mode, the binaural OTA information, and the like through the wireless communication connection with the main ear, if the information of the sub-ear cannot be acquired because the wireless communication connection quality between the electronic device 100 and the main ear is poor or because the wireless communication connection quality between the main ear and the sub-ear is poor, the electronic device 100 switches the current sub-ear to the main ear and the current main ear to the sub-ear to establish a wireless communication connection with the new main ear (i.e., the previous sub-ear), and acquires the information of the new main ear based on the wireless communication connection.

(2) When the consistency detection module is specifically configured in the wireless audio device 200, a specific implementation method for acquiring the corresponding binaural information by the consistency detection module according to the binaural information included in the consistency detection instruction is as follows:

Taking the wireless audio system 10 as an example, the wireless audio device 200 (taking the wireless audio device 201 as a main ear as an example) can acquire information whether the electronic device 100 synchronously displays binaural power through the wireless communication connection 12 with the electronic device 100, which may also be referred to as a second message.

Taking the wireless audio system 20 as an example, the wireless audio device 200 (taking the wireless audio device 201 as a main ear as an example) may acquire information whether the electronic device 100 synchronously displays binaural power through the wireless communication connection 21 with the electronic device 100, which may also be referred to as a second message.

Taking the wireless audio system 30 as an example, the wireless audio device 200 (wireless audio device 201/wireless audio device 201) can acquire information whether the electronic device 100 synchronously displays the binaural power through the wireless communication connection 31/32 with the electronic device 100, which may also be referred to as a second message.

Then, when the consistency detection module in the wireless audio device 200 detects that the binaural power prompt information is synchronously displayed, it determines that the binaural information is consistent; otherwise, the following step S503 is executed.

Taking wireless audio system 10 as an example, wireless audio device 200 (taking wireless audio device 201 as the primary ear as an example) may obtain the volume, operating mode, and OTA information for wireless audio device 202 from wireless audio device 202 (the secondary ear) via wireless communication connection 11.

Taking wireless audio system 20 as an example, wireless audio device 200 (taking wireless audio device 201 as the primary ear as an example) may obtain the volume, operating mode, and OTA information for wireless audio device 202 from wireless audio device 202 (the secondary ear) via wireless communication connection 22.

Taking the wireless audio system 30 as an example, the wireless audio device 201/202 may obtain the volume, operating mode and OTA information of the wireless audio device 202/201 from the wireless audio device 202/201 over the wireless communication connection 33.

Then, the consistency detection module in the wireless audio device 201/the wireless audio device 202 compares the obtained earphone information of the wireless audio device 202/the wireless audio device 201 and the own earphone information with the target information (if the consistency detection instruction carries the obtained earphone information), and determines that the two-ear information is consistent when the two-ear information is the same as the target information; otherwise, the following step S504 is executed. Or, the consistency detection module of the wireless audio device 201/the wireless audio device 202 compares the acquired earphone information of the wireless audio device 202/the wireless audio device 201 with the own earphone information, and determines that the two-ear information is consistent when the two-ear information is the same; otherwise, the following step S504 is executed.

S504, the consistency detection module sends a consistency adjustment instruction to the consistency adjustment module.

Specifically, when the binaural information is inconsistent, the consistency detection module sends a consistency adjustment instruction to the consistency adjustment module, where the consistency adjustment instruction is used to trigger the consistency adjustment module to perform consistency adjustment on the binaural information, so as to provide a better consistency experience for the user.

Wherein, the consistency adjustment instruction specifically carries: target information or information of one earphone (usually the main ear). The target information or the information of one headphone is mainly used for adjusting the binaural information to the target information or adjusting the binaural information to the information of the one headphone, i.e., the main ear. Specifically, when the consistency detection instruction is used to instruct to detect the power information, the consistency adjustment instruction carries instruction information for acquiring the power of the headset corresponding to the power of the headset (not shown) that is not acquired in the electronic device.

And a step 3 (S505) of performing consistency adjustment.

And S505, the consistency adjusting module performs consistency adjustment on the binaural information.

Specifically, after the consistency adjustment module receives the consistency adjustment instruction sent by the consistency detection module in step S504, the consistency adjustment module adjusts the binaural information according to the consistency adjustment instruction to implement binaural consistency.

The consistency adjustment module may be disposed in the electronic device 100 or the wireless audio device 200.

(1) When the consistency adjustment module is disposed in the electronic device 100, a specific implementation method for adjusting the binaural information according to the consistency adjustment instruction by the consistency adjustment module to achieve binaural consistency is as follows:

in the case where the coincidence modulation instruction instructs to adjust the binaural power amount information.

Taking the wireless audio system 10 as an example, the consistency adjustment module in the electronic device 100 obtains the current power of the wireless audio device 201 and the wireless audio device 202 (the sub-ear) from the wireless audio device 201 (the main ear) through the wireless communication connection 12, wherein the current power of the wireless audio device 202 is obtained by the wireless audio device 201 from the wireless audio device 202 through the wireless communication connection 11. Then, the consistency adjustment module in the electronic device 100 displays the acquired binaural power prompt information on a display screen of the electronic device, for example, the binaural power prompt information displayed in fig. 3C to fig. 3D above.

Taking the wireless audio system 20 as an example, the electronic device 100 may obtain the current power of the wireless audio device 201 and the wireless audio device 202 (the secondary ear) from the wireless audio device 201 (the primary ear) through the wireless communication connection 21, wherein the current power of the wireless audio device 202 is obtained by the wireless audio device 201 from the wireless audio device 202 through the wireless communication connection 22. Then, the consistency adjustment module in the electronic device 100 displays the acquired binaural power prompt information on a display screen of the electronic device, for example, the binaural power prompt information displayed in fig. 3C to fig. 3D above.

Taking the wireless audio system 30 as an example, the electronic device 100 may obtain the current power of the wireless audio device 201 from the wireless audio device 201 through the wireless communication connection 31, and may obtain the current power of the wireless audio device 202 from the wireless audio device 202 through the wireless communication connection 32. Then, the consistency adjustment module in the electronic device 100 displays the acquired binaural power prompt information on a display screen of the electronic device, for example, the binaural power prompt information displayed in fig. 3C to fig. 3D above.

Particularly, in the wireless audio system 10 and the wireless audio system 20, when the consistency adjustment module of the electronic device 100 sends the consistency adjustment command through the wireless communication connection with the main ear, if the consistency adjustment command cannot be successfully transmitted because the quality of the wireless communication connection between the electronic device 100 and the main ear is poor or because the quality of the wireless communication connection between the main ear and the sub-ear is poor, the electronic device 100 switches the current sub-ear to the main ear and the current main ear to the sub-ear, so as to establish the wireless communication connection with the new main ear (i.e., the previous sub-ear), and further send the consistency adjustment command to the new main ear based on the wireless communication connection.

In case the conformance detection instruction indicates an adjustment of the binaural volume, the binaural working mode and the binaural OTA information.

Taking the wireless audio system 10 as an example, the electronic device may send target information or primary ear earphone information, specifically, volume, operating mode, and OTA information, to the wireless audio device 201 (primary ear) via the wireless communication connection 12. Then, the wireless audio device 201 (primary ear) adjusts the self information to the target information, and simultaneously transmits the target information or the primary ear headphone information to the wireless audio device 202 (secondary ear) through the wireless communication connection 11 to control the secondary ear to adjust the self information to the target information or the primary ear headphone information.

Taking the wireless audio system 20 as an example, the electronic device may send target information or primary ear earphone information to the wireless audio device 201 (primary ear) through the wireless communication connection 21, where the target information or primary ear earphone information specifically refers to the volume, the operation mode, and the OTA information. Then, the wireless audio device 201 (primary ear) adjusts the self information to the target information, and simultaneously transmits the target information or primary ear headphone information to the wireless audio device 202 (secondary ear) through the wireless communication connection 22 to control the secondary ear to adjust the self information to the target information or primary ear headphone information.

Taking the wireless audio system 30 as an example, the electronic device may transmit the target information to the wireless audio device 201 through the wireless communication connection 31 and transmit the target information or the main earpiece information to the wireless audio device 202 through the wireless communication connection 31. The target information or the main ear-headphone information specifically refers to volume, working mode and OTA information. After that, the wireless audio device 201 adjusts the self information to the target information, and the wireless audio device 202 adjusts the self information to the target information or the main headphone information.

It should be noted that, in the above method flow, when information is transmitted based on wireless connection between two ears or between two ears and the electronic device 100, if the quality of wireless communication between two ears or between two ears and the electronic device 100 is poor or disconnected, the corresponding wireless connection needs to be re-established first, so that the subsequent steps can be executed. For example, in stage 2, when the consistency detection module in the wireless audio device 201 sends the target information or the main ear headphone information to the wireless audio device 202, if the wireless communication quality between the wireless audio device 201 and the wireless audio device 202 (and two ears) is poor or disconnected, the corresponding wireless connection needs to be re-established, and then the wireless audio device 202 can receive the target information or the main ear headphone information and adjust the information to the target information or the main ear headphone information, thereby achieving binaural consistency.

Therefore, after the binaural consistency control method provided by the application is implemented, no matter in any wireless audio system, the problem of the inconsistency of the binaural information can be detected in time, and when the inconsistency of the binaural information is detected, the consistency of the binaural information is adjusted in time, so that better consistency experience is brought to a user.

It should be understood that the steps of the above method embodiments provided by the present application may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in a processor.

The present application also provides an electronic device, which may include: a memory and a processor. Wherein the memory is operable to store a computer program; the processor may be adapted to invoke the computer program in said memory to cause the electronic device to perform the method of any of the above embodiments.

The present application further provides a chip system, where the chip system includes at least one processor, and is configured to implement the functions involved in the method performed by the electronic device in any of the above embodiments.

In one possible design, the system-on-chip further includes a memory to hold program instructions and data, the memory being located within the processor or external to the processor.

The chip system may be formed by a chip, and may also include a chip and other discrete devices.

Optionally, the number of processors in the system on chip may be one or more. The processor may be implemented by hardware or by software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

Optionally, the memory in the system-on-chip may also be one or more. The memory may be integrated with the processor or may be disposed separately from the processor, and the embodiments of the present application are not limited thereto. The memory may be a non-transitory processor, such as a read only memory ROM, which may be integrated on the same chip as the processor or may be separately disposed on different chips.

The system on chip may be a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), a system on chip (SoC), a Central Processor Unit (CPU), a Network Processor (NP), a Digital Signal Processor (DSP), a Microcontroller (MCU), a Programmable Logic Device (PLD), or other integrated chips.

The present application further provides a computer program product comprising: computer program (also may be referred to as code, or instructions) that, when executed, causes a computer to perform the method performed by the electronic device in any of the embodiments described above.

The present application also provides a computer-readable storage medium having stored thereon a computer program (also referred to as code, or instructions). When the computer program is run, the computer is caused to execute the method performed by the electronic device in any of the above embodiments.

The embodiments of the present application can be combined arbitrarily to achieve different technical effects.

In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media capable of storing program codes, such as ROM or RAM, magnetic or optical disks, etc.

In short, the above description is only an example of the technical solution of the present invention, and is not intended to limit the scope of the present invention. Any modifications, equivalents, improvements and the like made in accordance with the disclosure of the present invention are intended to be included within the scope of the present invention.

Claims

1. A binaural consistency control method, characterized in that the method is applied to a first headphone, the method comprising:

the first earphone detects a first user operation, and the first user operation indicates target information; the target information comprises one or more of the following indicated by the first user operation: volume, working mode, OTA upgrade package, clock or pairing information;

the first earphone acquires first information of the first earphone and second information of a second earphone; the first information and the second information each indicate one or more of the following for a corresponding headset: volume, working mode, OTA upgrade package, clock or pairing information;

and if the first information is inconsistent with the target information, the first earphone updates the first information to the target information, and/or if the second information is inconsistent with the target information, the second earphone is controlled to update the second information to the target information.

2. The method of claim 1, wherein after the first headset detects the first user operation, the method further comprises:

and the first earphone determines corresponding trigger time according to the first user operation, wherein the trigger time is used for indicating the first earphone to acquire first information of the first earphone and second information of the second earphone when the trigger time is reached.

3. The method according to claim 2, wherein the trigger time is specifically a first time after the first user operation is detected;

the first time is a default fixed time;

or, the first time is the same as the time required for executing the service corresponding to the first user operation.

4. A binaural consistency control method applied to a first headphone, the method comprising:

the first earphone receives a first message, wherein the first message indicates that the electronic equipment or a second earphone detects a first user operation, and the first user operation indicates target information; the target information comprises one or more of the following indicated by the first user operation: volume, working mode, OTA upgrade package, clock or pairing information;

the first earphone acquires first information of the first earphone and second information of the second earphone; the first information and the second information each indicate one or more of the following for a corresponding headset: volume, working mode, OTA upgrade package, clock or pairing information;

and the first earphone updates the first information into the target information, and/or controls the second earphone to update the second information into the target information under the condition that the second information is inconsistent with the target information.

5. The method of claim 4, wherein after the first message is received by the first headset, the method further comprises:

and the first earphone determines corresponding trigger time according to the first message, wherein the trigger time is used for indicating the first earphone to acquire first information of the first earphone and second information of the second earphone when the trigger time is reached.

6. The method of claim 5, wherein the trigger time is specifically a first time after receiving the first message;

the first time is a default fixed time;

or the first time is the same as the time required for executing the service corresponding to the first user operation.

7. A binaural consistency control method, characterized in that the method is applied to a first headphone, the method comprising:

the first earpiece detects a first state comprising any one or more of: the first earphone and the second earphone are connected, the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed;

the first earphone acquires first information of the first earphone and second information of the second earphone; the first information and the second information each indicate one or more of the following for a corresponding headset: volume, operating mode, OTA upgrade package, clock or pairing information;

and under the condition that the first information is inconsistent with the second information, the first earphone and the second earphone carry out information synchronization.

8. The method of claim 7, wherein after the first earpiece detects the first state, the method further comprises:

and the first earphone determines corresponding trigger time according to the first state, wherein the trigger time is used for indicating the first earphone to acquire first information of the first earphone and second information of the second earphone when the trigger time is reached.

9. The method of claim 8, wherein the trigger time is specifically a first time after the first state is detected;

the first time is a default fixed time;

alternatively, the first time corresponds to the first state.

10. A binaural consistency control method, characterized in that the method is applied to a first headphone, the method comprising:

the first earphone receives a second message, and the second message indicates the electronic equipment to only obtain the electric quantity of the first earphone;

the first earphone acquires the electric quantity of the second earphone;

and the first earphone sends the electric quantity of the second earphone to the electronic equipment, and the electric quantity of the first earphone and the electric quantity of the second earphone are simultaneously displayed by the electronic equipment.

11. The method of claim 10, wherein after the first earpiece detects the first state, the method further comprises:

and the first earphone determines corresponding trigger time according to the first state, wherein the trigger time is used for indicating the first earphone to acquire the second message when the trigger time is reached.

12. The method of claim 11, wherein the trigger time is specifically a first time after receiving the second message;

the first time is a default fixed time;

alternatively, the first time corresponds to the first state.

13. The method of claim 10, wherein the power of the first headset and the power of the second headset are used for displaying on a negative screen or a main interface of the electronic device;

or the electronic device is used for being displayed by the electronic device after the electronic device receives the user operation.

14. A binaural consistency control method, characterized in that the method is applied to a wireless audio system comprising: the device comprises a trigger detection module, a consistency detection module and a consistency adjustment module; the method comprises the following steps:

the trigger detection module detects a first user operation, wherein the first user operation indicates target information; the target information comprises one or more of the following indicated by the first user operation: volume, operating mode, OTA upgrade package, clock or pairing information;

the consistency detection module acquires first information of a first earphone and second information of a second earphone; the first information and the second information each indicate one or more of the following for a corresponding headset: volume, operating mode, OTA upgrade package, clock or pairing information;

and under the condition that the first information is inconsistent with the target information, the consistency detection module controls the consistency adjustment module to update the first information of the first earphone to the target information, and/or under the condition that the second information is inconsistent with the target information, the consistency detection module updates the second information of the second earphone to the target information.

15. The method of claim 14, wherein before the coincidence detection module obtains the first information for the first headset and the second information for the second headset, the method further comprises:

and the trigger detection module determines corresponding trigger time according to the first user operation, wherein the trigger time is used for indicating the consistency detection module to acquire first information of the first earphone and second information of the second earphone after the trigger time is reached.

16. The method according to claim 15, wherein the trigger time is specifically a first time after the first user operation is detected;

the first time is a default fixed time;

17. A binaural consistency control method, characterized in that the method is applied to a wireless audio system comprising: the device comprises a trigger detection module, a consistency detection module and a consistency adjustment module; the method comprises the following steps:

the trigger detection module detects a first state, where the first state includes any one or more of: the method comprises the steps that a first earphone and a second earphone are connected, the communication quality between the first earphone and the second earphone is lower than a threshold value, or the distance between the first earphone and the second earphone is changed;

the consistency detection module acquires first information of the first earphone and second information of the second earphone; the first information and the second information each indicate one or more of the following for a corresponding headset: volume, working mode, OTA upgrade package, clock or pairing information;

and under the condition that the first information is inconsistent with the second information, the consistency detection module controls the consistency adjustment module to synchronize the information of the first earphone and the information of the second earphone.

18. The method of claim 17, wherein before the coincidence detection module obtains the first information for the first headset and the second information for the second headset, the method further comprises:

and the trigger detection module determines corresponding trigger time according to the first state, wherein the trigger time is used for indicating the consistency detection module to acquire first information of the first earphone and second information of the second earphone after the consistency detection module reaches the trigger time.

19. The method of claim 18, wherein the trigger time is specifically a first time after the first state is detected;

the first time is a default fixed time;

alternatively, the first time corresponds to the first state.

20. The method of any of claims 14-19, wherein the wireless audio system comprises an electronic device, the first earpiece and the second earpiece; the trigger detection module, the consistency detection module and the consistency adjustment module are arranged in the electronic equipment, the first earphone or the second earphone.

21. A chip for application to a headset, the headset comprising one or more processors for invoking computer instructions to cause the headset to perform the method of any one of claims 1-13.

22. A wireless audio system, the wireless audio system comprising: the earphone comprises a first earphone, a second earphone and electronic equipment;

the first earpiece is for performing the method of any of claims 1-13.

23. A headset, characterized in that the headset comprises one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the headset to perform the method of any of claims 1-13.