CN118233808A - Speaker control method and electronic device - Google Patents

Abstract

The present application provides a speaker control method and electronic device, which relate to the field of smart terminal technology. The invention solves the problem of the influence on the audio to be played when the sound outlet of the speaker is blocked. The specific scheme is: when it is determined to play the first audio and the second audio, the first speaker is controlled to play the first audio, and the second speaker is controlled to play the second audio; when the sound outlet of the first speaker is blocked, the first speaker is controlled to play the adjusted first audio; or, the second speaker is controlled to play the first audio.

Description

Speaker control method and electronic device

Technical Field

The present application relates to the technical field of intelligent terminals, and in particular to a speaker control method and electronic device.

Background technique

With the iterative update of device hardware, various electronic devices can provide users with more high-quality services. For example, as the number of speakers connected to electronic devices increases, the sound field of the electronic devices also expands, so that electronic devices can provide users with better audio output services.

In some scenarios, the sound outlet of the speaker in the electronic device may be blocked, for example, when the user uses the electronic device, the hand blocks the sound outlet of the speaker, or the foreign object blocks the sound outlet of the speaker. When the sound outlet of the speaker is blocked, it will directly affect the service quality corresponding to the audio output service of the electronic device, such as affecting the actual volume heard by the user and the location of the sound source perceived by the user, which will also affect the user's experience of using the electronic device.

Summary of the invention

The present application provides a speaker control method and an electronic device, which are used to improve the sound effect of audio played by the electronic device when the sound outlet of the speaker is blocked.

To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

In a first aspect, a speaker control method provided by an embodiment of the present application is applied to an electronic device, wherein the electronic device includes a first speaker and a second speaker, and the method includes: when it is determined that a first audio and a second audio are to be played, controlling the first speaker to play the first audio and controlling the second speaker to play the second audio; when a sound outlet of the first speaker is blocked, controlling the first speaker to play an adjusted first audio; or controlling the second speaker to play the first audio.

In the above embodiment, by changing the way the first audio needs to be played by the first speaker, or by controlling the way the second speaker plays the first audio, even if the first speaker is blocked, it will not affect the playing effect of the first audio, thereby ensuring the quality of the audio output of the electronic device and improving the user experience.

In some embodiments, before controlling the first speaker to play the adjusted first audio, the method includes: adjusting a sound wave phase and a vibration amplitude corresponding to the first audio.

In the above embodiment, the sound wave phase and vibration amplitude of the first audio to be played by the first speaker are adjusted to compensate for the phase shift and vibration amplitude attenuation of the sound wave signal actually broadcast after the first speaker is blocked. In this way, the user cannot hear any difference after the first speaker is blocked.

In some embodiments, before adjusting the sound wave phase and vibration amplitude corresponding to the first audio, the method further includes: determining a first occlusion ratio corresponding to the sound outlet of the first speaker; and determining that the first occlusion ratio is less than a first threshold.

In the above embodiment, when the first occlusion ratio is less than the first threshold, the sound wave phase and vibration amplitude corresponding to the first audio are adjusted to improve the impact of the speaker being blocked, while reducing the overhead of switching the speaker to play the first audio.

In some embodiments, before adjusting the sound wave phase and vibration amplitude corresponding to the first audio, the method further includes: determining that a preset priority of the second audio is higher than that of the first audio.

In the above embodiment, when the preset priority of the second audio is higher than that of the first audio, the sound wave phase and vibration amplitude corresponding to the first audio are adjusted to improve the impact of the speaker being blocked, while avoiding affecting the playback of the second audio.

In some embodiments, before controlling the second speaker to play the first audio, the method includes: controlling the first speaker to stop playing the first audio.

In the above embodiment, if the second speaker is used to play the first audio, the first speaker can also be controlled to stop playing the first audio, so that the normal playback of the first audio can be ensured and the service life of the first speaker can be avoided.

In some embodiments, in the case of controlling the second speaker to play the first audio, the method further includes: controlling the second speaker to stop playing the second audio; and controlling the first speaker to play the second audio.

In the above embodiment, the first audio is prevented from being affected by swapping the speakers playing the first audio and the second audio. In other possible embodiments, when the preset priority of the first audio is higher than that of the second audio, the speakers are swapped to ensure that the more important first audio is not affected.

In some embodiments, before controlling the first speaker to stop playing the first audio, the method further includes: determining a first occlusion ratio corresponding to a sound outlet of the first speaker; and determining that the first occlusion ratio is not less than a first threshold.

In some embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio.

In the above embodiment, it is possible to ensure that the playing of the first audio and the second audio are not affected at the same time.

In some embodiments, the sound outlets of the first speaker and the second speaker are oriented in the same direction.

In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the method includes: when the third speaker and the fourth speaker are both playing a third audio, detecting that a sound outlet of the third speaker is blocked; controlling the third speaker to stop playing the third audio; and controlling the fourth speaker to play a fourth audio, wherein the fourth audio is the third audio after adjusting the sound wave phase and vibration amplitude.

In some embodiments, the sound outlets of the third speaker and the fourth speaker face the same direction.

In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the method includes: when the third speaker and the fourth speaker both play the fifth audio and the sixth audio, detecting that the sound outlet of the third speaker is blocked; when the fifth audio is marked as the first type of audio and the sixth audio is not the first type of audio, controlling the third speaker to only play the sixth audio; controlling the fourth speaker to play the seventh audio and the sixth audio, wherein the seventh audio is the fifth audio after the sound wave phase and vibration amplitude are adjusted.

In some embodiments, the electronic device includes a first set, the first set includes multiple audio type identifiers, and the audio matching the audio type identifier in the first set is the first type of audio.

In a second aspect, an electronic device provided by an embodiment of the present application includes one or more processors and a memory; the memory is coupled to the processor, and the memory is used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the one or more processors are used to: when determining to play the first audio and the second audio, control the first speaker to play the first audio, and control the second speaker to play the second audio; when the sound outlet of the first speaker is blocked, control the first speaker to play the adjusted first audio; or control the second speaker to play the first audio.

In some embodiments, before controlling the first speaker to play the adjusted first audio, the one or more processors are further used to: adjust the sound wave phase and vibration amplitude corresponding to the first audio.

In some embodiments, before adjusting the sound wave phase and vibration amplitude corresponding to the first audio, the one or more processors are further used to: determine a first occlusion ratio corresponding to the sound outlet of the first speaker; and determine that the first occlusion ratio is less than a first threshold.

In some embodiments, before adjusting the sound wave phase and vibration amplitude corresponding to the first audio, the one or more processors are further used to: determine that a preset priority of the second audio is higher than that of the first audio.

In some embodiments, before controlling the second speaker to play the first audio, the one or more processors are further used to: control the first speaker to stop playing the first audio.

In some embodiments, when controlling the second speaker to play the first audio, the one or more processors are further used to: control the second speaker to stop playing the second audio; and control the first speaker to play the second audio.

In some embodiments, before controlling the first speaker to stop playing the first audio, the one or more processors are further used to: determine a first occlusion ratio corresponding to the sound outlet of the first speaker; and determine that the first occlusion ratio is not less than a first threshold.

In some embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio.

In some embodiments, the sound outlets of the first speaker and the second speaker are oriented in the same direction.

In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the one or more processors are further used to: when the third speaker and the fourth speaker are both playing the third audio, detect that the sound outlet of the third speaker is blocked; control the third speaker to stop playing the third audio; and control the fourth speaker to play the fourth audio, wherein the fourth audio is the third audio after the sound wave phase and vibration amplitude are adjusted.

In some embodiments, the sound outlets of the third speaker and the fourth speaker are oriented in the same direction.

In some embodiments, the electronic device includes a third speaker and a fourth speaker, and the one or more processors are further used to: when the third speaker and the fourth speaker both play the fifth audio and the sixth audio, detect that the sound outlet of the third speaker is blocked; when the fifth audio is marked as the first type of audio and the sixth audio is not the first type of audio, control the third speaker to only play the sixth audio; control the fourth speaker to play the seventh audio and the sixth audio, and the seventh audio is the fifth audio after the sound wave phase and vibration amplitude are adjusted.

In some embodiments, the electronic device includes a first set, the first set includes multiple audio type identifiers, and the audio matching the audio type identifier in the first set is the first type of audio.

In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method in the above-mentioned first aspect and possible embodiments thereof.

In a fourth aspect, the present application provides a computer program product. When the computer program product is run on the above-mentioned electronic device, the electronic device executes the method in the above-mentioned first aspect and possible embodiments thereof.

It can be understood that the electronic devices, computer storage media and computer program products provided in the above-mentioned aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a tablet computer provided in an embodiment of the present application;

FIG2 is a second schematic diagram of a tablet computer provided in an embodiment of the present application;

FIG3 is a schematic diagram of a mobile phone provided in an embodiment of the present application;

FIG4 is one of the example diagrams of a scenario in which a user uses an electronic device provided in an embodiment of the present application;

FIG5 is a second example diagram of a scenario in which a user uses an electronic device according to an embodiment of the present application;

FIG6 is a third example diagram of a scenario in which a user uses an electronic device according to an embodiment of the present application;

FIG. 7 is one of the structural example diagrams of an electronic device provided in an embodiment of the present application;

FIG8 is a second structural diagram of an electronic device provided in an embodiment of the present application;

FIG9 is one of the example diagrams of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG10 is a second example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG11 is an example diagram of a sound wave signal obtained by superimposing the sound wave signal with other sound waves before and after the sound wave signal is phase shifted according to an embodiment of the present application;

FIG12 is a third example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG13 is a fourth example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG14 is a fifth example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG15 is a sixth example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG16 is a seventh example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG17 is an eighth example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG18 is a ninth example diagram of an electronic device controlling a speaker channel to play audio provided by an embodiment of the present application;

FIG19 is a flowchart of the steps of the speaker control method provided in an embodiment of the present application;

FIG. 20 is an example diagram of a chip system provided in an embodiment of the present application.

Detailed ways

In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

With the development of technology, the hardware resources (such as storage resources, computing resources, input and output resources, etc.) configured in various electronic devices are constantly iterating and upgrading, aiming to provide users with higher quality services.

Taking the audio output module (eg, speaker) of an electronic device as an example, as the audio output module is continuously iterated and upgraded, the quality of audio output services provided by the electronic device is also improved accordingly.

Exemplarily, upgrading the audio output module in the electronic device may include adding speaker types, such as configuring a high-frequency speaker and a low-profile speaker, so that different speakers can play audio of different frequencies, thereby improving the audio playback quality.

As another example, the upgrade of the audio output module in the electronic device may include an increase in the number of speakers, for example, iteratively upgrading from configuring two speakers to configuring four speakers, or upgrading to configuring eight speakers. In this way, more speakers can effectively expand the sound field of the electronic device and increase the stereoscopic sense of the sound effects of the electronic device. For example, when a user uses an electronic device to play a game, the electronic device can simulate a more stereoscopic game sound effect through multiple speakers, allowing the user to immersively experience the virtual game world.

In some embodiments, each speaker of the electronic device corresponds to a sound outlet, and the sound outlets corresponding to different speakers are located at different positions on the housing of the electronic device.

In addition, the arrangement of speaker holes may be different or similar for different types of electronic devices.

In some embodiments, the electronic device may be a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable device (such as a smart watch), a smart screen, a game console, and an augmented reality (AR) or virtual reality (VR) device or other intelligent electronic device.

Taking a tablet computer as an example, the speaker holes may be arranged on the left and right sides of the tablet computer.

For example, if a tablet computer is equipped with 8 speakers, 4 speaker sound holes can be set on the left edge of the tablet computer housing, and 4 speaker sound holes can also be deployed on the right edge of the tablet computer housing. Each sound hole corresponds to a speaker. It can be understood that the sound wave signal generated by the speaker when playing audio needs to be emitted outward from the corresponding sound hole. In this way, the position of the sound hole on the housing can also be called the configuration position of the speaker.

That is to say, if the sound outlet corresponding to the speaker is located at the left edge of the electronic device, then the speaker can be said to be deployed at the left edge of the electronic device. Similarly, if the sound outlet corresponding to the speaker is located at the right edge of the electronic device, then the speaker can be said to be deployed at the right edge of the electronic device.

In addition, in the above example, by symmetrically opening sound outlet holes on the left and right sides of the electronic device housing, the speakers can be symmetrically deployed on the left and right sides of the electronic device to form left and right channels and expand the sound field of the electronic device.

For example, among the four sound outlet holes opened on the left edge of the electronic device, two sound outlet holes are opened on the upper side of the left edge, and two sound outlet holes are opened on the lower side of the left edge.

As shown in FIG. 1 , there are two speaker holes on the upper side of the left edge of the tablet computer, and there are also two speaker holes on the lower side of the left edge of the tablet computer.

Similarly, among the four sound holes opened on the right edge, two sound holes are opened on the upper side of the right edge, and two sound holes are opened on the lower side of the right edge. As shown in FIG1 , there are two speaker sound holes on the upper side of the right edge of the tablet computer, and there are also two speaker sound holes on the lower side of the right edge of the tablet computer.

In addition, the sound outlet holes located on the upper side of the left edge are symmetrical with the sound outlet holes located on the upper side of the right edge, and the sound outlet holes located on the lower side of the left edge are symmetrical with the sound outlet holes located on the lower side of the right edge.

It should be noted that the above-mentioned up, down, left, and right may be directions determined with the tablet computer housing as a reference. For example, when the tablet computer is rectangular, the two relatively short edges of the tablet computer housing are the left edge and the right edge, and the two relatively long edges are the upper edge and the lower edge.

The portion near the upper edge on the left side edge can be called the upper side of the left side edge, and the portion near the lower edge can be called the lower side of the left side edge. Similarly, the portion near the upper edge on the right side edge can be called the upper side of the right side edge, and the portion near the lower edge can be called the lower side of the right side edge.

For another example, the four sound holes on the left edge of the electronic device are all opened on the lower side (or upper side) of the left edge, and the four sound holes are arranged adjacent to each other. Similarly, the four sound holes on the right edge of the electronic device are all opened on the lower side (or upper side) of the right edge, and the four sound holes are arranged adjacent to each other. For example, as shown in FIG2 , there are four speaker sound holes on the lower side of the left edge of the tablet computer, and there are four speaker sound holes on the lower side of the right edge of the tablet computer.

Taking a mobile phone as an example, the speaker holes can be arranged on the upper and lower sides of the mobile phone.

For example, in the case where a mobile phone is equipped with 8 speakers, 4 sound holes can be opened on the upper edge of the mobile phone shell, and 4 sound holes can be opened on the lower edge. In this way, 4 speakers can be deployed on the upper edge of the mobile phone, and 4 speakers can be deployed on the lower edge of the mobile phone. The speakers deployed symmetrically on the upper and lower edges can also form left and right channels to expand the sound field of the electronic device. The speaker deployed on the left side of the upper edge is symmetrical with the speaker deployed on the left side of the lower edge. The speaker deployed on the right side of the upper edge is also symmetrical with the speaker deployed on the right side of the lower edge.

For example, among the four speakers deployed on the upper edge, two speakers are deployed on the left side of the upper edge and two speakers are deployed on the right side of the upper edge. Similarly, among the four speakers deployed on the lower edge, two speakers are deployed on the left side of the lower edge and two speakers are deployed on the right side of the lower edge.

As shown in FIG3 , there are two speaker holes on the left side of the upper edge of the mobile phone, and two speaker holes on the right side of the upper edge. There are two speaker holes on the left side of the lower edge of the mobile phone, and two speaker holes on the right side of the lower edge.

It should be noted that the above-mentioned up, down, left and right can be directions determined by taking the housing of the mobile phone as a reference. For example, the two relatively short edges of the mobile phone housing are the upper edge and the lower edge, and the two relatively long edges are the left edge and the right edge.

On the housing of the mobile phone, the portion of the upper edge close to the left edge can be called the left side of the upper edge, and the portion close to the right edge can be called the right side of the upper edge. Similarly, the portion of the lower edge close to the left edge can be called the left side of the lower edge, and the portion close to the right edge can be called the right side of the lower edge.

In other possible embodiments, the speaker of the tablet computer may also be disposed on the upper edge and the lower edge. Similarly, the speaker of the mobile phone may also be disposed on the left edge and the right edge, which is not specifically limited in the embodiments of the present application.

In some embodiments, the sound outlet of the speaker is arranged at the side edge (e.g., the upper side edge, the lower side edge, the left side edge, and the right side edge) of the electronic device housing, which can amplify the sound field of the electronic device and enhance the stereoscopic sense of the broadcast audio. However, when a user uses an electronic device, he or she usually holds the side edge of the electronic device, which often causes the sound outlet of the speaker to be blocked.

It is understandable that if the sound outlet of the speaker is blocked while the speaker is playing audio, the audio actually emitted by the speaker will be affected, for example, the volume will become smaller, the sound wave phase corresponding to the audio (which can be simply referred to as audio phase) will change, etc.

Taking a tablet computer as an example, as shown in FIG4 , when a user uses a tablet computer, the user holds the lower side of the left edge of the tablet computer with the left hand and holds the lower side of the right edge with the right hand. In this way, the spatial position of the tablet computer can be fixed and the user can operate the tablet computer conveniently.

In the scenario where the speakers in the tablet computer are deployed at the positions shown in FIG1 , the user's hands will inevitably block the speakers deployed at the lower side of the left edge and the lower side of the right edge. When the speakers at the lower side of the left edge and the lower side of the right edge are blocked, the audio playback effect of the tablet computer will be affected.

For example, as shown in FIG5 , when the tablet computer is playing the same audio, if the speakers at the lower left and right edges of the tablet computer are blocked, the user will hear a decrease in the playback volume corresponding to the speakers at the lower left and right edges.

As another example, when the tablet computer is playing audio, if the speakers on the lower left and right edges of the tablet computer are blocked, the phase of the audio broadcast by the blocked speakers will change. In this way, after being superimposed with the audio played by other speakers in the tablet computer, the overall audio phase will also change due to the cancellation of the audio in some frequency bands.

In this way, as shown in FIG6 , before and after the speaker is blocked, as the overall audio phase changes, the user intuitively feels that the position of the sound source changes.

For example, when a user uses a tablet to play a shooting game, the tablet plays footsteps from the left side of the game world. If the user's hand does not block the speaker, the source of the footsteps heard by the user is located to the left of the user. If the user's hand blocks the speaker, the source of the footsteps heard by the user will shift to the left front of the user. Obviously, the tablet cannot accurately display the game sound effects at this time, affecting the user's experience.

In addition, in addition to the user's hands blocking the speaker sound holes when using an electronic device, the audio actually emitted by the speaker may also be affected if foreign objects are blocked in the speaker sound holes or the electronic device is equipped with an inappropriate protective case that causes the sound holes to be blocked.

In order to improve the above-mentioned problems, an embodiment of the present application provides a speaker control method. Among them, the speaker control method is applied to an electronic device equipped with multiple speakers. In this way, the electronic device can adjust the audio played by at least one speaker in the electronic device according to the obstruction of the speaker sound outlet (such as, whether it is obstructed or not, whether it is blocked or not, the degree of obstruction, and the blockage situation), such as adjusting the audio content played by the speaker, and for example, adjusting the audio phase and audio energy played by the speaker. Among them, after adjusting the audio phase, the phase of the sound wave signal corresponding to the audio will change. After adjusting the audio energy, the vibration amplitude of the sound wave corresponding to the audio will also change.

It can be understood that the electronic device can compensate for the impact of the speaker being blocked on the audio playback effect by adjusting the audio played by the speaker. The compensation principle can be referred to the description in the subsequent embodiments and will not be described in detail here. In this way, not only the intelligence level of the electronic device in audio playback is improved, but also the user experience is improved.

Please refer to FIG. 7 , which is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application.

As shown in Figure 7, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

Among them, the above-mentioned sensor module 180 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

It is understandable that the interface connection relationship between the modules illustrated in this embodiment is only for illustrative purposes and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and/or instructions stored in a memory provided in the processor.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include N cameras 193, where N is a positive integer greater than 1.

The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

In some embodiments, a large number of core components in electronic devices, such as processors (central processing units, image processors, etc.), memory, and various types of host controllers, can be integrated into the main chip. The high integration of the main chip helps to reduce the physical space of electronic devices and meet the current user demand for lightweight and portable electronic devices.

In some embodiments, the main chip is integrated with a host controller for managing the speaker, referred to as the speaker controller. In addition, the main chip can also correspond to multiple audio digital interfaces, such as a time division multiplexing (TDM) digital interface. Each audio digital interface corresponds to a speaker. In other words, the speaker configured in the electronic device can be connected to the speaker controller through the audio digital interface and receive the control instructions sent by the speaker controller. In this way, the speaker controller can control the audio played by each speaker.

For example, the electronic device shown in FIG8 is equipped with 8 speakers, so the main chip of the electronic device can provide at least 8 audio digital interfaces, such as the main chip provides audio digital interface 1, audio digital interface 2, audio digital interface 3, audio digital interface 4, audio digital interface 5, audio digital interface 6, audio digital interface 7, and audio digital interface 8. The above 8 audio digital interfaces are respectively connected to a speaker. Each audio digital interface and the speaker connected to the interface can form a speaker channel.

In some embodiments, the electronic device may group the speaker channels corresponding to the multiple speakers, for example, grouping the speaker channels corresponding to at least two speakers into one group, so that the speakers in the same group are used to play the same audio data.

Exemplarily, as shown in FIG8 , when the eight speakers of the electronic device include four high-frequency speakers and four low-frequency speakers, the speaker channels corresponding to one high-frequency speaker and one low-frequency speaker may be grouped together.

For example, audio digital interface 1 and a low-frequency speaker form a speaker channel, audio digital interface 2 and a high-frequency speaker form a speaker channel, and the speaker channels corresponding to audio data interface 1 and audio digital interface 2 are grouped together. Similarly, the speaker channels corresponding to audio digital interface 3 and audio digital interface 4 can be grouped together, the speaker channels corresponding to audio digital interface 5 and audio digital interface 6 can be grouped together, and the speaker channels corresponding to audio digital interface 7 and audio digital interface 8 can be grouped together.

In this way, when the audio data includes a high-frequency part and a low-frequency part, the high-frequency part of the audio data is played (played) by the high-frequency speakers in the same group, and the low-frequency part of the audio data is played by the low-frequency speakers in the same group.

In some embodiments, the grouping of speaker channels can be pre-configured, and the speaker sound holes corresponding to the same group of speaker channels are arranged adjacent to each other on the electronic device.

For example, when the electronic device is a tablet computer as shown in FIG1 , the speakers on the lower left side of the tablet computer can be grouped into a group, the speakers on the upper left side of the tablet computer can be grouped into a group, the speakers on the lower right side of the tablet computer can be grouped into a group, and the speakers on the upper right side of the tablet computer can be grouped into a group.

In some embodiments, the electronic device can control the audio to be played by each group of speaker channels through the main chip, and can also control the energy, phase, etc. of the audio to be played by each speaker.

It is understandable that when a specific service requirement is detected, the electronic device can play the corresponding audio data according to the service requirement, wherein the specific service requirement can be a service requirement for instructing to play audio.

Exemplarily, the above-mentioned specific business demand may be a business demand generated by user operation or application business logic triggering during the running of an application program on the electronic device.

For example, a video application is an application that can play video data a, and video data a includes audio data a. Thus, during the operation of the video application, if a user makes an operation to instruct to play video data a, the electronic device can determine that there is currently a business demand to play audio data a, and the business demand can instruct the electronic device to play audio data a.

For another example, after starting a game application with game sound effects, the electronic device may determine that there is currently a business demand for playing game audio data, and the business demand may instruct the electronic device to play the corresponding game audio data.

For another example, the business logic of a social application includes ringing a reminder for social information. Thus, when the social application is running and social information is received, the electronic device can determine that there is a business demand for playing a ringing audio, and the business demand can instruct the electronic device to play the ringing audio.

In some scenarios, the audio data that the electronic device needs to play may be a single audio, such as a ringing audio.

In the scenario where the audio data played by the electronic device is a single audio, the electronic device can control all speaker channels to play the audio through the main chip, that is, all speaker channels play the same audio content. In addition, the electronic device can also control the audio phase and audio energy of the audio data broadcast by each speaker through the main chip, so that the electronic device can achieve the ideal sound effect when playing the audio data. For the specific implementation method, please refer to the relevant technology, which will not be repeated here.

In other scenarios, the audio data that the electronic device needs to play may also be a combination of multiple types of audio data, and the audio content corresponding to different types of audio may be different. For example, game audio data composed of one or more of background sound, footstep sound effects, and gunshot sound effects. Another example is audio data a composed of one or more of background sound and dialogue sound effects.

In the scenario where the audio data played by the electronic device is a combination of multiple types of audio data, the electronic device can determine the audio that each group of speaker channels needs to play from the audio data, and control each group of speaker channels to play the corresponding audio through the main chip. Among them, in each group of speaker channels, there may be multiple groups of speaker channels corresponding to the same audio, or there may be different groups of speaker channels corresponding to different audio.

In some embodiments, speaker channels configured on the same side edge of the electronic device play the same audio, and speaker channels configured on different side edges of the electronic device play different audio.

Take the electronic device as a tablet computer as an example. As shown in FIG9 , the audio data played by the tablet computer includes a regular sound effect, a specific sound effect 1 and a specific sound effect 2.

Among them, the above-mentioned specific sound effect 1 and specific sound effect 2 are both specific sound effects. The specific sound effect can be a pre-selected type of sound effect. It can be understood that the specific sound effect is a relatively important audio in the audio data, or it can be an audio that the user does not want the playback effect to be affected.

For example, the audio data is the game audio data of a shooting game, and the game audio data includes background sound, footstep sound effects, gunshot sound effects, etc. If the pre-selected types of sound effects include footstep sound effects and gunshot sound effects, then it can be determined that the footstep sound effects and gunshot sound effects appearing in the game audio data are all specific sound effects. Among them, the footstep sound effects and gunshot sound effects from the left side of the game world are determined as specific sound effect 1. The footstep sound effects and gunshot sound effects from the right side of the game world are determined as specific sound effect 2.

In addition, the above-mentioned regular sound effects may refer to other audios other than specific sound effects. Continuing with the above example, the regular sound effects in the game audio data may be background sounds.

In some examples, the electronic device may be configured with a first set, which is composed of multiple audio types. For example, the first set includes audio types such as footstep sound effects, gunshot sound effects, and dialogue sound effects.

Exemplarily, the first set may be a configuration file in an application for recording specific sound effects, and the configuration file includes a type identifier of at least one type of sound effect. In this way, when parsing the configuration file of an application, the first set corresponding to the application may be obtained. For example, in a configuration file of a shooting game, the parsed first set may include footstep sound effects and gunshot sound effects. For another example, in a configuration file of a video application, the parsed first set may include dialogue sound effects, etc.

As another example, the first set may also be a configuration file in a system file for recording specific sound effects.

In some embodiments, the sound effects that match the type identifier in the first set are also specific sound effects. The electronic device defaults that the preset priority corresponding to the audio belonging to the specific sound effect is higher than the audio not belonging to the specific sound effect. Of course, in other possible embodiments, a list can also be preconfigured in the electronic device, and the list contains multiple types of audio and corresponding priorities. In this way, the priorities corresponding to various types of audio can be determined by looking up the table.

The priority corresponding to the above audio has a high reference value when determining whether to exchange the speakers corresponding to the audio, and to a certain extent, guarantees the playback effect corresponding to the audio with a higher priority.

In the above example, the speaker channel on the left edge of the tablet computer can be used to play regular sound effects and specific sound effect 1. For example, when a regular sound effect needs to be played, the main chip controls the speaker channel on the left edge to play the regular sound effect. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to the regular audio. Similarly, when specific sound effect 1 needs to be played, the main chip controls the speaker channel on the left edge to play the specific sound effect 1. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to specific sound effect 1. When regular sound effects and specific sound effect 1 need to be played at the same time, the main chip can mix the regular sound effects and specific sound effect 1, and then control the speaker channel on the left edge to play. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to the above-mentioned mixing.

In addition, the speaker channel on the right edge of the tablet computer can be used to play regular sound effects and specific sound effect 2. For example, when a regular sound effect needs to be played, the main chip controls the speaker channel on the right edge to play the regular sound effect. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to the regular audio. Similarly, when a specific sound effect 1 needs to be played, the main chip controls the speaker channel on the right edge to play the specific sound effect 1. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to the specific sound effect 1. When regular sound effects and specific sound effect 1 need to be played at the same time, the main chip can mix the regular sound effects and specific sound effect 1, and then control the speaker channel on the right edge to play. At this time, the sound wave signal actually broadcast by the speaker channel is the sound wave signal corresponding to the above-mentioned mixing.

As shown in FIG. 9 , the speaker channels in the tablet computer have been grouped. The “normal sound effect + specific sound effect 1” or “normal sound effect + specific sound effect 2” displayed relative to each group of speaker channels in FIG. 9 indicates the audio that needs to be played collaboratively by the group of speaker channels.

In addition, in a specific scenario, the audio played by the speaker channel on the left edge and the speaker channel on the right edge can be interchanged. For example, a specific scenario may be that the tablet computer is rotated so that the speaker on the original left edge faces the right side of the user, and the speaker on the original right edge faces the left side of the user. For example, the tablet computer shown in FIG9 detects that the tablet computer is rotated 180 degrees, that is, the speaker on the original left edge faces the right side of the user, and the speaker on the original right edge faces the left side of the user, then the normal sound effect and the specific sound effect 2 are played by the speaker channel on the original left edge, and the normal sound effect and the specific sound effect 1 are played by the speaker channel on the original right edge.

In other embodiments, the audio played by the speaker channels arranged on the same side edge of the electronic device may also be different.

Continuing to take the electronic device as a tablet computer as an example. As shown in FIG10 , when the audio data played by the tablet computer includes background sound, specific sound effect 1 and specific sound effect 2, specific sound effect 1 can be played by the speaker channel on the lower side of the left edge of the tablet computer, and the background sound can be played by the speaker channel on the upper side of the left edge of the tablet computer. In addition, specific sound effect 2 can also be played by the speaker channel on the lower side of the right edge of the tablet computer, and the background sound can be played by the speaker channel on the upper side of the right edge of the tablet computer.

In summary, in an embodiment of the present application, when the electronic device needs to play audio data, it can identify various types of specific sound effects from the audio data. Then, a specific speaker channel is controlled to play the specific sound effect. In some examples, a single specific speaker channel can be used to play at least one type of specific sound effect. Of course, the speaker channel can also be used to play regular sound effects. That is, similar to what is shown in Figure 9, the speaker channel can not only play specific sound effects, but also regular sound effects. In some other examples, a single specific speaker channel is only used to play specific sound effects, and other speaker channels play regular sound effects. That is, similar to what is shown in Figure 10, a specific speaker channel is only used to play specific sound effects, and other speaker channels are used to play regular sound effects.

In addition, the above-mentioned specific speaker channel may be a speaker channel in the electronic device that meets a preset rule. Exemplarily, the speaker channel that meets the preset rule may be any of the following:

(1) Among the speaker channels on the same side edge, the speakers are located in the speaker channels on the lower side of the same side edge.

(2) Among the speaker channels on the same side edge, the speaker is located on the upper side of the same side edge.

(3) All speaker channels in an electronic device.

(4) The speaker channel to which the audio digital interface marked with a specific identifier belongs. The specific identifier of the audio digital interface can be pre-configured. For example, it can be configured by the developer of the electronic device, or by the user of the electronic device, and the embodiments of the present application do not specifically limit this.

In addition, the above-mentioned specific identifier may also include multiple types of specific identifiers, such as a left channel specific identifier and a right channel specific identifier.

As an implementation method, a mapping relationship table between an audio digital interface and a specific identifier is configured in the electronic device, and the electronic device can play a specific sound effect through a specific speaker channel and play a regular sound effect through other speaker channels according to the pre-configured mapping relationship table. For example, the mapping relationship is shown in Table 1:

Table 1

Audio Digital Interface Specific identification Audio data interface 1 Left channel specific identification Audio data interface 2 Left channel specific identification Audio data interface 3 "None" mark Audio data interface 4 "None" mark Audio data interface 5 "None" mark Audio data interface 6 "None" mark Audio data interface 7 Right channel specific identification Audio data interface 8 Right channel specific identification

As shown in Table 1, the mapping relationship table includes all audio data interfaces in the electronic device, such as audio data interface 1 to audio data interface 8. In addition, the mapping relationship table also includes audio data interfaces marked with specific identifiers, such as audio data interface 1, audio data interface 2, audio data interface 7, and audio data interface 8. The above mapping relationship table also includes specific identification types corresponding to each audio data interface, for example, audio data interface 1 and audio data interface 2 correspond to left channel specific identifiers, and audio data interface 7 and audio data interface 8 correspond to right channel specific identifiers.

In the above implementation, the electronic device can also respond to the operation of the developer or user to adjust the correspondence between the audio data interface and various specific identifiers in the mapping table to configure the specific identifier corresponding to the audio data interface.

In addition, when the specific identifier includes multiple types, the electronic device can also determine the speaker channel used to play various specific sound effects according to the category of the specific identifier. For example, when the electronic device plays game audio data, it is determined to use the speaker channel with the specific identifier of the left channel to play specific sound effects from the left side of the game character in the game world, such as footsteps on the left side. For another example, when the electronic device plays game audio data, it is determined to use the speaker channel with the specific identifier of the right channel to play specific sound effects from the right side of the game character in the game world, such as footsteps from the right side.

As an implementation method, the electronic device may also pre-configure a correspondence 1 between different types of specific sound effects and various types of specific identifiers. In this way, after the electronic device determines that any type of specific sound effect, such as specific sound effect a, needs to be played, the electronic device may determine the specific identifier corresponding to the specific sound effect a, such as specific identifier a, according to the above correspondence 1. Then, in combination with the mapping relationship table, the audio data interface a corresponding to the specific identifier a is determined. In this way, the speaker channel corresponding to the audio data interface a may be controlled to play the specific sound effect a.

In some embodiments, when the electronic device is playing audio data, if it is detected that a speaker is blocked, the audio played by one or more groups of speaker channels can be adjusted.

In an exemplary scenario, when a user covers the sound outlet of a speaker on the housing of an electronic device with his hand, the electronic device can detect that the speaker channel is blocked. It can be understood that the electronic device can detect whether the speaker channel is blocked by referring to related technologies, for example, by detecting the impedance value corresponding to the speaker, to determine whether the speaker channel is blocked and the degree of the blockage. The specific implementation details will not be repeated here.

In an exemplary scenario, when the sound outlet of a speaker is blocked by a foreign object, the electronic device can also recognize that the speaker channel is blocked.

In some embodiments, the electronic device adjusts the audio played by one or more speaker channels in the following ways:

In the first way, the electronic device can adjust only the audio played by the speaker channel with occlusion (that is, the speaker channel with the speaker blocked, which may be referred to as speaker channel a later). For example, the audio energy and audio phase of the audio played by the speaker channel a group are adjusted.

It is understandable that when a speaker channel is blocked or clogged, even if the same audio is played, the actual sound wave signal broadcast by the corresponding speaker channel will change, for example, the phase will change, and the vibration amplitude will change. For users, these changes will reduce the volume they hear and change the perceived sound source location.

As shown in Figure 11, when speaker channel a is not blocked or blocked, when speaker channel a plays the corresponding audio, the actual broadcast sound wave signal a and the sound wave signal b broadcast by other speaker channels are superimposed to obtain sound wave signal c. When speaker channel a is blocked or blocked, the audio played by speaker channel a will be phase shifted, that is, the phase of the sound wave signal a actually broadcast by speaker channel a will change. In addition, the sound wave signal a and the sound wave signal b after the phase shift are superimposed to obtain the sound wave signal d.

As shown in Figure 11, the phase between the sound wave signal d and the original sound wave signal c also changes. At the same time, after the phase of the sound wave signal a changes, the sound waves in some frequency bands of the sound wave signal a and the sound wave signal b will cancel each other out, and the vibration amplitude of the sound wave signal d obtained after superposition will also be smaller than that of the sound wave signal c.

At this time, when the electronic device modulates the audio to be played by speaker channel a, it can adjust the phase of the audio, thereby compensating for the phase shift caused by the occlusion of speaker channel a. For example, after speaker channel a is blocked, the actual broadcast audio shifts the phase by half of π, so when modulating the audio to be played by speaker channel a, it is necessary to compensate for the phase by half of π.

In addition, as shown in FIG11 , when the speaker channel a is blocked or clogged, the vibration amplitude of the sound wave signal a actually broadcasted also attenuates when the speaker channel a plays the corresponding audio.

At this time, when the electronic device modulates the audio to be played by the speaker channel a, it can adjust the audio energy of the audio, thereby compensating for the attenuation of the vibration amplitude caused by the occlusion of the speaker channel a.

That is, in the embodiment of the present application, the electronic device can adjust the sound wave signal actually broadcasted by the speaker channel a to the state before the speaker channel a is not blocked by adjusting the audio phase and audio energy. In addition, in other embodiments, the sound wave signal actually broadcasted by the speaker channel a can be adjusted to the state before the speaker channel a is not blocked by adjusting the audio in the relevant technology, and this is not specifically limited in the embodiment of the present application. In this way, for the user, whether the speaker channel is blocked or not will not affect the sound heard by the user.

Take the electronic device as a tablet computer as shown in FIG9 as an example.

As shown in FIG12 , when no speaker channel is blocked or clogged, a group of speaker channels configured on the upper side of the left edge of the tablet computer is used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the lower side of the left edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the upper side of the right edge of the tablet computer is used to play regular sound effects and/or specific sound effect 2. A group of speaker channels configured on the lower side of the right edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 2.

As shown in Figure 12, when a group of speaker channels on the lower side of the left edge are blocked or clogged, that is, when a group of speaker channels configured on the lower side of the left edge is speaker channel a, adjust the audio played by a group of speaker channels on the lower side of the left edge, that is, control the speaker channel to play the adjusted regular sound effects and/or specific sound effects 1.

As shown in Figure 12, when a group of speaker channels on the lower side of the right edge have their speakers blocked or clogged, that is, when a group of speaker channels arranged on the lower side of the right edge are speaker channels a, adjust the audio played by a group of speaker channels on the lower side of the right edge, that is, control the speaker channels to play the adjusted regular sound effects and/or specific sound effects 2.

It is understood that the above adjustment may include adjustment of audio phase, audio energy, etc. By adjusting the audio phase and audio energy, the sound wave signals actually broadcast before and after the speaker channel is blocked are made similar (for example, the corresponding phase and vibration amplitude are nearly equal), and the volume actually heard by the user can also remain unchanged.

Of course, Figure 12 exemplarily shows the scenario where the speaker channels at the lower side of the left edge and the lower side of the right edge belong to speaker channel a. It can be understood that the speaker channels of other groups are handled in the same way when the speakers are blocked or blocked, which will not be repeated here.

In the second way, the electronic device can pause the use of the group of speaker channels a, and at the same time, adjust the audio played by the speaker channel on the same side and not blocked (such as speaker channel b).

Wherein, adjusting the audio played by the speaker channel b may include adjusting the audio phase and audio energy of the played audio. In addition, adjusting the audio played by the speaker channel b may also include adjusting the played audio content.

Example 1: Take the electronic device as the tablet computer shown in FIG9 as an example. As shown in FIG13, when no speaker is blocked or blocked, a group of speaker channels configured on the upper side of the left edge of the tablet computer is used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the lower side of the left edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the upper side of the right edge of the tablet computer is used to play regular sound effects and/or specific sound effect 2. A group of speaker channels configured on the lower side of the right edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 2.

As shown in FIG13 , when a speaker of a group of speaker channels at the lower side of the left edge is blocked or clogged, that is, when a group of speaker channels arranged at the lower side of the left edge is speaker channel a, the group of speaker channels at the lower side of the left edge pauses playing audio. In addition, a group of speaker channels arranged at the upper side of the left edge, that is, speaker channel b, plays the adjusted regular sound effects and/or specific sound effect 1.

As shown in FIG13 , when a speaker in a group of speaker channels at the lower side of the right edge is blocked or clogged, that is, when a group of speaker channels arranged at the lower side of the right edge is speaker channel a, the group of speaker channels at the lower side of the right edge pauses playing audio. In addition, a group of speaker channels arranged at the upper side of the right edge, that is, speaker channel b, plays the adjusted regular sound effects and/or specific sound effects 2.

The adjustments mentioned in the above Example 1 may include adjustments to audio phase, audio energy, etc.

It can be understood that before the speaker channel a is blocked or blocked, the sound wave signals actually broadcast by the speaker channel a and the corresponding speaker channel b are superimposed to obtain the sound wave signal e. After the speaker channel a is blocked or blocked, the sound wave signals actually broadcast by the speaker channel a and the corresponding speaker channel b are superimposed to obtain the sound wave signal f. By adjusting the audio phase and audio energy of the audio required to be broadcast by the speaker channel b, the phase difference and vibration amplitude difference between the sound wave signal e and the sound wave signal f can be reduced. In addition, the volume actually heard by the user can also remain unchanged.

Example 2: Take the electronic device as a tablet computer as shown in FIG10 as an example. As shown in FIG14, when no speaker channel is blocked or blocked, a group of speaker channels configured on the upper side of the left edge of the tablet computer is used to play general sound effects. A group of speaker channels configured on the lower side of the left edge of the tablet computer is used to play specific sound effect 1. A group of speaker channels configured on the upper side of the right edge of the tablet computer is used to play general sound effects. A group of speaker channels configured on the lower side of the right edge of the tablet computer is also used to play specific sound effect 2.

As shown in FIG14 , when a group of speaker channels on the lower side of the left edge are blocked or clogged, that is, when a group of speaker channels arranged on the lower side of the left edge are speaker channels a, the group of speaker channels on the lower side of the left edge pause playing audio. In addition, a group of speaker channels arranged on the upper side of the left edge, that is, speaker channels b, play the adjusted regular sound effects and/or specific sound effect 1. That is, speaker channel b, which originally does not need to play specific sound effect 1, needs to play specific sound effect 1 in addition to playing regular sound effects when the speaker channel on the lower side of the left edge is blocked or clogged. In this way, the electronic device adjusts the audio content played by the corresponding speaker channel b.

As shown in FIG14 , when a speaker in a group of speaker channels on the lower side of the right edge is blocked or clogged, that is, when a group of speaker channels configured on the lower side of the right edge is speaker channel a, the group of speaker channels on the lower side of the right edge pause playing audio. In addition, a group of speaker channels configured on the upper side of the right edge, that is, speaker channel b, plays the adjusted regular sound effects and/or specific sound effect 2. That is, speaker channel b, which originally does not need to play specific sound effect 2, needs to play specific sound effect 2 in addition to regular sound effects when the speaker channel on the lower side of the right edge is blocked. In this way, the electronic device adjusts the audio content played by the corresponding speaker channel b.

In a third manner, when the audio played by the group of speaker channels a includes a specific sound effect, the electronic device can adjust not only the audio played by speaker channel a, but also the audio played by a speaker channel (such as speaker channel b) on the same side as speaker channel a and not blocked. If there is no speaker channel on the same side as speaker channel a and not blocked, the audio played by any unblocked speaker channel can also be adjusted.

Take the electronic device as a tablet computer as shown in FIG9 as an example. As shown in FIG15, when no speaker channel is blocked or blocked, a group of speaker channels configured on the upper side of the left edge of the tablet computer is used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the lower side of the left edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 1. A group of speaker channels configured on the upper side of the right edge of the tablet computer is used to play regular sound effects and/or specific sound effect 2. A group of speaker channels configured on the lower side of the right edge of the tablet computer is also used to play regular sound effects and/or specific sound effect 2.

As shown in FIG15 , when a group of speaker channels on the lower side of the left edge are blocked or clogged, that is, when the group of speaker channels configured on the lower side of the left edge is speaker channel a, the group of speaker channels on the lower side of the left edge no longer play the specific sound effect 1, but the speaker channel can continue to play the regular sound effect. In addition, the group of speaker channels configured on the upper side of the left edge, that is, the corresponding speaker channel b, plays the adjusted regular sound effect and/or the specific sound effect 1.

For example, when only regular audio is played, no processing is performed; when only specific sound effect 1 is played, the sound wave phase and vibration amplitude corresponding to specific sound effect 1 are adjusted and played; when specific sound effect 1 and regular audio need to be played at the same time, the regular audio and specific sound effect 1 are mixed, and the sound wave phase and vibration amplitude corresponding to the mixing are adjusted and played. In this way, the electronic device adjusts the audio to be played by speaker channel a and the corresponding speaker channel b.

As shown in FIG15 , when a group of speaker channels on the lower side of the right edge is blocked or clogged, that is, when the group of speaker channels configured on the lower side of the right edge is speaker channel a, the group of speaker channels on the lower side of the right edge no longer plays the specific sound effect 2, but the speaker channel can continue to play the regular sound effect. In addition, the group of speaker channels configured on the upper side of the right edge, that is, speaker channel b, plays the adjusted regular sound effect and/or specific sound effect 2.

For example, when only regular audio is played, no processing is performed; when only specific sound effect 2 is played, the sound wave phase and vibration amplitude corresponding to specific sound effect 2 are adjusted and played; when specific sound effect 2 and regular audio need to be played at the same time, the regular audio and specific sound effect 2 are mixed, and the sound wave phase and vibration amplitude corresponding to the mixing are adjusted and played. In this way, the electronic device adjusts the audio to be played by speaker channel a and the corresponding speaker channel b.

Take the electronic device as a tablet computer shown in FIG10 as an example. As shown in FIG16, when no speaker channel is blocked or blocked, a group of speaker channels configured on the upper side of the left edge of the tablet computer is used to play regular sound effects. A group of speaker channels configured on the lower side of the left edge of the tablet computer is used to play specific sound effect 1. A group of speaker channels configured on the upper side of the right edge of the tablet computer is used to play regular sound effects. A group of speaker channels configured on the lower side of the right edge of the tablet computer is also used to play specific sound effect 2.

As shown in FIG16 , when a group of speaker channels on the lower side of the left edge are blocked or clogged, that is, when a group of speaker channels configured on the lower side of the left edge is speaker channel a, the electronic device can control a group of speaker channels on the lower side of the left edge to play only regular sound effects, and control a group of speaker channels on the upper side of the left edge to play only specific sound effect 1. That is, speaker channel b, which originally does not need to play specific sound effect 1, will no longer play regular sound effects, but will play specific sound effect 1 when the speaker channel on the lower side of the left edge is blocked or clogged. This ensures that more important specific sound effects are not affected by speaker blocking.

As shown in FIG16 , when a group of speaker channels on the lower side of the right edge is blocked or clogged, that is, when a group of speaker channels configured on the lower side of the right edge is speaker channel a, the electronic device can control a group of speaker channels on the lower side of the right edge to play only regular sound effects, and control a group of speaker channels on the upper side of the right edge to play only specific sound effect 2. That is, speaker channel b, which originally plays regular sound effects, no longer plays regular sound effects, but plays specific sound effect 2 when the speaker channel on the lower side of the right edge is blocked or clogged. This ensures that the more important specific sound effects are not affected by speaker blocking.

In other possible embodiments, different processing methods may be used for different specific scenarios.

For example, when the audio played by a group of speaker channels a does not include a specific sound effect, the electronic device may not adjust the audio played by each speaker channel.

For another example, if the speaker channels on one edge of the electronic device are blocked or clogged, all audio data can be played by the speaker channels on the other edge. In other words, the impact of the speaker channel blockage can be compensated by adjusting the audio to be played by the blocked or clogged speaker channel.

For another example, if the channel corresponding to the low-frequency speaker in a group of speaker channels a is blocked, but the high-frequency speaker is not blocked, when the high-frequency part of the audio needs to be played by speaker channel a, it is regarded as speaker channel a is not blocked, that is, the audio can be played normally without additional processing. When the low-frequency part of the audio needs to be played by speaker channel a, it is regarded as speaker channel a is blocked, and the audio to be played by one or more groups of speaker channels can be adjusted in the above manner.

In some embodiments, the electronic device may also adjust the audio played by one or more speaker channels according to the degree of obstruction (or blockage) of the speaker channels. The degree of obstruction (or blockage) may be a ratio quantified by the electronic device according to the impedance value of the speaker.

For example, the electronic device can obtain the impedance value a corresponding to each speaker when it is not blocked, and the impedance value b when it is completely blocked, and then correspond the impedance value a to 0% and the impedance value b to 100%. Finally, the impedance value between the impedance value a and the impedance value b can be quantified as a ratio between 0% and 100%.

In this way, the electronic device can determine the degree of shielding (or blocking) of the corresponding speaker channel according to the real-time impedance value of each speaker.

After determining the degree of occlusion (or blockage) corresponding to each speaker channel, the electronic device may determine whether the degree of occlusion (or blockage) exceeds a preset threshold value, wherein the preset threshold value may be a system default value or a user-configured value, for example, the preset threshold value may be 50%.

When the preset threshold is exceeded, the second method in the above embodiment is adopted to adjust the audio played by one or more speaker channels. When the preset threshold is not exceeded and is not 0, the first method or the third method in the above embodiment is adopted to adjust the audio played by one or more speaker channels.

Take the electronic device as the tablet computer shown in FIG9 as an example. As shown in FIG17 , when a group of speaker channels at the lower side of the left edge are blocked (or blocked) and the degree of blockage (or blockage) does not exceed the preset threshold, the group of speaker channels at the lower side of the left edge plays the adjusted regular sound effect and/or specific sound effect 1.

As shown in FIG17 , when the degree of occlusion (or blockage) of a group of speaker channels on the lower side of the right edge exceeds a preset threshold, a group of speaker channels on the upper side of the right edge can be controlled to pause playing audio. At the same time, a group of speaker channels on the upper side of the right edge can be controlled to play the adjusted regular sound effects and/or specific sound effects 2.

Take the electronic device as a tablet computer as shown in FIG10 as an example. As shown in FIG18 , when a group of speaker channels at the lower side of the left edge are blocked (or blocked) and the degree of blockage (or blockage) does not exceed the preset threshold, a group of speaker channels at the lower side of the left edge plays regular sound effects, and a group of speaker channels at the upper side of the left edge plays specific sound effects 1.

As shown in Figure 18, when the degree of occlusion (or blockage) of a group of speaker channels on the lower side of the right edge exceeds a preset threshold, a group of speaker channels on the upper side of the right edge play the adjusted regular sound effects and/or specific sound effects 2, and a group of speaker channels on the lower side of the right edge pause playing audio.

In summary, in some embodiments, as shown in FIG19 , the above speaker control method may include the following steps:

S101, determining audio data to be played, where the audio data includes a first audio and a second audio.

In some embodiments, the electronic device may determine the audio data to be played according to the detected specific service requirements. In order to facilitate the introduction of the above method, an example is given herein where the audio data to be played includes the first audio and the second audio.

In addition, the first audio and the second audio may be different audios. For example, the first audio may be the specific sound effect 1 in the aforementioned embodiment, and the second audio may be the regular sound effect in the aforementioned embodiment. For another example, the first audio may be the regular sound effect in the aforementioned embodiment, and the second audio may be the specific sound effect 1 in the aforementioned embodiment. For another example, the first audio may be the regular sound effect and the specific sound effect 1 in the aforementioned embodiment, and the second audio may be the regular sound effect and the specific sound effect 2 in the aforementioned embodiment.

S102, controlling the first speaker to play the first audio, and controlling the second speaker to play the second audio.

In some embodiments, the first speaker and the second speaker may be examples of two speakers disposed on the same side of the electronic device. For example, the first speaker and the second speaker are both disposed on the same side edge of the electronic device, that is, the corresponding sound outlets face the same direction.

In some embodiments, after determining the audio data to be played, it is also necessary to determine the part that each speaker needs to play. The method of determining the audio to be played by each speaker can refer to the description in the above embodiments, for example, according to the correspondence between the sound effect type and the speaker channel, the sound effect to be played by each speaker is determined. Here, the first speaker plays the first audio and the second speaker plays the second audio for example.

S103: When the sound outlet of the first speaker is blocked, adjust the audio played by the first speaker and/or the second speaker.

Exemplarily, when the sound outlet of the first speaker is blocked, the first speaker can be controlled to play the adjusted first audio. The first audio can be adjusted by changing the sound wave phase and audio energy of the first audio when modulating the first audio to be played by the first speaker, thereby also changing the phase and vibration amplitude of the sound wave signal actually broadcast by the first speaker.

In some embodiments, under condition 1, the first speaker is controlled to play the adjusted first audio. The condition 1 may include any one of the following:

(1) Obtain a first occlusion ratio corresponding to a sound outlet of a first speaker (that is, an occlusion degree of the first speaker), and determine that the first occlusion ratio is less than a first threshold (preset threshold).

(2) Determine that the preset priority of the second audio is higher than that of the first audio. For example, the second audio is a specific audio and the first audio is a regular audio.

Exemplarily, when the sound outlet of the first speaker is blocked, the second speaker is controlled to play the first audio.

In some examples, before controlling the second speaker to play the first audio, controlling the first speaker may stop playing the first audio or may not stop playing the first audio, which is not limited in the embodiments of the present application.

In other embodiments, when the preset priority of the first audio is higher than that of the second audio, for example, when the first audio is a specific audio and the second audio is a regular audio, the second speaker can be controlled to stop playing the second audio while the second speaker is controlled to play the first audio, and the first speaker can be controlled to play the second audio. By exchanging the speakers used for the first audio and the second audio, it is ensured that the first audio with a higher priority can be better broadcasted.

In some embodiments, under condition 2, the electronic device selects a method of controlling the second speaker to play the first audio control to ensure the audio output quality. Wherein, condition 2 includes: obtaining a first occlusion ratio corresponding to the sound outlet of the first speaker; and determining that the first occlusion ratio is not less than a first threshold.

In other embodiments, when the second speaker is controlled to play the first audio, the second speaker continues to play the second audio, similar to that shown in FIG. 14 .

In other embodiments, the electronic device may further include a third speaker and a fourth speaker, wherein the third speaker and the fourth speaker may also be arranged on the same side edge of the electronic device, that is, the sound outlets of the two speakers may also face the same direction.

When the third speaker and the fourth speaker are both playing the third audio, if it is detected that the sound outlet of the third speaker is blocked, the third speaker can be controlled to stop playing the third audio, and the fourth speaker can be controlled to play the fourth audio, which is the third audio after the sound wave phase and vibration amplitude are adjusted.

In other embodiments, when the third speaker and the fourth speaker both play the fifth audio and the sixth audio, it is detected that the sound outlet of the third speaker is blocked; when the fifth audio is the first type of audio, that is, belongs to a specific sound effect, and the sixth audio is not the first type of audio, the third speaker is controlled to only play the sixth audio; the fourth speaker is controlled to play the seventh audio and the sixth audio, and the seventh audio is the fifth audio after the sound wave phase and vibration amplitude are adjusted, similar to that shown in Figure 15.

In addition, the electronic device includes a first set, the first set includes multiple audio type identifiers, and the audio matching the audio type identifier in the first set is the first type of audio.

The following introduces the implementation effect of the speaker control method provided in the embodiment of the present application in combination with several common application scenarios, such as a scenario in which a user uses an electronic device to play games and a scenario in which a user uses an electronic device to watch videos.

For the convenience of description, taking an electronic device including a speaker channel 1 and a speaker channel 2 as an example, the speaker sound holes corresponding to the speaker channel 1 and the speaker channel 2 can be arranged on the same side of the electronic device housing.

In the scenario where a user uses an electronic device to play a shooting game, the game audio data corresponding to the shooting game includes background sound, gunshot sound effects, footstep sound effects, and game character sound effects. In some examples, in the configuration file corresponding to the shooting game, when gunshot sound effects and footstep sound effects are specified as specific sound effects, the electronic device can determine that the gunshot sound effects and footstep sound effects are specific sound effects, while the background sound and game character sound effects are regular sound effects. In other examples, in the system configuration file in the electronic device, when gunshot sound effects and footstep sound effects are specified as specific sound effects, the electronic device can also determine that the gunshot sound effects and footstep sound effects are specific sound effects, while the background sound and game character sound effects are regular sound effects.

For example, when the electronic device runs a shooting game, speaker channel 1 and speaker channel 2 are both used to play background sound, gunshot sound effects, footstep sound effects, and game character sound effects. That is, if the audio data that needs to be played in real time contains background sound, then speaker channel 1 and speaker channel 2 both play the background sound. If the audio data that needs to be played in real time contains background sound and footstep sound effects, speaker channel 1 and speaker channel 2 both play the mixed background sound and footstep sound effects, and so on.

When the electronic device detects that speaker channel 1 is blocked, the phase and audio intensity of the audio to be played by speaker channel 1 (such as background sound, gunshot sound effects, footsteps sound effects, and game character sound effects) can be adjusted.

Alternatively, when the electronic device detects that speaker channel 1 is blocked, it controls speaker channel 1 to stop playing audio and adjusts the phase and intensity of the audio that must be played by speaker channel 2 (such as background sound, gunshot sound effects, footsteps sound effects, and game character sound effects).

As another example, when the electronic device runs a shooting game, speaker channel 1 is used to play gunshot sound effects and footstep sound effects, and speaker channel 2 is used for background sounds and game character sound effects.

When the electronic device detects that speaker channel 1 is blocked, speaker channel 1 is controlled to play background sound and game character sound effects. Speaker channel 2 is controlled to play gunshot sound effects and footstep sound effects. In other words, the audio to be played by speaker channel 1 and speaker channel 2 are swapped.

In this way, even if some speakers are blocked, users can still clearly hear the footsteps and gunshots in the game, and can also accurately determine the sound source locations of the footsteps and gunshots in the game world.

In addition, in the scenario where the user uses an electronic device to watch a video, the audio data corresponding to the video includes background sound and speech sound effects. In some examples, in the configuration file corresponding to the video application, when the speech sound effect is specified as a specific sound effect, the electronic device can determine that the speech sound effect is a specific sound effect, and the background sound is a regular sound effect. In other examples, in the system configuration file in the electronic device, when the speech sound effect is specified as a specific sound effect, the electronic device can also determine that the speech sound effect is a specific sound effect, and the background sound is a regular sound effect.

In addition, when the electronic device plays a video, speaker channel 1 is used to play the dialogue sound effects, and speaker channel 2 is used to play the background sound.

When the electronic device detects that the speaker of speaker channel 1 is blocked, the phase and intensity of the audio (ie, the dialogue sound effect) to be played by speaker channel 1 can be adjusted.

Alternatively, when the electronic device detects that the speaker of speaker channel 1 is blocked, speaker channel 1 is controlled to stop playing audio, and speaker channel 2 is controlled to play background sound and dialogue sound effects.

Alternatively, when the electronic device detects that the speaker of speaker channel 1 is blocked, speaker channel 1 is controlled to play background sound, and speaker channel 2 is controlled to play dialogue sound effects.

In this way, even if some speakers are blocked, users can still clearly hear the actors' lines and dialogues in the video, without affecting the user's viewing experience.

The embodiment of the present application also provides an electronic device, which may include: a memory and one or more processors. The memory and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device can perform each step in the above embodiment. Of course, the electronic device includes but is not limited to the above memory and one or more processors.

The embodiment of the present application also provides a chip system, which can be applied to the terminal device in the aforementioned embodiment. As shown in Figure 20, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 can be the processor in the above-mentioned electronic device. The processor 2201 and the interface circuit 2202 can be interconnected by lines. The processor 2201 can receive and execute computer instructions from the memory of the above-mentioned electronic device through the interface circuit 2202. When the computer instructions are executed by the processor 2201, the electronic device can execute the various steps in the above-mentioned embodiment. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.

In some embodiments, through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims (16)

1. A speaker control method, characterized by being applied to an electronic device including a first speaker and a second speaker, the method comprising:

Under the condition that the first audio and the second audio are determined to be played, controlling the first loudspeaker to play the first audio, and controlling the second loudspeaker to play the second audio;

controlling the first loudspeaker to play the adjusted first audio under the condition that the sound outlet of the first loudspeaker is blocked;

Or controlling the second speaker to play the first audio.

2. The method of claim 1, wherein prior to controlling the first speaker to play the adjusted first audio, the method comprises:

and adjusting the sound wave phase and the vibration amplitude corresponding to the first audio frequency.

3. The method of claim 2, wherein prior to adjusting the acoustic wave phase and vibration amplitude corresponding to the first audio, the method further comprises:

determining a first shielding duty ratio corresponding to a sound outlet of the first loudspeaker;

determining that the first occlusion duty cycle is less than a first threshold.

4. The method of claim 2, wherein prior to adjusting the acoustic wave phase and vibration amplitude corresponding to the first audio, the method further comprises:

And determining that the preset priority of the second audio is higher than that of the first audio.

5. The method of claim 1, wherein prior to controlling the second speaker to play the first audio, the method comprises:

and controlling the first loudspeaker to stop playing the first audio.

6. The method of claim 5, wherein in the case of controlling the second speaker to play the first audio, the method further comprises:

Controlling the second loudspeaker to stop playing the second audio;

And controlling the first loudspeaker to play the second audio.

7. The method of claim 5, wherein prior to controlling the first speaker to stop playing the first audio, the method further comprises:

determining a first shielding duty ratio corresponding to a sound outlet of the first loudspeaker;

determining that the first occlusion duty cycle is not less than a first threshold.

8. The method of claim 1, wherein the second speaker continues to play the second audio with the second speaker controlled to play the first audio.

9. The method of any of claims 1-8, wherein the sound outlets of the first speaker and the second speaker are oriented the same.

10. The method of claim 1, wherein the electronic device comprises a third speaker and a fourth speaker, the method comprising:

Detecting that a sound outlet of the third speaker is blocked under the condition that the third speaker and the fourth speaker play third audio;

Controlling the third loudspeaker to stop playing the third audio;

and controlling the fourth loudspeaker to play fourth audio, wherein the fourth audio is the third audio subjected to sound wave phase and vibration amplitude adjustment.

11. The method of claim 10, wherein the sound outlets of the third and fourth speakers are oriented the same.

12. The method of claim 1, wherein the electronic device comprises a third speaker and a fourth speaker, the method comprising:

Detecting that a sound outlet of the third loudspeaker is blocked under the condition that the third loudspeaker and the fourth loudspeaker play a fifth audio and a sixth audio;

Controlling the third speaker to play only the sixth audio if the fifth audio is audio labeled as the first type and the sixth audio is not audio of the first type;

and controlling the fourth loudspeaker to play a seventh audio and the sixth audio, wherein the seventh audio is the fifth audio subjected to sound wave phase and vibration amplitude adjustment.

13. The method of claim 12, wherein the electronic device comprises a first set comprising a plurality of audio type identifiers, and wherein the audio matching the audio type identifiers in the first set is the first type of audio.

14. An electronic device comprising one or more processors and memory; the memory being coupled to a processor, the memory being for storing computer program code comprising computer instructions which, when executed by one or more processors, are for performing the method of any of claims 1-13.

15. A computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-13.

16. A computer program product, characterized in that the computer program product comprises a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-13.