CN113676590B

CN113676590B - Recording method, recording device, electronic equipment and storage medium

Info

Publication number: CN113676590B
Application number: CN202110898487.XA
Authority: CN
Inventors: 郭华
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-08-05
Filing date: 2021-08-05
Publication date: 2023-02-17
Anticipated expiration: 2041-08-05
Also published as: CN113676590A

Abstract

The application discloses a recording method, a recording device, electronic equipment and a storage medium, which are applied to the electronic equipment. The recording method comprises the following steps: determining azimuth information between a wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment; and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information. The method can reduce the influence of wireless charging on the recording quality.

Description

Recording method, recording device, electronic equipment and storage medium

Technical Field

The present application relates to the field of audio processing technologies, and in particular, to a recording method and apparatus, an electronic device, and a storage medium.

Background

In order to meet the recording requirements of users in life and work, most electronic devices have a recording function, such as mobile phones, tablet computers, music players, professional recording pens, and the like. However, the recording effect of the related recording technology still needs to be improved.

Disclosure of Invention

In view of the above problems, the present application provides a recording method, an apparatus, an electronic device and a storage medium, which can improve the above problems.

In a first aspect, an embodiment of the present application provides a recording method, which is applied to an electronic device, and the method includes: determining azimuth information between a wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment; and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

In a second aspect, an embodiment of the present application provides a sound recording apparatus, which is applied to an electronic device, and includes: the positioning module is used for determining azimuth information between a wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment; and the optimization module is used for executing recording optimization operation on the recorded recording signals based on the direction information, and the recording optimization operation is used for suppressing the sound signals of the direction information.

In a third aspect, an embodiment of the present application provides an electronic device, including: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to perform the sound recording method provided by the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the recording method provided in the first aspect.

According to the scheme provided by the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs the recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the recording optimization operation can be performed on the recorded recording signals by determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation, and the recording optimization operation is used for suppressing the sound signals of the azimuth information. Thereby reduce the wireless interference of charging to recording the quality, promote the recording effect when wireless charging.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 shows a scene schematic diagram provided in an embodiment of the present application.

Fig. 2 shows another scenario diagram provided in the embodiment of the present application.

FIG. 3 shows a flowchart of a recording method according to an embodiment of the present application.

Fig. 4 shows a natural coordinate system diagram provided in an embodiment of the present application.

Fig. 5 shows a flowchart of a recording method according to another embodiment of the present application.

Fig. 6 shows a schematic arrangement diagram of microphones in a sound recording method provided in an embodiment of the present application.

Fig. 7 is a flowchart illustrating step S220 of the recording method according to another embodiment of the present application.

FIG. 8 is a schematic diagram illustrating sound modeling in a sound recording method according to an embodiment of the application.

FIG. 9 is a flow chart of a recording method according to another embodiment of the present application.

Fig. 10 shows a flowchart of a recording method according to yet another embodiment of the present application.

Fig. 11 shows a schematic view of another scenario provided in the embodiment of the present application.

Fig. 12 shows a flowchart of a recording method according to a further embodiment of the present application.

Fig. 13 is a flowchart of step S220 in the sound recording method according to another embodiment of the present application.

FIG. 14 is a schematic block diagram illustrating an overall flow of a recording method according to the present application.

FIG. 15 shows a block diagram of a sound recording apparatus according to an embodiment of the present application.

Fig. 16 is a block diagram of an electronic device according to an embodiment of the present application for executing a recording method according to an embodiment of the present application.

Fig. 17 is a storage unit according to an embodiment of the present application, configured to store or carry program code for implementing a recording method according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

At present, in order to meet the recording requirements of users in life and work, most electronic devices have a recording function, such as mobile phones, tablet computers, music players, professional recording pens, and the like. However, the inventors found in their research that the recording effect of the related recording technology still needs to be improved. For example, when electronic equipment carries out wireless charging, start the recording function, can record the noise of wireless charging base all the time, recording quality is lower, and user experience is not good.

As more electronic devices with wireless charging functions are added, more wireless charging devices are also available. The inventor finds in research that these Wireless charging devices and electronic devices usually communicate through Qi protocol (Wireless charging standard proposed by Wireless Power Consortium (WPC)), and the Qi protocol has stable 2k noise and its harmonics, and is completely exposed when the electronic devices record sound, and records in the sound recording signal, thereby causing noise interference.

Wireless charging according to the Qi protocol specification generally uses two communication modes: one is called ASK (Amplitude Shift Keying), amplitude modulation communication; one is called FSK (Frequency Shift Keying), frequency modulated communication. The inventor finds in research that amplitude modulation propagates signals through changes in voltage and current, which naturally causes changes in the electric field across the capacitor, and is a major cause of noise. This communication mechanism is mainly applied to the reception RX to transmit TX signal generation.

Specifically, since the nature of the communicated information is to make the signal change, for example, A and B engage in a hand, B knows A is calling him when seeing that A's hand is changing. Therefore, when the receiving end transmits information, a group of capacitors are connected to or from two sides of the receiving end LC Tank (inductance-capacitance oscillating circuit). The connection or disconnection of the capacitor can cause the equivalent impedance of the transmitting end LC Tank to change. The change of the equivalent impedance can cause the change of the average current in the transmitting end LC Tank and the change of the voltage at the connection part of the capacitor and the inductor. This varying signal is collected and demodulated and passed to a MCU (Microcontroller Unit). The whole change rule is written in the WPC protocol, and the MCU utilizes the WPC protocol to know what information the receiving end tells the transmitting end at all.

It will be appreciated that the input at the transmitting end will often be connected to an input ceramic capacitor, and that variations in the average current in the LC Tank will often cause variations in the voltage across the capacitor. The variation of the voltage across the capacitor causes the vibration of the ceramic capacitor and the generation of noise. If the communication capacitance of the receiving end is larger, the change of the transmitting end is larger, the demodulation is easier, but the vibration of the ceramic capacitance is larger, the noise is larger, and the mutual balance among different parameters is realized. The WPC specifies a communication frequency of 2kHz. The voltage variation it causes across the input capacitance is thus 2KHz dominant frequency, which is well within the audio frequency range to which the human ear is most sensitive. That is to say, the main interference frequency points of the QI protocol are the data clock frequency 2k and the harmonic signals thereof, which leads to the recording of the electronic device during wireless charging and can clearly record the noise.

Because the wireless charging protocols on the market are all QI protocols, or are simply modified on the QI protocols, the noise existing when the electronic equipment performs recording during wireless charging cannot be avoided. When the microphone on the electronic device receives sound in an omnidirectional manner, the noise is easily recorded by the microphone on the electronic device during wireless charging, and is played back through a loudspeaker or an earphone, so that poor experience is caused.

Therefore, the inventor proposes a recording method and an electronic device in the present application, which determine orientation information between a wireless charging device and the electronic device when the electronic device performs a recording operation, so as to perform suppression processing on a sound signal of the orientation information based on the orientation information. Thereby reduce the wireless noise of charging to the interference of recording the quality, promote the recording effect when wireless charging.

The following first introduces a scenario related to an embodiment of the present application.

Fig. 1 is a schematic view of a scenario provided by an embodiment of the application, as shown in fig. 1, the scenario shown in fig. 1 includes an electronic device 100 and a wireless charging apparatus 200, and when the electronic device 100 is placed on the wireless charging apparatus 200, the wireless charging apparatus 200 can wirelessly charge the electronic device 100.

The electronic device 100 may include, but is not limited to, a mobile phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a smart watch, etc. and an electronic device having a wireless charging function and a recording function, and the wireless charging device 200 may be a wireless charging base, and the wireless charging device may perform wireless charging in an electromagnetic induction type, a magnetic resonance type, a radio wave type, or an electric field coupling type, etc., which is not limited in the embodiments of the present application.

Specifically, the principle of implementing wireless charging is roughly as follows: the wireless charging device 200 is provided with a transmitting coil, and the electronic apparatus 100 is provided with a receiving coil. Since the electronic device 100 and the wireless charging device 200 are respectively provided with a built-in coil, when the two are close to each other, the transmitting coil generates a certain current in the receiving coil of the mobile terminal through electromagnetic induction based on alternating current with a certain frequency, so that electric energy is transferred from the transmitting end to the receiving end. And because the wireless charging device and the electronic equipment transmit energy through a magnetic field, the wireless charging device and the electronic equipment are not connected through wires.

In some embodiments, the wireless charging device 200 may be circular, rectangular, trapezoidal, etc., without limitation. In some embodiments, the wireless charging apparatus 200 may be in a lying configuration, such as the wireless charging apparatus 200 shown in fig. 1 is in a circular lying configuration, and the electronic device 100 may be placed on the wireless charging apparatus 200 in a lying configuration. In other embodiments, the wireless charging device 200 may also be in a vertical configuration. Referring to fig. 2, fig. 2 is a schematic view illustrating another scenario provided by the embodiment of the present application, wherein the wireless charging device 200 shown in fig. 2 is in a circular vertical type, and the electronic device 100 can be obliquely vertical on the wireless charging device 200.

Referring to fig. 3, fig. 3 is a flowchart illustrating a recording method according to an embodiment of the present application. In a specific embodiment, the recording method can be applied to the recording apparatus 700 shown in fig. 15 and an electronic device (fig. 16) equipped with the recording apparatus 700. As will be described in detail with respect to the flow shown in fig. 3, the recording method may specifically include the following steps:

step S110: determining orientation information between a wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation.

The wireless charging mode can be understood as a mode in which the electronic device is wirelessly charged by a wireless charging device in wireless communication connection with the electronic device. If recording is carried out during wireless charging, the noise generated by the wireless charging device due to communication is recorded, so that the recording quality is not high. Therefore, in the embodiment of the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs the recording operation, the noise of the wireless charging device can be suppressed. Specifically, the position information between the wireless charging device and the electronic device may be determined when the electronic device performs the recording operation, where the electronic device is in the wireless charging mode when the electronic device performs the recording operation. In some embodiments, the orientation information may include angle information of the wireless charging apparatus with respect to the electronic device, and may also include distance information of the wireless charging apparatus with respect to the electronic device, which is not limited herein.

In an embodiment of the application, the electronic device may comprise a microphone for capturing audio signals of the surrounding environment. In some embodiments, the microphone may be a microphone for directionally picking up sound, may also be a microphone for non-directionally picking up sound, and may also be a microphone for omni-directionally picking up sound, which is not limited herein. In some embodiments, when the number of the microphones is multiple, the multiple microphones may be distributed on the same plane of the apparatus body, or may be distributed in the apparatus body in a three-dimensional manner, which is not limited herein.

In some embodiments, when the electronic device performs the recording operation, the microphone may be activated, so that the audio signal of the surrounding environment may be collected during the recording process, thereby implementing the recording function. In other embodiments, when the electronic device performs the recording operation, both the microphone and the camera may be activated, so that the audio signal of the surrounding environment and the image of the surrounding environment may be collected during the recording process, thereby implementing the recording function and the video recording function. The camera is used for acquiring images of the surrounding environment, and may be a fixed camera, a movable camera, or a rotatable camera, which is not limited herein.

In some embodiments, when the electronic device performs a recording operation, it may be determined in real time whether the electronic device is currently in a wireless charging mode, so as to determine whether to perform noise suppression according to a determination result. Specifically, if the electronic device is in the wireless charging mode, the electronic device needs to perform noise suppression on the wireless charging apparatus.

As one approach, the electronic device may be provided with a recording preparation function, which may be understood as a preparation work that the electronic device needs to do before formal recording. Specifically, if the electronic device determines that the electronic device is currently in the wireless charging mode when the recording operation is started, the recording preparation function may be triggered, and at this time, the electronic device may determine the orientation information between the wireless charging device and the electronic device. Optionally, the display of the recording preparation function on the user interface may be presented as a countdown of the start of recording, that is, the countdown period is the recording preparation time. As another mode, after the recording operation of the electronic device is finished, the direction information between the wireless charging device and the electronic device when the recording operation of the electronic device is performed may be determined. And is not limited herein.

It is understood that when the electronic device is not in the wireless charging mode, the electronic device may not need to perform noise suppression on the wireless charging apparatus because there is no noise of the wireless charging apparatus.

In some embodiments, the position information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation may be determined according to the recording signal recorded by the electronic equipment. It will be appreciated that the audio characteristics of the noise generated by the wireless charging device may vary depending on the spatial location of the wireless charging device relative to the microphone on the electronic device. For example, the loudness of the noise generated by the wireless charging device gradually decreases with increasing distance and gradually increases with increasing distance, so in some embodiments, after the mobile terminal acquires the recording signal, the mobile terminal may determine the orientation information between the wireless charging device and the electronic device according to the audio features of the recording signal.

As one mode, when the electronic device triggers the recording preparation function, a microphone may be activated to perform prerecording, so that the orientation information between the wireless charging device and the electronic device may be determined according to a prerecorded recording signal. As another mode, after the recording operation of the electronic device is finished, the azimuth information between the wireless charging device and the electronic device when the electronic device performs the recording operation may be determined according to the recorded recording signal.

In some embodiments, when the electronic device includes two microphones, the orientation information of the wireless charging apparatus may be determined using the binaural effect. The binaural effect is a spatial localization technique, for example, for a human, the human ears are symmetrically distributed on two sides of the head, and the auricle and the head of the human play an effective role in masking the sound. When the time and frequency intensity distribution of sound of a sound source sent to ears are different, the time difference and the intensity difference are obvious when the same sound source is sent to two ears, and the phenomenon results in that the position of the sound source, namely the 'binaural effect', can be clearly and accurately judged.

In some embodiments, when the electronic device includes three microphones or a microphone array consisting of more than three microphones, the orientation information of the wireless charging apparatus relative to the electronic device may be located using sound space location technology. Alternatively, the orientation information of the wireless charging device relative to the electronic device may be located according to the phase difference and amplitude difference of the noise generated by the wireless charging device at the plurality of microphones. The specific mode is not limited in the embodiments of the present application.

Step S120: and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

In the embodiment of the application, after the azimuth information between the wireless charging device and the electronic equipment is determined when the electronic equipment performs the recording operation, the recording optimization operation can be performed on the recorded recording signal based on the azimuth information. Wherein the recording optimization operation is used for suppressing the sound signal of the direction information. Thereby reducing interference of wireless charging on recording quality.

In some embodiments, the recording optimization operation is performed on the recorded recording signals based on the orientation information, and the electronic device may control the microphone to directionally collect sound signals of other orientations than the orientation information during the recording process. As a manner, if the electronic device determines that the electronic device is currently in the wireless charging mode when the electronic device starts to perform the recording operation, the azimuth information between the wireless charging device and the electronic device may be determined first, so that the recording angle of the microphone may be adjusted according to the azimuth information, and therefore, in the subsequent formal recording process, the sound signal of the azimuth information where the non-wireless charging device is located may be directionally collected, and a recording signal with better recording quality may be obtained.

For example, when the wireless charging apparatus is a lying-down wireless charging cradle, it may be determined that the wireless charging cradle is under the electronic device, so that the sound information under the wireless charging cradle may be suppressed. Referring to fig. 4, fig. 4 is a schematic diagram of a natural coordinate system, which can determine the-z-axis direction of the wireless charging base in the electronic device, so as to suppress the sound in the-z-axis direction.

In some embodiments, based on the orientation information, a recording optimization operation is performed on the recorded recording signal, or after the recording is finished, the electronic device performs audio processing on the recorded recording signal, so as to perform suppression processing on a sound signal of the orientation information where the wireless charging device is located in the recording signal.

According to the recording method provided by the embodiment of the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs the recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the recording optimization operation can be performed on the recorded recording signal by determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation, and the recording optimization operation is used for suppressing the sound signal of the azimuth information. Thereby reduce the wireless interference of charging to recording the quality, promote the recording effect when wireless charging.

Referring to fig. 5, fig. 5 is a schematic flow chart illustrating a recording method according to another embodiment of the present application. As will be described in detail with respect to the flow shown in fig. 5, the recording method may specifically include the following steps:

step S210: the method comprises the steps of determining the frequency spectrum characteristics of a noise sound source generated by the wireless charging device in a recording signal based on the recording signal acquired by a microphone, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation.

It can be understood that, because the main interference frequency point of the QI protocol is the data clock frequency 2kHz and the harmonic signal thereof, the main interference frequency point can be used as the identifier of the noise sound source to analyze the recording signal collected by the microphone, so that the positioning of the wireless charging device can be realized.

In this embodiment, the electronic device may determine, based on the recording signal acquired by the microphone, a spectral characteristic of a noise sound source generated by the wireless charging device in the recording signal. Specifically, the electronic device may analyze the 2khz and its harmonic components in the recorded signal to determine the spectral signature of the noise source generated by the wireless charging device in the recorded signal.

In some embodiments, the electronic device may include at least three microphones, which may be distributed in a non-same plane of the electronic device, i.e., in a stereo distribution, such as multiple microphones at the top, bottom, and back of the electronic device. Fig. 6 is a schematic layout view of microphones in an electronic device according to an embodiment of the present disclosure, and as shown in fig. 6, three microphones, denoted as a, b, and c, are arranged on the electronic device in a three-dimensional distribution. Therefore, the spectral characteristics of the noise source generated by the wireless charging device in the recording signals of each microphone can also be determined based on the recording signals acquired by the at least three microphones.

Step S220: and determining orientation information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation based on the frequency spectrum characteristics.

In the embodiment of the application, after the spectrum feature of the noise sound source generated by the wireless charging device in the recording signal is obtained, the direction information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation can be determined based on the spectrum feature.

In some embodiments, a one-to-one correspondence relationship table between the orientation information and the frequency spectrum characteristics may be stored in advance, so that after the frequency spectrum characteristics of the noise sound source generated by the wireless charging device in the recording signal are obtained, the orientation information between the wireless charging device and the electronic device when the electronic device performs the recording operation may be determined based on the frequency spectrum characteristics and the relationship table.

In some embodiments, the electronic device may include at least three microphones, such that the multi-microphone system may be used to locate the orientation of the noise source by taking advantage of the spatial localization capabilities of the sound. Specifically, referring to fig. 7, step S220 may include:

step S221: determining a difference in amplitude and/or a difference in phase of the spectral feature of the noise source for each two of the at least three microphones.

Step S222: and determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation according to the difference of the amplitude and/or the difference of the phase.

In some embodiments, the spatial position information of the sound may be acquired by establishing a sound space model in advance so as to obtain the spatial position information of the sound according to the sound space model. Specifically, a fixed sound source for testing may be placed in one direction relative to the electronic device in a recording test environment, and no sound source is located in other directions, and recording signals of the fixed sound source are obtained through at least three microphones on the electronic device, and then fourier transform is performed on the recording signal corresponding to each of the at least three microphones, so as to obtain corresponding spectrum data. Similarly, a fixed sound source for testing is also placed in another direction with respect to the electronic device, and no sound source is placed in the other direction, and then spectral data of the sound recording signal corresponding to each of the at least three microphones is acquired. Repeating the above process, placing a fixed sound source for testing in multiple directions relative to the electronic device to obtain the spectrum data of the recording signal corresponding to each microphone under each sound source point, so as to obtain the difference of the amplitude and/or the difference of the phase from different sound source points to at least three microphones according to the spectrum data, and constructing and obtaining the spatial distribution function of the sound source, so as to obtain the sound spatial model of at least three microphones on the electronic device. Optionally, if the electronic device is located at the origin of the X, Y, and Z axes, the single-point fixed sound source may be placed at different points of the X, Y, and Z, at least 8 positions, and it is ensured that the positive value and the negative value of each axis have one test sound source point. Illustratively, referring to fig. 8, the electronic device is located at the origin of the X, Y, and Z axes, and the single point sound source is placed at different points of the X, Y, and Z axes.

It can be understood that after obtaining the spatial distribution function of the sound source, the direction of the sound can be located by comparing the phase and amplitude differences of the microphones of the same sound, and the spatial distance between the sound and the electronic device can be obtained by comparing the phase difference of the same frequency signal of the same sound to the microphones and combining the wavelength of the frequency.

Thus, in some embodiments, the orientation information between the wireless charging apparatus and the electronic device may be determined by comparing the noise source to each microphone amplitude phase difference. Specifically, the sound recording signals acquired by the at least three microphones may be acquired, so as to perform fourier transform on the sound recording signal corresponding to each microphone of the at least three microphones, respectively, to obtain corresponding spectrum data, to extract, according to the spectrum data, the spectrum feature of the noise sound source generated by the wireless charging device in the sound recording signal of each microphone, and determine the difference of the amplitudes and/or the difference of the phases of the spectrum features of the noise sound source corresponding to each two microphones of the at least three microphones, so that the orientation information between the wireless charging device and the electronic device may be obtained by combining the sound space model.

Step S230: and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

According to the recording method provided by the embodiment of the application, if the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the frequency spectrum characteristic of a noise sound source generated by the wireless charging device in the recording signal can be determined based on the recording signal acquired by the microphone, so that the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation is determined based on the frequency spectrum characteristic, and recording optimization operation is performed on the recorded recording signal based on the azimuth information, wherein the recording optimization operation is used for suppressing a sound signal of the azimuth information. Therefore, the azimuth information of the wireless charging device relative to the electronic equipment is determined by analyzing the noise level of wireless charging in the recording signal acquired by the microphone, and the sound aiming at the azimuth information is suppressed, so that the interference of wireless charging noise on recording quality is reduced, and the recording effect during wireless charging is improved.

Referring to fig. 9, fig. 9 is a flowchart illustrating a recording method according to another embodiment of the present application. As will be described in detail with respect to the flow shown in fig. 9, the recording method may specifically include the following steps:

step S310: according to the equipment attribute of the wireless charging device, determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation.

It can be understood that the wireless charging device is in a lying state, and when the wireless charging device charges the electronic equipment, the electronic equipment is usually laid above the wireless charging device; the wireless charging device is in a vertical form, and when the wireless charging device charges the electronic equipment, the electronic equipment is usually placed above the wireless charging device in an inclined or vertical manner. That is, the orientation information between the wireless charging apparatus and the electronic device may be in one-to-one correspondence with the type of the wireless charging apparatus. Therefore, in the embodiment of the present application, the azimuth information between the wireless charging apparatus and the electronic device when the electronic device performs the recording operation may also be determined according to the device attribute of the wireless charging apparatus. The device attribute may be a device type of the wireless charging apparatus, such as a horizontal type, a vertical type, and the like. Optionally, the device attribute may also be a device identifier, so that the electronic device may query the database through the device identifier to determine the device type of the wireless charging apparatus.

In some embodiments, when the electronic device enters the wireless charging mode, the peripheral wireless charging devices are scanned and paired for communication connection. The electronic equipment can acquire the equipment attribute of the wireless charging device when in pairing communication connection, so that the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment executes recording operation can be determined according to the equipment attribute of the wireless charging device.

Step S320: and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

According to the recording method provided by the embodiment of the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation can be determined according to the equipment attribute of the wireless charging device, and recording optimization operation is performed on the recorded recording signal based on the azimuth information, wherein the recording optimization operation is used for suppressing the sound signal of the azimuth information. Therefore, for the recording scene during wireless charging, the azimuth information of the wireless charging device relative to the electronic equipment can be determined, and the sound aiming at the azimuth information is suppressed, so that the interference of wireless charging noise on the recording quality is reduced, and the recording effect during wireless charging is improved.

Referring to fig. 10, fig. 10 is a schematic flowchart illustrating a recording method according to still another embodiment of the present application. As will be described in detail with respect to the flow shown in fig. 10, the recording method may specifically include the following steps:

step S410: and determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation according to the attitude information of the electronic equipment, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation.

Because the wireless charging device is in a lying state, when the wireless charging device charges the electronic equipment, the electronic equipment is generally horizontally arranged above the wireless charging device; the wireless charging device is in a vertical form, and when the wireless charging device charges the electronic equipment, the electronic equipment is usually placed above the wireless charging device in an inclined or vertical manner. That is, the orientation information between the wireless charging device and the electronic device may also be in one-to-one correspondence with the posture information of the electronic device. Therefore, in the embodiment of the present application, the orientation information between the wireless charging apparatus and the electronic device when the electronic device performs the recording operation may also be determined according to the posture information of the electronic device.

In some embodiments, the electronic device may include an orientation sensor for sensing angular information of the electronic device in a three-dimensional space, such that the pose information of the electronic device may be determined based on the angular information sensed by the orientation sensor. The direction sensor may be an acceleration sensor, a gravity sensor, a gyroscope, or other devices capable of acquiring changes of a distance, an orientation, and a direction of the mobile terminal, and may be originally provided with the electronic device, or may be additionally added, and the present disclosure is not limited herein.

Exemplarily, please refer to fig. 2 and fig. 11, and fig. 11 shows a schematic view of another scenario provided by the embodiment of the present application. When the wireless charging device is in a vertical form and charges the electronic equipment, the electronic equipment is usually obliquely or vertically placed above the wireless charging device, the electronic equipment can be placed on a transverse screen or a vertical screen at the moment, and the orientation information between the wireless charging device and the electronic equipment can be accurately positioned by detecting the attitude information of the electronic equipment.

In some embodiments, the orientation information of the wireless charging apparatus relative to the electronic device may also be determined in combination with the device attributes of the wireless charging apparatus. This time is not limited.

Step S420: and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

According to the recording method provided by the embodiment of the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation can be determined according to the attitude information of the electronic equipment, and recording optimization operation is performed on the recorded recording signal based on the azimuth information, wherein the recording optimization operation is used for suppressing the sound signal of the azimuth information. Therefore, for the recording scene during wireless charging, the azimuth information of the wireless charging device relative to the electronic equipment can be determined, and the sound aiming at the azimuth information is suppressed, so that the interference of the wireless charging noise on the recording quality is reduced, and the recording effect during wireless charging is improved.

Referring to fig. 12, fig. 12 is a schematic flowchart illustrating a recording method according to another embodiment of the present application. As will be described in detail with respect to the flow shown in fig. 12, the recording method may specifically include the following steps:

step S510: determining orientation information between a wireless charging device and the electronic equipment when the electronic equipment performs recording operation, wherein the electronic equipment is in a wireless charging mode when the electronic equipment performs recording operation.

Step S520: and executing recording optimization operation on the recorded recording signals based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

In some embodiments, the suppression processing of the sound signals of the orientation information may be implemented by a beamforming algorithm. Specifically, referring to fig. 13, step S520 may include:

step S521: and determining a direction other than the azimuth information as a target beam direction based on the azimuth information.

Step S522: and performing beam forming processing on the recorded sound recording signals based on the target beam direction, wherein the beam forming processing is used for enhancing the sound signals in the target beam direction and suppressing the sound signals outside the target beam direction.

The beamforming process may process spatial information and time-frequency information provided by multiple microphones, estimate a time delay between microphone arrays to synchronize voice signals of each channel, and perform delay and sum (delay and sum beamforming) to eliminate background noise with an average value of zero. The method mainly suppresses sound interference outside a main lobe, for example, to strengthen voice in a zero-degree angle direction, when a beam is incident from the zero-degree angle direction, there is no delay difference between signals collected by a microphone array, so that audio is enhanced by a "superposition" effect, but collected noise and audio in other directions are not enhanced by the "superposition" because of different delay differences or low correlation, so that the gain of the beam formed in the zero-degree angle direction is larger than that of the signal incident in other directions. Therefore, the suppression processing of the sound signal of the azimuth information can be realized by the beam forming processing.

Specifically, a direction other than the azimuth information may be determined as a target beam direction based on the azimuth information, wherein the target beam direction is a main lobe direction of beamforming. It is understood that after the recorded recording signal is beamformed according to the target beam direction, the sound corresponding to the beam direction can be enhanced, and the sound in other directions than the beam direction can be suppressed. Therefore, the electronic equipment can perform enhancement processing on the sound in the direction other than the direction information and perform suppression processing on the sound signal of the direction information. In some embodiments, the target beam direction may be characterized by a target beam angle, wherein the angle corresponding to the target beam angle may be aligned in a direction other than the azimuth information.

It can be understood that, in the beam forming principle, only three microphones forming a triangle are needed to calculate the beam angle, when the number of the microphones of the electronic device is three, one beam angle can be obtained, and when the number of the microphones of the electronic device is greater than three, the recording signals collected by every three microphones can be calculated to obtain one beam angle. In some embodiments, the beam angles of all combinations (every three are a group, and if there are four microphones, there are 4 combinations) can be calculated, and then all the beam angles are processed by using the least square method to find the optimal solution, so that the stability and accuracy of the beam angles can be improved by using the information collected by all the microphones of the electronic device.

In some embodiments, the recording optimization operation is performed on the recorded recording signal, and may also be to increase a gain and filter the sound signal other than the orientation information, for example, a gain adjustment process is performed to increase a gain of the whole frequency domain or time domain portion of the sound signal other than the orientation information, and for example, an amplitude adjustment process is performed to increase an output amplitude of the sound signal other than the orientation information, so as to increase a volume. In some embodiments, the sound signal of the orientation information may also be attenuated, for example, the output amplitude of the sound signal of the orientation information may be reduced. The specific mode is not limited, and only the sound signal of the direction information needs to be suppressed.

Step S530: and when the electronic equipment exits the wireless charging mode, stopping executing the recording optimization operation on the recorded recording signals so as to stop the suppression processing on the sound signals of the azimuth information.

In this embodiment of the application, when it is detected that the electronic device exits the wireless charging mode, the recording optimization operation may be stopped from being performed on the recorded recording signal, so as to stop the suppression processing on the sound signal of the direction information, and ensure the recording effect of the sound signal of the direction information.

In some embodiments, if the recording optimization operation is executed when the electronic device executes the recording operation, the electronic device may detect whether the electronic device exits the wireless charging mode in real time during the recording process, so that when it is detected that the electronic device exits the wireless charging mode, the recording optimization operation may be stopped in time to recover the original recording mode. In some embodiments, if the recording optimization operation is performed on the recorded recording signal after the recording of the electronic device is finished, the recording signal may be analyzed, so that the recording optimization operation is performed only on the recording signal obtained when the electronic device is in the wireless charging mode, and the recording optimization operation is not performed on the recording signal obtained when the electronic device is not in the wireless charging mode. Optionally, when it is detected that the electronic device enters or exits the wireless charging mode, the current recording time may be recorded, so that the recording signal is cut according to the recording time in the following process, and after the recording optimization operation is accurately performed, the recording signal is spliced and synthesized into a final recording signal to be provided to the user. Optionally, the 2khz and harmonic components thereof in the recording signal may be analyzed in real time to determine the recording signal interfered by the noise of the wireless charging device and cut, so that the recording signal is spliced and synthesized to the final recording signal to the user after the recording optimization operation is accurately performed.

For example, referring to fig. 14, fig. 14 is a schematic block diagram illustrating an overall flow of a recording method according to the present application, when the electronic device starts a recording function, the electronic device may detect a noise level of wireless charging in audio picked up by multiple microphones, determine a direction of a wireless charging base relative to the electronic device, and suppress sound in the direction; when the wireless charging is finished, the omnidirectional recording needs to be recovered, and the influence on the recording quality is reduced.

According to the recording method provided by the embodiment of the application, if the electronic equipment is in the wireless charging mode when the electronic equipment performs the recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment, the recording optimization operation can be performed on the recorded recording signal by determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation, and the recording optimization operation is used for suppressing the sound signal of the azimuth information. And then when the electronic equipment exits the wireless charging mode, stopping executing the recording optimization operation on the recorded recording signals to stop the suppression processing on the sound signals of the azimuth information and restore the recording effect on the sound signals of the azimuth information. Therefore, only when wireless charging is carried out, noise reduction is carried out on the direction of the wireless charging device in the recording, and when the wireless charging is finished, the recording of the direction of the wireless charging device is recovered, so that the interference to the recording quality when wireless charging is reduced, the recording effect when wireless charging is improved, the recording effect when non-wireless charging is also ensured, and the dynamic optimization processing of the recording is realized.

Referring to fig. 15, a block diagram of a recording apparatus 700 according to an embodiment of the disclosure is shown, which is applied to an electronic device. The recording apparatus 700 includes: a positioning module 710, configured to determine orientation information between a wireless charging apparatus and the electronic device when the electronic device performs a recording operation, where the electronic device is in a wireless charging mode when the electronic device performs the recording operation, and the wireless charging mode is a mode in which the wireless charging apparatus wirelessly charges the electronic device; and an optimizing module 720, configured to perform a recording optimization operation on the recorded recording signal based on the orientation information, where the recording optimization operation is used to perform suppression processing on the sound signal of the orientation information.

In some embodiments, the location module 710 may include: the frequency domain conversion unit is used for determining the frequency spectrum characteristics of a noise sound source generated by the wireless charging device in a recording signal based on the recording signal acquired by a microphone; and the frequency domain analysis unit is used for determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation based on the frequency spectrum characteristics.

In some embodiments, the electronic device may comprise at least three microphones, and the frequency domain converting unit may be specifically configured to: determining the frequency spectrum characteristics of a noise sound source generated by the wireless charging device in the recording signals of each microphone based on the recording signals acquired by the at least three microphones; the frequency domain analysis unit may be specifically configured to: determining a difference in amplitude and/or a difference in phase of a spectral feature of the noise source corresponding to each two microphones of the at least three microphones; and determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation according to the difference of the amplitude and/or the difference of the phase.

In some embodiments, the positioning module 710 may also be specifically configured to: and determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation according to the equipment attribute of the wireless charging device.

In some embodiments, the positioning module 710 may be further specifically configured to: and determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation according to the attitude information of the electronic equipment.

In some embodiments, the optimization module 720 may be specifically configured to: determining a direction other than the azimuth information as a target beam direction based on the azimuth information; and performing beam forming processing on the recorded sound recording signals based on the target beam direction, wherein the beam forming processing is used for enhancing the sound signals in the target beam direction and suppressing the sound signals outside the target beam direction.

In some embodiments, the recording apparatus 700 may further include: and the recovery module is used for stopping executing the recording optimization operation on the recorded recording signal when the electronic equipment exits the wireless charging mode so as to stop the suppression processing on the sound signal of the azimuth information.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

In summary, according to the recording apparatus provided in the embodiment of the present application, if the electronic device is in the wireless charging mode when the electronic device performs the recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic device, the recording apparatus may perform the recording optimization operation on the recorded recording signal by determining the azimuth information between the wireless charging device and the electronic device when the electronic device performs the recording operation, where the recording optimization operation is used to suppress the sound signal of the azimuth information. Thereby reduce the wireless interference of charging to recording the quality, promote the recording effect when wireless charging.

Referring to fig. 16, a block diagram of an electronic device according to an embodiment of the present disclosure is shown. The electronic device 100 may be a mobile phone, a tablet computer, a music player, a wearable device, a bluetooth headset, a camera device, an intelligent home device, or other terminal devices that can be wirelessly charged and have a recording function. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more applications configured to perform the methods as described in the aforementioned method embodiments.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a sound recorder (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the electronic device 100 during use (e.g., phone book, audio-video data, chat log data), and the like.

It will be appreciated that the configuration shown in FIG. 16 is merely exemplary, and that electronic device 100 may include more or fewer components than shown in FIG. 16, or have a completely different configuration than shown in FIG. 16. The embodiments of the present application do not limit this.

Referring to fig. 17, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above method embodiments.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A recording method is applied to an electronic device, the electronic device comprises a microphone, a video recording operation of the electronic device comprises a formal recording stage and a recording preparation stage before the formal recording stage, and the method comprises the following steps:

when the electronic equipment is in a wireless charging mode and is in a recording preparation stage of video recording operation, acquiring an audio signal acquired by the microphone as a prerecorded recording signal;

determining azimuth information between a wireless charging device and the electronic equipment according to the prerecorded recording signal, wherein the wireless charging mode is a mode that the wireless charging device wirelessly charges the electronic equipment;

and executing recording optimization operation on the recording signals recorded in the formal recording stage based on the direction information, wherein the recording optimization operation is used for suppressing the sound signals of the direction information.

2. The method of claim 1, wherein determining orientation information between the wireless charging apparatus and the electronic device when the electronic device performs a recording operation comprises:

determining the frequency spectrum characteristics of a noise sound source generated by the wireless charging device in a recording signal based on the recording signal acquired by a microphone;

and determining orientation information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation based on the frequency spectrum characteristics.

3. The method of claim 2, wherein the electronic device comprises at least three microphones, and wherein determining the spectral characteristics of the noise source generated by the wireless charging device in the recorded sound signal based on the recorded sound signal collected by the microphones comprises:

determining the frequency spectrum characteristics of a noise sound source generated by the wireless charging device in the recording signals of each microphone based on the recording signals acquired by the at least three microphones;

the determining, based on the spectrum feature, the orientation information between the wireless charging apparatus and the electronic device when the electronic device performs a recording operation includes:

determining a difference in amplitude and/or a difference in phase of a spectral feature of the noise source corresponding to each two microphones of the at least three microphones;

and determining the azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs the recording operation according to the difference of the amplitude and/or the difference of the phase.

4. The method of claim 1, wherein determining orientation information between the wireless charging apparatus and the electronic device when the electronic device performs a recording operation comprises:

and determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation according to the equipment attribute of the wireless charging device.

5. The method of claim 1, wherein the determining the orientation information between the wireless charging apparatus and the electronic device when the electronic device performs the recording operation comprises:

and determining azimuth information between the wireless charging device and the electronic equipment when the electronic equipment performs recording operation according to the attitude information of the electronic equipment.

6. The method according to any one of claims 1 to 5, wherein performing a recording optimization operation on the recorded recording signal based on the orientation information, the recording optimization operation being used for suppressing a sound signal of the orientation information, comprises:

determining a direction other than the azimuth information as a target beam direction based on the azimuth information;

and performing beam forming processing on the recorded sound recording signals based on the target beam direction, wherein the beam forming processing is used for enhancing the sound signals in the target beam direction and suppressing the sound signals outside the target beam direction.

7. The method of any one of claims 1-5, wherein after performing a recording optimization operation on the recorded recording signal based on the orientation information, the method further comprises:

and when the electronic equipment exits the wireless charging mode, stopping executing the recording optimization operation on the recorded recording signals so as to stop the suppression processing on the sound signals of the direction information.

8. A recording apparatus, applied to an electronic device, wherein the electronic device includes a microphone, and a video recording operation of the electronic device includes a formal recording stage and a recording preparation stage before the formal recording stage, the apparatus comprising:

the positioning module is used for acquiring an audio signal acquired by the microphone as a prerecorded recording signal when the electronic equipment is in a wireless charging mode and is in a recording preparation stage of video recording operation; determining azimuth information between a wireless charging device and the electronic equipment according to the prerecorded recording signal, wherein the electronic equipment is in a wireless charging mode when performing recording operation, and the wireless charging mode is a mode in which the wireless charging device wirelessly charges the electronic equipment;

and the optimizing module is used for executing recording optimizing operation on the recording signals recorded in the formal recording stage based on the azimuth information, and the recording optimizing operation is used for suppressing the sound signals of the azimuth information.

9. An electronic device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to perform the method of any of claims 1-7.

10. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 7.