WO2017113937A1

WO2017113937A1 - Mobile terminal and noise reduction method

Info

Publication number: WO2017113937A1
Application number: PCT/CN2016/102388
Authority: WO
Inventors: 孙丽; 张圣杰
Original assignee: 努比亚技术有限公司
Priority date: 2015-12-29
Filing date: 2016-10-18
Publication date: 2017-07-06
Also published as: CN105679300A

Abstract

A mobile terminal and a noise reduction method, the mobile terminal comprising: a first acquisition module (10), configured to acquire an audio signal and identify a noise signal from the audio signal (S10); a second acquisition module (20), configured to acquire a noise source position corresponding to the noise signal identified by the first acquisition module (10), and acquire a user position (S20); a determination module (30), configured to determine a noise reduction signal according to the noise signal identified by the first acquisition module (10), and the noise source position and user position acquired by the second acquisition module (20) (S30); a noise reduction module (40), configured to adjust the audio signal according to the noise reduction signal determined by the determination module (30) so as to perform noise reduction on the audio signal (S40).

Description

Mobile terminal and noise reduction method

Technical field

This application relates to, but is not limited to, the field of mobile terminal technology.

Background technique

In the scheme of active noise reduction in the vehicle, the related art uses the in-vehicle intelligent device and the microphone assembled by the vehicle body for data transmission, and uses the algorithm and computing resources on the in-vehicle intelligent device to perform calculation and reverse sound wave superimposition and playback, therefore, on the vehicle The computing and computing power of the device is very high. The computing resources include a central processing unit (CPU), a memory, and the like. In addition, only some of the high-end models in the related art have the ability to reduce noise. Most of the mid- and low-end vehicles are equipped with a vehicle that does not have a noise reduction algorithm and corresponding computing power, and cannot achieve active noise reduction in the vehicle.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

This paper proposes a mobile terminal and noise reduction method to realize the method of active noise reduction through the mobile terminal.

A mobile terminal includes:

a first obtaining module configured to: obtain an audio signal, and identify a noise signal in the audio signal;

a second obtaining module, configured to: obtain a noise source location corresponding to the noise signal identified by the first obtaining module, and obtain a user location;

a determining module, configured to: determine a noise reduction signal according to the noise signal identified by the first obtaining module, and a noise source position obtained by the second obtaining module and the user position;

The noise reduction module is configured to: adjust the audio signal according to the noise reduction signal determined by the determining module to perform noise reduction on the audio signal.

Optionally, in the mobile terminal as described above, the noise reduction signal determined by the determining module is played by the mobile terminal; the noise reduction module is further configured to: play the noise with the mobile terminal When the noise-reduced signal of the signal inversion arrives at the user, it is superimposed with the noise generated by the noise source reaching the user.

Optionally, in the mobile terminal as described above,

The second obtaining module is further configured to: obtain a noise source location corresponding to the noise signal identified by the first obtaining module, and obtain a location of the user location and an audio position;

The determining module is further configured to: determine, according to the noise signal identified by the first obtaining module, the location of the noise source, the location of the user, and the location of the sound obtained by the second obtaining module Noise reduction signal;

The noise reduction module is further configured to: send the noise reduction signal determined by the determining module to the audio playback to perform noise reduction on the audio signal.

Optionally, in the mobile terminal as described above, the noise reduction module is further configured to: send the noise reduction signal to the audio play, and perform noise reduction on the audio play and the noise signal When the signal arrives at the user, it is superimposed with the noise emitted by the noise source reaching the user.

Optionally, in the mobile terminal, the first obtaining module identifies a plurality of noise signals, and the determining module is further configured to: identify, according to the first obtaining module, the plurality of noise signals The noise spectrum is classified to determine a noise reduction signal corresponding to each of the noise signals, and the noise reduction signal is a compensation sound wave that is inverted from the corresponding noise signal.

Optionally, in the mobile terminal as described above, the second obtaining module includes:

An acquiring unit, configured to: obtain a phase difference and a sound pressure difference of the waveform corresponding to the noise signal identified by the first obtaining module;

a calculating unit, configured to: calculate a three-dimensional spatial position of the noise source corresponding to the noise signal according to the phase difference acquired by the acquiring unit and the sound pressure difference, and obtain a relative movement of the user The three-dimensional position of the terminal.

Optionally, in the mobile terminal as described above, the determining module includes:

a determining unit, configured to: calculate a delay corresponding to the noise signal according to the noise source calculated by the calculating unit and a three-dimensional spatial position of the user relative to the mobile terminal;

And a generating unit, configured to: generate a noise reduction signal that is inverted from the noise signal according to the delay calculated by the determining unit.

Optionally, in the mobile terminal as described above, the delay is a delay that the noise corresponding to the noise signal reaches a distance of the user relative to the mobile terminal or the audio played the noise reduction signal reaches a distance of the user.

Optionally, in the mobile terminal as described above, the first obtaining module identifies a plurality of noise signals, and the determining unit calculates a delay corresponding to the noise signal, including:

Calculating a delay of the noise corresponding to each of the plurality of noise signals reaching the user's distance relative to the mobile terminal or the audio playbook noise reduction signal reaching the user.

Optionally, in the mobile terminal as described above, the first obtaining module is further configured to: receive an audio signal sent by the car, and identify a noise signal in the audio signal.

A noise reduction method, the method being applied to a mobile terminal, the method comprising:

Obtaining an audio signal and identifying a noise signal in the audio signal;

Obtaining a noise source location corresponding to the noise signal, and obtaining a user location;

Determining a noise reduction signal according to the noise signal, the noise source location, and the user location;

Adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal.

Optionally, in the noise reduction method as described above, the noise reduction signal is played by the mobile terminal; and the audio signal is adjusted according to the noise reduction signal to perform noise reduction on the audio signal, including :

When the mobile terminal plays the noise reduction signal inverted from the noise signal to the user, it is superimposed with the noise generated by the noise source reaching the user.

Optionally, in the noise reduction method as described above, the obtaining a noise source location corresponding to the noise signal, and obtaining a user location, includes:

Obtaining a noise source position corresponding to the noise signal, and obtaining a position of the user and an acoustic position;

Determining the noise reduction signal according to the noise signal, the noise source location, and the user location, including:

Based on the noise signal, the noise source location, the user location, and the location of the sound Determining the noise reduction signal;

Adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal, including:

The noise reduction signal is sent to the audio playback to denoise the audio signal.

Optionally, in the noise reduction method as described above, the sending the noise reduction signal to the audio playback to perform noise reduction on the audio signal includes:

Transmitting the noise reduction signal to the audio playback, and superimposing the noise that is generated by the noise source and reaching the user when the noise reduction signal that is opposite to the noise signal reaches the user.

Optionally, in the noise reduction method as described above, when the noise signal is multiple, the determining the noise reduction signal according to the noise signal, the noise source location, and the user location, includes:

And categorizing according to the noise spectrum of the plurality of noise signals, respectively determining a noise reduction signal corresponding to each of the noise signals, wherein the noise reduction signal is a compensation sound wave that is opposite to the corresponding noise signal.

Obtaining a phase difference and a sound pressure difference of the waveform corresponding to the noise signal;

And calculating, according to the phase difference and the sound pressure difference, a three-dimensional spatial position of the noise source corresponding to the noise signal with respect to the mobile terminal, and obtaining a three-dimensional spatial position of the user relative to the mobile terminal.

Optionally, in the noise reduction method as described above, the determining the noise reduction signal according to the noise signal, the noise source location, and the user location, includes:

Calculating a delay corresponding to the noise signal according to the noise source and a three-dimensional spatial position of the user relative to the mobile terminal;

A noise reduction signal inverted from the noise signal is generated according to the delay.

Optionally, in the noise reduction method as described above, the delay is a delay when the noise corresponding to the noise signal reaches a distance of the user relative to the distance that the noise reduction signal reaches the user by the mobile terminal or the audio device. .

Optionally, in the noise reduction method as described above, when the noise signal is multiple, the calculation is performed. The delay corresponding to the noise signal includes:

Optionally, in the noise reduction method as described above, the obtaining the audio signal and identifying the noise signal in the audio signal includes:

Receiving an audio signal transmitted by the car and identifying a noise signal in the audio signal.

The mobile terminal and the noise reduction method provided by the embodiment of the present invention, the mobile terminal includes: a first obtaining module, configured to: obtain an audio signal, and identify a noise signal in the audio signal; and the second obtaining module is configured to: obtain The first obtaining the noise source position corresponding to the noise signal identified by the module, and obtaining the user position; the determining module is configured to: the noise signal identified by the first obtaining module, and the noise source position and the user position obtained by the second obtaining module Determining the noise reduction signal; the noise reduction module is configured to: adjust the audio signal according to the noise reduction signal determined by the determining module to perform noise reduction on the audio signal. In the above manner, the embodiment of the present invention uses the resources of the mobile terminal to determine the noise reduction signal according to the obtained audio signal, the location of the noise source, and the position of the user, thereby implementing active noise reduction on the audio signal, thereby ensuring that the user is free from noise, and A variety of environments can be applied using a mobile terminal.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present invention;

Figure 2 is a schematic view showing the electrical structure of the camera shown in Figure 1;

FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure;

4 is a schematic diagram of a microphone array setting in a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of an application scenario of a mobile terminal according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of a second obtaining module in a mobile terminal according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a determining module in a mobile terminal according to an embodiment of the present disclosure;

FIG. 8 is a schematic flowchart diagram of a noise reduction method according to an embodiment of the present invention;

FIG. 9 is a schematic flowchart of obtaining a noise source location and a user location corresponding to a noise signal in a noise reduction method according to an embodiment of the present disclosure;

FIG. 10 is a schematic flowchart of determining a noise reduction signal in a noise reduction method according to an embodiment of the present disclosure;

FIG. 11 is a schematic flowchart diagram of another noise reduction method according to an embodiment of the present invention.

Embodiments of the invention

It is to be understood that the embodiments described below are merely illustrative of the invention and are not intended to limit the invention.

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments herein may be arbitrarily combined with each other.

The steps illustrated in the flowchart of the figures may be executed in a computer system in accordance with a set of computer executable instructions. Also, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

FIG. 1 is a schematic structural diagram of hardware of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, an output unit 150, a memory 160, a controller 180, a power supply unit 190, and the like. Figure 1 shows a mobile terminal with various components, but it should be understood that implementation is not required All the components shown. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication device or network. For example, the wireless communication unit can include at least one of the mobile communication module 112, the wireless internet module 113, and the short-range communication module 114.

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technologies include BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), ZigbeeTM, and the like.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 122 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display module 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information and can Including a keyboard, a pot, a touchpad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel, a rocker, and the like. In particular, when the touch panel is superimposed on the display module 151 in the form of a layer, a touch screen can be formed.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display module 151, an audio output module 152, and the like.

The display module 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display module 151 can display a user interface (UI) or graphical user interface (GUI) associated with a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capture mode, the display module 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display module 151 and the touch panel are superposed on each other in the form of layers to form a touch screen, the display module 151 can function as an input device and an output device. The display module 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio related to a specific function performed by the mobile terminal 100. Output (for example, call signal reception sound, message reception sound, etc.). The audio output module 152 can include a pickup, a buzzer, and the like.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Below, for the sake of brevity, will be described A slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like is taken as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

2, FIG. 2 is a schematic diagram of the electrical structure of the camera shown in FIG. 1.

The photographic lens 1211 may include a plurality of optical lenses that form a subject image, and the optical lens may be a single focus lens or a zoom lens. The photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance. The lens drive control circuit 1222 drives and controls the lens driver 1221 in accordance with a control command from the microcomputer 1217.

An imaging element 1212 is disposed on the optical axis of the photographic lens 1211 near the position of the subject image formed by the photographic lens 1211. The imaging element 1212 is provided to image the subject image and acquire captured image data. Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, which is subjected to charge accumulation by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of red, green, blue (abbreviation: RGB) color filters.

The imaging element 1212 is connected to an imaging circuit 1213 that performs charge accumulation control and image signal readout control in the imaging element 1212, and reduces the reset noise after the read image signal (for example, an analog image signal). The shaping is performed, and the gain is increased to obtain an appropriate signal level.

The imaging circuit 1213 is connected to an analog-to-digital conversion (A/D) converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal to the bus 1227 (hereinafter referred to as It is image data).

The bus 1227 is provided to transmit a transmission path of various data read or generated inside the camera. The A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, and a Synchronous Dynamic Random Access Memory (SDRAM) 1218 are connected. A memory interface (hereinafter referred to as a memory I/F) 1219 and an LCD liquid crystal display (LCD) driver 1220.

The image processor 1215 performs output buffering (Output Buffer, abbreviated as: OB) subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, and the image data based on the output of the imaging element 1212. Various image processing such as simultaneous processing and edge processing. The JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.

The operating unit 1223 includes, but is not limited to, a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button The operation controls such as various input buttons and various input keys detect the operational state of these operation controls.

The detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.

The SDRAM 1218 is provided as an electrically rewritable volatile memory that temporarily stores image data or the like. The SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225. Remember The recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body. However, the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.

The LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218. When display is required, the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed. In the SDRAM 1218, when display is required, the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.

The LCD 1226 is configured to display an image on the back of the camera body. The LCD 1226 may be an LCD, but is not limited thereto, and the LCD 1226 may be implemented by other display panels such as organic electroluminescence (EL), but is not limited thereto.

Based on the hardware structure of the mobile terminal and the electrical structure of the camera, the following embodiments of the present invention provide a mobile terminal and a noise reduction method.

The embodiment of the invention provides a mobile terminal.

FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal provided in this embodiment may include:

The first obtaining module 10 is configured to: obtain an audio signal, and identify a noise signal in the audio signal.

The embodiment of the present invention is mainly applied to a mobile terminal, and the mobile terminal includes an electronic device capable of performing calculation, such as a smart phone or a pad. The mobile device can be equipped with the following device: the controller 180 shown in FIG. 1 , of course, in an actual application scenario. One or a combination of the wireless communication unit 110, the A/V input unit 120, the user input unit 130, the output unit 150, and the like may also be included. The present invention is described by taking two application scenarios as an example:

Scene 1: Active noise reduction in the room:

The mobile terminal applied to the present scenario may include a CPU or a graphics processing unit (Graphics Processing Unit, GPU for short), that is, the controller 180 in FIG. 1, a camera 121, and a microphone 122. In practical applications, the number of microphones in this scenario may be, for example, three separate As shown in FIG. 4, it is a schematic diagram of a microphone array setting in the mobile terminal provided by the embodiment of the present invention. Since the detection accuracy of the sound pressure level in the related art can reach 0.1DBA, the detection accuracy of the phase difference can reach 0.1 degree, so when the position changes, the software has strong stability and does not need to change the corresponding technology. The noise source of this scene can be the noise generated by the square dance, the noise emitted by the car horn, and the like. When the user is in the room, the user is vulnerable to external noise. As shown in FIG. 5, it is a schematic diagram of an application scenario of the mobile terminal provided by the embodiment of the present invention. In this case, the user can perform the user input unit on the mobile terminal. Operation, start active noise reduction.

In this scenario, by turning on the microphone on the mobile terminal, receiving the external sound, and obtaining an audio signal, the external sound includes noise and effective sound, and the mobile terminal classifies and recognizes the signal in the audio signal when the audio signal is obtained. A noise signal in an audio signal. In practical applications, the external noise can be distinguished according to the general noise detection algorithm, such as the noise generated by the square dance, and of course, the effective sound in the audio signal, such as human voice, can be recognized, if the external noise If there are multiple, they can be classified according to the noise spectrum sequence and extracted one by one. For example, the power of the frequency component of white noise is uniform throughout the audible range (0 to 20 kHz); the energy of the pink noise is continuously attenuated from the low frequency to the high frequency, and the curve is 1/f, usually 3 drops per 8 degrees. Decibel; the frequency component power of brown noise is mainly concentrated in the low frequency band, and its energy drop curve is 1/f^2, and its waveform is very self-similar.

Scene 2: Active noise reduction in the car:

In the vehicle, the automobile engine noise is the main noise source when the main vehicle is running. In this scenario, the mobile terminal may also include at least one of a CPU or a GPU (ie, the controller 180 in FIG. 1) and the wireless communication unit 110 for calculation. Kind. For example, the mobile terminal in this embodiment includes a short-range communication module 114, such as Bluetooth or wireless fidelity (WIreless-FIdelity, hereinafter referred to as: wifi). The car in this scenario may, for example, comprise an array of microphones arranged in a car, the number of which may be, for example, three. Since the sound is transmitted at a relatively fast speed, the positions of the plurality of microphones disposed in the car can be relatively far apart, which is much larger than the microphone array set on the mobile terminal, and the data obtained by setting the microphone array on the car is calculated. The result of the calculation is smaller than the data obtained by the microphone on the mobile terminal.

In this scenario, the first obtaining module 10 may be further configured to: receive an audio signal sent by the car, And identifying the noise signal in the audio signal.

After receiving the audio signal by setting the microphone in the car, the audio signal is sent to the mobile terminal, for example, can be sent to the mobile terminal through Bluetooth or wifi, and can also be sent to the mobile terminal through the communication carrier during implementation. Thereby the mobile terminal receives the audio signal transmitted by the car and recognizes the noise signal in the audio signal.

Alternatively, active noise reduction in the vehicle can also obtain an audio signal through a microphone array on the mobile terminal.

The second obtaining module 20 is configured to: obtain the noise source position corresponding to the noise signal recognized by the first obtaining module 10, and obtain the user position.

After the first obtaining module 10 recognizes the noise signal in the audio signal, the second obtaining module 20 may obtain the noise source position corresponding to the noise signal according to the noise signal.

Optionally, as shown in FIG. 6 , a schematic diagram of a structure of a second obtaining module in a mobile terminal according to an embodiment of the present invention, where the second obtaining module 20 in this embodiment may include:

The obtaining unit 21 is configured to acquire a phase difference and a sound pressure difference of the waveform corresponding to the noise signal recognized by the first obtaining module 10.

The calculating unit 22 is configured to calculate a three-dimensional spatial position of the noise source corresponding to the noise signal according to the phase difference and the sound pressure difference acquired by the acquiring unit 21, and obtain a three-dimensional spatial position of the user relative to the mobile terminal.

In the embodiment of the present invention, the phase difference and the sound pressure difference of the corresponding waveform of the noise signal are obtained according to the noise signal obtained by the microphone (Microphone, MIC for short), and the phase difference and the sound pressure difference of the waveform are recorded through the microphone array to calculate the noise. The position of the sound source relative to the three-dimensional space of the terminal. Each input waveform has a position difference with the sound source, and the sound pressure level intensity is inversely proportional to the square of the distance, and the phase difference is related to the reception delay. By subtracting each input waveform, the phase difference and the sound pressure difference are obtained. According to the speed formula of the sound wave propagating in the air, the position distance of the sound source to each MIC can be calculated, and by drawing a circle to find the intersection point, the actual position of the current sound source relative to the terminal in the space can be judged.

The calculation unit 22 can locate the position of the user in the above manner. In the actual application, the voice detection algorithm (Voice Activity Detection, VAD for short) distinguishes the human voice, and then according to the phase difference and the sound pressure difference of the human voice waveform. To determine the location of the person, in other ways, For example, the positioning is performed by the dual camera in the mobile terminal or by the single camera on the mobile terminal and the infrared ranging unit, so that the positioning can be performed by using a dual camera or a single camera in the car or the room. The infrared ranging unit performs positioning. In more implementations, sonar positioning is also possible.

The determining module 30 is configured to determine the noise reduction signal according to the noise signal recognized by the first obtaining module 10 and the noise source position and the user position obtained by the second obtaining module 20.

In the embodiment of the present invention, the determining module 30 determines the noise reduction signal according to the noise signal recognized by the first obtaining module 10 and the noise source position and the user position obtained by the second obtaining module 20. In a possible application scenario, if there are multiple noise signals, the determining module 30 classifies the noise spectra of the plurality of noise signals, extracts one by one, and respectively determines a noise reduction signal corresponding to each noise signal, and the noise reduction is performed. The signal compensates for the sound wave by inverting the corresponding noise signal.

Optionally, as shown in FIG. 7, a schematic structural diagram of a determining module in a mobile terminal according to an embodiment of the present invention, where the determining module 30 in this embodiment may include:

The determining unit 31 is configured to: calculate a delay corresponding to the noise signal according to the noise source calculated by the calculating unit 22 and the three-dimensional spatial position of the user relative to the mobile terminal;

The generating unit 32 is configured to generate a noise reduction signal that is inverted from the noise signal according to the delay calculated by the determining unit 31.

In the embodiment, after determining the three-dimensional spatial position of the noise source and the user relative to the mobile terminal, the delay of the noise corresponding to the noise signal reaching the distance of the user relative to the distance at which the mobile terminal plays the noise reduction signal reaches the user is calculated. The noise reduction signal is out of phase with the noise signal. In a possible application scenario, if there are multiple noise sources, the determining unit 31 is further configured to: calculate a noise corresponding to each of the plurality of the noise signals to reach a user distance relative to the mobile terminal The corresponding delay of playing multiple noise reduction signals to reach the user's distance.

A noise reduction signal that is inverted from the noise signal is generated according to the calculated delay, so that the noise emitted by the noise source can be cancelled when the noise reduction signal reaches the user.

The noise reduction module 40 is configured to: adjust the audio signal according to the noise reduction signal determined by the determining module 30 to perform noise reduction on the audio signal.

In the embodiment of the present invention, the noise reduction signal determined by the determining module 30 is passed in this embodiment. The mobile terminal plays, so that when the mobile terminal plays a noise reduction signal that is inverted with the noise signal and reaches the user, it can be superimposed with the noise generated by the noise source to reach the user, thereby canceling, achieving the purpose of noise reduction, and effectively avoiding noise. interference.

The mobile terminal provided by the embodiment of the present invention includes: a first obtaining module, configured to: obtain an audio signal, and identify a noise signal in the audio signal; and the second obtaining module is configured to: obtain the noise recognized by the first obtaining module a noise source position corresponding to the signal, and obtaining a user position; the determining module is configured to: determine a noise reduction signal according to the noise signal identified by the first obtaining module, and the noise source position and the user position obtained by the second obtaining module; the noise reduction module And being set to: adjust an audio signal according to the noise reduction signal determined by the determining module to perform noise reduction on the audio signal. In the above manner, the embodiment of the present invention uses the resources of the mobile terminal to determine the noise reduction signal according to the obtained audio signal, the location of the noise source, and the position of the user, thereby implementing active noise reduction on the audio signal, thereby ensuring that the user is free from noise, and A variety of environments can be applied using a mobile terminal.

With continued reference to FIG. 3, a schematic structural diagram of another mobile terminal according to an embodiment of the present invention is provided. The mobile terminal provided in this embodiment may include:

Scene 1: Active noise reduction in the room:

The mobile terminal applied to the present scenario may include a CPU or GPU (ie, the controller 180 in FIG. 1) for calculation, a camera 121, and a microphone 122. In practical applications, the number of microphones in the present scenario may be, for example, three suitable positions respectively set on the mobile terminal, such as respectively located at two ends of the mobile terminal, and also configured as a microphone array as shown in FIG. Since the detection accuracy of the sound pressure level in the related art can reach 0.1DBA, the detection accuracy of the phase difference can reach 0.1 degree, so when the position changes, the software has strong stability and does not need to change the corresponding technology. This scene The noise source can be noise generated by the square dance, noise emitted by the car horn, and the like. When the user is in the room, it is very susceptible to external noise harassment. The application scenario shown in Figure 5 is as follows. At this time, the user can operate the user input unit on the mobile terminal to activate the active noise reduction function.

In this scenario, by turning on the microphone on the mobile terminal, receiving the external sound, and obtaining an audio signal, the external sound includes noise and effective sound, and the mobile terminal classifies and recognizes the signal in the audio signal when the audio signal is obtained. A noise signal in an audio signal. In practical applications, the external noise can be distinguished according to the general noise detection algorithm, such as the noise generated by the square dance, and of course, the effective sound in the audio signal, such as human voice, can be recognized, if the external noise If there are multiple, they can be classified according to the noise spectrum sequence and extracted one by one. For example, the power of a frequency component such as white noise is uniform throughout the audible range (0 to 20 kHz); the energy of pink noise is continuously attenuated from low frequency to high frequency, and the curve is 1/f, usually every 8 degrees. 3 dB; the frequency component power of brown noise is mainly concentrated in the low frequency band, and its energy drop curve is 1/f^2, and its waveform is very self-similar.

Scene 2: Active noise reduction in the car:

In the vehicle, the automobile engine noise is the main noise source when the main vehicle is running. In this scenario, the mobile terminal may also include at least one of a CPU or a GPU (ie, the controller 180 in FIG. 1) and the wireless communication unit 110 for calculation. Kind. For example, the mobile terminal in this embodiment includes a short-range communication module 114, such as Bluetooth or wifi. The car in this scenario may, for example, comprise an array of microphones arranged in a car, the number of which may be, for example, three. Since the sound is transmitted at a relatively fast speed, the positions of the plurality of microphones disposed in the car can be relatively far apart, which is much larger than the microphone array set on the mobile terminal, and the data obtained by setting the microphone array on the car is calculated. The result of the calculation is smaller than the data obtained by the microphone on the mobile terminal.

In this scenario, the first obtaining module 10 may be further configured to: receive an audio signal transmitted by the car, and identify a noise signal in the audio signal.

The second obtaining module 20 is further configured to: obtain the noise source position corresponding to the noise signal recognized by the first obtaining module 10, and obtain the position of the user position and the sound.

In the embodiment of the present invention, the phase difference and the sound pressure difference of the waveform corresponding to the noise signal are obtained according to the noise signal obtained by the microphone, and the phase difference and the sound pressure difference of the waveform are recorded through the microphone array, and the three-dimensional spatial position of the noise source relative to the terminal is calculated. . Each input waveform has a position difference with the sound source, and the sound pressure level intensity is inversely proportional to the square of the distance, and the phase difference is related to the reception delay. By subtracting each input waveform, the phase difference and the sound pressure difference are obtained. According to the speed formula of the sound wave propagating in the air, the position distance of the sound source to each MIC can be calculated, and by drawing a circle to find the intersection point, the actual position of the current sound source relative to the terminal in the space can be judged.

In addition, the second obtaining module 20 can locate the position of the user in the above manner. In the actual application, the vocal detection algorithm VAD distinguishes the vocal, and then determines the position of the person according to the phase difference of the vocal waveform and the sound pressure difference. In the implementation, the positioning may also be performed by other means, for example, by positioning the two cameras in the mobile terminal or by using a single camera on the mobile terminal to cooperate with the infrared ranging unit, thereby positioning, and of course, by setting in the car or the room. The dual camera in the middle, or a single camera and infrared ranging unit for positioning. In more implementations, sonar positioning is also possible.

Similarly, the sound of the test position is played, and the position of the sound for playing the subsequent noise reduction signal is measured by the above method, and of course, the position of the sound can be preset in the application scene in the vehicle. In the implementation, the user can also input the position of the sound through the input menu.

The determining module 30 is further configured to determine the noise reduction signal according to the noise signal identified by the first obtaining module 10 and the position of the noise source, the position of the user, and the position of the sound obtained by the second obtaining module 20.

In the embodiment of the present invention, the determining module 30 determines the noise reduction signal according to the noise signal recognized by the first obtaining module 10 and the position of the noise source, the position of the user, and the position of the sound obtained by the second obtaining module 20. In a possible application scenario, if there are multiple noise signals, the determining module 30 determines that the noise reduction signal may be implemented by classifying the noise spectra of the plurality of noise signals, extracting one by one, and determining each noise separately. a noise reduction signal corresponding to the signal, and the noise reduction signal is corresponding to The noise signal is inverted to compensate for the sound wave.

In the embodiment, after determining the three-dimensional spatial position of the noise source and the user relative to the mobile terminal, the delay of the noise corresponding to the noise signal reaching the distance of the user relative to the distance at which the noise reduction signal reaches the user is obtained. The sound plays the phase difference between the noise reduction signal and the noise signal. In a possible application scenario, if there are multiple noise sources, the noise corresponding to each of the plurality of noise signals is calculated to reach the user's distance relative to the audio to play the plurality of noise reduction signals to reach the user. The corresponding delay.

The noise reduction module 40 is further configured to: send the noise reduction signal determined by the determination module 30 to the audio playback to perform noise reduction on the audio signal.

In the embodiment of the present invention, the noise reduction signal is sent to the audio playback according to the noise reduction signal determined by the determining module 30 to perform noise reduction on the audio signal.

In this embodiment, the audio is played, so that when the noise reduction signal in which the audio playback and the noise signal are inverted reaches the user, it can be superimposed with the noise generated by the noise source to reach the user, thereby canceling, achieving the purpose of noise reduction, and effectively Avoid noise interference.

In practical applications, considering that the power and volume of the mobile terminal may not meet the demand, the above sound may be an internal sound of the car or a home audio in the room. In the scene of noise reduction in the car, the active noise reduction in the vehicle is carried out by using the mobile terminal and the microphone assembled by the automobile, and the noise reduction algorithm and computing resources on the mobile terminal are used to collect the external environment sound in real time, and analyze and calculate. Identifying the noise from it and controlling the car to play the reverse noise reduction signal to weaken, so as to achieve the effect of active noise reduction, a mobile terminal can adapt to a variety of vehicle types, and there is no requirement for the computing resources of the vehicle equipment, and the user is increasingly growing. The comfortable driving experience requires more humanity.

Embodiments of the present invention also provide a noise reduction method.

FIG. 8 is a schematic flowchart diagram of a noise reduction method according to an embodiment of the present invention. The noise reduction method provided in this embodiment may include the following steps, that is, S10 to S40:

S10, obtaining an audio signal and identifying a noise signal in the audio signal.

Scene 1: Active noise reduction in the room:

The mobile terminal applied to the present scenario may include a CPU or GPU (ie, the controller 180 in FIG. 1) for calculation, a camera 121, and a microphone 122. In practical applications, the number of microphones in the present scenario may be, for example, three suitable positions respectively set on the mobile terminal, for example, respectively located at two ends of the mobile terminal, and may also be set with reference to the microphone array shown in FIG. 4. Since the detection accuracy of the sound pressure level in the related art can reach 0.1DBA, the detection accuracy of the phase difference can reach 0.1 degree, so when the position changes, the software has strong stability and does not need to change the corresponding technology. The noise source of this scene can be the noise generated by the square dance, the noise emitted by the car horn, and the like. When the user is in the room, it is easy to be disturbed by external noise. The application scenario shown in Figure 5 can also be referred to. At this time, the user can operate through the user input unit on the mobile terminal to activate the active noise reduction function.

Scene 2: Active noise reduction in the car:

In the vehicle, the car engine noise is the main noise source when the main car is running. In this scenario, the mobile terminal can also include a CPU or GPU for calculation (ie, the controller 180 in FIG. 1). And at least one of the wireless communication units 110. For example, the mobile terminal in this embodiment includes a short-range communication module 114, such as Bluetooth or wifi. The car in this scenario may, for example, comprise an array of microphones arranged in a car, the number of which may be, for example, three. Since the sound is transmitted at a relatively fast speed, the positions of the plurality of microphones disposed in the car can be relatively far apart, which is much larger than the microphone array set on the mobile terminal, and the data obtained by setting the microphone array on the car is calculated. The result of the calculation is smaller than the data obtained by the microphone on the mobile terminal.

In this scenario, the implementation of S10 may be: receiving an audio signal sent by the car, and identifying a noise signal in the audio signal.

S20: obtain a noise source location corresponding to the noise signal, and obtain a user location.

After the noise signal in the audio signal is identified in S10, the noise source position corresponding to the noise signal can be obtained according to the noise signal.

Optionally, as shown in FIG. 9 , a schematic flowchart of obtaining a noise source location and a user location corresponding to a noise signal in the noise reduction method provided by the embodiment of the present invention, where the noise source location corresponding to the noise signal is obtained in this embodiment And obtaining the implementation manner of the user location, which may include the following steps, namely, S21 to S22:

S21: Obtain a phase difference and a sound pressure difference of the waveform corresponding to the noise signal;

S22. Calculate a three-dimensional spatial position of the noise source corresponding to the noise signal relative to the mobile terminal according to the phase difference and the sound pressure difference, and obtain a three-dimensional spatial position of the user relative to the mobile terminal.

In the embodiment of the present invention, the phase difference and the sound pressure difference of the waveform corresponding to the noise signal are obtained according to the noise signal obtained by the microphone, and the phase difference and the sound pressure difference of the waveform are recorded through the microphone array, and the three-dimensional spatial position of the noise source relative to the terminal is calculated. . Each input waveform has a position difference due to the sound source Different, the sound pressure level intensity is inversely proportional to the square of the distance, and the phase difference is related to the receiving delay. By subtracting each input waveform, the phase difference and the sound pressure difference are obtained, according to the velocity formula of the sound wave propagating in the air. The position distance of the sound source to each MIC can be calculated. By drawing a circle to find the intersection point, the actual position of the current sound source relative to the terminal in the space can be judged.

In addition, the position of the user can be located in the above manner. In the actual application, the vocal detection algorithm VAD distinguishes the vocal, and then the position of the person is determined according to the phase difference of the vocal waveform and the sound pressure difference, and the implementation can also be performed. By other means, for example, by using a dual camera in the mobile terminal to locate the distance or by using a single camera on the mobile terminal to perform ranging with the infrared ranging unit, the positioning can be performed, of course, by a dual camera set in the car or in the room. Or a single camera and an infrared ranging unit for positioning. In more implementations, sonar positioning is also possible.

S30. Determine a noise reduction signal according to the noise signal, the noise source location, and the user location.

In S30 of the embodiment of the present invention, the noise reduction signal is determined according to the noise signal, the noise source position, and the user position obtained in the above steps. In a possible application scenario, if there are multiple noise signals, the implementation manner of S30 may be: classifying according to the noise spectrum of the multiple noise signals, extracting one by one, and respectively determining the noise reduction signals corresponding to each noise signal. The noise reduction signal compensates the sound wave in inverse phase with the corresponding noise signal.

Optionally, as shown in FIG. 10, a schematic flowchart of determining a noise reduction signal in a noise reduction method according to an embodiment of the present invention, where the noise reduction signal is determined according to a noise signal, a noise source location, and a user position in this embodiment. The implementation manner may include the following steps, that is, S31 to S32:

S31. Calculate a delay corresponding to the noise signal according to the noise source and the three-dimensional spatial position of the user relative to the mobile terminal;

S32. Generate a noise reduction signal that is inverted from the noise signal according to the delay.

In the embodiment, after determining the three-dimensional spatial position of the noise source and the user relative to the mobile terminal, the delay of the noise corresponding to the noise signal reaching the distance of the user relative to the distance at which the mobile terminal plays the noise reduction signal reaches the user is calculated. The noise reduction signal is out of phase with the noise signal. In a possible application scenario, if there are multiple noise sources, the implementation of S31 may be: calculating that the noise corresponding to each of the plurality of noise signals reaches the user's distance and is more than the mobile terminal. The noise reduction signal reaches the corresponding delay of the user's distance.

S40. Adjust an audio signal according to the noise reduction signal to perform noise reduction on the audio signal.

In the embodiment of the present invention, according to the noise reduction signal determined by S30, in the embodiment, the mobile terminal performs playback, so that when the mobile terminal plays a noise reduction signal inverted from the noise signal and reaches the user, it may be sent out with the noise source. The arrival of the user's noise superimposed, thereby canceling, to achieve the purpose of noise reduction, effectively avoiding noise interference.

The noise reduction method provided by the embodiment of the present invention obtains an audio signal and identifies a noise signal in the audio signal; obtains a noise source position corresponding to the noise signal, and obtains a user position; according to the noise signal, the noise source location, and the user Position determining the noise reduction signal; adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal. In the above manner, the embodiment of the present invention uses the resources of the mobile terminal to determine the noise reduction signal according to the obtained audio signal, the location of the noise source, and the position of the user, thereby implementing active noise reduction on the audio signal, thereby ensuring that the user is free from noise, and A variety of environments can be applied using a mobile terminal.

FIG. 11 is a schematic flowchart diagram of another noise reduction method according to an embodiment of the present invention. The noise reduction method provided in this embodiment may include the following steps, namely, S10, S50 to S70:

Scene 1: Active noise reduction in the room:

The mobile terminal applied to the present scenario may include a CPU or GPU (ie, the controller 180 in FIG. 1) for calculation, a camera 121, and a microphone 122. In practical applications, the number of microphones in the present scenario may be, for example, three suitable positions respectively set on the mobile terminal, such as respectively located at two ends of the mobile terminal, and also configured as a microphone array as shown in FIG. Due to the softness of the related art The detection accuracy of the sound pressure level can reach 0.1DBA, and the detection accuracy of the phase difference can reach 0.1 degree. Therefore, when the position changes, the software has strong stability and does not need to change the corresponding technology. The noise source of this scene can be the noise generated by the square dance, the noise emitted by the car horn, and the like. When the user is in the room, it is very susceptible to external noise harassment. The application scenario shown in Figure 5 is as follows. At this time, the user can operate the user input unit on the mobile terminal to activate the active noise reduction function.

Scene 2: Active noise reduction in the car:

After receiving the audio signal by setting the microphone in the car, the audio signal is sent to the mobile terminal, for example, can be sent to the mobile terminal through Bluetooth or wifi, and the communication can also be performed in the implementation. The operator sends it to the mobile terminal. Thereby the mobile terminal receives the audio signal transmitted by the car and recognizes the noise signal in the audio signal.

S50: obtain a noise source position corresponding to the noise signal, and obtain a position of the user and an acoustic position.

After the noise signal in the audio signal is recognized by S10, the noise source position corresponding to the noise signal can be obtained according to the noise signal.

In addition, in the S50, the position of the user can be located in the above manner. In the actual application, the human voice is determined by the voice detection algorithm VAD, and then the position of the person is determined according to the phase difference of the voice waveform and the sound pressure difference. The positioning can also be performed by other means, for example, by positioning the two cameras in the mobile terminal or by using a single camera on the mobile terminal to cooperate with the infrared ranging unit, and of course, by setting the double in the car or the room. Camera, or single camera and infrared ranging unit for positioning. In more implementations, sonar positioning is also possible.

S60, determining a noise reduction signal according to the noise signal, the location of the noise source, the position of the user, and the position of the sound.

In the embodiment of the present invention, the noise reduction signal, the noise source position, and the user position obtained according to the above steps are determined in S60. In a possible application scenario, if there are multiple noise signals No., the implementation manner of the S60 may be: classifying according to the noise spectrum of the plurality of noise signals, extracting one by one, respectively determining the noise reduction signal corresponding to each noise signal, and the noise reduction signal is inversely compensated with the corresponding noise signal. Sound waves.

S70: Send the noise reduction signal to the audio player to perform noise reduction on the audio signal.

In the embodiment of the present invention, the noise reduction signal is sent to the audio playback according to the noise reduction signal determined by S60 to perform noise reduction on the audio signal.

The above are only the embodiments and the alternative embodiments of the present invention, and are not intended to limit the scope of the embodiments of the present invention, and the equivalent structure or equivalent process transformations made by the contents of the specification and the drawings herein, or directly or indirectly Used in other related technical fields, all of which are included in this issue. Within the scope of patent protection.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium on a corresponding hardware platform (according to The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Industrial applicability

In the technical solution provided by the embodiment of the present invention, the mobile terminal includes: a first obtaining module, configured to: obtain an audio signal, and identify a noise signal in the audio signal; and the second obtaining module is configured to: obtain the first obtaining module Identifying a noise source corresponding to the noise source position, and obtaining a user position; the determining module is configured to: determine a noise reduction signal according to the noise signal identified by the first obtaining module, and the noise source position and the user position obtained by the second obtaining module The noise reduction module is configured to: adjust the audio signal according to the noise reduction signal determined by the determining module to perform noise reduction on the audio signal. In the above manner, the embodiment of the present invention uses the resources of the mobile terminal to determine the noise reduction signal according to the obtained audio signal, the location of the noise source, and the position of the user, thereby implementing active noise reduction on the audio signal, thereby ensuring that the user is free from noise, and A variety of environments can be applied using a mobile terminal.

Claims

A mobile terminal includes:

a first obtaining module configured to: obtain an audio signal, and identify a noise signal in the audio signal;

a second obtaining module, configured to: obtain a noise source location corresponding to the noise signal identified by the first obtaining module, and obtain a user location;

a determining module, configured to: determine a noise reduction signal according to the noise signal identified by the first obtaining module, and the noise source position and the user position obtained by the second obtaining module;

The noise reduction module is configured to: adjust the audio signal according to the noise reduction signal determined by the determining module to perform noise reduction on the audio signal.
The mobile terminal according to claim 1, wherein the noise reduction signal determined by the determining module is played by the mobile terminal; the noise reduction module is further configured to: play the noise with the mobile terminal When the noise-reduced signal of the signal inversion arrives at the user, it is superimposed with the noise generated by the noise source reaching the user.
The mobile terminal of claim 1, wherein

The second obtaining module is further configured to: obtain a noise source location corresponding to the noise signal identified by the first obtaining module, and obtain a location of the user location and an audio position;

The determining module is further configured to: determine, according to the noise signal identified by the first obtaining module, the location of the noise source, the location of the user, and the location of the sound obtained by the second obtaining module Noise reduction signal;

The noise reduction module is further configured to: send the noise reduction signal determined by the determining module to the audio playback to perform noise reduction on the audio signal.
The mobile terminal according to claim 3, wherein the noise reduction module is further configured to: send the noise reduction signal to the audio playback, and reduce noise in the audio playback and the noise signal inversion When the signal arrives at the user, it is superimposed with the noise emitted by the noise source reaching the user.
The mobile terminal according to any one of claims 1 to 4, wherein the first obtaining module identifies a plurality of noise signals, and the determining module is further configured to: according to the first obtaining module And identifying a noise spectrum of the plurality of noise signals to determine a noise reduction signal corresponding to each of the noise signals, wherein the noise reduction signal is a compensation sound wave that is opposite to the corresponding noise signal.
The mobile terminal of claim 1, wherein the second obtaining module comprises:

An acquiring unit, configured to: obtain a phase difference and a sound pressure difference of the waveform corresponding to the noise signal identified by the first obtaining module;

a calculating unit, configured to: calculate a three-dimensional spatial position of the noise source corresponding to the noise signal according to the phase difference acquired by the acquiring unit and the sound pressure difference, and obtain a relative movement of the user The three-dimensional position of the terminal.
The mobile terminal of claim 6, wherein the determining module comprises:

a determining unit, configured to: calculate a delay corresponding to the noise signal according to the noise source calculated by the calculating unit and a three-dimensional spatial position of the user relative to the mobile terminal;

And a generating unit, configured to: generate a noise reduction signal that is inverted from the noise signal according to the delay calculated by the determining unit.
The mobile terminal according to claim 7, wherein the delay is a delay of the noise corresponding to the noise signal reaching a distance of the user relative to the mobile terminal or the audio playing the noise reduction signal reaching the user.
The mobile terminal of claim 7, wherein the first obtaining module identifies a plurality of noise signals, and the determining unit calculates a delay corresponding to the noise signal, comprising:

Calculating a delay of the noise corresponding to each of the plurality of noise signals reaching the user's distance relative to the mobile terminal or the audio playbook noise reduction signal reaching the user.
The mobile terminal of claim 1, wherein the first obtaining module is further configured to: receive an audio signal transmitted by the car, and identify a noise signal in the audio signal.
A noise reduction method, the method being applied to a mobile terminal, the method comprising:

Obtaining an audio signal and identifying a noise signal in the audio signal;

Obtaining a noise source location corresponding to the noise signal, and obtaining a user location;

Determining a noise reduction signal according to the noise signal, the noise source location, and the user location;

Adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal.
The method of claim 11, wherein the noise reduction signal is played by the mobile terminal; the adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal comprises:

When the mobile terminal plays the noise reduction signal inverted from the noise signal to the user, it is superimposed with the noise generated by the noise source reaching the user.
The method of claim 11, wherein the obtaining a noise source location corresponding to the noise signal and obtaining a user location comprises:

Obtaining a noise source position corresponding to the noise signal, and obtaining a position of the user and an acoustic position;

Determining the noise reduction signal according to the noise signal, the noise source location, and the user location, including:

Determining a noise reduction signal according to the noise signal, the noise source position, the user position, and the position of the sound;

Adjusting the audio signal according to the noise reduction signal to perform noise reduction on the audio signal, including:

The noise reduction signal is sent to the audio playback to denoise the audio signal.
The method of claim 13 wherein said transmitting said noise reduction signal to said audio playback to noise reduce said audio signal comprises:

Transmitting the noise reduction signal to the audio playback, and superimposing the noise that is generated by the noise source and reaching the user when the noise reduction signal that is opposite to the noise signal reaches the user.
The method according to any one of claims 11 to 14, wherein when the noise signal is plural, the determining a noise reduction signal according to the noise signal, the noise source position, and the user position includes :

And categorizing according to the noise spectrum of the plurality of noise signals, respectively determining a noise reduction signal corresponding to each of the noise signals, wherein the noise reduction signal is a compensation sound wave that is opposite to the corresponding noise signal.
The method of claim 11, wherein the obtaining a noise source location corresponding to the noise signal and obtaining a user location comprises:

Obtaining a phase difference and a sound pressure difference of the waveform corresponding to the noise signal;

And calculating, according to the phase difference and the sound pressure difference, a three-dimensional spatial position of the noise source corresponding to the noise signal with respect to the mobile terminal, and obtaining a three-dimensional spatial position of the user relative to the mobile terminal.
The method of claim 16 wherein said determining a noise reduction signal based on said noise signal, said noise source location, and a user location comprises:

Calculating a delay corresponding to the noise signal according to the noise source and a three-dimensional spatial position of the user relative to the mobile terminal;

A noise reduction signal inverted from the noise signal is generated according to the delay.
The method according to claim 17, wherein the delay is a delay in which the noise corresponding to the noise signal reaches a distance of the user relative to the distance at which the mobile terminal or the audio signal is played by the noise reduction signal reaches the user.
The method according to claim 17, wherein when the noise signal is plural, the calculating a delay corresponding to the noise signal comprises:

Calculating a delay of the noise corresponding to each of the plurality of noise signals reaching the user's distance relative to the mobile terminal or the audio playbook noise reduction signal reaching the user.
The method of claim 11 wherein said obtaining an audio signal and identifying a noise signal in said audio signal comprises:

Receiving an audio signal transmitted by the car and identifying a noise signal in the audio signal.