WO2019071491A1

WO2019071491A1 - Intelligent terminal-based sound effect distinguishing method and sound effect distinguishing system

Info

Publication number: WO2019071491A1
Application number: PCT/CN2017/105763
Authority: WO
Inventors: 杨康; 夏相声; 王周丹; 王雪蓉; 骆海涛
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-10-11
Filing date: 2017-10-11
Publication date: 2019-04-18

Abstract

Provided in the present invention are an intelligent terminal-based sound effect distinguishing method and sound effect distinguishing system, the sound effect distinguishing method comprising: when an intelligent terminal comprises two or more current sound effects, an output device of the intelligent terminal playing back a same audio using each of the current sound effects; recording a current waveform of the audio when the audio is played back using each current sound effect; comparing to see whether two or more current waveforms have the same loudness value at the same frequency point; if yes, determining that the current sound effects corresponding to the two or more current waveforms are the same; if any loudness value is not the same, determining that the current sound effects corresponding to the two or more current waveforms are different. The sound effect distinguishing system comprises: an output module, a recording module, a comparison module and a determination module. The technical solution of the present invention distinguishes among a plurality of different or similar sound effects on the basis of a change in the loudness of waveforms between different sound effects at each frequency point, which is more logical and more accurate than subjective determination.

Description

Sound effect distinguishing method based on intelligent terminal and sound effect distinguishing system

Technical field

The present invention relates to the field of intelligent terminals, and in particular, to a sound effect distinguishing method and a sound effect distinguishing system based on an intelligent terminal.

Background technique

At present, with the rapid development of intelligent terminals, the functions of intelligent terminals are increasingly rich. In today's people's lives, smart terminals are no longer limited to the function of calling, and have more functions such as taking pictures, paying, shopping, games, business, listening to music and so on. Accordingly, smart terminals have gradually replaced functions such as cameras, wallets, physical stores, game consoles, music players, and the like. In order to further optimize the experience of additional functions when users use smart terminals, the performance of all aspects of smart terminals is still improving. In order to further improve the user's listening enjoyment using the smart terminal to listen to music, the smart terminal can further increase the output of the music by introducing different sound effects.

However, in a smart terminal, users often import multiple sound effects in order to experience a variety of auditory experiences, but often there are certain repetitions in multiple sound effects, that is, there are multiple identical sound effects. At present, users can only roughly judge whether the two sound effects are the same through subjective hearing. But the method relies entirely on the individual's sensitivity to music, and for two very similar sound effects, it is difficult to distinguish only by the user's ear.

To this end, it is necessary to provide a sound-distinguishing method based on intelligent terminals and a sound-distinguishing system, which distinguishes between different or similar sound effects based on the change of the loudness of the waveform between different sound effects at each frequency point. Subjective judgment is more reasonable and more accurate.

Summary of the invention

In order to overcome the above technical deficiencies, an object of the present invention is to provide a sound effect distinguishing method and a sound effect distinguishing system based on an intelligent terminal. Compared with the prior art, the technical solution provided by the present invention distinguishes between different or similar sound effects based on the change of the loudness of the waveform between different sound effects at each frequency point, which is more reasonable than the subjective judgment. , the accuracy is higher.

The invention discloses a sound effect distinguishing method based on an intelligent terminal, and the sound effect distinguishing method comprises the following steps:

When the smart terminal includes two or more current sound effects, the output device of the smart terminal plays the same audio by using each of the current sound effects;

Recording the audio based on a current waveform when each of the current sound effects is played;

Comparing whether two or more of the current waveforms have the same loudness value at each frequency point;

When two or more of the current waveforms have the same loudness value at each of the frequency points, determining that the current sound effects corresponding to the two or more of the current waveforms are the same;

When two or more of the current waveforms have different loudness values at any of the frequency points, it is determined that the current sound effects corresponding to the two or more of the current waveforms are different.

Preferably, when the smart terminal includes two or more current sound effects, the output device of the smart terminal uses the step of playing the same audio for each of the current sound effects, and further includes:

Parsing audio data of the audio;

Obtaining sound effect parameters of each of the current sound effects;

And superimposing each of the sound effect parameters with the audio data to generate play data;

The audio of the current sound effect is played in turn according to each of the play data.

Preferably, in the step of recording the audio based on the current waveform of each of the current sound effects, the method further comprises:

Acquiring a loudness value of the audio at each frequency point based on each of the current sound effects played by an audio recorder;

The current waveform is generated according to the loudness value of each frequency point.

Preferably, the output device comprises a speaker, a speaker and/or an external audio output device connected to the smart terminal built in the smart terminal.

Preferably, when two or more of the current sound effects are the same, the smart terminal further pops up a prompt.

The present invention further provides a sound effect distinguishing system based on an intelligent terminal, the sound effect distinguishing system comprising: an output module, a recording module, a comparison module, and a judgment module;

The output module is in communication with the recording module. When the smart terminal includes two or more current sound effects, the output module plays the same audio by using each of the current sound effects;

The recording module is communicably connected to the output module and the comparison module, and records the current waveform of the audio based on each of the current sound effects;

The comparison module is connected to the recording module and the determining module to compare whether two or more of the current waveforms have the same loudness value at each frequency point;

The determining module is communicatively connected to the comparing module;

The determining module determines the current sound effect corresponding to the two or more of the current waveforms when two or more of the current waveforms have the same loudness value at each of the frequency points the same;

The determining module determines that the current sound effects corresponding to the two or more of the current waveforms are different when two or more of the current waveforms have different loudness values at any of the frequency points.

Preferably, the output module further comprises:

a parsing unit that parses audio data of the audio;

Obtaining a unit, acquiring sound effect parameters of each of the current sound effects;

a superimposing unit, which sequentially superimposes each of the sound effect parameters with the audio data to generate play data;

The playing unit sequentially plays the audio using the current sound effect according to each of the playing data.

Preferably, the recording module further comprises:

The collecting unit collects, by an audio recorder, a loudness value of the audio at each frequency point based on each of the current sound effects playing;

Generating unit, generating the current waveform according to the loudness value of each frequency point.

Preferably, the output module comprises a speaker, a speaker and/or an external audio output device connected to the smart terminal built in the smart terminal.

Preferably, the sound effect distinguishing system is further provided with a prompting module, and the prompting module is communicatively connected with the determining module;

When the determining module determines that two or more of the current sound effects are the same, the prompting module further pops up a prompt.

After adopting the above technical solution, compared with the prior art, the following beneficial effects are obtained:

Objectively determine whether there is a same sound effect between multiple sound effects to achieve a distinction between multiple sound effects;

It is judged whether the plurality of sound effects are the same sound effect by the loudness change of the audio at each frequency point, and the distinguishing method provided by the present invention is more objective and more accurate than the subjective judgment of the user.

DRAWINGS

1 is a schematic flow chart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention;

2 is a schematic flow chart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention;

3 is a schematic flow chart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention;

4 is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention.

Detailed ways

Advantages of the present invention are further explained below in conjunction with the accompanying drawings and specific embodiments.

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.

The terms used in the present disclosure are for the purpose of describing particular embodiments only, and are not intended to limit the disclosure. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

The smart terminal can be implemented in various forms. For example, the terminal described in the present invention may include a smart terminal such as a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, and the like, and such as Fixed terminal for digital TV, desktop computer, etc. In the following, it is assumed that the terminal is a smart terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

1 is a schematic flowchart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, when there are multiple sound effects in the smart terminal and the user wants to recognize whether there is a duplicate sound effect in the plurality of sound effects or whether the plurality of sound effects in the smart terminal are all valid sound effects, the sound effect is distinguished based on the sound effect in the embodiment. The method can help the user to verify the sound effect in the smart terminal. Specifically, the sound effect distinguishing method includes the following steps:

S001: When the smart terminal includes two or more current sound effects, the output device of the smart terminal plays the same audio by using each of the current sound effects;

In a preferred embodiment, the output device comprises a speaker, a speaker and/or an external audio output device connected to the smart terminal.

When the user needs to verify multiple sound effects in the smart terminal, it is necessary to enter the engineering mode of the smart terminal, and open the audio recorder in the engineering mode. After being opened, the plurality of current sound effects to be verified are sequentially applied to the same audio, and the audio data of the audio is superimposed with the sound effect data, and the audio output device of the intelligent terminal sequentially plays the same audio having the current sound effect in any smart terminal. The sound effect in this embodiment includes the sound effect of the smart terminal itself, and includes third-party sound effects, such as non-popular sound effects, soul sound effects, rap sound effects, and the like. For example, there are three current sound effects of non-popular sound effects, soul sound effects and rap sound effects in the smart terminal, in order to verify whether the three sound effects are the same. The intelligent terminal first opens the audio recorder in the engineering mode, and then the output device of the smart terminal includes a speaker, a headphone, an external speaker, etc., and one of the non-popular sound effects, the soul sound effect and the rap sound effect is respectively used for one audio A. Play in sequence.

In a preferred embodiment, the method for distinguishing sound effects provided by the present invention can be applied to an audio output device built in the smart terminal, and can also be applied to an audio output device external to the smart terminal. These include: built-in / external speakers, speakers, stereos, MP3 players and more.

S002: recording the audio based on a current waveform when each of the current sound effects is played;

After the output device of the smart terminal sequentially plays the same audio with different sound effects, the waveform change when playing the same audio with different sound effects is recorded by using the audio recorder, which is the current waveform. Among them, the current waveform has a one-to-one correspondence with the current sound effect. Each current waveform is played at each frequency point when the sound effect is played. Degree values are connected.

S003: comparing whether two or more of the current waveforms have the same loudness value at each frequency point;

According to step S002, the smart terminal obtains a plurality of current waveforms formed by the same audio after each sound effect is output. Further, comparing the plurality of current waveforms between the loudness values of each frequency point to determine whether the loudness values at the respective frequency points between the two current waveforms are the same.

S004: when two or more of the current waveforms have the same loudness value at each of the frequency points, determining that the current sound effects corresponding to the two or more current waveforms are the same;

S004': determining that the current sound effects corresponding to the two or more of the current waveforms are different when two or more of the current waveforms have different loudness values at any of the frequency points.

In this embodiment, the distinction between the plurality of current sound effects is based on using each current sound effect for the same audio output, by comparing the plurality of current waveforms formed after the output. For each of the current waveforms in this embodiment, the frequency band is the horizontal axis and the loudness value is the vertical axis. Therefore, in this embodiment, based on the loudness value at each frequency point in each current waveform as a comparison basis, it is determined whether the current sound effect corresponding to each current waveform is the same. Therefore, when the loudness values of each of the two or more current waveforms are the same, the plurality of sound effects corresponding to the two or more current waveforms are the same sound effect. On the contrary, it is a different sound effect.

In a preferred embodiment, when the current sound effects are the same, the smart terminal further pops up a prompt.

Based on the method for distinguishing sound effects provided in this embodiment, when the smart terminal determines that there are two or more identical current sound effects, the smart terminal further pops up a prompt window, and the prompt includes displaying the same name, location, and the like of the current sound effect. Information to prompt the user to have the same current sound effect.

Referring to FIG. 2, it is a schematic flowchart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, when the smart terminal includes two or more current sound effects, the output device of the smart terminal uses each of the current sound effects to play the same audio, and the sound effect is differentiated. The method further includes:

Parsing audio data of the audio;

Obtaining sound effect parameters of each of the current sound effects;

In this embodiment, when the output device of the smart terminal applies the current audio effect in the smart terminal to the same audio, and the step of playing further includes:

First, the audio in the smart terminal needs to be parsed to obtain audio data of the audio. The audio data is audio data to which a sound effect needs to be added. After the original audio data is obtained, for the sound effects to be distinguished, the distinguishing method in this embodiment may sequentially obtain the sound effect parameters of each current sound effect, including the change parameters of the audio loudness value of each frequency point. . After obtaining the sound effect parameter, the sound effect parameter is further superimposed with the audio data to output an audio using a current sound effect. There are a plurality of current sound effects in the smart terminal. Therefore, in this embodiment, in order to distinguish a plurality of current sound effects, the audio needs to be superimposed and outputted with each current sound effect. For example, when there are 3 current sound effects in the smart terminal, the audio needs to be superimposed with one current sound effect each time, and a total of three outputs are required.

Referring to FIG. 3, it is a schematic flowchart of a method for distinguishing sound effects based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the step of recording the audio based on the current waveform during each of the current sound effects playback further includes:

In this embodiment, it is further illustrated that the current waveform is a two-dimensional graph based on frequency points and loudness values. Each point in the graph corresponds to the loudness value of an output audio at each frequency point. In this embodiment, the loudness value of each output audio at each frequency point is collected by a built-in audio recorder in a smart terminal. For each one After the acquisition of the loudness value of the frequency point is completed, the current waveform of the output audio is further generated according to the collected data.

Referring to FIG. 4, it is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, when there are multiple sound effects in the smart terminal and the user wants to recognize whether there is a duplicate sound effect in the plurality of sound effects or whether the plurality of sound effects in the smart terminal are all valid sound effects, the sound effect is distinguished based on the sound effect in the embodiment. The system can help users verify the sound effects in the smart terminal. Specifically, the sound effect distinguishing system includes: an output module, a recording module, a comparison module, and a judgment module;

In a preferred embodiment, the output module includes a speaker, a speaker and/or an external audio output device connected to the smart terminal.

When the user needs to verify multiple sound effects in the smart terminal, it is necessary to enter the engineering mode of the smart terminal, and open the audio recorder in the engineering mode. After being opened, the plurality of current sound effects to be verified are sequentially applied to the same audio, the audio data of the audio is superimposed with the sound effect data, and the output module sequentially plays a plurality of the same audio using the current sound effect in any smart terminal. The sound effect in this embodiment includes the sound effect of the smart terminal itself, and includes third-party sound effects, such as non-popular sound effects, soul sound effects, rap sound effects, and the like. For example, there are three current sound effects of non-popular sound effects, soul sound effects and rap sound effects in the smart terminal, in order to verify whether the three sound effects are the same. The intelligent terminal first opens the audio recorder in the engineering mode, and then the output module sequentially plays one of the non-popular sound effects, the soul sound effect and the rap sound effect on an audio A.

In a preferred embodiment, the distinguishing sound system provided by the present invention can be applied to an output module built in the smart terminal, or can be applied to an output module externally connected to the smart terminal. These include: built-in / external speakers, speakers, stereos, MP3 players and more.

The recording module is communicably connected to the output module and the comparison module, and records the current waveform of the audio based on each of the current sound effects; the output module sequentially plays a plurality of different audios with different sound effects, and further records the module. The audio recorder in the middle records the waveform change when playing the same audio with different sound effects, which is the current waveform. Among them, the current waveform has a one-to-one correspondence with the current sound effect. Each current waveform is connected by the loudness value at each frequency point when the sound effect is played.

The comparison module is connected to the recording module and the determining module to compare whether two or more of the current waveforms have the same loudness value at the same frequency point;

Based on the recording module, the distinguishing sound effect system in this embodiment obtains a plurality of current waveforms formed by the same audio based on each sound effect output. The comparing module further compares the plurality of current waveforms between the loudness values of each frequency point, so that the determining module determines whether the loudness values at each frequency point between the two current waveforms are the same.

When two or more of the current waveforms have the same loudness value at each of the frequency points, the determining module determines that the current sound effects corresponding to the two or more of the current waveforms are the same;

When two or more of the current waveforms have different loudness values at any of the frequency points, the determining module determines that the current sound effects corresponding to the two or more of the current waveforms are different.

In this embodiment, the distinction between the plurality of current sound effects by the sound effect system is based on the output module using each current sound effect for the same audio output, and then comparing the plurality of current waveforms formed by the comparison module after the output is compared. For each of the current waveforms in this embodiment, the frequency band is the horizontal axis and the loudness value is the vertical axis. Therefore, the comparison module in this embodiment is based on the loudness value at each frequency point in each current waveform as a comparison basis, and the judging module judges the current sound effect corresponding to each current waveform based on the comparison result of the comparison module. Is it the same? Therefore, when the comparison module compares that the loudness values of each of the two or more current waveforms are the same, the determining module determines the plurality of the two or more current waveforms. The sound effects are the same. On the contrary, it is a different sound effect.

In a preferred embodiment,

The sound effect distinguishing system is further provided with a prompting module, and the prompting module is communicatively connected with the determining module;

Based on the distinguishing sound effect system provided in the embodiment, when the determining module determines that there are two or more identical current sound effects, the determining result is further sent to the prompting module through the communication connection, and the prompting module further pops up a prompt window, prompting It includes information such as the name, location, etc. that display the same current sound effect to prompt the user to have the same current sound effect.

Referring to FIG. 5, it is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the output module further includes:

a parsing unit that parses audio data of the audio;

In this embodiment, when the output module applies the current sound effects in the smart terminal to the same audio one by one, the step of playing further includes:

First, the parsing unit in the output module needs to parse the audio in the smart terminal to obtain the audio data of the audio. The audio data is audio data to which a sound effect needs to be added. After the parsing unit obtains the original audio data, for a plurality of sound effects to be distinguished, the acquiring unit may sequentially obtain the sound effect parameters of each current sound effect respectively, including the change parameters of the audio loudness value of each frequency point. . After the obtaining unit obtains the sound effect parameter, the superimposing unit further superimposes the sound effect parameter and the audio data, and finally outputs the audio using a current sound effect by the playing unit. There are a plurality of current sound effects in the smart terminal. Therefore, in this embodiment, in order to distinguish a plurality of current sound effects, the audio output by the playing unit needs to be superimposed by each of the current sound effects by the superimposing unit to be output. For example, when there are three current sound effects in the smart terminal, when the playing unit outputs the audio, the superimposing unit needs to superimpose the audio with one current sound effect each time, so the playing unit needs to output three times in total.

FIG. 6 is a schematic structural diagram of a sound effect distinguishing system based on an intelligent terminal according to an embodiment of the present invention. In this embodiment, the recording module further includes:

In this embodiment, it is further illustrated that the current waveform is a two-dimensional graph based on frequency points and loudness values. Each point in the graph corresponds to the loudness value of an output audio at each frequency point. In this embodiment, the loudness value of each output audio at each frequency point is collected by an audio recorder in the acquisition unit of the recording module. After the acquisition unit acquires the loudness value of each frequency point, the further generating unit generates a current waveform of the output audio according to the collected data.

Compared with the prior art, the technical solution provided by the present invention distinguishes between different or similar sound effects based on the change of the loudness of the waveform between different sound effects at each frequency point, which is more reasonable than the subjective judgment. , the accuracy is higher.

It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. Any modification or equivalent changes and modifications of the above embodiments in accordance with the technical spirit of the present invention are still within the scope of the technical solutions of the present invention.

Claims

A sound effect distinguishing method based on intelligent terminal, characterized in that

The sound effect distinguishing method includes the following steps:

When the smart terminal includes two or more current sound effects, the output device of the smart terminal plays the same audio by using each of the current sound effects;

Recording the audio based on a current waveform when each of the current sound effects is played;

Comparing whether two or more of the current waveforms have the same loudness value at each frequency point;

When two or more of the current waveforms have the same loudness value at each of the frequency points, determining that the current sound effects corresponding to the two or more of the current waveforms are the same;

When two or more of the current waveforms have different loudness values at any of the frequency points, it is determined that the current sound effects corresponding to the two or more of the current waveforms are different.
A sound effect distinguishing method according to claim 1, wherein

When the smart terminal includes two or more current sound effects, the output device of the smart terminal uses the step of playing the same audio for each of the current sound effects, and further includes:

Parsing audio data of the audio;

Obtaining sound effect parameters of each of the current sound effects;

And superimposing each of the sound effect parameters with the audio data to generate play data;

The audio of the current sound effect is played in turn according to each of the play data.
A sound effect distinguishing method according to claim 1, wherein

In the step of recording the audio based on the current waveform during each of the current sound effects, the method further includes:

Acquiring a loudness value of the audio at each frequency point based on each of the current sound effects played by an audio recorder;

The current waveform is generated according to the loudness value of each frequency point.
A sound effect distinguishing method according to any one of claims 1 to 3, characterized in that

The output device includes a speaker, a speaker and/or an external audio output device connected to the smart terminal.
A sound effect distinguishing method according to any one of claims 1 to 3, characterized in that

When two or more of the current sound effects are the same, the smart terminal further pops up a prompt.
A sound effect distinguishing system based on intelligent terminal, characterized in that

The sound effect distinguishing system comprises: an output module, a recording module, a comparison module, and a judgment module;

The output module is in communication with the recording module. When the smart terminal includes two or more current sound effects, the output module plays the same audio by using each of the current sound effects;

The recording module is communicably connected to the output module and the comparison module, and records the current waveform of the audio based on each of the current sound effects;

The comparison module is connected to the recording module and the determining module to compare whether two or more of the current waveforms have the same loudness value at each frequency point;

The determining module is communicatively connected to the comparing module;

The determining module determines the current sound effect corresponding to the two or more of the current waveforms when two or more of the current waveforms have the same loudness value at each of the frequency points the same;

The determining module determines that the current sound effects corresponding to the two or more of the current waveforms are different when two or more of the current waveforms have different loudness values at any of the frequency points.
A sound effect distinguishing system according to claim 6, wherein

The output module further includes:

a parsing unit that parses audio data of the audio;

Obtaining a unit, acquiring sound effect parameters of each of the current sound effects;

a superimposing unit, which sequentially superimposes each of the sound effect parameters with the audio data to generate play data;

The playing unit sequentially plays the audio using the current sound effect according to each of the playing data.
A sound effect distinguishing system according to claim 6, wherein

The recording module further includes:

The collecting unit collects, by an audio recorder, a loudness value of the audio at each frequency point based on each of the current sound effects playing;

Generating unit, generating the current waveform according to the loudness value of each frequency point.
A sound effect distinguishing system according to any one of claims 6-8, characterized in that

The output module includes a speaker, a speaker and/or an external audio output device connected to the smart terminal.
A sound effect distinguishing system according to any one of claims 6-8, characterized in that

The sound effect distinguishing system is further provided with a prompting module, and the prompting module is communicatively connected with the determining module;

When the determining module determines that two or more of the current sound effects are the same, the prompting module further pops up a prompt.