WO2017135350A1

WO2017135350A1 - Recording medium, acoustic processing device, and acoustic processing method

Info

Publication number: WO2017135350A1
Application number: PCT/JP2017/003715
Authority: WO
Inventors: 賀文水野
Original assignee: ヤマハ株式会社
Priority date: 2016-02-03
Filing date: 2017-02-02
Publication date: 2017-08-10
Also published as: JP2017139592A

Abstract

Provided is a computer-readable recording medium having recorded thereon a program for causing a computer to execute: an identifying procedure for identifying a kind of musical instrument corresponding to sound to be played, represented by an acoustic signal; and an adjusting procedure for adjusting the acoustic signal in accordance with the identified kind of musical instrument.

Description

Recording medium, sound processing apparatus, and sound processing method

The present invention relates to a technique for processing an acoustic signal.

Various techniques for processing acoustic signals have been proposed. For example, Patent Document 1 discloses a technique for processing an acoustic signal by a user specifying parameters for selecting an algorithm and parameters for selecting a waveform of an operator (FM synthesizer).

JP 2011-197429 A

However, in the technique of Patent Document 1, in order to specify parameters for processing an acoustic signal, the user needs specialized knowledge and experience regarding adjustment contents and acoustic characteristics of the acoustic signal. For users who have no experience, it is difficult to appropriately process parameters for processing acoustic signals. In view of the above circumstances, an object of the present invention is to appropriately adjust an acoustic signal without requiring specialized knowledge regarding adjustment contents and acoustic characteristics.

In order to solve the above problems, the recording medium of the present invention adjusts an acoustic signal according to a specified procedure for specifying the type of musical instrument corresponding to the performance sound represented by the acoustic signal, and the specified type of musical instrument. The program for executing the adjustment procedure is recorded.

An acoustic processing device according to a preferred aspect of the present invention includes a specifying unit that specifies a type of musical instrument corresponding to a performance sound represented by an acoustic signal, and an adjustment unit that adjusts the acoustic signal according to the type of instrument specified by the specifying unit It comprises.

The acoustic processing method according to a preferred aspect of the present invention identifies the type of musical instrument corresponding to the performance sound represented by the acoustic signal, and adjusts the acoustic signal according to the identified type of musical instrument.

1 is a configuration diagram of a sound processing apparatus according to a first embodiment of the present invention. It is explanatory drawing of a 1st process. It is a block diagram of a 1st process part. It is explanatory drawing of the process of a characteristic provision part. It is a flowchart of the process of the whole acoustic treatment apparatus. It is a block diagram of the sound processing apparatus which concerns on 2nd Embodiment of this invention. It is explanatory drawing of band information. It is explanatory drawing of priority information. It is a block diagram of a 2nd process part. It is explanatory drawing of a 2nd process. It is a display example of the parameter adjusted by the second process. It is a flowchart of the process of the whole acoustic treatment apparatus. It is a block diagram of the sound processing apparatus which concerns on 3rd Embodiment of this invention. It is explanatory drawing of priority information. It is explanatory drawing of a 3rd process. It is a display example of a parameter applied to the third process. It is a flowchart of the process of the whole acoustic treatment apparatus.

<First Embodiment>
FIG. 1 is a configuration diagram of a sound processing apparatus 100 according to the first embodiment of the present invention. As illustrated in FIG. 1, a plurality (N) of signal supply devices 12_1 to 12_N and a sound emission device 14 are connected to the sound processing device 100 of the first embodiment. The signal supply device 12_n (n = 1 to N) supplies the acoustic signal x_n to the acoustic processing device 100. The acoustic signal x_n is a time domain signal indicating the waveform of the performance sound of the musical instrument 10_n. Specifically, the signal supply device 12_n is a sound collection device that collects a performance sound of the musical instrument 10_n and generates an acoustic signal x_n. It is also possible to use, as the instrument 10_n, an electric musical instrument in which a pickup for detecting vibration of a sound source such as a string is incorporated as the signal supply device 12. Also, a playback device that acquires an acoustic signal x_n corresponding to the performance sound of the musical instrument 10_n from a portable or built-in recording medium and supplies the acoustic signal x_n to the acoustic processing device 100, or an acoustic signal corresponding to the performance sound of the musical instrument 10_n from a communication network A communication device that receives the signal x_n and supplies the signal to the sound processing device 100 may be employed as the signal supply device 12. The illustration of the A / D converter that converts the acoustic signal x_n from analog to digital is omitted for convenience.

The acoustic processing apparatus 100 according to the first embodiment includes N acoustic signals generated by adjusting each of N (N-channel) acoustic signals x_1 to x_N respectively supplied from N signal supply apparatuses 12_1 to 12_N. An acoustic signal z is generated by mixing y_1 to y_N. That is, the sound processing apparatus 100 according to the first embodiment is an N-channel mixing system. The sound emitting device 14 (for example, a speaker or headphones) emits sound waves according to the acoustic signal z generated by the sound processing device 100. Illustration of a D / A converter that converts the acoustic signal z from digital to analog, an amplifier that amplifies the acoustic signal z, and the like is omitted for convenience. In the first embodiment, the case where the acoustic signal z is supplied to the sound emitting device 14 and reproduced is illustrated, but the acoustic signal z is stored in the storage device 24 or reproduced separately from the acoustic processing device 100. It is also possible to transmit the acoustic signal z to a device or the like.

As illustrated in FIG. 1, the sound processing device 100 is realized by a computer system including an arithmetic processing device 22 and a storage device 24. The storage device 24 stores a program executed by the arithmetic processing device 22 and various data used by the arithmetic processing device 22. A known recording medium such as a semiconductor recording medium and a magnetic recording medium or a combination of a plurality of types of recording media can be arbitrarily employed as the storage device 24. A configuration in which the acoustic signal x_n is stored in the storage device 24 (therefore, the signal supply device 12_n is omitted) is also preferable.

The storage device 24 of the first embodiment stores a plurality of target characteristics R respectively corresponding to different instrument types. The type of instrument is, for example, the name of the sound source (specifically, instrument name or performance part name). In the first embodiment, instrument names such as guitar and bass drum are exemplified as the types of instruments. The target characteristic R of the first embodiment is a frequency characteristic. Specifically, the target characteristic R corresponding to any one type of musical instrument is a suitable acoustic characteristic that is a target as the characteristic of the performance sound of that type of musical instrument. The generation method of the target characteristic R is arbitrary. For example, the target characteristic R is generated by analyzing existing acoustic data recorded on a recording medium such as a music CD. It is also possible for a producer such as an acoustic engineer to manually generate the target characteristic R.

The arithmetic processing device 22 executes a program stored in the storage device 24, thereby providing a plurality of functions (specification unit 32 and adjustment unit 34) for generating the acoustic signal z from the N acoustic signals x_1 to x_N. Realize. A configuration in which each function of the arithmetic processing device 22 is distributed to a plurality of devices, or a configuration in which a dedicated electronic circuit (for example, DSP) realizes a part of the functions of the arithmetic processing device 22 may be employed.

The specifying unit 32 analyzes each of the N acoustic signals x_1 to x_N supplied from the N signal supply devices 12_1 to 12_N, respectively, and thereby the musical instrument type A_n corresponding to the performance sound represented by each acoustic signal x_n. Is identified. Specifically, the specifying unit 32 compares the feature amount analyzed from the acoustic signal x_n with each of a plurality of reference feature amounts prepared in advance for different instrument types, and a plurality of reference features. The type of musical instrument corresponding to the characteristic amount similar to the characteristic amount of the acoustic signal x_n among the characteristic amounts is specified as the type A_n of the musical instrument 10_n. As the feature quantity used for specifying the type A_n, for example, MFCC (Mel-Frequency 色 Cepstrum Coefficient) representing the tone color characteristic of the performance sound of the musical instrument is suitable. The technique described in Japanese Patent Application No. 2015-191026 and Japanese Patent Application No. 2015-191928 is employed to specify the type of musical instrument A_n. For example, a pattern recognition algorithm such as SVM (Support Vector Vector Machine) can be used to specify the type A_n.

The adjusting unit 34 generates the acoustic signal z by adjusting each acoustic signal x_n according to the instrument type A_n specified by the specifying unit 32. The adjustment unit 34 of the first embodiment includes N first processing units 341_1 to 341_N corresponding to the N acoustic signals x_1 to x_N, respectively, and a mixing unit 343. As illustrated in FIG. 2, the first processing unit 341 </ b> _n performs first processing for bringing the frequency characteristic X_n (solid line) of the acoustic signal x_n closer to the target characteristic R (dotted line) corresponding to the instrument type A_n specified by the specifying unit 32. Is performed on the acoustic signal x_n.

FIG. 3 is a configuration diagram of an arbitrary first processing unit 341_n. The first processing unit 341_n includes a frequency analysis unit 40, a characteristic imparting unit 50, and a waveform generation unit 60, and generates the acoustic signal y_n by executing a first process on the acoustic signal x_n. That is, the acoustic signal y_n has an acoustic characteristic close to the target characteristic R corresponding to the musical instrument type A_n.

The frequency analysis unit 40 in FIG. 3 analyzes the acoustic signal x_n supplied from the signal supply device 12_n, thereby sequentially obtaining the frequency characteristics (frequency spectrum) X_n of the acoustic signal x_n for each unit section (frame) on the time axis. To generate. For the calculation of the frequency characteristic X_n, a known frequency analysis such as a short-time Fourier transform can be arbitrarily employed. Note that it is also possible to use a series (filter bank) of a plurality of bandpass filters having different passbands as the frequency analysis unit 40.

The characteristic imparting unit 50 brings the frequency characteristic X_n of the acoustic signal x_n closer to the target characteristic R corresponding to the instrument type A_n identified by the identifying unit 32, so that the frequency characteristic (frequency spectrum) Y_n of the acoustic signal y_n is a unit interval. It generates sequentially every time.

FIG. 4 is an explanatory diagram of the processing of the characteristic assigning unit 50. Specifically, as illustrated in FIG. 4, the characteristic assigning unit 50 executes, as a first process, an equalizing process that brings the frequency characteristic X_n of the acoustic signal x_n closer to the target characteristic R using a plurality of bandpass filters having different characteristics. To do. The characteristics of each bandpass filter are defined by parameters such as a frequency point (for example, center frequency), a gain, and a Q value. The characteristic assigning unit 50 calculates each parameter of the plurality of bandpass filters so that the frequency characteristic X_n approaches the target characteristic R, and then applies each bandpass filter to the frequency characteristic X_n so that the frequency characteristic of the acoustic signal y_n is obtained. Y_n is generated. The total number of band pass filters is arbitrary. If the total number is increased, the ability to adjust the acoustic signal x_n is improved, but the processing load of the adjustment unit 34 (characteristic imparting unit 50) and, consequently, the processing load of the entire acoustic processing apparatus 100 increase. I am trying. It is also possible to variably control the total number of band pass filters.

3 generates a time-domain acoustic signal y_n from the frequency characteristic Y_n generated by the characteristic applying unit 50 for each unit section. Short-time inverse Fourier transform is preferably used for generating the acoustic signal y_n.

1 mixes the acoustic signal y_n generated by each first processing unit 341_n (waveform generation unit 60) to generate the acoustic signal z. That is, an acoustic signal z representing a mixed sound of performance sounds of N different types of N musical instruments 10_1 to 10_N is generated. The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N.

FIG. 5 is a flowchart of processing of the entire sound processing apparatus 100. The process in FIG. 5 is started when the performer starts playing a musical instrument (for example, a bass drum). The first processing unit 341_n acquires the acoustic signal x_n generated by collecting the performance sound of the bass drum (SA1). The identifying unit 32 identifies, for each of the N acoustic signals x_1 to x_N, the musical instrument type A_n corresponding to the performance sound represented by the acoustic signal x_n (SA2). For example, the type “bass drum” is specified by the analysis of the acoustic signal x_2 generated by the musical instrument 10_2, and the type “base” is specified by the analysis of the acoustic signal x_3 generated by the musical instrument 10_3. The first processing unit 341_n (frequency analysis unit 40) sequentially generates a frequency characteristic (frequency spectrum) X_n of each acoustic signal x_n for each unit section (frame) on the time axis by analyzing each acoustic signal x_n ( SA3). The first processing unit 341_n (characteristic imparting unit 50) executes a first process that brings each frequency characteristic X_n of the acoustic signal x_n closer to the target characteristic R corresponding to the instrument type A_n (bass drum) identified by the identifying unit 32. Thus, the frequency characteristic (frequency spectrum) Y_n of each acoustic signal y_n is sequentially generated for each unit section (SA4). The first processing unit 341_n (waveform generating unit 60) generates a time domain acoustic signal y_n from each frequency characteristic Y_n generated by the characteristic providing unit 50 (SA5). That is, an acoustic signal y_n having a frequency characteristic Y_n close to the frequency characteristic represented by the target characteristic R of the instrument type A_n (bass drum) is generated. The adjustment unit 34 (mixing unit 343) generates the acoustic signal z by mixing the acoustic signals y_n generated by the first processing units 341_n (SA6). The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N (SA7).

As understood from the above description, the acoustic signal x_n is adjusted according to the musical instrument type A_n specified by the specifying unit 32. Therefore, it is possible to appropriately adjust the acoustic signal x_n without requiring specialized knowledge regarding the adjustment content and the acoustic characteristics as compared with the configuration in which the user specifies the adjustment content for the acoustic signal x_n. In the first embodiment, in particular, the characteristics of each bandpass filter are controlled so that the frequency characteristic X_n of the acoustic signal x_n approaches the target characteristic R (according to the difference between the two). Therefore, when the acoustic signal x_n is already close to the target characteristic R as compared with the configuration in which the characteristics of the filter that processes the acoustic signal x_n are fixed (configuration that does not depend on the frequency characteristic X_n of the acoustic signal x_n), the acoustic signal x_n The degree of adjustment is reduced. That is, it is possible to bring the acoustic signal x_n closer to the target characteristic R while making use of the frequency characteristic X_n of the original acoustic signal x_n.

Second Embodiment
A second embodiment of the present invention will be described. In addition, about the element which an effect | action and a function are the same as that of 1st Embodiment in each form illustrated below, the code | symbol used by description of 1st Embodiment is diverted, and each detailed description is abbreviate | omitted suitably.

FIG. 6 is a configuration diagram of the sound processing apparatus 100 according to the second embodiment. The adjustment unit 34 of the second embodiment has a configuration in which a second processing unit 345 is added to a plurality (N) of first processing units 341_1 to 341_N and a mixing unit 343 similar to those of the first embodiment. As in the first embodiment, the first processing unit 341_n generates the acoustic signal y_n through the first processing on the acoustic signal x_n. The second processing unit 345 generates an acoustic signal w_n from the acoustic signal y_n processed by each first processing unit 341_n. The mixing unit 343 generates the acoustic signal z by mixing the N acoustic signals w_1 to w_N processed by the second processing unit 345.

The storage device 24 of the second embodiment stores target characteristics R, band information T, and priority information P1. The target characteristic R is the same as that in the first embodiment. FIG. 7 is an explanatory diagram of the band information T. The band information T designates a frequency band (hereinafter referred to as “sound generation band”) of an acoustic component that is predominantly included in the performance sound of the musical instrument of type A_n. Specifically, as illustrated in FIG. 7, the band information T specifies any one of “low band”, “middle band”, and “high band” as the sound generation band. For example, when the instrument type A_n is “bass”, the sounding band corresponding to “bass” is “low range”.

FIG. 8 is an explanatory diagram of the priority information P1. The priority information P1 specifies the priority for each type of musical instrument for each of the plurality of bands B1 to BM on the frequency axis. Specifically, as illustrated in FIG. 8, the priority information P1 specifies the priority with an integer, for example. For example, in the band B1, the priority is designated as “keyboard = 1, bass drum = 3, bass = 4, guitar = 2,...”, So “...> bass> bass drum> guitar> keyboard ...”. And the priority is high. The bandwidth and total number of each of the bands B1 to BM are arbitrary. For example, a plurality of bands B1 to BM can be made into three bands B1 to B3, and each band B1 to B3 can correspond to each of the sound generation bands “low range”, “middle range”, and “high range” indicated by the band information T. is there.

The second processing unit 345 includes an acoustic signal y_n1 (example of the first acoustic signal) and an acoustic signal y_n2 in which the sound generation bands corresponding to the instrument type A_n identified by the identifying unit 32 among the N acoustic signals y_1 to y_N. (Exemplary second acoustic signal) For (n1 ≠ n2), the second process of suppressing one acoustic component of the acoustic signal y_n1 and the acoustic signal y_n2 relative to the other is performed with respect to one acoustic signal y_n (acoustic The acoustic signal w_n1 or the acoustic signal w_n2 is generated by executing the signal y_n1 or the acoustic signal y_n2). The acoustic signal y_n1 and the acoustic signal y_n2 correspond to different channels.

FIG. 9 is a configuration diagram of the second processing unit 345. The second processing unit 345 includes a frequency analysis unit 70, a suppression unit 80, and a waveform generation unit 90. The frequency analysis unit 70 analyzes the acoustic signal y_n generated by each first processing unit 341_n, so that the frequency analysis unit 40 generates the frequency characteristic Y_n of the acoustic signal y_n in the same manner as the frequency analysis unit 40 generates the frequency characteristic X_n. Generated sequentially for each upper unit section. The frequency characteristic Y_n generated by the characteristic applying unit 50 of each first processing unit 341_n is supplied to the suppression unit 80 (therefore, the frequency analysis of the waveform generating unit 60 and the second processing unit 345 of each first processing unit 341_n). (It is omitted from the section 70).

When the sound generation band corresponding to the instrument type A_n identified by the identifying unit 32 overlaps between the acoustic signal y_n1 and the acoustic signal y_n2 (for example, both are “low range”), the suppressing unit 80 By performing the second process on y_n1 or the acoustic signal y_n2, the frequency characteristic W_n1 of the acoustic signal w_n1 or the frequency characteristic W_n2 of the acoustic signal w_n2 is sequentially generated for each unit section. In the second embodiment, the frequency characteristic W_n1 of the acoustic signal w_n1 is generated by executing the second process on the acoustic signal y_n1 that is one of the acoustic signal y_n1 and the acoustic signal y_n2 whose sound generation bands overlap each other. The configuration is illustrated. The acoustic signal y_n2 and the acoustic signals y_n of the musical instruments whose sound generation bands do not overlap with other musical instruments are supplied as they are as the acoustic signals w_n from the second processing unit 345 to the mixing unit 343.

Specifically, the suppression unit 80 selects the acoustic component corresponding to the instrument type with the lower priority among the acoustic signals y_n1 and y_n2 with the sound generation bands overlapping each other, and the acoustic component corresponding to the instrument type with the higher priority. The second process for suppressing relative to the component is performed for each of the bands B1 to BM with respect to the frequency characteristic Y_n1 of the acoustic signal y_n1. In the second process, a known technique can be arbitrarily employed for the process of adjusting the frequency characteristic Y_n1 of the acoustic signal y_n1. For example, an equalizing process for adjusting the gain of the frequency characteristic Y_n1 for each of the bands B1 to BM by using a plurality of bandpass filters having different characteristics. The characteristics of each bandpass filter are defined by parameters such as a frequency point (for example, center frequency), a gain, and a Q value. The suppression unit 80 calculates each parameter of the plurality of bandpass filters so that the frequency characteristic Y_n1 is suppressed, and generates the frequency characteristic W_n1 of the acoustic signal w_n by applying each bandpass filter to the frequency characteristic Y_n1. To do.

The frequency characteristic W_n1 generated in the second process for the frequency characteristic Y_n1 of the acoustic signal y_n1 whose sound generation band overlaps with another musical instrument is output to the waveform generation unit 90, and the frequency characteristic Y_n of the other acoustic signal y_n is the frequency. It is output to the waveform generator 90 as the characteristic W_n. The waveform generation unit 90 generates a time domain acoustic signal w_n from the frequency characteristic W_n generated by the suppression unit 80 for each unit section. Short-time inverse Fourier transform is preferably used for generating the acoustic signal w_n.

FIG. 10 is an explanatory diagram of the second process. When the sound generation band overlaps between the acoustic signal y_n1 and the acoustic signal y_n2 (that is, when the band information T_n1 of the instrument type A_n1 and the band information T_n2 of the instrument type A_n2 are the same), the suppression unit 80 sets the priority information P1. The second process is performed with reference to. As illustrated in FIG. 10, the second process suppresses or emphasizes the acoustic components of the bands B1 to BM of the acoustic signal y_n1 according to the level of the priority of the acoustic signal y_n1 and the priority of the acoustic signal y_n2. It is processing. Specifically, in the band B1 where the priority of the musical instrument type A_n1 is lower than the priority of the musical instrument type A_n2, the acoustic component of the acoustic signal y_n1 is suppressed by adjusting the frequency characteristic Y_n1. On the other hand, in the band B2 and the band B3 in which the priority of the musical instrument type A_n1 exceeds the priority of the musical instrument type A_n2, the acoustic component of the acoustic signal y_n1 is emphasized by adjusting the frequency characteristic Y_n1. That is, the frequency characteristic Y_n2 is suppressed with respect to the frequency characteristic Y_n1. That is, relative suppression of an acoustic component (frequency characteristic) includes a case where one acoustic component is suppressed with respect to the other acoustic component, and a case where the other acoustic component is emphasized with respect to one acoustic component. Includes both.

As understood from the above description, even when the sound generation bands overlap between the musical instrument type A_n1 and the musical instrument type A_n2, the frequency characteristic W_n1 generated from the frequency characteristic Y_n1 by the second processing corresponding to the musical instrument type A_n1. The frequency characteristic in one of the frequency characteristics Y_n2 corresponding to the instrument type A_n2 is suppressed relatively to the other. The peak of the frequency characteristic Y_n1 and the peak of the frequency characteristic Y_n2 are close to each other on the frequency axis before the execution of the second process. However, as a result of the second process, both peaks are mutually on the frequency axis. Move to a position shifted to. For example, when the second process is performed by an equalizer (for example, a graphic equalizer or a parametric equalizer), the gain corresponding to each band B1 to BM is adjusted according to the priority information P1, and as illustrated in FIG. The gain corresponding to each band B1 to BM of the signal y_n1 can be displayed on the display device (not shown) of the sound processing device 100 so that the user can visually grasp the gain. As understood from the above description, when the arithmetic processing unit 22 executes the program stored in the storage device 24, the parameters (B1 to BM) of the respective bands B1 to BM adjusted according to the priority information P1 by the second processing ( For example, a function of displaying a gain or a Q value on a display device is realized.

The mixing unit 343 in FIG. 6 generates the acoustic signal z by mixing the N acoustic signals w_1 to w_N generated by the second processing unit 345 (the suppressing unit 80). That is, an acoustic signal z representing a mixed sound of performance sounds of N different types of N musical instruments 10_1 to 10_N is generated. The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N.

FIG. 12 is a flowchart of processing of the entire sound processing apparatus 100 according to the second embodiment. The process shown in FIG. 12 is started when each performer starts playing a musical instrument (for example, bass drum and bass). The process from the process (SA1) for acquiring the acoustic signal x_n by the first processing unit 341_n to the process (SA5) for generating the acoustic signal y_n is the same as in the first embodiment. In the process (SA2) for specifying the type A_n of the instrument, for example, the type “bass drum” is specified from the analysis of the acoustic signal x_2 generated by the instrument 10_2, and “bass” is determined from the analysis of the acoustic signal x_3 generated by the instrument 10_3. Is specified. Note that the sound generation band of the musical instrument “bass drum” indicated by the type A_2 and the sound generation band of the musical instrument “bass” indicated by the type A_3 are both “low frequency”, and the other (N−2) types A_na (na The instruments indicated by ≠ 2, 3) do not include instruments with the same tone band.

The second processing unit 345 (frequency analysis unit 70) sequentially generates the frequency characteristic Y_n of each acoustic signal y_n generated by the first processing unit 341_n for each unit section (SB1). The second processing unit 345 (suppression unit 80) performs the second process with reference to the priority information P1 for the frequency characteristic Y_2 corresponding to one of the types A_2 and A_3 of the musical instruments having the same sound generation band. By executing this, the frequency characteristic W_2 is sequentially generated for each unit section, and the frequency characteristic Y_3 and the frequency characteristic Y_n of the acoustic signal y_n of the musical instrument whose sound generation band does not overlap with other musical instruments are output as the frequency characteristic W_n as it is ( SB2). Therefore, even when the sound generation band overlaps between the musical instrument “bass drum” indicated by the type A_2 and the musical instrument “bass” indicated by the type A_3, the frequency characteristics W_2 corresponding to the type A_2 (bass drum) and the type A_3 (bass) One of the corresponding frequency characteristics Y_3 is suppressed relative to the other. The second processing unit 345 (waveform generation unit 90) generates a time domain acoustic signal w_n from the frequency characteristic W_n generated by the suppression unit 80 (SB3). The adjustment unit 34 (mixing unit 343) generates the acoustic signal z by mixing the N acoustic signals w_1 to w_N generated by the second processing unit 345 (SA6). The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N (SA7). Note that for the acoustic signal y_na corresponding to the type A_na indicating a musical instrument other than the musical instruments (bass drum and bass) having the same sound generation band, the processing of steps SB1 to SB3 can be omitted and the acoustic signal w_na can be supplied as it is. (SA6).

In the second embodiment, the same effect as in the first embodiment can be obtained. Particularly in the second embodiment, when the frequency band corresponding to the type of instrument specified by the specifying unit 32 overlaps between the acoustic signal y_n1 and the acoustic signal y_n2, the frequency band in one of the acoustic signal y_n1 and the acoustic signal y_n2 The acoustic signal w_n1 is generated so that the acoustic component is suppressed relative to the other. Therefore, there is an advantage that the performance sound corresponding to the other acoustic component can be easily heard with respect to the performance sound corresponding to the relatively suppressed acoustic component. Further, since the second process is performed with reference to the priority information P1, it is possible to appropriately adjust the acoustic signal y_n1, that is, generate the acoustic signal w_n1.

<Third Embodiment>
FIG. 13 is a configuration diagram of the sound processing apparatus 100 according to the second embodiment. The adjustment unit 34 of the third embodiment has a configuration in which a third processing unit 347 is added to a plurality (N) of first processing units 341_1 to 341_N and a mixing unit 343 similar to those of the first embodiment. As in the first embodiment, the first processing unit 341_n generates the acoustic signal y_n through the first processing on the acoustic signal x_n. The third processing unit 347 generates an acoustic signal v_n from the acoustic signal y_n processed by each first processing unit 341_n. The mixing unit 343 generates the acoustic signal z by mixing the N acoustic signals v_1 to v_N processed by the third processing unit 347.

The storage device 24 of the third embodiment stores target characteristics R, band information T, and priority information P2. The target characteristic R is the same as in the first embodiment, and the band information T is the same as in the second embodiment. FIG. 14 is an explanatory diagram of the priority information P2. As illustrated in FIG. 14, the priority information P <b> 2 is for each instrument type A_n for each of a plurality of sound generation bands (specifically, “low range”, “mid range”, “high range”) indicated by the band information T. Specify the priority. Specifically, the priority information P2 specifies the priority with an integer, for example, as in the case of the priority information P1 of the second embodiment.

The third processing unit 347 overlaps the sound generation bands corresponding to the instrument type A_n specified by the specifying unit 32 among the N sound signals y_1 to y_N (for example, both are “low range”). For the first acoustic signal) and the acoustic signal y_n2 (second acoustic signal) (n1 ≠ n2), one of the acoustic signal y_n1 and the acoustic signal y_n2 has a relative acoustic component that overlaps the other on the time axis. The acoustic signal v_n1 or the acoustic signal v_n2 is generated by executing the third process to be suppressed. The acoustic signal y_n1 and the acoustic signal y_n2 correspond to different channels.

Specifically, the third processing unit 347 performs a third process for suppressing the acoustic signal corresponding to the instrument type having a low priority relative to the acoustic signal corresponding to the instrument type having a high priority. Is performed with reference to the priority information P2 with respect to the acoustic signal y_n1 or the acoustic signal y_n2. In the third embodiment, among the acoustic signals y_n1 and y_n2, an acoustic signal having a low priority indicated by the priority information P2 is suppressed as a target of the third process. For example, when the sound band of the type A_n1 corresponding to the sound signal y_n1 is the same as the sound band of the type A_n2 corresponding to the sound signal y_n2 in the “low range”, the priority of the sound signal y_n is the priority shown in FIG. Reference is made to the priorities represented by the types A_n1 and A_n2 in the sound generation band “low range” of the information P2. In 3rd Embodiment, the structure which produces | generates acoustic signal v_n1 by performing a 3rd process with respect to acoustic signal y_n1 with a low priority is illustrated. Note that the acoustic signal y_n2 and the acoustic signals y_n of the musical instruments whose sound generation bands do not overlap with other musical instruments are supplied as they are to the mixing unit 343 as the acoustic signals v_n.

FIG. 15 is an explanatory diagram of the third process. As described above, the third process is a process of relatively suppressing the acoustic signal y_n1 that overlaps the other of the acoustic signal y_n1 and the acoustic signal y_n2 on the time axis. When one of the acoustic signal y_n1 and the acoustic signal y_n2 overlaps with the other on the time axis, the time waveform peak of the acoustic signal y_n1 and the peak of the time waveform of the acoustic signal y_n2 are time axis as illustrated in FIG. This is a case where they overlap each other. The case where the peaks overlap includes, for example, a case where both peaks are coincident on the time axis and a case where both peaks are located within a predetermined period on the time axis. When the peaks of the time waveforms overlap each other, the performance sound represented by the acoustic signal y_n1 and the performance sound represented by the acoustic signal y_n2 are pronounced at the same time, and it tends to be difficult for the listener to hear both performance sounds. . As a case where the performance sound represented by the acoustic signal y_n1 and the performance sound represented by the acoustic signal y_n2 are simultaneously pronounced, for example, the performance sound of a stringed instrument that continuously plays over the music (that is, the sound generation period is long), and the music Assume that the performance sound of a percussion instrument that plays completely at a specific point in the middle (that is, the sound generation period is short) is simultaneously sounding. As understood from the above description, the third process is the same as the sound generation band of the type A_n1 corresponding to the sound signal y_n1 and the sound generation band of the type A_n2 corresponding to the sound signal y_n2, and the time waveform of the sound signal y_n1. And the peak of the time waveform of the acoustic signal y_n2 overlap each other on the time axis.

A well-known technique can be arbitrarily employed for the third process for suppressing the acoustic signal y_n1. For example, a compressor process that compresses the signal level of the acoustic signal y_n1 is a good example of the third process. As illustrated in FIG. 15, by compressing a portion where the signal level of the acoustic signal y_n1 exceeds the threshold Z, the acoustic component of the acoustic signal y_n1 is relatively suppressed with respect to the acoustic signal y_n2. Although the compression rate (ratio) with respect to the signal level of the acoustic signal y_n1 in the third processing is arbitrary, for example, a configuration that compresses the signal level to the threshold Z (that is, compression rate ∞: 1), or a type corresponding to the acoustic signal y_n1 A configuration in which the compression rate is set according to A_n1 may be employed. The threshold value Z is selected experimentally or statistically. Note that in a section where the signal level of the acoustic signal y_n1 is lower than the threshold Z, the acoustic signal y_n1 is supplied to the mixing unit 343 as the acoustic signal v_n1. In addition, for example, a configuration in which the third process is performed on the acoustic signal y_n1 when the signal level of the acoustic signal y_n1 exceeds the signal level of the acoustic signal y_n2 can be suitably employed.

As understood from the above description, even when the sound generation band overlaps between the musical instrument type A_n1 and the musical instrument type A_n2, the acoustic signal y_n1 overlapping the acoustic signal y_n2 on the time axis is relative to the acoustic signal y_n2. Is suppressed. The third processing unit 347 generates the acoustic signal v_n1 by compressing the acoustic component exceeding the threshold in the acoustic signal y_n1 as illustrated in FIG. 15 by performing compressor processing (third processing) on the acoustic signal y_n1. To do. As illustrated in FIG. 16, the threshold value (Threshold) Z and the compression ratio (Ratio) used in the compressor processing for the acoustic signal y_n1 are visually displayed on the display device (not shown) of the acoustic processing device 100 by the user. It is also possible to display it so that it can be grasped. In FIG. 16, in addition to the numerical values of the threshold value Z and the compression rate, a graph showing the relationship between before and after the compressor processing (input / output) is illustrated. As understood from the above description, the arithmetic processing device 22 executes the program stored in the storage device 24, thereby causing the display device to display parameters (for example, the threshold value Z and the compression rate) applied to the third processing. Function is realized.

The mixing unit 343 in FIG. 13 generates the acoustic signal z by mixing the N acoustic signals w_1 to w_N generated by the third processing unit 347. That is, an acoustic signal z representing a mixed sound of performance sounds of N different types of N musical instruments 10_1 to 10_N is generated. The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N.

FIG. 17 is a flowchart of processing of the entire sound processing apparatus 100 according to the third embodiment. The process shown in FIG. 17 is started when each player performs a musical instrument (for example, bass drum and bass). The process from the process (SA1) for acquiring the acoustic signal x_n by the first processing unit 341_n to the process (SA5) for generating the acoustic signal y_n is the same as in the first embodiment. In the process (SA2) for specifying the type A_n of the instrument, for example, the type “bass drum” is specified from the analysis of the acoustic signal x_2 generated by the instrument 10_2, and “bass” is determined from the analysis of the acoustic signal x_3 generated by the instrument 10_3. Is specified. Note that the sound generation band of the musical instrument “bass drum” indicated by the type A_2 and the sound generation band of the musical instrument “bass” indicated by the type A_3 are both “low frequency”, and the priority in the “low frequency” indicated by the priority information P2 Is higher than the priority of “bass drum” indicated by the type A_2. It is assumed that instruments of the other (N-2) types A_na (na ≠ 2, 3) do not include instruments of the same tone generation band.

The third processing unit 347 generates the acoustic signal v_2 by performing the third process on the acoustic signal y_2 corresponding to one of the types A_2 and A_3 of the musical instruments having the same sound generation band, and generates the acoustic signal v_2. The signal y_3 and the sound signal y_na of the musical instrument whose sound generation band does not overlap with other musical instruments are directly output as the sound signal v_na (SC1). As understood from the above description, even when the sound generation band overlaps between the musical instrument “bass drum” indicated by the type A_2 and the musical instrument “bass” indicated by the type A_3, the acoustic signal y_2 overlapping the acoustic signal y_3 on the time axis. Is suppressed relative to the acoustic signal y_3. The adjustment unit 34 (mixing unit 343) generates the acoustic signal z by mixing the N acoustic signals w_1 to w_N generated by the third processing unit 347 (SA6). The sound emitting device 14 emits sound according to the acoustic signal z, that is, sound according to the performance sounds of the N musical instruments 10_1 to 10_N (SA7).

In the third embodiment, the same effect as in the first embodiment can be obtained. Particularly in the third embodiment, when the frequency band corresponding to the instrument type A_n specified by the specifying unit 32 overlaps between the acoustic signal y_n1 and the acoustic signal y_n2, the acoustic signal y_n1 that overlaps the acoustic signal y_n2 on the time axis. Is relatively suppressed. Therefore, there is an advantage that the performance sound corresponding to the acoustic signal y_n2 including the other acoustic component can be easily heard with respect to the performance sound corresponding to the acoustic signal y_n1 including the relatively suppressed acoustic component. Further, since the third process is performed with reference to the priority information P2, it is possible to appropriately adjust the acoustic signal y_n1, that is, generate the acoustic signal v_n1.

<Modification>
Each form illustrated above can be variously modified. Specific modifications are exemplified below. Two or more modes arbitrarily selected from the following examples can be appropriately combined.

(1) In each of the embodiments described above, the musical instrument type A_n is identified by analyzing the acoustic signal x_n corresponding to the musical instrument 10_n, but the identifying method of the musical instrument type A_n is not limited to the analysis of the acoustic signal x_n. For example, the specifying unit 32 detects an operation (for example, an operation for selecting a musical instrument from a plurality of candidates) in which the user uses the input device to specify a musical instrument, and specifies the type A_n of the musical instrument instructed by the operation. . In this case, the specifying unit 32 is an operating device capable of instructing the sound processing apparatus 100 to specify the musical instrument type A_n by a user operation. According to the above-described embodiments in which the instrument type A_n is specified by analyzing the acoustic signal x_n, the burden on the user is reduced as compared with the configuration in which the instrument type A_n is directly specified by a user instruction. Is possible. Further, there is an advantage that the instrument type A_n can be specified even when the user does not recognize the instrument type corresponding to the performance sound.

(2) In each of the above-described embodiments, the first process, the second process, and the third process are exemplified as the process according to the instrument type A_n specified by the specifying unit 32. However, the adjustment unit 34 adjusts the acoustic signal. Is not limited to the above examples. In other words, the content of the process is arbitrary as long as it is a process of adjusting the acoustic signal corresponding to the instrument type A_n specified by the specifying unit 32. Therefore, for example, a configuration in which the adjustment unit 34 performs both the second processing and the third processing after the first processing, or a configuration in which each of the second processing and the third processing is performed independently may be employed. .

(3) In each of the above-described embodiments, the configuration in which the instrument name is the type of the instrument is illustrated, but the instrument type is not limited to the instrument name. The type of musical instrument is arbitrary as long as it is information indicating what kind of sound the performance sound represented by the acoustic signal is, for example, the presence or absence of harmonicity (whether there is a harmonic structure in the performance sound) Information) indicating the sound generation band (any one of “low range”, “middle range”, and “high range”) may be used as the instrument type.

(4) In each of the embodiments described above, the configuration in which the acoustic signal x_n is adjusted according to the musical instrument type A_n identified by the identifying unit 32 is exemplified, but the reliability of the musical instrument type A_n is added to the adjustment of the acoustic signal x_n. It is also possible. The reliability is the accuracy of the instrument type A_n specified by the specifying unit 32 (accuracy of the identification result). For example, the similarity (for example, distance or correlation) with the feature amount of the acoustic signal x_n is calculated for each of a plurality of feature amounts prepared in advance for different instrument types, and the similarity is high (distance is small or correlated). In the configuration in which the instrument type A_n is specified for the acoustic signal x_n, the specifying unit 32 sets the reliability of the identification result according to the similarity. For example, a configuration using the similarity as the reliability, or a configuration for calculating the reliability by a predetermined calculation using the similarity is illustrated.

The adjusting unit 34 controls the degree of adjustment of the acoustic signal x_n according to the reliability of the instrument type A_n specified by the specifying unit 32. For example, the adjustment unit 34 may be configured such that the higher the reliability of the type A_n specified for the acoustic signal x_n, the higher the degree of adjustment for the acoustic signal x_n (or the lower the degree of adjustment, the lower the degree of adjustment). The degree of adjustment of the acoustic signal x_n is controlled. In the above configuration, the adjustment of the acoustic signal x_n is suppressed according to the reliability of the result of specifying the instrument type A_n. Therefore, for example, when the reliability of the musical instrument type A_n is high, priority is given to the addition of acoustic characteristics suitable for the musical instrument, while the reliability of the musical instrument type A_n is low (the identification result of the type A_n is erroneous). If the possibility is assumed), the acoustic characteristic prepared for the musical instrument is not necessarily valid for the acoustic signal x_n, so that the addition of the acoustic characteristic is suppressed. Appropriate adjustment according to the specific result can be realized. Similarly, in the second embodiment and the third embodiment, reliability can be added to the adjustment of the acoustic signal y_n in addition to the acoustic signal x_n.

(5) In the second embodiment, the second process is performed on the acoustic signal y_n1 which is one of the acoustic signal y_n1 and the acoustic signal y_n2 whose sound generation bands overlap each other. It is not limited to y_n1. For example, the second process may be performed on the acoustic signal y_n2, or the second process may be performed on both the acoustic signal y_n1 and the acoustic signal y_n2. It is also possible to change the acoustic signal y_n for performing the second process for each of the bands B1 to B3. As understood from the above description, if the processing is to suppress the acoustic component corresponding to the instrument type with low priority relative to the acoustic component corresponding to the instrument type with high priority, The target of two processes is arbitrary. Similarly, in the third embodiment, the target of the third process is arbitrary.

In the second embodiment and the third embodiment, in the process of suppressing one acoustic component A of the acoustic signal y_n1 and the acoustic signal y_n2 relative to the other acoustic component B, the acoustic component A is used as the acoustic component. In addition to processing for suppressing B, processing for enhancing the acoustic component B with respect to the acoustic component A is also included.

(6) In the second embodiment, the configuration in which the second process is performed when the frequency band of the acoustic signal y_n1 and the frequency band of the acoustic signal y_n2 are illustrated, but the frequency bands of three or more acoustic signals y_n overlap. Similarly, it is possible to perform the second process. For example, the suppressing unit 80 performs the second process on one or more of the three acoustic signals y_n (acoustic signal y_n1, acoustic signal y_n2, and acoustic signal y_n3). The suppression unit 80 makes relative the acoustic components corresponding to the other two musical instrument types relative to the acoustic component corresponding to the musical instrument type having the highest priority, for example, among the acoustic signal y_n1, the acoustic signal y_n2, and the acoustic signal y_n3. The second process is performed to suppress the failure. Similarly, in the third embodiment, it is possible to execute the third process even when the frequency bands of three or more acoustic signals y_n overlap.

(7) In each of the above-described embodiments, the configuration in which the acoustic processing device 100 is separate from the musical instrument 10_n is illustrated. However, the configuration in which the acoustic processing device 100 is mounted on the musical instrument 10_n (that is, the musical instrument 10_n and the acoustic processing device 100). Can be suitably employed.

(8) The sound processing device 100 exemplified in each of the above-described embodiments is suitably realized by the cooperation of the arithmetic processing device 22 and the program as described above. Specifically, the program according to a preferred aspect of the present invention causes the computer to specify a specific procedure for specifying the musical instrument type A [n] corresponding to the performance sound represented by the acoustic signal, and the specified musical instrument type A [n. ], The adjustment procedure for adjusting the acoustic signal is executed. This program can be provided in a form stored in a computer-readable recording medium and installed in the computer. The recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disk) such as a CD-ROM is a good example, but a known arbitrary one such as a semiconductor recording medium or a magnetic recording medium This type of recording medium can be included. Note that the non-transitory recording medium includes an arbitrary recording medium excluding a transient propagation signal (transitory, propagating signal) and does not exclude a volatile recording medium. It is also possible to provide a program to a computer in the form of distribution via a communication network. Further, the program exemplified above can be provided in the form of distribution via a communication network and installed in a computer.

The present invention is also specified as an operation method (acoustic processing method) of the acoustic processing device 100 according to each of the above-described embodiments. The acoustic processing method according to a preferred aspect of the present invention specifies the musical instrument type A_n corresponding to the performance sound represented by the acoustic signal, and adjusts the acoustic signal according to the identified musical instrument type A_n.

(9) From the form illustrated above, for example, the following configuration is grasped.
<Aspect 1>
A recording medium according to a preferred aspect (aspect 1) of the present invention is a computer that adjusts an acoustic signal in accordance with a specific procedure for identifying the type of musical instrument corresponding to the performance sound represented by the acoustic signal, and the identified musical instrument type. The program for executing the adjustment procedure is recorded. In the above configuration, the acoustic signal is adjusted according to the specified type of musical instrument. Therefore, it is possible to appropriately adjust the acoustic signal without requiring specialized knowledge regarding the adjustment content and the acoustic characteristics, as compared with the method in which the user instructs the adjustment content for the acoustic signal.

<Aspect 2>
In a preferred example (Aspect 2) of Aspect 1, in the adjustment procedure, the first process of bringing the frequency characteristic of the acoustic signal close to the target characteristic corresponding to the specified type of musical instrument is performed on the acoustic signal. With the above configuration, the characteristics of each bandpass filter are controlled so that the frequency characteristics of the acoustic signal approach the target characteristics (in accordance with the difference between the two). Therefore, when the acoustic signal is already close to the target characteristic when the acoustic signal is already close to the target characteristic with a method in which the characteristics of the filter for processing the acoustic signal are fixed (method that does not depend on the frequency characteristics of the acoustic signal), the degree of adjustment is small. Become. In other words, it is possible to bring the acoustic signal closer to the target characteristic while making use of the original frequency characteristic of the acoustic signal.

<Aspect 3>
In the preferred example (Aspect 3) of Aspect 1 or Aspect 2, in the specifying procedure, the type of the musical instrument is specified for each of the first acoustic signal and the second acoustic signal corresponding to different channels, and in the adjustment procedure, it is specified. When the frequency band corresponding to the type of musical instrument overlaps between the first acoustic signal and the second acoustic signal, the acoustic component of the frequency band in one of the first acoustic signal and the second acoustic signal is relative to the other. The 2nd process to suppress automatically is performed. In the above configuration, when the frequency band corresponding to the specified type of musical instrument overlaps between the first acoustic signal and the second acoustic signal, the sound of the frequency band in one of the first acoustic signal and the second acoustic signal is recorded. The component is suppressed relative to the other. Therefore, there is an advantage that the performance sound corresponding to the other acoustic component can be easily heard with respect to the performance sound corresponding to the relatively suppressed acoustic component.

<Aspect 4>
In the preferred example (Aspect 4) of Aspect 1 or Aspect 2, in the specifying procedure, the type of the musical instrument is specified for each of the first acoustic signal and the second acoustic signal corresponding to different channels, and in the adjusting procedure, the type is specified. When the frequency band corresponding to the type of musical instrument overlaps between the first acoustic signal and the second acoustic signal, the relative acoustic component that overlaps the other on the time axis in one of the first acoustic signal and the second acoustic signal The third process to be suppressed is executed. In the above configuration, when the frequency band corresponding to the specified musical instrument type overlaps between the first acoustic signal and the second acoustic signal, one of the first acoustic signal and the second acoustic signal is the other on the time axis. The acoustic component overlapping with is relatively suppressed. Therefore, there is an advantage that the performance sound corresponding to the other acoustic component can be easily heard with respect to the performance sound corresponding to the relatively suppressed acoustic component.

<Aspect 5>
In a preferred example (Aspect 5) of Aspect 3 or Aspect 4, the adjustment procedure refers to priority information that designates a priority for each instrument type, and identifies the specified musical instrument out of the first acoustic signal and the second acoustic signal. The acoustic component having the lower priority specified by the priority information with respect to the type is suppressed relative to the other. In the above configuration, of the first acoustic signal and the second acoustic signal, the lower priority specified by the priority information for the specified musical instrument type is suppressed relative to the other. Therefore, the acoustic signal is adjusted more appropriately as compared with the configuration in which the acoustic component in one of the first acoustic signal and the second acoustic signal is relatively suppressed without referring to the priority information. It is possible.

<Aspect 6>
In a preferred example (Aspect 6) of Aspect 5, the priority information specifies a priority for each of a plurality of bands on the frequency axis. In the above configuration, the priority information specifies the priority for each of a plurality of bands on the frequency axis. Therefore, the acoustic signal can be adjusted more precisely.

<Aspect 7>
In the suitable example (aspect 7) in any one of the aspects 3 to 6, the adjustment procedure adjusts both the first acoustic signal and the second acoustic signal.

<Aspect 8>
In a preferred example (Aspect 8) of Aspect 1, in the specifying procedure, the type of musical instrument is specified by analyzing an acoustic signal. In the above configuration, since the type of musical instrument is specified by analyzing the acoustic signal, it is possible to reduce the burden on the user as compared with a configuration in which the type of musical instrument is specified according to an instruction from the user, for example. It is. Further, there is an advantage that the type of musical instrument can be specified even when the user does not recognize the type of musical instrument corresponding to the performance sound.

<Aspect 9>
In a preferred example (aspect 9) of aspect 8, in the adjustment procedure, the adjustment of the acoustic signal is controlled according to the reliability of the result of specifying the type of instrument. In the above configuration, the adjustment of the acoustic signal is suppressed according to the reliability of the result of specifying the type of musical instrument. Therefore, for example, when the reliability of a musical instrument type is high, priority is given to the addition of acoustic characteristics suitable for the musical instrument, while when the reliability of the musical instrument type is low (the instrument type identification result may be erroneous). If the sound characteristics prepared for the instrument are not necessarily valid for the sound signal, the addition of the sound characteristics is suppressed. Appropriate adjustment can be realized.

<Aspect 10>
In a preferred example (aspect 10) of aspect 9, in the adjustment procedure, the degree of adjustment is controlled so that the degree of adjustment increases as the reliability increases. In the above configuration, the degree of adjustment is controlled so that the degree of adjustment increases as the reliability increases (so that the degree of adjustment decreases as the reliability decreases).

<Aspect 11>
A sound processing apparatus according to a preferred aspect (aspect 11) of the present invention specifies an acoustic signal corresponding to the type of instrument identified by the identifying unit and the identifying unit that identifies the type of instrument corresponding to the performance sound represented by the acoustic signal. And an adjusting unit for adjusting.

<Aspect 12>
The acoustic processing method according to a preferred aspect (aspect 12) of the present invention identifies the type of musical instrument corresponding to the performance sound represented by the acoustic signal, and adjusts the acoustic signal according to the identified musical instrument type.

DESCRIPTION OF SYMBOLS 10 ... Musical instrument, 100 ... Sound processing device, 12 ... Signal supply device, 14 ... Sound emission device, 22 ... Arithmetic processing device, 24 ... Memory | storage device, 32 ... Specific part, 34 ... Adjustment part, 40 …… Frequency analysis unit, 50 …… Characterizing unit, 60 …… Waveform generation unit, 70 …… Frequency analysis unit, 80 …… Suppression unit, 90 …… Waveform generation unit, 341 …… First processing unit, 343 ... Mixing unit, 345 ... Second processing unit, 347 ... Third processing unit.

Claims

On the computer,
A specific procedure for identifying the type of instrument corresponding to the performance sound represented by the acoustic signal,
A computer-readable recording medium storing a program for executing an adjustment procedure for adjusting the acoustic signal according to the type of the specified musical instrument.
The recording medium according to claim 1, wherein in the adjustment procedure, a first process is performed on the acoustic signal to bring the frequency characteristic of the acoustic signal closer to the target characteristic corresponding to the specified type of musical instrument.
In the specifying procedure, the type of musical instrument is specified for each of the first acoustic signal and the second acoustic signal corresponding to different channels,
In the adjustment procedure, when a frequency band corresponding to the type of the specified musical instrument overlaps between the first acoustic signal and the second acoustic signal, one of the first acoustic signal and the second acoustic signal. The recording medium of Claim 1 or Claim 2 which performs the 2nd process which suppresses relatively the acoustic component of the said frequency band with respect to the other.
In the specifying procedure, the type of musical instrument is specified for each of the first acoustic signal and the second acoustic signal corresponding to different channels,
In the adjustment procedure, when a frequency band corresponding to the type of the specified musical instrument overlaps between the first acoustic signal and the second acoustic signal, one of the first acoustic signal and the second acoustic signal. The recording medium according to claim 1, wherein a third process for relatively suppressing an acoustic component overlapping with the other on the time axis is executed.
In the adjustment procedure, the priority information for specifying the priority for each instrument type is referred to, and the priority information for the specified instrument type is selected from the first acoustic signal and the second acoustic signal. The recording medium according to claim 3 or 4, wherein the acoustic component having a lower priority to be specified is suppressed relative to the other.
The recording medium according to claim 5, wherein the priority information specifies the priority for each of a plurality of bands on a frequency axis.
The recording medium according to claim 3, wherein in the adjustment procedure, both the first acoustic signal and the second acoustic signal are adjusted.
The recording medium according to claim 1, wherein in the specifying procedure, the type of the musical instrument is specified by analyzing the acoustic signal.
The recording medium according to claim 8, wherein in the adjustment procedure, the adjustment of the acoustic signal is controlled according to the reliability of the result of specifying the type of the musical instrument.
The recording medium according to claim 9, wherein in the adjustment procedure, the degree of adjustment is controlled such that the degree of adjustment increases as the reliability increases.
A specific unit for identifying the type of musical instrument corresponding to the performance sound represented by the acoustic signal;
An acoustic processing apparatus comprising: an adjustment unit that adjusts the acoustic signal in accordance with the type of instrument specified by the specification unit.
Identify the type of instrument that corresponds to the performance sound represented by the acoustic signal,
A sound processing method for adjusting the sound signal according to the type of the specified musical instrument.