JP2012163861A - Signal processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform signal processing on an audio signal to change a sound with a specific one of relationships of feature quantities depending on frequencies between a plurality of channels into a sound with a different relationship.SOLUTION: A signal processing part 100 of a terminal according to an embodiment of the present invention converts audio signals of a plurality of acquired channels into a frequency spectrum, calculates a sound image position corresponding to each frequency, and displays it on a display screen using a coordinate system with coordinate axes of the frequency and the sound image position. A portion of a region in a coordinate system that is specified by a user is set as a specified region. By setting a variation mode for changing a correlationship between a frequency value and a relationship value into a different correlationship, the signal processing part 100 changes a first frequency spectrum of each channel into a second frequency spectrum based on a set variation mode, and converts it into an audio signal to output.

Description

  The present invention relates to a technique for performing signal processing on an audio signal.

  A technique capable of displaying a sound image position for each frequency band in a stereo audio signal has been developed (for example, Patent Document 1). According to this technique, the position of the sound image can be known in detail for the sound represented by the stereo audio signal.

Japanese Patent No. 3912386

  By the way, an acoustic processing device such as an effector that imparts an acoustic effect to an audio signal performs processing for imparting an acoustic effect such as delay, reverb, and pitch shift to the input sound and outputs the processed sound. Some of such acoustic processing devices can perform acoustic processing on sound in a specific frequency band using a bandpass filter or the like. On the other hand, such a sound processing apparatus cannot perform sound processing on sound having a specific frequency band and a specific sound image position.

  The present invention has been made in view of the above-described circumstances, and a sound having a specific relationship is changed from a relationship between feature quantities depending on frequencies between a plurality of channels to a sound having a relationship different from this. An object is to perform signal processing on an audio signal.

  In order to solve the above-mentioned problem, the present invention provides an acquisition means for acquiring an audio signal of a plurality of channels, and a first frequency indicating the frequency dependence of a feature quantity including at least an output level of the acquired audio signal of each channel. First conversion means for converting into a spectrum, calculation means for calculating a relation value corresponding to the relation of the feature quantity between each channel based on the first frequency spectrum, corresponding to each frequency value; and the frequency A display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having a coordinate axis of a value and a coordinate axis of the relation value, and an area for setting a partial area in the coordinate system as a designated area A change mode for changing the correspondence relationship between the setting means and the frequency value and the relationship value in the calculation result included in the designated region to a different relationship. Change mode setting means to be determined, spectrum change means for changing the first frequency spectrum of each channel to a second frequency spectrum based on the change mode, and converting the second frequency spectrum to an audio signal of each channel. There is provided a signal processing apparatus comprising: a second conversion unit; and an output unit that outputs the audio signal converted by the second conversion unit.

  In another preferred embodiment, a frequency value corresponding to the calculation result included in the designated region is extracted, and an output level corresponding to the extracted frequency value in the first frequency spectrum is predetermined. First level changing means for changing the amount of adjustment, and the second converting means further converts the first frequency spectrum whose output level is changed by the first level changing means into an audio signal of each channel. The output means converts and outputs a plurality of audio signals converted by the second conversion means for each channel.

  In another preferable aspect, a frequency value corresponding to the calculation result included in the designated area and an area determined according to the change aspect is extracted, and the frequency value corresponding to the extracted frequency value in the first frequency spectrum is extracted. Second level changing means for changing the output level to be changed by a predetermined adjustment amount, wherein the second converting means further includes a first frequency whose output level is changed by the second level changing means. The spectrum is converted into an audio signal of each channel, and the output means synthesizes and outputs a plurality of audio signals converted by the second conversion means for each channel.

  The present invention also provides an acquisition means for acquiring audio signals of a plurality of channels, and a first frequency spectrum for converting the acquired audio signals of each channel into a first frequency spectrum indicating frequency dependence of a feature amount including at least an output level. Based on the first frequency spectrum, a conversion unit, a calculation unit that calculates a relationship value corresponding to the relationship of the feature quantity between the channels, corresponding to each frequency value, a coordinate axis of the frequency value, Display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having a coordinate axis of a relation value; area setting means for setting a partial area in the coordinate system as a designated area; Storage means for storing a template indicating a frequency spectrum of a plurality of channels indicating the received sound, and a template stored in the storage means. Spectrum changing means for changing to a second frequency spectrum based on the range of the frequency value and the relationship value indicated by the designated region, and extracting the frequency value corresponding to the calculation result included in the designated region, and the first frequency spectrum A level changing means for changing an output level corresponding to the extracted frequency value by a predetermined adjustment amount, a second frequency spectrum, and a first frequency whose output level is changed by the level changing means. And a second conversion unit that converts the spectrum into an audio signal of each channel, and an output unit that combines and outputs a plurality of audio signals converted by the second conversion unit for each channel. A signal processing apparatus is provided.

  The present invention also provides an acquisition means for acquiring audio signals of a plurality of channels, and a first frequency spectrum for converting the acquired audio signals of each channel into a first frequency spectrum indicating frequency dependence of a feature amount including at least an output level. Based on the first frequency spectrum, a conversion unit, a calculation unit that calculates a relationship value corresponding to the relationship of the feature quantity between the channels, corresponding to each frequency value, a coordinate axis of the frequency value, Display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having a coordinate axis of a relation value; area setting means for setting a partial area in the coordinate system as a designated area; and the designation A sound effect setting means for setting a sound effect for the region; and a frequency value corresponding to the calculation result included in the designated region is extracted; and the first frequency Sound effect applying means for generating an audio signal of each channel to which the sound effect is applied to the sound indicated by the output level corresponding to the extracted frequency value in the spectrum, and the calculation result included in the specified region And a level changing means for changing an output level corresponding to the extracted frequency value in the first frequency spectrum by a predetermined adjustment amount and an output level by the level changing means. The second conversion means for converting the changed first frequency spectrum into the audio signal of each channel, the audio signal generated by the acoustic effect applying means, and the audio signal converted by the second conversion means are channeled. And a signal processing device characterized by comprising output means for synthesizing each output. To.

  According to the present invention, a signal with respect to an audio signal is changed so that a sound having a specific relationship among the relationship of feature quantities depending on frequencies between a plurality of channels is changed to a sound having a different relationship. Processing can be performed.

It is a figure explaining the external appearance of the terminal in 1st Embodiment of this invention. It is a block diagram explaining the structure of the terminal in 1st Embodiment of this invention. It is a functional block diagram explaining the structure of the signal processing function in 1st Embodiment of this invention. It is a figure explaining the example of a display of the display screen in 1st Embodiment of this invention. It is a figure explaining the example of a display of the display screen on which the designation field in a 1st embodiment of the present invention was displayed. It is a figure explaining the example of a display of the display screen on which the designation | designated area | region and the transfer area | region in 1st Embodiment of this invention were displayed. It is a functional block diagram explaining the structure of the signal processing function in 2nd Embodiment of this invention. It is a figure explaining the example of a display of the display screen on which the designation | designated area | region in 2nd Embodiment of this invention was displayed. It is a functional block diagram explaining the structure of the signal processing function in 3rd Embodiment of this invention. It is a figure explaining the adjustment amount set to the designation | designated area | region in the modification 1 of this invention. It is a figure explaining the example of a display of the display screen on which the designation | designated area | region and the transfer area | region in the modification 2 of this invention were displayed. It is a figure explaining the example of a display of the display screen on which the designation | designated area | region and the transfer area | region in the modification 3 of this invention were displayed. It is a figure explaining the example of a display of the display screen in the modification 7 of this invention. It is a figure explaining the example of a display of a display screen when designating the designation field and transition field in modification 8 of the present invention, fixing a frequency range. It is a figure explaining another display example of a display screen when designating the designation | designated area | region and transition area | region in the modification 8 of this invention, fixing a frequency range. It is a figure explaining the example of a display of the display screen in the modification 9 of this invention. It is a figure explaining the designation | designated area | region and transfer area | region set in the modification 11 of this invention.

<First Embodiment>
[Configuration of terminal 1]
FIG. 1 is a diagram illustrating the appearance of a terminal 1 in the first embodiment of the present invention. The terminal 1 is a portable information processing terminal such as a mobile phone, a PDA (Personal Digital Assistant), or a music player. The terminal 1 is not limited to a portable information processing terminal, and may be a personal computer or the like.
As illustrated in FIG. 1, the terminal 1 includes a touch sensor 121, operation buttons 122, and a display screen 131 on the front surface of the housing. The touch sensor 121 is provided in front of the display screen 131 and constitutes a touch panel together with the display screen 131. Although only one operation button 122 is shown in FIG. 1, a plurality of operation buttons 122 may be provided or may not be provided.

  FIG. 2 is a block diagram illustrating the configuration of the terminal 1 in the first embodiment of the present invention. The terminal 1 includes a control unit 11, an operation unit 12, a display unit 13, a storage unit 14, a posture detection unit 15, an interface 16, and a communication unit 17. Each of these components is connected to each other by a bus.

  The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The control unit 11 controls each unit of the terminal 1 via the bus by executing a control program stored in the ROM or the storage unit 14. In this example, the control unit 11 implements various functions such as a signal processing function for performing designated signal processing on an audio signal by executing a control program. In this example, the various functions include the functions of a general mobile phone, PDA, music player, etc., but may not necessarily be included.

The operation unit 12 includes a touch sensor 121 that accepts an operation from a user and an operation button 122, and outputs operation information indicating the contents of the accepted operation to the control unit 11. The touch sensor 121 is a so-called multi-touch sensor that detects simultaneous contact with a plurality of touch sensors 121. Hereinafter, designation and instruction from the user are performed by operations performed via the operation unit 12 unless otherwise specified.
The display unit 13 is a display device having a display screen 131 such as a liquid crystal display, and displays content on the display screen 131 according to the control of the control unit 11. When the signal processing function is realized, the display screen 131 displays a display relating to the audio signal to be processed, a display for designating the content of the signal processing, and the like.

  The storage unit 14 is a recording medium such as a hard disk or a nonvolatile memory. The storage unit 14 has an area for storing a plurality of channels of audio signals indicating the contents of music. In this example, the plurality of channels are stereo 2ch (Lch, Rch).

The posture detection unit 15 includes an acceleration sensor, an angular velocity sensor, and the like, detects the movement of the casing of the terminal 1, and outputs a movement signal.
The interface 16 is connected to an external device and has a terminal for inputting / outputting various information such as an audio signal. The terminals include, for example, terminals for connecting sound emission means such as headphones and speakers and supplying audio signals to the connected sound emission means.
The communication unit 17 performs wireless and wired communication with other devices according to the control of the control unit 11. The above is the description of the hardware configuration of the terminal 1.

[Function configuration]
Next, a signal processing function realized by the control unit 11 of the terminal 1 executing a control program will be described. Note that some or all of the components in the signal processing unit 100 that implements the signal processing function described below may be realized by hardware.

FIG. 3 is a functional block diagram illustrating the configuration of the signal processing function in the first embodiment of the present invention. The signal processing unit 100 that realizes the signal processing function includes an acquisition unit 110, a first conversion unit 120, a sound image position calculation unit 130, a display control unit 140, a region setting unit 150, a change setting unit 160, a level changing unit 171 and a spectrum change. Unit 172, second conversion unit 180, and output unit 190.
The acquisition unit 110 acquires the audio signal of the music specified by the user from among the audio signals stored in the storage unit 14 and outputs the audio signal to the first conversion unit 120. Note that the acquisition unit 110 may acquire an audio signal input from an external device via the interface 16.

  The first conversion unit 120 performs an FFT (Fast Fourier Transform) process on the audio signal output from the acquisition unit 110 for each frame having a predetermined length of time for each of the Lch and Rch, and thereby the frequency spectrum. Convert to The frequency spectrum shows the correspondence between the frequency values (f1, f2,... Fn) and the output levels (A1, A2,..., An), that is, the frequency dependence of the output level. As described above, the output level for each frequency value extracted from the audio signal is an example of a feature quantity depending on the frequency.

Here, the output level of the frequency spectrum converted from the Lch audio signal is called (AL1, AL2,..., ALn), and the output level of the frequency spectrum converted from the Rch audio signal is ( AR1, AR2,..., ARn).
The first conversion unit 120 outputs the frequency spectrum for each frame thus obtained to the sound image position calculation unit 130, the level change unit 171 and the spectrum change unit 172.

Based on the frequency spectrum output from the first conversion unit 120, the sound image position calculation unit 130 calculates a sound image position as a relation value indicating the relationship between the output levels between the channels corresponding to each frequency value. The sound image position calculation unit 130 calculates the sound image position Pi according to the following equation (1) using the ratio of the output levels between the channels corresponding to each frequency value (i = 1 to n).
Pi = 2 / π × arctan (ARi / ALi) (1)

The sound image position Pi indicates that the sound image is located on the Lch side (left side as viewed from the user) as it is closer to “0”, and the sound image position Pi is located on the Rch side (right side as viewed from the user) as it is closer to “1”. Yes. Further, if the sound image position Pi is “0.5”, it indicates that the sound image is located at the center.
In this way, the sound image position calculation unit 130 calculates the correspondence between the frequency values (f1, f2,... Fn) and the sound image positions (P1, P2,..., Pn) to correspond to each frame. And output to the display control unit 140, the level changing unit 171 and the spectrum changing unit 172 as information indicating the sound image calculation result. Note that the calculation method of the sound image position is not limited to the above calculation method, and other calculation methods may be used as long as the calculation method is performed according to the relationship between the output levels of the respective channels.

  The display control unit 140 causes the display screen 131 of the display unit 13 to display content based on the sound image calculation result in the sound image position calculation unit 130. A display example displayed on the display screen 131 will be described with reference to FIG.

  FIG. 4 is a diagram illustrating a display example of the display screen 131 according to the first embodiment of the present invention. As shown in FIG. 4A, the display control unit 140 controls the display unit 13 to display windows w1, w2, and w3 on the display screen 131. The display control unit 140 displays contents based on the sound image calculation result in the window w1, displays operation buttons for various designations and instructions in the window w2, and displays on the display screen 131 in the window w3. Information related to the content being played (such as a song name) is displayed.

In the window w1, a display in which the sound image calculation results are plotted in a coordinate system having the coordinate axes having the relationship shown in FIG. The coordinate axis in the vertical direction of the window w1 indicates the frequency (the frequency in the upward direction is a high frequency value and is logarithmically displayed), and the coordinate axis in the horizontal direction indicates the sound image position. A display example of the sound image calculation result displayed in the window w1 in this way is shown in FIG. The display content of the window w1 shown in FIG. 4A indicates a sound image calculation result in a specific frame. However, since the sound image calculation result is a result obtained for each frame, it changes with time. To go.
The sound corresponding to the display example shown in FIG. 4 (a) is perceived by the user so that the sound image is generally localized at the center portion and the sound image is localized at a position closer to the right side in the high frequency band. The

  Note that the display control unit 140 may change the display mode of each point indicating the sound image calculation result displayed in the window w1 according to the output level. The contents to be changed are brightness, saturation, luminance, dot size, and the like. In this case, the sound image position calculation unit 130 outputs the sound image calculation result to the display control unit 140 so that the information indicating the absolute value of the output level such as the added value of the output level (ALi + ARi) is further included. What should I do?

In addition, the display control unit 140 indicates the sound image calculation result with dots, but is not limited to dots. For example, display in various forms is possible, such as displaying a line, a specific mark, or a gradation in the window w1 according to the output level.
Furthermore, the display control unit 140 may display the coordinate axes shown in FIG. 4B together with the sound image calculation result shown in FIG.

Returning to FIG. 3, the description will be continued. The area setting unit 150 sets a part of the area indicated by the coordinate system displayed in the window w <b> 1 of the display screen 131 as the designated area according to the operation information output from the operation unit 12. The designated region is a region for extracting a frequency value to be processed for changing the output level, and includes a frequency range (hereinafter referred to as a designated frequency range) and a sound image position range (hereinafter designated as a designated sound image range). This is an area that defines The region setting unit 150 outputs designated region information indicating the set designated region to the display control unit 140, the level changing unit 171 and the spectrum changing unit 172.
The area setting unit 150 causes the display control unit 140 to acquire the specified area information output in this way, and displays the specified area in the window w1 of the display screen 131. A display example when a partial area in the coordinate system is set as a designated area in the state shown in FIG. 4A will be described with reference to FIG.

  FIG. 5 is a diagram illustrating a display example of the display screen 131 on which the designated area is displayed according to the first embodiment of the present invention. In the example shown in FIG. 5A, the designated area sc1 is set. The user operates an operation button for causing the designated area to appear among the operation buttons in the window w2, and designates the position to be the upper left vertex sc1a and the position to be the lower right vertex sc1b of the area to be designated as the designated area sc1. When the operation is performed (operation such as touching the position), the area setting unit 150 sets the specified area as the specified area sc1. Accordingly, the display control unit 140 displays the designated area sc1 on the display screen 131.

  Note that the area setting unit 150 is not limited to setting one area as the designated area (designated area sc1) as shown in FIG. 5A, but as shown in FIG. It can also be set as designated areas (designated areas sc1, sc2). Note that the user operation performed for the region setting unit 150 to set a part of the region in the coordinate system as the designated region is an example, and may be designated by another operation.

  Returning to FIG. 3, the description will be continued. The change setting unit 160 sets a change mode of the sound image calculation result in the designated area according to the operation information output from the operation unit 12. The contents to be set are contents necessary for changing the sound image calculation result in the designated area to an area different from the designated area in the coordinate system (hereinafter referred to as a transition area). In this example, the transition area, The amount of adjustment of the output level in the transition area and the amount of adjustment of the output level in the designated area are set as change modes. The change setting unit 160 outputs change setting information indicating these setting contents to the display control unit 140, the level changing unit 171, and the spectrum changing unit 172. It should be noted that information indicating the transition region in the setting content may be output to the spectrum changing unit 172, and information regarding the adjustment amount may not be output.

  The change setting unit 160 causes the display control unit 140 to acquire the change setting information output in this way, and displays the transition area in the window w1 of the display screen 131. A display example when the transition area is set in the state shown in FIG. 5A will be described with reference to FIG.

  FIG. 6 is a diagram illustrating a display example of the display screen 131 on which the designated area and the transition area are displayed according to the first embodiment of the present invention. In the example illustrated in FIG. 6, the designated area sc is already set in the area setting unit 150 and the transition area sp is set in the change setting unit 160. Note that the arrows shown in FIG. 6 (the same applies to other drawings) may or may not be displayed.

  The example shown in FIG. 6A is a case where a transition region sp that is a region having a different sound image position with respect to the designated region sc is set. The example shown in FIG. 6B is a case where a transition region sp that is a region having a frequency value different from the designated region sc is set. The transition area sp may be set as an area where both the sound image position and the frequency value are different.

  The change setting unit 160 performs an operation in which the user specifies a specified area (an operation such as touching a part of the specified area in the window w1), and has the same shape as the specified area specified by an operation button in the window w2. The transition area is set by performing an operation for displaying the transition area and performing an operation for specifying the position of the transition area (an operation such as touching a specific position in the window w1). Therefore, in this example, the shape of the designated area sc and the transition area sp are the same. Note that the user operation performed for the change setting unit 160 to set as the transition area is an example, and may be specified by another operation. For example, it may be changed in the coordinate axis direction of the frequency or the coordinate axis direction of the sound image position by operating the operation button of the window w2.

  The change setting unit 160 performs an operation in which the user specifies a designated area or a transition area for which an adjustment amount is desired to be set (an operation such as touching a part of the designated area or the transition area in the window w1). By specifying the adjustment amount with the operation button, the adjustment amount in the specified designated area or transition area is set. Here, if the change setting unit 160 needs to recognize the position of the designated region in order to recognize whether or not an operation for specifying the designated region has been performed, the designated region information output from the region setting unit 150 Just get it. Note that the user's operation performed for the change setting unit 160 to set the adjustment amount is an example, and may be designated by another operation. The output level adjustment amount in the transition area and the output level adjustment amount in the designated area may be set in advance. Alternatively, a plurality of templates with predetermined adjustment amounts may be stored in the storage unit 14, and the adjustment amount may be set by the user selecting one template.

  This adjustment amount is defined as a value to be multiplied with the output level. In this example, the adjustment amount is defined in the range of 0% to 100%. For example, if the adjustment amount is 100%, the output level adjustment in the level changing unit 171 is not performed, and if it is less than 100%, the adjustment for decreasing the output level is performed. Note that the adjustment amount is not limited to that defined by%, and may be defined by, for example, dB. Moreover, it may be defined not only as a relative amount but also as an absolute amount. Further, it may be defined so as to align with a specific output level.

  Returning to FIG. 3, the description will be continued. The level changing unit 171 compares the sound image calculation result with the designated area information, and extracts a frequency value corresponding to the sound image calculation result included in the designated area. Specifically, the level changing unit 171 refers to the sound image calculation result and extracts a frequency value included in the specified frequency range from among the frequency values corresponding to the sound image positions included in the specified sound image range. In the example shown in FIG. 5A, the point d1 (fx, Px) in the sound image calculation result is included in the designated area s1, but the point d2 (fy, Py) is not included in the designated area. The level changing unit 171 extracts the frequency value fx but does not extract the frequency value fy.

  Then, the level changing unit 171 generates an output level corresponding to a frequency value extracted corresponding to the designated region in the frequency spectrum output from the first conversion unit 120 (hereinafter, generated by an output level corresponding to this frequency value). The sound is referred to as “sound included in the designated area”) by an adjustment amount indicated by the change setting information. In the example shown in FIG. 5A, when the adjustment amount set in the designated region sc is Z%, the level changing unit 171 sets the output level of the sound included in the designated region sc in the frequency spectrum. Each channel is changed to be Z / 100 times. That is, values corresponding to the point d1 in the frequency spectrum output from the first conversion unit 120 are Lch (fx, ALx) and Rch (fx, ARx), but the level changing unit 171 has Lch (fx , ALx × Z / 100), Rch (fx, ARx × Z / 100). If Z = 0, the sound included in the designated area sc cannot be heard from the sound output as described later.

Further, the level changing unit 171 compares the sound image calculation result with the transition region in the change setting information, and extracts the frequency value corresponding to the sound image calculation result included in the transition region in the same manner as in the specified region. .
Then, the level changing unit 171 generates an output level corresponding to the frequency value extracted corresponding to the transition region in the frequency spectrum output from the first converting unit 120 (hereinafter referred to as an output level corresponding to this frequency value). The sound is increased or decreased by the adjustment amount indicated by the change setting information.
As described above, the level changing unit 171 changes the frequency spectrum of each channel in which the output level of the sound included in the designated region and the sound included in the transition region is changed to the second conversion unit 180 corresponding to each frame. Output to.

  The spectrum changing unit 172 extracts the sound included in the designated area, and changes the correspondence between the frequency value and the sound image position for the sound according to the change setting information. Here, extracting the sound included in the specified area indicates that the sound other than the sound included in the specified area is removed by setting the output level to 0. Hereinafter, when changing the correspondence, a case where the sound image position is changed and a case where the frequency value is changed will be described.

  First, a case where the sound image position is changed, that is, a case where the positional relationship between the designated area and the transition area is shown in FIG. 6A will be described. In this case, the designated frequency range of the designated area sc and the transition area sp does not change, and the sound image position has moved to the negative side as a whole. When this movement amount is “Pm”, the spectrum changing unit 172 represents the sound of the sound included in the designated area sc as represented by a value obtained by subtracting all the sound image positions of the sound contained in the designated area sc by “Pm”. The ratio of the output level between the channels is changed as follows.

A specific point dz1 (fz1, Pz1) in the designated region sc has a correspondence obtained from the calculation formula shown in the following formula (2) using the output levels ARz1 and ALz1 corresponding to the frequency value fz. When the point dz1 is moved from the designated region sc to the transition region sp, the correspondence changes to the point dz2 (fz1, Pz1-Pm). Therefore, the spectrum changing unit 172 changes the ratio (ARz1 / ALz1) of the output level corresponding to the frequency value fz1 to (ARz2 / ALz2) so as to satisfy the following expression (3).
Pz1 = 2 / π × arctan (ARz1 / ALz1) (2)
Pz1−Pm = 2 / π × arctan (ARz2 / ALz2) (3)
At this time, the absolute values of ARz2 and ALz2 may be determined such that the sum of the output levels of ARz1 and ALz1 is the same, or may be determined so that the energy values are the same.

  Next, a case where the frequency value is changed, that is, a case where the positional relationship between the designated area and the transition area is shown in FIG. 6B will be described. In this case, the designated sound image range does not change between the designated area sc and the transition area sp, and the frequency value moves to the minus side as a whole. This amount of movement is assumed to be “1 / m” expressed as a ratio of frequency values. In this case, the spectrum changing unit 172 calculates the frequency value of the sound included in the designated region sc as follows, as expressed as a value obtained by multiplying all the frequency values of the sound included in the designated region sc by “1 / m”. Change as follows.

  When a specific point dz1 (fz1, Pz1) in the designated area sc is moved from the designated area sc to the transition area sp, the correspondence changes to the point dz3 (fz1 / m, Pz1). Therefore, the spectrum changing unit 172 changes the frequency value “fz1” to “fz1 / m” without changing the output level. In this example, since only the frequency values of the sounds included in the designated area sc are multiplied by “1 / m”, the frequency values of the sounds included in the designated area sc are reduced as a whole, Does not change. Therefore, although the pitch of the sound included in the designated area sc changes, the timbre does not change much.

In the above description, when changing the correspondence, the case where the sound image position is changed and the case where the frequency value is changed are described, respectively. However, depending on the positional relationship between the designated area and the transition area, the sound image position and the frequency are changed. Both values may be changed.
As described above, the spectrum changing unit 172 changes the correspondence between the frequency value of the sound included in the designated region and the sound image position in accordance with the relationship with the transition region. The frequency spectrum is output to the second converter 180.

  When only the sound image position is changed, the spectrum changing unit 172 does not extract the sound included in the designated area sc, but performs the above-described processing on the sound included in the designated area sc, and thereby performs the designated area. For sounds other than those included in sc, the frequency value and output level remain unchanged in the frequency spectrum. When the spectrum changing unit 172 has such a configuration, the processing in the level changing unit 171 may not be performed.

The second conversion unit 180 performs an IFFT (Inverse Fast Fourier Transform) process on the frequency spectrum of each channel output from the level changing unit 171 and converts the frequency spectrum into an audio signal of each channel. Similarly, the second conversion unit 180 performs IFFT processing on the frequency spectrum of each channel output from the spectrum changing unit 172 and converts the frequency spectrum into an audio signal of each channel. The second conversion unit 180 outputs the converted audio signal to the output unit 190. Note that the frequency spectrum output from the spectrum changing unit 172 changes the interval between frequency values before processing in the processing in the spectrum changing unit 172. Therefore, the second conversion unit 180 may be different from the IFFT process performed on the frequency spectrum output from the level changing unit 171 and the IFFT process performed on the frequency spectrum output from the spectrum conversion unit 172. In addition, the spectrum conversion unit 172 performs an interpolation process when the frequency value interval is wide, and a thinning process when the frequency value interval is narrow so that the frequency value interval is the same before and after the process in the spectrum conversion unit 172. Etc. may be performed.
The output unit 190 synthesizes the audio signal output from the second conversion unit 180 by, for example, mixing at a predetermined volume ratio for each channel, outputs it to the interface 16, and a speaker connected to the interface 16. Sound is emitted from the sound emission device. In the synthesis, a plurality of audio signals may be simply added or an arithmetic average may be taken.

In this way, the signal processing unit 100 converts the acquired audio signals of a plurality of channels into a frequency spectrum, calculates a sound image position corresponding to each frequency, and displays it using a coordinate system having the frequency and the coordinate axis of the sound image position. It is displayed on the screen 131. By setting a partial area in the coordinate system designated by the user as the designated area, and setting the transition area and the output level adjustment amount, the signal processing unit 100 allows the sound included in the designated area in the frequency spectrum. The sound image position, pitch, etc. are adjusted and converted into an audio signal for output.
As a result, the user can intuitively specify a partial area while viewing the sound image calculation result displayed on the display screen 131, and causes the area setting unit 150 to set this area as the specified area, thereby specifying the specified area. The position of the sound image included in the sound can be changed, and the pitch can be changed.

  For example, it is assumed that the sound indicated by the audio signal is a performance recorded using a plurality of musical instruments recorded in stereo, and the sound image of the guitar is localized on the right side. Then, it is assumed that this guitar sound is set as a sound included in the designated area, and a transition area is set on the left side. At this time, if the adjustment amount in the designated region is set to 100%, the sound image of the guitar can be localized on the right side and the left side. On the other hand, if the adjustment amount in the designated area is set to 0%, the sound image of the guitar localized on the right side can be moved to the left side. Also, if there is a sound of another instrument in the sound included in the transition area, if the adjustment amount in the transition area is set to 100%, the sound images of both the guitar and the other instrument are localized on the right side. If the adjustment amount in the transition region is set to 0%, the sound image of the guitar can be localized by changing to another instrument.

Second Embodiment
In the second embodiment, FIG. 7 shows the configuration of the signal processing unit 100A that performs processing for changing the frequency spectrum stored in advance in the storage unit 14A as a template in accordance with the designated region and synthesizing the frequency spectrum. It explains using.

  FIG. 7 is a functional block diagram illustrating the configuration of the signal processing function in the second embodiment of the present invention. The signal processing unit 100A that realizes the signal processing function in the second embodiment includes an acquisition unit 110, a first conversion unit 120, a sound image position calculation unit 130, a display control unit 140, a region setting unit 150, a change setting unit 160A, and a level change. Unit 171A, spectrum changing unit 172A, second conversion unit 180, and output unit 190. Since the configuration other than the change setting unit 160A, the level changing unit 171A, and the spectrum changing unit 172A is the same as that of the signal processing unit 100 in the first embodiment, the description thereof is omitted.

  The change setting unit 160A does not set the output level adjustment amount in the transition region and the transition region among the settings performed in the change setting unit 160 in the first embodiment, but sets the output level adjustment amount in the designated region. I do. In addition, when there are a plurality of templates stored in the storage unit 14A, the change setting unit 160A uses a setting for designating a template to be combined as a user operation (such as an operation button operation on the window w2). Do it accordingly.

Here, the templates stored in the storage unit 14A will be described. This template defines a frequency spectrum in a predetermined frequency range for each channel. The frequency spectrum is defined for a plurality of frames corresponding to a certain time.
The level changing unit 171A adjusts the output level in the designated region without adjusting the output level in the transition region performed in the level changing unit 171 in the first embodiment.

  The spectrum changing unit 172A reads the template set by the change setting unit 160 from the storage unit 14A, changes the read template (frequency spectrum) according to the specified frequency range and the specified sound image range indicated by the specified region, and performs the second conversion. Output to the unit 180. In this example, the spectrum changing unit 172A extracts and outputs the sound included in the designated region from the frequency spectrum of the template. In addition, the aspect which changes the frequency spectrum of a template may be another. For example, the frequency spectrum of the template may be changed so that the lower limit (or upper limit) of the frequency spectrum of the template matches the lower limit (or upper limit) of the specified frequency range. In this change, the overtone relationship may be maintained as described above, or may not be maintained. Further, the output level ratio of each channel may be adjusted so that the sound image position obtained from the frequency spectrum of the template is included in the designated sound image range.

FIG. 8 is a diagram illustrating a display example of the display screen 131 on which the designated area st is displayed according to the second embodiment of the present invention. As shown in FIG. 8, the display control unit 140 displays the correspondence between the frequency value calculated from the result of changing the frequency spectrum of the template according to the designated region st and the sound image position in the set designated region st. Correspondingly, it may be displayed in the window w1.
As described above, the audio signal output from the signal processing unit 100A in the second embodiment indicates a sound obtained by synthesizing the audio signal acquired by the acquisition unit 110 with the sound based on the frequency spectrum of the template in the designated region st. It becomes. At this time, by adjusting the output level in the designated region st to 0% in the level changing unit 171A, the sound included in the designated region st can be replaced with a sound based on the frequency spectrum of the template.

<Third Embodiment>
In the third embodiment, FIG. 9 shows the configuration of the signal processing unit 100B that performs the process of imparting the acoustic effect to the sound included in the designated area according to the acoustic processing information stored in advance in the storage unit 14B as a template. It explains using.

  FIG. 9 is a functional block diagram illustrating the configuration of the signal processing function in the third embodiment of the present invention. The signal processing unit 100B that realizes the signal processing function in the third embodiment includes an acquisition unit 110, a first conversion unit 120, a sound image position calculation unit 130, a display control unit 140, a region setting unit 150, a change setting unit 160B, and a level change. Unit 171B, sound effect applying unit 172B, second conversion unit 180, and output unit 190. Since the configuration other than the change setting unit 160B, the level change unit 171B, and the sound effect applying unit 172B is the same as that of the signal processing unit 100 in the first embodiment, the description thereof is omitted. Further, the level changing unit 171B is the same as the level changing unit 171A in the second embodiment, and a description thereof will be omitted.

  The change setting unit 160B does not set the output level adjustment amount in the transition region and the transition region among the settings made in the change setting unit 160 in the first embodiment, but sets the output level adjustment amount in the designated region. I do. In addition, when there are a plurality of pieces of acoustic processing information stored in the storage unit 14B, the change setting unit 160B sets a setting for designating acoustic processing information corresponding to the acoustic effect to be applied by the user's operation (window The operation is performed according to the operation button w2). At this time, the degree to which the acoustic effect is applied may be set.

Here, the acoustic processing information stored in the storage unit 14B will be described. In this acoustic processing information, parameters necessary for imparting acoustic effects such as delay, reverb, and compressor are defined.
The acoustic effect imparting unit 172B reads acoustic processing information corresponding to the acoustic effect set in the change setting unit 160B from the storage unit 14B, and performs IIR (Infinite impulse) on the sound included in the designated region according to the read acoustic processing information. response) processing for applying an acoustic effect using a filter or the like, and outputs the result to the second converter 180. Note that the acoustic effect imparting unit 172A may perform the process of imparting the acoustic effect after performing IFFT processing on the frequency spectrum of the sound included in the designated region to convert it into an audio signal. In this case, the conversion process in the 2nd conversion part 180 is unnecessary.
As described above, the audio signal output from the signal processing unit 100B according to the third embodiment indicates a sound in which an acoustic effect is applied to the sound included in the designated region among the audio signals acquired by the acquisition unit 110. It will be a thing.

<Modification>
As mentioned above, although embodiment of this invention was described, this invention can be implemented in various aspects as follows.
[Modification 1]
In the first, second, and third embodiments described above, the adjustment amount set by the change setting unit 160 is set as the same amount at any position in the designated area, but depending on the position in the designated area. Different amounts may be set. For example, the adjustment amount may be set as shown in FIG.

FIG. 10 is a diagram for explaining the adjustment amount set in the designated area in the first modification of the present invention. FIG. 10A is a diagram illustrating the adjustment amount set in the embodiment. FIG. 10B is a diagram illustrating an example of the adjustment amount set in the first modification.
In the embodiment described above, for example, as shown in FIG. 10A, at any position in the coordinate axis direction (a-a direction) of the sound image position and the frequency coordinate axis direction (bb direction) of the designated region sc. Is also set as the same adjustment amount L0. On the other hand, in the first modification, for example, as shown in FIG. 10B, the coordinate axis direction (a-a direction) of the sound image position of the designated region s1 and the frequency coordinate axis direction (bb direction) are set to positions. Accordingly, the adjustment amount is set to change. This example shows a state (concave shape) in which the central portion of the designated region sc is set to have a smaller adjustment amount than the peripheral portion.

In this case, the level changing unit 171 may specify an adjustment amount corresponding to the frequency value and sound image position of the sound included in the designated area sc in association with the frequency value extracted corresponding to the designated area s1. . The level changing unit 171 may change the output level corresponding to each frequency value of the sound included in the designated region sc according to the adjustment amount specified corresponding to each frequency value. If it does in this way, the signal processing part 100 can also adjust and output a sound volume with a different adjustment amount according to the position in the designated area | region about the sound contained in the designated area | region. For example, when the adjustment amount is set as shown in FIG. 10B, the signal processing unit 100 can output the sound corresponding to the peripheral part in the designated area sc with a larger volume. Note that the adjustment amount set by the change setting unit 160 only needs to be set so as to be different depending on the position in the designated region, and therefore, as shown in FIG. The portion may be in a state (convex shape) set so that the adjustment amount is larger than that in the peripheral portion, and can be set in various modes.
The adjustment amount in the designated area has been described above, but the same applies to the transition area.

[Modification 2]
In the first embodiment described above, the display control unit 140 may cause the transition region sp in the window w1 to display the correspondence between the frequency value based on the frequency spectrum after the spectrum change unit 172 has changed and the sound image position. .

  FIG. 11 is a diagram illustrating a display example of the display screen 131 on which the designated area sc and the transition area sp are displayed according to the second modification of the present invention. As shown in FIG. 11, the display control unit 140 displays each point included in the designated area sc in the transition area sp. At this time, the display control unit 140 may change the display mode (color, darkness, size, shape, etc.) of the dots for display. Further, the display control unit 140 may not display each point that has already been displayed in the portion of the transition area sp, or may remain displayed. The display of each point may be changed according to the setting of the adjustment amount in the transition area sp.

  Note that when applied to the second and third embodiments, there is no transition area, so the display control unit 140 may display the same in the designated area.

[Modification 3]
In the first embodiment described above, the designated region sc and the transition region sp have the same shape, but may not be the same. If they do not match, the migration area sp is set by the same operation as the user's operation for setting the designated area sc. The spectrum changing unit 172 may perform correction processing according to the difference in shape when changing the frequency value and the sound image position.

  FIG. 12 is a diagram illustrating a display example of the display screen 131 on which the designated area sc and the transition area sp are displayed according to the third modification of the present invention. In the case shown in FIG. 12, the transition region sp has a wider frequency value range (longer length in the vertical direction) and a narrower sound image position range (shorter in the horizontal direction) than the designated region sc. It has become.

  When the range of frequency values is different between the designated region sc and the transition region sp, the spectrum changing unit 172 changes the lower limit fcL of the frequency value in the designated region sc to the lower limit fpL of the frequency value in the transition region sp. What is necessary is just to process. That is, the spectrum changing unit 172 may multiply each frequency value in the designated region sc by “fpL / fcL”. Note that the relationship between the lower limit and the upper limit of the frequency value may be interchanged. In addition, the reference value for changing the spectrum is not limited to the upper limit or the lower limit of the frequency value, and any frequency value in the designated region sc may be used as the reference value.

  In addition, the spectrum changing unit 172, when the upper limit of the frequency value after changing the spectrum is higher than the upper limit of the frequency value of the transition region sp, about the portion that exceeds the upper limit of the frequency value of the transition region sp Remove it. In the case of the example shown in FIG. 12, there is no portion exceeding the upper limit of the frequency value of the transition region sp, so it is not necessary to remove it.

  The change of the frequency value is not limited to this change mode, and may be another mode as long as the change is made based on the relationship between the designated region sc and the transition region sp. For example, the coefficient to be multiplied by the frequency value so that the upper limit of the frequency value of the designated region sc is the upper limit of the frequency value of the transition region sp and the lower limit of the frequency value of the designated region sc is the lower limit of the frequency value of the transition region sp. May be changed according to the frequency value.

The case where the range of frequency values is different between the designated area sc and the transition area sp has been described. Similarly, when the range of the sound image position is different, similarly, the upper limit or lower limit of the sound image position or any one of the sound image positions in the designated area sc. As a reference, the output level ratio may be changed.
As described above, the spectrum changing unit 172 may change the frequency spectrum of each channel in any manner according to the relationship between the designated region sc and the transition region sp.
In designating the transition area sp, the shape of the transition area sp may be limited to be similar to the designation area sc. In the designation of the transition area sp, the position corresponding to the reference frequency value and the sound image position is designated in the designated area sc, and then the reference position is designated in the transition area sp. Even if the shape of the region sp changes, the reference position may be fixed.

[Modification 4]
In the first embodiment described above, the spectrum changing unit 172 changes the frequency spectrum of each channel so that the sound included in the designated region becomes the sound included in the transition region, but is included in the transition region. You may make it output to the 2nd conversion part 180 what changed the frequency spectrum so that a sound may become the sound contained in a designation | designated area | region. In this case, since the second conversion unit 180 acquires a plurality of sets of frequency spectra of each channel from the spectrum changing unit 172, each of them may be converted into an audio signal and synthesized for each channel.
Note that if the adjustment amount is set to 0% in the change setting unit 160 in both the designated area and the transition area, the audio in which the sound image position and the pitch are switched for the sound included in the designated area and the sound included in the transition area. A signal can also be output from the signal processing unit 100.

[Modification 5]
In the first embodiment described above, when changing the frequency spectrum, the spectrum changing unit 172 changes the lower limit of the frequency value and the sound image position so that it remains the lower limit of the frequency value and the sound image position after the change. The relationship between the upper limit and the lower limit may be changed.

[Modification 6]
In the first, second, and third embodiments described above, the level changing unit 171 adjusts the output level. However, the phase of the frequency spectrum may be changed in a predetermined manner. . As a mode of change, the phase may be changed randomly.

[Modification 7]
In the first, second, and third embodiments described above, the display control unit 140 displays the sound image calculation results displayed in the window w1 of the display screen 131 in the form of dots corresponding to the sound image positions corresponding to the respective frequency values. However, it may be displayed in other display modes. The example of the display mode in the modification 7 is demonstrated using FIG.

  FIG. 13 is a diagram illustrating a display example of the display screen 131 according to Modification 7 of the present invention. FIG. 13A is an enlarged view of a part of the window w1. As shown in FIG. 13A, the display control unit 140 displays a mesh-divided area (hereinafter, each divided area is referred to as a mesh area m1) in the window w1, and is included in each mesh area m1. The color intensity of the mesh area is changed according to the sound image calculation result. For example, the display control unit 140 includes, among the frequency values corresponding to the sound image positions in the range formed by the mesh region m1, the number of frequency values included in the frequency in the range formed by the mesh region m1, that is, included in the mesh region m1. What is necessary is just to change the color intensity of the mesh area | region m1 according to the number of sounds to be produced. Further, the display control unit 140 may change the color intensity of the mesh region m1 according to the output level of the sound included in the mesh region m1.

As another example, as shown in FIG. 13 (b), a figure (in this example, a circle centered on the center of gravity of the mesh area) corresponding to the mesh area is displayed. Also good. In this case, the diameter of the circle may be changed according to the number of sounds included in the mesh area.
In the case where the display is divided into mesh areas in this way, the area setting unit 150 may set the designated area with one mesh area as a minimum unit.

In this way, when transmitting and receiving information for display between devices, such as when the signal processing unit 100 and the display unit 13 are separate devices, the amount of information transmitted and received can be reduced. The display control unit 140 can also display the sound image calculation result on a display screen with a small number of pixels.
The display mode of the mesh area described above is changed according to the sound image calculation result for each frame, but may be changed according to the sound image calculation results for a plurality of temporally continuous frames.

[Modification 8]
In the first, second, and third embodiments described above, the designation of the area performed by the user in order to cause the area setting unit 150 to set the designated area can be performed separately in the axial direction of the frequency and the axial direction of the sound image position. You may do it. In this case, the display mode in the window w1 of the display screen 131 may be changed according to the designated axial direction. A display example of the display screen 131 when the axial direction of the frequency, that is, the range of the frequency value is designated and fixed in advance and the range of the sound image position is designated will be described with reference to FIG.

  FIG. 14 is a diagram illustrating a display example of the display screen 131 when the designated region sc and the transition region sp in the modified example 8 of the present invention are designated with a fixed frequency range. FIG. 14A is a diagram illustrating the currently designated area sc. In this state, when the user operates the operation button of the window w2 or the like to give an instruction to fix the frequency axial direction and specify only the axial direction of the sound image position, the display control unit 140 changes the display mode of the window w1. In this example, as shown in FIG. 14B, in the window w1, the frequency axis direction is changed to a mode in which only the designated frequency range of the designated area sc is displayed.

By being displayed in this way, and by being restricted so that the axial direction of the frequency cannot be changed from the designated frequency range in the designated region set by the region setting unit 150, the user can change the sound image position. It is possible to designate the designated sound image range of the designated area sc by paying attention only to the axial direction. In addition, the transition region sp can be easily set to have the same frequency range as that of the designated region sc.
It should be noted that a plurality of types of templates for determining the designated area in which the designated frequency range is determined in advance are stored in the storage unit 14, and the user selects one of the templates to display the display control unit. The designated frequency range when the designated area is designated may be fixed by the display by 140 and the setting restriction by the area setting unit 150. For example, if a template with a specified frequency range corresponding to the frequency range corresponding to the performance sound of the instrument is provided for each instrument type, the user can select the instrument type and select the instrument range. A designated frequency range corresponding to can be determined.
Further, in the display mode shown in FIG. 14B, the sound image calculation result in the specified frequency range is limited, but a different display mode may be used.

  FIG. 15 is a diagram for explaining another display example of the display screen 131 when the designated region sc and the transition region sp in the modified example 8 of the present invention are designated with a fixed frequency range. In the example shown in FIG. 15A, for the sound image calculation result displayed in the window w1 shown in FIG. 14B, the sound image position is divided into predetermined ranges, and the sound image calculation result indicating the sound image position in each range is shown. Is an example in which histograms are collectively displayed regardless of frequency values. In this histogram, the horizontal axis indicates the sound image positions in each range, and the vertical axis indicates the number of frequency values corresponding to the sound image positions in each range. The vertical axis may indicate the sum of output levels of sounds corresponding to the sound image positions in each range. As described above, when the designated frequency range is determined in advance, the user does not need to recognize the coordinate axis of the frequency, and thus may be changed to an axis corresponding to the frequency of the histogram.

Moreover, as shown in FIG.15 (b), you may display in barcode form. The display mode shown in FIG. 15B represents a value corresponding to the frequency shown in FIG. 15A as the thickness of the line. As described above, when the designated frequency range is fixed, the display control unit 140 may change the display so as not to use the frequency coordinate axis.
In the above example, the case where the designated frequency range is fixed has been described, but the present invention can also be applied to the case where the designated sound image range is fixed. For example, when the display mode illustrated in FIG. 14B is used, only the sound image calculation result included in the designated sound image range may be displayed.

[Modification 9]
In the first, second, and third embodiments described above, only one window w1 is displayed on the display screen 131. However, a plurality of windows w1 may be switched and displayed. A case of applying to the first embodiment will be described with reference to FIG.

  FIG. 16 is a diagram for explaining a display example of the display screen 131 in Modification 9 of the present invention. As shown in FIG. 16A, tabs wt1, wt2,... For selecting which of the plurality of windows w1 are to be displayed are provided in the upper part of the window w1. In this example, when the tab wt1 is selected, it is the same as the above-described embodiment. When the tab wt2 is selected, a window w1 corresponding to the tab wt2 is displayed.

  The window w1 corresponding to each tab may display the content of signal processing in parallel for each tab in the configuration of the above-described embodiment or the like, or display the content of signal processing in series. Also good. The signal processing according to the display content of the window w1 corresponding to the selected tab may be executed, and the signal processing according to the display content of the window w1 corresponding to the unselected tab may not be executed. In this case, the user can easily compare the effects by switching the tabs to be selected and confirming the sound contents to switch what acoustic effects can be obtained in the display contents of the window w1 in each tab. can do. In the case of parallel processing, the signal processing unit 100 may be configured so that audio signals obtained as a result of the parallel processing are mixed and output. At this time, the mix ratio may be controlled according to a user instruction. In addition, the audio signal of the same music may be used for the audio signal processed in parallel, and the audio signal of another music may be used.

  On the other hand, serial processing refers to the following processing. First, the audio signal acquired in the acquisition unit 110 is subjected to signal processing in the level changing unit 171 and the spectrum changing unit 172 in accordance with the display content of the window w1 corresponding to the tab wt1. The signal processing is performed on the result of the signal processing according to the display content of the window w1 corresponding to the tab wt2. As described above, the serial processing means that the result processed based on the display content in the window w1 of one tab is further processed based on the display content in the window w1 of another tab.

  When processing in series in this way, the display mode of the window w1 of the tab wt2 may be as shown in FIG. In this example, it is assumed that the designated area sc1 and the migration area sp1 are set as shown in FIG. In this case, as shown in FIG. 16B, in the window w1 corresponding to the tab wt2, the display state of the sound image calculation result corresponding to the designated area sc1 and the transition area sp1 is changed (in this example, Display is turned off. Then, based on this content, designation for setting the designated area sc2 and the migration area sp2 by the user is performed.

  Note that the processing in parallel and the processing in series may coexist. For example, tabs wt1 and wt2 may be processed in series, and tab wt3 may be processed in parallel with tabs wt1 and wt2. The windows w1 corresponding to the tabs may be displayed side by side on the display screen 131 at the same time.

[Modification 10]
In the first, second, and third embodiments described above, the display control unit 140 may display the adjustment amount set for the designated area and the transition area in the designated area and the transition area displayed in the window w1. . In addition, information indicating the range of frequency values and the range of sound image positions in the designated area and transition area may be displayed.
At this time, the display position of the set adjustment amount may be changed according to a position where the user touches the touch sensor 121 (hereinafter, referred to as a contact position in this modification). Specifically, the display control unit 140 displays the adjustment amount at a position away from the contact position by a certain distance. In this way, it is possible to prevent the user from losing the adjustment amount with his / her finger during operation.

[Modification 11]
In the embodiment described above, the shape of the designated area is a rectangle, but may be a shape other than a rectangle. The shape of the designated area may be determined by the user using the operation buttons displayed in the window w2. In addition, the user may designate various shapes by operating the user to trace the area to be set as the designated area.

FIG. 17 is a diagram illustrating the designated area sc and the transition area sp set in the eleventh modification of the present invention. The shape of the designated area sc shown in FIG. 17 is an example of the shape when the area is designated by the user tracing the touch sensor 121. When the designated region has a shape other than a rectangle, the designated frequency range and the designated sound image range cannot be determined as in the embodiment, but the level changing unit 171 and the spectrum changing unit 172 specify the shape of the designated region sc. The frequency value to be extracted can be determined by acquiring the coordinate information and specifying the designated sound image range for each frequency value.
The area setting unit 150 sets the inside of the area designated by the user as the designated area, but may set the outside as the designated area.
The designated area sc has been described above, but the same applies to the transition area sp.

[Modification 12]
In the embodiment described above, the display control unit 140 may display the range of the designated area in a manner corresponding to the adjustment amount set for the designated area. The display control unit 140 may display the range of the designated area so that, for example, the adjustment amount set in the designated area is represented by a color difference, darkness, transmission amount, pattern change, or the like. . In addition, the display control unit 140 may change the display mode of each point in accordance with the adjustment amount set for the designated area for the sound image calculation result displayed in the designated area.
Although the designated area has been described above, the same applies to the transition area.

[Modification 13]
In the above-described embodiment, the first conversion unit 120 extracts the output level for each frequency value as a feature quantity dependent on the frequency, and the sound image position calculation unit 130 is a relation value indicating the relationship between the output levels between the channels. Was calculated. The feature amount and the relation value may be other contents. For example, the feature amount may be a phase for each frequency value, and the relationship value may be a phase difference between the channels. In this case, the display control unit 140 may control the display content on the assumption that the coordinate system used for display in the window w1 uses the coordinate axis of the phase difference instead of the coordinate axis of the sound image position.

[Modification 14]
In the embodiment described above, the acquisition unit 110 acquires a stereo 2ch audio signal, but may acquire audio signals of more channels such as 5.1ch. In this case, the sound image position calculation unit 130 calculates a relation value corresponding to the relationship of the output levels between the channels based on the output levels in all the channels corresponding to each frequency value. Remember. This calculation formula is, for example, a direction viewed from a listening position when output from a speaker arranged according to a specific standard (such as ITU-R BS.775-1) (for example, in a horizontal plane with a specific direction as a reference). The sound image position (relation value) represented by (the angle) may be an expression for calculating from the difference in the output level of each channel.

Then, the sound image position calculation unit 130 may calculate a relation value corresponding to each frequency value using this calculation formula, and output information indicating the calculation result. In this case, the display control unit 140 may control the display content by assuming that the coordinate system used for display in the window w1 uses the coordinate axis of the above relational value instead of the coordinate axis of the sound image position.
In addition, when acquiring an audio signal of channels larger than 2ch, the acquisition unit 110 may mix down to 2ch and output it, or may extract and output specific 2ch. .

[Modification 15]
In the embodiment described above, the area setting unit 150 sets the area specified by the user's operation on the touch sensor 121 as the specified area, but the specified area may be set in another manner. . For example, the designated area specifying information that defines the range of the designated area is stored in advance, and the area setting unit 150 may acquire the designated area specifying information according to an instruction from the user and set the designated area.

The specified area specifying information may be further defined such that the range of the specified area changes with the progress of time. The change in the range of the designated area includes a change in the shape of the designated area, a change (movement) of the position of the designated area, and the like. In this case, the area setting unit 150 may set a range that changes with time as the designated area. The content of this change may be determined by analyzing the content of the audio signal. For example, if the audio signal is a music piece, the tempo of the music piece is detected from the time-series change of the volume of the audio signal, and the specified area specifying information defines that the movement mode or the shape of the specified area changes according to the tempo. May be. The designated area specifying information may be defined so as to change according to the sound image calculation result. For example, the designated area specifying information may be defined so that a range in which points indicating sound image calculation results of a certain density or higher with a sound image position other than the center are gathered is set as the designated area.
That is, the specified area specifying information may be information specified according to a predetermined algorithm, and may be an algorithm that randomly changes the range of the specified area using a generated random number or the like.

As another aspect, the region setting unit 150 may set the designated region according to the motion signal output from the posture detection unit 15. For example, when there is a designated area that is already set by a user operation or the like, the area setting unit 150 may move the designated area by tilting or shaking the terminal 1. . For example, when the right side of the display screen 131 is tilted so as to approach the ground, the area setting unit 150 may move the designated area to be set to the right side.
Although the designated area has been described above, the same applies to the transition area.

[Modification 16]
In the first embodiment described above, the frequency spectrum of each channel is changed so that the sound included in the designated region becomes the sound included in the transition region. At this time, the correspondence between the frequency value, which is the sound image calculation result, and the sound image position is the parallel movement from the designated area to the transition area in the coordinate system displayed in the window w1, Not limited. For example, the frequency spectrum may be changed according to an algorithm that does not cause parallel movement as long as it is included in the frequency value range and the sound image position range in the transition region. As such an algorithm, the frequency value or the sound image position may be randomly changed in the range of the frequency value and the range of the sound image position in the transition region.

  In such a case, the transition area need not be set. In this case, the frequency value or the sound image position may be changed in the designated frequency range and the designated sound image range, or the frequency value or the sound image position may be changed regardless of these ranges. .

[Modification 17]
In the above-described embodiment, the display control unit 140 displays the sound image calculation result on the window w1 of the display screen 131 using a coordinate system having two axes of the frequency coordinate axis and the sound image position coordinate axis. You may display using the coordinate system which has many axes | shafts. For example, in the case where the relationship value corresponding to the frequency value includes not only the sound image position but also a phase difference as shown in the modified example 13, three axes of a frequency coordinate axis, a sound image position coordinate axis, and a phase difference coordinate axis are provided. A coordinate system having

  When display is performed using a coordinate system having three axes, the display control unit 140 displays in the window w1 a coordinate system having a frequency coordinate axis and a sound image position coordinate axis, and the frequency coordinate axis and the phase difference. Two displays such as a display in a coordinate system having coordinate axes may be used instead of a display in a coordinate system having three axes, or an image representing a three-axis coordinate system in a pseudo manner may be displayed. Further, when the display screen 131 is a stereoscopic display or the like, an image in which a three-axis coordinate system is three-dimensionally displayed may be displayed.

  When a three-axis coordinate system is expressed, when a region to be set as a designated region is designated, the user may designate the region in a state where the region is once displayed after being replaced with the two-axis coordinate system. .

[Modification 18]
In the above-described embodiment, the display control unit 140 uses logarithmic display for the coordinate axis of the frequency of the window w1, but it may be linear display. In the case of linear display, as shown in the first embodiment, when the frequency value is changed so as to maintain the overtone ratio, the shape of the designated area sc and the transition area sp is different. On the other hand, the frequency ratio may be changed by adding or subtracting the entire frequency value without maintaining the overtone ratio. In this case, the shape of the designated region sc and the transition region sp does not change in the linear display, and the shape changes in the logarithmic display as shown in the embodiment. When the frequency value is changed by addition or subtraction, the interval between the frequency values does not change before and after processing in the spectrum conversion unit 172. Therefore, in the second conversion unit 180, the IFFT process applied to the frequency spectrum output from the level changing unit 171 and the IFFT process applied to the frequency spectrum output from the spectrum conversion unit 172 can be the same.

[Modification 19]
The control program in the above-described embodiment is provided in a state stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. Can do. Further, the terminal 1 may download the control program via a network.

DESCRIPTION OF SYMBOLS 1 ... Terminal, 11 ... Control part, 12 ... Operation part, 13 ... Display part, 14, 14A, 14B ... Memory | storage part, 15 ... Attitude detection part, 16 ... Interface, 17 ... Communication part, 121 ... Touch sensor, 122 ... Operation buttons, 131 ... display screen, 100, 100A, 100B ... signal processing unit, 110 ... acquisition unit, 120 ... first conversion unit, 130 ... sound image position calculation unit, 140 ... display control unit, 150 ... area setting unit, 160 , 160A, 160B ... change setting unit, 171, 171A, 171B ... level change unit, 172, 172A ... spectrum change unit, 172B ... acoustic effect applying unit, 180 ... second conversion unit, 190 ... output unit

Claims (5)

Acquisition means for acquiring audio signals of a plurality of channels;
First conversion means for converting the acquired audio signal of each channel into a first frequency spectrum showing frequency dependence of a feature amount including at least an output level;
A calculation means for calculating a relation value corresponding to the relation of the feature quantity between each channel based on the first frequency spectrum in correspondence with each frequency value;
Display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having the coordinate axis of the frequency value and the coordinate axis of the relation value;
Area setting means for setting a partial area in the coordinate system as a designated area;
A change mode setting means for setting a change mode for changing the correspondence relationship between the frequency value and the relationship value in the calculation result included in the designated region to a different correspondence relationship;
Spectrum changing means for changing the first frequency spectrum of each channel to a second frequency spectrum based on the change mode;
Second conversion means for converting the second frequency spectrum into an audio signal of each channel;
And an output means for outputting the audio signal converted by the second conversion means. A first level for extracting a frequency value corresponding to the calculation result included in the designated region and changing an output level corresponding to the extracted frequency value in the first frequency spectrum by a predetermined adjustment amount. Further comprising a change means,
The second converting means further converts the first frequency spectrum whose output level is changed by the first level changing means into an audio signal of each channel,
The signal processing apparatus according to claim 1, wherein the output unit synthesizes and outputs a plurality of audio signals converted by the second conversion unit for each channel. A frequency value corresponding to the calculation result included in the designated region and a region determined according to the change mode is extracted, and an output level corresponding to the extracted frequency value in the first frequency spectrum is determined in advance. And a second level changing means for changing by the adjusted amount,
The second converting means further converts the first frequency spectrum whose output level is changed by the second level changing means into an audio signal of each channel,
The signal processing apparatus according to claim 1, wherein the output unit synthesizes and outputs the plurality of audio signals converted by the second conversion unit for each channel. Acquisition means for acquiring audio signals of a plurality of channels;
First conversion means for converting the acquired audio signal of each channel into a first frequency spectrum showing frequency dependence of a feature amount including at least an output level;
A calculation means for calculating a relation value corresponding to the relation of the feature quantity between each channel based on the first frequency spectrum in correspondence with each frequency value;
Display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having the coordinate axis of the frequency value and the coordinate axis of the relation value;
Area setting means for setting a partial area in the coordinate system as a designated area;
Storage means for storing a template indicating a frequency spectrum of a plurality of channels indicating a predetermined sound;
Spectrum changing means for changing the template stored in the storage means to a second frequency spectrum based on a range of frequency values and relationship values indicated by the designated area;
Level changing means for extracting a frequency value corresponding to the calculation result included in the designated region and changing an output level corresponding to the extracted frequency value in the first frequency spectrum by a predetermined adjustment amount. When,
Second conversion means for converting the second frequency spectrum and the first frequency spectrum whose output level is changed by the level changing means into audio signals of respective channels;
Output means for combining and outputting a plurality of audio signals converted by the second conversion means for each channel. Acquisition means for acquiring audio signals of a plurality of channels;
First conversion means for converting the acquired audio signal of each channel into a first frequency spectrum showing frequency dependence of a feature amount including at least an output level;
A calculation means for calculating a relation value corresponding to the relation of the feature quantity between each channel based on the first frequency spectrum in correspondence with each frequency value;
Display control means for displaying a calculation result by the calculation means on a display screen using a coordinate system having the coordinate axis of the frequency value and the coordinate axis of the relation value;
Area setting means for setting a partial area in the coordinate system as a designated area;
Sound effect setting means for setting a sound effect for the designated area;
Each of the frequency values corresponding to the calculation result included in the designated region is extracted, and the acoustic effect is applied to the sound indicated by the output level corresponding to the extracted frequency value in the first frequency spectrum. Sound effect applying means for generating an audio signal of the channel;
Level changing means for extracting a frequency value corresponding to the calculation result included in the designated region and changing an output level corresponding to the extracted frequency value in the first frequency spectrum by a predetermined adjustment amount. And second conversion means for converting the first frequency spectrum whose output level has been changed by the level changing means into an audio signal of each channel;
A signal processing apparatus comprising: an output unit configured to synthesize and output the audio signal generated by the acoustic effect applying unit and the audio signal converted by the second conversion unit for each channel.

Images