JP5826996B2 - Acoustic signal conversion device and program thereof, and three-dimensional acoustic panning device and program thereof - Google Patents

Description

  The present invention relates to an acoustic signal conversion device that converts an acoustic signal corresponding to a certain number of channels into an acoustic signal that corresponds to a number of channels different from the number of channels, a program thereof, and a three-dimensional acoustic panning device and a program thereof.

  Conventionally, a downmix method for converting an audio signal for a 5.1 channel surround system into an audio signal for a 2 channel stereo system is defined by the ITU-R (International Telecommunication Union Radiocommunication Division) standard. .

In addition to this, various technologies for converting content (acoustic signals) produced for a certain acoustic system into content (acoustic signals) for other acoustic systems having different numbers of channels and speakers (audio signals) are disclosed ( For example, see Patent Document 1).
The invention described in Patent Document 1 includes an original sound field vector whose component is a physical quantity of an acoustic signal (original acoustic signal) in an original sound field, and a physical quantity of an acoustic signal (reproduced acoustic signal) in a reproduced sound field as components. A conversion matrix that minimizes a square error with the original sound field vector is obtained, and the original sound signal is converted into a reproduction sound signal corresponding to a predetermined speaker (channel) in the reproduction sound field.

In recent years, various techniques for three-dimensional panning of a virtual sound image in a vertical direction, a horizontal direction, and a front-rear direction using a plurality of speakers have been disclosed (see, for example, Patent Document 2).
In the invention described in Patent Document 2, an acoustic physical quantity vector such as a sound pressure vector indicating the direction of sound pressure at a sound receiving point is used as a virtual sound image assumed by a speech engineer, and a plurality of speakers in an actual three-dimensional sound system. The sound signal is converted into an acoustic signal corresponding to a plurality of predetermined speakers by matching with the sound image formed by.

JP 2009-218655 A JP 2007-194900 A

  According to the above-described conventional technology, the number of channels of an acoustic signal can be arbitrarily converted. For example, for an acoustic system using a large number of speakers such as 22.2 multi-channel system for Super Hi-Vision and WFS (Wave Field Synthesis). Can be converted into content that can be played back with a small number of speakers, such as at home. Further, for example, when producing content of a 22.2 multi-channel system, the content produced for the 5.1 channel surround system can be used.

  However, in the conventional technique, it is necessary to previously determine a plurality of converted channels (speakers) for distributing the acoustic signal for each acoustic signal of the original channel. That is, in the conventional technology, when converting to an acoustic signal for another acoustic system having a different number of channels or speakers, conversion into a reproduced acoustic signal of a predetermined channel (speaker) without impairing realism is possible. However, there has been no disclosure of a method for automatically selecting three channels as a basic unit for three-dimensional sound reproduction from a large number of channels (speakers).

  In addition, there is no conventional technique for automatically selecting a converted channel when converting an acoustic signal corresponding to a certain number of channels into an acoustic signal corresponding to a number of channels different from the number of channels. There was a strong demand for automation.

  The present invention has been made in view of the above-described demands. When an acoustic signal corresponding to a certain number of channels is converted into an acoustic signal having a different number of channels, three-dimensionally, among the channels on the reproduction side, the present invention has been made. It is an object of the present invention to provide an acoustic signal converter and its program capable of automatically selecting three channels as basic units for sound reproduction, and a three-dimensional acoustic panning device and its program.

  The present invention has been devised to solve the above problems. First, the acoustic signal converter according to claim 1 converts an original acoustic signal having one or more channels into a reproduced acoustic signal having a different number of channels. The acoustic signal conversion device to be converted is configured to include storage means, reproduction channel determination means, weight coefficient calculation means, and acoustic signal distribution means.

In such a configuration, the acoustic signal conversion apparatus stores the position of the original speaker corresponding to the channel of the original acoustic signal and the position of the reproduction speaker corresponding to the channel of the reproduced acoustic signal in the storage unit. These positions are coordinate positions with the sound receiving point in the three-dimensional acoustic space as the origin.
Then, the acoustic signal conversion device uses the reproduction channel determination unit to generate three reproduction speakers based on the position of each speaker stored in the storage unit, with the sound receiving point in the three-dimensional acoustic space as the origin for each original speaker. A set of three reproduction speakers including the direction of the original speaker is determined in the direction area specified by the direction. As a result, three reproduction speakers capable of reproducing the original sound signal of one original speaker in a three-dimensional space are selected.

Then, the acoustic signal conversion device supports the original speaker based on the position of the original speaker by the weighting coefficient calculation means and each position of the reproduction speaker set determined by the reproduction channel determination means for the original speaker. A set of reproduction speakers according to an arithmetic expression determined in advance so that the acoustic physical quantity at the sound receiving point of the original sound signal to be matched matches the acoustic physical quantity at the sound receiving point of the reproduced sound signal corresponding to the determined reproduction speaker set. The distribution ratio of the original sound signal to each reproduction speaker is calculated as a weighting coefficient. Note that this distribution ratio is based on the condition that if the position of one original speaker and the position of three reproduction speakers are specified, the acoustic physical quantities coincide with each other at the sound receiving point. The distribution ratio (weighting coefficient) of each reproduction channel with respect to the signal is uniquely specified.
Then, the acoustic signal converter distributes the original acoustic signals having the number of channels of 1 or more by the acoustic signal distribution unit based on the weighting factor to the reproduction speaker with respect to the original speaker calculated by the weighting factor calculation unit, and reproduces it. A reproduced sound signal having the number of channels corresponding to the speaker is generated.

Furthermore, the acoustic signal conversion apparatus according to claim 1, playback channel determining means for each original speaker, in the virtual sphere the sound receiving point with the origin, the direction of the original speaker from the origin, three reproduction speaker An inclusion relation determining means for determining whether or not to be included in a spherical triangle specified by the direction of the original sound, and selecting a plurality of directions of three reproduction speakers constituting the spherical triangle including the direction of the original speaker, and this inclusion And a spherical triangle selection means for selecting a set of three reproduction speakers constituting a spherical triangle that minimizes the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the relationship determination means. .

  In such a configuration, the acoustic signal conversion device selects a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker by the inclusion relation determining means. There are a plurality of spherical triangles including this one direction. Therefore, the acoustic signal conversion device selects a set of three reproduction speakers constituting the spherical triangle having the smallest area of the spherical triangle by the spherical triangle selection means. This is because if the area of the spherical triangle is large, the sound image localization by the three reproduction speakers may become unclear.

The acoustic signal converter according to claim 2 is an acoustic signal converter for converting an original acoustic signal having one or more channels into a reproduced acoustic signal having a different number of channels, a storage unit, a reproduction channel determination unit, The weight coefficient calculation means and the acoustic signal distribution means are provided.
Furthermore, in the acoustic signal conversion device according to claim 2, the reproduction channel determining means has a virtual spherical surface with the sound receiving point as the origin for each original speaker, and the direction of the original speaker from the origin is that of the three reproduction speakers. An inclusion relationship determining means for determining whether or not to be included in a spherical triangle specified by a direction and selecting a plurality of directions of three reproduction speakers constituting the spherical triangle including the direction of the original speaker; and the inclusion relationship Spherical triangle selection means for selecting a plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles in ascending order of the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the determination means; It was set as the structure provided.

  In such a configuration, the acoustic signal conversion device selects a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker by the inclusion relation determining means, and the spherical triangle selection means in advance in ascending order of area. A set of three reproduction speakers constituting a predetermined number of spherical triangles is selected.

Then, the acoustic signal converter uses the weighting factor calculation means to set the weighting factor calculated for each of the three reproduction speakers as a temporary weighting factor, and further according to the inverse of the area of the spherical triangle selected by the spherical triangle selection means. By multiplying the temporary weighting factor by the value , the weighting factor of the original sound signal for the reproduction speaker is calculated. As a result, the original sound signal for one channel is distributed to a predetermined number of reproduction speakers including three reproduction speakers.

The acoustic signal conversion program according to claim 3, in order to convert one or more of the number of channels of the original audio signal in different playback sound signals channel number, a computer, playback channel determining means, the weighting factor calculation means, The acoustic signal distribution means is configured to function.
Furthermore, in the acoustic signal conversion program according to the third aspect, the reproduction channel determination means has a virtual spherical surface with the sound receiving point as the origin for each original speaker, and the direction of the original speaker from the origin corresponds to the three reproduction speakers. It is determined whether or not it is included in the spherical triangle specified by the direction, a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker are selected, and the three reproduction speakers of the selected three reproduction speakers are selected. The configuration is such that a set of three reproduction speakers constituting the spherical triangle that minimizes the area of the spherical triangle specified by the direction is selected.

According to another aspect of the present invention, there is provided an audio signal conversion program for converting a source audio signal having one or more channels into a reproduction audio signal having a different number of channels, a reproduction channel determination unit, a weight coefficient calculation unit, The acoustic signal distribution means is configured to function.
Furthermore, in the acoustic signal conversion program according to the fourth aspect, the reproduction channel determination means has a virtual spherical surface with the sound receiving point as the origin for each original speaker, and the direction of the original speaker from the origin corresponds to the three reproduction speakers. It is determined whether or not it is included in the spherical triangle specified by the direction, a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker are selected, and the three reproduction speakers of the selected three reproduction speakers are selected. A plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles are selected in ascending order of the area of the spherical triangle specified by the direction. Then, the weighting factor calculation means sets the weighting factor calculated for each of the three reproduction speakers as a temporary weighting factor, and further sets a value corresponding to the reciprocal of the area of the spherical triangle specified in the direction of the three reproduction speakers, By multiplying the temporary weighting factor, the weighting factor of the original sound signal for the reproduction speaker is calculated.

  The three-dimensional acoustic panning apparatus according to claim 5 is a three-dimensional acoustic panning apparatus that generates a reproduced acoustic signal of a plurality of channels that localizes an original acoustic signal serving as a sound source as a sound image at a specified localization position. And a reproduction channel determination means, a weight coefficient calculation means, and an acoustic signal distribution means.

In such a configuration, the acoustic signal conversion device stores the position of the reproduction speaker corresponding to the channel of the reproduction acoustic signal in the storage unit. This position is a coordinate position with the sound receiving point in the three-dimensional acoustic space as the origin.
The three-dimensional sound panning apparatus uses the sound receiving point in the three-dimensional sound space as the origin based on the position of the reproduction speaker stored in the storage means and the specified localization position by the reproduction channel determination means. A set of three reproduction speakers including the direction of the localization position is determined in the direction area specified by the directions of the two reproduction speakers. As a result, three reproduction speakers capable of reproducing the original sound signal as a sound source at a localization position in the three-dimensional space are selected.

The three-dimensional sound panning apparatus receives the original sound signal based on the localization position by the weighting coefficient calculation means and each position of the reproduction speaker set determined by the reproduction channel determination means with respect to the localization position. Based on a predetermined arithmetic expression so that the acoustic physical quantity at the sound point matches the acoustic physical quantity at the sound receiving point of the reproduced sound signal corresponding to the determined reproduction speaker set, the source for each reproduction speaker of the reproduction speaker set is determined. The distribution ratio of the acoustic signal is calculated as a weighting factor.
In the three-dimensional sound panning apparatus, the sound signal distribution unit distributes the original sound signal based on the weighting factor calculated by the weighting factor calculation unit, and generates a playback sound signal for each playback speaker.

Furthermore, in the three-dimensional acoustic panning apparatus according to claim 5, the reproduction channel determination means specifies the direction of the localization position from the origin in the direction of the three reproduction speakers in the virtual spherical surface with the sound receiving point as the origin. An inclusion relationship determining means for determining whether or not the image is included in a spherical triangle and selecting a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the localization position; And a spherical triangle selection means for selecting a set of three reproduction speakers constituting a spherical triangle that minimizes the area of the spherical triangle specified in the direction of the three reproduction speakers.

  In such a configuration, the three-dimensional acoustic panning apparatus selects a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the localization position by the inclusion relation determining unit. Then, the three-dimensional acoustic panning apparatus selects a set of three reproduction speakers constituting the spherical triangle that minimizes the area of the spherical triangle by the spherical triangle selection means. As a result, three reproduction speakers to which the original sound signal is distributed are specified.

The three-dimensional acoustic panning apparatus according to claim 6 is a three-dimensional acoustic panning apparatus that generates a reproduced acoustic signal of a plurality of channels that localizes an original acoustic signal serving as a sound source as a sound image at a specified localization position. And a reproduction channel determination means, a weight coefficient calculation means, and an acoustic signal distribution means.
Furthermore, 3-dimensional acoustic panning device according to claim 6, playback channel determining means, in the virtual sphere in which the sound receiving point as the origin, the direction of the localization position from the origin, identified in the direction of the three reproduction speaker An inclusion relation determining means for selecting a plurality of directions of three reproduction speakers constituting the spherical triangle including the direction of the localization position, and selecting by this inclusion relation determining means And a spherical triangle selection means for selecting a plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles in ascending order of the area of the spherical triangle specified by the direction of the three reproduction speakers. .

In such a configuration, the three-dimensional acoustic panning apparatus selects a plurality of directions of the three reproduction speakers constituting the spherical triangle that includes the direction of the localization position by the inclusion relation determining unit, and the spherical triangle selection unit by the order of the smaller area. A set of three reproduction speakers constituting a predetermined number of spherical triangles is selected.
The three-dimensional acoustic panning apparatus uses the weight coefficient calculated for each of the three reproduction speakers by the weight coefficient calculation means as a temporary weight coefficient, and further according to the inverse of the area of the spherical triangle selected by the spherical triangle selection means. the value is multiplied by the weighting coefficient of the temporary, it calculates the weight coefficient of the original audio signal for playback speaker. As a result, the original sound signal is distributed to a predetermined number of reproduction speakers each including three reproduction speakers.

According to a seventh aspect of the present invention, there is provided a three-dimensional sound panning program for determining a reproduction channel to generate a reproduction sound signal of a plurality of channels for localizing an original sound signal serving as a sound source as a sound image at a specified localization position. It is configured to function as a means, a weight coefficient calculation means, and an acoustic signal distribution means.
Furthermore, in the three-dimensional sound panning program according to claim 7, the reproduction channel determination means specifies the direction from the origin to the localization position in the direction of the three reproduction speakers in the virtual spherical surface with the sound receiving point as the origin. It is determined whether or not it is included in a spherical triangle, a plurality of three reproduction speaker directions constituting the spherical triangle including the direction of the localization position are selected, and a spherical surface specified by the selected three reproduction speaker directions A set of three reproduction speakers constituting a spherical triangle having the smallest triangular area was selected.

The three-dimensional sound panning program according to claim 8 is configured to determine a reproduction channel in order to generate a reproduction sound signal of a plurality of channels for localizing an original sound signal serving as a sound source as a sound image at a specified localization position. It is configured to function as a means, a weight coefficient calculation means, and an acoustic signal distribution means.
Furthermore, in the three-dimensional sound panning program according to claim 8, the reproduction channel determination means specifies the direction from the origin to the localization position in the direction of the three reproduction speakers in the virtual spherical surface having the sound receiving point as the origin. It is determined whether or not it is included in the spherical triangle, a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the localization position are selected, and the direction of the selected three reproduction speakers is specified. A plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles are selected in ascending order of the area of the spherical triangle. Then, the weighting factor calculation means sets the weighting factor calculated for each of the three reproduction speakers as a temporary weighting factor, and further, a ratio according to the reciprocal of the area of the spherical triangle specified in the direction of the three reproduction speakers, By multiplying the temporary weighting factor, the weighting factor of the original sound signal for the reproduction speaker is calculated.

The present invention has the following excellent effects.
According to the first to fourth aspects of the present invention, when the original sound signal corresponding to a certain number of channels is converted into a reproduced sound signal corresponding to the number of channels different from the number of channels, only the position of the speaker is set. Thus, it is possible to determine to which reproduction speaker the original sound signal is assigned without human intervention. Accordingly, the present invention can automatically convert the original sound signal into a reproduced sound signal having a different number of channels while maintaining a sense of reality.

According to the first to fourth aspects of the present invention, when the original sound signal corresponding to a certain number of channels is converted into a reproduced sound signal corresponding to the number of channels different from the number of channels, only the position of the speaker is set. Therefore, it can be automatically converted into a reproduced sound signal with a small number of channels without human intervention. Accordingly, the present invention can convert the original sound signal into a reproduced sound signal that can clearly reproduce a sound image with a small number of channels.

According to the fifth to eighth aspects of the present invention, when generating a reproduction sound signal of a plurality of channels that localizes an original sound signal serving as a sound source as a sound image at a specified localization position, the localization position and even the position of the speaker are generated. If set, it is possible to determine to which reproduction speaker the original sound signal is assigned without human intervention. Thus, the present invention can automatically generate a reproduced sound signal capable of localizing the original sound signal at a designated position while maintaining a sense of reality.
According to the fifth to eighth aspects of the present invention, when generating a reproduction sound signal of a plurality of channels that localizes an original sound signal serving as a sound source as a sound image at a specified localization position, the localization position and even the speaker position are generated. If set, it can be automatically converted to a reproduced sound signal having a small number of channels without human intervention. Accordingly, the present invention can convert the original sound signal into a reproduced sound signal that can clearly reproduce a sound image with a small number of channels.

It is a block block diagram which shows the structure of the acoustic signal converter which concerns on 1st Embodiment of this invention. It is a figure for demonstrating the inclusion relation of a spherical triangle. It is a figure for demonstrating the area of a spherical triangle. It is a flowchart which shows operation | movement of the acoustic signal converter which concerns on 1st Embodiment of this invention. It is explanatory drawing for demonstrating the principle which makes an acoustic physical quantity correspond in a sound receiving point. It is a figure which shows the example of arrangement | positioning of a 22.2 channel speaker (except LFE). It is a figure which shows the example of arrangement | positioning of a 10 channel speaker. It is a figure which shows the weighting coefficient at the time of converting into the acoustic signal of the speaker arrangement | positioning of FIG. 7 from the acoustic signal of the speaker arrangement | positioning of FIG. It is a block block diagram which shows the structure of the three-dimensional sound panning apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows operation | movement of the three-dimensional sound panning apparatus which concerns on 2nd Embodiment of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
<First Embodiment>
[Configuration of acoustic signal converter]
Initially, with reference to FIG. 1, the structure of the acoustic signal converter which concerns on 1st Embodiment of this invention is demonstrated. The acoustic signal converter 1 converts an acoustic signal having a certain number of channels (n channels) into an acoustic signal having a number of channels (m channels) different from the number of channels. In the following description, an input n-channel acoustic signal is expressed as an n-dimensional vector signal s (t) = (s ₁ (t) s ₂ (t)... S _n (t)) ^T. The output m-channel acoustic signal is expressed as m-dimensional vector signal q (t) = (q ₁ (t) q ₂ (t)... Q _m (t)) ^T. T indicates vector transposition. Also, the channel of the input acoustic signal (original acoustic signal) is referred to as the original sound channel, and the channel of the output acoustic signal (reproduced acoustic signal) is referred to as the reproduction channel.

  Here, the acoustic signal conversion device 1 includes a Fourier transform unit 10, a speaker position input unit 20, a storage unit 30, a weight matrix calculation unit 40, an acoustic signal distribution unit 50, and a Fourier inverse transform unit 60. I have.

The Fourier transform means 10 inputs acoustic signals for an acoustic system having one or more channels (n channels) in time series, and performs Fourier transform on the acoustic signals of the respective channels. In this way, the Fourier transform unit 10 transforms the acoustic signal into a signal represented in the frequency domain by performing Fourier transform on the acoustic signal. The Fourier-transformed acoustic signal is output to the acoustic signal distribution means 50. Here, the input acoustic signal is expressed as a function s (t) in the time domain, whereas the acoustic signal after Fourier transform is expressed as a function in the frequency domain, and s (ω) = (s ₁ (ω) s ₂ (ω)... s _n (ω)) ^T.

  The number of acoustic signal channels input to the Fourier transform means 10 is not particularly limited. For example, in the case of an acoustic signal of a 22.2 multi-channel system for Super Hi-Vision, a low-frequency sound effect channel is used. There are 22 channels excluding a certain LFE (Low Frequency Effect) channel.

The speaker position input means 20 inputs position information (speaker position information) indicating a position in a three-dimensional acoustic space corresponding to a channel (original sound channel, reproduction channel). The speaker position information is information indicated by three-dimensional coordinates with the sound receiving point r = (x yz) ^T in the three-dimensional acoustic space as the origin (T is a transposition of a vector).

Here, the speaker position information is expressed in polar coordinates with the sound receiving point as the origin, and the position (original speaker position information) of the speaker (original speaker) of the original sound channel is expressed as ξ _i = (σ _i , θ _i , φ _i ). , I = 1, 2,..., N, and the position (reproduction speaker position information) of the reproduction channel speaker (reproduction speaker) is represented by ζ _j = (σ ′ _j , θ ′ _j , φ ′ _j ), j = 1, 2, ..., m. Σ _i and σ ′ _j are distances from the sound receiving point r, θ _i and θ ′ _j are azimuth angles, and φ _i and φ ′ _j are elevation angles.
The speaker position input unit 20 writes and stores the input speaker position information in the storage unit 30.

The storage unit 30 stores speaker position information (original speaker position information and reproduction speaker position information) input by the speaker position input unit 20 and is a general storage medium such as a hard disk or a memory.
In this storage means 30, original speaker position information ξ _i = (σ _i , θ _i , φ _i ) is stored in association with identification information i = 1, 2,..., N, and reproduced speaker position information ζ. _j = (σ ′ _j , θ ′ _j , φ ′ _j ) is stored in association with the identification information j = 1, 2,..., m.

The weight matrix calculating means 40 calculates a matrix (weight matrix) for converting the sound signal of the original sound channel into the sound signal of the reproduction channel. The weight matrix calculation means 40 outputs the weight matrix W obtained by the calculation to the acoustic signal distribution means 50.
Here, the weight matrix calculation means 40 includes an original sound channel selection means 41, a reproduction channel determination means 42, and a weight coefficient calculation means 43.

  The original sound channel selection unit 41 sequentially selects an original sound channel for each channel from the original speaker position information stored in the storage unit 30. Here, the original sound channel selection means 41 selects the positions of the original speakers in the order of i = 1, 2,..., N, and outputs them to the reproduction channel determination means 42.

The reproduction channel determination unit 42 determines a reproduction channel (reproduction speaker) that distributes an acoustic signal to the original sound channel (original speaker) selected by the original sound channel selection unit 41. The reproduction channel determination means 42 performs three reproductions including the direction of the original speaker in the direction area specified by the direction of the three reproduction speakers with the sound receiving point in the three-dimensional sound space as the origin for each original speaker. Determine the set of speakers.
At this time, the reproduction channel determination means 42 includes a spherical surface on the virtual spherical surface that includes the original speaker direction from the sound receiving point and includes three reproduction speaker directions from the sound receiving point in the virtual spherical surface with the sound receiving point as the origin. Among the triangles, the reproduction speakers existing in the three reproduction speaker directions having the smallest area are specified as the reproduction channels for one original sound channel. This makes it possible to specify three reproduction channels that distribute the sound signal of the original sound channel.
Here, the reproduction channel determination means 42 includes inclusion relation determination means 42a and spherical triangle selection means 42b.

  The inclusion relation determining means 42a determines whether or not the original speaker direction of the channel selected by the original sound channel selecting means 41 is included in a spherical triangle specified by the three reproduction speaker directions, and the original speaker direction. To specify three reproduction speaker directions. There are a plurality of three reproduction speaker directions including the original speaker direction. Therefore, the inclusion relation determining unit 42a selects a plurality of arbitrary sets of three reproduction speaker directions with respect to one original speaker direction, and outputs them to the spherical triangle selection unit 42b.

Here, whether or not the original speaker direction is included in the spherical triangle specified by the three reproduction speaker directions is determined based on each reproduction speaker direction ζ _j , starting from the sound receiving point r as shown in FIG. Inside the spherical triangle formed by three vertices where the half line extending j = 1, 2, 3 intersects the virtual sphere, the half line extending from the sound receiving point r to the original speaker direction ξ is the virtual sphere. Depends on whether intersecting points are included.

Here, an inclusion relationship determination method performed by the inclusion relationship determination unit 42a will be described. When the spherical surface having the sound receiving point as the origin is a sphere having a unit length radius (virtual spherical surface), the original speaker direction ξ can be expressed by ξ = (1, θ, φ), and three reproduction speakers. The directions ζ _j , j = 1, 2, 3 can be represented by ζ _j = (1, θ ′ _j , φ ′ _j ), j = 1, 2, 3. Hereinafter, when only the direction is expressed, the radial component “1” is omitted, the direction ξ = (θ, φ), the direction ζ _j = (θ ′ _j , φ ′ _j ), j = 1, 2. , 3.
At this time, whether or not the original speaker direction ξ is included in the three reproduction speaker directions ζ _j , j = 1, 2, 3 can be determined using a vector product.
Here, three vector products are defined by the following equation (1).

When the original speaker direction ξ is included in the spherical triangle specified by the three reproduction speaker directions ζ _j , j = 1, 2, 3, the three vectors V ₁ , V ₂ , V ₃ in the equation (1) are the same. It will face in the direction (the sign of each element is the same).
Therefore, the inclusion relationship determination unit 42a determines that the original speaker direction ξ is included in the three reproduction speaker directions ζ _j when a logical expression shown in the following expression (2) is satisfied.

In other words, the inclusion relation determining means 42a has three reproduction speakers that form a spherical triangle identified by the three reproduction speaker directions ζ _j when the three vectors V ₁ , V ₂ , and V ₃ face the same direction. Select multiple directions.
As described above, the inclusion relation determining means 42a specifies a plurality of sets of three reproduction speaker directions ζ _j , j = 1, 2, 3 with respect to the original speaker direction ξ satisfying the expression (2), and spherical triangle selection means. To 42b.

  The spherical triangle selection unit 42b selects a group in which the area of the spherical triangle specified in the three reproduction speaker directions is the smallest among the plurality of sets in the three reproduction speaker directions specified by the inclusion relation determination unit 42a. is there. In other words, the spherical triangle selection means 42b selects a set of three reproduction speaker directions in which the area of the spherical triangle is minimum at a predetermined radius for each original speaker direction, and thus exists in that direction. Each position of the set of two playback speakers is selected. The positions of the three reproduction speakers selected in this way are output to the weight coefficient calculation means 43.

Here, a method of calculating the area of the spherical triangle performed by the spherical triangle selection unit 42b will be described. Each side of the spherical triangle becomes an arc connecting two points on a great circle of the sphere (a circle passing through the center of the sphere). The length of the arc is equal to an angle (radian) formed by two directions on a spherical surface having a radius “1”. By the way, when the two directions are (θ _j , φ _j ), (θ _k , φ _k ) and the angle formed by the two directions is a _jk from the center (sound receiving point) of the sphere, The following equation (3) is established by the inner product of

Therefore, the angle a _jk (that is, the length of the arc connecting the two directions with a great circle) can be expressed by the following equation (4).

Here, as shown in FIG. 3, the spherical triangle is formed on each side in the direction ζ _j = (θ _j , φ _j ), ζ _k = (θ _k , φ _k ), ζ _l = (θ _l , φ _l ). The lengths of A, B, and C are a _jk , a _kl , and a _jl , respectively, the angle between sides A and B is α _jl , the angle between sides B and C is α _jk , and the angle between sides C and A is When α _kl is set, the area S of the spherical triangle is given by the following equation (5).

  Further, the following formula (6) is established from the basic formula of the spherical triangle.

  Therefore, the area S of the spherical triangle can be calculated by the following equation (7).

That is, the spherical triangle selection means 42b calculates the area of the spherical triangle specified by the three reproduction speaker directions in the plurality of sets of the three reproduction speaker directions specified by the inclusion relation determination means 42a by the above equation (7). Then, the positions of the three reproduction speakers indicating the three reproduction speaker directions having the smallest area are selected.
Note that the reproduction channel determination unit 42 sequentially determines three reproduction channels corresponding to the original sound channel each time the original sound channel is sequentially selected from the original sound channel selection unit 41.

  As a result, the reproduction channel determination means 42 selects the reproduction speaker set specified by the spherical triangle with the smallest area when distributing the sound signal of one original sound channel to the three reproduction channels, so that the storage means 30 is selected. Can be determined from among the reproduction loudspeakers stored in the above.

  The weight coefficient calculation means 43 calculates weights (weight coefficients) for distributing the acoustic signals of the individual original sound channels (original speakers) to the three reproduction channels (reproduction speakers) determined by the reproduction channel determination means 42. Is. The weighting coefficient calculating means 43 outputs the weighting coefficient obtained by the calculation to the acoustic signal distributing means 50.

Specifically, the weight coefficient calculation means 43 determines the position of the original speaker specified by the original sound channel (σ, θ, φ), the position of the reproduction speaker (σ ′ _j , θ ′ _j , φ ′ _j ), When j = 1, 2, 3, the weight coefficient w = (w ₁ w ₂ w ₃ ) ^T for each reproduction speaker is calculated by the following equation (8).

Here, e is the base of the natural logarithm, i is the imaginary unit, k is the wave number (phase constant, wavelength constant), and is a coefficient represented by k = 2π / λ (λ is the wavelength of the sound wave). Further, D ′ ₁ , D ′ ₂ , D ′ ₃ , D are values shown in the following equation (9).

The weighting factor w shown in the equation (8) is determined in advance so that the acoustic physical quantities match between the sound receiving point of the acoustic system having n channels and the sound receiving point of the acoustic system having m channels. It is a coefficient. The principle that the acoustic physical quantities coincide with each other at the sound receiving point by this weighting coefficient will be described in detail later.
In this way, the weighting factor calculating means 43 calculates the distribution ratio (weighting factor) to each speaker for reproducing the acoustic signal reproduced by one original speaker to the three reproducing speakers by the number of original speakers. .

  Here, as shown in the following equation (10), the weight coefficient calculation means 43 converts each acoustic signal of n original sound channels (original speakers) to each acoustic signal of m reproduction channels (reproduction speakers). It is assumed that an m (row) × n (column) weight matrix W for conversion is generated.

Here, each column (w _1n w _2n ... W _mn ) ^T indicates a weighting factor for m reproduction channels for the nth original sound channel. Here, since the sound signal of one original sound channel is distributed to the sound signals of three reproduction channels, the nth original sound channel is distributed to, for example, the first to third (m = 1 to 3) reproduction channels. In this case, weighting factors are set for w _1n , w _2n , and w _3n , and a weighting factor “0” is set for the other w _4n to w _mn .
As a result, the weight coefficient calculation unit 43 generates a weighting example W for converting the n-channel acoustic signal into the m-channel acoustic signal.

  The sound signal distribution means 50 distributes the n-channel original sound signal using the weighting coefficient (weight matrix) generated by the weight matrix calculation means 40 (weighted addition calculation), and outputs the m-channel reproduced sound signal. Is to be generated.

Here, as shown in the following equation (11), the acoustic signal distribution unit 50 performs the acoustic signal s (ω) = (s ₁ (ω) s ₂ (ω). _n (ω)) By calculating the product of the matrix using the weight matrix W (formula (9)) generated by the weight matrix calculator 40 for ^T , the acoustic signal q ( ω) = (q ₁ (ω) q ₂ (ω)... q _m (ω)) ^T is generated.

  The m-channel acoustic signal generated in this way is output to the inverse Fourier transform means 60.

The inverse Fourier transform means 60 performs inverse transform of the Fourier transform performed by the Fourier transform means 10 on the m-channel acoustic signal in the frequency domain generated by the acoustic signal distribution means 50. In this way, by performing Fourier inverse transform on the acoustic signal, the Fourier inverse transform means 60 transforms the acoustic signal into a signal represented in the time domain. The acoustic signal subjected to inverse Fourier transform is output to the outside as the m-channel acoustic signal q (t) = (q ₁ (t) q ₂ (t)... Q _m (t)) ^T to be generated.

By configuring the acoustic signal conversion device 1 as described above, when converting an acoustic signal corresponding to a certain number of channels into an acoustic signal corresponding to a number of channels different from the number of channels, from among a number of channels. It is possible to select three channels that are basic units for three-dimensional sound reproduction.
As a result, as long as the position information of the speaker is input, the acoustic signal conversion device 1 can convert the acoustic signal into an acoustic signal having a different number of channels while maintaining a sense of reality based on the original acoustic signal.
The acoustic signal conversion device 1 can be operated by a program (acoustic signal conversion program) that causes a general computer to function as each of the above-described means.

[Operation of acoustic signal converter]
Next, referring to FIG. 4 (refer to FIG. 1 as appropriate for the configuration), the operation of the acoustic signal converter according to the first embodiment of the present invention will be described.

First, the acoustic signal conversion device 1 uses the speaker position input means 20 to position the speaker (original speaker) of the original sound channel (original speaker position information) ξ _i = (σ _i , θ _i , φ _i ), i = 1, 2,..., N and the position of the reproduction channel speaker (reproduction speaker position) (reproduction speaker position information) ζ _j = (σ ′ _j , θ ′ _j , φ ′ _j ), j = 1, 2,. Is input (step S1). Then, the speaker position input unit 20 writes and stores the input speaker position information (original speaker position information and reproduction speaker position information) in the storage unit 30.

  After that, the acoustic signal conversion apparatus 1 selects one original sound channel (original speaker position) from the original speaker position information stored in the storage means 30 by the original sound channel selection means 41 (step S2). Note that this selection may be performed in the order of identification information associated with the original speaker in advance.

  Then, the acoustic signal conversion apparatus 1 determines the reproduction channel for distributing the acoustic signal to the original sound channel selected in step S2 by the reproduction channel determination unit 42. That is, the acoustic signal conversion apparatus 1 uses the inclusion relationship determination unit 42a to select the original sound channel selected in step S2 with a plurality of spherical triangles specified in three reproduction speaker directions on the virtual spherical surface with the sound receiving point as the origin. Is determined to include the original speaker direction, and a plurality of spherical triangles including the original speaker direction, that is, a set of three reproduction speaker positions positioned in the direction of each vertex of the spherical triangle are selected (step S3). ).

  After that, the acoustic signal conversion apparatus 1 calculates the area of the spherical triangle selected in step S3 by the spherical triangle selection means 42b of the reproduction channel determination means 42 (see the equation (7)), and the spherical surface having the smallest area. Three reproduction speakers existing in the three reproduction speaker directions constituting the triangle are specified (step S4).

  Then, the acoustic signal conversion device 1 uses the weight coefficient calculation means 43 based on the positions of the three reproduction speakers specified in step S4 and the positions of the original speakers selected in step S2, to determine the original sound channel (original speaker). ) Is calculated (see equation (8) above) for distributing the sound signal of 3) to the three reproduction channels (reproduction speakers) (step S5).

  Here, it is determined whether or not the original sound channel selection means 41 has selected all the original sound channels (step S6). And when all the original sound channels are selected (Yes in step S6), the acoustic signal converter 1 advances the operation to step S7. On the other hand, when all the original sound channels have not been selected (No in step S6), the acoustic signal converter 1 returns to step S2, selects another original sound channel (original speaker), and selects all the original sound channels. Thus, the weight for distribution to the reproduction channel (reproduction speaker) is calculated. This makes it possible to generate a weight matrix that converts an n-channel acoustic signal into an m-channel acoustic signal.

After that, the acoustic signal converter 1 performs Fourier transform on the n-channel acoustic signals (s ₁ (t) s ₂ (t)... S _n (t)) ^T input from the outside by the Fourier transform unit 10 (step S7). ). As a result, the acoustic signal is converted into an acoustic signal represented in the frequency domain.
Then, the acoustic signal conversion device 1 performs a weight addition operation on each frequency component of the n-channel acoustic signal using the weights (weighting coefficients) generated in steps S2 to S6 by the acoustic signal distribution unit 50. Thus, the acoustic signal is distributed to generate an m-channel acoustic signal (step S8).

Then, the acoustic signal conversion device 1 performs Fourier inverse transform on the m-channel acoustic signal generated in step S8 by the Fourier inverse transform unit 60, whereby the acoustic signal (q ₁ ( t) q ₂ (t)... q _m (t)) Converted to ^T and output to the outside (step S9).
Through the above operation, the acoustic signal conversion device 1 can convert an n-channel acoustic signal into an m-channel acoustic signal having a different number of channels by simply setting the position of the speaker.

[About weighting factors]
Next, with reference to FIG. 5, the principle that the acoustic physical quantities coincide with each other at the sound receiving point will be described using the equation (8). FIG. 5 is a diagram for explaining a weighting coefficient for matching acoustic physical quantities at sound receiving points when an n-channel acoustic signal is converted into an m-channel acoustic signal using an m × n weight matrix W. is there.

Here, in order to convert an n-channel acoustic signal into an m-channel acoustic signal, it is necessary to match the acoustic physical quantities such as sound pressure and particle velocity at the sound receiving point.
That is, as shown in FIG. 5, at the sound receiving point when the acoustic signal s (ω) after the Fourier transform of the n-channel acoustic signal s (t) is propagated by the acoustic propagation of the sound field based on the original speaker position. M-channel acoustic signal q (ω) generated by multiplying the acoustic signal s (ω) and the m × n weight matrix W by the acoustic propagation of the sound field based on the reproduction speaker position. It suffices if the acoustic physical quantity at the sound point matches.

Hereinafter, the principle of matching the acoustic physical quantities at the sound receiving points will be specifically described.
Here, the assumptions (a) to (e) are made.
(A) Each speaker can be approximated by a point sound source.
(B) The sound pressure at a unit distance from the speaker is proportional to the sound pressure of the speaker input signal (here, the proportionality coefficient is G).
(C) Only the traveling wave from the speaker is considered.
(D) The reflected sound in the room is negligible compared to the direct sound from the speaker.
(E) Assume kσ _min << 1 (k is the wave number, and σ _min represents the minimum distance between the speaker and the sound receiving point).

In general, the behavior of sound is defined by acoustic physical quantities such as sound pressure and particle velocity. The sound pressure is a scalar quantity with time and position as variables, and the particle velocity is a three-dimensional vector quantity with time and position as variables.
Here, the position (σ, θ, φ) of the speaker is represented using polar coordinates with the sound receiving point as the origin. The direction of the speaker is expressed as (θ, φ) with σ omitted. Here, σ is a distance from the sound receiving point, θ is an azimuth angle, and φ is an elevation angle.

  When the sound signal s (t) is input to the speaker (original speaker) of the sound system before conversion placed at this position (σ, θ, φ), the Fourier transform p (ω) of the sound pressure at the sound receiving point The Fourier transform u (ω) of the particle velocity is expressed by the following equations (12) and (13) under the assumptions of (a) to (e).

  Here, e is the base of the natural logarithm, i is the imaginary unit, k is the wave number, ρ is the air density, and c is the propagation velocity of the sound wave. H is a vector defined by the following equation (14).

On the other hand, the weights w = (w ₁ , w) of the acoustic signal s (t) are applied to the three converted speakers (reproduction speakers) placed in the direction (θ ′ _j , φ ′ _j ), j = 1, 2, 3 ₂ , w ₃ ) When signals w ₁ s (t), w ₂ s (t), and w ₃ s (t) multiplied by respective weights of ^T are input, Fourier transform p ′ of sound pressure at the sound receiving point (Ω) and the Fourier transform u ′ (ω) of the particle velocity are expressed by the following equations (15) and (16) under the assumptions of (a) to (e).

  Here, H ′ is a matrix defined by the following equation (17).

  Therefore, the condition for making the sound pressures coincide at the sound receiving point is the following equation (18) from the equations (12) and (15).

  Further, the condition for matching the particle velocities at the sound receiving point is the following equation (19) from the equations (13) and (16).

  From the equation (19), the weight w for matching the particle velocities can be analytically solved as shown in the following equation (20).

Here, D ′, D ′ ₁ , D ′ ₂ and D ′ ₃ are values represented by the following expression (21).

  Further, when the equation (20) is transformed so as to satisfy the condition (18), the weight w is given by the following equation (22) (same as the equation (8)).

  Here, D is a value shown in the following equation (23).

  As described above, the weighting factor calculating unit 43 (see FIG. 1) obtains the weighting (weighting factor) by the equation (22), so that the n-channel acoustic signal and the m-channel acoustic signal are obtained at the sound receiving point. The acoustic physical quantities can be matched, and the acoustic signal can be converted while maintaining a sense of reality.

  In addition, when making an acoustic physical quantity correspond, it is not necessary to make sound pressure and particle velocity correspond exactly, for example, it is good also as making only particle velocity correspond. In that case, the weighting factor calculating means 43 (see FIG. 1) may calculate the weighting factor using the equation (20).

[Example of acoustic signal conversion]
Next, referring to FIG. 6 to FIG. 8, an example of converting 22-channel acoustic signals excluding the LFE channel among the acoustic signals of the Super Hi-Vision 22.2 multi-channel system into 10-channel acoustic signals. explain.

  FIG. 6 shows the speaker position of the 22.2 multi-channel system for Super Hi-Vision before acoustic signal conversion. In FIG. 6, ◯ indicates the position of the sound receiving point, and ● indicates the position of the speaker (original speaker). Here, the elevation angle is 0 °, the azimuth is 0 °, 30 °, 60 °, 90 °, 120 °, 150 °, 180 °, 225 °, 270 °, 315 °, and the azimuth is 45 °. 8 in the direction of 0 °, 45 °, 90 °, 135 °, 180 °, 225 °, 270 °, 315 °, 1 in the direction of 90 ° elevation, -30 ° in elevation and 45 ° azimuth , 90 °, 135 °, three speakers, a total of 22 speakers are arranged.

FIG. 7 illustrates the speaker positions of a 10-channel multi-channel system. In FIG. 7, ◯ indicates the position of the sound receiving point, and ● indicates the position of the speaker (reproducing speaker). Here, the elevation angle is 0 °, the azimuth angles are 30 °, 75 °, 105 °, 150 °, 210 °, and 330 °, and the elevation angle is 45 ° and the azimuth angles are 90 °, 202.5 °, and 337. In this example, a total of 22 speakers are arranged, three in the direction of 5 °, and one in the direction with an elevation angle of −30 ° and an azimuth angle of 90 °.
6 and 7 show examples in which the speakers are arranged at the same distance from the sound receiving point, that is, on the same spherical surface.

FIG. 8 shows the result of converting the 22-channel acoustic signal shown in FIG. 6 into the 10-channel acoustic signal shown in FIG.
In the table shown in FIG. 8, the left column indicates the direction of the speaker (original speaker) in the original acoustic space, that is, the direction of the original speaker position of the 22.2 multi-channel system shown in FIG. In the right column, the upper column indicates the directions of the speakers (reproduction speakers) in the three reproduction acoustic spaces that distribute the sound signals of the original speakers in the left column, that is, the reproduction channel positions of the 10 channels shown in FIG. Three of the directions are shown. In the right column, the lower column indicates the weighting coefficient for distributing the acoustic signal to the original speaker in the left column with respect to each reproduction speaker direction in the upper column.

  For example, when the original speaker in the direction (0, 0) in FIG. 6 is used as a reference, the acoustic signals for the original speaker are the directions (30, 0), (330, 0), (337.5, 45) in FIG. ) Are multiplied by weighting coefficients of “0.500”, “0.500”, and “0.000”, respectively, and distributed.

  For example, when the reproduction speaker in the direction (30, 0) in FIG. 7 is used as a reference, the acoustic signal distributed to the reproduction speaker is weighted to the acoustic signal of the original speaker in the direction (0, 0) in FIG. The acoustic signal multiplied by the coefficient “0.500”, the acoustic signal of the original speaker in the direction (30, 0) multiplied by the weighting factor “1.000”, and the original speaker of the direction (60, 0) An acoustic signal obtained by adding the acoustic signal obtained by multiplying the acoustic signal by the weighting factor “0.341” and the acoustic signal obtained by multiplying the acoustic signal of the original speaker in the direction (45, −30) by the weighting factor “0.059”; Become.

Second Embodiment
[Configuration of three-dimensional acoustic panning apparatus]
Next, the configuration of a three-dimensional acoustic panning apparatus (acoustic signal conversion apparatus) according to the second embodiment of the present invention will be described with reference to FIG. The three-dimensional acoustic panning apparatus 2 converts a single channel acoustic signal serving as a sound source into acoustic signals having a plurality of channels. That is, the three-dimensional acoustic panning apparatus 2 generates an acoustic signal that localizes a one-channel acoustic signal as a sound image by a plurality of channels (speakers) in a three-dimensional acoustic space.

  In the three-dimensional sound panning apparatus 2, in the sound signal conversion apparatus 1 described with reference to FIG. 1, the input sound signal is a one-channel sound signal, and the original speaker position corresponds to the position where the sound image is to be localized.

  Here, the three-dimensional acoustic panning apparatus 2 includes a Fourier transform means 10, a speaker position input means 20B, a storage means 30B, a weight matrix calculation means 40B, an acoustic signal distribution means 50, a Fourier inverse transform means 60, Localization position input means 70. The components other than the speaker position input unit 20B, the storage unit 30B, the weight matrix calculation unit 40B, and the localization position input unit 70 are the same as those in the acoustic signal conversion apparatus 1 described in FIG. Therefore, the description is omitted.

The speaker position input means 20B inputs position information (speaker position information) indicating the position in the three-dimensional acoustic space corresponding to the reproduction channel.
Here, the speaker position information is expressed in polar coordinates with the sound receiving point as the origin, and the position of the reproduction channel speaker (reproduction speaker) (reproduction speaker position information) is represented by ζ _j = (σ ′ _j , θ ′ _j , φ ′ _J ), j = 1, 2,. Σ ′ _j is a distance from the sound receiving point, θ ′ _j is an azimuth angle, and φ ′ _j is an elevation angle. The speaker position input unit 20B writes and stores the input speaker position information in the storage unit 30B.

The storage unit 30B stores speaker position information (reproduced speaker position information) input by the speaker position input unit 20B, and is a general storage medium such as a hard disk or a memory. In this storage means 30B, reproduction speaker position information ζ _j = (σ ′ _j , θ ′ _j , φ ′ _j ) is stored in association with identification information j = 1, 2,.

The weight matrix calculating means 40B calculates a matrix (weight matrix) for converting the input acoustic signal into the acoustic signal of the reproduction channel. Here, since the input acoustic signal is one channel, the weight matrix calculating means 40B is configured by omitting the original sound channel selecting means 41 from the weight matrix calculating means 40 described in FIG.
In addition, since the input acoustic signal is one channel, if the number of reproduction channels (reproduction speakers) is m, the weight matrix calculation unit 40B uses the weight coefficient calculation unit 43 in the equation (10), A weight matrix W of m (rows) × 1 (columns) is generated.
The other components inside the weight matrix calculating means 40B are the same as those of the weight matrix calculating means 40, and thus the description thereof is omitted.

The localization position input means 70 inputs position information (localization position information) indicating the position in the three-dimensional acoustic space where the sound image is to be localized. Note that this localization position information is the same position information as the original speaker position serving as a sound source when the input acoustic signal is a one-channel acoustic signal in the acoustic signal converter 1 described with reference to FIG. Here, the localization position information is expressed in polar coordinates with the sound receiving point as the origin, and expressed as ξ ₁ = (σ ₁ , θ ₁ , φ ₁ ). Σ ₁ is the distance from the sound receiving point, θ ₁ is the azimuth angle, and φ ₁ is the elevation angle.
The localization position input means 70 outputs the input localization position information to the weight matrix calculation means 40B.

Then, the weight matrix calculating means 40B calculates a weight matrix for localizing the sound image of the input acoustic signal s ₁ (t) to the localization position by the acoustic signals of the plurality of reproduction channels. Note that the reproduction channel determination means 42 may determine the inclusion relation of the spherical triangles according to the direction of the localization position instead of the direction of the original speaker position described in FIG. 1, and select the spherical triangle.

  As a result, the three-dimensional sound panning apparatus 2 can perform sound localization that localizes a sound image to a specified position by an acoustic signal of a plurality of channels as long as the localization information of the sound image and the position information of the speaker for reproduction are input. A signal can be generated.

  The three-dimensional sound panning apparatus 2 can be operated by a program (a three-dimensional sound panning program) that causes a general computer to function as each of the means described above.

[Operation of 3D Acoustic Panning Device]
Next, the operation of the three-dimensional acoustic panning apparatus according to the second embodiment of the present invention will be described with reference to FIG.

First, the three-dimensional acoustic panning apparatus 2 uses the speaker position input means 20B to determine the position of the reproduction channel speaker (reproduction speaker) (reproduction speaker position information) ζ _j = (σ ′ _j , θ ′ _j , φ ′ _j ), j = 1, 2,..., m are input (step S1B). Then, the speaker position input unit 20B writes and stores the input speaker position information (reproduced speaker position information) in the storage unit 30B.

The three-dimensional acoustic panning apparatus 2 uses the localization position input means 70 to position information (localization position information) ξ ₁ = (σ ₁ , θ ₁ , φ ₁ ) indicating the position in the three-dimensional acoustic space where the sound image is to be localized. ) Is input (step S2B).

  In the three-dimensional sound panning apparatus 2, the reproduction channel determining unit 42 determines a reproduction channel for distributing the input acoustic signal in order to localize the sound image at the localization position input in step S2B. That is, the three-dimensional acoustic panning device 2 uses the inclusion relationship determination unit 42a to determine the localization input in step S2B with spherical triangles specified in all three reproduction speaker directions on the virtual spherical surface with the sound receiving point as the origin. It is determined whether or not the position direction is included, and a plurality of spherical triangles including the localization position direction, that is, a set of three reproduction speaker positions positioned in the direction of each vertex of the spherical triangle are selected (step S3B). .

The subsequent operations of steps S4, S5, S7 to S9 are the same as the operations of the acoustic signal converter 1 described in FIG.
By the above operation, the three-dimensional acoustic panning device 2 converts the sound signal of the sound source of one channel into the sound signals of a plurality of channels that localize the sound image only by setting the localization position of the sound image and the position of the speaker. Can do.

[Modification]
As mentioned above, although the structure and operation | movement of the acoustic signal converter 1 and the three-dimensional acoustic panning apparatus 2 which concern on embodiment of this invention were demonstrated, this invention is not limited to this embodiment.
For example, here, the weight matrix calculation means 40 and 40B use a vector product to determine whether or not the original speaker direction (localization position direction) is included in three reproduction speaker directions by the inclusion relation determination means 42a. It calculated | required by the logical formula (refer said Formula (2)).

  However, the weight matrix calculation means 40 and 40B, for each spherical triangle from the set of the original speaker direction (localization position direction) and all three reproduction speaker directions, are included in the spherical triangle by the inclusion relation determining means 42a. When the weights for the reproduction speakers constituting the sound are calculated by the above formula (8) or the above formula (20) and all the weights are non-negative values, the original speaker direction (localization position direction) is specified by the spherical triangle. It is also possible to determine that it is included in the three playback speaker directions. In this case, since the weight to each reproduction speaker has already been calculated, the weight coefficient calculation means 43 is incorporated as an internal process of the inclusion relation determination means 42a.

  Further, here, the weight matrix calculation means 40 and 40B are identified as the reproduction speaker constituting the spherical triangle with the smallest area by the spherical triangle selection means 42b, and the weight coefficient for the three reproduction speakers is obtained by the weight coefficient calculation means 43. Calculated.

  However, the weight matrix calculation means 40, 40B may select a predetermined number of spherical triangles by the spherical triangle selection means 42b. For example, a maximum of six playback speakers constituting two spherical triangles in the order of decreasing area (when the vertices of two spherical triangles are common, the number obtained by subtracting the number of common vertices from “6” is the number of speakers). The weighting coefficient calculation means 43 may specify and weighting coefficients for up to six reproduction speakers may be calculated.

  In this case, the weighting factor calculation means 43 uses the weighting factor obtained for each of the two spherical triangles as a temporary weighting factor and multiplies the values according to the reciprocals of the areas of the two spherical triangles, thereby reproducing each reproduction. The weight coefficient for the speaker. Of course, it goes without saying that even if the number of spherical triangles to be selected is three or more, the weighting coefficient can be obtained in accordance with the reciprocal of the area of the spherical triangle.

Here, the weight matrix calculation means 40 and 40B have selected the reproduction speaker constituting the spherical triangle with the smallest area by the spherical triangle selection means 42b.
However, the weight matrix calculation means 40 and 40B correspond to the position corresponding to the original speaker direction on the virtual spherical surface and the three reproduction speaker directions constituting the spherical triangle including this position by the spherical triangle selection means 42b. It is also possible to calculate the distance to the position and select the spherical triangle that minimizes the sum of these three distances.

  At this time, the spherical triangle selection means 42b may select a predetermined number of spherical triangles as described above when selecting the spherical triangle. For example, two spherical triangles may be selected in ascending order of the sum of the three distances or in ascending order of the minimum distance of the three distances. In this case, as described above, the weighting factor calculating unit 43 multiplies a value corresponding to the reciprocal of the area of the two spherical triangles by using the weighting factor obtained for each of the two spherical triangles as a temporary weighting factor. Thus, the weight coefficient for each reproduction speaker may be used.

DESCRIPTION OF SYMBOLS 1 Acoustic signal converter 2 Three-dimensional sound panning apparatus 10 Fourier transform means 20, 20B Speaker position input means 30, 30B Storage means 40, 40B Weight matrix calculation means 41 Original sound channel selection means 42 Playback channel determination means 42a Inclusion relation determination means 42b Spherical triangle selection means 43 Weight coefficient calculation means 50 Acoustic signal distribution means 60 Fourier inverse transform means 70 Localization position input means

Claims (8)

In an acoustic signal converter for converting an original acoustic signal having a number of channels of 1 or more into a reproduced acoustic signal having a different number of channels,
Storage means for storing the position of the original speaker corresponding to the channel of the original acoustic signal and the position of the reproduction speaker corresponding to the channel of the reproduced acoustic signal;
Based on the position of each speaker stored in the storage means, for each original speaker, the original point is set in the direction area specified by the directions of the three reproduction speakers with the sound receiving point in the three-dimensional acoustic space as the origin. Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the speaker;
Based on the position of the original speaker and each position of the set of reproduction speakers determined by the reproduction channel determination means for the original speaker, the sound at the sound receiving point of the original sound signal corresponding to the original speaker The original value for each reproduction speaker of the reproduction speaker set is calculated by a predetermined arithmetic expression so that the physical quantity matches the acoustic physical quantity at the sound receiving point of the reproduction acoustic signal corresponding to the determined reproduction speaker set. A weighting factor calculating means for calculating a distribution ratio of the acoustic signal as a weighting factor;
The original audio signals having the number of channels of 1 or more are distributed on the basis of the weighting factor to the reproduction speaker with respect to the original speaker calculated by the weighting coefficient calculating means, and the reproduced audio signal having the number of channels corresponding to the reproduction speaker is distributed. An acoustic signal distribution means for generating ,
The reproduction channel determination means includes
For each of the original speakers, in the virtual spherical surface with the sound receiving point as the origin, it is determined whether or not the direction of the original speaker from the origin is included in the spherical triangle specified by the directions of the three reproduction speakers. An inclusion relationship determining means for selecting a plurality of directions of three reproduction speakers constituting a spherical triangle that includes the direction of the original speaker;
Spherical triangle selection means for selecting a set of three reproduction speakers constituting a spherical triangle that minimizes the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the inclusion relation determining means. The acoustic signal converter characterized by the above-mentioned. In an acoustic signal converter for converting an original acoustic signal having a number of channels of 1 or more into a reproduced acoustic signal having a different number of channels,
Storage means for storing the position of the original speaker corresponding to the channel of the original acoustic signal and the position of the reproduction speaker corresponding to the channel of the reproduced acoustic signal;
Based on the position of each speaker stored in the storage means, for each original speaker, the original point is set in the direction area specified by the directions of the three reproduction speakers with the sound receiving point in the three-dimensional acoustic space as the origin. Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the speaker;
Based on the position of the original speaker and each position of the set of reproduction speakers determined by the reproduction channel determination means for the original speaker, the sound at the sound receiving point of the original sound signal corresponding to the original speaker The original value for each reproduction speaker of the reproduction speaker set is calculated by a predetermined arithmetic expression so that the physical quantity matches the acoustic physical quantity at the sound receiving point of the reproduction acoustic signal corresponding to the determined reproduction speaker set. A weighting factor calculating means for calculating a distribution ratio of the acoustic signal as a weighting factor;
The original audio signals having the number of channels of 1 or more are distributed on the basis of the weighting factor to the reproduction speaker with respect to the original speaker calculated by the weighting coefficient calculating means, and the reproduced audio signal having the number of channels corresponding to the reproduction speaker is distributed. An acoustic signal distribution means for generating ,
The reproduction channel determination means includes
For each of the original speakers, in the virtual spherical surface with the sound receiving point as the origin, it is determined whether or not the direction of the original speaker from the origin is included in the spherical triangle specified by the directions of the three reproduction speakers. An inclusion relationship determining means for selecting a plurality of directions of three reproduction speakers constituting a spherical triangle that includes the direction of the original speaker;
Spherical triangle selection for selecting a plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles in ascending order of the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the inclusion relation determining means Means, and
The weighting factor calculation means uses the weighting factor calculated for each of the three reproduction speakers as a temporary weighting factor, and further sets a value corresponding to the inverse of the area of the spherical triangle selected by the spherical triangle selection means. by multiplying the weighting factor of the temporary, acoustic signal conversion apparatus characterized that you calculate the weight coefficient of the original audio signal for the reproduction speaker. In order to convert an original sound signal having one or more channels into a reproduced sound signal having a different number of channels,
For each original speaker corresponding to the channel of the original sound signal, the sound receiving point in the three-dimensional sound space is set as the origin, and the direction of three playback speakers among the playback speakers corresponding to the channel of the playback sound signal is specified. Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the original speaker in the direction area;
Based on the position of the original speaker and each position of the set of reproduction speakers determined by the reproduction channel determination means for the original speaker, the sound at the sound receiving point of the original sound signal corresponding to the original speaker The original acoustic signal for each of the reproduction speaker sets is calculated by a predetermined arithmetic expression so that the physical quantity and the acoustic physical quantity at the sound receiving point of the reproduced acoustic signal corresponding to the determined reproduction speaker set match. Weighting factor calculation means for calculating the distribution ratio of
The original audio signals having the number of channels of 1 or more are distributed on the basis of the weighting factor to the reproduction speaker with respect to the original speaker calculated by the weighting coefficient calculating means, and the reproduced audio signal having the number of channels corresponding to the reproduction speaker is distributed. Function as acoustic signal distribution means to generate ,
The reproduction channel determining means is included in a spherical triangle in which the direction of the original speaker from the origin is specified by the directions of the three reproduction speakers in a virtual spherical surface with the sound receiving point as the origin for each of the original speakers. The area of the spherical triangle specified by the direction of the selected three reproduction speakers is selected by selecting a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker. acoustic signal conversion program but, wherein you to select a set of three reproduction speaker that constitutes a spherical triangle with the smallest. In order to convert an original sound signal having one or more channels into a reproduced sound signal having a different number of channels,
For each original speaker corresponding to the channel of the original sound signal, the sound receiving point in the three-dimensional sound space is set as the origin, and the direction of three playback speakers among the playback speakers corresponding to the channel of the playback sound signal is specified. Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the original speaker in the direction area;
Based on the position of the original speaker and each position of the set of reproduction speakers determined by the reproduction channel determination means for the original speaker, the sound at the sound receiving point of the original sound signal corresponding to the original speaker The original acoustic signal for each of the reproduction speaker sets is calculated by a predetermined arithmetic expression so that the physical quantity and the acoustic physical quantity at the sound receiving point of the reproduced acoustic signal corresponding to the determined reproduction speaker set match. Weighting factor calculation means for calculating the distribution ratio of
The original audio signals having the number of channels of 1 or more are distributed on the basis of the weighting factor to the reproduction speaker with respect to the original speaker calculated by the weighting coefficient calculating means, and the reproduced audio signal having the number of channels corresponding to the reproduction speaker is distributed. Function as acoustic signal distribution means to generate,
The reproduction channel determining means is included in a spherical triangle in which the direction of the original speaker from the origin is specified by the directions of the three reproduction speakers in a virtual spherical surface with the sound receiving point as the origin for each of the original speakers. The area of the spherical triangle specified by the direction of the selected three reproduction speakers is selected by selecting a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the original speaker. A plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles in ascending order of
The weighting coefficient calculating means uses the weighting coefficient calculated for each of the three reproduction speakers as a temporary weighting coefficient, and further specifies a spherical surface specified by the three reproduction speakers selected in ascending order of area by the reproduction channel determination means. An acoustic signal conversion program for calculating a weighting factor of an original acoustic signal for the reproduction speaker by multiplying the temporary weighting factor by a value corresponding to a reciprocal of a triangular area. In a three-dimensional acoustic panning device that generates a reproduced acoustic signal of a plurality of channels that localizes an original acoustic signal as a sound source as a sound image at a specified localization position,
Storage means for storing the position of a reproduction speaker corresponding to the channel of the reproduction acoustic signal;
Based on the position of the reproduction speaker stored in the storage means and the specified localization position, the sound receiving point in the three-dimensional acoustic space is set as the origin, and the direction area specified by the direction of the three reproduction speakers is Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the localization position;
Based on the localization position and each position of the reproduction speaker set determined by the reproduction channel determination means with respect to the localization position, the acoustic physical quantity at the sound receiving point of the original sound signal, and the determined The distribution ratio of the original sound signal to each playback speaker of the set of playback speakers is determined by a predetermined arithmetic expression so that the acoustic physical quantity at the sound receiving point of the playback sound signal corresponding to the set of playback speakers matches. A weighting factor calculating means for calculating as a weighting factor;
Sound signal distribution means for distributing the original sound signal based on the weight coefficient calculated by the weight coefficient calculation means to generate a reproduction sound signal for each reproduction speaker ;
The reproduction channel determination means includes
In the virtual spherical surface with the sound receiving point as the origin, it is determined whether or not the direction of the localization position from the origin is included in a spherical triangle specified by the directions of three reproduction speakers, and the direction of the localization position Inclusion relation determining means for selecting a plurality of directions of three reproduction speakers constituting a spherical triangle including
Spherical triangle selection means for selecting a set of three reproduction speakers constituting a spherical triangle that minimizes the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the inclusion relation determining means. A three-dimensional acoustic panning device. In a three-dimensional acoustic panning device that generates a reproduced acoustic signal of a plurality of channels that localizes an original acoustic signal as a sound source as a sound image at a specified localization position,
Storage means for storing the position of a reproduction speaker corresponding to the channel of the reproduction acoustic signal;
Based on the position of the reproduction speaker stored in the storage means and the specified localization position, the sound receiving point in the three-dimensional acoustic space is set as the origin, and the direction area specified by the direction of the three reproduction speakers is Reproduction channel determination means for determining a set of the three reproduction speakers including the direction of the localization position;
Based on the localization position and each position of the reproduction speaker set determined by the reproduction channel determination means with respect to the localization position, the acoustic physical quantity at the sound receiving point of the original sound signal, and the determined The distribution ratio of the original sound signal to each playback speaker of the set of playback speakers is determined by a predetermined arithmetic expression so that the acoustic physical quantity at the sound receiving point of the playback sound signal corresponding to the set of playback speakers matches. A weighting factor calculating means for calculating as a weighting factor;
Sound signal distribution means for distributing the original sound signal based on the weight coefficient calculated by the weight coefficient calculation means to generate a reproduction sound signal for each reproduction speaker ;
The reproduction channel determination means includes
In the virtual spherical surface with the sound receiving point as the origin, it is determined whether or not the direction of the localization position from the origin is included in a spherical triangle specified by the directions of three reproduction speakers, and the direction of the localization position Inclusion relation determining means for selecting a plurality of directions of three reproduction speakers constituting a spherical triangle including
Spherical triangle selection for selecting a plurality of sets of three reproduction speakers constituting a predetermined number of spherical triangles in ascending order of the area of the spherical triangle specified by the direction of the three reproduction speakers selected by the inclusion relation determining means Means, and
The weighting factor calculation means uses the weighting factor calculated for each of the three reproduction speakers as a temporary weighting factor, and further sets a value corresponding to the inverse of the area of the spherical triangle selected by the spherical triangle selection means. by multiplying the weighting factor of the temporary, the stereophonic sound panning and wherein that you calculate the weight coefficient of the original audio signal for the reproduction speaker. In order to generate a multi-channel playback acoustic signal that localizes the original acoustic signal as a sound source as a sound image at a specified localization position,
The above 3 including the direction of the localization position in a direction area specified by the directions of three reproduction speakers among the reproduction speakers corresponding to the channel of the reproduction acoustic signal with the sound receiving point in the three-dimensional acoustic space as the origin. Playback channel determination means for determining a set of two playback speakers;
Based on the localization position and the position of the reproduction speaker set determined by the reproduction channel determination means with respect to the localization position, the acoustic physical quantity at the sound receiving point of the original sound signal, and the determined The distribution ratio of the original sound signal to each playback speaker of the set of playback speakers is determined by a predetermined arithmetic expression so that the acoustic physical quantity at the sound receiving point of the playback sound signal corresponding to the set of playback speakers matches. Weighting factor calculation means for calculating as a weighting factor,
Distributing the original sound signal based on the weighting coefficient calculated by the weighting coefficient calculating means to function as sound signal distributing means for generating a reproduction sound signal for each reproduction speaker ;
The reproduction channel determination means determines whether or not the direction of the localization position from the origin is included in a spherical triangle specified by the directions of three reproduction speakers in a virtual spherical surface with the sound receiving point as an origin. Then, a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the localization position are selected, and a spherical triangle having a minimum area of the spherical triangle specified by the selected three reproduction speaker directions is selected. stereophonic sound panning program characterized you to select a set of three reproduction speaker constituting. In order to generate a multi-channel playback acoustic signal that localizes the original acoustic signal as a sound source as a sound image at a specified localization position,
The above 3 including the direction of the localization position in a direction area specified by the directions of three reproduction speakers among the reproduction speakers corresponding to the channel of the reproduction acoustic signal with the sound receiving point in the three-dimensional acoustic space as the origin. Playback channel determination means for determining a set of two playback speakers;
Based on the localization position and the position of the reproduction speaker set determined by the reproduction channel determination means with respect to the localization position, the acoustic physical quantity at the sound receiving point of the original sound signal, and the determined The distribution ratio of the original sound signal to each playback speaker of the set of playback speakers is determined by a predetermined arithmetic expression so that the acoustic physical quantity at the sound receiving point of the playback sound signal corresponding to the set of playback speakers matches. Weighting factor calculation means for calculating as a weighting factor,
Distributing the original sound signal based on the weighting coefficient calculated by the weighting coefficient calculating means to function as sound signal distributing means for generating a reproduction sound signal for each reproduction speaker;
The reproduction channel determination means determines whether or not the direction of the localization position from the origin is included in a spherical triangle specified by the directions of three reproduction speakers in a virtual spherical surface with the sound receiving point as an origin. Then, a plurality of directions of the three reproduction speakers constituting the spherical triangle including the direction of the localization position are selected, and the directions of the spherical triangles specified by the selected three reproduction speaker directions are determined in ascending order. Select a set of three playback speakers that make up a number of spherical triangles,
The weighting coefficient calculating means uses the weighting coefficient calculated for each of the three reproduction speakers as a temporary weighting coefficient, and further specifies a spherical surface specified by the three reproduction speakers selected in ascending order of area by the reproduction channel determination means. A three-dimensional sound panning program characterized by calculating a weighting factor of an original sound signal for the reproduction speaker by multiplying the temporary weighting factor by a value corresponding to an inverse number of a triangular area.

Images