USRE43273E1 - Generation of a sound signal - Google Patents
Generation of a sound signal Download PDFInfo
- Publication number
- USRE43273E1 USRE43273E1 US12/725,693 US72569305A USRE43273E US RE43273 E1 USRE43273 E1 US RE43273E1 US 72569305 A US72569305 A US 72569305A US RE43273 E USRE43273 E US RE43273E
- Authority
- US
- United States
- Prior art keywords
- sound signals
- transfer functions
- related transfer
- signal
- head related
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime, expires
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 132
- 230000006870 function Effects 0.000 claims abstract description 75
- 238000012546 transfer Methods 0.000 claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 33
- 238000004590 computer program Methods 0.000 claims description 6
- 101100111947 Arabidopsis thaliana CYP72C1 gene Proteins 0.000 abstract 1
- 101150015099 CHIA1 gene Proteins 0.000 abstract 1
- 101100439244 Glycine max CHI2-A gene Proteins 0.000 abstract 1
- 101100166889 Zea mays CHI gene Proteins 0.000 abstract 1
- 101150014959 chi1 gene Proteins 0.000 abstract 1
- 101150071577 chi2 gene Proteins 0.000 abstract 1
- 210000003128 head Anatomy 0.000 description 43
- 230000005540 biological transmission Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 6
- 210000003454 tympanic membrane Anatomy 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 3
- 210000005069 ears Anatomy 0.000 description 3
- 239000000872 buffer Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 210000000883 ear external Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
- H04S1/005—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/007—Two-channel systems in which the audio signals are in digital form
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Definitions
- the present invention relates to, in a media system, a method of generating at least one output signal from at least one input signal from a second set of sound signals having a related second set of Head Related Transfer Functions.
- the present invention also relates to a computer system for performing the method.
- the present invention further relates to a computer program product for performing the method.
- This invention further relates to a media system for generating at least one output signal from a first set of sound signals from at least one input signal from a second set of sound signals having a related second set of Head Related Transfer Functions.
- a weighted relation comprised by intermediate sound signals and at least one weight value is determined.
- said input sound signals are converted to intermediate sound signals for a subsequent internally use.
- said first, but new set of HRTFs is then determined based on the second set of sound signals, typically input sound signals and said second set of Head Related Transfer Functions, related to said input sound signals and initially dedicated to transform or transfer said second set of input sound signals.
- the new set of HRTFs comprises fewer HRTFs than said second set of Head Related Transfer Functions originally dedicated to transfer the input sound signals.
- said new, but fewer HRTFs i.e., first set of Head Related Transfer Functions
- said new, but fewer HRTFs are used to generate one or more output signal (belonging to said first set of sound signals) since one or more signals belonging to the third set of intermediate sound signals is transferred by means of said new, lower number of HRTFs in order to obtain said output signals.
- the media system may be a TV, a CD player, a DVD player, a Radio, a display with sound, an amplifier, a headphone or a VCR.
- said media system comprising:
- the media system gives the same advantages for the same reasons as described previously in relation to the method.
- FIG. 1 shows examples of the generation of two output sound signals from three input sound signals in the prior art and according to the invention
- FIG. 2 shows the generation of two output sound signals from one input sound signal
- FIG. 3 shows a method of generating at least one output sound signal from at least one input sound signal belonging to a second set of input sound signals having a related second set of Head Related Transfer Functions.
- a set of head related transfer functions may be used to generate one or more sound signals.
- the HRTFs may be defined as functions describing how sound propagates from a specific sound source to the ear and the number of HRTFs belonging to a set, this could be from one HRTF describing sound propagation from a source to the two ears and to a number of HRTFs depending on the number of sources delivering sound.
- m intermediate signals are derived which needs 2 times m HRTFs (m>n) head related transfer functions (HRTFs) may be used to expand said input signals (as the source) into multi-channel sound (as an intermedia product), which then may be down-mixed to fewer resulting output sound signals, e.g., a Left and a Right signal for a headphone.
- HRTFs head related transfer functions
- HRTF Head Related Transfer Function
- the head related transfer function is well known and is described in a number of documents, such as Blauert, Spatial hearing: The Psychophysics of Human Sound Localization (MIT Press, Cambridge, Mass., 1983).
- the set of HRTFs are filter functions with parameters or coefficients being specific for specific persons. For a specific person, different sets of HRTFs can be obtained depending on the arbitrary source mentioned above, the distance between the source and the person and also on the characteristics of the room in which the function parameters are measured.
- the HRTFs depend on the headphone through which sound reproduction takes place.
- the result of filtering sound using this function is that an optimal spatial reproduction of surround sound in headphones is obtained.
- the source could also be a typical loudspeaker; in this case, it is necessary to perform cross-talk cancellation, which, e.g., can be based on the HRTF.
- Stereophonic sound signals comprise a left and a right signal component which may originate from a stereo signal source, for example from a set of microphones, e.g., via further electronic equipment, such as a mixing equipment, etc.
- the signals may further be received as an output from another stereo player, over-the-air as a radio signal, or by any other suitable means.
- FIG. 1 shows examples of the generation of two output sound signals from three input sound signals in the prior art and according to the invention.
- Said two sound signals may, in a typical use, comprise a stereophonic signal distributed to two speakers in a headphone.
- binaural refers to the fact that there are two inputs to the listener's ears (left and right). Any set of left and right channel signals that are recorded at the position of the eardrum are called binaural signals.
- HRTF Head Related Transfer Functions
- reference numerals 1 , 2 and 3 indicate the corresponding three channels (i.e., three input sound signals) CH 1 , CH 2 and CH 3 combined into a left, H PL and a right H PR resulting (output) sound signal for the headphone.
- Said channels are each transmitted by means of three related Head Related Transfer Functions, reference numerals 4 through 9 .
- CH 1 is transmitted by means of the Head Related Transfer Function HRTF 1
- CH 2 is transmitted by means of the Head Related Transfer Function HRTF 2 , etc. This is performed for both channels in order to achieve—by summation of products of channels and related HRTFs, reference numerals 10 and 11 —that the stereophonic signals are generated.
- Said stereophonic (output) signals are indicated by left, H PL reference numeral 12 , and right, H PR reference numeral 13 , as the two resulting sound signals.
- H PL CH 1 ⁇ HRTF 1,L +CH 2 ⁇ HRTF 2,L +CH 3 ⁇ HRTF 3,L (1)
- H PR CH 1 ⁇ HRTF 1,R +CH 2 ⁇ HRTF 2,R +CH 3 ⁇ HRTF 3,R (2)
- ⁇ denotes a product if the above-mentioned variables are in the frequency domain; whereas in the time domain, “ ⁇ ” denotes a convolution of the variables.
- the same transmission may be implemented in a different way.
- the same three channels (CH 1 , CH 2 , and CH 3 ) will be discussed. It is that these may be linear combinations or a weighted version of the left and right (intermediate) channel with the weights ⁇ and ⁇ .
- CHi ⁇ i ⁇ L+ ⁇ i ⁇ R+c i ⁇ C+d i ⁇ D, etc., for a corresponding higher number of resulting (output) sound signals (H PL , H PR , H PC , H PD , etc.) for corresponding speakers or end result sounds.
- CH 1 ⁇ 1 ⁇ L+ ⁇ 1 ⁇ R (4)
- CH 2 ⁇ 2 ⁇ L+ ⁇ 2 ⁇ R (5)
- CH 3 ⁇ 3 ⁇ L+ ⁇ 3 ⁇ R (6)
- H PL L ⁇ ( ⁇ 1 ⁇ HRTF 1,L + ⁇ 2 ⁇ HRTF 2,L + ⁇ 3 ⁇ HRTF 3,L )+R ⁇ ( ⁇ 1 ⁇ HRTF 1,L + ⁇ 2 ⁇ HRTF 2,L + ⁇ 3 ⁇ HRTF 3,L ); (9)
- H PR L ⁇ ( ⁇ 1 ⁇ HRTF 1,R + ⁇ 2 ⁇ HRTF 2,R + ⁇ 3 ⁇ HRTF 3,R )+R ⁇ ( ⁇ 1 ⁇ HRTF 1,R + ⁇ 2 ⁇ HRTF 2,R + ⁇ 3 ⁇ HRTF 3,R ).
- H PL L ⁇ ⁇ i ⁇ ⁇ ( ⁇ i ⁇ HRTF i , L ) + R ⁇ ⁇ i ⁇ ⁇ ( ⁇ i ⁇ HRTF i , L ) ( 11 )
- H PR L ⁇ ⁇ i ⁇ ⁇ ( ⁇ i ⁇ HRTF i , R ) + R ⁇ ⁇ i ⁇ ⁇ ( ⁇ i ⁇ HRTF i , R ) ( 12 )
- ⁇ ( ⁇ i ⁇ HRTF i,R ) and ⁇ ( ⁇ i ⁇ HRTF i,R ) are the two filters for the Right headphone driver, H PR .
- FIG. 2 shows the generation of two output sound signals from one input sound signal.
- Said two sound signals may in a typical use again comprise a stereophonic signal distributed to two speakers in a headphone, however in this example—as a second embodiment of the invention—only one source, M of an input sound signal is discussed.
- the prior art is applied for only one input channel (as in this figure), i.e., an input sound source M and then distributed to two resulting (output) sound signals H PL , H PR .
- one channel i.e., CH 3
- the first uppercase notation is each of the loudspeaker channels, L and R, respectively, and the second lower case notation is l for the left ear, r for the right ear.
- the necessary alpha's, ⁇ i 's (as shown below in the formulas (15)) may be recovered.
- two channels are used to locate the singer on the line between the loudspeakers. It may be the case that that the alpha's are time variant.
- the single sound (input) source, M may be anywhere between two loudspeakers.
- the left intermediate channel (CHI1) which may be expressed as ⁇ i1 ⁇ M
- channels (CHI 1 , CHI 2 ) in respect of the invention for this particular embodiment are merely used as intermediate channels (variables) in the formulas—and are not real channels as opposed to the discussion (i.e. CH 1 , CH 2 ) relating to the prior art.
- left and right (intermediate channels) are mapped onto one channel M.
- the transmission will now only require two Head Related Transfer Functions. Compared to the prior art—where four Head Related Transfer Functions were required—the invention will require fewer Head Related Transfer Functions (and correspondingly convolutions) for the same transmission from one (input) sound source, M.
- said second embodiment of mapping only two output channels onto one channel is very simple, the second embodiment may be generalized to mapping of more than two channels onto one (with corresponding ⁇ 's) as discussed in:
- HRTF general-purpose
- Transmission between channels, (input sound signals) CH's and M to other intermediate sound channels and to resulting (output) sound signals or channels are drawn in the figures by lines with arrows. These lines may indicate that transmission may take place by means of circuitry suitable for enabling the communication of sound data, e.g., via a wired or a wireless data link. Examples of such transmission may be various transmitters, e.g., a transmitter including a network interface, a network card, a radio transmitter, a transmitter for other suitable electromagnetic signals, such as an LED for transmitting infrared light, e.g., via an IrDa port, radio-based communications, e.g., via a Bluetooth transceiver, or the like.
- a communications channel may be any suitable wired or wireless data link, for example, of a packet-based communications network, such as the Internet or another TCP/IP network, a short-range communications link, such as an infrared link, a Bluetooth connection or another radio-based link.
- a packet-based communications network such as the Internet or another TCP/IP network
- a short-range communications link such as an infrared link, a Bluetooth connection or another radio-based link.
- the communications channel include computer networks and wireless telecommunications networks, such as a Cellular Digital Packet Data (CDPD) network, a Global System for Mobile (GSM) network, a Code Division Multiple Access (CDMA) network, a Time Division Multiple Access Network (TDMA), a General Packet Radio service (GPRS) network, a Third Generation network, such as a UMTS network, or the like.
- CDPD Cellular Digital Packet Data
- GSM Global System for Mobile
- CDMA Code Division Multiple Access
- TDMA Time Division Multiple Access Network
- GPRS General Packet Radio service
- Third Generation network such as a UMTS network, or the like.
- FIG. 3 shows a method of generating at least one output sound signal from at least one input signal belonging to a second set of input sound signals having a related second set of Head Related Transfer Functions. This generation may take place in a media system, such as a TV, a CD player, a DVD player, a Radio, a display, an amplifier, a headphone and in a VCR.
- a media system such as a TV, a CD player, a DVD player, a Radio, a display, an amplifier, a headphone and in a VCR.
- said output sound signal may belong to a first set of output sound signals, e.g., one or more outputs such as H PL or H PR directed to headphones or other speakers.
- said second set of sound signals may be inputs such as CH 1 , CH 2 . . . CH n and M.
- said (input) sound signals may—in a sound signal cascade chain with function blocks of HRTF—be considered as general purpose sound signals as inputs or outputs depending on whether they enter (as input) or leave (as output) a block of cascade coupled sound signals.
- output sound signals from one function block may be input (sound signals) to another function block and vice versa.
- Said second set of Head Related Transfer Functions may—from the discussed embodiments—comprise Head Related Transfer Functions (such as HRTF_L,l, HRTF_R,l, HRTF_L,r, HRTF_R,r, HRTF 1,L, HRTF 2,L , HRTF 3,L , . . . HRTF 1,R , HRTF 2,R , . . . etc.) initially dedicated to transform or transfer said second set of input sound signals.
- Head Related Transfer Functions such as HRTF_L,l, HRTF_R,l, HRTF_L,r, HRTF_R,r, HRTF 1,L, HRTF 2,L , HRTF 3,L , . . . HRTF 1,R , HRTF 2,R , . . . etc.
- step 90 the method in accordance with preferred embodiments of the invention is started. Variables, flags, buffers, etc., keeping track of HRTFs, input and intermediate sound channels, output sound channels, weights, etc., corresponding to the sound signals processed are set to default values. When the method is started a second time, only corrupted variables, flags, buffers, etc, are reset to default values.
- a weighted relation may be determined.
- Said weighted relation may comprise at least one signal from a third set of intermediate sound signals ( 120 ), such as L and R; CHI 1 and CHI 2 , respectively, (according to the two embodiments discussed) with corresponding weight values.
- one example—as the first embodiment—may be CH i (i.e., each of the i input sound signals) ⁇ i ⁇ L+ ⁇ i ⁇ R, wherein ⁇ i , and ⁇ i are weight values, and L and R each is a signal belonging to said third set of the intermediate sound signals.
- more input sound signals than (generated) output sound signals are processed by means of fewer HRTFs as compared to the prior art.
- a first (newly generated) set of Head Related Transfer Functions may be determined.
- Said first set (of Head Related Transfer Functions) may be based on the second set of sound signals ( 110 ), i.e., the input sound signals, the second set of Head Related Transfer Functions ( 110 ) (as discussed and used in the prior art) and the newly determined weighted relation(s).
- said first new set of Head Related Transfer Functions are generated for the purpose of a subsequent transformation of the intermediate sound signal(s) by means of it in the next step.
- the determination takes into account the second set of sound signals, i.e., inputs such as sound signals (typical as inputs) such as CH 1 , CH 2 . . .
- step 300 at least one signal belonging to said third set of intermediate sound signals (L, R, CHI 1 , CHI 2 ) may be transferred by means of at least one HRTF belonging to said first set (of newly generated Head Related Transfer Functions) in order to generate at least one signal (as an output signal) belonging to said first set of output sound signals (H PL , H PR ).
- HRTFs i.e., said first set of Head Related Transfer Functions ( ⁇ ( ⁇ i ⁇ HRTFi,R), ⁇ ( ⁇ i ⁇ HRTFi,R), H — 1, H — 2, etc.) may be used to, actually to transfer and transform (convolve) one or more intermediate sound signals, such as L, R, (first embodiment) or CHI 1 and CHI 2 (second embodiment).
- the method will start all over again as long as the media system is powered. Otherwise, the method may terminate in step 400 ; however, when the media system is powered again, etc, the method may proceed from step 100 .
- a computer readable medium may be magnetic tape, optical disc, digital versatile disk (DVD), compact disc (CD record-able or CD write-able), mini-disc, hard disk, floppy disk, smart card, PCMCIA card, etc.
- any reference signs placed between parentheses shall not be constructed as limiting the claim.
- the word “comprising” does not exclude the presence of elements or steps other than those listed in a claim.
- the word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements.
- the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer.
- the device claim enumerating several means several of these means can be embodied by one and the same item of hardware.
- the mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
In a method and a media system of/for generation of at least one output signal (HPL,HPR) from at least one input signal belonging to a second set of sound signals (M) having a related second set of Head Related Transfer Functions, in which the media system can be a TV, a CD player, a DVD player, a Radio, a display, an amplifier, a headphone or a VCR, the method includes the steps of determining, for each signal in the second set of sound signals, a weighted relation (14) including at least one signal belonging to a third set of intermediate sound signals (CHI1, CHI2) and at least one weight value (Weights); determining a first set of Head Related Transfer Functions (HRTFs) based on the second set of sound signals, the second set of Head Related Transfer Functions and the weighted relation; and transferring at least one signal belonging to the third set of intermediate sound signals by means of at least one HRTF belonging to said first set of Head Related Transfer Functions in order to generate at least one output signal belonging to said first set of sound signals. Hereby, in the end, fewer HRTFs are determined for a subsequent transfer of input signal(s) to output signal(s). Accordingly, few convolutions are required.
Description
1. Field of the Invention
The present invention relates to, in a media system, a method of generating at least one output signal from at least one input signal from a second set of sound signals having a related second set of Head Related Transfer Functions.
The present invention also relates to a computer system for performing the method.
The present invention further relates to a computer program product for performing the method.
This invention further relates to a media system for generating at least one output signal from a first set of sound signals from at least one input signal from a second set of sound signals having a related second set of Head Related Transfer Functions.
2. Description of the Related Art
International Patent Application No. WO 01/49073, corresponding to U.S. Pat. No. 7,110,556, discloses a sound reproduction system simulating external sound sources. The system uses a number of so-called Head Related Transfer Functions, HRTFs, to generate sound for a set of headphones.
It is generally known in prior art literature that input channels of sound sources which are to be combined into outputs, i.e., resulting sound signals, will require a relatively high number of HRTFs. This typically leads to system implementations with said HRTFs, which are quite expensive, require unnecessary convolutions and are complex to design. This will be discussed further by means of FIGS. 1 and 2 , where prior art applications and the invention with corresponding formulas and numbers of HRTFs are shown by means of calculation.
The above problems are solved by said method, the method comprising the steps of:
determining, for each signal in the second set of sound signals, a weighted relation comprising at least one signal from a third set of intermediate sound signals and at least one weight value;
determining a first set of Head Related Transfer Functions based on the second set of sound signals, the second set of Head Related Transfer Functions and the weighted relation; and
transferring at least one signal belonging to the third set of intermediate sound signals by means of at least one HRTF belonging to said first set of Head Related Transfer Functions in order to generate at least one output signal belonging to said first set of sound signals.
In the first step, for each signal in the second set of sound signals, i.e., for each signal in a number of input sound signals, a weighted relation comprised by intermediate sound signals and at least one weight value is determined. Hereby said input sound signals are converted to intermediate sound signals for a subsequent internally use.
In the second step, said first, but new set of HRTFs is then determined based on the second set of sound signals, typically input sound signals and said second set of Head Related Transfer Functions, related to said input sound signals and initially dedicated to transform or transfer said second set of input sound signals.
It is an advantage that in said determination—which will be discussed in the embodiments according to the invention—the new set of HRTFs comprises fewer HRTFs than said second set of Head Related Transfer Functions originally dedicated to transfer the input sound signals.
Subsequently, in the third step, said new, but fewer HRTFs (i.e., first set of Head Related Transfer Functions) are used to generate one or more output signal (belonging to said first set of sound signals) since one or more signals belonging to the third set of intermediate sound signals is transferred by means of said new, lower number of HRTFs in order to obtain said output signals.
Said problems are further solved by said media system on which said method can be executed. The media system may be a TV, a CD player, a DVD player, a Radio, a display with sound, an amplifier, a headphone or a VCR.
In a preferred embodiment, said media system comprising:
-
- means for determining for each signal in the second set of sound signals, a weighted relation comprising at least one signal belonging to a third set of intermediate sound signals and at least one weight value;
- means for determining a first set of Head Related Transfer Functions based on the second set of sound signals, the second set of Head Related Transfer Functions and the weighted relation; and
- means for transferring at least one signal belonging to the third set of intermediate sound signals by means of at least one HRTF belonging to said first set of Head Related Transfer Functions in order to generate at least one output signal belonging to said first set of sound signals.
The media system gives the same advantages for the same reasons as described previously in relation to the method.
The prior art and the invention will be explained more fully below in connection with preferred embodiments and with reference to the drawings, in which:
Throughout the drawings, the same reference numerals and like names indicate similar or corresponding features, functions, etc.
In the present invention a set of head related transfer functions (HRTFs) may be used to generate one or more sound signals. The HRTFs may be defined as functions describing how sound propagates from a specific sound source to the ear and the number of HRTFs belonging to a set, this could be from one HRTF describing sound propagation from a source to the two ears and to a number of HRTFs depending on the number of sources delivering sound. Alternatively, from few (n) inputs signals, m intermediate signals are derived which needs 2 times m HRTFs (m>n) head related transfer functions (HRTFs) may be used to expand said input signals (as the source) into multi-channel sound (as an intermedia product), which then may be down-mixed to fewer resulting output sound signals, e.g., a Left and a Right signal for a headphone.
A description of HRTF can further be found in the following journal: H. Moller, “Fundamentals of binaural technology”, Applied Acoustics, Special issue on auditory environment and telepresence, Vol. 36, No. 3-4, pp. 171-218, (1992).
In the following HRTF is defined in further detail. By finding the sound pressure that an arbitrary source produces at the eardrum (taking into consideration parameters, such as the distance between the ears and the shape of the outer ear), all that is needed is the impulse response from the source to the eardrum, which can be measured, e.g., by placing a microphone in the ear. This is called the Head-Related Impulse Response, and its Fourier transform is called the Head Related Transfer Function (HRTF). The HRTF captures all of the physical cues to source localization. Once the HRTF for the left ear and the right ear are known, it is possible to synthesize accurate binaural signals from a monaural source. The head related transfer function is well known and is described in a number of documents, such as Blauert, Spatial hearing: The Psychophysics of Human Sound Localization (MIT Press, Cambridge, Mass., 1983). When sound is filtered by a set of HRTFs, the sound is optimized for the person to which the set of HRTFs belongs and, therefore, the sound experience is never optimal for anyone but the person to which the set of HRTFs belongs. The set of HRTFs are filter functions with parameters or coefficients being specific for specific persons. For a specific person, different sets of HRTFs can be obtained depending on the arbitrary source mentioned above, the distance between the source and the person and also on the characteristics of the room in which the function parameters are measured. When, e.g., the source is headphones, the HRTFs depend on the headphone through which sound reproduction takes place. The result of filtering sound using this function is that an optimal spatial reproduction of surround sound in headphones is obtained. The source could also be a typical loudspeaker; in this case, it is necessary to perform cross-talk cancellation, which, e.g., can be based on the HRTF.
Stereophonic sound signals comprise a left and a right signal component which may originate from a stereo signal source, for example from a set of microphones, e.g., via further electronic equipment, such as a mixing equipment, etc. The signals may further be received as an output from another stereo player, over-the-air as a radio signal, or by any other suitable means.
Firstly, according to the prior art, it is well known to reproduce multi-channel sound via headphones. This multi-channel sound reproduction through a headphone makes use of the known techniques called binaural and Head Related Transfer Function (HRTF). The term “binaural” refers to the fact that there are two inputs to the listener's ears (left and right). Any set of left and right channel signals that are recorded at the position of the eardrum are called binaural signals.
It is the intention to have the same sound at the eardrum when using a headphone as when loudspeakers are playing. In order to achieve this, more knowledge must be gathered about the transmissions of the sound source into the eardrum. This transmission is best described in terms of Head Related Transfer Functions (HRTF) that include any linear filtering, such as coloration and inter-aural time and spectral differences. Inter-aural time differences occur because a sound wave travels at two different distances to left and right ear. These transfer functions depend on the angle of incidence and distance to the sound source.
Reverting back to the figure, reference numerals 1, 2 and 3 indicate the corresponding three channels (i.e., three input sound signals) CH1, CH2 and CH3 combined into a left, HPL and a right HPR resulting (output) sound signal for the headphone. Said channels are each transmitted by means of three related Head Related Transfer Functions, reference numerals 4 through 9. In other words, CH1, is transmitted by means of the Head Related Transfer Function HRTF1, correspondingly CH2, is transmitted by means of the Head Related Transfer Function HRTF2, etc. This is performed for both channels in order to achieve—by summation of products of channels and related HRTFs, reference numerals 10 and 11—that the stereophonic signals are generated. Said stereophonic (output) signals are indicated by left, HPL reference numeral 12, and right, HPR reference numeral 13, as the two resulting sound signals.
The summation for the left resulting sound signal is then:
HPL=CH1·HRTF1,L+CH2·HRTF2,L+CH3·HRTF3,L (1)
HPL=CH1·HRTF1,L+CH2·HRTF2,L+CH3·HRTF3,L (1)
Correspondingly, summation for the right resulting sound signal will then be:
HPR=CH1·HRTF1,R+CH2·HRTF2,R+CH3·HRTF3,R (2)
HPR=CH1·HRTF1,R+CH2·HRTF2,R+CH3·HRTF3,R (2)
Thus in the prior art case, this transmission will require two times three, i.e., six Head Related Transfer Functions.
Generally throughout the application, the notation “·” denotes a product if the above-mentioned variables are in the frequency domain; whereas in the time domain, “·” denotes a convolution of the variables.
Generally and correspondingly, when expanding the prior art example, n=3 (input) channels of sound sources (CH1 to CH3) to be combined into m sound outputs, i.e., m resulting sound signals, will require n times m Head Related Transfer Functions.
Secondly, according to a preferred embodiment of the invention, the same transmission—as the prior art example—may be implemented in a different way. In order to continue the example, the same three channels (CH1, CH2, and CH3) will be discussed. It is that these may be linear combinations or a weighted version of the left and right (intermediate) channel with the weights α and β. Said α and β may have their weight values depending on each channel, i.e., L and R, thus in general:
CHi=αi·L+βi·R. (3)
CHi=αi·L+βi·R. (3)
Someone skilled in the art may—when applying the invention for more than two channels (L, R), e.g., for a third, a fourth channel, etc, i.e., C, D, etc.,—subsequently generalize formula (3) into:
CHi=αi·L+βi·R+ci·C+di·D, etc., for a corresponding higher number of resulting (output) sound signals (HPL, HPR, HPC, HPD, etc.) for corresponding speakers or end result sounds.
In the Sound Engineering Society Conference Paper, presented at the 19th International Conference 2001 Jun. 21-24 Schloss Elmau, Germany by Roy Irwan and Ronald M. Aarts, Philips Research Laboratories, a method to convert stereo to multi-channel sound is disclosed. In this paper—on page 3—said α and β's are defined using a corresponding WL(k) and WR(k) (weight) notation—at the time instant k—for the left and right channel, respectively.
For the sake of conciseness, two channels (of resulting (output) sound signals) will only be used in this example.
Continuing the prior art example of FIG. 1 , but implemented in a preferred first embodiment of the invention according to the following:
CH1=α1·L+β1·R (4)
CH2=α2·L+β2·R (5)
CH3=α3·L+β3·R (6)
CH1=α1·L+β1·R (4)
CH2=α2·L+β2·R (5)
CH3=α3·L+β3·R (6)
It is found that formula (1) and (2) may still be applied for the summation (of products of channels and related HRTFs), thus when (4) (5) and (6) are inserted in (1) and (2), it gives:
HPL=(α1·L+β1·R)·HRTF1,L+(α2·L+β2·R)·HRTF2,L+(α3·L+β3·R)·HRTF3,L (7)
HPR=(α1·L+β1·R)·HRTF1,R+(α2·L+β2·R)·HRTF2,R+(α3·L+β3·R)·HRTF3,R (8)
HPL=(α1·L+β1·R)·HRTF1,L+(α2·L+β2·R)·HRTF2,L+(α3·L+β3·R)·HRTF3,L (7)
HPR=(α1·L+β1·R)·HRTF1,R+(α2·L+β2·R)·HRTF2,R+(α3·L+β3·R)·HRTF3,R (8)
Or expressed differently:
HPL=L·(α1·HRTF1,L+α2·HRTF2,L+α3·HRTF3,L)+R·(β1·HRTF1,L+β2·HRTF2,L+β3·HRTF3,L); (9)
HPL=L·(α1·HRTF1,L+α2·HRTF2,L+α3·HRTF3,L)+R·(β1·HRTF1,L+β2·HRTF2,L+β3·HRTF3,L); (9)
Accordingly,
HPR=L·(α1·HRTF1,R+α2·HRTF2,R+α3·HRTF3,R)+R·(β1·HRTF1,R+β2·HRTF2,R+β3·HRTF3,R). (10)
HPR=L·(α1·HRTF1,R+α2·HRTF2,R+α3·HRTF3,R)+R·(β1·HRTF1,R+β2·HRTF2,R+β3·HRTF3,R). (10)
However, note—the HRTFs discussed so far in respect of the invention—are merely used as intermediate variables in the formulas—and are not and need not as opposed to the discussion relating to said prior art, be implemented as real Head Related Transfer Functions.
Or for i=3, i.e., in a generalized form:
Thus there are only two filters for the Left headphone driver, HPL needed in order to filter the Left and Right signals respectively, since the factors in formula (11)·(αi·HRTFi,L), ·(βi·HRTFi,L) are considered each as one filter.
Correspondingly, with regard to formula 12, ·(αi·HRTFi,R) and ·(βi·HRTFi,R) are the two filters for the Right headphone driver, HPR.
Thus only two filters are needed to filter the Left and Right signals for the Right headphone driver.
Thus—when continuing the implementation according to the invention with three input sound channels—the transmission will now only require two times two, i.e., four Head Related Transfer Functions. Compared to the prior art example of FIG. 1—where six Head Related Transfer Functions were required—the invention will require fewer Head Related Transfer Functions for the same transmission.
Correspondingly, fewer convolutions will be required for the same transmission.
In other words, when the example is further generalized—starting with and according to the prior art—in a simple cascading of sound signals, e.g., with m=2 (i.e., stereo, two output channels or signals, e.g., for two headphone drivers), n=5 input channels or sound signals (CH1 to CH5) will require a total of 2 times 5 that is 10 HRTF (in the prior art), but only four Head Related Transfer Functions for a similar transmission are still required according to the invention's first embodiment.
Firstly, the prior art will be discussed with a calculation of HRTF's used:
The prior art is applied for only one input channel (as in this figure), i.e., an input sound source M and then distributed to two resulting (output) sound signals HPL, HPR. Compared to and according to FIG. 1 , in principle one channel (i.e., CH3) less is used; correspondingly, the summation for the left resulting (output) sound signal in the prior art is:
HPL=CH1·HRTF_L,l+CH2·HRTF_R,l (13)
HPL=CH1·HRTF_L,l+CH2·HRTF_R,l (13)
And, correspondingly, summation for the right resulting (output) sound signal will then be:
HPR=CH1·HRTF_L,r+CH2·HRTF_R,r (14)
HPR=CH1·HRTF_L,r+CH2·HRTF_R,r (14)
Here the first uppercase notation is each of the loudspeaker channels, L and R, respectively, and the second lower case notation is l for the left ear, r for the right ear.
Thus in this prior art case, this transmission will require two times two, i.e., four Head Related Transfer Functions.
Secondly, the second embodiment, i.e., FIG. 2 , according to the invention will be discussed:
Imagine a (moving) singer “M” in a studio is recorded onto a CD with two output sound channels, HPL and HPR.
By using Principle Component Analysis, the necessary alpha's, αi's (as shown below in the formulas (15)) may be recovered. Hence two channels are used to locate the singer on the line between the loudspeakers. It may be the case that that the alpha's are time variant.
A general discussion on Principle Component Analysis can be found in Principal Component Analysis by S. Haykin, Neural Networks, Prentice-Hall, N.J., 1999, Second Edition which is used in the previously mentioned article: “A method to convert stereo to multi-channel.”
The single sound (input) source, M may be anywhere between two loudspeakers. E.g., in a studio there is a singer M, pan-potted between both (or even more channels) so the left intermediate channel (CHI1) which may be expressed as αi1·M and the right intermediate channel (CHI2) may be expressed as αi2·M, thus:
CHI1=αi1·M and CHI2=αi2·M (15)
CHI1=αi1·M and CHI2=αi2·M (15)
However, note—said channels (CHI1, CHI2) in respect of the invention for this particular embodiment—are merely used as intermediate channels (variables) in the formulas—and are not real channels as opposed to the discussion (i.e. CH1, CH2) relating to the prior art.
In other words, in respect of the invention, left and right (intermediate channels) are mapped onto one channel M.
So equation 13 and 14 can—switching from the prior art to another embodiment of the invention according to FIG. 2—be expressed as:
HPL=αi1·M·HRTF_L,l+αi2·M·HRTF_R,l (16)
HPR=αi1·M·HRTF_L,r+αi2·M·HRTF_R,r (17)
or
HPL=M·(αi1·HRTF_L,l+αi2·HRTF_R,l) (18)
HPR=M·(αi1·HRTF_L,r+αi2·HRTF_R,r) (19)
or
HPL=M·H—1 (20)
HPR=M·H—2 (21)
whereH —1=(αi1·HRTF_L,l+αi2·HRTF_R,l) (22)
andH —2=(αi1·HRTF_L,r+αi2·HRTF_R,r) (23)
HPL=αi1·M·HRTF_L,l+αi2·M·HRTF_R,l (16)
HPR=αi1·M·HRTF_L,r+αi2·M·HRTF_R,r (17)
or
HPL=M·(αi1·HRTF_L,l+αi2·HRTF_R,l) (18)
HPR=M·(αi1·HRTF_L,r+αi2·HRTF_R,r) (19)
or
HPL=M·H—1 (20)
HPR=M·H—2 (21)
where
and
This shows that the invention needs only two convolutions or HRTFs, since the factors (H —1, H—2) in formula 20 and 21, respectively, are considered each as one HRTF filter.
Thus the transmission will now only require two Head Related Transfer Functions. Compared to the prior art—where four Head Related Transfer Functions were required—the invention will require fewer Head Related Transfer Functions (and correspondingly convolutions) for the same transmission from one (input) sound source, M.
However, said second embodiment of mapping only two output channels onto one channel is very simple, the second embodiment may be generalized to mapping of more than two channels onto one (with corresponding α's) as discussed in:
International Patent Application No. WO02/07481: Multi-channel stereo converter for deriving a stereo surround and/or audio centre signal, Koninklijke Philips Electronics N.V. Inventor(s): Irwan, Roy; AARTS, Ronaldus, M., (European Patent Application No. EP1295511, Filed 20010705, A2. Published 20020124) where two channels (L,R) are mapped onto one C, or centre channel, using Principle Component Analysis; and
C. Faller and F. Baumgartner, “Binaural cue coding applied to stereo and multi-channel audio compression”, Convention paper 5574 (L-6) of the 112th AES Convention Munich, Germany, Audio Eng. Soc., May 2002.
Someone skilled in the art may—when applying the invention according the two embodiments—combine and consider these as general-purpose (HRTF) functions blocks with sound inputs and outputs. In other words, said embodiments may be applied to cascade couple sound signals. In other words, instead of HPL and HPR being output sound signals from one function block, they may—by cascading—be input to another function block.
Generally said formulas throughout the application may be implemented in a media system, such as a TV, a CD player, a DVD player, a Radio, a display, an amplifier or a VCR. This is shown by means of reference numeral 20 of FIG. 2 . However, it may alternatively or additionally be the case that said formulas are integrated into a circuitry (or software) suitable for the purpose embedded in headphones with sufficient processing power.
Transmission between channels, (input sound signals) CH's and M to other intermediate sound channels and to resulting (output) sound signals or channels are drawn in the figures by lines with arrows. These lines may indicate that transmission may take place by means of circuitry suitable for enabling the communication of sound data, e.g., via a wired or a wireless data link. Examples of such transmission may be various transmitters, e.g., a transmitter including a network interface, a network card, a radio transmitter, a transmitter for other suitable electromagnetic signals, such as an LED for transmitting infrared light, e.g., via an IrDa port, radio-based communications, e.g., via a Bluetooth transceiver, or the like. Further examples of suitable transmitters include a cable modem, a telephone modem, an Integrated Services Digital Network (ISDN) adapter, a Digital Subscriber Line (DSL) adapter, a satellite transceiver, an Ethernet adapter, or the like. Correspondingly, a communications channel may be any suitable wired or wireless data link, for example, of a packet-based communications network, such as the Internet or another TCP/IP network, a short-range communications link, such as an infrared link, a Bluetooth connection or another radio-based link.
Further examples of the communications channel include computer networks and wireless telecommunications networks, such as a Cellular Digital Packet Data (CDPD) network, a Global System for Mobile (GSM) network, a Code Division Multiple Access (CDMA) network, a Time Division Multiple Access Network (TDMA), a General Packet Radio service (GPRS) network, a Third Generation network, such as a UMTS network, or the like.
In a typical application of the method (or embedded in an apparatus such as said media system), said output sound signal may belong to a first set of output sound signals, e.g., one or more outputs such as HPL or HPR directed to headphones or other speakers. Conversely, said second set of sound signals may be inputs such as CH1, CH2 . . . CHn and M. However, said (input) sound signals may—in a sound signal cascade chain with function blocks of HRTF—be considered as general purpose sound signals as inputs or outputs depending on whether they enter (as input) or leave (as output) a block of cascade coupled sound signals. In other words, output sound signals from one function block may be input (sound signals) to another function block and vice versa.
Said second set of Head Related Transfer Functions (related to said input sound signals) may—from the discussed embodiments—comprise Head Related Transfer Functions (such as HRTF_L,l, HRTF_R,l, HRTF_L,r, HRTF_R,r, HRTF1,L, HRTF 2,L, HRTF3,L, . . . HRTF1,R, HRTF2,R, . . . etc.) initially dedicated to transform or transfer said second set of input sound signals.
In step 90, the method in accordance with preferred embodiments of the invention is started. Variables, flags, buffers, etc., keeping track of HRTFs, input and intermediate sound channels, output sound channels, weights, etc., corresponding to the sound signals processed are set to default values. When the method is started a second time, only corrupted variables, flags, buffers, etc, are reset to default values.
In step 100—continuing the method description—for each signal in the second set of (input) sound signals (110), a weighted relation may be determined. Said weighted relation may comprise at least one signal from a third set of intermediate sound signals (120), such as L and R; CHI1 and CHI2, respectively, (according to the two embodiments discussed) with corresponding weight values.
As discussed in the embodiments of the invention, one example—as the first embodiment—may be CHi (i.e., each of the i input sound signals)=αi·L+βi·R, wherein αi, and βi are weight values, and L and R each is a signal belonging to said third set of the intermediate sound signals.
In the first embodiment, more input sound signals than (generated) output sound signals are processed by means of fewer HRTFs as compared to the prior art.
As further discussed in the embodiments of the invention, another example—as the second embodiment—may be CHI1=αi1·M and CHI2=αi2·M, wherein αi1 and αi2 each is the weight value, and where CHI1 and CHI2 are the corresponding intermediate sound signals for this second embodiment.
In the second embodiment—as opposed to the first embodiment—fewer input sound signals, generally (in the example one) than generated output sound signals (in the example two) are processed by means of fewer HRTFs as compared to the prior art.
In step 200, a first (newly generated) set of Head Related Transfer Functions may be determined. Said first set (of Head Related Transfer Functions) may be based on the second set of sound signals (110), i.e., the input sound signals, the second set of Head Related Transfer Functions (110) (as discussed and used in the prior art) and the newly determined weighted relation(s). In other words, said first new set of Head Related Transfer Functions are generated for the purpose of a subsequent transformation of the intermediate sound signal(s) by means of it in the next step. The determination takes into account the second set of sound signals, i.e., inputs such as sound signals (typical as inputs) such as CH1, CH2 . . . CHn and M, and said second set of Head Related Transfer Functions initially dedicated to transform or transfer said second set of input sound signals. Further, the determination takes said weighted relation (CHi=αi·L+βi·R, etc.) with corresponding intermediate signals (L, R, etc.) into account corresponding to the formulas used to explain the invention's two embodiments.
In step 300, at least one signal belonging to said third set of intermediate sound signals (L, R, CHI1, CHI2) may be transferred by means of at least one HRTF belonging to said first set (of newly generated Head Related Transfer Functions) in order to generate at least one signal (as an output signal) belonging to said first set of output sound signals (HPL, HPR). At this point, newly generated HRTFs, i.e., said first set of Head Related Transfer Functions (·(αi·HRTFi,R), ·(βi·HRTFi,R), H —1, H —2, etc.) may be used to, actually to transfer and transform (convolve) one or more intermediate sound signals, such as L, R, (first embodiment) or CHI1 and CHI2 (second embodiment). As a result, at least one of the output sound signals HPL, HPR is then generated.
It is hereby an advantage by the invention that said generation will—as previously discussed in the embodiments—generally be performed by fewer HRTFs and convolutions than the prior art.
Usually, the method will start all over again as long as the media system is powered. Otherwise, the method may terminate in step 400; however, when the media system is powered again, etc, the method may proceed from step 100.
A computer readable medium may be magnetic tape, optical disc, digital versatile disk (DVD), compact disc (CD record-able or CD write-able), mini-disc, hard disk, floppy disk, smart card, PCMCIA card, etc.
In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word “comprising” does not exclude the presence of elements or steps other than those listed in a claim. The word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements.
The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Claims (12)
1. A method of generating, in a media system, at least one output signal belonging to a first set of sound signals from at least one input signal belonging to a second set of sound signals having a related second set of Head Related Transfer Functions, said method comprising the steps of determining, for each signal in the second set of sound signals, a weighted relation comprising at least one signal belonging to a third set of intermediate sound signals and at least one weight value; determining a first set of Head Related Transfer Functions based on the second set of sound signals, the second set of Head Related Transfer Functions and the weighted relation; and transferring at least one signal from the third set of intermediate sound signals by means of at least one HRTF from said first set of Head Related Transfer Functions to generate at least one output signal belonging to said first set of sound signals.
2. A method according to claim 1 , characterized in the step of determining for each signal, i in the second set of sound signals determines CHi=αi·L+βi·R, wherein αi, and βi each is the weight value, and wherein L and R each is a signal from said third set of intermediate sound signals.
3. A method according to claim 1 , characterized in the step of determining for each signal determines CHI1=αi1·M and CHI2=αi2·M, wherein αi1 and αi2 each is the weight value, and wherein M is a signal belonging to said third set of intermediate sound signals.
4. A method according to claim 1 , characterized in that the media system is a TV, a CD player, a DVD player, a Radio, a display, an amplifier, a headphone or a VCR.
5. A non-transitory computer-readable medium encoded with a computer program product comprising program code means stored on a computer readable medium for performing for causing a computer, when loaded with and running the computer program, to perform the method of claim 1 when the computer program is run on a computer.
6. A media system for generating at least one output signal belonging to a first set of sound signals from at least one input signal belonging to a second set of sound signals having a related second set of Head Related Transfer Functions, said media system comprising: means for determining, for each signal in the second set of sound signals, a weighted relation comprising at least one signal belonging to a third set of intermediate sound signals and at least one weight value; means for determining a first set of Head Related Transfer Functions based on the second set of sound signals, the second set of Head Related Transfer Functions and the weighted relation; and means for transferring at least one signal from the third set of intermediate sound signals by means of at least one HRTF from said first set of Head Related Transfer Functions to generate at least one output signal belonging to said first set of sound signals.
7. A method of generating, in a media system, at least one output signal belonging to a first set of sound signals from at least one input signal belonging to a second set of sound signals having a related second set of Head Related Transfer Functions, said method comprising the steps of
determining, for each signal in the second set of sound signals, a weighted relation comprising at least one signal belonging to a third set of intermediate sound signals and at least one weight value;
determining a first set of Head Related Transfer Functions based on the second set of Head Related Transfer Functions and the weighted relation; and
transferring at least one signal from the third set of intermediate sound signals by means of at least one HRTF from said first set of Head Related Transfer Functions to generate at least one output signal belonging to said first set of sound signals.
8. A method according to claim 7, characterized in the step of determining for each signal, i in the second set of sound signals determines CHi=αi·L+βi·R, wherein αi, and βi each is the weight value, and wherein L and R each is a signal belonging to said third set of intermediate sound signals.
9. A method according to claim 7, characterized in the step of determining for each signal determines CHI1=αi1·M and CHI2=αi2·M, wherein αi1 and αi2 each is the weight value, and wherein M is a signal belonging to said third set of intermediate sound signals.
10. A method according to claim 7, characterized in that the media system is a TV, a CD player, a DVD player, a Radio, a display, an amplifier, a headphone or a VCR.
11. A non-transitory computer-readable medium encoded with a computer program comprising program code for causing a computer, when loaded with and running the computer program, to perform the method of claim 7.
12. A media system for generating at least one output signal belonging to a first set of sound signals from at least one input signal belonging to a second set of sound signals having a related second set of Head Related Transfer Functions, said media system comprising:
means for determining, for each signal in the second set of sound signals, a weighted relation comprising at least one signal belonging to a third set of intermediate sound signals and at least one weight valve;
means for determining a first set of Head Related Transfer Functions based on the second set of Head Related Transfer Functions and the weighted relation; and
means for transferring at least one signal from the third set of intermediate sound signals by means of at least one HRTF from said first set of Head Related Transfer Functions to generate at least one output signal belonging to said first set of sound signals.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/725,693 USRE43273E1 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02078943 | 2002-09-23 | ||
EP02078943 | 2002-09-23 | ||
US12/725,693 USRE43273E1 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
US10/528,489 US7489792B2 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
PCT/IB2003/004002 WO2004028204A2 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
Publications (1)
Publication Number | Publication Date |
---|---|
USRE43273E1 true USRE43273E1 (en) | 2012-03-27 |
Family
ID=32011013
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/725,693 Expired - Lifetime USRE43273E1 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
US10/528,489 Ceased US7489792B2 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/528,489 Ceased US7489792B2 (en) | 2002-09-23 | 2003-09-16 | Generation of a sound signal |
Country Status (9)
Country | Link |
---|---|
US (2) | USRE43273E1 (en) |
EP (1) | EP1547436B1 (en) |
JP (1) | JP4399362B2 (en) |
KR (1) | KR101016975B1 (en) |
CN (1) | CN100594744C (en) |
AU (1) | AU2003260841A1 (en) |
DE (1) | DE60328402D1 (en) |
ES (1) | ES2328922T3 (en) |
WO (1) | WO2004028204A2 (en) |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1547436B1 (en) * | 2002-09-23 | 2009-07-15 | Koninklijke Philips Electronics N.V. | Generation of a sound signal |
JP4694763B2 (en) * | 2002-12-20 | 2011-06-08 | パイオニア株式会社 | Headphone device |
EP1752017A4 (en) * | 2004-06-04 | 2015-08-19 | Samsung Electronics Co Ltd | Apparatus and method of reproducing wide stereo sound |
KR100725818B1 (en) * | 2004-07-14 | 2007-06-11 | 삼성전자주식회사 | Sound reproducing apparatus and method for providing virtual sound source |
US8627213B1 (en) * | 2004-08-10 | 2014-01-07 | Hewlett-Packard Development Company, L.P. | Chat room system to provide binaural sound at a user location |
US7634092B2 (en) * | 2004-10-14 | 2009-12-15 | Dolby Laboratories Licensing Corporation | Head related transfer functions for panned stereo audio content |
US7813933B2 (en) | 2004-11-22 | 2010-10-12 | Bang & Olufsen A/S | Method and apparatus for multichannel upmixing and downmixing |
EP1691348A1 (en) * | 2005-02-14 | 2006-08-16 | Ecole Polytechnique Federale De Lausanne | Parametric joint-coding of audio sources |
CN101185118B (en) * | 2005-05-26 | 2013-01-16 | Lg电子株式会社 | Method and apparatus for decoding an audio signal |
JP4988716B2 (en) | 2005-05-26 | 2012-08-01 | エルジー エレクトロニクス インコーポレイティド | Audio signal decoding method and apparatus |
US8917874B2 (en) | 2005-05-26 | 2014-12-23 | Lg Electronics Inc. | Method and apparatus for decoding an audio signal |
CN101263742B (en) * | 2005-09-13 | 2014-12-17 | 皇家飞利浦电子股份有限公司 | Audio coding |
KR100708196B1 (en) | 2005-11-30 | 2007-04-17 | 삼성전자주식회사 | Apparatus and method for reproducing expanded sound using mono speaker |
TWI333642B (en) * | 2006-01-19 | 2010-11-21 | Lg Electronics Inc | Method and apparatus for processing a media signal |
KR100829870B1 (en) * | 2006-02-03 | 2008-05-19 | 한국전자통신연구원 | Apparatus and method for measurement of Auditory Quality of Multichannel Audio Codec |
EP1987512A4 (en) | 2006-02-07 | 2010-05-19 | Lg Electronics Inc | Apparatus and method for encoding/decoding signal |
JP5081838B2 (en) * | 2006-02-21 | 2012-11-28 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Audio encoding and decoding |
RU2407226C2 (en) | 2006-03-24 | 2010-12-20 | Долби Свидн Аб | Generation of spatial signals of step-down mixing from parametric representations of multichannel signals |
US8027479B2 (en) | 2006-06-02 | 2011-09-27 | Coding Technologies Ab | Binaural multi-channel decoder in the context of non-energy conserving upmix rules |
FR2903562A1 (en) * | 2006-07-07 | 2008-01-11 | France Telecom | BINARY SPATIALIZATION OF SOUND DATA ENCODED IN COMPRESSION. |
US7876904B2 (en) * | 2006-07-08 | 2011-01-25 | Nokia Corporation | Dynamic decoding of binaural audio signals |
KR20080079502A (en) * | 2007-02-27 | 2008-09-01 | 삼성전자주식회사 | Stereophony outputting apparatus and early reflection generating method thereof |
EP2806661B1 (en) * | 2013-05-23 | 2017-09-06 | GN Resound A/S | A hearing aid with spatial signal enhancement |
US10425747B2 (en) | 2013-05-23 | 2019-09-24 | Gn Hearing A/S | Hearing aid with spatial signal enhancement |
US9226090B1 (en) * | 2014-06-23 | 2015-12-29 | Glen A. Norris | Sound localization for an electronic call |
US10129681B2 (en) | 2015-03-10 | 2018-11-13 | Ossic Corp. | Calibrating listening devices |
US9967693B1 (en) * | 2016-05-17 | 2018-05-08 | Randy Seamans | Advanced binaural sound imaging |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0107757A1 (en) | 1982-09-28 | 1984-05-09 | Robert Bosch Gmbh | Illuminating device for passive displays |
US5572591A (en) * | 1993-03-09 | 1996-11-05 | Matsushita Electric Industrial Co., Ltd. | Sound field controller |
US5742689A (en) * | 1996-01-04 | 1998-04-21 | Virtual Listening Systems, Inc. | Method and device for processing a multichannel signal for use with a headphone |
WO2001049073A2 (en) | 1999-12-24 | 2001-07-05 | Koninklijke Philips Electronics N.V. | Multichannel audio signal processing device |
WO2001049066A2 (en) | 1999-12-24 | 2001-07-05 | Koninklijke Philips Electronics N.V. | Headphones with integrated microphones |
US6496584B2 (en) | 2000-07-19 | 2002-12-17 | Koninklijke Philips Electronics N.V. | Multi-channel stereo converter for deriving a stereo surround and/or audio center signal |
US6990205B1 (en) * | 1998-05-20 | 2006-01-24 | Agere Systems, Inc. | Apparatus and method for producing virtual acoustic sound |
US7489792B2 (en) * | 2002-09-23 | 2009-02-10 | Koninklijke Philips Electronics N.V. | Generation of a sound signal |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4237710A1 (en) * | 1991-11-07 | 1993-05-13 | Koenig Florian | Improving head related sound characteristics for TV audio signal playback - using controlled audio signal processing for conversion into stereo audio signals |
AU1527197A (en) * | 1996-01-04 | 1997-08-01 | Virtual Listening Systems, Inc. | Method and device for processing a multi-channel signal for use with a headphone |
US6067361A (en) * | 1997-07-16 | 2000-05-23 | Sony Corporation | Method and apparatus for two channels of sound having directional cues |
-
2003
- 2003-09-16 EP EP03797465A patent/EP1547436B1/en not_active Expired - Lifetime
- 2003-09-16 CN CN03822586A patent/CN100594744C/en not_active Expired - Lifetime
- 2003-09-16 AU AU2003260841A patent/AU2003260841A1/en not_active Abandoned
- 2003-09-16 KR KR1020057004893A patent/KR101016975B1/en active IP Right Grant
- 2003-09-16 JP JP2004537424A patent/JP4399362B2/en not_active Expired - Lifetime
- 2003-09-16 US US12/725,693 patent/USRE43273E1/en not_active Expired - Lifetime
- 2003-09-16 DE DE60328402T patent/DE60328402D1/en not_active Expired - Lifetime
- 2003-09-16 US US10/528,489 patent/US7489792B2/en not_active Ceased
- 2003-09-16 WO PCT/IB2003/004002 patent/WO2004028204A2/en active Application Filing
- 2003-09-16 ES ES03797465T patent/ES2328922T3/en not_active Expired - Lifetime
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0107757A1 (en) | 1982-09-28 | 1984-05-09 | Robert Bosch Gmbh | Illuminating device for passive displays |
US5572591A (en) * | 1993-03-09 | 1996-11-05 | Matsushita Electric Industrial Co., Ltd. | Sound field controller |
US5742689A (en) * | 1996-01-04 | 1998-04-21 | Virtual Listening Systems, Inc. | Method and device for processing a multichannel signal for use with a headphone |
US6990205B1 (en) * | 1998-05-20 | 2006-01-24 | Agere Systems, Inc. | Apparatus and method for producing virtual acoustic sound |
WO2001049073A2 (en) | 1999-12-24 | 2001-07-05 | Koninklijke Philips Electronics N.V. | Multichannel audio signal processing device |
WO2001049066A2 (en) | 1999-12-24 | 2001-07-05 | Koninklijke Philips Electronics N.V. | Headphones with integrated microphones |
US6829361B2 (en) * | 1999-12-24 | 2004-12-07 | Koninklijke Philips Electronics N.V. | Headphones with integrated microphones |
US7110556B2 (en) * | 1999-12-24 | 2006-09-19 | Koninklijke Philips Electronics N.V. | Multichannel audio signal processing device |
US6496584B2 (en) | 2000-07-19 | 2002-12-17 | Koninklijke Philips Electronics N.V. | Multi-channel stereo converter for deriving a stereo surround and/or audio center signal |
US7489792B2 (en) * | 2002-09-23 | 2009-02-10 | Koninklijke Philips Electronics N.V. | Generation of a sound signal |
Also Published As
Publication number | Publication date |
---|---|
EP1547436B1 (en) | 2009-07-15 |
DE60328402D1 (en) | 2009-08-27 |
WO2004028204A2 (en) | 2004-04-01 |
KR101016975B1 (en) | 2011-02-28 |
AU2003260841A8 (en) | 2004-04-08 |
ES2328922T3 (en) | 2009-11-19 |
US7489792B2 (en) | 2009-02-10 |
WO2004028204A3 (en) | 2004-07-15 |
CN1685763A (en) | 2005-10-19 |
JP2006500817A (en) | 2006-01-05 |
EP1547436A2 (en) | 2005-06-29 |
KR20050043985A (en) | 2005-05-11 |
AU2003260841A1 (en) | 2004-04-08 |
US20060045274A1 (en) | 2006-03-02 |
JP4399362B2 (en) | 2010-01-13 |
CN100594744C (en) | 2010-03-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE43273E1 (en) | Generation of a sound signal | |
US7382885B1 (en) | Multi-channel audio reproduction apparatus and method for loudspeaker sound reproduction using position adjustable virtual sound images | |
AU2008362920B2 (en) | Method of rendering binaural stereo in a hearing aid system and a hearing aid system | |
CN101356573A (en) | Control for decoding of binaural audio signal | |
EP1194007A2 (en) | Method and signal processing device for converting stereo signals for headphone listening | |
EP1971979A1 (en) | Decoding of binaural audio signals | |
JP2003070100A (en) | Device and method for multichannel audio reproduction using two speakers | |
CN102804747A (en) | Multichannel echo canceller | |
WO2007080225A1 (en) | Decoding of binaural audio signals | |
EP3895451A1 (en) | Method and apparatus for processing a stereo signal | |
US6700980B1 (en) | Method and device for synthesizing a virtual sound source | |
US7599498B2 (en) | Apparatus and method for producing 3D sound | |
US20070109977A1 (en) | Method and apparatus for improving listener differentiation of talkers during a conference call | |
EP1275269B1 (en) | A method of audio signal processing for a loudspeaker located close to an ear and communications apparatus for performing the same | |
KR20080078907A (en) | Controlling the decoding of binaural audio signals | |
US20240056735A1 (en) | Stereo headphone psychoacoustic sound localization system and method for reconstructing stereo psychoacoustic sound signals using same | |
WO2021140791A1 (en) | Encoding device, decoding device, encoding method, and decoding method | |
CN117082406A (en) | Audio playing system | |
GB2620593A (en) | Transporting audio signals inside spatial audio signal | |
JP2020039168A (en) | Device and method for sound stage extension |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |