WO2007073818A1 - System and method for separation of a user’s voice from ambient sound - Google Patents
System and method for separation of a user’s voice from ambient sound Download PDFInfo
- Publication number
- WO2007073818A1 WO2007073818A1 PCT/EP2006/011423 EP2006011423W WO2007073818A1 WO 2007073818 A1 WO2007073818 A1 WO 2007073818A1 EP 2006011423 W EP2006011423 W EP 2006011423W WO 2007073818 A1 WO2007073818 A1 WO 2007073818A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- microphone
- audio signal
- ear
- ear canal
- Prior art date
Links
- 238000000926 separation method Methods 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims description 13
- 230000005236 sound signal Effects 0.000 claims abstract description 92
- 238000012545 processing Methods 0.000 claims abstract description 54
- 210000000613 ear canal Anatomy 0.000 claims abstract description 50
- 210000000883 ear external Anatomy 0.000 claims description 7
- 230000001939 inductive effect Effects 0.000 claims description 6
- 230000002238 attenuated effect Effects 0.000 claims description 2
- 230000006854 communication Effects 0.000 description 17
- 238000004891 communication Methods 0.000 description 17
- 239000000203 mixture Substances 0.000 description 9
- 238000012986 modification Methods 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 241001622623 Coeliadinae Species 0.000 description 2
- 241000238367 Mya arenaria Species 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012880 independent component analysis Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000000843 powder Substances 0.000 description 2
- 239000004952 Polyamide Substances 0.000 description 1
- 230000005534 acoustic noise Effects 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 238000000149 argon plasma sintering Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- -1 for example Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000012625 in-situ measurement Methods 0.000 description 1
- 238000001459 lithography Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 229920002647 polyamide Polymers 0.000 description 1
- 238000006116 polymerization reaction Methods 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- 210000000216 zygoma Anatomy 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0272—Voice signal separating
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1016—Earpieces of the intra-aural type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/407—Circuits for combining signals of a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/021—Behind the ear [BTE] hearing aids
- H04R2225/0216—BTE hearing aids having a receiver in the ear mould
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/023—Completely in the canal [CIC] hearing aids
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/025—In the ear hearing aids [ITE] hearing aids
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
Definitions
- the present invention relates to a system and a method for separation of a user's voice from ambient sound by using at least one device to be worn at the user's ear or at least partly in the user's ear canal.
- a sound pick-up system which is capable at least to some extent to separate the user's voice from ambient noise, or generally ambient sound, in order to improve the intelligibility of the person's speech to the listener, who may be one of the other persons exposed to the noisy environment or who may be a remote person.
- a common approach to achieve such separation of a person's voice is the use of a boom microphone, i.e. a microphone which is placed close to the mouth, carried by a headset, helmet or any other device worn by the person.
- a boom microphone i.e. a microphone which is placed close to the mouth, carried by a headset, helmet or any other device worn by the person.
- Such microphone selectively emphasizes the near field around the mouth.
- vibration pick-up devices which are in direct contact with the throat, picking up the vibrations of the vocal chord, or which are in direct contact with the meatus wall or the outer ear canal, picking up the vibrations of the head tissue (i.e. "bone conduction” microphones) or which are in direct contact with the cheek-bone.
- US 6,661,901 Bl relates to an active hearing protection system comprising an earplug with an outer microphone for picking up ambient sound and an inner microphone which is sealed with respect to ambient sound but is open towards the inner part of the user's ear canal.
- an operation mode in which separation of the user's voice from ambient noise is desired only the inner microphone is activated while the outer microphone is not, with the signal from the inner microphone being processed by an electronics unit integrated within the earplug in order to make the user's voice highly natural and intelligible, either for the user himself or his external communication partners.
- BSS blind source separation
- US 2005/0060142 Al relates in a more general manner to the use of two spaced-apart microphones operated with a BSS algorithm for voice separation from background noise in audio applications.
- EP 1 509 065 Al relates to a binaural hearing aid system wherein the audio signals captured by the microphone of the right ear hearing aid and the microphone of the left ear hearing aid undergo a BSS algorithm, followed by additional signal processing, in order to increase the intelligibility of speech in background noise by the user of the hearing aid system.
- the invention is beneficial in that, by using a first microphone and a second microphone, wherein according to the solution of claims 1 and 36 the first microphone is oriented acoustically outwardly towards the environment and the second microphone oriented acoustically inwardly towards the user's ear canal and according to the solution of claims 33 and 37 the first microphone is located at the right ear and the second microphone is located at the left ear, and by processing the audio signals from the first and second microphone by a blind source separation algorithm, good separation of the user's voice from ambient sound with resulting high intelligibility of the user's speech is achieved without the need for additional restrictions regarding the location of the microphones, so that in particular the need for a boom microphone or a bone-conduction microphone can be avoided.
- blind source separation also referred to as “independent component analysis” (ICA)
- ICA independent component analysis
- blind source separation applies an "un-mixing" matrix of weights to the mixed signals, for example, multiplying the matrix with the mixed signals, to produce separated signals.
- the weights are assigned initial values, and then adjusted to maximize joint entropy of the signals in order to minimize information redundancy. This weight-adjusting and entropy-increasing process is repeated until the information redundancy of the signals is reduced to a minimum. Because this technique does not require information on the source of each signal, it is referred to as “blind source separation”.
- An introduction to blind source separation is found, for example, in US 2005/0060142 Al.
- BSS is applied to two different mixtures of two (acoustic) sources, wherein the two different mixtures are obtained by using two spaced apart microphones.
- Mixing of the two sources can be represented by a matrix A, with the BSS algorithm corresponding mathematically to finding the inverse matrix of A without knowing anything about the matrix nor about the sources, except that they are statistically independent, hi the case of a person's voice mixed with background noise the latter assumption usually is valid.
- the mixtures of the two sources could be different with respect to amplitude and/or phase of the two sources, hi other words, by picking up sound signals with two differently oriented microphones the signal of each of these microphones will correspond to a mixture which is different with regard to the difference in amplitude and/or phase of the two acoustic sources (i.e. user's voice on the one hand and ambient noise on the other hand).
- the signal of each of these microphones will correspond to a mixture which is different with regard to the difference in amplitude and/or phase of the two acoustic sources (i.e. user's voice on the one hand and ambient noise on the other hand).
- the two microphones are part of a hearing protection device.
- the microphones can be arranged such that the ambient sound reaching the inwardly oriented microphone is attenuated by the hearing protection device relative to ambient sound reaching the outwardly oriented microphone.
- the hearing protection device could be an earmuff
- the hearing protection device is an earplug comprising a shell which is to be inserted at least partially into the user's ear canal.
- the shell is a customized hard shell having an elasticity from shore D85 to D65 and having an outer shape according to the measured inner shape of the user's outer ear and ear canal.
- the shell is a generic soft shell capable of adapting to the shape of the user's outer ear and ear canal.
- the inwardly oriented microphone is located at or is open to the inner part of the shell which is to be inserted into the ear canal, with the inwardly oriented microphone preferably being located at the inner end of the shell or within a channel of the shell open to the inner end of the shell.
- the outwardly oriented microphone is located at or is open to the outer part of the shell which is not to be inserted into the ear canal, with the outwardly oriented microphone preferably being located at the outer end of the shell or within a channel of the shell open to the outer end of the shell.
- the hearing protection device is an earmuff
- the first microphone is located at or is open to the outer side of the earmuff and the second microphone is located at or is open to the inner side of the earmuff.
- the device preferably comprises a speaker adapted to provide an external audio signal to the user's ear.
- the speaker is located at or is open to a portion of the device which is to be worn within the user's ear canal, whereby the speaker is brought acoustically close to the user's ear drum so that good intelligibility of the sound provided by the speaker is achieved even in noisy environments.
- the device will be binaural, i.e. it will comprise one unit for the right ear and another unit for the left ear.
- the speaker and the microphones may be integrated in the same unit, i.e. in at least one of the units, or the speaker may be part of the unit for one ear and the microphones may be part of the unit for the other ear.
- the device may be adapted to be worn completely within the user's ear canal, whereby the device can be more or less completely hidden from the views of other persons.
- the device may be any other kind of a wired or wireless headset.
- the audio signal processing unit is integrated within the device, hi an alternative embodiment, the audio signal processing unit may be adapted to be worn behind the user's ear or somewhere at the user's body, hi this case, although the device becomes more handy, more space, and hence also more power, is available for the audio signal processing unit, which may reduce the costs an/or may improve the performance of the blind source separation, hi such case, the audio signal processing unit may be connected to the microphone either by wires, which is the most simple solution, or via a wireless link, for example, a radio frequency link such as Bluetooth link, an inductive link or an infrared link, which solution would result in enhanced wearing comfort for the user.
- a radio frequency link such as Bluetooth link, an inductive link or an infrared link
- the audio signal processing unit could be designed to be located remote from the user and is connected to the microphones via a radio frequency link such as Bluetooth link, hi this case, there would be even less restrictions regarding the size and power consumption of the audio signal processing unit, which might result in reduced costs and/or increased performance of the blind source separation.
- the system preferably comprises a radio frequency transmitter for transmitting the processed audio signal output of the audio signal processing unit to a remote radio frequency receiver in order to provide the user's voice to another person.
- the radio frequency transmitter is integrated within the audio signal processing unit, i.e.
- the radio frequency transmitter may be either integrated within the device or it may be adapted to be worn behind the use's ear or at the user's body or it could be even located remote from the user.
- the radio frequency transmitter could be remote from the audio signal processing unit, in which case the processed audio signal output of the audio signal processing unit would be provided to a radio frequency transmitter by wires or via a radio frequency link, an inductive link or an infrared link.
- the location of the audio signal processing unit and the radio frequency transmitter can be optimized independently form each other.
- the blind source separation algorithm preferably works in the frequency domain, i.e. the algorithm is simultaneously carried out in different frequency bands/bins and the outcomes of these bands/bins are combined in an appropriate way.
- the blind source separation algorithm preferably works with the assumption that the sources are statistically independent, i.e. that the user's voice is independent of the ambient sound.
- Fig. 1 shows a schematic view of a first embodiment of a hearing protection earplug system according to the invention inserted into a person's ear canal with a block diagram of the most relevant electronic components;
- Fig. 2 shows a schematic view of a modified embodiment of a hearing protection earplug according to the invention
- FIGs. 3 and 4 show further modified embodiments of a system according to the invention
- Fig. 5 shows a modification of the embodiment of Fig. 1;
- Fig. 6 shows a modification of the embodiment of Fig. 5;
- Fig.7 shows a schematic view of an embodiment of a BTE hearing instrument according to the invention with a block diagram of the most relevant electronic components
- Fig. 8 shows a modified embodiment of a BTE hearing instrument according to the invention
- Fig. 9 shows a schematic view of an embodiment of a headset according to the invention with a block diagram of the most relevant electronic components.
- Fig. 10 shows a modified embodiment of a headset according to the invention.
- the system of Fig. 1 comprises a device 10 designed as a hearing protection earplug which may have a hard shell with an elasticity from shore D85 to shore D65, which is customized, i.e. it has an outer shape according to the individual measured inner shape of the user's outer ear and ear canal.
- the hard shell may be manufactured by layer-by-layer laser sintering of a powder material, for example, polyamide powder, or by laser stereo-lithography or photo- polymerization.
- An overview regarding such additive layer-by-layer build-up processes for manufacturing customized shells of hearing devices can be found, for example, in US 2003/0133583 Al or US 6,533,062 Bl.
- the inner shape of the person's ear canal and outer ear can be measured, for example, by taking an impression which then undergoes laser scanning or by direct laser scanning of the ear.
- the hard shell is designed such that it provides for an acoustic attenuation, averaged over the audible frequency range, of at least 10 dB when inserted into the user's ear canal.
- earplug 10 may have a generic soft shell which adapts to the shape of the users outer ear and ear canal due to its elasticity.
- Fig. 1 the earplug 10 is shown to be inserted with its inner end portion into a user's ear canal 12.
- the earplug 10 comprises an outer microphone Ml, which is located at the outer part of the earplug 10 and which is open to the outer end 14 of the earplug 10 via a sound channel 16, and an inner microphone M2, which is located at the inner part of the earplug 10 and which is open to the inner end 18 of the earplug 10 via a sound channel 20.
- the earplug 10 further comprises a speaker S which is likewise located at the inner part of the earplug 10 and is open to the inner end 18 via a sound channel 22.
- the earplug 10 also includes a digital audio signal processing unit 24 comprising a digital signal processor as well as a radio frequency transmitter unit Tl and a radio frequency receiver unit Rl.
- the audio signal processing unit 24 functionally includes a unit 26 for applying a blind source separation algorithm to the audio signals provided by the microphones Ml and M2.
- the earplug 10 includes additional electrical components, such as amplifiers and analogue-to-digital converters for the audio signals provided by the microphones Ml and M2, a digital-to-analogue converter and an amplifier for the audio signal to be transformed into sound by the speaker S, program and data memory components for the audio signal processing unit 24, a battery for power supply, a demodulator, a modulator, an antenna, etc., which are not shown in Fig. 1 for the sake of simplicity.
- the transmitter Tl of the earplug 10 is adapted to transmit audio signals from the earplug 10 to a remote receiver R2 via a radio link, while the receiver Rl of the earplug 10 is adapted to receive audio signals from a remote transmitter T2.
- the audio signals received by the receiver Rl are demodulated and then undergo signal processing in the audio signal processing unit 24 as input to the speaker S in order to provide remote audio signals to the user.
- Such remote audio signals could be the speech of another person picked up by a microphone whose output is sent to the remote transmitter T2 by wires or via, for example, a mobile telephone or mobile radio device.
- the audio signals provided by the microphones Ml and M2 are passed as input to the blind source separation unit 26, in which a processed audio signal output for the transmitter Tl is produced, with the processed audio signal output consisting completely or at least essentially of the user's voice which has been separated from the ambient sound by action of the blind source separation algorithm carried out in the BSS unit 26.
- BSS signal processing utilizes the fact that the sound mixtures picked up by the microphone Ml which is oriented towards the environment and M2 which is oriented towards the ear canal 12, respectively, consist - due to the different orientation of the microphones Ml and M2 - of essentially different mixtures of the ambient sound and the user's voice, which are different regarding amplitude ratio of these two signal contributions or sources (i.e. ambient sound on the one hand and user's voice on the other hand) and regarding phase difference of these two signal contributions of the mixture.
- the output signal of the BSS unit 26 is transmitted via the transmitter Tl to the remote receiver R2 which usually will be connected to a remote speaker for presenting the user's voice to another person.
- the remote speaker and the remote microphone connected to the remote transmitter T2 could be part of an earpiece or an earplug worn by another person, which may be similar or identical to the earplug 10.
- in-the-ear hearing protection devices with integrated communication function can be achieved.
- Such a system could be used by any persons who need to communicate in a noisy environment, such as workers, soldiers, firemen, etc.
- the remote receiver R2 also might serve for communication via a mobile telephone or a mobile radio device.
- the remote receiver R2 / transmitter T2 could be a part of an interface of a standard wireless communication device, such as a mobile telephone device or a mobile radio device
- a standard wireless communication device such as a mobile telephone device or a mobile radio device
- the wireless link between the transmitter Tl / receiver Rl and the remote receiver R2 / remote transmitter T2 is a Bluetooth link.
- the remote receiver R2 / transmitter T2 then could be a part of the Bluetooth interface of a standard wireless communication device, such as a mobile telephone device or a mobile radio device.
- the audio signal produced by the microphones Ml and M2, which is used as input to the BSS unit 26, in addition could undergo other audio signal processing within the audio signal processing unit 24, for example, in order to provide the ambient sound picked up by the microphone Ml to the speaker S for enabling perception of desired ambient sounds during times when the noise level is low so that the hearing protection function provided by the earplug 10 is not needed, or to provide for an in-situ measurement of the actual acoustic attenuation provided by the earplug 10 when inserted into the user's ear canal 12 by comparing the sound levels measured by the microphones Ml and M2.
- Fig. 1 the audio signal produced by the microphones Ml and M2 which is used as input to the BSS unit 26, in addition could undergo other audio signal processing within the audio signal processing unit 24, for example, in order to provide the ambient sound picked up by the microphone Ml to the speaker S for enabling perception of desired ambient sounds during times when the noise level is low so that the hearing protection function provided by the earplug 10 is not needed, or
- the transmitter Tl and the receiver Rl have been removed from the earplug 10 and now are located in an external unit 28 which is connected by wires 30 to the earplug 10 and which is to be worn at an appropriate location at the user's body, for example behind the user's ear or somewhere within or below the user's clothing, for example, within a helmet.
- the external unit 28 may include further electrical components removed from the earplug 10, for example, the power supply battery.
- Fig. 3 a further modified embodiment is shown, wherein not only the transmitter Tl and the receiver Rl (and the power supply battery) but in addition also the audio signal processing unit 24 including the BSS unit 26 has been removed from the earplug 10 and is connected via corresponding wires to the microphones Ml and M2 and the speaker S, respectively.
- a still further modified embodiment is shown, wherein the wire connection 30 between the earplug 10 and the external unit 28 has been replaced by a bidirectional wireless link 32, which is established by a transmitter T3 and a receiver R3 located in the earplug 10 and a corresponding receiver R4 and transmitter T4 located in the external unit 28.
- the wireless link 32 could be a radio frequency link, an inductive link or an infrared link. If it is an inductive link, the external unit 28 would have to be located relatively close to the earplug 10, for example at a distance of not more than 20 cm.
- the distance could be larger; in this case it would be even be possible to locate the external unit 28 at a position remote from the user's body, for example, within a distance of a few meters.
- the wireless link 32 of the embodiment of Fig. 4 is a Bluetooth link.
- the speaker S is shown as being integrated in the same earplug 10 as the microphones Ml and M2, in other embodiments the speaker S may be provided at an earplug other than the earplug at which the microphones Ml and M2 are provided.
- Fig. 5 shows a modified version of the embodiment of Fig. 1 , wherein the inwardly oriented second microphone M2 is not part of the earplug 10 - as shown in Fig. 1 - but rather is provided at the earplug 1 1 for the other ear.
- the second microphone M2 is located at the inner part of the earplug 11 and is open to the inner end 18 of the earplug 11 via a sound channel 20.
- the earplug 11 further comprises a speaker S which is likewise located at the inner part of the earplug 11 and is open to the inner end 18 via a sound channel 22.
- the microphone M2 and the speaker S of the earplug 11 are connected to the audio signal processing unit 24 located in the earplug 10 via a wire connection 40 which be integrated in a mechanical connection (not shown) between the earplugs 10 and 11 which may be provided for preventing loss of the earplugs 10, 11.
- the outwardly oriented first microphone Ml may be provided at the earplug 1 1, while the inwardly oriented second microphone M2 may be provided at the earplug 10 as in Fig. 1.
- FIG. 6 An alternative modification of the embodiment of Fig. 5 is shown in Fig. 6, wherein both the first microphone Ml of the earplug 10 and the second microphone M2 of the earplug 1 1 are outwardly oriented, hi this case the differences in the sound mixtures picked up by the microphone Ml of the earplug 10 and the microphone M2 of the earplug 11 are due to the different location of the microphone Ml at one ear and the microphone M2 at the other ear
- a disturbing noise source usually will be located closer to one of the two ears and hence will contribute more strongly and with different phase to the signal picked up by the microphone located at that ear than to that located at the other ear).
- both microphones Ml and M2 could be inwardly oriented rather than outwardly oriented.
- FIGs. 5 and 6 and the above-discussed variants thereof are modifications of the embodiment of Fig. 1 , according to which both the audio signal processing unit 24 and the transmitter Tl / receiver Rl are part of the earplug 10, it is to be understood that the embodiments of Figs. 2 to 4 may be analogously modified, i.e. by providing the second microphone M2 at the earplug 11 rather than at the earplug 10.
- the invention also may be applied to earmuffs serving as a hearing protection device or generally to any kind of headset, i.e. also to hearing devices which do not provide for a hearing protection function.
- the headset may consist of a device with a customized or a generic shell which is designed such that it can be worn completely in the ear canal 12 (i.e. as a "CIC device") and which serves exclusively communication purposes, for example, for security persons, policemen, firemen, etc., i.e. for persons who are exposed to a noisy environment, with the noise level, however, being below a threshold value which would require the use of hearing protection devices.
- Such CIC device generally could have the construction of the earplug of Fig. 1 , however, without considerable acoustic attenuation provided due to the material and the design of the shell, and would be reduced in size so that it can be worn completely within the ear canal 12.
- the device need not be designed as an earplug but it may rather be any kind of headset.
- oriented acoustically outwardly towards the environment it is meant that the respective microphone is acoustically open to the environment, whereas by “oriented acoustically outwardly towards the user's ear canal” it is meant that the respective microphone is acoustically open to the user's ear canal.
- This does not necessarily imply that there is line-of- sight connection to the environment or the ear canal, respectively; rather, it is sufficient that there is an acoustic connection to the environment or the ear canal, respectively, for example by a sound channel or a sound tube.
- earplug any device is meant which is to be worn in the ear canal or in the concha, so that also earmolds, i.e. devices to be worn in the concha rather than in the ear canal, are included.
- Fig. 7 an embodiment is shown, wherein the device 10, in contrast to the embodiments shown in Figs. 1 to 6, is not designed as a hearing protection earplug but rather as a hearing instrument to be worn behind the user's ear, with the design corresponding to that of a BTE hearing instrument.
- the device 10 comprises a housing 50 to be worn behind the user's ear, with a sound tube 52 extending from the housing 50 to an earplug 54 to be worn in the user's ear canal or concha, respectively.
- the earplug 54 is provided at the free end of the sound tube 52, while at the other end the speaker S and the microphone M2 are provided in order to acoustically connect the speaker S and the microphone M2 to the user's ear canal.
- the earplug 54 is provided at the free end of the sound tube 52, while at the other end the speaker S and the microphone M2 are provided in order to acoustically connect the speaker S and the microphone M2 to the user's ear canal
- the housing 50 in addition to the speaker S and the microphone M2, also includes an outwardly oriented microphone Ml, an audio signal processing unit 24 with a BSS unit 26, a RF transmitter unit Tl , a RF receiver unit Rl and a power supply 56.
- the functionality of the electronic components may correspond, for example, to that of the embodiment of Fig. 1 , i.e. the audio signals captured by the outwardly oriented microphone Ml and the inwardly oriented microphone M2 are supplied to the BSS unit 26 in order to extract the user's voice from ambient sound, and the output signal of the BSS unit 26 is transmitted via the transmitter unit Tl to an external receiver unit (not shown) for supplying the user's voice to, for example, another person.
- External audio signals may be received by the receiver unit Rl and may be supplied via the audio signal processing unit 24 and the speaker S to the user, hi addition, the audio signals captured by the outwardly oriented microphone Ml may be processed in the audio signal processing unit 24 and then may be supplied to the user's ear via the speaker S, whereby the device 10 may function as a hearing aid.
- Fig. 8 a modified version of embodiment of Fig. 7 is shown, wherein both the speaker S and the microphone M2 are provided directly in the earplug 54 rather than being acoustically connected to the earplug 54 via a sound tube 52 as in Fig. 7.
- the speaker S and the microphone M2 are connected to the housing 50 and to the audio signal processing unit 24 via a cable connection 58.
- the device 10 is designed as a headset comprising a housing 50 which is to be worn below the user's ear and is fixed to the user's pinna by means of a loop 60 which may be made of wire and which is adjustable to the individual size of the user's pinna.
- the housing 50 is provided with an adjustment element which is fixed to one end of the loop and through which the other end 64 of the loop is guided in such a manner that it can be fixed in various positions.
- the size of the loop 60 can be adjusted by the user by pulling at the free end 64 of the loop 60.
- Such a loop is described, for example, in the German Patent Application 10 2006 016 052.5 or in DE 10 2005 002 482 B3. According to Fig.
- the audio signal processing unit 24, the receiver unit Rl, the transmitter unit Tl and the power supply may be integrated in a separate housing 5OA, which is electrically and mechanically connected via a connector 66 to the housing 50 which includes the microphones Ml and M2 and the speaker S.
- the transmission unit Tl and the receiver unit Rl serve to establish a bi-directional wireless link to communication devices, such as a mobile phone or a walkie-talkie.
- element 56 is a power supply, such as a primary or rechargeable battery.
- the speaker S and the microphone M2 are located at one end of a sound tube 52 which extends with its free end 68 into the user's ear canal.
- the free end 68 may be provided with an earplug.
- the housing 50A with the electronic components 24, Tl, Rl, and power supply 56 included therein forms a communication unit which, on the one hand, receives external audio signals from a communication device, which are reproduced via the speaker S to the user's ear.
- the communication device extracts the user's voice by blind source separation of audio signals from the microphones Ml and M2 in the BSS unit 26, with the separated audio signals corresponding to the user's voice and being transmitted to the communication device.
- the housing 50 in addition to the inwardly oriented microphone M2, the speaker S, and the outwardly oriented microphone Ml may also include the audio signal processing unit 24 with the BSS unit 26, the RF transmitter unit Tl, the RF receiver unit Rl and the power supply 56.
- the additional housing 5OA would be obsolete.
- FIG. 10 A modification of the embodiment of Fig. 9 is shown in Fig. 10, wherein a cable connector 70, rather than the communication unit 50A of Fig. 9, is received in the connector 66.
- the cable connector 70 serves to connect the microphones Ml and M2 and the speaker S to an external audio signal processing unit (not shown) which includes a BSS unit in order to apply BSS to the signals of the microphones Ml and M2 in order to separate the user's voice.
- This external audio signal processing unit also is connected to a communication device in order to supply the user's voice to such communication device and to receive external audio signals which are to be reproduced by the speaker S.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Neurosurgery (AREA)
- Headphones And Earphones (AREA)
Abstract
The invention relates to a system for separation of a user's voice from ambient sound, comprising a device (10) to be worn at the user's ear or at least partly in the user's ear canal (12) comprising a first microphone (Ml) oriented acoustically outwardly towards the environment and a second microphone (M2) oriented acoustically inwardly towards the user's ear canal, and an audio signal processing unit (24, 26) for processing audio signals from the first and second microphone by a blind source separation algorithm adapted to separate the user's voice from ambient sound.
Description
System and Method for Separation of a User's Voice from Ambient Sound
The present invention relates to a system and a method for separation of a user's voice from ambient sound by using at least one device to be worn at the user's ear or at least partly in the user's ear canal.
For communication purposes, in particular for wireless electronic communication between or from persons exposed to a noisy environment, such as workers in industrial plants, policemen, soldiers, firemen, etc., it is desirable to have a sound pick-up system which is capable at least to some extent to separate the user's voice from ambient noise, or generally ambient sound, in order to improve the intelligibility of the person's speech to the listener, who may be one of the other persons exposed to the noisy environment or who may be a remote person.
A common approach to achieve such separation of a person's voice is the use of a boom microphone, i.e. a microphone which is placed close to the mouth, carried by a headset, helmet or any other device worn by the person. Such microphone selectively emphasizes the near field around the mouth.
Other approaches are vibration pick-up devices which are in direct contact with the throat, picking up the vibrations of the vocal chord, or which are in direct contact with the meatus wall or the outer ear canal, picking up the vibrations of the head tissue (i.e. "bone conduction" microphones) or which are in direct contact with the cheek-bone.
Devices of these types are either fairly sensitive to acoustic noise masking the speech or certain speech sounds are poorly transmitted, especially the high frequency consonant sounds necessary for good intelligibility. Furthermore, for industrial applications boom microphones have the drawbacks that they limit the freedom of movement of the user and that, when combined with a hearing protection device, they will affect the stability and hence the attenuation of the hearing protection device. Bone-conduction microphones have the drawbacks that they have a very limited audio bandwidth which limits the intelligibility of the speech and that they often have to be pressed fairly hard which causes discomfort to the user.
US 6,661,901 Bl relates to an active hearing protection system comprising an earplug with an outer microphone for picking up ambient sound and an inner microphone which is sealed with respect to ambient sound but is open towards the inner part of the user's ear canal. In an operation mode in which separation of the user's voice from ambient noise is desired only the inner microphone is activated while the outer microphone is not, with the signal from the inner microphone being processed by an electronics unit integrated within the earplug in order to make the user's voice highly natural and intelligible, either for the user himself or his external communication partners.
Another approach is based on a so-called "blind source separation" (BSS) algorithm in order to separate a person's voice from background noise by corresponding audio signal processing. hi this respect, US 2003/0055535 Al relates to the use of a BSS algorithm for separating the voice of an operator of a vehicle wheel alignment system with a voice audio interface from background noise by using a microphone array in order to avoid the necessity to use a headset.
US 2005/0060142 Al relates in a more general manner to the use of two spaced-apart microphones operated with a BSS algorithm for voice separation from background noise in audio applications. EP 1 509 065 Al relates to a binaural hearing aid system wherein the audio signals captured by the microphone of the right ear hearing aid and the microphone of the left ear hearing aid undergo a BSS algorithm, followed by additional signal processing, in order to increase the intelligibility of speech in background noise by the user of the hearing aid system.
It is an object of the invention to provide for a system and a method for separation of a person's voice from ambient sound wherein good intelligibility of speech is achieved while nevertheless discomfort to the person is to be avoided as far as possible.
According to the invention this object is achieved by a system as defined in claims 1 and 33, and by corresponding methods as defined in claims 36 and 37, respectively.
The invention is beneficial in that, by using a first microphone and a second microphone, wherein according to the solution of claims 1 and 36 the first microphone is oriented acoustically outwardly towards the environment and the second microphone oriented acoustically inwardly towards the user's ear canal and according to the solution of claims 33
and 37 the first microphone is located at the right ear and the second microphone is located at the left ear, and by processing the audio signals from the first and second microphone by a blind source separation algorithm, good separation of the user's voice from ambient sound with resulting high intelligibility of the user's speech is achieved without the need for additional restrictions regarding the location of the microphones, so that in particular the need for a boom microphone or a bone-conduction microphone can be avoided. In particular, by orienting the first microphone towards the environment and orienting the second microphone towards the user's ear canal or by locating the first microphone at the right ear and the second microphone at the left ear these two microphones pick up sufficiently differently mixed signals of the ambient sound and the user's voice so that a BSS algorithm will work efficiently.
Generally, blind source separation (also referred to as "independent component analysis" (ICA)) is a technique for separating mixed source signals (components) which are presumably statistically independent from each other, hi its simplified form, blind source separation applies an "un-mixing" matrix of weights to the mixed signals, for example, multiplying the matrix with the mixed signals, to produce separated signals. The weights are assigned initial values, and then adjusted to maximize joint entropy of the signals in order to minimize information redundancy. This weight-adjusting and entropy-increasing process is repeated until the information redundancy of the signals is reduced to a minimum. Because this technique does not require information on the source of each signal, it is referred to as "blind source separation". An introduction to blind source separation is found, for example, in US 2005/0060142 Al.
In the most simple case, BSS is applied to two different mixtures of two (acoustic) sources, wherein the two different mixtures are obtained by using two spaced apart microphones. Mixing of the two sources can be represented by a matrix A, with the BSS algorithm corresponding mathematically to finding the inverse matrix of A without knowing anything about the matrix nor about the sources, except that they are statistically independent, hi the case of a person's voice mixed with background noise the latter assumption usually is valid. The mixtures of the two sources could be different with respect to amplitude and/or phase of the two sources, hi other words, by picking up sound signals with two differently oriented
microphones the signal of each of these microphones will correspond to a mixture which is different with regard to the difference in amplitude and/or phase of the two acoustic sources (i.e. user's voice on the one hand and ambient noise on the other hand). By orienting one of the microphones outwardly towards the environment and the other microphone inwardly to the ear canal, a particularly large difference between the two mixtures can be obtained in a simple and particularly comfortable manner, i.e. no boom microphones or bone-conduction microphones which would cause discomfort to the user need to be used.
According to one embodiment, the two microphones are part of a hearing protection device. With such a configuration, the microphones can be arranged such that the ambient sound reaching the inwardly oriented microphone is attenuated by the hearing protection device relative to ambient sound reaching the outwardly oriented microphone. Although such hearing protection device could be an earmuff, according to a preferred embodiment the hearing protection device is an earplug comprising a shell which is to be inserted at least partially into the user's ear canal. According to one embodiment, the shell is a customized hard shell having an elasticity from shore D85 to D65 and having an outer shape according to the measured inner shape of the user's outer ear and ear canal. According to an alternative embodiment, the shell is a generic soft shell capable of adapting to the shape of the user's outer ear and ear canal.
Preferably, the inwardly oriented microphone is located at or is open to the inner part of the shell which is to be inserted into the ear canal, with the inwardly oriented microphone preferably being located at the inner end of the shell or within a channel of the shell open to the inner end of the shell.
Preferably, the outwardly oriented microphone is located at or is open to the outer part of the shell which is not to be inserted into the ear canal, with the outwardly oriented microphone preferably being located at the outer end of the shell or within a channel of the shell open to the outer end of the shell.
If the hearing protection device is an earmuff, the first microphone is located at or is open to the outer side of the earmuff and the second microphone is located at or is open to the inner side of the earmuff.
In all embodiments, the device preferably comprises a speaker adapted to provide an external audio signal to the user's ear. Thereby bidirectional communication with the user is achieved. Preferably the speaker is located at or is open to a portion of the device which is to be worn within the user's ear canal, whereby the speaker is brought acoustically close to the user's ear drum so that good intelligibility of the sound provided by the speaker is achieved even in noisy environments.
Usually the device will be binaural, i.e. it will comprise one unit for the right ear and another unit for the left ear. The speaker and the microphones may be integrated in the same unit, i.e. in at least one of the units, or the speaker may be part of the unit for one ear and the microphones may be part of the unit for the other ear.
According to one embodiment, the device may be adapted to be worn completely within the user's ear canal, whereby the device can be more or less completely hidden from the views of other persons. According to other embodiments, the device may be any other kind of a wired or wireless headset.
Preferably the 'audio signal processing unit is integrated within the device, hi an alternative embodiment, the audio signal processing unit may be adapted to be worn behind the user's ear or somewhere at the user's body, hi this case, although the device becomes more handy, more space, and hence also more power, is available for the audio signal processing unit, which may reduce the costs an/or may improve the performance of the blind source separation, hi such case, the audio signal processing unit may be connected to the microphone either by wires, which is the most simple solution, or via a wireless link, for example, a radio frequency link such as Bluetooth link, an inductive link or an infrared link, which solution would result in enhanced wearing comfort for the user.
As a further alternative, the audio signal processing unit could be designed to be located remote from the user and is connected to the microphones via a radio frequency link such as Bluetooth link, hi this case, there would be even less restrictions regarding the size and power consumption of the audio signal processing unit, which might result in reduced costs and/or increased performance of the blind source separation.
In all embodiments, the system preferably comprises a radio frequency transmitter for transmitting the processed audio signal output of the audio signal processing unit to a remote radio frequency receiver in order to provide the user's voice to another person. According to one embodiment, the radio frequency transmitter is integrated within the audio signal processing unit, i.e. the radio frequency transmitter may be either integrated within the device or it may be adapted to be worn behind the use's ear or at the user's body or it could be even located remote from the user. However, in an alternative embodiment, the radio frequency transmitter could be remote from the audio signal processing unit, in which case the processed audio signal output of the audio signal processing unit would be provided to a radio frequency transmitter by wires or via a radio frequency link, an inductive link or an infrared link. In this case the location of the audio signal processing unit and the radio frequency transmitter can be optimized independently form each other.
In all embodiments, the blind source separation algorithm preferably works in the frequency domain, i.e. the algorithm is simultaneously carried out in different frequency bands/bins and the outcomes of these bands/bins are combined in an appropriate way.
In all embodiments, the blind source separation algorithm preferably works with the assumption that the sources are statistically independent, i.e. that the user's voice is independent of the ambient sound.
In the following, examples of the invention will be explained in detail by reference to the attached drawings.
Fig. 1 shows a schematic view of a first embodiment of a hearing protection earplug system according to the invention inserted into a person's ear canal with a block diagram of the most relevant electronic components;
Fig. 2 shows a schematic view of a modified embodiment of a hearing protection earplug according to the invention;
Figs. 3 and 4 show further modified embodiments of a system according to the invention;
Fig. 5 shows a modification of the embodiment of Fig. 1;
Fig. 6 shows a modification of the embodiment of Fig. 5;
Fig.7 shows a schematic view of an embodiment of a BTE hearing instrument according to the invention with a block diagram of the most relevant electronic components;
Fig. 8 shows a modified embodiment of a BTE hearing instrument according to the invention;
Fig. 9 shows a schematic view of an embodiment of a headset according to the invention with a block diagram of the most relevant electronic components; and
Fig. 10 shows a modified embodiment of a headset according to the invention.
The system of Fig. 1 comprises a device 10 designed as a hearing protection earplug which may have a hard shell with an elasticity from shore D85 to shore D65, which is customized, i.e. it has an outer shape according to the individual measured inner shape of the user's outer ear and ear canal. The hard shell may be manufactured by layer-by-layer laser sintering of a powder material, for example, polyamide powder, or by laser stereo-lithography or photo- polymerization. An overview regarding such additive layer-by-layer build-up processes for manufacturing customized shells of hearing devices can be found, for example, in US 2003/0133583 Al or US 6,533,062 Bl. The inner shape of the person's ear canal and outer ear can be measured, for example, by taking an impression which then undergoes laser scanning or by direct laser scanning of the ear.
Preferably the hard shell is designed such that it provides for an acoustic attenuation, averaged over the audible frequency range, of at least 10 dB when inserted into the user's ear canal.
Rather than having a customized hard shell, earplug 10 may have a generic soft shell which adapts to the shape of the users outer ear and ear canal due to its elasticity.
In Fig. 1 the earplug 10 is shown to be inserted with its inner end portion into a user's ear canal 12. The earplug 10 comprises an outer microphone Ml, which is located at the outer part of the earplug 10 and which is open to the outer end 14 of the earplug 10 via a sound channel 16, and an inner microphone M2, which is located at the inner part of the earplug 10 and which is open to the inner end 18 of the earplug 10 via a sound channel 20. The earplug 10 further comprises a speaker S which is likewise located at the inner part of the earplug 10 and is open to the inner end 18 via a sound channel 22. The earplug 10 also includes a digital audio signal processing unit 24 comprising a digital signal processor as well as a radio frequency transmitter unit Tl and a radio frequency receiver unit Rl. The audio signal processing unit 24 functionally includes a unit 26 for applying a blind source separation algorithm to the audio signals provided by the microphones Ml and M2. It is evident to the skilled person that the earplug 10 includes additional electrical components, such as amplifiers and analogue-to-digital converters for the audio signals provided by the microphones Ml and M2, a digital-to-analogue converter and an amplifier for the audio signal to be transformed into sound by the speaker S, program and data memory components for the audio signal processing unit 24, a battery for power supply, a demodulator, a modulator, an antenna, etc., which are not shown in Fig. 1 for the sake of simplicity.
The transmitter Tl of the earplug 10 is adapted to transmit audio signals from the earplug 10 to a remote receiver R2 via a radio link, while the receiver Rl of the earplug 10 is adapted to receive audio signals from a remote transmitter T2. The audio signals received by the receiver Rl are demodulated and then undergo signal processing in the audio signal processing unit 24 as input to the speaker S in order to provide remote audio signals to the user. Such remote audio signals could be the speech of another person picked up by a microphone whose output is sent to the remote transmitter T2 by wires or via, for example, a mobile telephone or mobile radio device.
The audio signals provided by the microphones Ml and M2 are passed as input to the blind source separation unit 26, in which a processed audio signal output for the transmitter Tl is produced, with the processed audio signal output consisting completely or at least essentially of the user's voice which has been separated from the ambient sound by action of the blind source separation algorithm carried out in the BSS unit 26. Such BSS signal processing
utilizes the fact that the sound mixtures picked up by the microphone Ml which is oriented towards the environment and M2 which is oriented towards the ear canal 12, respectively, consist - due to the different orientation of the microphones Ml and M2 - of essentially different mixtures of the ambient sound and the user's voice, which are different regarding amplitude ratio of these two signal contributions or sources (i.e. ambient sound on the one hand and user's voice on the other hand) and regarding phase difference of these two signal contributions of the mixture.
The output signal of the BSS unit 26 is transmitted via the transmitter Tl to the remote receiver R2 which usually will be connected to a remote speaker for presenting the user's voice to another person. The remote speaker and the remote microphone connected to the remote transmitter T2 could be part of an earpiece or an earplug worn by another person, which may be similar or identical to the earplug 10. Thereby in-the-ear hearing protection devices with integrated communication function can be achieved. Such a system could be used by any persons who need to communicate in a noisy environment, such as workers, soldiers, firemen, etc. However, the remote receiver R2 also might serve for communication via a mobile telephone or a mobile radio device.
In general, the remote receiver R2 / transmitter T2 could be a part of an interface of a standard wireless communication device, such as a mobile telephone device or a mobile radio device Preferably, the wireless link between the transmitter Tl / receiver Rl and the remote receiver R2 / remote transmitter T2 is a Bluetooth link. The remote receiver R2 / transmitter T2 then could be a part of the Bluetooth interface of a standard wireless communication device, such as a mobile telephone device or a mobile radio device.
According to Fig. 1, the audio signal produced by the microphones Ml and M2, which is used as input to the BSS unit 26, in addition could undergo other audio signal processing within the audio signal processing unit 24, for example, in order to provide the ambient sound picked up by the microphone Ml to the speaker S for enabling perception of desired ambient sounds during times when the noise level is low so that the hearing protection function provided by the earplug 10 is not needed, or to provide for an in-situ measurement of the actual acoustic attenuation provided by the earplug 10 when inserted into the user's ear canal 12 by comparing the sound levels measured by the microphones Ml and M2.
In Fig. 2 a modified embodiment is shown, wherein the transmitter Tl and the receiver Rl have been removed from the earplug 10 and now are located in an external unit 28 which is connected by wires 30 to the earplug 10 and which is to be worn at an appropriate location at the user's body, for example behind the user's ear or somewhere within or below the user's clothing, for example, within a helmet. The external unit 28 may include further electrical components removed from the earplug 10, for example, the power supply battery.
In Fig. 3 a further modified embodiment is shown, wherein not only the transmitter Tl and the receiver Rl (and the power supply battery) but in addition also the audio signal processing unit 24 including the BSS unit 26 has been removed from the earplug 10 and is connected via corresponding wires to the microphones Ml and M2 and the speaker S, respectively.
In Fig. 4 a still further modified embodiment is shown, wherein the wire connection 30 between the earplug 10 and the external unit 28 has been replaced by a bidirectional wireless link 32, which is established by a transmitter T3 and a receiver R3 located in the earplug 10 and a corresponding receiver R4 and transmitter T4 located in the external unit 28. The wireless link 32 could be a radio frequency link, an inductive link or an infrared link. If it is an inductive link, the external unit 28 would have to be located relatively close to the earplug 10, for example at a distance of not more than 20 cm. With an RF (radio frequency) link, the distance could be larger; in this case it would be even be possible to locate the external unit 28 at a position remote from the user's body, for example, within a distance of a few meters. Preferably the wireless link 32 of the embodiment of Fig. 4 is a Bluetooth link.
Although in the embodiments shown is Figs. 1 to 4 the speaker S is shown as being integrated in the same earplug 10 as the microphones Ml and M2, in other embodiments the speaker S may be provided at an earplug other than the earplug at which the microphones Ml and M2 are provided.
Fig. 5 shows a modified version of the embodiment of Fig. 1 , wherein the inwardly oriented second microphone M2 is not part of the earplug 10 - as shown in Fig. 1 - but rather is provided at the earplug 1 1 for the other ear. The second microphone M2 is located at the inner part of the earplug 11 and is open to the inner end 18 of the earplug 11 via a sound channel 20. In addition, the earplug 11 further comprises a speaker S which is likewise located at the inner
part of the earplug 11 and is open to the inner end 18 via a sound channel 22. The microphone M2 and the speaker S of the earplug 11 are connected to the audio signal processing unit 24 located in the earplug 10 via a wire connection 40 which be integrated in a mechanical connection (not shown) between the earplugs 10 and 11 which may be provided for preventing loss of the earplugs 10, 11.
According to a modification of the embodiment of Fig. 5, the outwardly oriented first microphone Ml may be provided at the earplug 1 1, while the inwardly oriented second microphone M2 may be provided at the earplug 10 as in Fig. 1.
An alternative modification of the embodiment of Fig. 5 is shown in Fig. 6, wherein both the first microphone Ml of the earplug 10 and the second microphone M2 of the earplug 1 1 are outwardly oriented, hi this case the differences in the sound mixtures picked up by the microphone Ml of the earplug 10 and the microphone M2 of the earplug 11 are due to the different location of the microphone Ml at one ear and the microphone M2 at the other ear
(for example, a disturbing noise source usually will be located closer to one of the two ears and hence will contribute more strongly and with different phase to the signal picked up by the microphone located at that ear than to that located at the other ear).
According to a modification of the embodiment of Fig. 6 both microphones Ml and M2 could be inwardly oriented rather than outwardly oriented.
While Figs. 5 and 6 and the above-discussed variants thereof are modifications of the embodiment of Fig. 1 , according to which both the audio signal processing unit 24 and the transmitter Tl / receiver Rl are part of the earplug 10, it is to be understood that the embodiments of Figs. 2 to 4 may be analogously modified, i.e. by providing the second microphone M2 at the earplug 11 rather than at the earplug 10.
While the examples discussed so far relate to an application of the communication system to hearing protection earplugs, the invention also may be applied to earmuffs serving as a hearing protection device or generally to any kind of headset, i.e. also to hearing devices which do not provide for a hearing protection function. For example, the headset may consist of a device with a customized or a generic shell which is designed such that it can be worn
completely in the ear canal 12 (i.e. as a "CIC device") and which serves exclusively communication purposes, for example, for security persons, policemen, firemen, etc., i.e. for persons who are exposed to a noisy environment, with the noise level, however, being below a threshold value which would require the use of hearing protection devices. Such CIC device generally could have the construction of the earplug of Fig. 1 , however, without considerable acoustic attenuation provided due to the material and the design of the shell, and would be reduced in size so that it can be worn completely within the ear canal 12.
In general, the device need not be designed as an earplug but it may rather be any kind of headset.
By "oriented acoustically outwardly towards the environment" it is meant that the respective microphone is acoustically open to the environment, whereas by "oriented acoustically outwardly towards the user's ear canal" it is meant that the respective microphone is acoustically open to the user's ear canal. This does not necessarily imply that there is line-of- sight connection to the environment or the ear canal, respectively; rather, it is sufficient that there is an acoustic connection to the environment or the ear canal, respectively, for example by a sound channel or a sound tube.
By "earplug" any device is meant which is to be worn in the ear canal or in the concha, so that also earmolds, i.e. devices to be worn in the concha rather than in the ear canal, are included.
In Fig. 7 an embodiment is shown, wherein the device 10, in contrast to the embodiments shown in Figs. 1 to 6, is not designed as a hearing protection earplug but rather as a hearing instrument to be worn behind the user's ear, with the design corresponding to that of a BTE hearing instrument. The device 10 comprises a housing 50 to be worn behind the user's ear, with a sound tube 52 extending from the housing 50 to an earplug 54 to be worn in the user's ear canal or concha, respectively. The earplug 54 is provided at the free end of the sound tube 52, while at the other end the speaker S and the microphone M2 are provided in order to acoustically connect the speaker S and the microphone M2 to the user's ear canal. The earplug
54 usually will not act as a hearing protection device.
The housing 50, in addition to the speaker S and the microphone M2, also includes an outwardly oriented microphone Ml, an audio signal processing unit 24 with a BSS unit 26, a RF transmitter unit Tl , a RF receiver unit Rl and a power supply 56.
The functionality of the electronic components may correspond, for example, to that of the embodiment of Fig. 1 , i.e. the audio signals captured by the outwardly oriented microphone Ml and the inwardly oriented microphone M2 are supplied to the BSS unit 26 in order to extract the user's voice from ambient sound, and the output signal of the BSS unit 26 is transmitted via the transmitter unit Tl to an external receiver unit (not shown) for supplying the user's voice to, for example, another person. External audio signals may be received by the receiver unit Rl and may be supplied via the audio signal processing unit 24 and the speaker S to the user, hi addition, the audio signals captured by the outwardly oriented microphone Ml may be processed in the audio signal processing unit 24 and then may be supplied to the user's ear via the speaker S, whereby the device 10 may function as a hearing aid.
hi Fig. 8 a modified version of embodiment of Fig. 7 is shown, wherein both the speaker S and the microphone M2 are provided directly in the earplug 54 rather than being acoustically connected to the earplug 54 via a sound tube 52 as in Fig. 7. The speaker S and the microphone M2 are connected to the housing 50 and to the audio signal processing unit 24 via a cable connection 58.
According to the embodiment shown in Fig. 9 the device 10 is designed as a headset comprising a housing 50 which is to be worn below the user's ear and is fixed to the user's pinna by means of a loop 60 which may be made of wire and which is adjustable to the individual size of the user's pinna. To this end, the housing 50 is provided with an adjustment element which is fixed to one end of the loop and through which the other end 64 of the loop is guided in such a manner that it can be fixed in various positions. The size of the loop 60 can be adjusted by the user by pulling at the free end 64 of the loop 60. Such a loop is described, for example, in the German Patent Application 10 2006 016 052.5 or in DE 10 2005 002 482 B3.
According to Fig. 9, the audio signal processing unit 24, the receiver unit Rl, the transmitter unit Tl and the power supply may be integrated in a separate housing 5OA, which is electrically and mechanically connected via a connector 66 to the housing 50 which includes the microphones Ml and M2 and the speaker S. The transmission unit Tl and the receiver unit Rl serve to establish a bi-directional wireless link to communication devices, such as a mobile phone or a walkie-talkie.
In Figs. 7 through 9, element 56 is a power supply, such as a primary or rechargeable battery.
The speaker S and the microphone M2 are located at one end of a sound tube 52 which extends with its free end 68 into the user's ear canal. As in the embodiment of Fig. 7, the free end 68 may be provided with an earplug.
The housing 50A with the electronic components 24, Tl, Rl, and power supply 56 included therein forms a communication unit which, on the one hand, receives external audio signals from a communication device, which are reproduced via the speaker S to the user's ear. On the other hand, the communication device extracts the user's voice by blind source separation of audio signals from the microphones Ml and M2 in the BSS unit 26, with the separated audio signals corresponding to the user's voice and being transmitted to the communication device.
As an alternative to the embodiment shown in Fig. 9 the housing 50 in addition to the inwardly oriented microphone M2, the speaker S, and the outwardly oriented microphone Ml may also include the audio signal processing unit 24 with the BSS unit 26, the RF transmitter unit Tl, the RF receiver unit Rl and the power supply 56. In this case the additional housing 5OA would be obsolete.
A modification of the embodiment of Fig. 9 is shown in Fig. 10, wherein a cable connector 70, rather than the communication unit 50A of Fig. 9, is received in the connector 66. The cable connector 70 serves to connect the microphones Ml and M2 and the speaker S to an external audio signal processing unit (not shown) which includes a BSS unit in order to apply BSS to the signals of the microphones Ml and M2 in order to separate the user's voice. This external audio signal processing unit also is connected to a communication device in order to
supply the user's voice to such communication device and to receive external audio signals which are to be reproduced by the speaker S.
Claims
1. A system for separation of a user's voice from ambient sound, comprising a device (10) to be worn at the user's ear or at least partly in the user's ear canal (12) comprising a first microphone (Ml) oriented acoustically outwardly towards the environment and a second microphone (M2) oriented acoustically inwardly towards the user's ear canal, and an audio signal processing unit (24, 26) for processing audio signals from the first and second microphone by a blind source separation algorithm adapted to separate the user's voice from ambient sound.
2. The system of claim 1, wherein the device (10) is designed as a hearing protection device.
3. The system of claim 2, wherein the hearing protection device (10) is designed to provide for an acoustic attenuation, averaged over the audible frequency range, of at least 10 dB.
4. The system of claim 3, wherein the microphones (Ml, M2) are arranged such that ambient sound reaching the second microphone (M2) is attenuated by the hearing protection device (10) relative to ambient sound reaching the first microphone (Ml).
5. The system of one of claims 2 to 4, wherein the hearing protection device is an earplug (10) comprising a shell which is to be inserted at least partially into the user's ear canal (12).
6. The system of claim 5, wherein the shell is a hard shell having an elasticity from Shore D 85 to Shore D 65 and having an outer shape according to the measured inner shape of the user's outer ear and ear canal (12).
7. The system of one of claims 5 and 6, wherein the second microphone (M2) is located at or is open to the inner part of the shell which is to be inserted into the ear canal (12).
8. The system of claim 7, wherein the second microphone (M2) is located at the inner end of the shell or within a channel (20) of the shell open to the inner end of the shell.
9. The system of one of claims 5 to 8, wherein the first microphone (Ml) is located at or is open to the outer part of the shell which is not to be inserted into the ear canal (12).
10. The system of claim 9, wherein the second microphone (M2) is located at the outer end of the shell or within a channel (16) of the shell open to the outer end of the shell.
11. The system of one of claims 1 to 4, wherein the hearing protection device is an earmuff and wherein the first microphone is located at or is open to the outer side of the earmuff and the second microphone is located at or is open to the inner side of the earmuff.
12. The system of one of the preceding claims, wherein the device comprises a speaker (S) adapted to provide an external audio signal to the user's ear.
13. The system of claim 12, wherein the speaker (S) is located at or within a channel open to that end of the device which is to be worn within the user's ear canal.
14. The system of one of the preceding claims, wherein the device is adapted to be worn completely within the user's ear canal.
15. The system of one of the preceding claims, wherein the audio signal processing unit (24, 26) is integrated within the device (10).
16. The system of one of claims 1 to 14, wherein the audio signal processing unit (24, 26) is adapted to be worn behind the user' s ear or at the user's body.
17. The system of claim 16, wherein the audio signal processing unit (24, 26) is connected to the microphones (Ml, M2) by wires (30) or via a radio frequency link (32) such as a Bluetooth link, an inductive link or an infrared link.
18. The system of one of claims 1 to 14, wherein the audio signal processing unit (24, 26) is designed to be located remote from the user and is connected to the microphones (Ml, M2) via a radio frequency link (32) such as a Bluetooth link.
19. The system of claim 1, wherein the housing (50, 50A) of the device (10) is to be worn behind or below the user's ear and wherein a sound tube (52) is provided to extend from the second microphone (M2) into the user's ear canal.
20. The system of claim 19, wherein the free end (68) of the sound tube (52) is provided with an earplug (54).
21. The system of one of claims 19 and 20, wherein a speaker (S) is provided at the end of the sound tube (52) opposite to the free end (68) in order to provide an external audio signal and/or an audio signal produced by the audio signal processing unit (24, 26) from the audio signals captured by the first microphone (Ml) and/or the second microphone (M2) to the user's ear.
22. The system of claim 1, wherein the housing (50) of the device is to be worn behind or below the user's ear, wherein the second microphone (M2) is included in an earplug (54) to be inserted into the user's ear canal and/or the user's concha and wherein the second microphone (M2) is connected to the housing (50) of the device (10) via a cable (58).
23. The system of claim 22, wherein the earplug (54) includes a speaker (S) connected to the housing (50) of the device (10) via a cable (58) in order to provide an external audio signal and/or an audio signal produced by the audio signal processing unit (24, 26) from the audio signals captured by the first microphone (Ml) and/or the second microphone (M2) to the user's ear.
24. The system of one of claims 19 to 23, wherein the audio signal processing unit (24, 26) is integrated within the housing (50, 50A) of the device (10).
25. The system of one of claims 19 to 24, wherein the housing (50, 50A) of the device (10) is to be fixed at the user's pinna by an adjustable loop (60) around the pinna.
26. The system of claim 25, wherein the housing of the device comprises a first portion (50) and a second portion (50A) which are mechanically and eletrically connected in a detachable manner via a plug connector (66), with the first portion (50) including the first microphone (Ml) and the second microphone (M2) and the second portion (50A) including the audio signal processing unit (24, 26).
27. The system of one of the preceding claims, wherein the system comprises a radio frequency transmitter (Tl) for transmitting the processed audio signal output of the audio signal processing unit (24, 26) to a remote radio frequency receiver (R2) in order to provide the user's voice to another person.
28. The system of claim 27, wherein the remote radio frequency receiver (R2) is part of a Bluetooth interface of a mobile telephone or a mobile radio system.
29. The system of claim 27 or 28, wherein the radio frequency transmitter (Tl) is integrated with the audio signal processing unit (24, 26).
30. The system of claim 27 or 28, wherein the radio frequency transmitter (Tl) is remote from the audio signal processing unit (24, 26) and wherein the processed audio signal output of the audio signal processing unit is provided to the radio frequency transmitter by wires (30) or via an inductive link.
31. The system of one of claims 12, 21 and 23, wherein the system comprises a radio frequency receiver (Rl) for receiving the external audio signal from a remote radio frequency transmitter (T2).
32. The system of claim 31, wherein the remote radio frequency transmitter (T2) is part of a Bluetooth interface of a mobile telephone or a mobile radio system.
33. A system for separation of a user's voice from ambient sound, comprising: a first device (10) to be worn at the user's right ear or at least partly in the user's right ear canal (12), a second device (11) to be worn at the user's left ear or at least partly in the user's left ear canal (12), the first device comprising a first microphone (Ml) and the second device comprising a second microphone (M2), and an audio signal processing unit (24, 26) for processing audio signals from the first and second microphone by a blind source separation algorithm adapted to separate the user's voice from ambient sound.
34. The system of claim 33, wherein one of the first microphone (Ml) and second microphone (M2) is oriented outwardly towards the environment and the other one of the first microphone and second microphone is oriented inwardly towards the user's ear canal (12).
35. The system of one of claims 33 and 34, wherein the audio signal processing unit (24, 26) is located in one of the first device (10) and the second device (11) or is adapted to be worn behind the user's ear or at the user's body or is designed to be located remote from the user and is connected to the microphones via a radio frequency link (32) such as a Bluetooth link.
36. A method for separation of a user's voice from ambient sound, comprising: providing the user with a device (10) to be worn at a user's ear or at least partly in the user's ear canal (12) and comprising a first microphone (Ml) oriented acoustically towards the environment and a second microphone (M2) oriented acoustically towards the user's ear canal (12), picking up sound by the first microphone to create a first audio signal and by the second microphone to create a second audio signal, and processing the first and second audio signals by a blind source separation algorithm in order to produce a processed audio signal wherein the user's voice is separated from ambient sound.
37. A method for separation of a user's voice from ambient sound, comprising: providing the user with a first device (10) to be worn at the user's right ear or at least partly in the user's right ear canal (12) and a second device (11) to be worn at the user's left ear or at least partly in the user's left ear canal (12), the first device comprising a first microphone (Ml) and the second device comprising a second microphone (M2), picking up sound by the first microphone to create a first audio signal and by the second microphone to create a second audio signal, and processing the first and second audio signals by a blind source separation algorithm in order to produce a processed audio signal wherein the user's voice is separated from ambient sound.
38. The method of one of claims 36 and 37, wherein the blind source separation algorithm works in the frequency domain.
39. The method of one of claims 36 to 38, wherein the processed audio signal is provided to another person via a wireless link such as a Bluetooth link.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP06846980.8A EP1969335B1 (en) | 2005-12-23 | 2006-11-28 | System and method for separation of a user's voice from ambient sound |
DK06846980.8T DK1969335T3 (en) | 2005-12-23 | 2006-11-28 | System and approach for separating a user's voice from ambient sound |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP05028366.2 | 2005-12-23 | ||
EP05028366A EP1640972A1 (en) | 2005-12-23 | 2005-12-23 | System and method for separation of a users voice from ambient sound |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007073818A1 true WO2007073818A1 (en) | 2007-07-05 |
Family
ID=35694668
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2006/011423 WO2007073818A1 (en) | 2005-12-23 | 2006-11-28 | System and method for separation of a user’s voice from ambient sound |
Country Status (3)
Country | Link |
---|---|
EP (2) | EP1640972A1 (en) |
DK (1) | DK1969335T3 (en) |
WO (1) | WO2007073818A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011098142A1 (en) | 2010-02-12 | 2011-08-18 | Phonak Ag | Wireless hearing assistance system and method |
US8271276B1 (en) | 2007-02-26 | 2012-09-18 | Dolby Laboratories Licensing Corporation | Enhancement of multichannel audio |
WO2013075744A1 (en) | 2011-11-23 | 2013-05-30 | Phonak Ag | Hearing protection earpiece |
US8483418B2 (en) | 2008-10-09 | 2013-07-09 | Phonak Ag | System for picking-up a user's voice |
US9135907B2 (en) | 2010-06-17 | 2015-09-15 | Dolby Laboratories Licensing Corporation | Method and apparatus for reducing the effect of environmental noise on listeners |
US9401158B1 (en) | 2015-09-14 | 2016-07-26 | Knowles Electronics, Llc | Microphone signal fusion |
US9418667B2 (en) | 2006-10-12 | 2016-08-16 | Lg Electronics Inc. | Apparatus for processing a mix signal and method thereof |
EP2920980B1 (en) | 2012-11-15 | 2016-10-05 | Sonova AG | Own voice shaping in a hearing instrument |
US9779716B2 (en) | 2015-12-30 | 2017-10-03 | Knowles Electronics, Llc | Occlusion reduction and active noise reduction based on seal quality |
US9812149B2 (en) | 2016-01-28 | 2017-11-07 | Knowles Electronics, Llc | Methods and systems for providing consistency in noise reduction during speech and non-speech periods |
US9830930B2 (en) | 2015-12-30 | 2017-11-28 | Knowles Electronics, Llc | Voice-enhanced awareness mode |
US9905241B2 (en) | 2016-06-03 | 2018-02-27 | Nxp B.V. | Method and apparatus for voice communication using wireless earbuds |
EP3188508B1 (en) | 2015-12-30 | 2020-03-11 | GN Hearing A/S | Method and device for streaming communication between hearing devices |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102005032274B4 (en) | 2005-07-11 | 2007-05-10 | Siemens Audiologische Technik Gmbh | Hearing apparatus and corresponding method for eigenvoice detection |
EP1853092B1 (en) * | 2006-05-04 | 2011-10-05 | LG Electronics, Inc. | Enhancing stereo audio with remix capability |
US8917876B2 (en) | 2006-06-14 | 2014-12-23 | Personics Holdings, LLC. | Earguard monitoring system |
SE530137C2 (en) * | 2006-06-27 | 2008-03-11 | Bo Franzen | Headset with throat microphone in combination with an ear-tight soundproof ear speaker |
EP2044804A4 (en) | 2006-07-08 | 2013-12-18 | Personics Holdings Inc | Personal audio assistant device and method |
JP5295115B2 (en) * | 2006-10-10 | 2013-09-18 | シーメンス アウディオローギッシェ テヒニク ゲゼルシャフト ミット ベシュレンクテル ハフツング | Hearing aid driving method and hearing aid |
JP4838361B2 (en) | 2006-11-15 | 2011-12-14 | エルジー エレクトロニクス インコーポレイティド | Audio signal decoding method and apparatus |
EP2102855A4 (en) | 2006-12-07 | 2010-07-28 | Lg Electronics Inc | A method and an apparatus for decoding an audio signal |
AU2007328614B2 (en) | 2006-12-07 | 2010-08-26 | Lg Electronics Inc. | A method and an apparatus for processing an audio signal |
WO2007082579A2 (en) * | 2006-12-18 | 2007-07-26 | Phonak Ag | Active hearing protection system |
WO2008074350A1 (en) | 2006-12-20 | 2008-06-26 | Phonak Ag | Wireless communication system |
WO2008082276A1 (en) * | 2007-01-05 | 2008-07-10 | Lg Electronics Inc. | A method and an apparatus for processing an audio signal |
US8917894B2 (en) | 2007-01-22 | 2014-12-23 | Personics Holdings, LLC. | Method and device for acute sound detection and reproduction |
WO2008095167A2 (en) | 2007-02-01 | 2008-08-07 | Personics Holdings Inc. | Method and device for audio recording |
DE102007008739A1 (en) | 2007-02-22 | 2008-08-28 | Siemens Audiologische Technik Gmbh | Hearing device with noise separation and corresponding method |
DE102007010806B4 (en) | 2007-03-02 | 2010-05-12 | Siemens Ag | A method of providing advanced capabilities in the use of patient image data and radiographic angiography system unsuitable for use in registration procedures |
US11750965B2 (en) | 2007-03-07 | 2023-09-05 | Staton Techiya, Llc | Acoustic dampening compensation system |
US8111839B2 (en) | 2007-04-09 | 2012-02-07 | Personics Holdings Inc. | Always on headwear recording system |
US11856375B2 (en) | 2007-05-04 | 2023-12-26 | Staton Techiya Llc | Method and device for in-ear echo suppression |
US11683643B2 (en) | 2007-05-04 | 2023-06-20 | Staton Techiya Llc | Method and device for in ear canal echo suppression |
WO2009006418A1 (en) * | 2007-06-28 | 2009-01-08 | Personics Holdings Inc. | Method and device for background noise mitigation |
US10009677B2 (en) | 2007-07-09 | 2018-06-26 | Staton Techiya, Llc | Methods and mechanisms for inflation |
DE102007033520A1 (en) * | 2007-07-18 | 2009-01-29 | Noa Lerner | Device for sound reproduction |
US8867765B2 (en) * | 2008-02-06 | 2014-10-21 | Starkey Laboratories, Inc. | Antenna used in conjunction with the conductors for an audio transducer |
US8600067B2 (en) | 2008-09-19 | 2013-12-03 | Personics Holdings Inc. | Acoustic sealing analysis system |
US9129291B2 (en) | 2008-09-22 | 2015-09-08 | Personics Holdings, Llc | Personalized sound management and method |
WO2009047369A2 (en) * | 2009-01-21 | 2009-04-16 | Phonak Ag | Earpiece communication system |
US8705787B2 (en) * | 2009-12-09 | 2014-04-22 | Nextlink Ipr Ab | Custom in-ear headset |
EP2458586A1 (en) * | 2010-11-24 | 2012-05-30 | Koninklijke Philips Electronics N.V. | System and method for producing an audio signal |
US9538301B2 (en) | 2010-11-24 | 2017-01-03 | Koninklijke Philips N.V. | Device comprising a plurality of audio sensors and a method of operating the same |
WO2012103935A1 (en) | 2011-02-01 | 2012-08-09 | Phonak Ag | Hearing device with a receiver module and method for manufacturing a receiver module |
WO2013032317A1 (en) * | 2011-08-26 | 2013-03-07 | Neuralogy Sdn Bhd | An external auditory canal communication device |
US9167082B2 (en) | 2013-09-22 | 2015-10-20 | Steven Wayne Goldstein | Methods and systems for voice augmented caller ID / ring tone alias |
CN104581467A (en) * | 2013-10-11 | 2015-04-29 | 孙文宗 | Headset microphone, voice retrieval method applied the same and communication method |
US20150139448A1 (en) | 2013-11-18 | 2015-05-21 | International Business Machines Corporation | Location and orientation based volume control |
US10043534B2 (en) | 2013-12-23 | 2018-08-07 | Staton Techiya, Llc | Method and device for spectral expansion for an audio signal |
US10163453B2 (en) | 2014-10-24 | 2018-12-25 | Staton Techiya, Llc | Robust voice activity detector system for use with an earphone |
US10616693B2 (en) | 2016-01-22 | 2020-04-07 | Staton Techiya Llc | System and method for efficiency among devices |
SE542475C2 (en) | 2017-01-03 | 2020-05-19 | Earin Ab | A storage and charging capsule for wireless earbuds |
WO2018128577A2 (en) * | 2017-01-03 | 2018-07-12 | Earin Ab | Wireless earbuds, and a storage and charging capsule therefor |
US10951994B2 (en) | 2018-04-04 | 2021-03-16 | Staton Techiya, Llc | Method to acquire preferred dynamic range function for speech enhancement |
US11206485B2 (en) | 2020-03-13 | 2021-12-21 | Bose Corporation | Audio processing using distributed machine learning model |
DE102021200552B4 (en) * | 2021-01-21 | 2023-04-20 | Kaetel Systems Gmbh | Head wearable sound generator and method of operating a sound generator |
CN113470687A (en) * | 2021-06-29 | 2021-10-01 | 北京明略昭辉科技有限公司 | Audio acquisition and transmission device, audio processing system and audio acquisition and transmission method |
CN115497496B (en) * | 2022-09-22 | 2023-11-14 | 东南大学 | Voice enhancement method based on FirePS convolutional neural network |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6526148B1 (en) * | 1999-05-18 | 2003-02-25 | Siemens Corporate Research, Inc. | Device and method for demixing signal mixtures using fast blind source separation technique based on delay and attenuation compensation, and for selecting channels for the demixed signals |
US6661901B1 (en) * | 2000-09-01 | 2003-12-09 | Nacre As | Ear terminal with microphone for natural voice rendition |
EP1448014A1 (en) * | 2003-02-14 | 2004-08-18 | GN ReSound A/S | A retaining member for an earpiece |
EP1509065A1 (en) * | 2003-08-21 | 2005-02-23 | Bernafon Ag | Method for processing audio-signals |
US20050060142A1 (en) * | 2003-09-12 | 2005-03-17 | Erik Visser | Separation of target acoustic signals in a multi-transducer arrangement |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2000272660B2 (en) | 2000-09-25 | 2006-02-16 | Phonak Ag | Hearing Device and Method of Production |
US6533062B1 (en) | 2000-09-25 | 2003-03-18 | Phonak Ag | Production process for custom-moulded ear-plug devices |
US20030055535A1 (en) | 2001-09-17 | 2003-03-20 | Hunter Engineering Company | Voice interface for vehicle wheel alignment system |
-
2005
- 2005-12-23 EP EP05028366A patent/EP1640972A1/en not_active Withdrawn
-
2006
- 2006-11-28 EP EP06846980.8A patent/EP1969335B1/en active Active
- 2006-11-28 DK DK06846980.8T patent/DK1969335T3/en active
- 2006-11-28 WO PCT/EP2006/011423 patent/WO2007073818A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6526148B1 (en) * | 1999-05-18 | 2003-02-25 | Siemens Corporate Research, Inc. | Device and method for demixing signal mixtures using fast blind source separation technique based on delay and attenuation compensation, and for selecting channels for the demixed signals |
US6661901B1 (en) * | 2000-09-01 | 2003-12-09 | Nacre As | Ear terminal with microphone for natural voice rendition |
EP1448014A1 (en) * | 2003-02-14 | 2004-08-18 | GN ReSound A/S | A retaining member for an earpiece |
EP1509065A1 (en) * | 2003-08-21 | 2005-02-23 | Bernafon Ag | Method for processing audio-signals |
US20050060142A1 (en) * | 2003-09-12 | 2005-03-17 | Erik Visser | Separation of target acoustic signals in a multi-transducer arrangement |
Non-Patent Citations (2)
Title |
---|
SANG MIN LEE ET AL: "New idea of hearing aid algorithm to enhance speech discrimination in a noisy environment and its experimental results", SAN FRANCISCO, CA, USA 1-5 SEPT. 2004, PISCATAWAY, NJ, USA,IEEE, US, 1 September 2004 (2004-09-01), pages 978Vol2, XP010774935, ISBN: 0-7803-8439-3 * |
STANACEVIC M ET AL: "Gradient flow adaptive beamforming and signal separation in a miniature microphone array", 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PROCEEDINGS. (ICASSP). ORLANDO, FL, MAY 13 - 17, 2002, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), NEW YORK, NY : IEEE, US, vol. VOL. 4 OF 4, 13 May 2002 (2002-05-13), pages IV - 4016, XP010804511, ISBN: 0-7803-7402-9 * |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9418667B2 (en) | 2006-10-12 | 2016-08-16 | Lg Electronics Inc. | Apparatus for processing a mix signal and method thereof |
US9418680B2 (en) | 2007-02-26 | 2016-08-16 | Dolby Laboratories Licensing Corporation | Voice activity detector for audio signals |
US8271276B1 (en) | 2007-02-26 | 2012-09-18 | Dolby Laboratories Licensing Corporation | Enhancement of multichannel audio |
US10586557B2 (en) | 2007-02-26 | 2020-03-10 | Dolby Laboratories Licensing Corporation | Voice activity detector for audio signals |
US8972250B2 (en) | 2007-02-26 | 2015-03-03 | Dolby Laboratories Licensing Corporation | Enhancement of multichannel audio |
US10418052B2 (en) | 2007-02-26 | 2019-09-17 | Dolby Laboratories Licensing Corporation | Voice activity detector for audio signals |
US9368128B2 (en) | 2007-02-26 | 2016-06-14 | Dolby Laboratories Licensing Corporation | Enhancement of multichannel audio |
US9818433B2 (en) | 2007-02-26 | 2017-11-14 | Dolby Laboratories Licensing Corporation | Voice activity detector for audio signals |
US8483418B2 (en) | 2008-10-09 | 2013-07-09 | Phonak Ag | System for picking-up a user's voice |
WO2011098142A1 (en) | 2010-02-12 | 2011-08-18 | Phonak Ag | Wireless hearing assistance system and method |
US9135907B2 (en) | 2010-06-17 | 2015-09-15 | Dolby Laboratories Licensing Corporation | Method and apparatus for reducing the effect of environmental noise on listeners |
US9216113B2 (en) | 2011-11-23 | 2015-12-22 | Sonova Ag | Hearing protection earpiece |
WO2013075744A1 (en) | 2011-11-23 | 2013-05-30 | Phonak Ag | Hearing protection earpiece |
EP2920980B1 (en) | 2012-11-15 | 2016-10-05 | Sonova AG | Own voice shaping in a hearing instrument |
US9401158B1 (en) | 2015-09-14 | 2016-07-26 | Knowles Electronics, Llc | Microphone signal fusion |
US9961443B2 (en) | 2015-09-14 | 2018-05-01 | Knowles Electronics, Llc | Microphone signal fusion |
US9779716B2 (en) | 2015-12-30 | 2017-10-03 | Knowles Electronics, Llc | Occlusion reduction and active noise reduction based on seal quality |
US9830930B2 (en) | 2015-12-30 | 2017-11-28 | Knowles Electronics, Llc | Voice-enhanced awareness mode |
EP3188508B1 (en) | 2015-12-30 | 2020-03-11 | GN Hearing A/S | Method and device for streaming communication between hearing devices |
EP3188508B2 (en) † | 2015-12-30 | 2024-01-10 | GN Advanced Hearing Protection A/S | Method and device for streaming communication between hearing devices |
US9812149B2 (en) | 2016-01-28 | 2017-11-07 | Knowles Electronics, Llc | Methods and systems for providing consistency in noise reduction during speech and non-speech periods |
US9905241B2 (en) | 2016-06-03 | 2018-02-27 | Nxp B.V. | Method and apparatus for voice communication using wireless earbuds |
Also Published As
Publication number | Publication date |
---|---|
EP1969335B1 (en) | 2013-08-14 |
EP1969335A1 (en) | 2008-09-17 |
EP1640972A1 (en) | 2006-03-29 |
DK1969335T3 (en) | 2013-11-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1969335B1 (en) | System and method for separation of a user's voice from ambient sound | |
US20070160243A1 (en) | System and method for separation of a user's voice from ambient sound | |
US10743094B2 (en) | Helmet having dual mode headphone and method therefor | |
CN106937196B (en) | Hearing device | |
US20070147635A1 (en) | System and method for separation of a user's voice from ambient sound | |
US6671379B2 (en) | Ear microphone apparatus and method | |
US6952483B2 (en) | Voice transmission apparatus with UWB | |
US8005249B2 (en) | Ear canal signal converting method, ear canal transducer and headset | |
JP4541111B2 (en) | Method of using bone conduction speaker and method of using bone conduction receiver | |
CA2697268C (en) | Bone conduction hearing device with open-ear microphone | |
EP2127467B1 (en) | Active hearing protection system | |
US6823195B1 (en) | Ultra short range communication with sensing device and method | |
US8483418B2 (en) | System for picking-up a user's voice | |
CN112236812A (en) | Audio-enhanced hearing protection system | |
EP2391321B1 (en) | System and method for providing active hearing protection to a user | |
JP2020025250A (en) | Binaural hearing device system with binaural active occlusion cancellation function | |
US8411890B2 (en) | Hearing aid | |
US20080240477A1 (en) | Wireless multiple input hearing assist device | |
EP3324644B1 (en) | A wireless hearing device with stabilizing guide unit between tragus and antitragus | |
US9473859B2 (en) | Systems and methods of telecommunication for bilateral hearing instruments | |
Natalizia et al. | An overview of hearing impairment in older adults: perspectives for rehabilitation with hearing aids. | |
US20060140426A1 (en) | Hearing protection device and use of such a device | |
EP1674057B1 (en) | Hearing protection device and use of such a device | |
US20240244385A1 (en) | Bone Conduction Hearing Aid | |
US11758338B2 (en) | Authentication and encryption key exchange for assistive listening devices |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006846980 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2006846980 Country of ref document: EP |