JP6927029B2 - Vibration experience device - Google Patents

Description

The present invention relates to a vibration experience device that allows a user to experience vibration.

At concerts and live performances, people can enjoy more powerful performances by feeling not only the sound that reaches their ears but also the sound pressure. On the other hand, when the sound is reproduced by headphones, earphones or a speaker having a small diameter, it is difficult to reproduce the sound pressure. Therefore, it is desired to easily construct an audio reproduction environment with a high sense of presence.

The following Patent Document 1 describes a simple wearing type sensory vibration device that generates vibration along a waveform of an audio signal.

Japanese Unexamined Patent Publication No. 7-2457993

However, in recent VR (Virtual Reality) and the like, the content that reproduces the localization of the audio signal, that is, the sound source direction is increasing, and simply generating vibration in accordance with the audio signal will rather lack the sense of presence. It could be.

An object of the present invention is to provide a vibration experience device capable of enhancing the sense of presence.

The present invention is a sound source position which is information indicating the positions of a plurality of vibrating parts, which are attached to a plurality of parts of the user's body, an audio signal acquisition part which acquires an audio signal from the outside, and an object which emits a sound. The sound source position information acquisition unit that acquires information from the outside, the user position information acquisition unit that acquires the user position information that is information indicating the user's position and the direction in which the user is facing, and the sound source position information and the user position information. Based on, the vibration part calculation unit that calculates the part information representing the part of the user who gives vibration, and the vibration signal of the magnitude corresponding to the loudness of the sound represented by the audio signal are represented by the part information. The one or more vibrating parts provided with the vibrating signal generating part that outputs to one or more vibrating parts mounted on the parts, and the vibrating part to which the vibrating signal is supplied are strong according to the magnitude of the vibrating signal. Provided is a vibration sensation device that vibrates in the meantime.

According to the present invention, there is provided a vibration experience device that can enhance the sense of presence.

FIG. 1 is a diagram schematically showing an example of a system using the vibration experience device according to the embodiment. FIG. 2 is a diagram showing a configuration of a vibration experience device according to an embodiment. FIG. 3 is a diagram showing a mounting state of a plurality of vibrating portions of the vibration experience device according to the embodiment. FIG. 4 is a diagram showing a mounting state of a plurality of vibrating portions of the vibrating experience device according to the embodiment. FIG. 5 is a diagram showing an example of the positional relationship between the object and the user. FIG. 6 is a diagram showing an example of the positional relationship between the object and the user. FIG. 7 is a diagram showing an example of the positional relationship between the object and the user. FIG. 8 is a diagram showing an example of the positional relationship between the object and the user. FIG. 9 is a diagram showing an example of the positional relationship between the object and the user. FIG. 10 is a diagram showing an example of an audio signal and a vibration signal of the embodiment. FIG. 11 is a flowchart showing the operation of the vibration experience device according to the embodiment.

Hereinafter, embodiments according to the present invention will be described with reference to the drawings, but the present invention is not limited thereto. The components of the embodiments described below can be combined as appropriate. In addition, some components may not be used.

<System using the embodiment>
FIG. 1 is a diagram schematically showing an example of a system using the vibration experience device according to the embodiment.

The system 100 includes a vibration experience device 1 that gives vibration to the user U, and a content output device 110 that reproduces content including video and audio.

Content includes, but is not limited to, movies, concerts or live video and audio, or games. The video is exemplified by a 2D or 3D moving image or a still image.

In the embodiment, the content data includes the position information of the object (sound source) that emits sound. As an example, object-based audio (also called object audio) data includes data such as movement and volume change of each object, and an AV amplifier or the like performs optimum rendering according to the position and number of speakers. , Play the final sound.

When the content output device 110 is a portable type, a smartphone or a tablet is exemplified, but the content output device 110 is not limited thereto.

When the content output device 110 is a stationary type, a combination of a content player, a personal computer or a stationary game machine, an AV amplifier, a display device, and an audio output device is exemplified. The content player is exemplified by, but is not limited to, a Blu-ray (registered trademark) player. Examples of the display device include, but are not limited to, a VR head-mounted display (hereinafter referred to as VRHMD), a television device, or a projector. Examples of the audio output device include, but are not limited to, speakers, headphones or earphones.

The content output device 110 includes a processing unit 111, a video output unit 112, an audio output unit 113, a sensor unit 114, a communication unit 115, and a recording medium reading unit 116.

The communication unit 115 receives the content data from the server 120 via the network N and outputs the content data to the processing unit 111. The network N may be wired or wireless.

The recording medium reading unit 116 reads the content data recorded on the recording medium 117 and outputs the content data to the processing unit 111. The recording medium 117 is exemplified by, but is not limited to, a Blu-ray (registered trademark) disc.

The sensor unit 114 detects the position and the direction in which the user U is facing, and outputs the output to the processing unit 111. The direction in which the user U is facing is exemplified, but is not limited to, the direction in which the face of the user U is facing or the direction in which the body of the user U is facing.

When the content output device 110 is portable, the sensor unit 114 is exemplified by, but is not limited to, a front camera (in-camera) mounted on the image display side of a smartphone or tablet.

When the content output device 110 is a stationary type, the sensor unit 114 is exemplified by, but is not limited to, a camera or a beacon installed in a room.

The processing unit 111 causes the video output unit 112 to display the video based on the video data included in the content data. The processing unit 111 is exemplified by a CPU (Central Processing Unit), but the processing unit 111 is not limited to this.

When the content output device 110 is portable, the video output unit 112 is exemplified by a display panel mounted on a smartphone or tablet, or a VRHMD, a television device or a projector connected to the smartphone or tablet. , Not limited to these.

When the content output device 110 is a stationary type, the video output unit 112 is exemplified by, but is not limited to, a VRHMD, a television device, or a projector.

The processing unit 111 causes the audio output unit 113 to output audio based on the audio data included in the content data.

When the content output device 110 is portable, the audio output unit 113 includes, but is not limited to, a speaker mounted on a smartphone or tablet, or headphones or earphones connected to the smartphone or tablet. ..

When the content output device 110 is a stationary type, the audio output unit 113 is exemplified by a speaker, headphones or earphones, but is not limited thereto.

The processing unit 111 outputs the audio signal S ₁ to the vibration experience device 1. Processing unit 111 may transmit the audio data included in the content data as it is as the audio signals S ₁ to vibrotactile device 1.

In addition, human beings feel the sound pressure in the bass rather than the treble. Therefore, the processing unit 111 may be transmitted to the vibrotactile device 1 only bass component of the audio data included in the content data as an audio signal S _1.

As an example, the processing unit 111, the audio data included in the content data, a signal that has passed through a low pass filter having a cutoff frequency that is determined in advance, and transmits the audio signals S ₁ to vibrotactile device 1 Is also good.

Alternatively, the processing unit 111, if it contains object-based audio data to the content data, transmitted to the vibrotactile device 1 only audio data of the object that emits a predetermined frequency or less bass as audio signals S ₁ You may.

Alternatively, the processing unit 111, if it contains audio data for driving a subwoofer to the content data, the audio data for driving the subwoofer transmitted as audio signals S ₁ to vibrotactile device 1 You may.

The processing unit 111, the sound source position information S ₂ is information representing the position of an object, and outputs to the vibrotactile device 1. The sound source position information S ₂ may include information on the direction in which the speaker emits sound.

As an example, the processing unit 111, when the content data contains object-based audio data may transmit location information of a plurality of objects to vibrotactile device 1 as the sound source position information S _2.

Alternatively, processor 111 may transmit the vibrotactile device 1 only the position information of the dominant object as the sound source position information S _2. The dominant object is exemplified by the object having the highest signal level.

Alternatively, the processing unit 111 is calculated based on the signal level of the sound of a plurality of objects may send average position information of a plurality of objects to vibrotactile device 1 as the sound source position information S _2. The average position information may be calculated by substituting the mass with a signal level so that the center of gravity is calculated from the mass and the positional relationship of a plurality of objects. As the signal level, the average value of the signal levels for each unit time may be used.

Alternatively, processor 111 may transmit the vibrotactile device 1 only the position information of the object that emits a predetermined frequency below the bass as a sound source position information S _2.

The processing unit 111, in the space where the object is located, the user position information S ₃ is information indicating a direction in which the position and opposite the user U, and outputs the vibrotactile device 1. The position and facing direction of the user U may be an absolute position and direction in the space where the object is located, or may be a relative position and direction between the object and the user U. good.

<Embodiment>
[composition]
FIG. 2 is a diagram showing a configuration of a vibration experience device according to an embodiment. The vibration experience device 1 includes an audio signal acquisition unit 11, a sound source position information acquisition unit 12, a user position information acquisition unit 13, a vibration part calculation unit 14, a vibration signal generation unit 15, and a plurality of vibration units 16. including. The plurality of vibrating portions 16 are attached to a plurality of parts of the body of the user U, respectively.

3 and 4 are views showing a mounting state of a plurality of vibrating portions of the vibration experience device according to the embodiment. FIG. 3 is a front view of the user U. FIG. 4 is a view of the user U as viewed from the back.

As shown in FIGS. 3 and 4, in the embodiment, the plurality of vibrating portions 16 are attached to the vest 20. Then, the user U is wearing the best 20. As a result, the plurality of vibrating units 16 are attached to the user U. In the embodiment, a plurality of vibrating portions 16 are attached to the vest 20, but the present invention is not limited to this. The plurality of vibrating portions 16 may be attached to a band, a belt, a belly band, or the like and attached to the user U.

The plurality of vibrating portions 16 are preferably mounted in a plurality of directions around the axis 21 of the body of the user U. The shaft 21 is exemplified by a line connecting the top of the head and between both feet when the user U stands upright, but the shaft 21 is not limited to this.

For example, when there are two plurality of vibrating portions 16, one vibrating portion 16 may be attached to the abdomen of the user U, and the other vibrating portion 16 may be attached to the back of the user U. preferable. Alternatively, it is preferable that one vibrating portion 16 is mounted on the right flank of the user U and the other vibrating portion 16 is mounted on the left flank of the user U.

Further, for example, when the plurality of vibrating portions 16 are four, it is preferable that the four vibrating portions 16 are attached to the abdomen, the back, the right flank, and the left flank of the user U, respectively.

Further, as shown in FIGS. 3 and 4, it is preferable that a plurality of vibrating portions 16 are arranged along the extending direction of the shaft 21 in one direction around the shaft 21. For example, in FIG. 3, in the central abdomen of the body of the user U, a vibrating portion group 16a including three vibrating portions 16 is arranged along the extending direction of the shaft 21. Then, for example, when the position of the object is higher than the position of the user U, the vibration experience device 1 preferably vibrates the vibrating portion 16a1 arranged at the highest position in the vibrating portion group 16a most strongly. .. For example, when the object is an airplane, the vibration experience device 1 preferably vibrates the vibrating portion 16a1 arranged at the highest position in the vibrating portion group 16a most strongly. As a result, the user U can feel more realistic.

It is exemplified, but not limited to, each of the plurality of vibrating portions 16 is composed of a motor and a ballast, or is composed of a magnet and a coil.

The audio signal acquisition unit 11, the sound source position information acquisition unit 12, the user position information acquisition unit 13, the vibration part calculation unit 14, and the vibration signal generation unit 15 may be attached to the best 20, or may be attached to the best 20. It may not be possible to separate the vibration units 16 from each other.

Referring again to FIG. 2, the audio signal acquisition unit 11 acquires the audio signals S ₁ from the content output apparatus 110, and outputs the vibration signal generation section 15.

The sound source position information acquisition unit 12 acquires the sound source position information S ₂ from the content output device 110 and outputs it to the vibration portion calculation unit 14.

The user position information acquisition unit 13 acquires the user position information S ₃ from the content output device 110 and outputs the user position information S 3 to the vibration portion calculation unit 14.

Vibrating region calculating unit 14, based on the sound source position information S ₂ and the user position information S _3, calculates the part information S ₄ representing the site of the user U for vibrating, and outputs the vibration signal generation section 15.

As a specific example, first, the vibration part calculation unit 14 calculates the direction in which the object emits a sound from the relative positional relationship between the user U and the object. Next, the vibration portion calculation unit 14 calculates the direction in which the vibration should be transmitted from the direction in which the user U is facing and the direction in which the object emits a sound.

FIG. 5 is a diagram showing an example of the positional relationship between the object and the user. In FIG. 5, the video output unit 112 is a television device.

The video output unit 112 outputs video in the direction opposite to the Y-axis direction. The user U faces the video output unit 112. That is, the direction 33 in which the user U is facing is the Y-axis direction. The object 31 is located diagonally to the front right when viewed from the user U. The object 31 emits a sound in the direction 32 opposite to the Y-axis direction. In this case, the vibration portion calculation unit 14 calculates the direction 34 from the object 31 toward the user U as the direction in which the vibration should be transmitted. Then, the vibration portion calculation unit 14 calculates the right abdomen 35 of the user U as a portion to be vibrated based on the angle θ formed by the direction 33 and the direction 34. Referring to FIG. 3 again, the vibration experience device 1 vibrates the vibration unit group 16b including the three vibration units 16 arranged in the right abdomen of the user U.

The vibration portion calculation unit 14 may calculate the portion of the body of the user U that is closest to the object 31 as the portion that gives vibration. Referring to FIG. 5 again, the part of the body of the user U that is closest to the object 31 is the right abdomen 35 of the user U. Therefore, the vibration part calculation unit 14 may calculate the right abdomen 35 of the user U, which is the closest to the object 31 among the parts of the body of the user U, as the part to give vibration.

Alternatively, the vibration portion calculation unit 14 may calculate a portion of the body portion of the user U that faces the object 31 as a portion that gives vibration. Referring to FIG. 5 again, the part of the body of the user U facing the object 31 is the right abdomen 35 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the right abdomen 35 of the user U, which faces the object 31 in the body portion of the user U, as the portion to be vibrated.

FIG. 6 is a diagram showing an example of the positional relationship between the object and the user. FIG. 6 is a diagram showing a state in which the user U has rotated the direction 33 by 180 degrees as shown by an arrow 36 with the direction 33 perpendicular to the XY plane as an axis from the state shown in FIG.

The user U faces the side opposite to the video output unit 112. That is, the direction 33 in which the user U is facing is the direction opposite to the Y-axis direction. The object 31 is located diagonally to the left and rear when viewed from the user U. The object 31 emits a sound in the direction 32 opposite to the Y-axis direction. In this case, the vibration portion calculation unit 14 calculates the direction 34 from the object 31 toward the user U as the direction in which the vibration should be transmitted. Then, the vibration portion calculation unit 14 calculates the left back portion 37 of the user U as a portion to be vibrated based on the angle θ formed by the direction 33 and the direction 34. Referring to FIG. 4 again, the vibration experience device 1 vibrates the vibration unit group 16d including the three vibration units 16 arranged on the left back portion of the user U.

The vibration portion calculation unit 14 may calculate the portion of the body of the user U that is closest to the object 31 as the portion that gives vibration. Referring again to FIG. 6, the part of the body of the user U that is closest to the object 31 is the left back 37 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the left back portion 37 of the user U, which is the closest to the object 31 among the parts of the body of the user U, as the portion to be vibrated.

Alternatively, the vibration portion calculation unit 14 may calculate a portion of the body portion of the user U that faces the object 31 as a portion that gives vibration. Referring to FIG. 6 again, the portion of the body portion of the user U that faces the object 31 is the left back portion 37 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the left back portion 37 of the user U, which faces the object 31 in the body portion of the user U, as the portion to be vibrated.

FIG. 7 is a diagram showing an example of the positional relationship between the object and the user. Here, it is assumed that the content data has a multi-camera angle. FIG. 7 is a diagram showing a state in which the user U operates the content output device 110 to move the camera angle clockwise from the state shown in FIG. When the camera angle is moved clockwise, the object 31 moves in the direction 38 opposite to the X direction when viewed from the user U.

The user U faces the video output unit 112. That is, the direction 33 in which the user U is facing is the Y-axis direction. The object 31 is located diagonally to the left and front when viewed from the user U. The object 31 emits a sound in the direction 39 opposite to the Y-axis direction. In this case, the vibration portion calculation unit 14 calculates the direction 40 from the object 31 toward the user U as the direction in which the vibration should be transmitted. Then, the vibration portion calculation unit 14 calculates the left abdomen 41 of the user U as a portion to be vibrated based on the angle θ formed by the direction 33 and the direction 40. Referring to FIG. 3 again, the vibration experience device 1 vibrates the vibrating portion group 16c including the three vibrating portions 16 arranged on the left abdomen of the user U.

The vibration portion calculation unit 14 may calculate the portion of the body of the user U that is closest to the object 31 as the portion that gives vibration. Referring to FIG. 7 again, the part of the body of the user U that is closest to the object 31 is the left abdomen 41 of the user U. Therefore, the vibration part calculation unit 14 may calculate the left abdomen 41 of the user U, which is the closest to the object 31 among the parts of the body of the user U, as the part to give vibration.

Alternatively, the vibration portion calculation unit 14 may calculate a portion of the body portion of the user U that faces the object 31 as a portion that gives vibration. Referring to FIG. 7 again, the part of the body of the user U facing the object 31 is the left abdomen 41 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the left abdomen 41 of the user U, which faces the object 31 in the body portion of the user U, as the portion to be vibrated.

FIG. 8 is a diagram showing an example of the positional relationship between the object and the user. In FIG. 8, the video output unit 112 is a VRHMD.

The direction 33 in which the user U is facing is the Y-axis direction. The object 31 is located diagonally to the front right when viewed from the user U. The object 31 emits a sound in the direction 32 opposite to the Y-axis direction. In this case, the vibration portion calculation unit 14 calculates the direction 34 from the object 31 toward the user U as the direction in which the vibration should be transmitted. Then, the vibration portion calculation unit 14 calculates the right abdomen 35 of the user U as a portion to be vibrated based on the angle θ formed by the direction 33 and the direction 34. Referring to FIG. 3 again, the vibration experience device 1 vibrates the vibration unit group 16b including the three vibration units 16 arranged in the right abdomen of the user U.

The vibration portion calculation unit 14 may calculate the portion of the body of the user U that is closest to the object 31 as the portion that gives vibration. Referring to FIG. 8 again, the part of the body of the user U that is closest to the object 31 is the right abdomen 35 of the user U. Therefore, the vibration part calculation unit 14 may calculate the right abdomen 35 of the user U, which is the closest to the object 31 among the parts of the body of the user U, as the part to give vibration.

Alternatively, the vibration portion calculation unit 14 may calculate a portion of the body portion of the user U that faces the object 31 as a portion that gives vibration. Referring to FIG. 8 again, the part of the body of the user U facing the object 31 is the right abdomen 35 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the right abdomen 35 of the user U, which faces the object 31 in the body portion of the user U, as the portion to be vibrated.

FIG. 9 is a diagram showing an example of the positional relationship between the object and the user. FIG. 9 is a diagram showing a state in which the user U has rotated the direction 33 by 180 degrees as shown by an arrow 36 with the direction 33 perpendicular to the XY plane as an axis from the state shown in FIG.

The direction 33 in which the user U is facing is the direction opposite to the Y-axis direction. The object 31 is located diagonally to the left and rear when viewed from the user U. The object 31 emits a sound in the direction 32 opposite to the Y-axis direction. In this case, the vibration portion calculation unit 14 calculates the direction 34 from the object 31 toward the user U as the direction in which the vibration should be transmitted. Then, the vibration portion calculation unit 14 calculates the left back portion 37 of the user U as a portion to be vibrated based on the angle θ formed by the direction 33 and the direction 34. Referring to FIG. 4 again, the vibration experience device 1 vibrates the vibration unit group 16d including the three vibration units 16 arranged on the left back portion of the user U.

The vibration portion calculation unit 14 may calculate the portion of the body of the user U that is closest to the object 31 as the portion that gives vibration. Referring again to FIG. 9, the part of the body of the user U that is closest to the object 31 is the left back 37 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the left back portion 37 of the user U, which is the closest to the object 31 among the parts of the body of the user U, as the portion to be vibrated.

Alternatively, the vibration portion calculation unit 14 may calculate a portion of the body portion of the user U that faces the object 31 as a portion that gives vibration. Referring to FIG. 9 again, the portion of the body portion of the user U that faces the object 31 is the left back portion 37 of the user U. Therefore, the vibration portion calculation unit 14 may calculate the left back portion 37 of the user U, which faces the object 31 in the body portion of the user U, as the portion to be vibrated.

8 and 9 have described the case where the video output unit 112 is a VRHMD, but the same applies to the case where the video output unit 112 is a display panel mounted on a smartphone or tablet.

Referring again to FIG. 2, the vibration signal generation section 15, a vibration signal S ₅ having a magnitude corresponding to the magnitude of the sound represented by the audio signal S _1, is mounted on the moiety represented by the site information S ₄ Output to one or more vibrating units 16

FIG. 10 is a diagram showing an example of an audio signal and a vibration signal of the embodiment.

Vibration signal generating unit 15 calculates a plurality of extreme value 50 of the audio signal S _1. Next, the vibration signal generation unit 15 calculates a plurality of absolute values 51 of a plurality of extreme values 50. Then, the vibration signal generation unit 15 generates a pulse-shaped vibration signal S ₅ by multiplying a plurality of absolute values 51 by a predetermined gain. Therefore, the timing of the pulse of the vibration signal S ₅ is the same as the timing of the plurality of extreme values 50 of _{the audio signal S 1.} The vibration signal generation unit 15 outputs the vibration signal S ₅ to one or a plurality of vibration units 16 mounted on the portion represented by the portion information S _4. The one or more vibrating portions 16 to which the vibrating signal S ₅ is supplied vibrates with a strength corresponding to the magnitude of the _{vibrating signal S 5.}

Thus, one or more of the vibrating section 16 is attached to the moiety represented by the site information S ₄ can provide a vibration strength corresponding to the magnitude of the sound to the user U. Therefore, the user U can feel more realistic.

Incidentally, the vibration signal generation section 15 calculates the envelope of the audio signal S _1, may calculate the extremum 50 from the envelope. Vibration signal generating unit 15, by performing a Hilbert transform to the audio signal S _1, may calculate the envelope.

The vibration signal generator 15, when the processing unit 111 is outputted without passes the audio signals S ₁ to low pass filter the audio signals S _1, is passed through a low pass filter having a cut-off frequency to a predetermined You may.

The vibration signal generator 15, depending on the length of time between the extremes 50 and extremes 50, by changing the time for outputting the vibration signal S _5, changed the time to vibrate the vibrating portion 16 You may. For example, when the time length between the extreme value 50 and the extreme value 50 is long, the vibration signal generation unit 15 _{changes the time for outputting the vibration signal S 5} to a long time to increase the time for vibrating the vibration unit 16. You may change it for a long time. Further, when the time length between the extreme value 50 and the extreme value 50 is short, the vibration signal generation unit 15 _{reduces the time for outputting the vibration signal S 5} to shorten the time for vibrating the vibration unit 16. You may change it to a shorter time.

As a result, for example, the vibration time due to the sharp bass drum becomes short, and the vibration time due to the relaxed base becomes long. Therefore, the user U can experience the sound pressure with high reproducibility and can feel the presence more.

The vibration signal generation unit 15 may also output the _{vibration signal S 5} to one or more vibration units 16 mounted on a portion different from the portion represented by the _{portion information S 4.} In this case, the vibration signal generator 15, depending on the distance from the moiety represented by the site information S _4, it is preferable to reduce the amplitude of the vibration signal S _5.

Referring again to Figure 3, when moiety represented by the site information S ₄ is a front abdominal section, the vibration signal generator 15, the magnitude corresponding to the magnitude of the sound represented by the audio signals S ₁ a vibration signal _{S 5,} and outputs the vibration portion group 16a. In addition, the vibration signal generation section 15, a vibration signal S ₅ having a smaller amplitude in accordance with the distance from the moiety represented by the site information S _4, mounted on the vibration unit group 16b and the left abdomen is attached to the right abdomen It is preferable to output to the vibrating part group 16c.

Furthermore, the vibration signal generation unit 15 _{transmits the vibration signal S 5} whose amplitude is reduced according to the distance from the front abdomen represented by the _{site information S 4} , to the right side portion, the left side portion, the right back portion, and the left. It may be output to the vibrating part group attached to the back part and the central back part.

Thus, one or more of the vibrating section 16 is mounted at a site different from the site represented by the site information S ₄ is one which is attached to the moiety represented by the site information S ₄ or more vibration in accordance with the distance from the part 16, providing one is attached to the moiety represented by the site information S ₄ or more weak vibration than the vibration portion 16 to the user U. Therefore, since the user U is given vibrations of different magnitudes at the plurality of parts, the user U can feel more realistic.

Referring again to Figure 2, a plurality of vibrating portions 16 at the timing of the vibration signal S _5, to generate a vibration strength corresponding to the amplitude of the vibration signal S _5.

[motion]
FIG. 11 is a flowchart showing the operation of the vibration experience device of the embodiment. The vibration experience device 1 executes the process shown in FIG. 11 at a predetermined cycle.

Audio signal acquisition unit 11, at step S100, acquires the audio signals _{S 1} from the processing unit 111, and outputs the vibration signal generation section 15.

Sound source position information acquisition unit 12, at step S102, acquires the sound source position information _{S 2} from the processing section 111, and outputs the vibration region calculating unit 14.

User location information obtaining unit 13, at step S104, acquires the user position information _{S 3} from the processing unit 111, and outputs the vibration region calculating unit 14.

Vibrating region calculating unit 14 in step S106, based on the sound source position information S ₂ and the user position information S _3, calculates the part information S ₄ representing the site of the user U for vibrating, output the vibration signal generation section 15 do.

In step S108, the vibration signal generation unit 15 _{outputs a vibration signal S 5} having a magnitude corresponding to the loudness of the sound represented by the _{audio signal S 1} to one or a plurality of vibration units 16.

In step S110, one or a plurality of vibration units 16 generate vibration of a strength corresponding to the amplitude _{of the vibration signal S 5 at} the timing of the vibration signal S _5.

The vibrating one or more vibrating units 16 may stop vibrating when there is contact from a person different from the user U. As a result, it is possible to prevent the vibration from being transmitted to a person different from the user U.

The vibration signal generator 15, after supplying the oscillating signal S ₅ to one or more of the vibrating part 16, one or more of the vibrating section 16 starts to vibrate, the user U up felt vibration The delay time of may be output to the processing unit 111. Then, it is preferable that the processing unit 111 delays the output of the sound from the sound output unit 113 by the delay time. As a result, the voice output from the voice output unit 113 and the vibration generated by one or more vibration units 16 can be synchronized. As a result, the user U can feel more realistic.

[effect]
As described above, according to the present embodiment, it is possible to apply vibration to a part of the body of the user U according to the positional relationship between the object 31 and the user U. As a result, the presence of the user U can be enhanced.

1 Vibration sensor, 11 Audio signal acquisition unit, 12 Sound source position information acquisition unit, 13 User position information acquisition unit, 14 Vibration part calculation unit, 15 Vibration signal generation unit, 16 Vibration unit, 16a, 16b, 16c, 16d Vibration unit Group, 20 best, 31 objects, 100 systems, 110 content output device, 111 processing unit, 112 video output unit, 113 audio output unit, 114 sensor unit, 115 communication unit, 116 recording medium reader, 117 recording medium, 120 servers. ..

Claims (6)

Multiple vibrating parts, each attached to multiple parts of the user's body,
An audio signal acquisition unit that acquires audio signals from the outside,
A sound source position information acquisition unit that acquires sound source position information from the outside, which is information indicating the position of an object that emits sound.
A user position information acquisition unit that acquires user position information from the outside, which is information indicating the user's position and the direction in which the user is facing.
A vibration part calculation unit that calculates part information representing a part of a user who gives vibration based on the sound source position information and the user position information.
A vibration signal generator that outputs a vibration signal having a magnitude corresponding to the loudness of the sound represented by the audio signal to one or more of the vibration parts mounted on the parts represented by the part information. When,
With
One or more of the vibrating parts to which the vibrating signal is supplied vibrates with a strength corresponding to the magnitude of the vibrating signal.
Vibration experience device. The vibration part calculation unit
The vibration experience device according to claim 1, wherein the part information is calculated based on an angle formed by a direction in which the user is facing and a direction in which vibration from an object to the user should be transmitted. The vibration signal generator
The vibration signal is also output to one or more of the vibrating parts mounted on a part different from the part represented by the part information, and the vibration signal is output according to the distance from the part represented by the part information. The vibration experience device according to claim 1 or 2, which reduces the vibration signal. The sound source position information acquisition unit
The vibration experience device according to any one of claims 1 to 3, which acquires the sound source position information of the object having the highest signal level. The sound source position information acquisition unit
The vibration experience device according to any one of claims 1 to 3 , wherein the average position information of the plurality of objects calculated based on the signal levels of the sounds of the plurality of objects is acquired as the sound source position information. The vibration signal generator
Claims 1 to 5 calculate a plurality of extreme values based on the envelope of the audio signal, and change the time for outputting the vibration signal according to the time length between the extreme values. The vibration experience device according to any one of the above items.

Images