JP2017213240A - Voice instruction device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice instruction device detecting a prescribed movement such as a golf swing from a user's ears and instructing the user in real time during the movement.SOLUTION: A voice instruction device includes an applied part to be applied near an external auditory meatus of a user, and a guide voice generation part. The applied part includes a voice emission part for emitting the guide voice to the user, and a sensor for detecting the user's posture and movement. The guide voice generation part generates the guide voice determined in real time on the basis of the detected user's posture or movement. The guide voice generation part, for example, compares the detected user's posture or movement with a reference and represents the comparison result with a beat tone and volume of the guide voice.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a voice learning apparatus that learns an operation using a voice in real time during a user's predetermined operation.

  An apparatus for analyzing and evaluating a user's predetermined operation, for example, a golf swing, has been put into practical use (for example, Patent Document 1 and Patent Document 2). These devices analyze the user's swing and display the trajectory and speed after the swing to inform the user.

JP 2010-025737 A

JP 2012-254205 A

  However, the above-described conventional device does not notify the user in real time during the swing of the quality of the swing, for example, the deviation of the swing trajectory. Further, even if there is a device that displays a trajectory deviation or the like in real time during the swing, the user cannot see the display during the swing.

  An object of the present invention is to provide a voice learning device capable of learning a predetermined operation such as a golf swing in real time during the operation (determining the degree of quality without looking at the display).

  The speech learning apparatus of the present invention includes a mounting unit that is mounted near the user's ear canal and a guide sound generating unit. The mounting unit includes a sound emitting unit that emits a guide voice to the user, and a sensor that detects the posture or operation of the user. The guide sound generating unit generates guide sound determined in real time based on the detected posture or motion of the user.

  The guide sound generation unit may control at least one of beat, volume, left / right balance, and localization of the guide sound based on the detected posture or action of the user.

  The guide sound generation unit may generate a pulse sound as the guide sound and control the interval and / or volume of the pulse sound based on the detected posture or action of the user.

  A reference memory for storing a reference of the user's posture or action is further provided, and the guide sound generation unit compares the detected user's posture or action with the reference and controls the mode of the guide voice in real time based on the comparison result. It may be a thing.

  In addition to the above-described configuration, the speech learning apparatus according to the present invention mixes a musical sound generating unit that generates musical sounds, a guide voice generated by the guide sound generating unit, and a musical sound generated by the musical sound generating unit to generate a sound emitting unit. And a mixer that outputs the signal to the outside.

  According to the present invention, a predetermined operation such as a golf swing can be learned in real time during the operation using the voice.

It is a figure which shows the usage pattern of the audio training apparatus (audio | voice instructor) which is embodiment of this invention. It is a block diagram of an audio learning apparatus. It is a figure which shows the example of a user's swing and the change of head speed. It is a figure which shows the example of a user's swing and the change of head speed. It is a figure which shows the guide sound production | generation rule of an audio learning apparatus. It is a flowchart which shows the guide sound generation | occurrence | production procedure and reference update procedure of an audio learning apparatus.

  FIG. 1 is a diagram showing a usage pattern of the speech learning apparatus 1. FIG. 2 is a block diagram of the speech learning apparatus 1. The voice learning apparatus 1 has a mounting portion 2 that is worn on the user's ear, and a small speaker 14 and a motion sensor 15 are built in the mounting portion 2. The motion sensor 15 detects the motion of the user P and the motion of the head. For example, the motion of the head during the swing motion of the golf club C is detected. The voice learning device 1 detects the motion of the head of the user P by the motion sensors 15L and 15R provided in the mounting portions 2L and 2R of both ears, and the control unit 10 determines the difference between the motion and the reference with a small speaker. The user P is notified by voice (guide voice) via 14L and 14R. Thereby, the user P can correct the swing in real time by listening to the guide voice while performing the swing operation.

  In FIG. 1, a user P wears the voice learning device 1 and takes a golf club C and takes an address posture. The voice learning device 1 includes a mounting unit 2 (2L, 2R) mounted on both ears of a user and a control box 3 provided near the middle of a cable connecting the left and right mounting units 2L, 2R. . As described above, the left and right mounting portions 2L and 2R incorporate small speakers 14L and 14R that emit sound to the user's outer ear, and motion sensors 15L and 15R that detect swing. A 9-axis MEMS sensor is applicable as the motion sensors 15L and 15R. The motion sensors 15L and 15R are also referred to as a left ear sensor 15L and a right ear sensor 15R. From the small speakers 14L and 14R, a guide sound for guiding a golf swing in real time is emitted. The left mounting portion 2L and the control box 3, and the right mounting portion 2R and the control box 3 are connected by a stereo cable. The control box 3 transmits sound (guide sound) to be heard by the user P to the left and right mounting portions 2L and 2R, and acquires detection values from the motion sensors 15L and 15R provided in the left and right mounting portions 2L and 2R.

  The control box 3 includes a control unit 10 that is a small computer. A left ear sensor 15L, a right ear sensor 15R, a memory 12, and a sound source 11 are connected to the control unit 10. Note that the control box 3 may be dedicated to the audio learning device 1, but may be realized by a multi-function mobile phone (smartphone) and an application program. In this case, the mounting unit 2 and the multi-function telephone may communicate with each other via Bluetooth (registered trademark).

  The control unit 10 estimates and analyzes the movement of the user P based on the detection values input from the left ear sensor 15L and the right ear sensor 15R, and causes the sound source 11 to generate based on the difference between the analysis result and the reference. The mode of the guide sound is determined. The mode of the guide sound includes beats added to the guide sound, volume, left / right balance, and localization. The reference is stored in the memory 12. The guide sound mode determination process is performed, for example, every 10 milliseconds, and is output to the sound source 11 as guide sound control information. Details of the determination of the guide sound mode will be described later (see FIG. 4). The sound source (sound generator) 11 generates a guide sound based on the control information input from the control unit 10 and controls to change the mode. The guide sound is amplified by the left and right amplifiers (drivers) 13L and 13R and emitted from the small speakers 14L and 14R. In FIG. 1, the amplifiers 13L and 13R are provided in the control box 3, but may be provided in the mounting portions 2L and 2R.

  3 and 4 are diagrams showing the transition of the posture and the transition of the head direction when the user P swings the golf club C. FIG. FIG. 3 shows an example when the user P makes a preferable swing, and FIG. 4 shows an example when the user P makes an unfavorable swing. Here, the moving direction of the head is the forward direction in the drawing (the hitting ball direction) and the reverse direction is the backward direction.

  In the preferred example of FIG. 3, when the user P swings and hits the golf club C, the user P first takes an address posture (A), performs a back swing from this posture (B), and creates a top posture ( C). In this process, it can be seen from the detection value of the motion sensor 15 that the head turns to the right by a small angle, and the front and rear positions of the head hardly change. . The golf club C is slowly moving (turning) in a direction opposite to the swing direction. The user P starts the swing from the top posture (C) (D), and finishes the swing at the follow-through (F) through the impact (E) while accelerating. At the start of the swing, the head moves forward and turns to the right, and the forward movement and right turn are eliminated (moved and turned in the opposite direction) with the swing. Then, at the moment of impact, the head is facing backwards (turning angle = 0) and is moving backward greatly. After that, along with the follow-through, the head turns greatly to the left (in the direction of the hit ball), the backward movement is canceled and the head moves slightly forward.

  In the unfavorable example of FIG. 4, when the user P swings and hits the golf club C, the user P first takes an address posture (A), performs a back swing from this posture (B), and creates a top posture. (C). The process so far is almost the same as the preferred example of FIG. The user P starts swinging from the top posture (C) (D), passes through the impact (E) while accelerating and ends the swing through the follow-through (F), but the head moves forward from the start of the swing. Move and start turning left. Even at the moment of impact, the head is turning left (hit direction) while moving forward. And it will follow through with that posture.

  FIG. 5 is a diagram for explaining the rules for controlling the mode of the guide sound emitted from the voice learning device 1 to the user P. The speech learning apparatus 1 of this embodiment detects the movement of the head of the user P, and estimates and analyzes the movement of the whole body. Specifically, the front and back movement and turning of the user P's head are detected based on the detection values of the left and right ear sensors 15L and 15R. The movement of the head of the user P represents the posture of the user P, and based on the movement of the head, it is possible to estimate the movement of the whole body such as whether the body is facing the ball or the body is not open. Is possible.

  Reference that is a model data of the movement of the head of the user P that is the object of analysis and the turning of the head is stored in the memory 12 and is read out in synchronization with the swing of the user P for analysis. Compared with content. The reference may be data that records an ideal (teacher's) swing, or may be past data (in a good form).

  The sound source 11 generates sound having a predetermined frequency (for example, 440 hertz) as a guide sound. A sinusoidal wave may be used, but a sawtooth wave that includes overtones and has an easy-to-understand localization may be used.

The control unit 10 compares the turning angle and movement amount of the head detected in the address posture, the back swing posture, and the top posture with the reference, and causes the guide sound to produce an amount of beat corresponding to the deviation. The beat is a subtracted waveform of two sounds, and has a frequency corresponding to the frequency difference between the two sounds. Specifically, amplitude modulation (AM) may be performed on the guide sound with a low-frequency signal waveform corresponding to beat. The number of beats may be increased as the deviation is larger, and the number of beats may be reduced as the deviation is reduced. For example, the number of beats (beat frequency) can be determined using the following equation.
Number of beats = coefficient x (1- (analysis value / reference value)) x guide audio frequency

  Further, the depth of amplitude modulation may be adjusted. That is, the larger the deviation, the larger the beat (modulation deeper), and the smaller the deviation, the smaller the beat (modulation smaller). Since the deviation of the turning angle and the amount of movement of the head with respect to the reference is reflected in the number of times the guide voice beats, the user P may correct the swing posture so as to eliminate the beat while listening to the guide voice. The coefficient is adjusted so that the number of beats is around 10 Hz as in the case of normal instrument tuning. Further, a guide 1 sound and a guide 2 sound whose frequencies are controlled may be generated so that a predetermined number of beats occur, and played simultaneously.

  As described above, the size of the beat includes the height of the beat frequency and / or the depth of the beat (degree of modulation). In this embodiment, the number of beats and the depth of beat are made to correspond to the deviation of the amount of forward and backward movement and the deviation of the turning angle, respectively. The beat may be generated by amplitude-modulating the guide sound, but the basic guide sound (440 Hz) is emitted to one ear and the frequency is raised or lowered to the other ear according to the deviation of the swing trajectory. The sound of the swing analysis sound (440 ± b hertz) may be emitted to cause a beat in the user P's hearing.

  In the above, the example in which the user P is informed of the deviation between the turning angle of the head and the reference of the movement amount by the beat of the guide sound has been described. Thus, the user P may be notified of the deviation. Examples thereof will be described below.

  The control unit 10 compares the analyzed front and back position of the head with the reference, and if it is shifted, changes the left and right volume balance to notify the user P of the shift. That is, when the head is shifted behind the reference, the left sound is increased to alert the left direction. If the head is displaced before the reference, the right sound is increased to alert the right. This informs the user P that the position of the head is displaced and alerts the user in the direction to return, so that the user P can reflexively correct the head position. Note that, depending on the type of sound, there is a possibility that attention can be drawn when the volume is reduced. In this case, the direction of head displacement and the direction of volume balance may be reversed.

  The control unit 10 compares the analyzed turning of the head with the reference, and changes the localization of the guide sound when it is deviated. The guide sound is usually localized at the top of the head or the face. When the user P's head is turning to the right of the reference, the guide sound is localized to the left rear. As a result, interest is generated in the left rear, and an extra right turn can be stopped (returned to the original). Conversely, when the head is turning to the left of the reference, the guide sound is localized to the right rear. As a result, interest of the user P is generated at the right rear, and an extra left turn can be stopped.

  The above-described analysis of the detection value (motion) of the motion sensor and guide sound mode control processing are executed at short time intervals (for example, 10 milliseconds), and the mode of the guide sound generated by the sound source 11 is controlled in real time. While swinging the golf club C, the user P can correct the address position, the posture of the back swing, the posture during the swing, and the like by listening to the guide sound controlled in various modes.

  FIG. 6A is a flowchart of the swing guide process of the control unit 10. The control unit 10 repeats this process every 10 milliseconds. The control unit 10 acquires the detection values of the left and right ear sensors 15L and 15R (S20), and analyzes the back and forth movement of the head and the left and right turns based on the detection values (S21). Then, the control unit 10 compares the left / right movement of the head with the reference, and determines the number of beats of the guide sound and the left / right volume balance according to the deviation (S23). The control unit 10 compares the turning angle of the head with the reference, and determines the beat depth and localization position of the guide sound based on the deviation (S14). Then, the sound source 11 is instructed to generate the guide sound in the manner determined in S13, S14, S23, and S24.

  FIG. 6B is a flowchart illustrating an example of a reference update procedure. In this example, a procedure for registering a record of a past swing as a reference is shown. The memory 12 has an area for storing a plurality of times of swing analysis data, analyzes the detection values of the motion sensors 15L and R for each swing of the user P (S30), and stores the analysis data of the swing (S30). S31). The swing at S30 may be a practice swing using a reference that has already been registered. After swinging once or a plurality of times, the user P who has determined that there is a good swing performs a predetermined reference update operation on the speech training apparatus 1. When the reference update operation is performed (YES in S32), the control unit 10 advances the process to the history selection process in S33. In S33, the control unit 10 accepts a history selection by the user P. When the memory 12 can store analysis data for a plurality of past times, the user P selects the one that seems to be good. Then, the control unit 10 transfers the selected analysis data to the reference storage area (S34), and returns to the normal processing for receiving the detected value of the motion sensor by the swing.

  Note that when the memory 12 stores analysis data for the past one time and a reference update operation is performed, the control unit 10 may automatically register the stored analysis data as a reference. Further, the analysis data of a plurality of times may be stored in the memory 12, and the average value may be used as a reference.

  Further, the analysis target is not limited to the address position, the back swing posture, the swing trajectory, the swing speed, the left and right movement of the head, and the turning of the head. Some of these or other elements related to the operation of the user P may be analyzed.

  Moreover, the change mode of the guide sound for notifying the deviation between the analysis result and the reference in real time is not limited to the above. Further, instead of the guide sound or together with the guide sound, the guide wording may be generated and emitted. Guide words include, for example, “Gaze remains in the ball!” And “Do not thrust the upper body!”.

  Although the above embodiment has been described with respect to an example in which the swing of the golf club C is analyzed and instructed, the present invention can be applied to other than the golf swing. For example, a baseball bat swing, a tennis racket swing, and the analysis target are not limited to swings, and anything that can compare the posture / motion of the model and the posture / motion of the analysis target, such as dance. Further, the transmission medium of the sound emitting unit is not limited to air vibration, and any medium that transmits vibration to the human auditory organ may be used.

1 Voice learning device 2 (2L, 2R) Mounting part 15L, 15R Motion sensor

Claims (5)

A mounting unit mounted near the user's external auditory canal, including a sound emitting unit that emits a guide voice to the user, and a sensor that detects the posture or motion of the user;
A guide sound generator that generates the guide sound determined in real time based on the detected posture or motion of the user;
Voice learning device with   The audio learning device according to claim 1, wherein the guide sound generation unit controls at least one of beat, volume, left / right balance, and localization of the guide sound based on the detected posture or action of the user.   The speech learning apparatus according to claim 1, wherein the guide sound generation unit generates a pulse sound as a guide sound, and controls an interval and / or a volume of the pulse sound based on the detected posture or motion of the user. A reference memory for storing a reference of the posture or movement of the user;
The voice according to any one of claims 1 to 3, wherein the guide sound generation unit compares the detected posture or motion of the user with the reference, and controls a mode of the guide voice in real time based on a comparison result. Teaching device. A musical sound generator for generating musical sounds;
A mixer that mixes the guide sound generated by the guide sound generation unit and the musical sound generated by the musical sound generation unit and outputs the mixed sound to the sound emission unit;
The speech learning apparatus according to claim 1, further comprising:

Images