JPH05341785A - Musical sound control device - Google Patents

Abstract

PURPOSE:To provide a musical sound synthesis device which is less susceptible to the output variation of a bending angle detector caused by an environmental change. CONSTITUTION:Input gloves 1 are put on the right and the left hands of a player. On the sections of each finger, bending sensors 2, whose resistive values vary in accordance with the bending angles of the fingers, are provided. These resistance variations of the sensors 2 are detected by a specific detecting circuit not shown in the figure and are supplied to an A/D converter 3. The converter 3 converts voltage variations to digital signals and supplies them to a microcomputer 4. The microcomputer 4 computes the time duration between the start of a finger bending and the completion of the bending, the amount of the bending, the speed and the acceleration of the bending. Moreover, a sound source 7 synthesizes musical sound signals in accordance with the time duration between the start of a finger bending and the completion of the bending, the amount of the bending, the speed and the acceleration of the bending and the parameters set by a function switch group 5, supplies the signals to a sound system 8, the signals are converted to analog signals and musical sounds are generated by a speaker.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a musical tone control apparatus for detecting bending of joints in human limbs such as fingers, wrists, elbows and the like, and controlling musical sounds according to the bending.

2. Description of the Related Art As is well known, in natural musical instruments, it is common to play musical notes by playing strings or keyboards, or by blowing tubes, and most electronic musical instruments play keyboards. By this, a musical sound is generated.

By the way, when it becomes possible to generate a musical sound based on a natural human motion, the musical operation becomes a performance operation apart from the feeling of playing in a conventional musical instrument, and new musical enjoyment and a new musical performance effect are provided. Can play. For example, bending motions of fingers, wrists, elbows, shoulders, etc. are not only daily natural motions but also often used for choreography such as dance. Therefore, if the musical tone can be controlled based on these movements, the musical tone can be controlled according to the dance incorporating this motion or bending motion. From this point of view, therefore, the applicant has proposed an electronic musical instrument that controls the musical sound according to the bending of a human hand or foot, apart from the concept of playing.

In this type of electronic musical instrument, as described above, a bending angle detector for detecting the bending angle of a human hand or foot is used. In the conventional bending angle detector, two potentiometers are combined, and a bending angle is obtained by detecting a change in two orthogonal directions.

In the tone control device using the bending angle detector as described above, tone control is performed according to the state at the time when the operation is completed. For example, when the motion stops at a large acceleration, that is, when the motion is steep, the sound source is controlled so as to generate a short sustain sound, and when the motion stops at a small acceleration, that is, the motion is slow. In some cases, the sound source was controlled to produce a long sustain tone.

Here, two typical conventional techniques used for detecting the above-mentioned change in operation will be described. First, in the first conventional technique, two threshold values are provided, and a time interval that crosses these threshold values is measured. If the time interval is short, it is determined that the operation is performed abruptly, and the time interval is long. In that case, it was determined to have been operated slowly. Further, in the second conventional technique, the change in operation is discriminated by reading the value of the bending angle detector a predetermined time after the predetermined threshold value is exceeded.

[0006]

The bending angle detector described above causes a drift in its output due to changes in ambient temperature and the like. As a result, in the tone control apparatus according to the first and second prior arts, the tone itself is controlled by the output of the angle detector itself, so that even if the movement change is the same, the measured time interval is Is different,
There was a problem that the same control could not be performed for musical sounds. The drift is also caused by factors other than temperature, for example, the deviation between the bending angle detector and the human body surface.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a musical tone control device which is hardly affected by a change in the output of the bending angle detector due to a change in the environment.

[0008]

In order to solve the above-mentioned problems, according to the present invention, a motion detecting means for detecting a motion of a part of a player's body and an output of the motion detecting means are used. A timing detecting means for detecting a start time of the operation and an end time of the operation; and a parameter detecting means for detecting a time and an operation amount between the operation start time and the operation end time, The musical tone is controlled based on at least one of the values of the movement amount.

[0009]

The motion detecting means detects the motion of a part of the player's body, and the timing detecting means detects the start timing of the motion and the end timing of the motion based on the output of the motion detecting means. Further, based on the output of the timing detection means, after the time and the operation amount between the operation start timing and the operation end timing are detected by the parameter detection means, at least one of the time and the operation amount is set to a value. Control the musical sound based on.

[0010]

Embodiments of the present invention will now be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of an embodiment of the present invention. The input gloves 1 are worn on the right and left hands of the performer. FIG. 2 shows the configuration of the input glove 1, in which each finger of the right glove 1a includes (0), (2), (4), (6) and (8) from the thumb to the little finger as finger numbers. ), And each finger of the left glove 1b is numbered (1), (3), (5), (7) and (9). A bending sensor 2 whose resistance value changes according to the bending angle of the finger is provided at each finger portion of the input means 1. These bending sensors 2
Is composed of a resistor formed on a flexible base member, and the resistance value of the resistor is detected by a predetermined detection circuit (not shown) and converted into an analog signal whose voltage changes according to the change of the resistance value. After that, it is supplied to the A / D converter 3 shown in FIG. In addition, the deeper the bending of the finger,
The voltage of the analog signal supplied to the A / D converter 3 becomes high.

The A / D converter 3 converts the analog signal into a digital signal and then supplies it to the microcomputer 4. The microcomputer 4 is a CP
It is composed of U, ROM, RAM, timer, etc., and is used as a control means for controlling the entire electronic musical instrument. In particular, in the present embodiment, the resistance value of the bending sensor provided in the input glove 1 is set. The time from the start of bending of the finger to the end of bending, the amount of bending, the bending speed, the bending acceleration, etc. are calculated based on the change of. Next, the function switch 5 is composed of a plurality of switches, a volume and the like provided on the panel of the electronic musical instrument, and the tone color, rhythm and the like are set. The display device 6 displays the data set by the function switch group 5 and the status of the electronic musical instrument. Further, the tone generator circuit 7 synthesizes a musical tone signal (digital data) according to the parameters set by the input glove 1 and the function switch group 5, and supplies it to the sound system 8. The sound system 8, after converting the musical tone signal into an analog signal, produces a musical tone through a speaker (not shown).

Next, the overall operation of the above configuration will be described with reference to the flow chart shown in FIG. FIG. 3 is a flow chart for explaining the overall operation of this embodiment. The process according to the flowchart is repeatedly executed at a predetermined time interval by a predetermined interrupt process or the like. First, in step SA1, the current speed is stored in the current speed register CV (hereinafter referred to as the current speed CV, the same applies to other registers), the current acceleration is stored in the current addition CA, and further, the current speed is stored in the current position CP. The position of the finger is stored. Next, in step SA2, it is determined whether or not the finger is currently moving based on the current speed CV, the current addition CA and the current position CP. Here, if the finger is not moved yet, the result of the determination in step SA2 is "NO", and the process proceeds to step SA7. Step SA
At 7, it is determined whether or not the finger has stopped. In this case, since the finger has not moved yet, the determination result in step SA7 is "NO", and the process ends.

Next, when the finger is moved from the above-mentioned state, first, in step SA1, each data is stored in the current speed CV, the current addition CA and the current position CP, respectively. And
The determination result in step SA2 is "YES", and the process proceeds to step SA3. In step SA3, it is determined whether or not the bending of the finger has started. In this case, step SA
The determination result in 3 is "YES", and step SA
Go to 4. In step SA4, the current time is ST
And the current finger position is stored in the starting position SP. Next, in step SA5, the current speed,
That is, the current speed CV is compared with the array of speeds [1] to [N], and the speeds are stored in order of speeds [1] to [N].
In other words, sort by speed. In this case, since the finger bending speed is the first data, it is stored in the speed [1].

Next, in step SA6, the current acceleration, that is, the current addition CA and the array of accelerations [1] to
[N] is compared and stored in the accelerations [1] to [N] in the order of acceleration. In other words, they are sorted in the order of acceleration. In this case, since the finger bending acceleration is the first data, it is stored in the acceleration [1]. Then, the process ends. Next, when the process is executed, at this time, if the finger is not yet stopped and is moving, the result of the determination in step SA3 described above is "NO", and the process proceeds to step SA5 and step SA6. At each step, the current speed CV and the current addition CA at that time are stored in the respective arrays, speeds [1] to [N] and accelerations [1] to [N] in descending order. Then, when the finger stops at the predetermined position, the result of the determination in step SA2 is "NO", and the process proceeds to step SA7. In this case, since the finger has stopped, the determination result in step SA7 is "YES", and the process proceeds to step SA8. In Step SA8, first, as the time required from the start of bending to the stop of bending,
A value obtained by subtracting the start ST from the current CT is stored in the required TT. Next, a value obtained by subtracting the starting position SP from the current position CP is stored in the movement amount MA as the movement amount from the start of bending to the stop of bending.

Further, the speed [X] is stored in the speed Vx as an arbitrary Xth speed. Also, as the average speed from the start of bending to the stop of bending, a value obtained by dividing the sum of speeds [1] to [N] by N is stored in the average speed AV,
Acceleration [Y] to acceleration Ay as arbitrary Yth acceleration
Is stored. Further, as the average acceleration from the start of bending to the stop of bending, the average acceleration AA is accelerated [1] to
A value obtained by dividing the sum of [N] by N is stored. Next, the process proceeds to step SA9, and a tone control signal according to at least one of the required time TT, the movement amount MA, the velocity Vx, the average velocity AV, the acceleration Ay, and the average acceleration AA obtained in step SA8 is supplied to the sound source 7. To do. In the present embodiment, for example, the movement amount MA is used, and when the movement amount MA has a large value, a tone control signal for synthesizing a tone-like tone having many reverberation components is supplied to the sound source. On the other hand, when the operation amount MA is small, a tone control signal for synthesizing a tone with few reverberation components is supplied.

Also, when the required TT is used, when the required TT has a small value, a tone control signal for synthesizing a bright tone having many high frequency components is supplied to the sound source. On the other hand, when needed T
When the value of T is large, a tone control signal for synthesizing a tone having a low noise component and a slow rise is supplied.
In addition to the above, for example, the required TT and the movement amount MA
Both of them may be used to synthesize a musical sound having a velocity corresponding to the value of the movement amount MA / necessary time TT (that is, the average acceleration). In this way, it is less likely to be affected by electrical offset and noise. Further, both the required time TT and the movement amount MA may be used to synthesize a musical sound having a velocity according to the value of (movement amount MA / required TT) + movement amount MA. In this way, a large velocity musical tone is produced when moving fast and large, and a small velocity musical tone is produced when moving slowly and small. According to such control, a musical tone that is very suitable for the player's sense is produced.

Next, the details of the above-mentioned operation will be described with reference to FIG.
It will be described with reference to the flowchart shown in FIG.
FIG. 4 is a main routine for explaining the operation of this embodiment. In this figure, first, in step SB1, initialization is performed. Next, in step SB2, it is determined whether or not a predetermined time t (seconds) has elapsed after performing the processes of the following steps SB3 and SB4. If the predetermined time has not elapsed, step SB3 and Bypassing SB4, the process proceeds to step SB5, and when a predetermined time has elapsed, the process proceeds to step SB3. In step SB3, the right hand detection processing routine shown in FIG. 5 is performed. [Right hand detection processing routine] In the right hand detection processing routine,
In step SC1, "0" is substituted for the variable i.
Next, in step SC2, the bending data of the i-th finger is loaded into the variable FD (i). Here, the i-th bending data is stored while the right hand detection processing routine is activated m times. Then, in step SC3, OF
The bending data before n samples (n <m) are fetched into D (i), and the process proceeds to step SC4. At step SC4, the speed SPD (i) is added to the variable FD (i) -variable OFD.
Store (i). That is, the bending speed from the position n samples before to the current position is stored in the speed SPD (i). Next, in step SC5, the speed SPD
Whether or not a start event has occurred is determined depending on whether (i) exceeds a predetermined threshold value STH (i) for the first time. This prevents a slight change in the finger from being erroneously determined to start bending. Here, if a start event occurs,
That is, when it is determined that the finger of the right hand has started to be bent, the determination result in step SC5 is “YES”.
Then, the process proceeds to step SC6.

At step SC6, the bending angle FD (i) at the time when the finger is bent is set to the bending start angle IFD.
The time is stored in (i), and the time TIME is stored in the bending start time ITD (i) as the bending start time. The time TIME such as the start time is incremented in step SD1 of the timer interrupt routine shown in FIG. next,
In step SC7, "0" is stored in the maximum speed MPS (i) in which the maximum speed is stored. On the other hand, if the determination result in step SC5 is "NO", that is,
If the finger is not bent, or if the finger is already bent and is in the process of stopping, then step S
Proceed to C8. If the speed SPD (i) is greater than the maximum speed MPS (i) at step SC8, the maximum speed MPS (i) is reached.
The speed SPD (i) is stored in (i). In other words, here, only the maximum speed is left in the maximum speed MPS (i), instead of rearranging in the order of speed as performed in step SA5 of FIG. 3 described above.

Next, the above-mentioned step SC7 or SC
When step 8 ends, the process proceeds to step SC9, and it is determined whether the variable i has become "8" or more, that is, whether or not data has been fetched for all fingers of the right hand. If the data for all the fingers has not been captured yet, the result of the determination in step SC9 is "NO", and the process proceeds to step SC10. In step SC10, the variable i is incremented by "2", the variable i is set to the next finger number, and the process returns to step SC2. Then, the data for the finger numbers “2”, “4”, “6”, and “8” are sequentially captured. Then, when the data acquisition for all the fingers is completed, the determination result in step SC9 is "Y.
ES ”, and the process proceeds to step SC11. at this point,
The maximum speed is stored in the maximum speed MSP (i) corresponding to each finger. In step SC11, it is determined whether or not the finger of the variable max has stopped. Specifically, speed SPD
It is determined whether (i) is less than or equal to a predetermined threshold value STH (i). Note that the variable max is the number of the finger that is bent most deeply among the moving fingers, that is, the speed S.
While PD (i) ≧ STH (i) holds, the variable FD
The largest number is stored in (i). If the determination result in step SC11 is "NO", that is, if the finger that is bent most deeply has not stopped, the process proceeds to step SC12. Then, step SC1
In 2, the finger number of the above condition is stored in the variable max.

On the other hand, when the finger of the finger number stored in the variable max stops, the result of the determination in step SC11 becomes "YES", and the routine proceeds to step SC13. At step SC13, velocity data is generated and is substituted into the variable C. Generation of velocity data is performed as follows. First, the current bending angle FD (ma
The bending start angle IFD (max) is subtracted from x) and this is stored in the variable A. Next, the maximum speed MSP (ma
x) is stored in the variable B. And each variable A
X and A + Y and B for weighting B and B
(X and Y are weighting coefficients) are stored in the variable C. In this embodiment, the variable C is used as velocity data. Next, in step SC14, the variable C as the velocity data, the key code KCD (max) by the left glove described later, and the key-on signal are supplied to the sound source 7. The sound source 7 synthesizes a musical tone signal based on these parameters and supplies the musical tone signal to the sound system 8. In the sound system 8, after converting the musical tone signal into an analog signal, the speaker produces a sound. Then, the process proceeds to step SC12, the finger number of the above condition is stored in the variable max, the process is ended, and the process returns to the main routine.

In the main routine, the process then proceeds to the left hand detection processing routine of step SB4 shown in FIG. [Left hand detection processing routine] In the left hand detection processing routine,
First, in step SE1, the bending angle FD (i)
The bending data of each finger of the left hand is taken in (i = 1, 3, 5, 7, 9). Next, in step SE2, the bending amount of each finger is compared with the threshold value of each finger. If the bending amount exceeds the threshold value, it is determined that the finger is bent and the finger-on data FON is determined.
Store "1" in (i). If the threshold value is not exceeded, it is determined that the finger is not bent and "0" is set.
Is stored. Next, in step SE3, the pitch of the musical tone played with the right hand is calculated according to the combination of the finger-on data FON (i). Here, a method of calculating the pitch will be described. In this embodiment, three tables shown in FIGS. 8A, 8B and 8C are prepared for pitch calculation. FIG. 8A is a scale designation data table for each finger of the right hand for the finger on data FON (1) of the left thumb. "0" of finger on data FON (1)
, The right thumb (i = 0) was “0”, the index finger (i = 2) was “2”, the middle finger (i = 4) was “4”, and the ring finger (i = 6) was “5”. And scale designation data FN0 (i) of "7" is stored in the little finger (i = 8).

Also, the finger-on data FON (1) is "1".
For the right thumb (i = 0) "5", index finger (i = 2) "7", middle finger (i = 4) "9", ring finger (i = 6) "11" And "12" on the little finger (i = 8)
The scale designation data FN1 (i) is stored.
That is, when the thumb of the left hand is not bent, each finger of the right hand has “0 (do)”, “2 (re)”,
“4 (Mi)”, “5 (Fa)” and “7 (So)” are assigned. On the other hand, when the thumb of the left hand is bent, each finger of the right hand has “5” or “7”.
(So) ”,“ 9 (la) ”,“ 11 (si) ”and“ 12 ”
(D) ”is assigned. Further, FIG. 8B shows finger-on data FON (3) and FON (5) of the index finger of the left hand.
It is an octave specification data table by the combination of. Data OCT that specifies the octave of the musical sound to be produced according to the combination of FON (3) and FON (5)
Are stored, and “4”, “6”, and “7” are stored for FON (2) and FON (3) with “0” and “0” as reference “5”, respectively.

That is, when the index finger and the middle finger of the left hand are not bent, the octave designation data is set to "5" and is used as a reference. If the index finger of the left hand is not bent and the middle finger is bent, the octave designation data is set to "4", and the octave is lowered by one octave with respect to the above case. Further, FIG. 8C is a semitone (#b) designation data table obtained by combining the finger on data FON (7) of the left ring finger and the finger on data FON (9) of the left little finger. FON
Semitone data HT designating a semitone of a musical tone to be produced according to a combination of (7) and FON (9) is stored, and FON (7) and FON (9) are based on "0" and "0". As "± 0 (natural)", "-1"
(Flat), "+1 (sharp)" and "± 0
(Natural) "is stored. That is, the generated musical tone is controlled to be raised by a semitone or lowered by a semitone, depending on the bending state of the ring finger and little finger of the left hand.

In step SE3 described above, the pitch of the musical tone is calculated according to the following equation using the data in these tables. When the finger-on data FON (1) is “0”, KCD (i) = FN0 (i) + (12 × OCT) + HT, and when the finger-on data FON (1) is “1”, KCD (i) = FN1 (i) + (12 × OCT) + HT. When the above process ends, the process is ended and the process returns to the main routine. In the main routine, the process proceeds to step SB5 to perform other processes in accordance with the tone color switching by the function switch and the like, and then returns to step SB2 to repeatedly execute the above-described processes. As mentioned above,
According to the present invention, the musical sound is controlled according to the time from the start to the end of the operation, the amount of operation, and the like, which are less affected by the drift of the bending detector output.

In the right hand detection processing routine, the method of calculating the velocity data C has been described. However, other than this, the time from the start of bending to the stop of bending may be taken into consideration. In this case, for example, instead of the velocity data C,
Bending start time IT from time TIME as time data D
A value obtained by subtracting D (max) may be used to generate a fast rising (sharp) musical tone when the time data D is small. In addition to the maximum speed MSP (max), the second fastest data, the third fastest data may be used instead, or their average value may be used.

[0026]

As described above, according to the present invention, the motion detecting means detects a motion of a part of the player's body, and based on the output of the motion detecting means, the start timing of the above motion is started. And the end time of the operation is detected by the timing detection means, and further, based on the output of the timing detection means,
After the time and the amount of movement between the operation start timing and the operation end timing are detected by the parameter detection means, the musical sound is controlled based on at least one of the values of the above-mentioned time and movement amount. The advantage is that it is less susceptible to changes in the output of the bending angle detector.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an exemplary embodiment of the present invention.

FIG. 2 is a conceptual diagram showing a configuration of an input means shown in FIG.

FIG. 3 is a flowchart showing the overall processing of this embodiment.

FIG. 4 is a flowchart showing a main routine for explaining a detailed operation of this embodiment.

FIG. 5 is a flowchart showing a right hand detection processing routine for explaining the operation of the embodiment.

FIG. 6 is a flowchart showing an interrupt routine by a timer interrupt of the embodiment.

FIG. 7 is a flowchart showing a left hand detection processing routine of the embodiment.

FIG. 8A is a scale designation data table for each finger of the right hand with respect to finger on data FON (i), and FIG. 8B is an octave designation data table based on a combination of finger on data FON (2) and FON (3). (C) is a figure which shows the semitone (#b) designation | designated data table by the combination of finger on data FON (4) and FON (5).

[Explanation of symbols]

1 ... Input glove (motion detecting means), 4 ... Microcomputer (timing detecting means, parameter detecting means), 7 ... Sound source circuit (musical sound synthesizing means).

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI technical display location // G01B 7/00 L 9106-2F 7/28 D 9106-2F

Claims (1)

[Claims] 1. A motion detecting means for detecting a motion of a part of a player's body, and a timing detecting means for detecting a start timing of the motion and an end timing of the motion based on an output of the motion detecting means. Controlling a musical sound based on at least one of the time and the movement amount, and a parameter detection means for detecting a time and a movement amount between the operation start timing and the operation end timing. A tone control device characterized by.