JP5029770B2 - Performance support information generation apparatus and performance support information generation program - Google Patents

Description

  The present invention relates to a performance support information generation apparatus and a performance support information generation program suitable for use in an electronic musical instrument.

  Conventionally, an apparatus for generating information for supporting a performance operation is known. As an apparatus of this type, for example, in Patent Document 1, data indicating the posture (posture) of the hand operating the keyboard is generated from fingering information indicating which key should be pressed with which finger, and the key operation is practiced. What is supported is disclosed. Patent Document 2 also reads out song data including the pitch of each tone constituting a song and fingering data representing the finger that plays each tone from the memory, and corresponds to the pitch in the read song data. When the fingering data to be performed is a fingering for instructing a finger change, a method for generating a fingering image for instructing the finger change and instructing a fingering method is disclosed.

JP 2004-177546 A JP 2004-205791 A

  By the way, novice users who are unfamiliar with keyboard operation may not know where to put a finger that will not be pressed before that, as well as the position and posture of the hand when pressing the key, or how to change the finger. Many. Therefore, as in the techniques disclosed in Patent Documents 1 and 2, even if the user is instructed about the position and posture of the hand at the time of key pressing or the way of changing the finger, It is necessary to prepare for the key operation at a proper position with the finger that does not. In other words, in the techniques disclosed in Patent Documents 1 and 2, there arises a problem that it is impossible to teach where to place a finger that is not pressed.

  The present invention has been made in view of such circumstances, and provides a performance support information generation apparatus and a performance support information generation program capable of teaching a position where a finger not to be depressed should be placed. The purpose is that.

In order to achieve the above object, in the invention described in claim 1, song data storage means for storing song data representing at least each sound constituting a song and a finger playing each sound, and
The music data for each sound is read from the music data storage means, and the key-pressing finger position coordinates representing the position of the finger pressing the sound of the read music data are generated, and the sound of the read music data is a chord. If configured, key press information indicating whether or not each finger assigned to other chord constituent sounds other than the music data sound is in a key pressing state, and the position of each finger pressing the chord constituent sounds A key pressing finger position generating means for generating a chord key pressing finger position coordinate representing
The tune data for each sound is read from the tune data storage means, and when the tune data is composed of a finger for squeezing the sound of the read tune data and the tune data sounds constitute a chord, A no-pressing finger position generating means for generating a no-pressing finger position coordinate representing a finger position excluding the representing finger ;
Music data with reference to the key-pressing finger position coordinates and chord key-pressing finger position coordinates generated by the key-pressing finger position generating means, and the non-pressing key position coordinates generated by the non-pressing finger position generating means Finger position display means for displaying on the display unit a change in the position of each finger when playing the keyboard as a graph with the horizontal axis as the performance time starting from the performance start point and the vertical axis as the keyboard coordinates. And

In the invention according to claim 2 dependent on claim 1, hand position coordinates representing the position of the hand are generated from a position range that can be taken by all fingers from the thumb to the little finger with respect to the sound of the read music data. And a hand position display means for displaying a change in hand position when playing music data with reference to the hand position coordinates generated by the hand position generating means. To do.

In the invention according to claim 3, a computer having song data storage means for storing at least each song constituting the song and song data representing a finger playing each of the sounds,
A reading process of reading out song data for each sound from the song data storage means;
When the keying finger position coordinates representing the position of the finger pressing the key of the music data read out by the reading process are generated and the sound of the read music data constitutes a chord, the sound of the music data is excluded Generates key press information indicating whether or not each finger assigned to another chord constituent sound is in a key press state, and chord key press finger position coordinates indicating the position of each finger pressing the chord constituent sound Key finger position generation processing to be registered in the song data,
No key depression that represents the position of the finger excluding the finger that depresses the sound of the song data read out by the readout process and the key depression information when the sound of the song data constitutes a chord. Non-pressing key finger position generation processing for generating finger position coordinates;
Music data with reference to the key pressing finger position coordinates and chord key pressing finger position coordinates generated by the key pressing finger position generation process and the no key pressing finger position coordinates generated by the no key pressing finger position generation process A finger position display process for displaying a change in the position of each finger when playing the keyboard on the display unit as a graph with the horizontal axis as the starting time and the vertical axis as the keyboard coordinates. And

In the invention according to claim 4 , which is dependent on claim 3 , the hand position coordinates representing the position of the hand are generated from the position range that can be taken by all fingers from the thumb to the little finger with respect to the sound of the read music data. And a hand position display process for displaying a change in the hand position when playing music data with reference to the hand position coordinates generated by the hand position generation process. And

  In the present invention, at least the music constituting the music and the music data representing the fingers playing those sounds are read for each sound, and the keying finger position coordinates representing the position of the finger that presses the sound of the read music data are obtained. Generated and registered in the corresponding song data, and the keyless finger position coordinates indicating the position of the finger that does not press the sound of the read song data, and the thumb to the little finger with respect to the sound of the read song data Hand position coordinates representing the position of the hand are generated from the position range that can be taken by all fingers and registered in the corresponding music data. And since the position change of the hand and each finger when playing the song data is displayed with reference to the key-pressing finger position coordinates, the no-pressing finger position coordinates and the hand position coordinates registered in the music data, no key pressing is performed. You can teach where to put your finger.

It is a block diagram which shows the structure of one Embodiment by this invention. It is a figure which shows the data structure of music data ME. It is a flowchart which shows operation | movement of a performance assistance process. It is a flowchart which shows the operation | movement of the coordinate setting process of the finger to press a key. It is a flowchart which shows the operation | movement of the coordinate setting process of the finger to press a key. It is a flowchart which shows the operation | movement of the coordinate setting process of the finger | toe which does not press a key. It is a flowchart which shows the operation | movement of a coordinate candidate acquisition process. It is a flowchart which shows the operation | movement of coordinate acquisition [1] process. It is a flowchart which shows the operation | movement of coordinate acquisition [2] process. It is a flowchart which shows the operation | movement of a coordinate determination process. It is a figure for demonstrating an example of operation | movement of a performance assistance process. It is a figure for demonstrating an example of operation | movement of a performance assistance process.

Embodiments of the present invention will be described below with reference to the drawings.
A. Constitution
(1) Overall configuration
FIG. 1 is a block diagram showing the overall configuration of an electronic musical instrument equipped with a performance support information generating apparatus according to the present invention. In this figure, the keyboard 10 generates performance information such as key-on / key-off events, key numbers, and velocities in response to key press / release operations (performance operations). The switch unit 11 has various operation switches arranged on the musical instrument panel, and generates a switch event corresponding to a switch type operated by the user. As main switches arranged in the switch unit 11, for example, there are a power switch for turning on / off power, a music selection switch for selecting music data, a mode switch for setting an operation mode, and the like. In the present embodiment, a performance mode or a performance support information generation mode is set by a mode switch operation.

  The display unit 12 is composed of an LCD panel or the like, and displays an operation mode and various setting states of the entire musical instrument in accordance with a display control signal supplied from the CPU 13. Specifically, when the performance support information generation mode is set, the CPU 13 performs a performance support process to be described later, thereby graphing the positions of hands and fingers when playing the sounds constituting the music. The screen is displayed on the display unit 12.

  The CPU 13 controls each part of the musical instrument in an operation mode set by a mode switch operation. Specifically, when the performance mode is set, the CPU 13 generates various musical sound parameters (note on / note off, etc.) corresponding to the performance information output from the keyboard 10 in response to the key release operation. The tone generator 16 is supplied to the tone generator 16 to instruct the generation of musical sounds. On the other hand, when the performance support information generation mode is set, the CPU 13 executes performance support processing described later, generates performance support information based on the song data selected by the song selection switch operation, and generates the generated performance support information. Based on the above, the positions of the hands and fingers during performance are graphed and displayed on the display unit 12 on the screen.

  The ROM 14 stores various control programs loaded on the CPU 13. The various control programs include performance support processing described later. The RAM 15 includes a work area and a data area. In the work area of the RAM 15, various register / flag data used for the processing of the CPU 13 are temporarily stored. The data area of the RAM 15 stores music data of a plurality of songs, and the data structure will be described later.

  The sound source 16 is configured by a well-known waveform memory reading method and includes a plurality of sound generation channels that perform time-division operation. This sound source 16 stores waveform data of various timbres, and among these, reads out waveform data corresponding to a musical tone parameter supplied from the CPU 13 to generate a musical tone waveform. The sound system 17 converts the musical sound waveform output from the sound source 16 into an analog musical tone signal, and then performs filtering such as removing unnecessary noise from the musical tone signal, and then amplifies the level to generate sound from the speaker.

(2) Configuration of Song Data FIG. 2 is a diagram showing the configuration of song data stored in the data area of the RAM 15. One song is expressed in a so-called MIDI format, and is composed of song data ME [0] to ME [N] corresponding to each sound constituting the song. One piece of music data ME includes sound generation start time lTime, sound generation time (sound length) lGate, sound generation start time (absolute time) lTimsec, pitch (pitch) pitch, keyboard coordinates iPos, chord flag clsHarm, pointer pHTop, pointer pHtail, pointer pPHTop, pointer pPHTail, pointer pNHTop, pointer pNHTail, and fingering cfig. Further, the music data ME includes a key depression flag iFigOn [1] to [5] that indicates the presence / absence of key depression for each finger, coordinates sfigPos [1] to [5] that represent the position of each finger, and hand position coordinates. sHandPos is generated and registered by a performance support process described later. In addition, the place where each said data which comprises music data ME intends is described with description of the operation | movement mentioned later.

B. Operation Next, the operation of the performance support process executed by the CPU 13 in the embodiment having the above-described configuration will be described with reference to FIGS.

(1) Performance Support Processing Operation When the performance support information generation mode is set in response to the mode switch operation after power-on, the CPU 13 executes the performance support processing shown in FIG. 3 and proceeds to step SA1. . In step SA1, song data ME [0] to ME [N] selected by the song selection switch operation are read from the data area of the RAM 15 and developed in the work area.

  Subsequently, in step SA2, a coordinate setting process for a finger to be pressed is executed. In this process, as will be described later, for each piece of music data ME [me] specified by the pointer me, the key position (keyboard coordinates me.iPos) is changed to the position coordinates me. If it is registered as sfigPos [ifig], or the music data ME [me] is a chord constituent sound, the key pressing of each finger assigned to the other chord constituent sounds (key pressing flag iFigOn [cfigE] = 1) and The keyboard coordinates (coordinate me.sigPos [cfigE]) to be pressed by each finger are registered.

  Next, in step SA3, a coordinate setting process for a finger not to be depressed is executed. In this process, as will be described later, for each piece of music data ME [me] designated by the pointer me, the coordinate position me. In addition to registering sfigPos [ifig], register the hand position coordinate sHandPos obtained from the average value (sfMax + sfMin) / 2 of the maximum finger coordinate sfMax and the minimum finger coordinate sfMin that can be taken by all fingers from the thumb to the little finger.

  In step SA4, the position coordinates me. Of the key to be pressed me. Registered for each piece of music data ME [me] specified by the pointer me in steps SA2 to SA3. sigPos [ifig], coordinate position me. Based on sfigPos [ifig] and hand position coordinates sHandPos, the position change of the hand and each finger when playing each piece of music data ME [0] to [N] is graphed and displayed on the display unit 12. As a result, it is possible to teach where to place a finger that is not pressed.

(2) Operation of the coordinate setting process for the finger to be pressed Next, the operation of the coordinate setting process for the finger to be pressed will be described with reference to FIGS. When this process is executed through step SA2 (see FIG. 3) of the performance support process described above, the CPU 13 proceeds to step SB1 shown in FIG. 4 and sets an address for specifying the head song data ME [0]. Store to pointer me. Next, in step SB2, it is determined whether or not the incremented pointer me is “NULL”, that is, whether or not all the music data ME has been processed. If the incremented pointer me is not “NULL” and all the music data ME has been processed, the determination result is “NO”, and the process proceeds to step SB3.

  In step SB3, an initial value “1” is set to a pointer ifig for designating each finger of the right hand playing the melody part. The pointer ifig designates the thumb when “1”, the index finger when “2”, the middle finger when “3”, the ring finger when “4”, and the little finger when “5”. Therefore, in step SB3, the thumb is first designated. Next, in step SB4, it is determined whether or not the pointer ifig is smaller than “6”, that is, whether or not all the fingers from the thumb to the little finger have been processed. If processing has not been completed for all fingers, the determination result is “NO”, and the flow proceeds to step SB5.

  In step SB5, the pointer ifig matches the fingering cfig (me.cfig) in the music data ME [me] specified by the pointer me, that is, the finger currently specified by the pointer ifig is the fingering me. It is determined whether or not it matches the finger number of the finger to be pressed represented by cfig. If the currently designated finger is not a finger to be pressed, the determination result is “NO”, the process proceeds to step SB6, the pointer ifig is incremented, and the process is returned to step SB4.

  If the value of the incremented pointer ifig is smaller than “6” and processing has not been completed for all the fingers from the thumb to the little finger, the determination result in step SB4 becomes “NO” again, and the process returns to step SB5. move on. In step SB5, when the incremented pointer ifig matches the fingering cfig and the currently designated finger becomes the finger to be depressed, the determination result is “YES”, and the flow proceeds to step SB7.

  In step SB7, the keyboard coordinates me. In the music data ME [me] designated by the pointer me. iPos is changed to finger coordinates me. Register in sfigPos [ifig]. Here, the keyboard coordinates me. iPos represents the position of the key corresponding to the pitch Pitch (pitch) of the music data ME [me]. Therefore, in this step SB7, the position of the key to be pressed is registered as the position of the finger pressing the sound of the music data ME [me].

  Subsequently, the process proceeds to step SB8 shown in FIG. 5, and the chord flag me. It is determined whether or not clsHarm is greater than “0”. Chord flag me. clsHarm is a flag that indicates whether or not the sound of the music data ME [me] is a chord. When it is “0”, it represents a non-chord, and when it is “1”, it represents a chord.

  Therefore, in this step SB8, it is determined whether or not the sound of the music data ME [me] is a chord. If the sound of the song data ME [me] is a non-chord, the determination result is “NO”, the process proceeds to step SB14 shown in FIG. 4, and the next song data ME [me. After updating the pointer me so as to designate “next], the process is returned to step SB2.

  On the other hand, if the sound of the music data ME [me] is a chord, the determination result in step SB8 is “YES”, and the flow advances to next Step SB9. In step SB9, pointer me. In music data ME [me] designated by pointer me. pHTop is stored in the pointer mee. Here, the pointer me. pHTop designates the music data ME of the chord constituent sound (hereinafter referred to as the lowest sound) having the lowest pitch among the chords including the music data ME [me]. Next, in step SB10, the fingering mee.in the music data ME [mee] designated by the pointer mee. cfig is stored in register cfigE. That is, the register cfigE stores a fingering number representing a finger that presses the lowest sound.

  In step SB11, among the key pressing flags iFigOn [1] to [5] in the music data ME [me] specified by the pointer me, the finger pressing specified by the fingering number stored in the register cfigE is performed. “1” is set to the key flag iFigOn [cfigE]. As a result, the key depression of the finger assigned to the lowest sound is registered in the music data ME [me].

  In step SB11, the keyboard coordinates mee.in the music data ME [mee] designated by the pointer mee. iPos is set to coordinates me. in the music data ME [me] specified by the pointer me. Store in sfigPos [cfigE]. As a result, the keyboard coordinates of the lowest note are set to the finger coordinates me. Designated by the fingering number stored in the register cfigE. It is registered in the music data ME [me] as sfigPos [cfigE].

  Next, in step SB12, the pointer mee and the pointer me. In the music piece data ME [me] specified by the pointer me. It is determined whether or not pHTail matches. Here, the pointer me. pHTail designates music data ME of a chord constituent sound (hereinafter referred to as the highest sound) having the highest pitch among the chords including the music data ME [me].

  Accordingly, in this step SB12, it is determined whether or not the processing in step SB11 has been performed for each chord constituent sound from the lowest sound to the highest sound. That is, whether or not the key depression of each finger assigned to each chord component sound from the lowest tone to the highest tone and the keyboard coordinates to be depressed by each finger have been registered in the music data ME [me]. to decide. If registration has not been completed, the determination result is “NO”, and the flow advances to next Step SB13.

  In step SB13, the pointer me is updated so as to designate the chord constituent sound having the next lowest pitch among the chords including the music data ME [me], and the process is then returned to step SB10. . Thereafter, steps SB10 to SB13 are repeated until the highest sound is reached.

  Thus, when the key depression of each finger assigned to each chord constituent sound from the lowest tone to the highest tone and the keyboard coordinates to be depressed by each finger are registered in the music data ME [me], the above steps The determination result of SB12 is “YES”, and the process proceeds to step SB14 shown in FIG. After updating the pointer me so as to designate “next], the process is returned to step SB2. Thereafter, the above-described step SB2 and subsequent steps are repeated, and when all the music data ME [0] to [N] have been processed, the determination result in step SB2 is “YES”, and this processing is completed.

  As described above, in the coordinate setting process of the finger to be pressed, the key position (keyboard coordinate me.iPos) in the music data ME [me] designated by the incremented pointer me is used as the position of the finger to be pressed. It is registered as (finger coordinate me.sigPos [ifig]). Further, if the music data ME [me] is a chord, each finger pressing (key pressing flag iFigOn [cfigE] = 1) assigned to the lowest to highest tone of the chord component and each finger The keyboard coordinates (coordinate me.sfigPos [cfigE]) to be pressed by the key are registered.

(3) Operation of Finger Coordinate Setting Process without Key Pressing Next, with reference to FIG. 6, an operation of finger coordinate setting processing without key pressing will be described. When this process is executed through step SA3 (see FIG. 3) of the performance support process described above, the CPU 13 proceeds to step SC1 shown in FIG. 6, and sets an address for specifying the head song data ME [0]. Store to pointer me. Next, in step SC2, it is determined whether or not the incremented pointer me is “NULL”, that is, whether or not all the music data ME has been processed. If the incremented pointer me is not “NULL” and all the music data ME has been processed, the determination result is “NO”, and the process proceeds to step SC3.

  In step SC3, an initial value “1” is set to a pointer ifig for designating each finger of the right hand playing the melody part. The pointer ifig designates the thumb when “1”, the index finger when “2”, the middle finger when “3”, the ring finger when “4”, and the little finger when “5”. Therefore, in step SC3, the thumb is first designated. Next, in step SC4, it is determined whether or not the pointer ifig is smaller than “6”, that is, whether or not all the fingers from the thumb to the little finger have been processed. If all the fingers have not been processed, the determination result is “NO”, and the flow proceeds to step SC5.

  In step SC5, in the music data ME [me] specified by the pointer me, the key pressing flag iFigOn [ifig] of the finger specified by the pointer ifig is “0”, that is, the currently specified finger is pressed. Judge whether there is no. When the currently designated finger is depressed (key depression flag iFigOn [ifig] = 1), the determination result is “NO”, and the process proceeds to Step SC10 described later.

  On the other hand, if the currently designated finger is not depressed, the determination result in step SC5 is “YES”, and the flow advances to step SC6. In step SC6, coordinate candidate acquisition processing is executed. As will be described later, in the coordinate candidate acquisition process, the coordinate candidate of the finger not to be pressed extracted in step SC5 is acquired. When the finger of the finger number above the finger not to be pressed is pressed, The coordinate correction value determined according to the difference between the finger number of the finger to be depressed and the finger number of the finger not to be depressed is subtracted from the coordinate (me.sigPos [ifg]) representing the position of the finger to be depressed, and the key is depressed. A finger coordinate candidate sfigH is calculated. On the other hand, when a finger with a lower finger number than the finger that does not press the key is pressed, a coordinate correction value determined according to the difference between the finger number of the finger that is pressed and the finger number of the finger that is not pressed is Is added to the coordinates (me.sfigPos [ifg]) representing the position of the finger to be played, and a coordinate candidate sfigL of the finger not to be depressed is calculated.

  Next, in step SC7, coordinate acquisition [1] processing is executed. As will be described later, in the coordinate acquisition [1] process, the sound existing before the sound of the music data ME [me] specified by the pointer me has the same fingering as the non-key-pressed finger specified by the pointer ifig. The sound (music data ME [mep]) is searched, and if the corresponding sound exists, the position coordinates sfigP and the key pressing time lTfigP of the finger that pressed the sound are extracted.

  Subsequently, in step SC8, coordinate acquisition [2] processing is executed. As will be described later, in the coordinate acquisition [2] process, in the coordinate acquisition [2] process, in the sound existing after the sound of the music data ME [me] specified by the pointer me, the key depression specified by the pointer ifig is performed. A sound having the same fingering as the finger that does not play (music data ME [men]) is searched, and if there is a corresponding sound, the position coordinates sfigN and the key pressing time lTfigN of the finger that presses the sound are extracted.

  In step SC9, coordinate determination processing is executed. As will be described later, in the coordinate determination process, the finger coordinate candidates sfigH and sigL obtained in the coordinate candidate acquisition process in step SC6, and the finger position coordinates sfigP obtained in the coordinate acquisition [1] process in step SC7, In consideration of the key pressing time lTfigP, the finger position coordinates sfigN obtained by the coordinate acquisition [2] process of step SC8, and the key pressing time lTfigN, the pointer ifig in the music data ME [me] specified by the pointer me The coordinate position me. Register sfigPos [ifig].

  Next, in step SC10, the finger coordinate position me. If sfigPos [ifig] is larger than the maximum finger coordinate sfMax, it is updated as the maximum finger coordinate sfMax, or the finger coordinate position me. If sfigPos [ifig] is smaller than the minimum finger coordinate sfMin, it is newly updated as the minimum finger coordinate sfMin. In step SC11, the pointer ifig is incremented to designate the next finger, and then the process returns to step SC4.

  Thereafter, the above-described steps SC4 to SC11 are repeated until the stepped pointer ifig reaches “6”, that is, until all the fingers from the thumb to the little finger have been processed, and the music data ME [me ] In the coordinate position me. sfigPos [ifig] is registered, and the maximum finger coordinate sfMax and the minimum finger coordinate sfMin that can be taken by all fingers from the thumb to the little finger are detected. When all the fingers from the thumb to the little finger have been processed, the determination result in step SC4 described above is “YES”, and the flow proceeds to step SC12.

  In step SC12, the song data specified by the pointer me is updated in step SC10 and the average value (sfMax + sfMin) / 2 of the maximum finger coordinate sfMax and the minimum finger coordinate sfMin that can be taken by all the fingers from the thumb to the little finger. Register as hand position coordinates sHandPos in ME [me]. Subsequently, the process proceeds to step SC13, and the next song data ME [me. After updating the pointer me so as to designate “next], the process returns to the above-described step SC2. When the above-described processing is completed for all the music data ME, the determination result in step SC2 is “YES”, and this processing is completed.

  As described above, in the coordinate setting process of the finger not to be depressed, the coordinate position me. Of the finger not to be depressed is set in the music data ME [me] designated by the incremented pointer me. In addition to registering sfigPos [ifig], an average value (sfMax + sfMin) / 2 of the maximum finger coordinate sfMax and the minimum finger coordinate sfMin that can be taken by all fingers from the thumb to the little finger is registered as the hand position coordinate sHandPos.

(4) Operation of Coordinate Candidate Acquisition Process Next, the operation of the coordinate candidate acquisition process will be described with reference to FIG. When this process is executed via the above-described step SC6 (see FIG. 6), the CPU 13 proceeds to step SD1 shown in FIG. 7, and increments the finger number of the pointer ifig and stores it in the register ifg. The value of the register ifg is referred to as a search pointer ifg.

  Subsequently, in step SD2, it is determined whether or not the search pointer ifg is smaller than “6”. If the search pointer ifg is smaller than “6”, the determination result is “YES”, and the flow proceeds to step SD3. In step SD3, in the music data ME [me] designated by the pointer me, the finger pressing flag iFigOn [ifig] designated by the search pointer ifg is “1”, that is, the finger designated by the search pointer ifg. Determine if the key is pressed. If the finger specified by the search pointer ifg is not depressed, the determination result is “NO”, the process proceeds to step SD4, the search pointer ifg is incremented, and the process returns to step SD2.

  As described above, in steps SD1 to SD4, for example, in the above-described “coordinate setting processing of a finger not to be depressed”, if the finger not to be depressed designated by the pointer ifig is “middle finger (finger number: 3)”, The finger to be pressed is searched from “ring finger (finger number: 4)” and “little finger (finger number: 5)” designated according to the search pointer ifg to be advanced. If there is no finger to press, the determination result in step SD2 is “NO”, and the process proceeds to step SD6 described later.

  On the other hand, when a finger to press the key is found, the determination result in step SD3 is “YES”, and the process proceeds to step SD5. In step SD5, in the music data ME [me] to be processed in the above-mentioned “coordinate setting process of finger not to be pressed”, coordinates (me. Me) that are designated by the search pointer ifg and indicate the position of the finger to be pressed. The coordinate correction value 2 × (ifg−ifig) is subtracted from sfigPos [ifg]) to calculate a coordinate candidate sfigH of the finger not to be pressed designated by the pointer ifig. The coordinate correction value 2 × (ifg−ifig) is a value obtained by converting the difference between the finger number ifg of the finger to be depressed and the finger number ifig of the finger not to be depressed into the number of white keys. In keyboard coordinates, one white key corresponds to “2”.

  For example, when the finger that is not pressed by the pointer ifig is “middle finger (finger number: 3)” and the finger that is pressed by the search pointer ifg is “little finger (finger number: 5)” The coordinate correction value is 2 × (5-3) = 4. Therefore, the coordinate value obtained by subtracting the coordinate correction value “4” from the coordinate (me.sfigPos [ifg]) representing the position of the finger to be depressed, that is, the coordinate (me.sfigPos [ifg]) representing the position of the finger to be depressed. The coordinates that are two white keys lower than the white key are the coordinate candidates sfigH of the finger that is not pressed, designated by the pointer ifig.

  Next, in step SD6, the search pointer ifg is decremented. Subsequently, in step SD7, it is determined whether or not the value of the decremented search pointer ifg is “0” or more. If the search pointer ifg is greater than or equal to “0”, the determination result is “YES”, and the flow proceeds to step SD8. In step SD8, in the music data ME [me] designated by the pointer me, the finger pressing flag iFigOn [ifig] designated by the search pointer ifg is “1”, that is, the finger designated by the search pointer ifg. Determine if the key is pressed. If the finger specified by the search pointer ifg is not depressed, the determination result is “NO”, the process proceeds to step SD9, the search pointer ifg is decremented, and the process returns to step SD7 described above.

  As described above, in steps SD6 to SD9, for example, in the above-described “coordinate setting processing of the finger not to be depressed”, if the finger not to be depressed designated by the pointer ifig is “middle finger (finger number: 3)”, The finger to be pressed is searched from “index finger (finger number: 2)” and “thumb (finger number: 1)” designated according to the search pointer ifg to be decremented. If there is no finger to press the key, the determination result in step SD7 is “NO”, and this process is completed.

  On the other hand, if a finger to be pressed is found, the determination result in step SD8 is “YES”, and the process proceeds to step SD10. In step SD10, in the music data ME [me] to be processed in the above-described “coordinate setting process of finger not to be pressed”, the coordinates (me. The coordinate correction value 2 × (ifg−ifig) is subtracted from sfigPos [ifg]) to calculate the coordinate candidate sfigl of the finger not to be pressed designated by the pointer ifig, and this processing is completed.

  For example, when the finger not to be pressed designated by the pointer ifig is “middle finger (finger number: 3)” and the finger to be pushed designated by the search pointer ifg is “thumb (finger number: 1)” The coordinate correction value is 2 × (1-3) = − 4. Therefore, the coordinate value obtained by adding the coordinate correction value “4” to the coordinates (me.sigPos [ifg]) representing the position of the finger to be depressed, that is, the coordinates representing the position of the finger to be depressed (me.sfigPos [ifg]). The coordinate that is two white keys higher than the white key becomes the coordinate candidate sfigL of the finger that is not pressed, designated by the pointer ifig.

  As described above, in the coordinate candidate acquisition process, the coordinate candidate of the finger not to be pressed specified by the pointer ifig is acquired in the music data ME [me] to be processed in the “coordinate setting process of the finger not to be pressed”. When the finger of the finger number above the finger that does not press the key presses, the coordinate correction value determined according to the difference between the finger number of the finger that presses the key and the finger number of the finger that does not press the key, By subtracting from the coordinates (me.sfigPos [ifg]) representing the position of the finger to be depressed, the coordinate candidate sfigH of the finger not depressed is calculated. On the other hand, the finger having the lower finger number than the finger not depressed is depressed. When the key is pressed, a coordinate correction value determined according to the difference between the finger number of the finger to be pressed and the finger number of the finger not to be pressed is added to the coordinates (me.sfigPos [ifg]) representing the position of the key to be pressed. And finger coordinate candidate sfi To calculate the L.

(5) Operation of Coordinate Acquisition [1] Process Next, the operation of the coordinate acquisition [1] process will be described with reference to FIG. When this processing is executed via step SC7 (see FIG. 6) of the above “coordinate setting processing of finger not to be pressed”, the CPU 13 proceeds to step SE1 shown in FIG. Pointer me. In data ME [me]. Set pPHTail to the pointer mep. Pointer me. pPHTail is a pointer to the end (topmost sound) of the chord group of the sound string group before the sound of the music data ME [me] specified by the pointer me. A pointer to the sound itself. That is, it is a pointer that points to the sound immediately before ME [me].

  Subsequently, in step SE2, the sound generation start time me. In the music data ME [me] designated by the pointer me. lTimsec. Sound generation start time mep. in the music data ME [mep] specified by the pointer mep. It is determined whether or not the time difference obtained by subtracting lTimsec is smaller than a predetermined value ForecastTime. That is, it is determined whether or not the sound immediately before the music data ME [me] is within a range that is a predetermined value FocusTime earlier than the current time (sounding start time me.lTimsec).

  If the sound immediately before the music data ME [me] is within a range that is a predetermined value FocusTime earlier than the current time (sound generation start time me.lTimsec), the determination result in step SE2 is “YES”. The process proceeds to step SE3. In step SE3, the fingering mep. In the music data ME [mep] specified by the pointer mep. It is determined whether or not cfig matches the finger not pressed by the pointer ifig. If they do not match, the determination result is “NO”, and the flow proceeds to step SE4. In step SE4, the pointer mep is updated so as to specify the previous sound, and then the process returns to step SE2.

  Thereafter, Steps SE2 to SE4 are repeated to have the same fingering as the non-key-pressed finger designated by the pointer ifig within a range that is a predetermined value FocusTime from the current time (sounding start time me.lTimsec). Search for sounds that exist before the sound of [me]. If the corresponding sound is not found, the determination result in step SE2 is “NO”, and this process is finished. However, if the corresponding sound is found, the determination result in step SE3 is “YES”. Proceed to SE5.

  In step SE5, in the music data ME [mep] (corresponding sound) designated by the pointer mep, the coordinate mep. Of the finger designated by the pointer ifig. sfigPos [ifig] is stored in the register sfigP, and the sound generation start time mep. of the music data ME [mep] is stored. lTimsec is stored in the register lTfigP.

  As described above, in the coordinate acquisition [1] process, in the sound existing before the music data ME [me], the sound having the same fingering as the non-keyed finger specified by the pointer ifig (music data ME [mep ]) Is found, and if there is a corresponding sound, the position coordinates sfigP and the key pressing time lTfigP of the finger that pressed the sound are extracted.

(6) Operation of Coordinate Acquisition [2] Process Next, the operation of the coordinate acquisition [2] process will be described with reference to FIG. When this processing is executed via step SC8 (see FIG. 6) of the above “coordinate setting processing of finger not to be pressed”, the CPU 13 proceeds to step SF1 shown in FIG. Pointer me. In data ME [me]. pNTop is set to the pointer men. Pointer me. pNTop is a pointer to the head (bottom sound) of the chord of the tone string group after the sound of the music data ME [me] specified by the pointer me. If the tone string group is a single note, A pointer to the sound itself. That is, it is a pointer that points to the sound immediately after ME [me].

  Subsequently, in step SF2, the sound generation start time me. In the music data ME [me] designated by the pointer me. lTimsec, the sound generation start time mep. in the music data ME [men] specified by the pointer men. It is determined whether or not the time difference obtained by subtracting lTimsec is smaller than a predetermined value ForecastTime. That is, it is determined whether or not the sound immediately after the music data ME [me] is within a range in which the predetermined value FocusTime has elapsed from the current time (sound generation start time me.lTimsec).

  If the sound immediately after the song data ME [me] is within a range in which a predetermined value FocusTime has elapsed from the current time (sounding start time me.lTimsec), the determination result in step SF2 is “YES”. The process proceeds to step SF3. In step SF3, the fingering men. In the music data ME [men] designated by the pointer men. It is determined whether or not cfig matches the finger not pressed by the pointer ifig. If they do not match, the determination result is “NO”, and the process proceeds to Step SF4. In step SF4, the pointer men is updated so as to designate the next subsequent sound, and then the process returns to step SF2.

  Thereafter, steps SF2 to SF4 are repeated and the same fingering as the non-key-pressing finger specified by the pointer ifig is within the range where the predetermined value FocusTime has elapsed from the current time (sounding start time me.lTimsec), and the song data ME Search for sounds that exist after the [me] sound. If the corresponding sound is not found, the determination result in step SF2 is “NO”, and this process ends. However, if the corresponding sound is found, the determination result in step SF3 is “YES”. Proceed to SF5.

  In step SF5, the coordinates of the finger specified by the pointer ifig in the music data ME [men] (corresponding sound) specified by the pointer men. sfigPos [ifig] is stored in the register sfigN, and the sound generation start time men. lTimsec is stored in the register lTfigN.

  As described above, in the coordinate acquisition [2] process, in the sound existing after the sound of the music data ME [me], the sound (music data ME [men] having the same fingering as the finger not pressed specified by the pointer ifig is used. ]), And if there is a corresponding sound, the position coordinates sfigN of the finger that presses the sound and the key pressing time lTfigN are extracted.

(7) Operation of coordinate determination processing
Next, the operation of the coordinate determination process will be described with reference to FIG. When this process is executed through step SC9 (see FIG. 6) of the above-described “coordinate setting process of finger not to be pressed”, the CPU 13 proceeds to step SG1 shown in FIG. In step SG1, it is determined whether or not both the finger position coordinate sfigP obtained by the coordinate acquisition [1] process and the finger position coordinate sfiGN obtained by the coordinate acquisition [2] process exist. Hereinafter, "when both finger position coordinates sfigP and sfigN exist", "when only finger position coordinates sfigP exist", "when only finger position coordinates sfigN exist", and "finger position coordinates sfigP, sfigN" The explanation of the operation is divided into “the case where none exists”.

a. When both finger position coordinates sfigP and sfigN exist In this case, the determination result in step SG1 is “YES”, and the process proceeds to step SG2. In step SG2, according to the following equation (1), the finger position coordinates sfigP and the key pressing time lTfigP obtained by the coordinate acquisition [1] process described above, and the finger position coordinates sigN obtained by the coordinate acquisition [2] process are obtained. Further, interpolation interpolation is performed based on the key pressing time lTfigN to calculate the position coordinates sfigD of the finger not pressed at the current time (sounding start time me.lTimsec).
sfigD = (sfigP (lTfigN-me.lTimsec) + sfigN (lTfigP-me.lTimsec)) / (lTfigN-lTfigP) (1)

  Note that the finger position coordinates sfigP obtained by the coordinate acquisition [1] processing are fingers that do not press the sound of the music data ME [me], and the finger is the sound before the music data ME [me]. This represents the position of the finger when the key is pressed, and the key pressing time lTfigP represents the time. Also, the finger position coordinates sfigN obtained by the coordinate acquisition [2] process is a finger that does not press the sound of the music data ME [me], and that finger is the sound after the music data ME [me]. The position of the finger when the key is pressed is indicated, and the key pressing time lTfigN indicates the time.

Next, in step SG3, the following operations (a) to (e) are performed, and in the music data ME [me] specified by the pointer me, the coordinate position me. Register sfigPos [ifig]. That is,
(A) The larger coordinate candidate Max (sigH, sfigL) is selected from the finger coordinate candidates sfigH, sfigL obtained in the coordinate candidate acquisition process described above.
(B) Max (sigH, sigL) selected in (a) above is compared with the position coordinate sfiGD of the finger not to be depressed calculated by the interpolation in step SG2, and a position coordinate having a large value is selected.
(C) The smaller coordinate candidate min (sfigH, sfigL) is selected from the candidate coordinate candidates sfigH and sfigL obtained in the above-described coordinate candidate acquisition process.
(D) Compare min (sfigH, sfigL) selected in (c) above with the position coordinate sfigD of the finger not to be depressed calculated by the interpolation in step SG2, and select a position coordinate having a smaller value. .
(E) The average value of the position coordinate selected in (b) above and the position coordinate selected in (d) above is calculated, and this is calculated with the pointer ifig in the music data ME [me] designated by the pointer me. The coordinate position me. Registration in sfigPos [ifig] ends this processing.

b. When only the finger position coordinates sfigP exist
In this case, the determination result in step SG1 is “NO”, and the process proceeds to step SG4. In step SG4, it is determined whether or not only the finger position coordinates sfigP exist. Then, the judgment result at step SG4 is “YES”, and the CPU 4 proceeds to step SG5. In step SG5, the finger position coordinates sfigP are set to the finger position coordinates sfigD that are not depressed. Thereafter, the process proceeds to step SG3 described above, and the coordinate position me. sfigPos [ifig] is registered and the process is terminated.

c. When only the finger position coordinates sfigN exist
In this case, the determination results of steps SG1 and SG4 described above are both “NO”, and the process proceeds to step SG6. In step SG6, it is determined whether or not only the finger position coordinates sfigN exist. And the judgment result of step SG6 becomes "YES", and it progresses to step SG7. In step SG7, the finger position coordinates sfigN are set to the finger position coordinates sfigD that are not depressed. Thereafter, the process proceeds to step SG3 described above, and the coordinate position me. sfigPos [ifig] is registered and the process is terminated.

d. When neither finger position coordinates sfigP nor sfigN exist
In this case, all the determination results of the above-described steps SG1, SG4, and SG6 are “NO”, and the process proceeds to step SG8. In step SG8, the average value (sfigH + sfigL) / 2 of the finger coordinate candidates obtained in the coordinate candidate obtaining process described above is designated by the pointer ifig in the music data ME [me] designated by the pointer me. The coordinate position me. sfigPos [ifig] is set and the process is terminated.

  As described above, in the present embodiment, each sound constituting a song is represented, and the key to be pressed is set for each piece of music data ME [0] to [N] designating a finger to play each sound. Position coordinates me. sigPos [ifig], coordinate position me. sigPos [ifig] and hand position coordinates sHandPos are generated and registered, and based on these, the position change of the hand and each finger when playing each sound is graphed and displayed on the display unit 12 so that no key is depressed. It is possible to teach where to put a finger.

  Therefore, for example, in the case of musical score music data ME [0] to [N] shown in FIG. 11, the positions of hands and fingers during performance are expressed as a graph shown in FIG. In addition, the number given on each note in the musical score shown in FIG. 11 is a finger number representing fingering. In the graph shown in FIG. 12, the horizontal axis represents performance time starting from the performance start point, and the vertical axis represents keyboard coordinates.

10 keyboard 11 switch section 12 display section 13 CPU
14 ROM
15 RAM
16 sound source 17 sound system

Claims (4)

Song data storage means for storing song data representing at least each sound constituting the song and a finger playing each of the sounds;
The music data for each sound is read from the music data storage means, and the key-pressing finger position coordinates representing the position of the finger pressing the sound of the read music data are generated, and the sound of the read music data is a chord. If configured, key press information indicating whether or not each finger assigned to other chord constituent sounds other than the music data sound is in a key pressing state, and the position of each finger pressing the chord constituent sounds A key pressing finger position generating means for generating a chord key pressing finger position coordinate representing
The tune data for each sound is read from the tune data storage means, and when the tune data is composed of a finger for squeezing the sound of the read tune data and the tune data sounds constitute a chord, A no-pressing finger position generating means for generating a no-pressing finger position coordinate representing a finger position excluding the representing finger;
Music data with reference to the key-pressing finger position coordinates and chord key-pressing finger position coordinates generated by the key-pressing finger position generating means, and the non-pressing key position coordinates generated by the non-pressing finger position generating means Finger position display means for displaying the change in the position of each finger when playing the sound on the display unit as a graph with the horizontal axis as the performance time starting from the performance start point and the vertical axis as the keyboard coordinates;
A performance support information generating apparatus comprising:   Hand position generating means for generating hand position coordinates representing the position of the hand from a position range that can be taken by all fingers from the thumb to the little finger with respect to the sound of the read music data, and generated by the hand position generating means 2. The performance support information generating apparatus according to claim 1, further comprising hand position display means for displaying a change in the position of the hand when the music data is played with reference to the hand position coordinates. A computer having song data storage means for storing song data representing at least each sound constituting a song and a finger playing each of the sounds,
A reading process of reading out song data for each sound from the song data storage means;
When the keying finger position coordinates representing the position of the finger pressing the key of the music data read out by the reading process are generated and the sound of the read music data constitutes a chord, the sound of the music data is excluded Generates key press information indicating whether or not each finger assigned to another chord constituent sound is in a key press state, and chord key press finger position coordinates indicating the position of each finger pressing the chord constituent sound Key finger position generation processing to be registered in the song data,
No key depression that represents the position of the finger excluding the finger that depresses the sound of the song data read out by the readout process and the key depression information when the sound of the song data constitutes a chord. Non-pressing key finger position generation processing for generating finger position coordinates;
Music data with reference to the key pressing finger position coordinates and chord key pressing finger position coordinates generated by the key pressing finger position generation process and the no key pressing finger position coordinates generated by the no key pressing finger position generation process A finger position display process for displaying a change in the position of each finger when playing the keyboard on the display unit as a graph with the horizontal axis as the starting time and the vertical axis as the keyboard coordinates. A performance support information generation program. Generated by hand position generation processing for generating hand position coordinates representing the position of the hand from a position range that can be taken by all fingers from the thumb to the little finger with respect to the sound of the read music data, and generated by the hand position generation processing 4. The performance support information generating program according to claim 3, further causing the computer to execute hand position display processing for displaying a change in the position of the hand when playing the music data with reference to the hand position coordinates.

Images