JP4219652B2 - A singing practice support system for a karaoke device that controls the main melody volume at the relevant location based on the pitch error measured immediately before repeat performance - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a singing practice support system that performs performance control suitable for singing practice in a karaoke apparatus.
[0002]
[Prior art]
As a singing practice support system in a karaoke apparatus, there is a system in which the singing state is determined at any time during the performance of karaoke music, and the determination result is sequentially presented to the singer by changing the shape and color of the lyrics display (for example, (See below, Patent Document 1 or Patent Document 2) According to these techniques, a point that could not be sung in almost real time during singing is pointed out each time, so it is possible to know which part could not be sung correctly. .
[0003]
[Patent Document 1]
Japanese Patent No. 3050129 [0004]
[Patent Document 2]
JP 2000-29473 A
[Problems to be solved by the invention]
However, presenting information about the auditory sense of the singing state by visual perception such as the shape and color of the lyric display can be used as a basis for singing karaoke music according to the main melody, even if it can be used as a basis for knowing the abilities of the song. When doing it, it does not help at all. For example, suppose a song teacher points out where a student sang with a wrong pitch when the student sings a practice song. At that time, the teacher draws the note of the main melody and the sung note on the staff and points to the note, such as `` This sound is this height '', and corrects it to the correct pitch I won't do that. The conventional singing practice support system is exactly the same as this indication method. It is difficult to realize what the actual sound is even if it is shown visually how far the singing and the main melody are apart.
[0006]
[Means for Solving the Problems]
The present inventors thought that the most important thing in singing practice was to listen to an accurate sound and repeat it immediately so that it is the same as the sound. To give an example of the above song teacher and student, if the teacher is actually singing and showing the wrong singing point or playing the piano, the actual sound of the wrong part is actually played. The singer can realize the pitch of his singing and the main melody when he / she plays on the keyboard and explains, “It is really this sound”. He then pointed out the mistaken points and thought that it would be most effective to actually hear the exact sound at that point with a louder sound.
[0007]
This invention was created based on the above consideration. The singing practice support system according to the present invention is specified by the following items (1) to (6).
(1) The karaoke apparatus is a singing practice support system comprising pitch error measurement means, pitch error display means, evaluation recording means, repeat control means, and volume control means. (2) Pitch error measurement means. In the period when accompaniment music based on karaoke data is output, the singing voice signal pitch of the singer and the main melody pitch in the karaoke data are sequentially compared and the pitch error time series data is sequentially output (3) Pitch The error display means displays a horizontally long bar graph in which a number of vertically long minute segments are arranged horizontally on the display means, associates the full length of the bar graph with the performance period of the requested song, and subdivides each performance period into sub-periods Are assigned to each minute segment in order, and the pitch error time series data sequentially output by the pitch error measuring means is quantified for each minute period, The display color is determined based on the numerical value, and the minute segment assigned in the minute period is colored in the color. (4) The evaluation recording means predetermines the pitch error time-series data sequentially output by the pitch error measuring means. Grading for each section to generate evaluation values and associating these evaluation values with the time series of karaoke data and sequentially recording them in the memory. (5) The repeat control means is playing accompaniment music based on karaoke data. In response to a user input instructing repeat performance, a repeat performance start instruction location is additionally displayed on the bar graph with a cursor, and a repeat performance is performed from a designated location in the already played portion of the karaoke data ( 6) When the repeat control means repeats the karaoke data from the designated place, the sound volume control means records the evaluation recording means until immediately before. The evaluation value permutation is read from the memory, and the evaluation value corresponding to the performance point in the karaoke data time series is identified as the repeat performance progresses. The lower the grade of the specified evaluation value, the lower the performance level of the main melody in the karaoke data Increase relative to other accompaniment volume
DETAILED DESCRIPTION OF THE INVENTION
=== Basic configuration and operation of karaoke apparatus ===
A functional block diagram of a karaoke apparatus according to an embodiment of the present invention is shown in FIG. This karaoke apparatus 1 has substantially the same configuration as a performance terminal of a known communication karaoke system. The central control unit 11 controls each peripheral component unit to control the karaoke device 1. The hard disk device 12 includes accompaniment music data mainly composed of MIDI data and generation origins of lyrics images for many karaoke songs. Karaoke data including lyric rendering data is accumulated. In the accompaniment music data, each of a large number of sound sources built in the synthesizer is used as one instrument, and the sound generation / mute timing, pitch, volume, etc. are specified for the accompaniment sound to be generated by each instrument. The lyric rendering data includes lyric characters, lyrics character string display / erase timing, instruction information for changing the color of characters at the singing timing in the displayed character string, and the like. The karaoke data also includes table of contents information such as the titles of music and artist names, standard tempo (number of beats per minute) and performance time when playing at the standard tempo. Furthermore, the hard disk device 12 stores moving image data for a long time in a predetermined format and script data that defines a processing sequence of moving image data (such as a storage location and a processing order of moving image data to be processed). And the central control part 11 identifies the karaoke data and script data of each music by a music number, and manages this as a karaoke database. The central control unit 11 communicates with a host device connected to a predetermined information communication network via the communication control unit 23 in a timely manner, obtains karaoke data, script data, etc. about new music pieces, and contents of the karaoke database. Is updated from time to time.
[0011]
When the central control unit 11 receives a performance reservation command including a music number from the operation panel 14 or the remote control transmitter 13 provided in the main body of the karaoke apparatus 1 via the operation control unit 15, the central control unit 11 stores the number in the internal RAM. And manage in the performance processing queue. Then, the music numbers are sequentially extracted from the queue, the corresponding karaoke data is read from the hard disk device 12, the accompaniment music data in the karaoke data is transferred to the synthesizer 16 to generate accompaniment music, and the accompaniment is based on the lyric rendering data. The lyric image in which the portion to be sung in synchronism with the music changes in color in the video RAM 20 in order. Also, predetermined moving image data is sequentially transferred to the video control unit 21 in a predetermined order based on the script data, and the background moving image of the lyrics image is decoded.
[0012]
The mixing amplifier 17 mixes and amplifies the accompaniment music and the singing voice input to the microphone 19 and outputs the sound from the speaker 18. The video control unit 21 superimposes the lyric image on the decoded moving image and displays it on the display 22.
[0013]
Karaoke songs generally have the main melody part as the singer and other instruments as the other melody, so the volume of the instrument part responsible for the main melody in the accompaniment music data is set lower than the volume of the other melody. Has been. However, the karaoke device can be used to increase the volume of the main melody relative to the volume of other melody. You can also perform a performance that emphasizes the main melody. When the central control unit 11 receives a predetermined user input during the performance of the music, the central control unit 11 increases the volume setting value of the instrument part responsible for the main melody in the accompaniment music data, or decreases the volume setting value of the other parts. To do.
[0014]
=== Singing practice support system ===
The karaoke apparatus 1 is equipped with a system for supporting singing practice of karaoke music in addition to the above basic configuration. The singing practice support system of the present embodiment analyzes the singing situation at the time of music performance, presents the analysis result to the singer in real time, and uses it to return to a specified location and re-play during the performance of the music When the user input is accepted, the music is replayed from the designated place. Then, at the time of re-playing, the main melody accompaniment sound is played in a main melody emphasis performance mode that generates a louder volume than the accompaniment sound of the other melody. It should be noted that during re-playing, the main melody may be emphasized uniformly, but in this embodiment, the portion where the pitch between the singing voice and the main melody is more than a predetermined distance is emphasized. Yes.
[0015]
The karaoke apparatus 1 is equipped with a pitch measurement unit 30 as dedicated hardware for realizing a singing practice support system, and the central control unit 11 follows the music number input from the operation panel 14 or the remote control transmitter 13. When predetermined operation information for activating the singing practice mode is input, the pitch measurement unit is activated and the replay instruction is accepted when the music is played.
[0016]
=== Analysis of singing situation and presentation of analysis state ===
When the central controller 11 performs a song in the singing practice mode, the central melody pitch (pitch reference value) in the karaoke data is obtained for each beat, and the pitch measurement unit 30 compares the pitch reference value with the singing voice pitch. Error information is output. FIG. 2 shows a conceptual diagram of the pitch error measurement method. If there are a plurality of accompaniment sounds generated in one beat, the central control unit 11 acquires the pitch reference value P2 based on the sound lengths and pitches P1 of the plurality of accompaniment sounds. For example, if there are triplets in one beat, each accompaniment sound is different only in pitch with the same sound length, and the average value of the three notes is given to the pitch measurement unit 30 as the pitch reference value P2. Further, when a plurality of notes having different sound lengths are combined in one beat, a weighted average corresponding to each sound length is taken. For example, if there are a total of three notes, one octal note "do" and sixteenth note "mi" in one beat, these notes will have sixteenth note "do" 2 The sixteenth note “mi” is replaced with two notes in total, and the average of the four notes is taken to obtain the pitch reference value “re”. The central control unit 11 transfers the pitch reference values sequentially obtained in this way to the pitch measurement unit 30 in synchronization with the time signature.
[0017]
FIG. 3 shows a functional block diagram of the pitch measurement unit 30. The pitch measuring unit 30 includes a dedicated DSP 31 as a main body and includes an A / D converter 32 and a communication interface 33 with the central control unit 11. In the pitch measuring unit 30, first, the A / D converter 32 samples the singing voice signal input from the microphone 19 and converts it into digital singing voice data, and the DSP 31 extracts the singing voice pitch P3 from the singing voice data. The sampling in this embodiment is 10 times per beat, and the central control unit 11 gives the tempo information described in the karaoke data of the performance music to the DSP 31 of the pitch measurement unit 30, and the DSP 31 uses the tempo information. The required sampling period is calculated, and the A / D converter 32 samples the singing voice for each period. For example, if the tempo is 120, one beat is 500 ms, and the sampling period is 50 ms.
[0018]
The DSP 31 compares the pitch reference value P2 transferred from the central control unit 11 for each beat with the average value P4 of the ten singing pitches P3 obtained in one beat, and the cent is used as the comparison result. The pitch error ΔP is transferred to the central control unit 11. For example, if the singing pitch cannot be specified five times or more at the sampling opportunity of 10 times per beat because the singer is singing, the DSP 31 does not output the pitch error information for this beat. The central control unit 11 records the pitch error information transferred from the pitch measurement unit 30 in association with the cumulative number of beats from the start of the performance. For the beats for which no pitch error information was output, information indicating no data is associated and recorded.
[0019]
The central control unit 11 also performs control to display this error information as a bar graph in parallel with the process of recording the pitch error information. FIG. 4 shows the display state of this bar graph. A bar graph 40 in which the minute segments 41 are connected to the left and right in a strip shape is displayed on the display 22 so as not to overlap the lyrics characters 42. In this example, a bar graph 40 is formed by 30 minute segments 41. For example, if the full length of the bar graph is displayed on the left and right 720 dots of the display 22, 24 dots are assigned to each minute segment in the left-right direction. Further, the bar graph 40 shows a performance time axis, and the central control unit 11 changes the color of each segment 41 one after another based on the pitch error information recorded for each minute time corresponding to each minute segment 41. Such an image together with the lyrics image is developed into a bit map in the video RAM 20.
[0020]
The central control unit 11 first calculates the number of beats to be assigned to each minute segment by associating the total number of beats of the musical piece with the entire length of the bar graph. For example, if the song has a tempo of 120 (120 beats / minute) and 3 minutes and 30 seconds, the total number of beats is 420, and the total number of beats is divided by the number of small segments, and 14 beats are assigned to each segment. Hereinafter, the display control method of the bar graph 40 will be described by taking the music having the total number of beats 420 as an example.
[0021]
The central control unit 11 evaluates the correctness of the singing in four stages based on the pitch error information for each beat transferred from the pitch measurement unit 30 as the performance progresses, and further, the evaluation results for 14 beats Pass / fail is determined according to the breakdown. 5A and 5B show the correspondence between the pitch error information and the evaluation, the breakdown of the pitch error information for 14 beats, and the correspondence between pass / fail. Each beat is evaluated in four levels, “No Miss”, “Small Miss”, “Middle Miss”, and “Large Miss”, and “Excellent”, “Pass”, “Fail” according to the breakdown of 14 beats. Pass / fail judgment is performed.
[0022]
The central control unit 11 colors all the minute segments 41 in the same color at the start of the performance, and when the four-stage evaluation is acquired for 14 beats, the corresponding minute segments 41a to 41 are colored in accordance with the three pass / fail judgment results. 41c is colored. Note that a period in which the main melody does not exist in the performance time series is recognized as a non-singing period, and the minute segment 41d corresponding to this period is colored in a predetermined color. In addition, if a predetermined number of beats having no pitch error information are included in the 14 beats, the pass / fail determination is impossible, and the minute segment 41e corresponding to this determination failure is also colored in a predetermined color and presented to that effect. ing. While the pitch error information for 14 beats is being acquired, a cursor (▼ mark) 44 is displayed on the minute segment corresponding to the current performance, and the minute segment 41f is also colored in a predetermined color. The minute segment 41g of the unplayed portion remains the initial color.
[0023]
Note that the singing analysis status presentation form is not limited to the above bar graph, and may be presented in appropriate expressions such as numerical values and words such as “pass” and “fail”.
[0024]
=== Main melody emphasis performance control during replay ===
For example, suppose that a singer looks at the color state of the bar graph and the part sung immediately before is rejected. If the singer wants to be able to sing this part correctly, the singer can operate the remote control transmitter 13 or the like to return to the designated part and re-perform and sing again. In the present embodiment, while a predetermined button on the remote control transmitter 13 or the operation panel 14 is being pressed, the central control unit 11 determines the performance time series based on the information indicating the elapsed performance time on the karaoke data. When the button operation is completed by going backward at a predetermined speed, karaoke data is transferred to the synthesizer 16 from the performance location at that time and replayed. In addition, the central control unit 11 sequentially acquires the elapsed performance time that goes backward while the button is pressed, and displays an image in which the cursor is placed at a position corresponding to the acquired elapsed time on the displayed bar graph. Bitmaps are successively developed in the video RAM 20. Thereby, an image in which the cursor moves to the left is displayed, and the user can confirm to what point the performance part has been returned.
[0025]
A performance location where replaying is to be started is specified, and when replaying is started from this location, this replay location is a location where pitch error information has already been recorded. The central control unit 11 acquires the recorded pitch error information in parallel with the replay processing, and when the error information is equal to or greater than a predetermined reference, that is, the main melody and the collected singing voice pitch are If it is recorded that the pitch is more than the predetermined pitch, the volume value of each melody in the accompaniment music data is adjusted so that the volume of the main melody is increased and the volume of other melody is muted. 16 is transferred. As a result, when the singer enters a performance location where the pitch is off by a predetermined amount or more, only the accompaniment sound of the main melody is acoustically output. FIG. 6 shows a flowchart of processing in the singing practice mode.
[0026]
It should be noted that the pitch error information itself may not be compared with a predetermined standard, and the main melody emphasis performance may be performed on the “large mistake” portion or the “fail” portion. As for the control method of the main melody emphasis performance, the pitch error information above the standard is recorded in the process of recording the pitch error information instead of editing the volume value of the corresponding part of the accompaniment music data in real time during the replay. In such a case, the volume value of each melody at the time of recording in the accompaniment music data may be reset, and the accompaniment music data after the reset may be stored separately for replay. Then, at the time of replaying, the other accompaniment music data is processed.
[0027]
=== Emphasis on the main melodic sound ===
In the above embodiment, the main melody emphasis performance control is applied only to a location where the singing pitch and the pitch of the main melody are separated from each other by more than the standard, but the correctly sung location is short and before and after the location. If it is sung by mistake, it is difficult to sing instead of performing the main melody emphasis only on the wrong part. Therefore, if a correctly sung portion continues for a predetermined time or less, the portion may be played with emphasis on the main melody.
[0028]
It is not necessary to mute the melody other than the main melody during the performance of the main melody emphasis, and the volume of the main melody may be made relatively larger than the volume of other melody. Also, the accompaniment music data may be edited so that the instrument responsible for the main melody is changed to another instrument that the singer can easily hear.
[0029]
=== Replay instruction ===
The replay instruction may be issued not only during the performance of the music but also after the performance of one music has been completed. Then, the music piece played immediately before may be played from the beginning or from a location designated by the user. Also in this case, it is possible to perform the main melody emphasis performance only at a location where the singing pitch and the pitch of the main melody are more than the reference.
[0030]
【The invention's effect】
According to the singing practice support system in the karaoke apparatus of the present invention, the point where the pitch was mistakenly sung during the singing of the karaoke music piece is pointed out sequentially, and the portion of the pitch that is correct in the main melody is actually replayed. Can be presented. As a result, the singer can actually confirm how the wrong part is wrong by hearing, and can surely support the progress of the singing.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a karaoke apparatus in an embodiment of the present invention.
FIG. 2 is a conceptual diagram of the principle of a pitch measurement method by a singing practice support system in the karaoke apparatus.
FIG. 3 is a functional block diagram of a pitch measurement unit mounted on the karaoke apparatus.
FIG. 4 is a schematic view of a screen displayed on the display when the karaoke apparatus performs a performance process in the singing practice mode.
FIG. 5 is a correspondence diagram (A) between the pitch error information output by the pitch measuring unit for each beat and the singing evaluation, and a correspondence diagram between the breakdown of the singing evaluation for each predetermined number of beats and the pass / fail judgment result ( B).
FIG. 6 is a flowchart of a main melody emphasizing performance process in the karaoke apparatus.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Karaoke apparatus 11 Central control part 12 Hard disk apparatus 19 Microphone 22 Display 30 Pitch measurement part 40 Bar graph 41, 41a-41f Minute segment 42 Lyric character string

Claims (1)

In a karaoke apparatus, a singing practice support system comprising pitch error measuring means, pitch error display means, evaluation recording means, repeat control means, and volume control means,
The pitch error measurement means sequentially outputs the pitch error time-series data by sequentially comparing the singing voice signal pitch of the singer and the main melody pitch in the karaoke data during the period in which the accompaniment music based on the karaoke data is output,
The pitch error display means displays a horizontally long bar graph in which a number of vertically long small segments are arranged horizontally on the display means, associates the full length of the bar graph with the performance period of the requested song, and subdivides the performance period into small pieces. A period is assigned to each minute segment in turn, and pitch error time series data sequentially output by the pitch error measuring means is digitized for each minute period, a display color is determined based on the numerical value, and assigned to the minute period. Color the minute segment to the color,
The evaluation recording means classifies the pitch error time series data sequentially output by the pitch error measuring means to generate evaluation values for each predetermined section, and sequentially associates these evaluation values with the time series of karaoke data in the memory. Record,
The repeat control means responds to user input instructing repeat performance during performance of accompaniment music based on karaoke data, and additionally displays a repeat performance start instruction location on the bar graph with a cursor, and the karaoke Repeat from the specified part of the data already played,
When the repeat control means repeats the karaoke data from the designated place, the volume control means reads the evaluation value sequence recorded by the evaluation recording means until immediately before from the memory, and the performance place in the karaoke data time series as the repeat performance progresses. The singing practice support system in the karaoke apparatus, in which the performance value of the main melody in the karaoke data is relatively increased with respect to other accompaniment volumes as the grade of the specified evaluation value is lower.

Images