JP6708437B2 - Karaoke equipment - Google Patents

Description

The present invention relates to a karaoke device.

The conventional karaoke device is provided with a scoring function for scoring the skill of the user's singing. For example, Patent Document 1 discloses a technique for comparing and evaluating the pitch, volume, and rhythm of a singing voice that is input to a microphone in accordance with a karaoke performance, and the pitch, volume, and rhythm of score data corresponding to the song melody. Has been done.

In the case of the scoring function of Patent Document 1, it is possible to obtain a high score by singing exactly according to the score, but such singing is mechanical and is not good and neither is it pleasant to the audience. ..

On the other hand, when singing a piece of music, the user may make full use of various singing techniques (vibrato, hiccup, fall, fist, shout, etc.) that are not included in the score data. By making full use of such a singing technique, it is possible to sing a song better and to provide a comfortable singing to the audience. Therefore, by detecting and evaluating these singing techniques, it is possible to provide a scoring result that matches the skill of the actual singing.

As a technique for detecting a singing technique, for example, Patent Document 2 discloses a technique for detecting a “hiccup”. Patent Document 3 discloses a technique for detecting a “fall”. Patent Document 4 discloses a technique for detecting “fists”. Patent Document 5 discloses a technique for detecting “shout”.

Japanese Patent Laid-Open No. 10-049183 JP, 2005-107336, A JP, 2008-225115, A JP, 2008-268370, A JP 2012-078701A

By the way, there is a singing technique called the Heacup method, which is said to have originated from rockabilly. The heat cup singing method is a method of singing so that the pitch of the ending of a musical phrase is flipped up. While such a technique is frequently used in karaoke singing, there is no known method capable of detecting the Heacup singing so far.

It is an object of the present invention to provide a karaoke device capable of detecting the Heacup method.

The main invention for achieving the above-mentioned object is a pitch detection unit that detects a pitch of song data obtained by singing a karaoke song, and based on the detected pitch, in the song data, in a predetermined short period of time. A first determination unit that determines whether or not there is a first section in which the pitch rises by a predetermined value or more, and is located immediately before the first section in the singing data based on the detected pitch. A second determination unit that determines whether or not there is a second section in which the pitch is kept substantially constant for a certain period or more, and it is determined that the first section and the second section exist In addition, the karaoke device includes a first cup that determines the first section is a singing section based on the heacup singing method.
Other characteristics of the present invention will be clarified by the description and drawings described later.

According to the present invention, the Heacup method can be detected.

It is a figure which shows the outline of the karaoke apparatus which concerns on 1st Embodiment. It is a figure which shows the hardware structural example of the karaoke main body which concerns on 1st Embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 1st Embodiment. It is the figure which showed typically the data which show the detected pitch. It is a flow chart which shows processing of a karaoke device concerning a 1st embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 2nd Embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on 2nd Embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 3rd Embodiment. It is a flow chart which shows processing of a karaoke device concerning a 3rd embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 4th Embodiment. It is a flow chart which shows processing of a karaoke device concerning a 4th embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 5th Embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on 5th Embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on 6th Embodiment. It is a flow chart which shows processing of a karaoke device concerning a 6th embodiment.

In addition to the main invention described above, at least the following matters will be apparent from the description and drawings described below.

That is, immediately after the first section, there is a third judgment section for judging whether or not there is a third section in which the volume of the karaoke song is below a predetermined value for a predetermined period, and the heat cup singing method judgment section is provided. Determines that the first section is a singing section by the Heacup method when it is determined that the first section, the second section, and the third section exist. Karaoke device becomes clear. According to such a karaoke device, it is possible to prevent erroneous detection of the heat cup singing method.

In addition, the song data includes a fourth determination unit that determines whether or not a fourth period in which the pitch cannot be detected exists for a predetermined time immediately after the first period, and the heat cup singing method determination unit. Karaoke is characterized in that, when it is determined that the first section, the second section and the fourth section are present, the first section is determined to be a singing section by the Heacup method. The device becomes clear. According to such a karaoke device, it is possible to prevent erroneous detection of the heat cup singing method.

Also, based on the music data of the music, a detection unit that detects a phrase break of the music, and a specifying unit that specifies a note corresponding to the detected phrase break in the song data, The heat cup singing method determination unit determines that the first section and the second section are present, and if a note corresponding to the specified segment of the phrase exists immediately after the first section, A karaoke device characterized by determining that the first section is a singing section by the Heacup method is clarified. According to such a karaoke device, it is possible to prevent erroneous detection of the heat cup singing method.

Further, a karaoke device characterized in that the detection unit detects a phrase delimiter of the music based on the music data and the lyrics telop data of the music is clarified. According to such a karaoke device, it is possible to prevent erroneous detection of the heat cup singing method.

In addition, the method includes a ratio calculation unit that calculates a ratio of the overtones included in the first section to the overtones included in the second section, and the heat cup singing method determination unit includes the first section and the second section. A karaoke apparatus that determines that the first section is a singing section by the Heacup singing method using a falsetto when the section is determined to exist and the ratio is equal to or less than a predetermined value becomes clear. According to such a karaoke apparatus, it is possible to detect the heat cup singing method using the falsetto.

Further, based on the pitch detection unit that detects the pitch of the song data obtained by singing the song karaoke, based on the detected pitch, during the song data, the pitch rises by a predetermined value or more in a predetermined short period of time. Based on the detected pitch, the first determination unit that determines whether or not the first section exists, is located immediately before the first section in the song data, and has a substantially constant pitch for a certain period or more. A second determination unit that determines whether or not there is a second section that is maintained at the first section; and, if it is determined that the first section and the second section exist, the first section is a heat cup. A heacup singing method determination unit that determines a singing section by a singing method, a Heacup singing method scoring unit that scores a singing section by the Heacup singing method based on a predetermined condition, and the first harmonic overtone included in the second section. A ratio calculation unit that calculates a ratio of overtones included in the section, and a point processing unit that, when the ratio is equal to or less than a predetermined value, adds a score to the score value of the singing section by the Heacup method. Karaoke device becomes clear. According to such a karaoke device, it is possible to perform the scoring of the heat cup singing method using the falsetto.

Further, in the computer, a pitch detection step of detecting the pitch of the song data obtained by singing a karaoke song, and based on the detected pitch, in the song data, the pitch is a predetermined value or more in a predetermined short period, A first determination step of determining whether or not there is a rising first section, and a pitch that is located immediately before the first section in the singing data based on the detected pitch and is equal to or longer than a predetermined period. A second determination step for determining whether or not there is a second section in which the first section and the second section are present is maintained. A determination program for determining that the section is a singing section by the Heacup singing method, and a detection program for the Heacup singing method to be executed become clear. According to such a program, the Heacup method can be detected.

<First Embodiment>
The karaoke device 1 according to the first embodiment will be described with reference to FIGS. 1 to 5.

== Karaoke device ==
(Hardware configuration)
The karaoke device 1 is a device for performing a karaoke performance and singing by a singer. As shown in FIG. 1, the karaoke device 1 includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

The speaker 20 is configured to emit sound based on a sound emission signal from the karaoke body 10. The display device 30 is configured to display a video or image on the screen based on a signal from the karaoke body 10. The microphone 40 is a structure for converting the voice of the singer (singing voice) into an analog voice signal and inputting it to the karaoke body 10. The remote control device 50 is a device for performing various operations on the karaoke body 10. The singer can use the remote control device 50 to activate the karaoke device 1, reserve a song, and the like. Icons for inputting instructions for various operations are displayed on the display of the remote controller 50.

The karaoke body 10 performs various controls related to karaoke singing, such as performance control of a selected music piece, display control of lyrics and background images, and processing of a singing voice signal input through the microphone 40. FIG. 2 is a diagram showing a hardware configuration example of the karaoke body 10. The karaoke body 10 includes a control unit 11, a communication unit 12, a storage unit 13, a sound processing unit 14, a display processing unit 15, and an operation unit 16. Each component is connected to the bus B via an interface (not shown).

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing the operation program stored in the memory 11b. The memory 11b is a storage device that stores a program executed by the CPU 11a and temporarily stores various information when the program is executed.

The communication unit 12 provides an interface for connecting the karaoke body 10 to a communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various data, and is, for example, a hard disk drive.

The storage unit 13 stores a plurality of music piece data. The music data is data for performing a karaoke performance by the karaoke device 1. The singer can sing a karaoke song because the karaoke device 1 plays a song based on the song data. A predetermined ID (song ID) is assigned to each piece of music data. The music data includes MIDI data, score data, and the like. The musical score data is data that serves as a reference for singing a karaoke song, and is composed of time-series information indicating the pitch (pitch), volume, and length of each note. In addition, the storage unit 10 stores the lyrics telop data for displaying the lyrics telop corresponding to the karaoke piece on the display device 30 and the like, and the background image data such as the background image displayed on the display device 30 and the like during the karaoke performance. .. The lyrics character string included in the lyrics telop data is divided for each phrase and divided into a plurality of blocks.

Based on the control of the control unit 11, the sound processing unit 14 controls the performance of the karaoke piece and processes the audio signal input through the microphone 40. The sound processing unit 14 includes, for example, a MIDI sound source, a mixer, and an amplifier (all not shown). The MIDI sound source generates a musical tone signal based on music data. The mixer mixes the music signal and the audio signal output from the microphone 40 at an appropriate ratio and outputs the mixed signal to the amplifier. The amplifier amplifies the mixing signal from the mixer and outputs it as a sound emission signal to the speaker 20. As a result, the karaoke performance sound based on the sound emission signal and the singing voice from the microphone 40 are emitted from the speaker 20.

The display processing unit 15 performs processing related to various displays on the display device 30 and the remote control device 50 under the control of the control unit 11. For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics telops and various icons are superimposed on the background image during karaoke performance.

The operation unit 16 is composed of a panel switch and a remote control reception circuit and the like, and sends operation signals such as a reservation signal and a performance stop signal to the control unit 11 according to the operation of the panel switch of the karaoke device 1 or the remote control device 50 by a singer. Output. The control unit 11 detects an operation signal from the operation unit 16 and executes a corresponding process.

(Software configuration)
FIG. 3 is a diagram showing a software configuration example of the karaoke body 10. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first determination unit 300, a second determination unit 400, and a heat cup singing method determination unit 500. The singing voice storage unit 100 is realized as a part of the storage area provided by the storage unit 13. The pitch detection unit 200, the first determination unit 300, the second determination unit 400, and the Hey-Cup method determination unit 500 are realized by the CPU 11a executing a program stored in the memory 11b.

[Singing data storage]
The song data storage unit 100 temporarily stores song data (voice signal from the microphone 40) obtained by singing a karaoke song. The singing data, like the musical score data, is composed of time-series information indicating the pitch, volume, length, etc. of each sung note.

[Pitch detector]
The pitch detection unit 200 detects the pitch of the song data stored in the song data storage unit 100. For example, the pitch detection unit 200 reads out certain song data from the song data storage unit 100, detects the pitch of each note in frame units of a predetermined time length, and generates data indicating the detected pitch.

[First determination unit]
The first determination unit 300 determines, based on the pitch detected by the pitch detection unit 200, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period. The “predetermined short period” and the “predetermined value” at which the pitch increases are not particularly limited as long as they are within the range in which the human can recognize the Heacup method. For example, the predetermined short period is about 50 msec, and the predetermined value for increasing the pitch is 100 msec (semitone) or more. Alternatively, from the viewpoint of preventing erroneous detection of the Heacup method, it is preferable that the predetermined short period is 50 msec or more and 200 msec or less, and the predetermined value of the pitch rising during that period is 200 cent or more.

FIG. 4 is a diagram schematically showing data indicating the detected pitch. The horizontal axis represents time (msec), and the vertical axis represents pitch (cent).

For example, the first determination unit 300 determines that there is a first section Z1 in which the pitch is increased by 100 msec or more within 50 msec with respect to the data shown in FIG.

[Second determination unit]
The second determination unit 400 is located immediately before the first section in the singing data based on the pitch detected by the pitch detection unit 200, and the pitch is kept substantially constant for a certain period or longer. It is determined whether the section of exists. The "certain period" is not particularly limited as long as it is a range in which the pitch is detected. For example, the fixed period can be set to 200 msec or more, which is slightly shorter than the eighth note (250 msec) of the tempo 120. The term "immediately before the first section" means that the section is before the first section and is temporally continuous with the first section. The range in which it is determined that the "pitch is almost constant" varies depending on the length of the certain period, but is, for example, ±50 msec.

For example, with respect to the data shown in FIG. 4, the second determination unit 400 determines that there is a second section Z2 in which the pitch is within ±50 cents for 200 msec or more before the first section Z1. To do.

[Heacup method of judging]
If it is determined that there is a first section and a second section, the heatcup singing method determination unit 500 determines that the first section is a singing section based on the Heacup singing method.

For example, regarding the data shown in FIG. 4, when the first determining unit 300 determines that the first section Z1 exists and the second determining unit 400 includes the second section Z2, the heat cup singing method determination section 500 determines that the second section Z2 exists. When it is determined, the first section Z1 is determined to be a singing section by the Heacup method.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke device 1 in this embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing an operation example of the karaoke device 1.

The singer selects an arbitrary piece of music and sings a karaoke song using the karaoke device 1 (karaoke song, step 10).

The singing data storage unit 100 stores the singing data obtained by the karaoke singing of step 10 (storing of singing data, step 11).

The pitch detection unit 200 detects the pitch of the song data stored in step 11 (pitch detection, step 12).

The first determination unit 300 determines, based on the pitch detected in step 12, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The existence of the section 1 is judged, step 13).

If the first section is present (Y in step 14), the second determination unit 400 is positioned immediately before the first section in the singing data based on the pitch detected in step 12. Then, it is determined whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is determined, step 15). On the other hand, when the first section does not exist (N in step 14), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

If the second section exists (Y in step 16), the heatcup singing method determination unit 500 determines that the first section is a singing section by the heatcup singing method (determined as the heatcup singing method, step 17). On the other hand, when the second section does not exist (N in step 16), the heacup singing method determination unit 500 determines that the singing data obtained by the karaoke singing in step 10 does not include the heacup method.

As described above, according to the karaoke device 1 according to the present embodiment, it is possible to detect, based on the singing data, whether or not the singing data includes the Heacup method.

It should be noted that the pitch detection, the determination as to whether the first section exists, or the like may be performed for all the singing data, or for example, a predetermined range of the singing data (only the portion corresponding to No. 1 of the song starts singing). From a predetermined time).

<Second Embodiment>
Next, the karaoke device 1 according to the second embodiment will be described with reference to FIGS. 6 and 7. The second embodiment will describe an example of preventing erroneous detection of the Heacup method based on the volume input from the microphone 40. Detailed description of the same configuration as that of the first embodiment is omitted.

Heacup singing is often performed at the break of the phrase of the song. Therefore, in many cases, the singing voice is not input after performing the heat cup singing method. In the present embodiment, a configuration for preventing erroneous detection of the Heacup method using such characteristics will be described.

(Software configuration)
FIG. 6 is a diagram showing a software configuration example of the karaoke body 10 according to the present embodiment. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first judgment unit 300, a second judgment unit 400, a Heacup singing method judgment unit 500, and a third judgment unit 600. The third determination unit 600 is realized by the CPU 11a executing a program stored in the memory 11b.

[Third judging section]
The third determination unit 600 determines whether or not there is a third section in which the volume of the karaoke song is below a predetermined value for a predetermined period immediately after the first section. The volume of the karaoke song is included in the song data. The term "immediately after the first section" means that it is after the first section and is temporally continuous with the first section. The "predetermined period" is not particularly limited. For example, since there is usually a silent period of about 100 msec between phrases of a musical composition, the silent period may be set as the predetermined period. Alternatively, when the predetermined short period is 50 msec or more and 200 msec or less and the predetermined value of the pitch rising during that period is 200 cent or more, it is preferable that the predetermined period is a section corresponding to a 16th note (125 msec at 120 BPM). The “predetermined value” of the volume of the karaoke song is a threshold value and is not particularly limited. For example, an arbitrary value may be set as a predetermined value in advance, or an average value of the lowest volume of each song may be obtained from a plurality of song data, and the average value may be set as the predetermined value.

[Heacup method of judging]
When it is determined that the first section, the second section, and the third section are present, the heatcup singing method determination unit 500 according to the present embodiment determines that the first section is a singing section by the heatcup singing method. To do.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke device 1 in this embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an operation example of the karaoke apparatus 1.

The singer selects an arbitrary piece of music and sings a karaoke song using the karaoke device 1 (karaoke song, step 20).

The singing data storage unit 100 stores the singing data obtained by the singing of the karaoke song in step 20 (storage of singing data, step 21).

The pitch detection unit 200 detects the pitch of the song data stored in step 21 (pitch detection, step 22).

The first determination unit 300 determines, based on the pitch detected in step 22, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The existence of the section 1 is judged, step 23).

When the first section is present (Y in step 24), the second determination unit 400 is located immediately before the first section in the singing data based on the pitch detected in step 22. Then, it is judged whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is judged, step 25). On the other hand, when the first section does not exist (N in step 24), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

When the second section exists (Y in step 26), the third determination unit 600 determines that the third section in which the volume of the karaoke song is equal to or lower than the predetermined value for a predetermined period immediately after the first section. It is determined whether or not there is (the presence of the third section is determined, step 27).

If the third section is present (Y in step 28), the heatcup singing method determination unit 500 determines that the first section is a singing section by the heatcup singing method (determined as the heatcup singing method, step 29). On the other hand, when the third section does not exist (N in step 28), the heatcup singing method determination unit 500 determines that the singing data obtained by the karaoke singing in step 20 does not include the heatcup method.

As described above, according to the karaoke device 1 according to the present embodiment, the singing data includes the Heacup method in consideration of the presence of the third section in which the volume of the karaoke song is equal to or lower than the predetermined value for the predetermined period. It can detect whether there is. Therefore, it is possible to prevent erroneous detection of the Heacup method.

<Third Embodiment>
Next, the karaoke device 1 according to the third embodiment will be described with reference to FIGS. 8 and 9. The third embodiment will describe an example in which erroneous detection of the Heacup method is prevented depending on the presence or absence of the pitch included in the song data. Detailed description of the same configurations as those of the first embodiment will be omitted.

As described in the second embodiment, in many cases, the singing voice is not input after performing the heat cup singing method. Therefore, the song data does not include the pitch. In the present embodiment, a configuration for preventing erroneous detection of the Heacup method using such characteristics will be described.

(Software configuration)
FIG. 8 is a diagram showing a software configuration example of the karaoke body 10 according to the present embodiment. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first determination unit 300, a second determination unit 400, a Heacup singing method determination unit 500, and a fourth determination unit 700. The fourth determination unit 700 is realized by the CPU 11a executing a program stored in the memory 11b.

[Fourth determination unit]
The fourth determination unit 700 determines whether or not there is a fourth section in which the pitch cannot be detected for a predetermined period immediately after the first section in the song data. The "predetermined period" is not particularly limited, but for example, as in the second embodiment, the predetermined period may be a length corresponding to the silent period of the music.

[Heacup method of judging]
When it is determined that the first section, the second section, and the fourth section are present, the heatcup singing method determination unit 500 according to the present embodiment determines that the first section is a singing section based on the Heacup singing method. To do.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke device 1 in this embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing an operation example of the karaoke apparatus 1.

The singer selects an arbitrary music piece and performs karaoke singing by the karaoke device 1 (karaoke singing, step 30).

The singing data storage unit 100 stores the singing data obtained by the singing of the karaoke song in step 30 (storage of singing data, step 31).

The pitch detector 200 detects the pitch of the song data stored in step 31 (pitch detection, step 32).

The first determination unit 300 determines, based on the pitch detected in step 32, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The presence of the section 1 is judged, step 33).

When the first section is present (Y in step 34), the second determination unit 400 is positioned immediately before the first section in the singing data based on the pitch detected in step 32. Then, it is judged whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is judged, step 35). On the other hand, when the first section does not exist (N in step 34), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

If the second section exists (Y in step 36), the fourth determination unit 700 determines that the fourth section in which the pitch cannot be detected exists in the song data immediately after the first section for a predetermined period. It is determined whether or not to perform (determination of the presence of the fourth section, step 37).

If the fourth section is present (Y in step 38), the heatcup singing method determination unit 500 determines that the first section is a singing section based on the heatcup singing method (determination of the heatcup singing method, step 39). On the other hand, when the fourth section does not exist (in the case of N at step 38), the heacup singing method determination unit 500 determines that the singing data obtained by the karaoke singing of step 30 does not include a heacup method.

As described above, according to the karaoke device 1 of the present embodiment, it is possible to detect whether or not the singing data includes the Heacup method in consideration of the presence of the fourth section in which the pitch cannot be detected for a predetermined period. You can Therefore, it is possible to prevent erroneous detection of the Heacup method.

<Fourth Embodiment>
Next, the karaoke device 1 according to the fourth embodiment will be described with reference to FIGS. 10 and 11. The fourth embodiment will describe an example of preventing erroneous detection of the Heacup singing method based on music data played when obtaining singing data. Detailed description of the same configurations as those of the first embodiment will be omitted. In the present embodiment, in the song that is the source of the song data, it is assumed that all the notes included in the song data are being sung (a situation in which some songs are not missing midway). .. That is, each note included in the song data (song pitch data) has a one-to-one correspondence with a note included in the score data.

(Software configuration)
FIG. 10 is a diagram showing a software configuration example of the karaoke body 10 according to the present embodiment. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first determination unit 300, a second determination unit 400, a Heacup singing method determination unit 500, a detection unit 800, and a fifth determination unit 900. The detection unit 800 and the fifth determination unit 900 are realized by the CPU 11a executing a program stored in the memory 11b.

[Detection unit]
The detection unit 800 detects a phrase delimiter of the music based on the music data of the music. As a specific example, the detection unit 800 reads, from the storage unit 13, song data of a song played when obtaining song data. The detection unit 800 determines whether or not the time interval from the note-off timing of one note included in the music data to the note-on timing of the next note is a predetermined value or more (for example, 100 msec or more). When there is a time interval equal to or greater than the predetermined value, the detection unit 800 detects that portion as a phrase delimiter.

[Specification part]
The identifying unit 900 identifies the notes corresponding to the detected phrase delimiters in the song data. As a specific example, the specifying unit 900 specifies where in the song data the musical notes corresponding to the phrase breaks detected by the detecting unit 800 exist.

[Heacup method of judging]
The heat cup singing method determination unit 500 according to the present embodiment determines that the first section and the second section are present, and the note corresponding to the specified phrase break is present immediately after the first section. , The first section is determined to be a singing section by the Heacup method. As described above, the Heacup method is often performed by separating phrases of music. In the present embodiment, the phrase delimiter (notes indicating the delimiter) of the music is directly obtained from the music data, and when the delimiter exists immediately after the first section, it is determined that the heacup method is performed, and thus the heacup method To prevent false detection.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke device 1 in this embodiment will be described with reference to FIG. 11. FIG. 11 is a flowchart showing an operation example of the karaoke device 1.

The singer selects an arbitrary piece of music and sings a karaoke song using the karaoke device 1 (karaoke song, step 40).

The singing data storage unit 100 stores the singing data obtained by the karaoke singing in step 40 (storing singing data, step 41).

The pitch detector 200 detects the pitch of the song data stored in step 41 (pitch detection, step 42).

The first determination unit 300 determines, based on the pitch detected in step 42, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The existence of the section 1 is judged, step 43).

If the first section is present (Y in step 44), the second determination unit 400 is positioned immediately before the first section in the singing data based on the pitch detected in step 42. Then, it is determined whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is determined, step 45). On the other hand, when the first section does not exist (N in step 44), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

When the second section exists (Y in step 46), the detection unit 800 detects the phrase break of the music based on the music data (phrase break detection, step 47).

The identifying unit 900 identifies the notes corresponding to the phrase breaks detected in step 47 in the song data (note identification, step 48).

When the note corresponding to the specified phrase break exists immediately after the first section (Y in step 49), the heatcup singing method determination unit 500 determines that the first section is a singing section by the heatcup singing method. Judgment (judgment of heat cup method, step 50). On the other hand, when the note corresponding to the specified phrase break does not exist immediately after the first section (in the case of N in step 49), the heatcup singing method determination unit 500 determines the song data obtained by the karaoke song in step 40. It is determined that does not include the heatcup method.

As described above, according to the karaoke apparatus 1 according to the present embodiment, it is possible to detect whether or not the song data includes the Heacup method, based on the song data. Therefore, it is possible to prevent erroneous detection of the Heacup method.

In the above example, the phrase delimiter is detected only from the music data, but the lyrics telop data may be used.

That is, the detection unit 800 can also detect the phrase delimiter of the music, based on the music data and the lyrics telop data of the music. For example, the detection unit 800 identifies a block of a character string included in the lyrics telop data. The detection unit 800 searches the music data for a note associated with the last character of the specified block, and detects the note as a phrase delimiter. In this case, it is assumed that the character strings of the lyrics included in the lyrics telop data and the notes included in the music data have a one-to-one correspondence.

<Fifth Embodiment>
Next, the karaoke device 1 according to the fifth embodiment will be described with reference to FIGS. 12 and 13. The fifth embodiment will describe a detection example of the Heacup method using a falsetto. Detailed description of the same configurations as those of the first embodiment will be omitted.

There is falsetto as one of the singing methods. According to the spectrum of the frequency calculated from the singing data which is performing the falset, the harmonic component (overtone) is extremely smaller in the portion where the falset is performed than in the portion where the vocal is singing. There are some singers who perform the Heacup method while making full use of the falsetto.

(Software configuration)
FIG. 12 is a diagram showing a software configuration example of the karaoke body 10 according to the present embodiment. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first determination unit 300, a second determination unit 400, a Heacup singing method determination unit 500, and a ratio calculation unit 1000. The ratio calculation unit 1000 is realized by the CPU 11a executing a program stored in the memory 11b.

[Ratio calculator]
The ratio calculator 1000 calculates the ratio of the overtones included in the first section to the overtones included in the second section. Specifically, the ratio calculation unit 1000 respectively obtains a time series pattern of a spectrum indicating a frequency component from the song data corresponding to the first section and the second section. The ratio calculation unit 1000 detects a section in which the harmonic component is extremely smaller than other sections in the time-series pattern, and sets the section as an overtone section. The ratio calculation unit 1000 obtains the overtone sections of each of the first section and the second section. Then, the ratio calculation unit 100 calculates the ratio of the overtones included in the first section to the overtones included in the second section based on the obtained overtone data.

[Heacup method of judging]
The heat cup method determination unit 500 according to the present embodiment determines that the first section and the second section are present, and when the calculated ratio is less than or equal to a predetermined value, the first section uses a false cup. It is determined that it is a singing section by the singing method. The “predetermined value” is a threshold value for determining whether or not a falset is included in the song data, and is not particularly limited.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke apparatus 1 in this embodiment will be described with reference to FIG. FIG. 13 is a flowchart showing an operation example of the karaoke apparatus 1.

The singer selects an arbitrary piece of music and sings a karaoke song using the karaoke device 1 (karaoke song, step 60).

The singing data storage unit 100 stores the singing data obtained by the singing of the karaoke song in step 60 (storage of singing data, step 61).

The pitch detection unit 200 detects the pitch of the song data stored in step 61 (pitch detection, step 62).

The first determination unit 300 determines, based on the pitch detected in step 62, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The existence of the section 1 is judged, step 63).

If the first section is present (Y in step 64), the second determination unit 400 is positioned immediately before the first section in the singing data based on the pitch detected in step 62. Then, it is determined whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is determined, step 65). On the other hand, when the first section does not exist (N in step 64), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

When the second section exists (Y in step 66), the ratio calculation unit 1000 calculates the ratio of the overtones included in the first section to the overtones included in the second section (the ratio of the overtones is set). Calculation, step 67).

When the ratio of the overtones is equal to or less than the predetermined value (Y in step 68), the heatcup singing method determination unit 500 determines that the first section is a singing section by the heatcup singing method using a falset (determined as the heatcup singing method. Step 69). On the other hand, when the ratio of the overtones is greater than the predetermined value (N in step 68), the heacup singing method determination unit 500 includes only the heacup singing method in the singing data obtained by the karaoke singing in step 40 ( Healy cup singing method based on the ground voice).

As described above, according to the karaoke apparatus 1 according to the present embodiment, it is possible to detect whether or not the song data includes the Heacup singing method using the falsetto.

<Sixth Embodiment>
Next, a karaoke device 1 according to the sixth embodiment will be described with reference to FIGS. 14 and 15. The sixth embodiment describes a configuration for more reliably scoring the Heacup method in consideration of the falsetto. Detailed description of the same configurations as those of the first embodiment will be omitted.

As described in the fifth embodiment, there are some singers who perform the heatcup singing method while making full use of the falsetto. In this case, it is possible to provide a more comfortable singing to the audience, since different singing methods such as the falset and the heacup singing method are performed at the same time. Therefore, it is preferable that the result is reflected in the score value.

(Software configuration)
FIG. 14 is a diagram showing a software configuration example of the karaoke body 10 according to the present embodiment. The karaoke body 10 includes a singing data storage unit 100, a pitch detection unit 200, a first determination unit 300, a second determination unit 400, a Heacup singing method determination unit 500, a ratio calculation unit 1000, a Heacup singing method scoring unit 1100, and point addition processing. The unit 1200 is provided. The heat cup singing method scoring unit 1100 and the point addition processing unit 1200 are realized by the CPU 11a executing a program stored in the memory 11b.

[Heacup method of judging]
As with the first embodiment, the heat cup singing method determination unit 500 according to the present embodiment determines that the first section is a singing section based on the Heacup singing method when it is determined that the first section and the second section exist. judge.

[Healing Cup Scoring Section]
The heat cup singing method scoring unit 1100 scores a singing section by the heat cup singing method based on a predetermined condition. When it is determined by the heacup singing method determination unit 500 that the singing data includes the heacup singing method, the karaoke device 1 adds a score to the scoring value obtained by the normal scoring function by performing the heacup singing method. Note that the normal scoring function has the same configuration as the conventional one, so detailed description thereof will be omitted in the present embodiment, but the karaoke device 1 naturally has such a configuration.

For example, the heat cup scoring method scoring unit 1100 detects the number of singing sections by the heat cup singing method included in the singing data, and counts a score value of plus 3 points for each. The predetermined condition, the number of points, and the number of times can be set arbitrarily. In addition, if the heacup method is used too much, the audience may feel uncomfortable. Therefore, a deduction condition (for example, minus 5 points when used five times or more) may be set as the predetermined condition.

[Point processing unit]
When the ratio calculated by the ratio calculation unit 1000 is less than or equal to a predetermined value, the point addition processing unit 1200 adds points to the score value of the singing section by the Heacup method. When the ratio is less than or equal to the predetermined value, the heat cup singing method for the section is performed using the falsetto. Compared to the case of only the heacup singing method, the healcup singing method that makes full use of the falset is a more advanced singing, and therefore it is preferable to further add the score to the score value obtained by the heacup singing method scoring unit 1100. Therefore, when the ratio is less than or equal to the predetermined value, the point adding unit 1200 adds a predetermined value (for example, plus 3 points per time) to the score value obtained by the Heacup method scoring unit 1100 (for example, once. 3 points for each + 3 points for a total of 6 points). It should be noted that the predetermined value is a threshold value for determining whether or not the song data includes a falsetto, and is not particularly limited.

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke device 1 in this embodiment will be described with reference to FIG. FIG. 15 is a flowchart showing an operation example of the karaoke device 1.

The singer selects an arbitrary piece of music and sings a karaoke song using the karaoke device 1 (karaoke song, step 70).

The singing data storage unit 100 stores the singing data obtained by the singing of the karaoke song in step 70 (storage of singing data, step 71).

The pitch detection unit 200 detects the pitch of the song data stored in step 71 (pitch detection, step 72).

The first determination unit 300 determines, based on the pitch detected in step 72, whether or not the song data includes a first section in which the pitch increases by a predetermined value or more in a predetermined short period (first time). The presence of the section 1 is judged, step 73).

When the first section exists (Y in step 74), the second determination unit 400 determines the position in the singing data before the first section based on the pitch detected in step 72. Then, it is determined whether or not there is a second section in which the pitch is kept substantially constant for a certain period or longer (the existence of the second section is determined, step 75). On the other hand, when the first section does not exist (N in step 74), it is determined that the Heacup method is not included, and the subsequent processing is not performed.

If the second section exists (Y in step 76), the heatcup singing method determination unit 500 determines that the first section is a singing section based on the heacup singing method (judgment is a heatcup singing method, step 77). On the other hand, when the second section does not exist (N in step 76), the heacup singing method determination unit 500 determines that the singing data obtained by the karaoke singing in step 10 does not include the heacup method.

The heacup singing method scoring unit 1100 scores the singing section determined in step 77 based on a predetermined condition (heacup singing method scoring, step 78).

The ratio calculator 1000 calculates the ratio of the overtones included in the first section to the overtones included in the second section (calculates the overtone ratio, step 79).

When the ratio of the overtones is equal to or lower than the predetermined value (Y in step 80), the point addition processing unit 1200 determines that the Heacup singing method using the falsetto has been performed, and adds the point value evaluated in step 78 (pointing). Addition of value, step 81). On the other hand, when the ratio of overtones is equal to or less than the predetermined value (N in step 80), the point addition processing unit 1200 does not perform point addition processing.

In addition, when presenting the score to the singer, the sum of the normal score and the score may be presented, or the proportion of the Heacup method (Heacup method + falsetto) in that may be indicated separately. Good.

As described above, according to the karaoke apparatus 1 according to the present embodiment, it is possible to score the Heacup singing method in consideration of the falset.

<Other>
The above-described embodiment can be realized by causing a computer or a microprocessor to execute the above-described various processes by a program. In this case, all the processes may be prepared as a program, or a part of the processes may be processed by hardware and the remaining processes may be prepared as a program. It is also possible to supply a program to a computer using a non-transitory computer-readable medium that stores an executable program. Note that examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), CD-ROMs, and the like.

The above embodiments and the like are presented as examples, and do not limit the scope of the invention. The above configurations can be appropriately combined and implemented, and various omissions, replacements, and changes can be made without departing from the scope of the invention. The above-described embodiments and modifications thereof are included in the invention described in the claims and equivalents thereof as well as included in the scope and the gist of the invention.

DESCRIPTION OF SYMBOLS 1 Karaoke device 10 Karaoke main body 11 Control part 13 Storage part 100 Singing data storage part 200 Pitch detection part 300 First judgment part 400 Second judgment part 500 Hea cup singing method judgment part

Claims (6)

A pitch detection unit that detects the pitch of the song data obtained by singing a karaoke song,
A first determination unit that determines, based on the detected pitch, whether or not there is a first section in which the pitch rises by a predetermined value or more in a predetermined short period in the song data;
Based on the detected pitch, it is determined whether or not there is a second section in the singing data immediately before the first section, in which the pitch is kept substantially constant for a certain period or longer. 2 judgment part,
Immediately after the first section, a third determination unit that determines whether or not there is a third section in which the volume of the karaoke song is below a predetermined value for a predetermined period,
If it is determined that the first section, the second section, and the third section are present, the first section is a Heacup singing method determination unit that determines that the first section is a singing section by the Heacup singing method,
Karaoke device having a . A pitch detection unit that detects the pitch of the song data obtained by singing a karaoke song,
A first determination unit that determines, based on the detected pitch, whether or not there is a first section in which the pitch rises by a predetermined value or more in a predetermined short period in the song data;
Based on the detected pitch, it is judged whether or not there is a second section in the singing data immediately before the first section, in which the pitch is kept substantially constant for a certain period or longer. 2 judgment part,
A fourth determination unit that determines whether or not there is a fourth section in which the pitch cannot be detected for a predetermined time immediately after the first section in the singing data.
If it is determined that the first section, the second section, and the fourth section are present, the first section is a Heacup singing method determination unit that determines that the first section is a singing section by the Heacup singing method,
Karaoke device having a . A pitch detection unit that detects the pitch of the song data obtained by singing a karaoke song,
A first determination unit that determines, based on the detected pitch, whether or not there is a first section in which the pitch rises by a predetermined value or more in a predetermined short period in the song data;
Based on the detected pitch, it is judged whether or not there is a second section in the singing data immediately before the first section, in which the pitch is kept substantially constant for a certain period or longer. 2 judgment part,
A detection unit for detecting phrase breaks of the music, based on the music data of the music;
A specifying unit that specifies the notes corresponding to the detected delimiters of the phrase in the song data,
When it is determined that the first section and the second section are present, and the note corresponding to the specified segment of the phrase exists immediately after the first section, the first section is a heat cup. A heatcup singing method determination unit that determines that the singing section is based on the singing method ,
Karaoke device having a . 4. The karaoke device according to claim 3, wherein the detection unit detects a phrase delimiter of the music based on the music data and the lyrics telop data of the music. A pitch detection unit that detects the pitch of the song data obtained by singing a karaoke song,
A first determination unit that determines, based on the detected pitch, whether or not there is a first section in which the pitch rises by a predetermined value or more in a predetermined short period in the song data;
Based on the detected pitch, it is determined whether or not there is a second section in the singing data immediately before the first section, in which the pitch is kept substantially constant for a certain period or longer. 2 judgment part,
When it is determined that the first section and the second section are present, the first section is a Heacup singing method determination unit that determines that the first section is a singing section by the Heacup singing method,
A ratio calculation unit that calculates a ratio of overtones included in the first section to overtones included in the second section;
A karaoke device having:
The heat cup singing method determination unit determines that the first section and the second section are present, and when the ratio is less than or equal to a predetermined value, the first section is a singing section by a heat cup singing method using a falsetto. Karaoke device that is determined to be. A pitch detection unit that detects the pitch of the song data obtained by singing a karaoke song,
A first determination unit that determines, based on the detected pitch, whether or not there is a first section in which the pitch rises by a predetermined value or more in a predetermined short period in the song data;
Based on the detected pitch, it is determined whether or not there is a second section in the singing data immediately before the first section, in which the pitch is kept substantially constant for a certain period or longer. 2 judgment part,
When it is determined that the first section and the second section are present, the first section is a Heacup singing method determination unit that determines that the first section is a singing section by the Heacup singing method,
Based on a predetermined condition, a Hea cup singing method scoring unit for scoring a singing section by the Hea cup singing method,
A ratio calculation unit that calculates a ratio of overtones included in the first section to overtones included in the second section;
When the ratio is less than or equal to a predetermined value, a point processing unit that adds points to the score value of the singing section according to the heat cup method,
Karaoke apparatus characterized by having.

Images