JP2018112724A - Performance guide device, performance guide program and performance guide method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a performance guide device, a performance guide program and a performance guide method capable of shortening the time required to start reproduction of audio data and performance support and reducing the storage area to be secured.SOLUTION: A receiving unit 22 sequentially receives a plurality of audio data portions and a plurality of guide data portions transmitted from a music content transmitting device 100. The plurality of received audio data portions and the plurality of guide data portions are sequentially stored in a storage device 210. A reading unit 24 sequentially reads the plurality of audio data portions and the plurality of guide data portions from the storage device 210. A reproducing unit 25 continuously reproduces the plurality of read audio data portions. A performance support processing unit 26 executes performance support processing synchronized with reproduction of the plurality of audio data portions based on the plurality of read guide data portions.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a performance guide device, a performance guide program, and a performance guide method for supporting a user's performance.

  An electronic musical instrument having a performance guide function for supporting a user's performance is known. Patent Document 1 describes an electronic musical instrument capable of presenting performance data synchronized with musical sounds emitted from a content reproduction apparatus. The content playback apparatus stores audio data, tempo map data, and performance data of a plurality of music contents. The performance data includes control data for performing a performance guide. In response to the selection of a song by the electronic musical instrument, tempo map data and performance data associated with the selected musical piece are transmitted from the content reproduction apparatus to the electronic musical instrument and stored in the storage unit of the electronic musical instrument. In response to a request from the electronic musical instrument, the content playback apparatus starts playback of the selected song. The electronic musical instrument acquires the current playback position of the music content from the content playback apparatus, and performs a performance guide based on the performance data based on the acquired playback position.

Japanese Patent No. 5109426

  In the above-mentioned Patent Document 1, after all performance data and all tempo map data of music contents are transmitted from the content playback device to the electronic musical instrument, the audio data playback on the content playback device and the performance guide on the electronic musical instrument are performed. Be started. Therefore, it takes time until the reproduction of audio data and the performance guide are started. In addition, it is necessary to store all performance data and tempo map data in the electronic musical instrument, and it is necessary to secure a sufficient storage area in the electronic musical instrument.

  An object of the present invention is to provide a performance guide device, a performance guide program, and a performance guide method capable of reducing the time required to start playback of audio data and performance support and reduce the storage area to be secured. Is to provide.

  The performance guide device according to the present invention comprises a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting performance corresponding to the music content. Receiving means for sequentially receiving a plurality of guide data portions inserted between the audio data portions, storage means for sequentially storing the plurality of received audio data portions and the plurality of guide data portions, A reading means for sequentially reading out the audio data portion and the plurality of guide data portions, a reproducing means for continuously playing back the plurality of read audio data portions, and a plurality of based on the plurality of read guide data portions. Performance support processing means for performing performance support processing synchronized with reproduction of the audio data portion.

  In this performance guide device, a plurality of audio data portions constituting audio data and a plurality of guide data portions constituting guide data and inserted between the plurality of audio data portions are sequentially received. In this case, since the plurality of guide data portions are inserted between the plurality of audio data portions, the plurality of guide data portions can be sequentially received while the plurality of audio data portions are sequentially received. Therefore, it is possible to sequentially perform the performance support processing based on the plurality of guide data portions while continuously reproducing the plurality of audio data portions. Thereby, before all the audio data portions and all the guide data portions are received, reproduction of the audio data portions and performance support based on the guide data portions can be started. Therefore, it is possible to shorten the time required to start playing audio data and supporting performance using guide data.

  Further, it is possible to sequentially reproduce from the received audio data part and to process sequentially from the received guide data part. Therefore, it is not necessary to store all audio data portions and all guide data portions. Therefore, it is possible to reduce the storage area to be secured.

  Each audio data portion includes first identification information, each guide data portion includes second identification information, and the performance guide device performs the audio data portion and the guide based on the first and second identification information. An identification means for identifying the data portion may be further provided. In this case, the received audio data portion and guide data portion can be easily and appropriately identified.

  The second identification information may include a temporal relationship between the plurality of audio data portions and the plurality of guide data portions. In this case, the time point of the performance support process can be specified based on the second identification information of each guide data portion.

  The performance guide program according to the present invention comprises a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting a performance corresponding to the music content. Sequentially receiving a plurality of guide data portions inserted between the audio data portions, sequentially storing the received plurality of audio data portions and the plurality of guide data portions, and a plurality of stored audio Sequentially reading the data portion and the plurality of guide data portions; continuously reproducing the read plurality of audio data portions; and a plurality of audio data portions based on the plurality of read guide data portions. A step of performing performance support processing in synchronization with playback. To be executed by the data.

  The performance guide method according to the present invention includes a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting performance corresponding to the music content. Sequentially receiving a plurality of guide data portions inserted between the audio data portions, sequentially storing the received plurality of audio data portions and the plurality of guide data portions, and a plurality of stored audio Sequentially reading the data portion and the plurality of guide data portions; continuously reproducing the read plurality of audio data portions; and a plurality of audio data portions based on the plurality of read guide data portions. Performing performance support processing synchronized with reproduction.

  According to these performance guide programs and performance guide methods, it is possible to reduce the time required to start playback of audio data and performance support using guide data, and to reduce the storage area to be secured. Become.

  According to the present invention, it is possible to reduce the time required to start playback of audio data and performance support using guide data, and to reduce the storage area to be secured.

It is a block diagram which shows the structure of the music system containing the performance guide apparatus which concerns on embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the music content transmission apparatus of FIG. It is a block diagram which shows an example of the hardware constitutions of the electronic musical instrument of FIG. It is a block diagram which shows the functional structure of a music content transmission apparatus and a performance guide apparatus. It is a figure which shows an example of an audio data part. It is a figure which shows an example of a guide data part. It is a figure for demonstrating transmission of an audio data part and a guide data part. It is a figure for demonstrating transmission of an audio data part and a guide data part. It is a figure for demonstrating the process of each data part received in the electronic musical instrument. It is a figure for demonstrating interchange of the audio data part and guide data part in a memory | storage device. It is a flowchart which shows an example of the music content transmission process in a music content transmission apparatus. It is a flowchart which shows an example of the performance guide process in a performance guide apparatus. It is a flowchart which shows an example of the performance guide process in a performance guide apparatus.

  Hereinafter, a performance guide device, a performance guide program, and a performance guide method according to embodiments of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Music System FIG. 1 is a block diagram showing a configuration of a music system including a performance guide device according to an embodiment of the present invention. The music system 1 in FIG. 1 includes a music content transmission device 100 and an electronic musical instrument 200. The music content transmission device 100 is, for example, a portable information device such as a smartphone or a tablet terminal, or a personal computer. The music content transmission device 100 stores audio data of a plurality of music contents, as well as audio data of selected music contents and selected music. Guide data supporting the performance corresponding to the content is transmitted to the performance guide device 200A. The electronic musical instrument 200 is, for example, an electronic keyboard musical instrument such as an electronic piano, and includes a performance guide device 100A for supporting a user's performance. The performance guide device 100A reproduces the audio data transmitted from the performance guide device 200 and performs performance support processing synchronized with the reproduction of the audio data.

  FIG. 2 is a block diagram showing an example of a hardware configuration of the music content transmitting apparatus 100 of FIG. As shown in FIG. 2, the music content transmitting apparatus 100 includes a touch panel display 101, a detection circuit 102, and a display circuit 103. The touch panel display 101 is connected to the bus 120 via the detection circuit 102 and the display circuit 103.

  The music content transmitting apparatus 100 further includes a RAM (random access memory) 111, a ROM (read only memory) 112, a CPU (central processing unit) 113, a timer 113a, a storage device 114, and a communication I / F (interface) 115. . The RAM 111, the ROM 112, the CPU 113, the storage device 114, and the communication I / F 115 are each connected to the bus 120, and the timer 113a is connected to the CPU 113. The RAM 111 is composed of, for example, a volatile memory, is used as a work area for the CPU 113, and temporarily stores various data. The ROM 112 is composed of, for example, a nonvolatile memory, and stores computer programs such as a system program and a music content transmission program. The CPU 113 performs a music content transmission process described later by executing a music content transmission program stored in the ROM 112.

  The storage device 114 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card, and stores audio data of a plurality of music contents. The music content includes the entire music, a music phrase constituting a part of the music, a part sound of a part of the music, and the like. The music content transmission program may be stored in the storage device 114. The communication I / F 115 is connected to the electronic musical instrument 200 so that wired communication or wireless communication is possible. Audio data and guide data are transmitted to the electronic musical instrument 200 via the communication I / F 115.

  The music content transmission program may be provided in a form stored in a computer-readable recording medium and installed in the ROM 112 or the storage device 114. Further, the communication I / F 115 may be connected to a communication network, and a music content transmission program distributed from a server connected to the communication network may be installed in the ROM 112 or the storage device 114.

FIG. 3 is a block diagram illustrating an example of a hardware configuration of the electronic musical instrument 200 of FIG. As shown in FIG. 3, the electronic musical instrument 200 includes a performance operator 201, a setting operator 202, a display unit 203, an input I / F (interface) 204, a detection circuit 205, a display circuit 206, and a guide unit 250. The performance operator 201 includes a pitch specifier such as a keyboard, and is connected to the bus 220 via the input I / F 204. When the user operates the performance operator 201, performance data is input. The performance data is, for example, MIDI (Musical Instrument Digital
Interface) data.

  The setting operator 202 includes a switch that is turned on and off, a rotary encoder that is rotated, a linear encoder that is slid, and the like, and is connected to the bus 220 via the detection circuit 205. The setting operator 202 is used to adjust the volume, turn on / off the power, and perform various settings. The display unit 203 includes a liquid crystal display, for example, and is connected to the bus 220 via the display circuit 206. The display unit 203 displays various information related to performance or settings. At least a part of the setting operator 202 and the display unit 203 may be configured by a touch panel display.

  The guide unit 250 presents support information for supporting the user's performance to the user. For example, when the performance operator 201 is a keyboard, the guide unit 250 includes a plurality of light emitting elements (for example, light emitting diodes) respectively corresponding to a plurality of keys. Each light emitting element is provided integrally with the corresponding key or at a position adjacent to the corresponding key. When each light emitting element emits light, the timing to press the corresponding key is presented to the user as support information.

  The display unit 203 may include a guide unit 250, and may display a score or a key pressing position as support information. Alternatively, the sound system 215 may include a guide unit 250 and output a guide sound having a pitch to be played as support information.

  The electronic musical instrument 200 further includes a RAM 207, a ROM 208, a CPU 209, a timer 209a, a storage device 210, and a communication I / F 211. The RAM 207, ROM 208, CPU 209, storage device 210, and communication I / F 211 are connected to the bus 220, and the timer 209a is connected to the CPU 209. The RAM 207, ROM 208, CPU 209, and timer 209a constitute a computer.

  The RAM 207 is composed of, for example, a volatile memory, is used as a work area for the CPU 209, and temporarily stores various data. The ROM 208 is composed of, for example, a non-volatile memory, and stores computer programs such as a system program and a performance guide program. The CPU 209 performs a performance guide process described later by executing a chord detection program stored in the ROM 208 on the RAM 207. The timer 209a gives time information such as the current time to the CPU 113.

  The storage device 210 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card, and stores audio data and guide data transmitted from the music content transmitting apparatus 100. The above performance guide program may be stored in the storage device 210. The communication I / F 211 is connected to the music content transmitting apparatus 100 so that wired communication or wireless communication is possible. Audio data and guide data are transmitted from the music content transmitting apparatus 100 via the communication I / F 211.

  The performance guide program may be provided in a form stored in a computer-readable recording medium and installed in the ROM 208 or the storage device 210. Also, the communication I / F 211 may be connected to a communication network, and a performance guide program distributed from a server connected to the communication network may be installed in the ROM 208 or the storage device 210.

  The electronic musical instrument 200 further includes a sound source 213, an effect circuit 214, and a sound system 215. The sound source 213 and the effect circuit 214 are connected to the bus 220, and the sound system 215 is connected to the effect circuit 214. The sound source 213 generates a musical sound signal based on the performance data input by the performance operator 201. The effect circuit 214 gives an acoustic effect to the audio data given from the storage device 210 and the musical sound signal generated by the sound source 213.

  The sound system 215 includes a digital analog (D / A) conversion circuit, an amplifier, and a speaker. The sound system 215 converts the audio data supplied from the storage device 210 through the effect circuit 214 and the musical sound signal supplied from the sound source 213 through the effect circuit 214 into an analog sound signal, and generates a sound based on the analog sound signal. Thereby, a musical sound signal is reproduced. In the electronic musical instrument 2, the guide unit 250, the RAM 9, the ROM 10, the CPU 113, and the storage device 13 mainly constitute the performance guide device 200A.

(2) Functional Configuration FIG. 4 is a block diagram showing a functional configuration of the music content transmitting apparatus 100 and the performance guide apparatus 200A. As shown in FIG. 4, the music content transmitting apparatus 100 includes a receiving unit 11, a guide data acquiring unit 12, an audio data dividing unit 13, a guide data dividing unit 14, an audio data transmitting unit 15, a specifying unit 16, and a guide data transmitting unit. 17 is included. The CPU 113 in FIG. 2 executes the music content transmission program stored in the ROM 112 or the storage device 114, thereby realizing the functions of the respective units of the music content transmission device 100 in FIG.

  The accepting unit 11 accepts designation of music content to be reproduced among a plurality of music contents stored in the storage device 114. For example, the reception unit 11 displays a music content designation screen including a plurality of stored music content title lists on the touch panel display 101 of FIG. The user can designate desired music content on the music content designation screen by operating the touch panel display 101. Hereinafter, the music content that has been designated by the accepting unit 11 is referred to as designated content.

  The guide data acquisition unit 12 acquires guide data for supporting a performance corresponding to the designated content (hereinafter referred to as a corresponding performance). The corresponding performance may be a performance of the designated content itself, an accompaniment of the designated content, or a performance of a part of the designated content. Guide data consists of a collection of event data, for example. Each event data includes time information representing a temporal relationship with audio data. For example, each event data is note-on and note-off event data in the MIDI (Musical Instrument Digital Interface) standard, and includes pitch information and a time stamp indicating a time position in the designated content as time information.

  In this example, the guide data acquisition unit 12 automatically generates guide data based on the audio data of the designated content. For example, the guide data acquisition unit 12 extracts the melody or chord of the specified content from the audio data, generates note information of the corresponding performance based on the extracted melody or chord, and generates guide data based on the note information. . A plurality of methods for extracting a melody or chord from audio data may be prepared, and a melody or chord may be extracted by an extraction method selected by the user from among the plurality of extraction methods. In that case, a different extraction method may be designated for each phrase for one music content.

  The audio data dividing unit 13 divides the audio data of the designated content into a plurality of audio data parts. Each audio data portion is audio data representing a part of designated content, and has a predetermined time length, for example. The guide data dividing unit 14 divides the guide data acquired by the guide data acquiring unit 12 into a plurality of guide data parts. Each guide data portion is composed of one or a plurality of event data.

  In response to the reproduction start request from the performance guide device 200A, the audio data transmission unit 15 controls the communication I / F 115 in FIG. 2 to sequentially transmit a plurality of audio data portions arranged in time series. The specifying unit 16 specifies a plurality of interruptable positions where a plurality of divided guide data portions can be interrupted between the plurality of audio data portions. The guide data transmission unit 17 controls the communication I / F 115 in FIG. 2 to transmit each guide data part by interrupting it at an interruptible position. In this case, mixed data in which a plurality of audio data portions and a plurality of guide data portions are mixed is transmitted from the music content transmitting device 100 to the performance guide device 200A. Details of the mixed data will be described later.

  The performance guide device 200A includes a start reception unit 21, a reception unit 22, an identification unit 23, a reading unit 24, a playback unit 25, and a performance support processing unit 26. The CPU 209 in FIG. 3 executes the performance guide program stored in the ROM 208 or the storage device 210, thereby realizing the functions of the respective units of the performance guide device 200A in FIG. The start receiving unit 21 receives an instruction to start playback of the designated content. For example, the user instructs the start of reproduction of the designated content by operating the setting operator 202 in FIG. When the start reception unit 21 receives a reproduction start instruction, the start reception unit 21 controls the communication I / F 211 in FIG. 3 to transmit a reproduction start request to the music content transmission device 100.

  The receiving unit 22 controls the communication I / F 211 in FIG. 3 to sequentially receive a plurality of audio data portions and a plurality of guide data portions transmitted from the music content transmitting apparatus 100. The identification unit 23 identifies the received audio data portion and guide data portion. The plurality of received audio data portions and the plurality of guide data portions are sequentially stored in the storage device 210.

  The reading unit 24 sequentially reads a plurality of audio data portions and a plurality of guide data portions from the storage device 210. In this case, the reading unit 24 reads the plurality of audio data portions in the order stored in the storage device 210 and reads the plurality of guide data portions in the order stored in the storage device 210. The reproducing unit 25 continuously reproduces the plurality of audio data portions read by the reading unit 24.

  The performance support processing unit 26 performs performance support processing synchronized with the reproduction of the plurality of audio data portions based on the plurality of guide data portions read by the reading unit 24. Thereby, support information is presented to the user from the guide unit 250 of FIG. For example, when the guide unit 250 is a plurality of light emitting elements respectively corresponding to a plurality of keys of the keyboard as the performance operator 201, the performance support processing unit 26 performs performance support based on each read guide data portion. As a process, each light emitting element emits light at an appropriate timing.

(3) Audio Data Part and Guide Data Part FIG. 5 is a diagram showing an example of the audio data part. In FIG. 5, the horizontal axis represents time. In the example of FIG. 5, the audio data AD of the designated content is divided into a plurality of audio data portions PA1, PA2,..., PAn (n is a positive integer). The audio data portion PA1 represents a portion from the start time t0 to the time t1 of the designated content, and the audio data portion PA2 represents a portion from the time t1 to the time t2 of the designated content. Similarly, the audio data portions PA3,..., An-1 each represent a part of the designated content. In this example, the audio data portions PA1, PA2,..., PAn have the same time length.

  FIG. 6 is a diagram illustrating an example of the guide data portion. FIG. 6 shows guide data corresponding to the designated content shown in FIG. In the example of FIG. 6, the guide data GD includes a plurality of guide data portions PG1, PG2, PG3,..., PGm (m is a positive integer). The guide data portion PG1 indicates an event (for example, note-on) that should be generated at the designated content time T1, and the guide data portion PG2 indicates an event (for example, note-off) that should be generated at the specified content time T2. Show. Similarly, guide data portions PG3,... PGm indicate events to be generated at predetermined time positions of the designated content. In FIG. 6, each guide data portion is schematically represented by a rectangle. However, when the guide data portion is composed of event data indicating an instantaneous value, the horizontal width of each guide data portion in FIG. 6 does not make sense.

  In this example, guide data GD is automatically generated based on the audio data AD. Therefore, it is not necessary to prepare the guide data GD in advance, and if there is audio data AD, performance support synchronized with the reproduction of the designated content is realized. In this case, the user can participate in the reproduction of the designated content by performing by performing according to the performance support.

(4) Transmission of audio data portion and guide data portion FIGS. 7 and 8 illustrate transmission of audio data portions PA1, PA2,..., PAn and guide data portions PG1, PG2, PG3,. It is a figure for doing. 7 and 8, the vertical axis represents time. In the example of FIG. 7, the audio data portions PA1, PA2,..., PAn are arranged in time series according to the order in the designated content. Each of the audio data portions PA1, PA2,..., PAn is assigned an identifier D1 representing “Audio”. Guide data part PG1, PG2, ..., PG
Each m is assigned an identifier D2 representing “Instruction”. The identifier D1 is an example of first identification information, and the identifier D2 is an example of second identification information. With these identifiers D1 and D2, the audio data portion and the guide data portion can be easily and appropriately identified. Further, the guide data portions PG1, PG2,... PGm include time stamps TS representing the time points T1, T2,.

  Between the audio data portions PA1, PA2,..., PAn, interruptable positions where the guide data portions PG1, PG2,. For example, based on the data density of each audio data portion, it is determined whether or not each guide data portion can be interrupted between each two adjacent audio data portions on the time axis, and it is determined that interrupt is possible. A position between the two audio data portions is specified as an interruptible position. The data density of the audio data portion depends on the density or quality of the sound to be emitted.

  Specifically, when the data density of two audio data portions adjacent on the time axis is relatively small, a guide data portion can be inserted between the two audio data portions. In addition, when at least one of the last part of the preceding audio data part and the beginning part of the subsequent audio data part of two audio data parts adjacent on the time axis corresponds to the silent part of the designated content, It is possible to interrupt the guide data portion between the audio data portions.

  In this way, each guide data portion is interrupted at an interruptible position specified based on the data density of each audio data portion, so that the audio data portions PA1, PA2,..., PAn and the guide data portions PG1, PG2,... PGm can be transmitted without delay. Therefore, in the performance guide apparatus 200A, it is possible to prevent delays in the reproduction of the audio data portions PA1, PA2,..., PAn and the performance support processing based on the guide data portions PG1, PG2,.

  In the example of FIG. 7, the position between the audio data portions PA2 and PA3 is specified as the interruptable position of the guide data portions PG1 and PG2, and the position between the audio data portions PA4 and PA5 is determined as the interrupt of the guide data portion PG3. It is specified as a possible position.

  It is preferable that the interruptable position of each guide data part corresponds to a time position before the time of occurrence of an event corresponding to the guide data part. In this example, as shown in FIG. 6, the event occurrence times T1 and T2 corresponding to the guide data portions PG1 and PG2 are before the start time t2 of the audio data portion PA3, and correspond to the guide data portion PG3. The event occurrence time T3 is before the start time t3 of the audio data portion PA4.

  The audio data portions PA1, PA2,..., PAn are sequentially transmitted to the electronic musical instrument 200 according to the order in the designated content. In addition, the guide data portions PG1, PG2,..., PGm are interrupted at the specified interruptable position in accordance with the order of occurrence of events, and sequentially transmitted to the electronic musical instrument 200. The interruptable position may be specified while transmitting the audio data part, or may be performed before transmitting the audio data part.

  In the example of FIG. 8, after the audio data portions PA1 and PA2 are sequentially transmitted, the guide data portions PG1 and PG2 are sequentially transmitted, and after the audio data portion PA3 is subsequently transmitted, the guide data portion PG3 is transmitted. . In this way, the mixed data MD in which the guide data portions PG1, PG2,..., PGm are inserted between the audio data portions PA1, PA2,. Hereinafter, the audio data portion and the guide data portion included in the mixed data are collectively referred to as a data portion.

(5) Reception of Mixed Data FIG. 9 is a diagram for explaining processing of each data portion received by the electronic musical instrument 200. As shown in FIG. 9, the electronic musical instrument 200 sequentially receives a plurality of data portions in the mixed data MD. Each received data portion is identified as an audio data portion and a guide data portion based on the identifiers D1 and D2, and stored in the storage device 210. Note that a time stamp TS may be used instead of the identifier D2 as the second identification information for identifying the guide data portion. In that case, the identifier D2 may not be attached to the guide data portion.

  In this example, an audio storage area AR for storing the audio data part and a guide storage area GR for storing the guide data part are respectively secured in the storage device 210. When the received data part is identified as the audio data part, it is stored in the audio storage area AR, and when it is identified as the guide data part, it is stored in the guide data area GR. In the example of FIG. 9, a plurality of audio data portions PA1, PA2,..., PAn are sequentially stored in the audio storage area AR in the order received, and a plurality of guide data portions PG1, PG2,. Are sequentially stored in the guide storage area GR in the order received.

  The audio data portions PA1, PA2,..., PAn stored in the audio storage area AR are continuously reproduced in the stored order. As a result, the sound system 215 of FIG. 3 continuously generates musical sounds of the designated content. The performance support process is performed based on the guide data portions PG1, PG2,..., PAm sequentially stored in the guide data area GR so as to be synchronized with the reproduction of the audio data portions PA1, PA2,. Is called. In this case, the time point of the performance support process corresponding to each guide data portion is determined based on the time information (time stamp TS) of each guide data portion.

  In this example, each audio data portion is erased from the audio storage area AR when the reproduction ends. Each guide data portion is deleted from the guide data storage area GR when the corresponding performance support process is completed.

  FIG. 10 is a diagram for explaining the replacement of the audio data portion and the guide data portion in the storage device 210. In the example of FIG. 10A, the audio data portion PA1 is being reproduced (time t0 to t1 in FIG. 5). At this point, there is no reproduced audio data portion and processed guide data portion. Therefore, audio data portions PA1 to PA5 received at this time are stored in the audio storage area AR, and guide data portions PG1 to PG5 received at this time are stored in the guide data storage area GR. It is remembered.

  In the example of FIG. 10B, the audio data portion PA3 is being reproduced (time points t2 to t3 in FIG. 5). At this time point, the reproduction of the audio data portions PA1 and PA2 is finished, and the performance support process corresponding to the guide data portions PG1 and PG2 is finished. Therefore, the reproduced audio data parts PA1 and PA2 are deleted from the audio storage area AR, and the processed guide data parts PG1 and PG2 are deleted from the guide data area GR. On the other hand, the newly received audio data parts PA6 and PA7 are stored in the audio storage area AR, and the newly received guide data parts PG6 to PG8 are stored in the guide data area GR.

  In the example of FIG. 10C, the audio data portion PA5 is being reproduced (time t4 to t5 in FIG. 5). At this time point, the reproduction of the audio data portions PA3 and PA4 is finished and the processing of the guide data portions PG3 and PG4 is finished as compared with the time point of FIG. Therefore, the reproduced audio data parts PA3 and PA4 are further erased from the audio storage area AR, and the processed guide data parts PG3 and PG4 are further erased from the guide data area GR. On the other hand, the newly received audio data part PA8 is stored in the audio storage area AR, and the newly received guide data part PG9 is stored in the guide data area GR.

  As described above, in this example, the reproduced audio data portions are sequentially deleted in the audio storage area AR, and the newly received audio data portions are sequentially stored. In the guide storage area GR, the processed guide data portions are sequentially erased and the newly received guide data portions are sequentially stored. Thereby, the data capacity in the audio storage area AR and the guide storage area GR can be suppressed. In the audio storage area AR, the reproduced audio data portion may be overwritten with the newly received audio data portion. In the guide storage area GR, the processed guide data part may be overwritten with the newly received guide data part.

(6) Music Content Transmission Processing FIG. 11 is a flowchart illustrating an example of music content transmission processing in the music content transmission device 100. The music content transmission process in FIG. 11 is performed by the CPU 113 in FIG. 2 executing a music content transmission program stored in the ROM 112 or the storage device 114.

  First, the reception unit 11 determines whether or not music content to be played is specified among a plurality of music contents stored in the storage device 114 (step S1). For example, when the user operates the touch panel display 101 of FIG. 2, music content to be played is designated. The reception unit 11 repeats step S1 until the music content to be played is designated. When the music content to be played is designated, the guide data acquisition unit 12 generates guide data based on the audio data of the music content (designated content) to be played stored in the storage device 114 (step S2). .

  Next, the audio data dividing unit 13 divides the audio data of the designated content stored in the storage device 114 into a plurality of audio data parts (step S3). Further, the guide data dividing unit 14 divides the guide data generated in step S2 into a plurality of guide data portions (step S4).

  Next, the specifying unit 16 specifies an interruptible position where a plurality of guide data portions can be interrupted between the plurality of audio data portions (step S5). Next, the audio data transmission unit 15 determines whether or not a reproduction start request from the performance guide device 200A has been received (step S6). The audio data transmitting unit 15 repeats step S6 until a reproduction start request is received. When the reproduction start request is received, the audio data transmission unit 15 controls the communication I / F 115 of FIG. 2 to sequentially transmit a plurality of audio data portions according to the order in the designated content (step S7). The guide data transmission unit 17 controls the communication I / F 115 of FIG. 2 and sequentially transmits a plurality of guide data parts by interrupting the interruptable positions specified in step S5 in accordance with the order of occurrence of events (step S8). . When all the audio data parts and all the guide data parts are transmitted, the music content transmission process ends. In addition, the music content transmission process may be terminated by instructing the user to stop transmission.

(7) Performance Guide Processing FIGS. 12 and 13 are flowcharts showing an example of performance guide processing in the performance guide device 200A. The performance guide process of FIGS. 12 and 13 is performed by the CPU 209 of FIG. 3 executing a performance guide program stored in the ROM 208 or the storage device 210.

  First, the start receiving unit 21 determines whether or not an instruction to start reproduction of the designated content is given (step S21). For example, when the user operates the setting operator 202 shown in FIG. 3, the reproduction start of the designated content is instructed. The start receiving unit 21 repeats step S21 until the start of reproduction of the designated content is instructed. When the start of reproduction of the designated content is instructed, the start receiving unit 21 transmits a reproduction start request (step S22). As a result, transmission of the audio data portion and the guide data portion is started in steps S7 and S8 of FIG.

  Next, the receiving unit 22 determines whether a data part (audio data part or guide data part) is received from the music content transmitting apparatus 100 in the communication I / F 211 of FIG. 3 (step S23). The receiving unit 22 repeats step S23 until the data portion is received. When the data portion is received, the identification unit 23 determines whether or not the received data portion is an audio data portion (step S24). For example, if the received data part is attached with the identifier D1, it is determined that the data part is an audio data part, and if the received data part is attached with the identifier D2 or the time stamp TS, The data part is determined to be a guide data part. If the received data portion is a guide data portion, the identification unit 23 stores the guide data portion in the guide storage area GR of the storage device 210 (step S25), and the process proceeds to step S30.

  In step S24, when the received data portion is an audio data portion, the identification unit 23 stores the audio data portion in the audio storage area AR of the storage device 210 (step S26). Next, the playback unit 25 determines whether or not playback of the audio data portion has started at that time (step S27). When the reproduction of the audio data portion has been started, the reproducing unit 25 continues the reproduction of the audio data portion (step S28), and proceeds to step S30. When the reproduction of the audio data portion has not been started, the reading unit 24 reads the audio data portion stored in step S26 by the reproduction unit 25, and the reproduction unit 25 starts reproducing the read audio data portion. (Step S29), the process proceeds to Step S30.

  In step S30, the reproducing unit 25 determines whether or not the reproduced audio data part is stored in the audio storage area AR. When the reproduced audio data part is stored, the reproducing unit 25 deletes the reproduced audio data part from the audio storage area AR (step S31). If the reproduced audio data portion is not stored, the reproducing unit 25 skips step S31.

  Next, the performance support processing unit 26 determines whether or not the time point of the next performance support process has been calculated (step S32). If the time point of the next performance support process has been calculated, the performance support processing unit 26 proceeds to step S36. If the time point of the next performance support process has not been calculated, the performance support processing unit 26 determines whether or not the guide data portion corresponding to the next performance support process is stored in the guide storage area GR (step S33). ). When the next guide data portion is not received, the next guide data portion is not stored in the guide storage area GR. In that case, the performance support processing unit 26 proceeds to step S39.

  When the next guide data portion is stored, the reading unit 24 reads the next guide data portion from the guide storage area GR (step S34). Next, the performance support processing unit 26 calculates the time point of the next performance support process based on the read time stamp TS of the guide data portion (step S35). For example, based on the playback position, playback tempo, and time position indicated by the time stamp TS in the specified content at the current time, the time until the next performance support processing time can be calculated. In this case, the time after the time calculated from the current time has elapsed is calculated as the time of the next performance support process.

  Next, the performance support processing unit 26 determines whether or not the next performance support processing time has come based on the time information given from the timer 209a of FIG. 3 (step S36). When the next performance support processing time comes, the performance support processing unit 26 performs performance support processing corresponding to the next guide data portion (step S37). After the performance support process, the performance support processing unit 26 deletes the processed guide data portion from the guide storage area GR (step S38).

  Next, the receiving unit 22 determines whether or not a new data portion has been received (step S39). When the new data portion is received, the receiving unit 22 returns to step S24. If no new data portion has been received, the playback unit 25 determines whether or not playback of the last audio data portion has ended. For example, end information indicating the end of the designated content is attached to the last audio data portion. In this case, when the playback of the audio data portion to which the end information is attached ends, the playback unit 25 determines that the playback of the last audio data portion has ended, and ends the process. On the other hand, when the reproduction of the last audio data portion has not ended, the reproducing unit 25 returns to step S28. Note that the performance guide process may be terminated by instructing the user to stop playback.

(8) Effects of the Embodiment In the performance guide device 200A according to the present embodiment, a plurality of audio data portions constituting audio data of music content to be reproduced and a plurality of guides constituting guide data of the music content. Data portions are received sequentially. In this case, since the plurality of guide data portions are inserted between the plurality of audio data portions, the plurality of guide data portions can be sequentially received while the plurality of audio data portions are sequentially received. Therefore, it is possible to sequentially perform the performance support processing based on the plurality of guide data portions while continuously reproducing the plurality of audio data portions. Thereby, before all the audio data portions and all the guide data portions are received, reproduction of the audio data portions and performance support based on the guide data portions can be started. Therefore, it is possible to shorten the time required to start playing audio data and supporting performance using guide data.

  Further, it is possible to sequentially reproduce from the received audio data part and to process sequentially from the received guide data part. Therefore, it is not necessary to store all audio data portions and all guide data portions. Therefore, it is possible to reduce the storage area to be secured in the storage device 210.

(9) Other Embodiments In the above embodiment, in the performance guide device 200A, the audio storage area AR and the guide storage area GR are separately secured in the storage device 210. It may be stored in a common area of the storage device 210.

  In the above embodiment, the music content to be played back is specified in the music content transmitting apparatus 100, but the music content to be played back in the electronic musical instrument 200 may be specified. In this case, content specifying information indicating the specified music content is transmitted from the electronic musical instrument 200 to the music content transmitting device 100, and the receiving unit 11 of the music content transmitting device 100 receives the specification of the music content based on the content specifying information. .

  In the above embodiment, the music content transmitting apparatus 100 automatically generates the guide data GD based on the audio data of the designated content. However, guide data may be prepared in advance. Further, once the guide data GD generated once is stored in the storage device 114 and the same music content is designated again, the stored guide data GD may be read from the storage device 114.

(10) Correspondence between each constituent element of claims and each part of the embodiment Hereinafter, an example of correspondence between each constituent element of the claim and each part of the embodiment will be described, but the present invention is limited to the following example. Not. As each constituent element in the claims, various other elements having configurations or functions described in the claims can be used.

  In the above embodiment, the receiving unit 22 is an example of a receiving unit, the storage device 210 is an example of a storing unit, the reading unit 24 is an example of a reading unit, and the reproducing unit 25 is an example of a reproducing unit, The performance support processing unit 26 is an example of a performance support processing unit, and the identification unit 23 is an example of an identification unit.

  The present invention can be effectively used in various devices for supporting performance.

DESCRIPTION OF SYMBOLS 11 ... Reception part, 12 ... Guide data acquisition part, 13 ... Audio data division part, 14 ... Guide data division part, 15 ... Audio data transmission part, 16 ... Identification part, 17 ... Guide data transmission part, 21 ... Start reception part , 22 ... receiving unit, 23 ... identification unit, 24 ... reading unit, 25 ... playback unit, 26 ... performance support processing unit, 100 ... music content transmitting device, 101 ... touch panel display, 102 ... detection circuit, 103 ... display circuit, 111,207 ... RAM, 112,208 ... ROM, 113,209 ... CPU, 113a ... timer, 114,210 ... storage device, 115, 211 ... communication I / F, 120 ... bus, 200 ... electronic musical instrument, 201 ... performance Operator 202, setting operator 203, display, 204, input I / F, 205, detection circuit, 206, display circuit, 209a, tie , 213 ... sound source, 214 ... effect circuit, 215 ... sound system, 250 ... guide portion

Claims (5)

Between a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting performance corresponding to the music content and between the plurality of audio data portions Receiving means for sequentially receiving a plurality of inserted guide data portions;
Storage means for sequentially storing a plurality of received audio data portions and a plurality of guide data portions;
Reading means for sequentially reading a plurality of audio data portions and a plurality of guide data portions from the storage means;
Playback means for continuously playing back a plurality of read audio data portions;
A performance guide apparatus comprising performance support processing means for performing performance support processing synchronized with reproduction of the plurality of audio data portions based on the plurality of read guide data portions. Each audio data portion includes first identification information;
Each guide data portion includes second identification information,
The performance guide apparatus according to claim 1, further comprising an identification unit that identifies an audio data portion and a guide data portion based on the first and second identification information. The performance guide device according to claim 2, wherein the second identification information includes a temporal relationship between the plurality of audio data portions and the plurality of guide data portions. Between a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting performance corresponding to the music content and between the plurality of audio data portions Sequentially receiving a plurality of inserted guide data portions;
Sequentially storing a plurality of received audio data portions and a plurality of guide data portions;
Sequentially reading a plurality of stored audio data portions and a plurality of guide data portions;
Continuously playing a plurality of read audio data portions;
Performing performance support processing synchronized with reproduction of the plurality of audio data portions based on the plurality of read guide data portions;
A performance guide program to be executed by a computer. Between a plurality of audio data portions constituting audio data of music content to be reproduced and arranged in time series, and guide data for supporting performance corresponding to the music content and between the plurality of audio data portions Sequentially receiving a plurality of inserted guide data portions;
Sequentially storing a plurality of received audio data portions and a plurality of guide data portions;
Sequentially reading a plurality of stored audio data portions and a plurality of guide data portions;
Continuously playing a plurality of read audio data portions;
Performing a performance support process in synchronization with reproduction of the plurality of audio data portions based on the plurality of read guide data portions.

Images