JP7100701B2 - Music playback operation device and program - Google Patents

Description

The present invention relates to a music reproduction operation device and a program.

In recent years, in the field of SNS (Social Networking Service), DJ performances performed by oneself using a music playback operation device such as a DJ controller are uploaded as active contents such as videos, and one's DJ play is widely viewed by the public. , Is being done to appeal to the viewer. When viewing such a video, the viewer may want to randomly access any music that is continuously played in the video. If a chapter or the like is set at the playback start position of the music data in the video, random access can be easily performed.

By the way, even in moving images such as movies provided by streaming or downloading, chapters are set at positions that oneself wants to repeatedly play.
Previously, chapter setting was done manually, but since manual chapter setting is time-consuming, a technique for automatically setting chapters has been proposed.

However, since the automatically set chapters do not always match the time when you want to start the playback of yourself, there is a problem that you have to rely on the manual chapter setting in the end.
As a method for solving this, for example, in Patent Document 1, operation information for a user's content is acquired, the acquired operation information is specified as an operation pattern of the content, and a chapter is based on the specified operation pattern information. Techniques for determining the position are disclosed.

Japanese Unexamined Patent Publication No. 2012-195025

However, in the technique described in Patent Document 1, since the operation pattern of the content is specified from the operation information for the user's content, only the specified limited operation pattern can determine the chapter position.
On the other hand, in a music reproduction operation device such as a DJ controller, the operation of the DJ controller is complicated in various ways, and it is difficult to specify it as an operation pattern, and the technique described in Patent Document 1 cannot cope with it. There are challenges.

An object of the present invention is to provide a music reproduction operation device and a program capable of easily setting a reproduction time position of music data continuously reproduced in active contents.

The music reproduction operation device of the present invention is a music reproduction operation device that reproduces active contents including a plurality of consecutive music data and sets a reproduction start time point of the music data being reproduced, and is a music reproduction operation device of the music data being reproduced. Time position to register the playback time position of the music data being played in the active content based on the operation status acquisition unit for acquiring the operation status of the volume and the operation status of the volume acquired by the operation status acquisition unit. It has a registration department.
The computer-readable program of the present invention causes the computer to function as the above-mentioned music reproduction operation device.

The schematic diagram which shows the structure of the music-playing operation apparatus which concerns on embodiment of this invention. The block diagram of the music reproduction operation apparatus in the said Embodiment. The schematic diagram for demonstrating the registration of the play time position of the music data in the movie data in the said Embodiment. The schematic diagram which shows the registered reproduction time position of the music data in the said embodiment. The flowchart for demonstrating the operation of the said Embodiment.

Hereinafter, an embodiment of the present invention will be described. FIG. 1 shows a music reproduction operation device 1 according to an embodiment of the present invention. The music reproduction operation device 1 includes a DJ controller 2, a computer 3, and a speaker 4. The DJ controller 2 and the computer 3 are connected so as to be capable of bidirectional communication by a USB cable 5 capable of bidirectional communication. The DJ controller 2 and the speaker 4 are connected by an analog cable 6.

The DJ controller 2 performs a scratch, loop playback, CUE, or other playback operation on the music being played on the computer 3 by the operator. Further, the DJ controller 2 performs effect processing such as phase and noise on the music data being played. The DJ controller 2 includes two deck units 2A arranged on the left and right sides and a mixer unit 2B arranged between the two deck units 2A.

The deck unit 2A is a main part in which the operator operates the DJ controller 2, and performs various special reproduction operations such as scratching, loop reproduction, and queuing on the music data being reproduced by the computer 3.
Specifically, the deck unit 2A includes a jog dial 21, a tempo slider 22, a cue button 23, a play / pause button 24, and a performance pad 25 so that a two-channel sound source can be connected to each deck unit 2A. It has become.

The jog dial 21 functions as a rotation controller, and the operator can rotate the jog dial 21 to increase the speed of the music data being played in the forward direction or rotate it in the reverse direction for reverse playback. .. Further, the jog dial 21 can perform scratch reproduction peculiar to DJ performance by repeating rotation in the forward direction and the reverse direction.
The tempo slider 22 is a lever for adjusting the reproduction speed of the music data being reproduced. When it is slid from the center to the upper part, the reproduction speed is increased, and when it is slid to the lower part, the reproduction speed is decreased.

The cue button 23 can be operated by the operator to set the reproduction start position of the music data as a cue point. Specifically, when the cue button 23 is operated, a predetermined position in the music data is set as a cue point, and at the next playback start, playback is started from the set cue point.
The play / pause button 24 can be operated by the operator to start and stop the reproduction of the music data being reproduced.
The performance pad 25 can be operated by the operator to switch the effect on the music data being played. For example, by operating the performance pad 25 by the operator, effects such as loops, cues, and key shifts can be instantaneously applied to the music data being played.

The mixer unit 2B adjusts the output volume level output from the left and right deck units 2A by being operated by the operator, and various effects such as chorus, echo, and noise are applied to the music data being played. Can be granted.
The mixer unit 2B includes an effect selection knob 26, an effect amount adjustment knob 27, a channel fader 28, and a crossfader 29.

The effect selection knob 26 can select the effect processing for the music data by the operator rotating the operation. The effect processing that can be selected is, for example, chorus, echo, distortion, noise, or the like.
The effect amount adjustment knob 27 is configured as a knob that can be rotated steplessly, and the operator can adjust the depth and size of the effect processing for the music data by rotating the knob 27.

The channel fader 28 can be operated by the operator to adjust the output volume level in each channel of the deck unit 2A.
The crossfader 29 is a lever for switching the output volume level of the music data output from the left and right deck portions 2A.
In addition, the mixer unit 2B is provided with an equalizer adjustment knob that can change the sound quality by adjusting the output volume level in the high frequency range, medium frequency range, and low frequency range in each channel by the operator's operation. ..
Further, the DJ controller 2 includes a display unit 30 that displays a waveform indicating the progress of music data being played and a cue point position.

As shown in FIG. 1, the computer 3 includes a display 31 and a keyboard 32, and the movie playback software linked with the DJ controller 2 is executed, and the time position registration software as a computer-readable program of the present invention is executed. Will be done. In the present embodiment, the computer 3 is connected by the USB cable 5, but the present invention is not limited to this. For example, a PDA (Personal Digital Assistant) capable of wirelessly communicating with the DJ controller 2 may be used instead of the computer 3.
FIG. 2 shows a functional block diagram of the computer 3. The computer 3 includes a storage device 33 such as a hard disk and an SD memory, and an arithmetic processing device 34.

The storage device 33 stores various software and data including a movie reproduction software storage unit 331, a time position registration software storage unit 332, a movie data storage unit 333, and a time position storage unit 334.
The movie playback software storage unit 331 stores software for playing back the movie data stored in the movie data storage unit 333. When the movie playback software is loaded into the arithmetic processing device 34, the movie playback unit 341, the playback control unit 342, and the movie output unit 343 are executed.

The time position registration software storage unit 332 stores the time position registration software for registering the reproduction time position of each music data during the reproduction of the movie data including a plurality of music data continuously. The computer-readable time position registration software is loaded into the arithmetic processing device 34, so that the operation status acquisition unit 344, the time position registration unit 345, the time position correction unit 346, and the time position display unit 347 are executed.
A plurality of movie data are stored in the movie data storage unit 333 in a predetermined format such as an MPEG format. The stored movie data is used, for example, to store a moving image such as a DJ performance in which a plurality of songs are continuously played during playback, and to appeal one's own performance by uploading it on the Internet.

The movie playback unit 341 selects desired movie data from a plurality of movie data stored in the movie data storage unit 333, and reproduces the selected movie data. Specifically, the movie playback unit 341 decompresses the compressed MPEG format file and converts it into a format that can be processed in the arithmetic processing device 34.
Further, the movie reproduction unit 341 feeds back the DJ performance captured by the CCD camera or the like, and reproduces the image as movie data at the same time as the imaging. The fed-back movie data is displayed on the display 31 via the movie output unit 343.

The reproduction control unit 342 reflects the operation status of the controls for adjusting the volume of the channel fader 28, the crossfader 29, etc. provided in the mixer unit 2B of the DJ controller 2 in the movie data, and reflects the operation status of the controls for adjusting the volume in the movie data, and the predetermined time position of the movie data. To switch the output volume level of continuous music data with.
The movie output unit 343 outputs movie data reflecting the operation status of the DJ controller 2 by the playback control unit 342 and displays it on the display 31.

The operation status acquisition unit 344 monitors the operation status of the DJ controller 2 input to the reproduction control unit 342, and acquires the operation status of the channel fader 28 and the crossfader 29.
The time position registration unit 345 registers the playback time position of continuous music data in the movie data based on the operation status of the channel fader 28 and the crossfader 29 acquired by the operation status acquisition unit 344.
Specifically, as shown in FIG. 3, the time position registration unit 345 registers the reproduction start time of the music data SD4 from the music data SD1 included in the movie data MD as the reproduction start time position.

The time position registration unit 345 registers the time position where the output volume level of the music data exceeds a predetermined threshold value TH as the reproduction start time position of each music data.
However, as in the second to fourth songs in FIG. 3, the time when the operator operates the channel fader 28 and the crossfader 29 in small steps to exceed the threshold TH of the music data SD2 from the music data SD2 is continuous for a predetermined time. If this is not done, it is not preferable to determine the playback start time position of the music data SD4 from the music data SD1. Therefore, the time position correction unit 346 performs correction before registering the music data SD1 in the time position storage unit 334.

The time position correction unit 346 operates the operator's channel fader 28 and crossfader 29 in small steps, and if the time exceeding the threshold value TH does not reach a predetermined time, the time position is excluded from the playback start time position. do. Then, the time position correction unit 346 corrects the time point in which the time exceeding the threshold value TH continues for a predetermined time as the reproduction start time position, as in the case of the music data SD2 to the music data SD4.

The time position registration unit 345 registers the artist and the song name acquired from the metadata of each music data and the playback start time position in the movie data MD of the music as a table format file in the time position storage unit 334.
At that time, for example, the time position registration unit 345 generates a CUE file separately from the file of the movie data MD, associates it with the movie data MD, and registers it in the time position storage unit 334. The data format of the file to be registered is not limited to the CUE file, and may be a file of another data format, and may be attached to the movie data MD.

The time position display unit 347 displays the reproduction start time position of the music data SD1 to the music data SD4 on the display 31 together with the reproduction time position of the movie data. Specifically, as shown in FIG. 4, the time position display unit 347 is placed on the playback time position of the movie data MD from the playback start time position # 1 of the music data SD1 to the playback start time position # of the music data SD4. 4 is displayed on the display 31 in a graph format.
Further, the time position display unit 347 displays the artist name, the song name, and the start time of the music data SD1 to the music data SD4 as a table TBL under the graph of the playback time position of the movie data MD.

Next, the operation of this embodiment will be described with reference to the flowchart shown in FIG.
The arithmetic processing device 34 of the computer 3 loads the time position registration software stored in the storage device 33, and activates the time position registration software (procedure S1).
Imaging of the DJ performance performed by the operator is started by a CCD camera or the like (procedure S2).
The operation status acquisition unit 344 acquires the operation status of the DJ controller 2 performed by the operator (procedure S3).
The time position registration unit 345 determines whether or not there is a volume operation in the operation of the DJ controller 2 (procedure S4). If it is not a volume operation, the acquisition of the operation status is continued.

When it is determined that the volume operation is performed, the time position registration unit 345 determines whether or not the output volume level exceeds a predetermined threshold value TH (procedure S5). If it is determined that the threshold value TH is not exceeded, the acquisition of the operation status is continued.
When it is determined that the threshold value TH is exceeded, the time position registration unit 345 determines whether or not the time exceeding the threshold value TH is continuous for a predetermined time (procedure S6).

If it is determined that the time position is not continuous for a predetermined time, the time position correction unit 346 makes a correction to exclude the time position from the reproduction start time position of the music data (procedure S7).
When it is determined that the time position is continuous for a predetermined time, the time position registration unit 345 maintains the registration of the time position as the reproduction start time position of the music data. Specifically, in the case of the music data SD1 in FIG. 3, since the output volume level is maintained for a predetermined time from the point P0 exceeding the threshold value TH, the point P0 is registered as the reproduction start time position. On the other hand, in the case of the music data SD2, the threshold value TH is exceeded from the point P1 to the point P5, but the exceeded time is not continuous for a predetermined time, the point P1 to the point P4 are excluded, and the point P5 is the playback start time. Registered as a location.

The time position registration unit 345 determines whether or not all the movie data MDs have been completed (procedure S8).
If it is determined that the movie data MD has not ended, the feedback reproduction of the movie data MD is continued, and the operation status acquisition unit 344 continues to acquire the operation status.
When it is determined that the movie data MD has ended, the time position registration unit 345 generates a CUE file from the music data SD1 with the artist name, song name, and playback start time position of the music data SD4 as table format information. , It is stored in the time position storage unit 334 of the storage device 33 in association with the captured movie data (procedure S9).

According to such an embodiment, there are the following effects.
In the present embodiment, during the imaging of the movie data MD of the DJ performance, the operation status of the volume of the DJ controller 2 is acquired by the operation status acquisition unit 344, and the playback start time position is registered by the time position registration unit 345. There is. Therefore, while the DJ performance is being imaged by the movie data MD, the playback start time position of the music data SD4 can be automatically registered from the music data SD.
Therefore, the playback start time position of the music data SD4 can be easily set from the continuous music data SD in the movie data MD, and it is not necessary to manually register the playback start position while watching the movie data MD.

In the present embodiment, the time position display unit 347 can visually recognize the reproduction start time position of the music data SD4 from the music data SD1 in the movie data MD. Therefore, when the movie data MD is uploaded to the Internet or the like, the viewer who watches the movie data MD can select the playback start time position at his / her own discretion and repeatedly watch the reproduced image and the reproduced music.
Further, by providing the viewer with a table TBL such as a CUE file together with the movie data, the viewer can freely edit the playback start position.
In the present embodiment, the time when the output volume level of the music data being played exceeds a predetermined threshold value is registered as the playback start time position. Therefore, the viewer of the movie data MD can recognize the music data SD4 from the reproduced music data SD from a state in which the music data SD4 can be sufficiently viewed.

In the present embodiment, when the time exceeding the threshold value of the output volume level of the music data SD4 from the music data SD2 being played is not continuous for a predetermined time, the time position correction unit 346 registers the time as the playback start time position. Is excluded. Therefore, it is possible to prevent the registration of the playback time position at the position where the output volume of the music data SD1 of the previous song and the output volume of the music data SD1 of the subsequent music are mixed, and the output volume of the music data SD2 to the music data SD4 is stable. At that point, it can be reliably registered as the playback start time position.

The present invention is not limited to the above-described embodiment, but also includes the following modifications.
In the above-described embodiment, the playback start time position of the music data SD4 is registered from the continuous music data SD in the movie data MD, but the present invention is not limited to this. For example, the present invention may be applied to active content consisting only of audio and active content consisting of audio and still images.

In the above-described embodiment, the playback start time position of the music data SD1 is registered from the music data SD1, but the present invention is not limited to this. For example, the playback end time position, the verse start time position excluding the intro of the music, and the chorus start time position where the music is most excited may be registered as the playback time position.
In the above-described embodiment, if the output volume level does not continuously meet the predetermined threshold value TH for a certain period of time, it is excluded from the registration as the reproduction start time position, but the present invention is not limited to this. For example, when the operator scratches the jog dial 21 of the DJ controller 2 at the seam of a musical piece, the scratch start position is not registered as the playback start time position, but the time when the scratch ends is registered as the playback start time position. It may be corrected as follows.

In the above-described embodiment, the present invention has been applied to the music reproduction operation device 1 in which the DJ controller 2 and the computer 3 are connected by the USB cable 5, but the present invention is not limited to this. For example, the present invention may be applied to a music playing operation device composed of software activated on a computer 3.
In addition, the specific procedure, device configuration, etc. for carrying out the present invention may be other procedures, device configurations, etc. as long as the object of the present invention can be achieved.

1 ... Music playback operation device, 2 ... DJ controller, 2A ... Deck section, 2B ... Mixer section, 3 ... Computer, 4 ... Speaker, 5 ... USB cable, 6 ... Analog cable, 21 ... Jog dial, 22 ... Tempo slider, 23 Cue button, 24 ... play / pause button, 25 ... performance pad, 28 ... channel fader, 29 ... crossfader, 30 ... display, 31 ... display, 32 ... keyboard, 33 ... storage device, 34 ... arithmetic processing device, 331 ... Movie playback software storage unit, 332 ... Time position registration software storage unit, 333 ... Movie data storage unit, 334 ... Time position storage unit, 341 ... Movie playback unit, 342 ... Playback control unit, 343 ... Movie output unit, 344 ... Operation status acquisition unit, 345 ... Time position registration unit, 346 ... Time position correction unit, 347 ... Time position display unit, MD ... Movie data, SD ... Music data, SD1 ... Music data, SD2 ... Music data, SD3 ... Music Data, SD4 ... music data, TBL ... table, TH ... threshold.

Claims (5)

A music playback operation device that plays active content including a plurality of consecutive music data and sets the playback time position of the music data being played.
The operation status acquisition unit for acquiring the operation status of the volume of the music data being played, and the operation status acquisition unit.
Time position registration for registering the time when the output volume level of the music data being played in the active content exceeds a predetermined threshold value as the playback time position based on the operation status of the volume acquired by the operation status acquisition unit. Department and
When the time exceeding the threshold value of the music data being played is not continuous for a predetermined time, the time position correction unit for correcting the playback time position registered in the time position registration unit and the time position correction unit.
A music playback operation device equipped with. In the music reproduction operation device according to claim 1,
A music reproduction operation device including a time position display unit that displays a reproduction time position registered by the time position registration unit together with the reproduction time position of the active content during reproduction of the active content. In the music reproduction operation device according to claim 1 or 2.
The time position correction unit is used in correcting the reproduction time position.
When the time exceeding the threshold value of the music data being played is not continuous for a predetermined time, the time point at which the output volume level of the music data being played exceeds the threshold value is excluded from the playback time position. ,
When the time exceeding the threshold value of the music data being played is continuous for a predetermined time, the time when the output volume level of the music data being played exceeds the threshold value is set as the playback time position. Operation device. In the music reproduction operation device according to claim 1 or 2.
The time position correction unit is
Based on the operation status acquired by the operation status acquisition unit, it is determined whether or not the scratch operation has been performed.
When the scratch operation is performed, the music reproduction operation device sets the time point at which the scratch operation is completed as the reproduction time position. A computer-readable program that causes a computer to function as the music reproduction operation device according to any one of claims 1 to 4.

Images