JP2014048471A - Server, and music reproduction system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a reproduction device side to reproduce posting data obtained by sound recording signing and musical performance by easily erasing only the sound of a specific part or reducing the volume of the sound when reproducing the posting data.SOLUTION: A host server generates music streaming data of a streaming distribution type in each part from internal musical data of Karaoke music made of parts divided in each different kind of sound. The host server also generates second streaming data of a streaming distribution type in each part of each different kind of sound from posting data uploaded from a Karaoke device. When receiving a distribution request for posting data from a user terminal, the host server transmits each streaming data corresponding to the distribution request to the user terminal by restricting sound outputted by music streaming data or posting streaming data which corresponds to a predetermined or user's arbitrary part among music streaming data and posting streaming data corresponding to the distribution request.

Description

  The present invention relates to a technique for distributing public data including sound data obtained by recording a user's singing sound and musical instrument performance sound to a terminal device.

  Conventionally, for example, as a service form such as a karaoke network system, public data including sound data obtained by recording musical instrument performance sounds and singing sounds by a user is posted on a server, and the public data posted on the server is used as a karaoke device, musical instrument performance device, or the like. There is a service that plays music on other music players.

  As this type of prior art, there is a karaoke network system described in Patent Document 1. Japanese Patent Laid-Open No. 2004-151867 discloses that, when a postal data (public data) and music data are played back in synchronization on a viewer's karaoke device, the sound included in the post data among a plurality of performance parts included in the music data. A technique for reproducing a corresponding performance part in a state where the sound is erased (minus one) is disclosed. By doing in this way, the performance part corresponding to the musical instrument or singing performed by the poster is not reproduced, and the performance sound of the music data and the performance sound of the posted data are not overlapped.

  The “public data” referred to here is a concept including the above-mentioned post data posted by the user, and data provided by the karaoke service operator for example, such as model performance data of a professional artist. It is.

JP 2010-237553 A

  In the above prior art, when other users view the public data uploaded to the server, the public data is downloaded by a dedicated karaoke device, and the music reproduced by synchronizing the public data and the music data by the karaoke device is reproduced. , Other users can watch. At this time, minus one is applied to the reproduction of the music data reproduced together with the public data by the karaoke apparatus.

  In this way, when viewing public data with a device dedicated to karaoke, playback is performed by applying minus one to the music data using a dedicated function of the karaoke device (for example, a sound source board or a dedicated software sound source). It can be performed. However, when viewing public data on a general personal computer or portable information terminal owned by the user, a dedicated sound source is required to play only a specific sound of the music data while erasing or reducing the volume. It was necessary to install an application to replace the board, etc., which was not easy to use.

  The present invention has been made to solve the above problems. The purpose of this is to play back the public data where singing and performances are recorded without having to implement a special mechanism on the playback device side, in which only the sound of a specific part is deleted or the volume is lowered. It is to provide a technique for enabling reproduction.

  The server of the present invention made to achieve the above object includes storage means, first generation means, second generation means, distribution reception means, and transmission means. The storage means includes music identification information for identifying music, first input sound information representing a sound acquired from a sound source, and first sound identification information for identifying a type of sound represented by the first input sound information. The associated first public data is stored. The first generation means generates first streaming data in a predetermined data format capable of streaming distribution for each part from music data composed of parts divided according to sound types. The second generation means performs second streaming in a predetermined data format capable of streaming distribution for each part for each type of sound indicated by the first sound identification information from the first input sound information included in the first public data. Generate data. The distribution accepting unit accepts the first public data distribution request from the terminal device via the network.

  The transmission means includes first streaming data corresponding to music identification information included in the first public data corresponding to the distribution request and second input corresponding to first input sound information included in the first public data corresponding to the distribution request. The streaming data is transmitted to the requesting terminal device via the network. At this time, the transmission means limits the sound output by the first or second streaming data of a specific part among the parts constituting the first and second streaming data to be transmitted to the requesting terminal device, Transmit first and second streaming data.

  According to the present invention, the sound output by the streaming data of a specific part from among the music data and the public data generated from the first and second streaming data for each part divided by the type of sound. And can be distributed to the requesting terminal device. In this way, only the sound of a specific part can be erased or volumed easily in the terminal device without implementing a dedicated mechanism on the terminal device side that receives and reproduces music and public data from the server. Playback can be performed in a state of lowering.

  Next, the server according to claim 2 has the following characteristics. In other words, the server further includes part accepting means for accepting designation of a part that restricts sound output from the terminal device via the network. The transmission means limits the sound output by the first or second streaming data of the part for which the designation is accepted, and transmits the first and second streaming data. By doing in this way, the sound output by the streaming data of an arbitrary part of the user can be restricted by the designation from the terminal device side of the user who views the public data, which is convenient.

  Or you may comprise as described in Claim 3. That is, the transmission means restricts the sound output by the first streaming data of the part corresponding to the type of sound indicated by the first sound identification information included in the first public data corresponding to the distribution request, and And transmitting the second streaming data. In this way, when streaming data is played back on the terminal device side, the performance sound of the music does not overlap with the user's performance sound or singing sound in the public data, and it becomes easy to listen.

  By the way, when the user's public data posted on the server is reproduced on the karaoke device or the like, simultaneously with the output of the voice of the public data, the user's performance or singing voice performed in real time on the karaoke device is output at the same time. Services that allow users to enjoy non-real-time collaboration have been proposed. In addition, a service has been proposed in which the second input sound input by such a collaboration and by the sound source handled by the user can be further posted as public data.

  Therefore, a configuration as described in claim 4 is preferable. That is, when the music playback device performs a performance using the first public data downloaded from the server, the storage means uses the music playback device as public data regarding the second input sound acquired from the sound source by the music playback device. Uploaded second public data, which is represented by music identification information, first input sound information, first sound identification information, second input sound information representing the second input sound, and second input sound information. Second public data associated with second sound identification information for identifying the type of sound to be stored is stored. And a 2nd production | generation means further produces | generates 2nd streaming data for every part according to the kind of sound shown by 2nd sound identification information from the 2nd input sound information contained in 2nd public data. The distribution accepting unit accepts a second public data distribution request from the terminal device.

  When receiving the distribution request for the second public data, the transmission means transmits the first and second streaming data corresponding to the second public data corresponding to the distribution request to the requesting terminal device. Of the parts of the second streaming data, the sound output by the first or second streaming data of a specific part is limited. In this way, the second public data generated by the collaboration with the first public data is also distributed to the terminal device that requested the distribution by limiting the sound output by the streaming data of the specific part. be able to.

  Further, as described in claim 5, the transmitting means includes the first sound identification information included in the second public data corresponding to the distribution request and the part number corresponding to the sound type indicated by the second sound identification information. It may be configured to transmit the first and second streaming data while limiting the sound output by the one streaming data. In this way, even when streaming data related to the second public data created by collaboration is reproduced on the terminal device side, the performance sound of the music and the user's performance sound and singing sound in the second public data are It becomes easy to listen without overlapping.

  By the way, in this invention, uploading the performance sound of the musical instrument which a user performs as public data to a server can be considered. Therefore, as described in claim 6, the music data is composed of a plurality of parts divided according to the type of the instrument, and the first input sound information representing the sound acquired from the sound source is used as the performance sound by the instrument. The first sound identification information may be information for identifying the type of musical instrument as the type of sound. By doing in this way, the public data which recorded the performance sound which the user played the musical instrument can be viewed with a terminal device.

  Next, the music playback system of the present invention made to achieve the above object comprises a server and a terminal device. The server includes a storage unit, a first generation unit, a second generation unit, a distribution reception unit, and a transmission unit. Among these, the transmission means corresponds to the first streaming data corresponding to the music identification information included in the first public data corresponding to the distribution request and the first input sound information included in the first public data corresponding to the distribution request. The second streaming data to be transmitted is transmitted to the requesting terminal device via the network.

  On the other hand, the terminal device includes a distribution request unit, a reception unit, and a control unit. The distribution request unit transmits a distribution request for the first public data to the server via the network. The receiving means receives the first and second streaming data related to the first public data corresponding to the distribution request from the server via the network. The control means limits the output of sound by the first or second streaming data of a specific part among the parts of the first and second streaming data received by the receiving means, and outputs the first and second streaming data. Play and output the played sound.

  According to the present invention, the server can distribute, to the requesting terminal device, the first and second streaming data of the music and the public data that are divided in advance according to the type of sound. By doing so, the terminal device can delete only the sound of a specific part or reduce the volume from the first and second streaming data generated separately for each part by sound type by the server. Playback can be performed. This allows the terminal device to simply delete the sound of a specific part or reduce the volume without implementing a dedicated mechanism on the terminal device side that receives and plays music and public data from the server. Can be played.

  Next, the server according to claim 8 has the following characteristics. That is, the terminal device further includes a part receiving unit that receives designation of a part that restricts the output of sound. Then, the control unit of the terminal device reproduces the first and second streaming data by limiting the sound output by the first or second streaming data of the part whose designation is received by the part receiving unit. According to such a configuration, it is possible to limit the sound output by the streaming data of any part of the user by accepting the designation of the part from the user viewing the public data at the terminal device, which is convenient. .

  Or you may comprise as described in Claim 9. That is, the terminal device further includes acquisition means for acquiring the first sound identification information included in the first public data corresponding to the distribution request from the server via the network. Then, the control means of the terminal device restricts the sound output by the first streaming data of the part corresponding to the sound type indicated by the acquired first sound identification information, and reproduces the first and second streaming data To do. In this way, when streaming data is played back on the terminal device side, the performance sound of the music does not overlap with the user's performance sound or singing sound in the public data, and it becomes easy to listen.

  In the music playback system of the present invention, when handling the second public data created by the collaboration with the first public data, it is preferable to configure as in the tenth aspect. That is, in the server, the storage means includes, as the second public data generated by the collaboration performance with the first public data, the music identification information, the first input sound information, the first sound identification information, and the second input sound. 2nd public data in which the 2nd input sound information which expresses, and the 2nd sound identification information which identifies the kind of sound represented by the 2nd input sound information are matched. The second generation means further generates second streaming data for each sound type part indicated by the second sound identification information from the second input sound information included in the second public data stored in the storage means. To do. The distribution accepting unit accepts a second public data distribution request from the terminal device. When receiving the distribution request for the second public data, the transmission unit transmits the first and second streaming data corresponding to the second public data corresponding to the distribution request to the requesting terminal device.

  On the other hand, in the terminal device, the distribution request means transmits a distribution request for the second public data to the server. The receiving unit receives the first and second streaming data related to the second public data corresponding to the distribution request from the server. The control means reproduces the first and second streaming data by limiting the sound output by the first or second streaming data of a specific part among the first and second streaming data parts related to the second public data. To do. By doing so, the terminal device can also reproduce the second public data generated by the collaboration with the first public data by limiting the sound output by the streaming data of the specific part. .

  Furthermore, you may comprise as described in Claim 11. That is, in the terminal device, the acquisition unit acquires the first and second sound identification information included in the second public data corresponding to the distribution request from the server. Then, the control means reproduces the first and second streaming data by limiting the sound output by the first streaming data of the part corresponding to the type of sound indicated by the acquired first and second sound identification information To do. By doing in this way, even when the terminal device reproduces the streaming data related to the second public data created by the collaboration, the musical performance sound overlaps the user's performance sound and singing sound in the second public data. It becomes easy to listen.

  By the way, in this invention, uploading the performance sound of the musical instrument which a user performs as public data to a server can be considered. Therefore, as described in claim 12, the music data is composed of a plurality of parts divided according to the type of the instrument, and the first input sound information representing the sound acquired from the sound source is a performance sound by the instrument. The first sound identification information may be information that identifies the type of musical instrument as the type of sound. According to such a structure, the public data which recorded the performance sound which the user played the musical instrument can be viewed with a terminal device.

1 is a block diagram showing a schematic configuration of a karaoke network system 1. FIG. Explanatory drawing which shows an example of a structure of internal music data. Explanatory drawing which shows an example of a structure of contribution data. FIG. 3 is a sequence diagram showing a sequence of processing related to uploading of posted data and streaming distribution of posted data (first embodiment). FIG. 10 is a sequence diagram showing a series of processing procedures related to uploading post data and streaming distribution of post data (second embodiment).

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In addition, this invention is not limited to the following embodiment at all, and can be implemented in various aspects.
[Description of configuration of karaoke network system 1]
As shown in FIG. 1, the karaoke network system 1 includes a karaoke device 10 installed in a karaoke store, a remote control terminal 30 for remotely operating the karaoke device 10, an external host server 40, and a user terminal 50. Prepare. The karaoke apparatus 10, the remote control terminal 30, the host server 40, and the user terminal 50 are connected to be communicable via the Internet. Moreover, the karaoke apparatus 10 and the remote control terminal 30 are communicably connected via a LAN installed in a karaoke store. In FIG. 1, for ease of understanding, one karaoke device 10 is shown in the karaoke store. However, more LANs in the karaoke store may be connected to the Internet, and one karaoke device 10 may be connected to the Internet. A plurality of karaoke apparatuses 10 may be installed in the karaoke store. The Internet and the LAN are connected by a router (not shown). The LAN may be a wired system or a wireless system.

  The karaoke apparatus 10 includes a control unit 11, a storage unit 12, a music playback unit 13, a voice control unit 14, a video control unit 15, a video input unit 16, an operation unit 17, a communication unit 18, and the like. This karaoke apparatus has functions such as playback of karaoke music, download and playback of post data, and generation and upload of post data. The control unit 11 is an information processing device that controls the entire karaoke apparatus 10. As a main function of the karaoke apparatus 10, the control unit 11 causes the music playback unit 13 to play back the internal music data corresponding to the karaoke music requested by the user.

  The storage unit 12 is a storage device such as a hard disk drive, and includes a karaoke database in which a large number of internal music data for playing karaoke music are recorded, a system program and application program for controlling the operation of the karaoke device 10, and various information contents. The data etc. used for the reproduction are stored.

  The music playback unit 13 plays back music based on internal music data stored in the storage unit 12 and post data downloaded from the host server 40. The voice control unit 14 is a device that controls voice input / output, and includes a microphone input unit 14a, a musical instrument input unit 14b, and an output unit 14c. A microphone 19 is connected to the microphone input unit 14a. Thereby, the microphone input part 14a acquires a user's song sound.

  A musical instrument 20 played by the user is connected to the musical instrument input unit 14b. Thereby, the musical instrument input unit 14b acquires musical instrument sounds performed by the user using the musical instrument 20. The musical instrument input unit 14 b includes a terminal directly connected to the microphone and the musical instrument 20. Note that the musical instrument input unit 14b may be incorporated in the karaoke device 10 or may be configured as a separate device from the karaoke device 10. The musical instrument 20 includes electronic musical instruments realized by a personal computer, a portable information processing terminal, a game machine, and the like, in addition to string instruments, percussion instruments, wind instruments, and keyboard instruments.

  The left and right speakers 21a and 21b are connected to the output unit 14c. The output unit 14c outputs the sound source signal of the music reproduced by the music reproduction unit 13, the singing sound output from the microphone input unit 14a and the instrument input unit 14b, and the sound source signal of the instrument sound to the speakers 21a and 21b. The speakers 21a and 21b output sound source signals output from the output unit 14c instead of sounds.

  The video control unit 15 reproduces and outputs video based on the video data sent from the control unit 11. A monitor 23 for displaying video is connected to the video control unit 15. Thereby, the video control unit 15 displays the reproduced video on the monitor 23. The operation unit 17 is an input device for performing various operations on the karaoke apparatus 10. The communication unit 18 is a communication interface for performing communication by connecting the karaoke apparatus 10 to a LAN.

  The remote control terminal 30 includes a control unit 31 that controls the entire apparatus, an operation unit 32 including a touch panel and a key switch, a storage unit 33 that stores various information, a display unit 34 that displays various information, a LAN, and the Internet. The communication part 35 etc. which control communication are provided. The remote control terminal 30 has a communication function, an information display function, and an input function for a user to perform an input operation. The remote control terminal 30 is input from the user with information about the user such as the requested karaoke song and post data identification information, the user identification information, and the type of sound source (musical instrument or singing) used when recording the post data. Is done. The remote control terminal 30 transmits information input from the user to the karaoke apparatus 10 via the LAN.

  The host server 40 includes a known server device and constitutes a computer system. The host server 40 includes a control unit 41, a storage unit 42 that stores various information, a communication unit 43 that controls communication via the Internet, and the like. The control unit 41 is an information processing device configured mainly with a CPU, ROM, RAM, and the like, and controls the entire apparatus. The control unit 41 executes various processes based on programs and data read from the storage unit 42. The host server 40 has a function of providing music data to the karaoke apparatus 10. Specifically, the storage unit 42 stores music data that can be newly provided. And the control part 41 distributes the music data which are the new music memorize | stored in the memory | storage part 42 to the karaoke apparatus 10. FIG.

  Here, the structure of the internal music data of the karaoke music stored in the storage unit 42 will be described with reference to FIG. The internal music data is composed of music management information in which information related to music is described, and music composition data of a plurality of parts constituting the music. Among these, the music management information includes music identification information and music composition information. The music identification information is identification information (for example, a music number) for identifying a karaoke music. The music composition information is information describing the type of sound (instrument or singing) assigned to each part of the music composition data of a plurality of parts constituting the music. In FIG. 2, as the music composition information, the musical instrument 1 (guitar), the musical instrument 2 (bass), the musical instrument 3 (drum), the musical instrument 4 (piano), and the singing (chorus) are included in each musical composition data 1 to 5. , Shows examples associated with each other. The music composition data is music data created separately for each type of sound. The internal music data includes music composition data of a plurality of parts respectively corresponding to a plurality of sound types. That is, the music composition data of a plurality of parts included in the internal music data is reproduced at the same time, whereby one whole music is reproduced. As the music composition data, for example, MIDI performance data (MIDI data) or a sound file of a predetermined sound compression format is used.

  In addition, the host server 40 includes a database that stores user post data uploaded from the plurality of karaoke apparatuses 10 via the Internet in the storage unit 42. This post data is composed of data recording voices of users who performed singing or playing using the karaoke apparatus 10 and management information. The posted data is associated with the music identification information, and the remote control terminal 30, the user terminal 50, and the like can search the posted data based on the music identification information.

  Such post data is created by the karaoke device 10 when the karaoke device 10 performs a karaoke song. The posted data includes recording data obtained by recording a singing sound or a musical instrument sound input from the microphone 19 or the musical instrument 20 when the karaoke music piece is played. The created post data is temporarily stored in the storage unit 12 of the karaoke apparatus 10 and is uploaded to the host server 40 after obtaining the user's approval regarding the creation of the post data. In this way, a plurality of post data can be stored in the storage unit 42 of the host server 40.

  In response to a distribution request from the karaoke device 10 or the user terminal 50, the host server 40 distributes the post data stored in the storage unit 42 to the requesting terminal device. When distributing the posted data to the karaoke apparatus 10, the host server 40 performs distribution in a download format in which the posted data is copied to the karaoke apparatus 10. On the other hand, when delivering post data to the user terminal 50, the control unit 41 sets the post data and internal music data corresponding to the post data to data conforming to a known streaming delivery format (hereinafter referred to as streaming data). ) Will be streamed. Specifically, the host server 40 generates and stores streaming data for each piece of music composition data for a plurality of pieces of music composition data corresponding to a plurality of parts divided by type of sound included in the internal music data. Record in part 42. In addition, the host server 40 generates streaming data for each piece of posted recording data included in the posted data uploaded from the karaoke apparatus 10 and records the streaming data in the storage unit 42.

  The karaoke apparatus 10 reproduces the internal music data of the karaoke music corresponding to the downloaded post data, and simultaneously reproduces the recording data of the post data. In addition, the singing sound and musical instrument sound input from the microphone 19 and the musical instrument 20 are output. By doing so, non-real-time collaboration (co-production and co-starring) is realized among a plurality of users who are not present.

  Moreover, the karaoke apparatus 10 newly acquires recording data based on the song and performance performed by the collaboration using the downloaded contribution data. The acquired new recording data can be uploaded to the host server 40 as post data produced by collaboration. A plurality of related post data produced by such collaboration is accumulated in the host server 40. Based on the posted data created by such collaboration, another user can further sing and perform and create posted data, thereby increasing the number of participants in the collaboration.

  The user terminal 50 is configured by a known information processing terminal such as a personal computer, a tablet computer, or a high-function mobile phone terminal (so-called smartphone) possessed by the user. The user terminal 50 includes a control unit 51, a storage unit 52 that stores various types of information, a music playback unit 53, an operation unit 54 that includes an input device for inputting operations, a display unit 55 that displays various types of information, and communication via the Internet. The communication part 56 etc. which control are provided. The control unit 51 is an information processing device mainly configured with a CPU, ROM, RAM, and the like, and controls the entire apparatus. The control unit 51 executes various processes based on programs and data read from the storage unit 52. As a main function of the user terminal 50 in the present embodiment, the control unit 51 requests the host server 40 to distribute streaming data related to post data designated by the user via the operation unit 54. Then, the music is reproduced based on the streaming data distributed from the host server 40. The music reproduction unit 53 reproduces the streaming data received from the host server 40 based on the control from the control unit 51 and outputs sound.

[Description of post data structure]
A specific structure of the posted data stored in the storage unit 42 of the host server 40 will be described with reference to FIG. FIG. 3A shows an example of the structure of post data (one user) produced by a single user who is not collaborating. This post data includes post data management information, post user information, and post recording data.

  Of these, the post data management information is information related to post data, and includes post identification information and music identification information. The post identification information is information for identifying post data. This posting identification information is given as unique identification information for each individual posting data by the control unit 41 of the host server 40 when the posting data is uploaded from the karaoke apparatus 10 to the host server 40. The music identification information is identification information for identifying the karaoke music corresponding to the post data, that is, the karaoke music played by the karaoke apparatus 10 when the post data is produced.

  The posted user information is information related to the posted user, and includes user data identification information, a user name, and posted recording information. The user data identification information is unique identification information for distinguishing individual posted user information within the same posted data when a plurality of posted user information is included in the same posted data. The user name is the name of the user related to the user data identification information, and is unique identification information for identifying the user. The posted recording information is information that describes the type of sound being recorded in the posted recording data for each type of sound included in the posted data. The type of sound is information that identifies the type of instrument or singing, for example. FIG. 3A shows an example in which a musical instrument 1 (guitar) is defined as the type of sound as posted recording information 1 corresponding to posted recording data named “B0001 # posted recording data 1”. . When a plurality of posted recording data is included in the posted data, a plurality of posted recording information corresponding to each posted recording data is included in the posted data.

  The posted recording data is voice data in which singing sounds and instrument sounds by the user corresponding to the posting user information are recorded for each type of sound. In the example of FIG. 3A, a file named “B001 # posted recording data 1” corresponds to posted recording data. One post data includes one or a plurality of post recording data according to the number of sound sources (singing or musical instruments) used for producing the post data. As the post recording data, for example, an audio file in a predetermined audio compression format is used.

  Next, FIG. 3B shows an example of the structure of post data with collaboration (two users) produced by another user collaborating using the post data shown in FIG. It is. The post data with collaboration is accumulated in the host server 40 by uploading post data including post recording data for two users related to the collaboration from the karaoke apparatus 10.

  The post data with collaboration includes post user information 1 and post recording data regarding post data of the first user who is a collaborator. That is, when post data with collaboration is produced in the karaoke apparatus 10, post user information 1 and post recording data regarding past post data reproduced together are included in the post data with collaboration. In addition, post user information 2 relating to the additional second user and post recording data relating to the user are included. In the example shown in FIG. 3B, two pieces of post recording data “B002 # post recording data 1” and “B002 # post recording data 2” are included as additional portions. Correspondingly, a microphone (chorus) is defined as a kind of sound in the posted recording information 1 corresponding to “B002 # posted recording data 1”. In addition, in the posted recording information 2 corresponding to “B002 # posted recording data 2”, the musical instrument 2 (base) is defined as the type of sound. This is because the second user related to this post data performed a singing with a microphone and a performance with a bass at the same time, and two post recording data in which each sound was individually recorded was uploaded as post data. means.

  By the way, in the storage unit 42 of the host server 40, in addition to the post data produced by the user and posted from the karaoke apparatus 10, the karaoke service operating side prepared for the user to disclose, for example, the model performance of a professional artist This data can also be stored. The model performance data for publishing prepared on the management side is also structured in the same way as the post data, so that it can be distributed to the karaoke apparatus 10 and the user terminal 50 in the same way as the post data, Enjoy collaboration. In the present invention, a concept including post data posted by a user and data prepared for release to the user on the management side is referred to as public data.

[Description of Overall Operation of Karaoke Network System 1 (First Embodiment)]
A first embodiment of a series of operations by each device of the karaoke network system 1 will be described based on the sequence diagram of FIG.

  First, the remote control terminal 30 receives a posting request from the user. Specifically, the user performs an input operation on the remote control terminal 30 to specify a karaoke piece desired to be played and a type of sound (song or instrument) to be recorded in the posted data. At this time, when the user desires collaboration with other post data, an input operation for designating post data of the collaborator is also performed. The designation of the type of sound to be recorded may be one or more. When the remote control terminal 30 accepts the input operation, the music identification information of the designated karaoke piece, the user name related to the requested user, the post recording information indicating the type of the designated sound, and the designated post data Post request information including post identification information (in the case of collaboration) is transmitted to the karaoke apparatus 10 (S10).

  It is assumed that the user name is stored in advance in the remote control terminal 30 when the user performs a predetermined login procedure when starting to use the karaoke apparatus 10. Further, it is assumed that information such as post identification information necessary for searching post data is acquired from the host server 40 by the remote control terminal 30 and stored in the storage unit 33.

  The karaoke apparatus 10 reproduces the internal music data of the karaoke music corresponding to the music identification information based on the posting request information received from the remote control terminal 30 (S12). At this time, when the posting identification information is included in the posting request information, the karaoke apparatus 10 downloads the corresponding posting data from the host server 40. Then, the karaoke apparatus 10 reproduces the internal music data of the karaoke music and the post recording data included in the post data downloaded from the host server 40 in synchronization. The karaoke apparatus 10 records the singing sound and the musical instrument sound input from the microphone 19 and the musical instrument 20 according to the type of sound in parallel with the reproduction of the internal music data and the posting data, and generates the post recording data.

  When the reproduction of the karaoke music is completed, the karaoke device 10 generates post data including the music identification information corresponding to the post request information, the post user information, and the generated post recording data (S14). The post data generated at this time is exemplified in FIG. When collaboration with post data downloaded from the host server 40 is performed, the following is performed. The karaoke apparatus 10 synthesizes post identification information, post user information and post recording data generated for the current generation, and post user information and post recording data included in post data downloaded as a collaborator. Is generated. The post data generated in this case is illustrated in FIG. The karaoke apparatus 10 uploads the generated posting data to the host server 40 via the Internet (S16).

  On the other hand, when the control unit 41 of the host server 40 newly stores the internal music data of the karaoke music in the storage unit 42, the streaming corresponding to each part from the plurality of music composition data included in the stored internal music data. Data is generated (S18). For example, in the example shown in FIG. 2, five pieces of streaming data corresponding to each piece of music composition data are generated for the piece of music composition data 1 to 5 included in the internal music data. Hereinafter, streaming data generated from internal music data is referred to as music streaming data. The generated music streaming data is stored in the storage unit 42 in association with the original internal music data. Then, the control unit 41 discloses the music management information of the stored internal music data, and publishes the internal music data so that it can be searched by the user terminal 50 (S20).

  In addition, when the posting data is uploaded from the karaoke apparatus 10, the control unit 41 of the host server 40 gives unique posting identification information to the posting data and stores it in the storage unit 42 (S22). When newly storing the posted data in the storage unit 42, the control unit 41 generates streaming data corresponding to each part from one or a plurality of posted recording data included in the posted data (S24). For example, in the case shown in FIG. 3A, for the “B001 # posted recording data 1” included in post data without collaboration, one streaming data corresponding to the posted recording data is generated. Further, in the example shown in FIG. 3B, three pieces of post data included in post data with collaboration, “B001 # post recording data 1”, “B002 # post recording data 1”, “B002 # post recording data 2”. ", Three streaming data corresponding to each posted recording data is generated. Hereinafter, the streaming data generated from the posted data is referred to as posted streaming data.

  The generated posting streaming data is stored in the storage unit 42 in association with the original posting data. Then, the control unit 41 discloses posted data management information and posted user information of the stored posted data, and publishes the posted data so that it can be searched by a terminal device such as the remote control terminal 30 or the user terminal 50 (S26). Specifically, the host server 40 publishes a list such as post identification information of post data, music identification information, and a post user name.

  On the other hand, the control unit 51 of the user terminal 50 acquires posted data management information and posted user information related to published posted data from the host server 40 (S28). Then, the control unit 51 accepts a request for post data desired to be reproduced from the user based on the information related to the post data acquired from the host server 40. Specifically, the control unit 51 receives an input operation for designating post data desired to be reproduced via the operation unit 54. When the control unit 51 accepts the input operation, the control unit 51 transmits a post data distribution request including post identification information of the specified post data to the host server 40 via the communication unit 56 (S30).

  When receiving the posting data distribution request from the user terminal 50, the control unit 41 of the host server 40 notifies the requesting user terminal 50 of the posting data streaming information regarding the posting data corresponding to the posting data distribution request (S32). ). This posted data streaming information includes information indicating the number and type (part) of streaming data corresponding to the posted data and internal music data corresponding to the posted data distribution request. Information on the number and type of streaming data is based on post recording information (sound type) included in the posting user information of the post data and music composition information (sound type) included in the music management information of the internal music data. Determined.

  For example, in the case of music streaming data corresponding to the internal music data shown in FIG. 2, the number of music streaming data is 5, which is the same as the music composition data 1 to 5 included in the internal music data of FIG. The information indicating the type (part) of the music streaming data is “musical instrument 1 (guitar)”, “musical instrument 2 (base)”, “musical instrument” indicated by the music composition information 1 to 5 of the music management information in FIG. 3 (drum) "," musical instrument 4 (piano) ", and" singing (chorus) ". On the other hand, in the case of post streaming data corresponding to the post data shown in FIG. 3B, the number of post streaming data is 3, which is the same as the post recording data included in the post data shown in FIG. The information indicating the type (part) of the posted streaming data corresponding to “B001 # posted recording data 1” is “instrument 1 (guitar)” indicated by the posted recording information 1 of the user information 1 in FIG. It is. Also, the information indicating the type (part) of the posted streaming data corresponding to “B002 # posted recording data 1” is “microphone (chorus)” indicated by the posted recording information 1 of the user information 2 in FIG. is there. Also, information indicating the type (part) of post streaming data corresponding to “B002 # post recording data 2” is “instrument 2 (base)” indicated by post recording information 2 of user information 2 in FIG. It is.

  When acquiring the posted data streaming information from the host server 40, the control unit 51 of the user terminal 50 determines the minus one setting regarding whether or not to limit the output of the sound (minus one) for each piece of the music streaming data and the posted streaming data. (S34). Specifically, the control unit 51 causes the display unit 55 to display the content of the posted data streaming information. For example, description will be made assuming that a post data distribution request is made for the post data in FIG. In this case, as information on the internal music data (see FIG. 2) corresponding to the posted data, the number of parts is “5”, and the types of parts are “guitar”, “bass”, “drum”, “piano”, “Chorus” is displayed on the display unit 55. Further, as the information related to the posted data in FIG. 3B, the number of parts is “3” and the types of parts are “guitar”, “bass”, and “chorus” are displayed on the display unit 55. Then, based on the display, an instruction to restrict / not output the sound for the part corresponding to each streaming data is received from the user via the operation unit 54.

  When determining the minus one setting of the streaming data based on the instruction from the user, the control unit 51 notifies the host server 40 of the setting content and makes a streaming data distribution request (S36). In addition to instructing minus one setting from the user terminal 50, streaming data to be automatically minus one may be determined on the host server 40 side. Specifically, among all the music streaming data and post streaming data corresponding to the post data distribution request, the music streaming data that overlaps with the post streaming data part (the type of singing or instrument indicated by the post recording information) Minus One is applied to the part (singing or musical instrument type indicated by the music composition information). For example, if the posted streaming data corresponds to the guitar part, minus one is applied to the music streaming data that also corresponds to the guitar part.

  Based on the received streaming data distribution request, the control unit 41 of the host server 40 distributes only streaming data to which minus one is not applied from among the music streaming data and the posted streaming data corresponding to the posted data distribution request (S38). ). As described above, in the present embodiment, as a method for restricting the output of sound by streaming data of a specific part, a method of not transmitting streaming data of a specific part to which minus one is applied is adopted. As a result, the sound of the specific part to which minus one is applied is not output at all at the user terminal 50 that receives the streaming data. Not limited to this, the control unit 41 of the host server 40 only mutes or lowers the volume for the streaming data of the specific part to which minus one is applied, and then also the specific part streaming data. Stream distribution may be performed in the same manner as other streaming data. When there are a plurality of post streaming data to be distributed, the output destinations of the respective sounds may be distributed to the left and right speakers in an equal number.

  The control unit 51 of the user terminal 50 synchronizes the music streaming data and the posted streaming data transmitted from the host server 40 and causes the music reproduction unit 53 to reproduce the data (S40). When the user terminal 50 receives an instruction from the user to change the minus one setting for the streaming data during the streaming reproduction, the control unit 51 transmits a minus one setting change request to the host server 40 ( S42). Upon receiving the minus one setting change request from the user terminal 50, the control unit 41 of the host server 40 switches to streaming data distribution to which minus one is not applied based on the minus one setting reflecting the change request (S44). ). For example, if you set Minus One for music streaming data corresponding to a guitar part, you can cancel the Minus One application, or a song corresponding to a part that has been set to Minus One, which is different from the guitar part. New minus one is applied to streaming data or posted streaming data. The control unit 51 of the user terminal 50 synchronizes the music streaming data and the posted streaming data transmitted from the host server 40 and causes the music reproduction unit 53 to reproduce the synchronized data (S46). Note that the minus one setting change request by the user terminal 50 can be performed any number of times at any timing of the user during streaming playback.

  When the distribution of the streaming data is completed, the control unit 41 of the host server 40 transmits a streaming completion notification to the user terminal 50 (S48). The control unit 51 of the user terminal 50 ends the streaming reproduction (S50).

[Description of Overall Operation of Karaoke Network System 1 (Second Embodiment)]
A second embodiment of a series of operations by each device of the karaoke network system 1 will be described based on the sequence diagram of FIG. In the procedure shown in FIG. 5, the procedure of S60 to S82 in the first half is the same as S10 to S32 of the first embodiment described above, and the description of the overlapping parts is omitted.

  The control unit 51 of the user terminal 50 makes a streaming data distribution request to the host server 40 (S84). Here, unlike S36 of the first embodiment, distribution of all streaming data corresponding to the post data distribution request is requested. Based on the received streaming data distribution request, the control unit 41 of the host server 40 performs streaming distribution of all corresponding music streaming data and post streaming data to the user terminal 50 (S86).

  The control unit 51 of the user terminal 50 includes a part of the music streaming data that overlaps the part of the posted streaming data (the type of singing / instrument indicated by the posted recording information) among all the streaming data to be distributed (the music composition information). The output of the sound is limited by the type of singing / instrument shown), and the streaming data is synchronized with the streaming data to be reproduced by the music reproducing unit 53 (S88). As a method for restricting the output of sound, there is exemplified a method in which streaming data of a specific part is not reproduced, or muted or reproduced by lowering the volume. When a plurality of types of post streaming data are distributed from the host server 40, the output destinations of the respective sounds may be allocated to the right and left speakers and reproduced.

  In the middle of streaming playback, when the user terminal 50 receives an instruction from the user to change the part that restricts the sound output (S90), the control unit 51 restricts the sound output based on the change instruction. The target streaming data is switched and the streaming reproduction is continued (S92). The part that restricts the output of sound can be changed any number of times at any timing during streaming playback.

  When the distribution of the streaming data is completed, the control unit 41 of the host server 40 transmits a streaming completion notification to the user terminal 50 (S94). The control unit 51 of the user terminal 50 ends the streaming reproduction (S96).

[effect]
According to the karaoke network system 1 of the above embodiment, the following effects can be obtained.
According to the first embodiment (FIG. 4), the streaming data of an arbitrary part of the user from the streaming data for each part divided by sound type, which is generated by the host server 40 from the internal music data and the public data. Can be distributed to the user terminal 50. By doing in this way, streaming reproduction can be easily performed on the user terminal 50 side in a state where only the sound of a specific part is deleted or the volume is lowered.

  According to the second embodiment (FIG. 5), the host server 40 can distribute the streaming data for each part, which is generated from the internal music data and the public data, divided according to the type of sound, to the user terminal 50. In this way, since the streaming data to be distributed is divided for each part in advance, the user terminal 50 can easily perform streaming reproduction by restricting the output of the streaming data of any part of the user. .

  In addition, it is possible to upload post recording data, which is a video recording a video of a user singing or playing a musical instrument when creating post data, together with the post recording data, by connecting a camera to the karaoke apparatus 10 You may do it. Then, when the user views the posted data on the karaoke apparatus 10 or the user terminal 50, the posted recording data and the posted recorded data are reproduced at the same time, so that the user can present the music, voice, and video as a unit. You can enjoy a feeling of collaboration.

  In the above-described embodiment, the case in which the user terminal 50 performs streaming playback from the host server 40 on the post data uploaded from the karaoke apparatus 10 to the host server 40 has been described. Not limited to this, the karaoke apparatus 10 may stream the posted data from the host server 40.

[Correspondence with configuration described in claims]
The correspondence between the configuration of the karaoke network system 1 of the embodiment and the configuration described in the claims is as follows. The host server 40 corresponds to the server. Among these, the memory | storage part 42 corresponds to a memory | storage means. The control unit 41 corresponds to a first generation unit and a second generation unit. The control unit 41 and the communication unit 43 correspond to a distribution receiving unit, a transmitting unit, and a part receiving unit (claim 2). The user terminal 50 corresponds to a terminal device. Among these, the control unit 51 and the communication unit 56 correspond to a distribution request unit, a reception unit, and an acquisition unit. The control unit 51 corresponds to control means. The control unit 51 and the operation unit 54 correspond to part accepting means (claim 8). The karaoke device 10 corresponds to a music playback device.

  DESCRIPTION OF SYMBOLS 1 ... Karaoke network system, 10 ... Karaoke apparatus, 11 ... Control part, 12 ... Memory | storage part, 13 ... Music reproduction part, 14 ... Voice control part, 14a ... Microphone input part, 14b ... Musical instrument input part, 14c ... Output part, DESCRIPTION OF SYMBOLS 15 ... Video control part, 17 ... Operation part, 18 ... Communication part, 19 ... Microphone, 20 ... Musical instrument, 21a, 21b ... Speaker, 23 ... Monitor, 30 ... Remote control terminal, 31 ... Control part, 32 ... Operation part, 33 ... storage unit 34 ... display unit 35 ... communication unit 40 ... host server 41 ... control unit 42 ... storage unit 43 ... communication unit 50 ... user terminal 51 ... control unit 52 ... storage unit 53 A music reproduction unit, 54 an operation unit, 55 a display unit, and 56 a communication unit.

Claims (12)

The music identification information for identifying the music, the first input sound information representing the sound acquired from the sound source, and the first sound identification information for identifying the type of sound represented by the first input sound information are associated with each other. Storage means for storing the first public data;
First generation means for generating, for each part, first streaming data in a predetermined data format capable of streaming delivery from music data composed of parts divided according to sound types;
A first data in a predetermined data format that can be streamed from the first input sound information included in the first public data stored in the storage means for each part by sound type indicated by the first sound identification information. 2nd generation means for generating 2 streaming data;
A delivery accepting means for accepting a delivery request for the first public data from a terminal device via a network;
The first streaming data corresponding to the music identification information included in the first public data corresponding to the distribution request, and the second corresponding to the first input sound information included in the first public data corresponding to the distribution request. Transmitting means for transmitting the streaming data to the requesting terminal device via the network;
With
The transmission means is output by the first streaming data or the second streaming data of a specific part among the parts constituting the first streaming data and the second streaming data transmitted to the requesting terminal device. And transmitting the first streaming data and the second streaming data corresponding to the first public data corresponding to the distribution request. The server according to claim 1,
Part reception means for receiving designation of a part that restricts output of sound from the terminal device via the network;
The transmission means limits the sound output by the first streaming data or the second streaming data of the part whose designation is accepted by the part acceptance means, and corresponds to the first public data corresponding to the distribution request The server transmits the first streaming data and the second streaming data. In the server according to claim 1 or 2,
The transmission means limits the sound output by the first streaming data of the part corresponding to the type of sound indicated by the first sound identification information included in the first public data corresponding to the distribution request, and The server, wherein the first streaming data and the second streaming data corresponding to the first public data corresponding to the distribution request are transmitted. In the server according to any one of claims 1 to 3,
When the music playback device performs a performance using the first public data acquired from the server, the storage means uses the music as public data regarding the second input sound acquired from the sound source by the music playback device. Second public data uploaded by a playback device, wherein the music identification information, the first input sound information, the first sound identification information, the second input sound information representing the second input sound, Storing second public data associated with second sound identification information for identifying the type of sound represented by the second input sound information;
The second generation unit performs the second streaming for each part by sound type indicated by the second sound identification information from second input sound information included in the second public data stored in the storage unit. Generate more data,
The delivery accepting unit accepts a delivery request for the second public data from the terminal device,
When the distribution accepting unit accepts the distribution request for the second public data, the transmission unit requests the first streaming data and the second streaming data corresponding to the second public data corresponding to the distribution request. Limiting the sound output by the first streaming data or the second streaming data of a specific part among the parts of the first streaming data and the second streaming data when transmitting to the terminal device A server characterized by The server according to claim 4,
The transmission means outputs the first sound identification information included in the second public data corresponding to the distribution request and the sound output from the first streaming data of the part corresponding to the sound type indicated by the second sound identification information. And transmitting the first streaming data and the second streaming data corresponding to the second public data corresponding to the distribution request. In the server according to any one of claims 1 to 5,
The music data is composed of a plurality of parts divided by instrument type,
The first input sound information representing a sound acquired from a sound source is information representing a performance sound by a musical instrument, and the first sound identification information is information identifying a type of the instrument as the type of sound. Feature server. The music identification information for identifying the music, the first input sound information representing the sound acquired from the sound source, and the first sound identification information for identifying the type of sound represented by the first input sound information are associated with each other. Storage means for storing the first public data;
First generation means for generating, for each part, first streaming data in a predetermined data format capable of streaming delivery from music data composed of parts divided according to sound types;
A first data in a predetermined data format that can be streamed from the first input sound information included in the first public data stored in the storage means for each part by sound type indicated by the first sound identification information. 2nd generation means for generating 2 streaming data;
A delivery accepting means for accepting a delivery request for the first public data from a terminal device via a network;
The first streaming data corresponding to the music identification information included in the first public data corresponding to the distribution request, and the second corresponding to the first input sound information included in the first public data corresponding to the distribution request. A server comprising: transmission means for transmitting streaming data to the requesting terminal device via the network;
A distribution request means for transmitting a distribution request for the first public data to the server via the network;
Receiving means for receiving the first streaming data and the second streaming data related to the first public data corresponding to the distribution request from the server via the network;
Of the parts of the first streaming data and the second streaming data received by the receiving means, the first streaming data or the second streaming data of a specific part is limited to output sound, and the first streaming data and the second streaming data are limited. Control means for reproducing streaming data and the second streaming data and outputting the reproduced sound;
A music playback system consisting of The music playback system according to claim 7, wherein
The terminal device
It further comprises part accepting means for accepting designation of a part that restricts sound output,
The control means reproduces the first streaming data and the second streaming data by restricting the output of sound by the first streaming data or the second streaming data of the part whose designation is received by the part receiving means. A music playback system characterized by The music playback system according to claim 7 or 8,
The terminal device
Further comprising an acquisition means for acquiring the first sound identification information included in the first public data corresponding to the distribution request from the server via the network;
The control means limits the output of sound by the first streaming data of the part corresponding to the type of sound indicated by the first sound identification information acquired by the acquisition means, and the first streaming data and the first 2. A music playback system characterized by playing back streaming data. The music playback system according to any one of claims 7 to 9,
In the server,
When the music playback device performs a performance using the first public data acquired from the server, the storage means uses the music as public data regarding the second input sound acquired from the sound source by the music playback device. Second public data uploaded by a playback device, wherein the music identification information, the first input sound information, the first sound identification information, the second input sound information representing the second input sound, Storing second public data associated with second sound identification information for identifying the type of sound represented by the second input sound information;
The second generation unit performs the second streaming for each part by sound type indicated by the second sound identification information from second input sound information included in the second public data stored in the storage unit. Generate more data,
The delivery accepting unit accepts a delivery request for the second public data from the terminal device,
When the distribution accepting unit accepts the distribution request for the second public data, the transmission unit requests the first streaming data and the second streaming data corresponding to the second public data corresponding to the distribution request. To the terminal device of
In the terminal device,
The distribution request means transmits a distribution request for the second public data to the server,
The receiving means receives the first streaming data and the second streaming data related to the second public data corresponding to the distribution request from the server,
The control means restricts the output of sound by the first streaming data or the second streaming data of a specific part among the first streaming data and the second streaming data part related to the second public data. A music playback system for playing back the first streaming data and the second streaming data. The music playback system according to claim 10 quoting claim 9.
In the terminal device,
The acquisition means acquires the first sound identification information and the second sound identification information included in the second public data corresponding to the distribution request from the server,
The control means limits the output of sound by the first streaming data of the part corresponding to the type of sound indicated by the first sound identification information and the second sound identification information acquired by the acquisition means, and A music playback system, wherein one streaming data and the second streaming data are played back. The music playback system according to any one of claims 7 to 11,
The music data is composed of a plurality of parts divided by instrument type,
The first input sound information representing a sound acquired from a sound source is information representing a performance sound by a musical instrument, and the first sound identification information is information identifying a type of the instrument as the type of sound. A featured music playback system.

Images