CN107665703A - The audio synthetic method and system and remote server of a kind of multi-user - Google Patents
The audio synthetic method and system and remote server of a kind of multi-user Download PDFInfo
- Publication number
- CN107665703A CN107665703A CN201710812051.8A CN201710812051A CN107665703A CN 107665703 A CN107665703 A CN 107665703A CN 201710812051 A CN201710812051 A CN 201710812051A CN 107665703 A CN107665703 A CN 107665703A
- Authority
- CN
- China
- Prior art keywords
- user
- song
- user terminal
- audio information
- singing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010189 synthetic method Methods 0.000 title abstract 2
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 16
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 16
- 238000004891 communication Methods 0.000 claims abstract description 6
- 238000001308 synthesis method Methods 0.000 claims description 16
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 241001342895 Chorus Species 0.000 abstract description 40
- HAORKNGNJCEJBX-UHFFFAOYSA-N cyprodinil Chemical compound N=1C(C)=CC(C2CC2)=NC=1NC1=CC=CC=C1 HAORKNGNJCEJBX-UHFFFAOYSA-N 0.000 abstract description 40
- 238000000034 method Methods 0.000 abstract description 7
- 239000012634 fragment Substances 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/155—Musical effects
- G10H2210/245—Ensemble, i.e. adding one or more voices, also instrumental voices
- G10H2210/251—Chorus, i.e. automatic generation of two or more extra voices added to the melody, e.g. by a chorus effect processor or multiple voice harmonizer, to produce a chorus or unison effect, wherein individual sounds from multiple sources with roughly the same timbre converge and are perceived as one
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present embodiments relate to communication technical field, the audio synthetic method and system, remote server of a kind of multi-user are disclosed.In the present invention, remote server receives the audio-frequency information that the user collected by the first user terminal of N number of first user terminal uploads gives song recitals, wherein, N is the natural number more than 1；According to performance order of first user terminal in song, obtain the first user terminal corresponding to each singing songses fragment, and according to the time delay of the first user terminal by singing songses fragment corresponding to the audio-frequency information of the first user terminal uploads and the melody of song synthesized；The synthesis of the audio-frequency information and melody of upper singing songses fragment, the reception with the audio-frequency information of next singing songses fragment perform parallel；In the audio-frequency information after being synthesized, the audio-frequency information after synthesis is sent immediately to second user terminal.This method enables second user terminal immediately and hears the chorus audio of the first user terminal glibly.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a multi-user audio synthesis method and system and a remote server.
Background
Network KTVs are fashionable entertainment modes nowadays, and the network KTVs are novel music interactive community modes and have the characteristics of convenience, free use or low price use and the like, and become entertainment newpets of white-collar newsfeed families and college students. The system is integrated in a KTV song requesting system, and a user can show himself, record personal MV (music video), shoot a photo sticker as much as possible and release the photo sticker to an interactive entertainment platform website, so that the user breaks through the boundary line of a ward and shares a happy network entertainment terminal with more people. A user can record own video and audio on the network KTV and upload the video and audio to the network to be shared with people.
However, the inventors found that at least the following problems exist in the prior art: at present, when a network KTV is used for chorusing, users can upload the audio information of the whole song to a server only after singing the whole song, and other users can hear the chorus song after the audio information is processed by the server. And if the audio information uploaded when the user sings is directly sent to other user terminals to be listened by other users, the user listening to the network chorus song can not immediately and smoothly listen to the song sung by different users.
Disclosure of Invention
The invention aims to provide a multi-user audio synthesis method and system and a remote server, so that a user listening to a network chorus song can instantly and smoothly listen to songs chorus by different users.
In order to solve the above technical problem, an embodiment of the present invention provides a multi-user audio synthesis method, including the following steps:
the remote server receives audio information uploaded by N first user terminals, wherein N is a natural number greater than 1; the audio information is the audio information of a song sung by the user and collected by the first user terminal; the remote server acquires a first user terminal corresponding to each song singing segment according to the singing sequence of the N first user terminals in the songs, and synthesizes audio information uploaded by the first user terminal corresponding to the song singing segment with the melody of the song according to the delay time of the first user terminal; the delay time is the time for transmitting the audio information of the first user terminal from the first user terminal to the remote server; the synthesis of the audio information of the singing segment of the previous song and the melody is executed in parallel with the receiving of the audio information of the singing segment of the next song; and when the remote server obtains the synthesized audio information, the remote server immediately sends the synthesized audio information to the second user terminal.
An embodiment of the present invention further provides a remote server, including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the multi-user audio synthesis method as described above.
An embodiment of the present invention further provides a multi-user audio synthesis system, including:
the system comprises N first user terminals, at least one second user terminal and the remote server, wherein N is a natural number greater than 1;
the remote server is respectively connected with the second user terminal and the N first user terminals through wireless communication;
the N first user terminals are used for uploading audio information to the remote server;
the second user terminal is used for receiving the synthesized audio information sent by the remote server.
Compared with the prior art, the method and the device have the advantages that N users singing the song send the audio information of the singing song to the remote server through N user terminals, namely the first user terminals, the remote server obtains the first user terminal corresponding to each song singing segment according to the singing sequence of the N first user terminals in the song, so that the first user terminal corresponding to the singing song part corresponding to the uploaded audio information and the first user terminal from which the audio information is uploaded can be known, and the audio information uploaded by the first user terminal corresponding to the song singing segment is synthesized with the melody of the song according to the delay time of the first user terminal. Since there is a delay time in the audio information, i.e. the remote server is not able to receive the audio information instantaneously, in an embodiment of the invention, the remote server will synthesize the audio information and the song melody into a segment of the song, i.e. new audio information, according to the delay time. And the synthesis of the audio information of the singing segment of the previous song and the melody is executed in parallel with the receiving of the audio information of the singing segment of the next song, and the synthesized song segment can be immediately sent to the user terminal which receives the audio information, namely the second user terminal, so that the consistency of the songs in the synthesis time is ensured, and a user who listens can immediately and smoothly hear the whole chorus song.
In addition, before receiving the audio information uploaded by the N first user terminals, the remote server allocates song singing sequences for the N first user terminals and issues the song singing sequences to the N first user terminals; and the received audio information uploaded by the N first user terminals is the audio information of the song singing segments collected by the first user terminals according to the preset song singing sequence. The audio information uploaded by the first user terminal is obtained according to the song singing sequence sent by the remote server, the fragments are chorus by a plurality of persons, the remote server controls the song sequence and issues the song sequence, the terminal side only needs to collect the required fragment record and upload the record to the remote server, and the synthesis of the network side is easy.
In addition, the personal information of the user is obtained through the first user terminal, and the personal information of the user is noted in the song singing segment matched with the first user terminal. The personal information of the singer is noted on the song singing segment, so that the singer knows which song segment to sing is, and the user can sing the songs according to the song singing sequence.
In addition, the first user terminal is specifically configured to control the vibration frequency of the first user terminal according to the number of beats of the song singing segment to be acquired in a preset time period before the audio information of the song singing segment is acquired. Namely, the first user terminal vibrates in a preset time period before the audio information of the singing segment of the singing song is collected to remind the owner of the first user terminal to prepare for starting singing the song, so that the first user terminal is favorable for avoiding the situation that the audio information of the singing segment of the song cannot be collected, and the comfort of a user listening to the chorus song when listening to the chorus song is ensured. And the tempo number of the song singing segment to be collected controls the vibration frequency of the first user terminal, so that the owner of the first user terminal knows when to start singing the song, the first user terminal can not collect the audio information of the song singing segment, and the comfort of the user listening to the chorus song when listening to the chorus song is ensured.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a detailed flowchart of a multi-user audio synthesis method according to a first embodiment of the present invention;
fig. 2 is a detailed flowchart of a multi-user audio synthesis method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a remote server according to a third embodiment of the present invention;
fig. 4 is a schematic diagram of a multi-user audio synthesis system according to a fourth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
The first embodiment of the invention relates to a multi-user audio synthesis method which is applied to a remote server. The specific flow is shown in figure 1.
Step S101: and the remote server receives the audio information uploaded by the first user terminal.
Specifically, when a user carries out karaoke in the network KTV, the user uses a mobile phone, a tablet personal computer and other equipment to record, and transmits recorded information to the remote server in time, and the mobile phone or the tablet personal computer which has the recording function, can establish communication connection with the remote server and can transmit the information to the server is a first user terminal. When a user sings a song on demand in the network K song, the first user terminal inputs the audio information of the song sung by the user and sends the audio information of the song sung by the user to the remote server, namely the audio information is the audio information of the song sung by the user, which is collected by the first user terminal.
When N users sing the same song, the remote server receives audio information uploaded by N first user terminals, wherein N is a natural number greater than 1; the audio information is the audio information of a song sung by the user and collected by the first user terminal; and the remote server acquires the first user terminal corresponding to each song singing segment according to the singing sequence of the N first user terminals in the songs, wherein N is a natural number greater than 1, namely different users can sing one of the segments in the songs according to a set sequence, and meanwhile, the user terminals acquire the audio information of the songs sung by the users and send the acquired audio information to the remote server. When the remote server receives the audio information sent by the user terminal sending the audio information of the singing song, namely the first user terminal, the remote server can know which first user terminal sends the uploaded audio information and which singing segment of the corresponding song the audio information sent by the first user terminal is through the set singing sequence of the user and the identification number of the first user terminal.
Step S102: and the remote server synthesizes the audio information uploaded by the first user terminal corresponding to the song singing segment with the melody of the song according to the delay time of the first user terminal.
Specifically, the delay time is a time when the audio information of the first user terminal is transmitted from the first user terminal to the remote server, and the delay time has a great influence on a user listening to a song, for example, when two first user terminals send chorus audio information of the same song to the server according to a song singing sequence, due to the existence of the delay time, when the audio information of two singing segments in the songs performed by the two users is respectively sent by different first user terminals, and the delay times from the different first user terminals to the server are not consistent, when the audio information of the previous singing segment is sent to the server, the server cannot immediately obtain the audio information of the next singing segment. If the server is a terminal that instantly sends the received audio information to the user listening to the chorus, the user listening to the chorus will not be able to smoothly listen to the entire chorus.
Therefore, in order to solve this problem, when the server receives the audio information transmitted from the first user terminal, a delay time for the first user terminal to transmit the audio information to the server is first calculated, and then the received audio information is synthesized with the melody of the song based on the delay time.
For example, when a user a and a user B sing the same song by using a first user terminal a and a first user terminal B, the first user terminal a sends audio information of lyrics of the song sung by the user a at 5 o' clock 0 min 0 sec to a server, and the delay time of the audio information sent by the first user terminal a to the server is 1 sec; the first user terminal B sends audio information of lyrics of 1 minute 01 second of a song sung by the user B to the server at 5 o' clock 0 minute 01 second, and the delay time of the audio information sent by the first user terminal B to the server is 2 seconds; the server receives the audio information of the lyrics of the song at 1 min 0 s sent by the first user terminal a at 5 o 'clock 0 min 01 s, and receives the audio information of the lyrics of the song at 1 min 01 s sent by the first user terminal B at 5 o' clock 0 min 03 s, because the lyrics of the song at 1 min 0 s and the lyrics of the song at 1 min 01 s are two consecutive lyrics, if the server receives the audio information of the lyrics of the song at 1 min 0 s, the audio information is immediately combined with the melody to which the lyrics belong and sent out, and the 1 sec pause of the originally consecutive lyrics can be caused.
Therefore, the server can receive the audio information of the lyrics of the song at 1 min 0 s sent by the first user terminal A at 5 o ' clock 0 min 01 s according to the delay time, wait for 5 o ' clock 0 min 02 s, and then combine the audio information of the lyrics of the song at 1 min 0 s with the melody to which the lyrics belong, and immediately combine the audio information of the lyrics of the song at 1 min 01 s with the melody to which the lyrics belong when receiving the audio information of the lyrics of the song at 1 min 01 s sent by the first user terminal B at 5 o ' clock 0 min 03 s. Therefore, the situation that the original coherent lyrics are stopped for 1 second is improved, and the audio information of the chorus songs synthesized by the server becomes smooth.
The synthesis of the audio information and the melody of the singing segment of the previous song is executed in parallel with the receiving of the audio information of the singing segment of the next song, namely, the server does not stop receiving the singing segment of the next song when synthesizing the received lyrics, so that the audio information of the chorus song is not unnecessarily blocked due to the action of synthesizing new audio information by the remote server, and the audio information of the chorus song synthesized by the server becomes fluent
Step S103: and when the remote server obtains the synthesized audio information, the remote server immediately sends the synthesized audio information to the second user terminal.
Specifically, the terminal of the user listening to the chorus song is called a second user terminal, and after the remote server synthesizes the audio information uploaded by the first user terminal corresponding to the song singing segment with the melody of the song, the synthesized audio information is immediately sent to the second user terminal, so that the user listening to the chorus song can immediately listen to the chorus song. And when a plurality of users sing the same song, the plurality of first user terminals acquire and send the audio information of the users in the chorus according to the song singing sequence to the remote server, and due to the existence of the delay time, the remote server synthesizes the audio information uploaded by the first user terminals corresponding to the song singing segments and the melody of the song according to the delay time of the plurality of first user terminals, synthesizes the received lyrics by the server, and does not stop receiving the next song singing segment during synthesis, so that the users listening to the chorus song can smoothly listen to the chorus song.
As can be seen from the above, the first embodiment of the present invention synthesizes the audio information uploaded by the first user terminal with the melody of the song according to the delay time from each first user terminal to the server, and immediately transmits the synthesized audio information to the second user terminal, thereby achieving an effect of enabling a user listening to the chorus song to listen to the chorus song immediately and smoothly.
The second embodiment of the invention relates to a multi-user audio synthesis method, which is applied to a remote server and is an improvement of the first embodiment of the invention, and the main improvement is that: before receiving the audio information uploaded by the N first user terminals, distributing song singing sequences for the N first user terminals, issuing the song singing sequences to the N first user terminals, acquiring personal information of a user through the first user terminals, and remarking the personal information of the user in a song singing segment matched with the first user terminal. The specific flow chart is shown in fig. 2, and includes:
step S201: the remote server distributes song singing sequences for the N first user terminals and issues the song singing sequences to the N first user terminals, wherein N is a natural number larger than 1.
Specifically, before receiving audio information of singing a chorus song by a user, which is sent by a first user terminal, a remote server firstly allocates song singing sequences to N first user terminals, namely, which first user terminal collects the audio information of a specific singing segment in the chorus song is determined, and the specific method is that the song is divided into L song singing segments, wherein L is a natural number greater than 1; the method comprises the steps that at least one first user terminal is matched with each song singing segment, then song singing sequences are sent to N first user terminals, the first user terminals can determine time for collecting audio information of singing songs according to the song singing sequences, and therefore audio information uploaded by the N first user terminals and received by a remote server is the audio information of the song singing segments collected by the first user terminals according to the preset song singing sequences.
The remote server can also determine whether to receive the audio information sent from the first user terminal according to the song singing sequence, so that the received audio information is ensured, and the audio information of the song singing segment collected by the first user terminal according to the preset song singing sequence is provided, namely, a certain terminal is allowed to input in a fixed time period. Other times do not allow the terminal to make inputs. For example, which sentence the user a sings is preset, the remote server sends a song singing sequence to the terminal of the user a, and when the song played by the terminal of the user a reaches the time that the user a needs to sing, the audio information of the user a singing the song is collected until the song segment that the user a needs to sing is finished, the terminal of the user a collects the audio information and sends the audio information to the remote server. By doing so, the situation that several users upload audio information when singing the same song segment at the same time can be avoided, and the comfort of the user listening to the chorus song when listening to the chorus song can be ensured
Step S202: and the remote server acquires the personal information of the user through the first user terminal and notes the personal information of the user in the song singing segment matched with the first user terminal.
Specifically, after at least one first user terminal is matched for each song singing segment, the remote server can obtain personal information of a user about to sing the songs, such as names, mobile phone numbers and other information, through the first user terminals matched with the song singing sequence, and notes the information in the song singing segments matched with the first user terminals so as to remind the user when the user starts singing the songs. The first user terminal can not acquire the audio information of the song singing segment, and comfort of a user listening to the chorus song when listening to the chorus song is facilitated.
Step S203 corresponds to step S101, and will not be described in more detail here.
Step S204 corresponds to step S102, and will not be described in detail here.
Step S205 corresponds to step S103, and will not be described in more detail here.
It can be easily known that the second embodiment of the present invention not only achieves the effect of enabling a user listening to a chorus song to listen to the chorus song instantly and smoothly, but also avoids the occurrence of the situation that several users upload audio information when singing the same song segment simultaneously and the first user terminal cannot acquire the audio information of the song singing segment, thereby ensuring the comfort of the user listening to the chorus song when listening to the chorus song.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A third embodiment of the present invention relates to a remote server, as shown in fig. 3, including:
at least one processor 31; and a memory 32 communicatively coupled to the at least one processor.
The memory 32 stores instructions executable by the at least one processor 31, the instructions being executable by the at least one processor 31 to enable the at least one processor 31 to perform a multi-user audio synthesis method according to the second embodiment of the present invention.
Where the memory 32 and the processor 31 are coupled in a bus, the bus may comprise any number of interconnected buses and bridges, the buses coupling together one or more of the various circuits of the processor 31 and the memory 32. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 31 is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor 31.
The processor 31 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory 32 may be used to store data used by the processor in performing operations.
A fourth embodiment of the present invention relates to a multi-user audio synthesis system, as shown in fig. 4, comprising N first user terminals 41, at least one second user terminal 42, and a remote server 43 according to the third embodiment of the present invention, wherein N is a natural number greater than 1.
The remote server 43 is connected to the second user terminal 42 and the N first user terminals 41 by wireless communication, respectively.
The N first user terminals 41 are used to upload audio information to the remote server 43.
The first user terminal 41 is further configured to receive a song singing sequence issued by the remote server 43, and the audio information uploaded by the first user terminal 41 is specifically audio information of a song singing segment collected by the first user terminal 41 according to the preset song singing sequence;
the first user terminal 41 is also configured to vibrate within a preset time period before the audio information of the song singing segment is collected.
Specifically, the first user terminal 41 is configured to control the vibration frequency of the first user terminal according to the number of beats of the song singing segment to be collected in a preset time period before the audio information of the song singing segment is collected. That is, the first user terminal 41 will vibrate within a preset time period before the audio information of the singing segment of the singing song is collected, so as to remind the owner of the first user terminal 41 to prepare to start singing the song, so that the first user terminal 41 cannot collect the audio information of the singing segment of the song, and comfort of a user listening to the chorus song when listening to the chorus song is ensured. The number of beats of the song singing segment to be collected controls the vibration frequency of the first user terminal, so that the owner of the first user terminal 41 knows when to start singing the song, the first user terminal cannot collect the audio information of the song singing segment, and the comfort of the user listening to the chorus song when listening to the chorus song is ensured.
The second user terminal 42 is configured to receive the synthesized audio information sent by the remote server 43.
It should be understood that this embodiment is a system example corresponding to the first and second embodiments, and may be implemented in cooperation with the first and second embodiments. The related technical details mentioned in the first embodiment and the second embodiment are still valid in this embodiment, and are not described herein again to reduce the repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the first embodiment as well as the second embodiment.
It should be noted that each module referred to in this embodiment is a logical module, and in practical applications, one logical unit may be one physical unit, may be a part of one physical unit, and may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, elements that are not so closely related to solving the technical problems proposed by the present invention are not introduced in the present embodiment, but this does not indicate that other elements are not present in the present embodiment.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.
Claims (9)
1. A multi-user audio synthesis method applied to a remote server is characterized by comprising the following steps:
receiving audio information uploaded by N first user terminals, wherein N is a natural number greater than 1; the audio information is the audio information of a song sung by the user and collected by the first user terminal;
acquiring a first user terminal corresponding to each song singing segment according to the singing sequence of the N first user terminals in the songs, and synthesizing audio information uploaded by the first user terminal corresponding to the song singing segment with the melody of the song according to the delay time of the first user terminal; the delay time is the time when the audio information of the first user terminal is transmitted from the first user terminal to the remote server;
the synthesis of the audio information of the singing segment of the previous song and the melody is executed in parallel with the receiving of the audio information of the singing segment of the next song; and when the synthesized audio information is obtained, immediately sending the synthesized audio information to a second user terminal.
2. The multi-user audio synthesis method according to claim 1, further comprising:
before the audio information uploaded by the N first user terminals is received, distributing song singing sequences for the N first user terminals, and issuing the song singing sequences to the N first user terminals;
and the received audio information uploaded by the N first user terminals is the audio information of the song singing segments collected by the first user terminals according to the preset song singing sequence.
3. The multi-user audio synthesis method according to claim 2, wherein the assigning of the song singing order to the N first user terminals specifically comprises:
dividing the song into L song singing segments, wherein L is a natural number more than 1;
and matching at least one first user terminal for each song singing segment.
4. The multi-user audio synthesis method according to claim 3, wherein the matching at least one of the first user terminals for each of the song singing segments further comprises:
and acquiring personal information of a user through the first user terminal, and remarking the personal information of the user in the song singing segment matched with the first user terminal.
5. A remote server, comprising:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the multi-user audio synthesis method of any of claims 1 to 4.
6. A multi-user audio synthesis system, comprising: n first user terminals, at least one second user terminal, and the remote server of claim 5, wherein N is a natural number greater than 1;
the remote server is respectively connected with the second user terminal and the N first user terminals through wireless communication;
the N first user terminals are used for uploading audio information to the remote server;
and the second user terminal is used for receiving the synthesized audio information sent by the remote server.
7. The multi-user audio synthesis system of claim 6, wherein the processor of the remote server is capable of performing the multi-user audio synthesis method of claim 2;
the first user terminal is further configured to receive a song singing sequence issued by the remote server, and the audio information uploaded by the first user terminal is specifically audio information of a song singing segment acquired by the first user terminal according to a preset song singing sequence;
the first user terminal is further used for vibrating within a preset time period before the audio information of the song singing segment is collected.
8. The multi-user audio synthesis system according to claim 7, wherein the first user terminal is specifically configured to control the vibration frequency of the first user terminal according to a number of beats of a song singing segment to be collected within a preset time period before collecting audio information of the song singing segment.
9. The multi-user audio synthesis system according to any one of claims 6 to 8, wherein the first user terminal is a mobile phone or a tablet computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710812051.8A CN107665703A (en) | 2017-09-11 | 2017-09-11 | The audio synthetic method and system and remote server of a kind of multi-user |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710812051.8A CN107665703A (en) | 2017-09-11 | 2017-09-11 | The audio synthetic method and system and remote server of a kind of multi-user |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107665703A true CN107665703A (en) | 2018-02-06 |
Family
ID=61098372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710812051.8A Pending CN107665703A (en) | 2017-09-11 | 2017-09-11 | The audio synthetic method and system and remote server of a kind of multi-user |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107665703A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110910917A (en) * | 2019-11-07 | 2020-03-24 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio clip splicing method and device |
| CN112086081A (en) * | 2020-08-26 | 2020-12-15 | 深圳传音控股股份有限公司 | Chorus method, terminal and computer storage medium |
| WO2020253754A1 (en) * | 2019-06-19 | 2020-12-24 | 华为技术有限公司 | Multi-terminal multimedia data communication method and system |
| CN112489611A (en) * | 2020-11-27 | 2021-03-12 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song room implementation method, electronic device and computer readable storage medium |
| CN112533023A (en) * | 2019-09-19 | 2021-03-19 | 聚好看科技股份有限公司 | Method for generating Lian-Mai chorus works and display equipment |
| CN114023299A (en) * | 2021-10-29 | 2022-02-08 | 福建星网视易信息系统有限公司 | Network chorus method and storage medium |
| WO2023160713A1 (en) * | 2022-02-28 | 2023-08-31 | 北京字跳网络技术有限公司 | Music generation methods and apparatuses, device, storage medium, and program |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020144587A1 (en) * | 2001-04-09 | 2002-10-10 | Naples Bradley J. | Virtual music system |
| CN104392711A (en) * | 2014-08-27 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Method and device for realizing karaoke function |
| CN106531201A (en) * | 2016-10-18 | 2017-03-22 | 腾讯科技（深圳）有限公司 | Song recording method and device |
| CN106601220A (en) * | 2016-12-08 | 2017-04-26 | 天脉聚源(北京)传媒科技有限公司 | Method and device for recording antiphonal singing of multiple persons |
-
2017
- 2017-09-11 CN CN201710812051.8A patent/CN107665703A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020144587A1 (en) * | 2001-04-09 | 2002-10-10 | Naples Bradley J. | Virtual music system |
| CN104392711A (en) * | 2014-08-27 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Method and device for realizing karaoke function |
| CN106531201A (en) * | 2016-10-18 | 2017-03-22 | 腾讯科技（深圳）有限公司 | Song recording method and device |
| CN106601220A (en) * | 2016-12-08 | 2017-04-26 | 天脉聚源(北京)传媒科技有限公司 | Method and device for recording antiphonal singing of multiple persons |
Non-Patent Citations (1)
| Title |
|---|
| 王春力: "基于P2P的网络音频捕获与多路混音算法研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020253754A1 (en) * | 2019-06-19 | 2020-12-24 | 华为技术有限公司 | Multi-terminal multimedia data communication method and system |
| CN112533023A (en) * | 2019-09-19 | 2021-03-19 | 聚好看科技股份有限公司 | Method for generating Lian-Mai chorus works and display equipment |
| CN110910917A (en) * | 2019-11-07 | 2020-03-24 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio clip splicing method and device |
| CN112086081A (en) * | 2020-08-26 | 2020-12-15 | 深圳传音控股股份有限公司 | Chorus method, terminal and computer storage medium |
| CN112489611A (en) * | 2020-11-27 | 2021-03-12 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song room implementation method, electronic device and computer readable storage medium |
| CN114023299A (en) * | 2021-10-29 | 2022-02-08 | 福建星网视易信息系统有限公司 | Network chorus method and storage medium |
| WO2023160713A1 (en) * | 2022-02-28 | 2023-08-31 | 北京字跳网络技术有限公司 | Music generation methods and apparatuses, device, storage medium, and program |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107665703A (en) | The audio synthetic method and system and remote server of a kind of multi-user | |
| KR102039239B1 (en) | Karaoke processing methods, devices and systems | |
| CN104205209B9 (en) | Playback controlling apparatus, playback controls method | |
| EP3176782B1 (en) | Apparatus and method for outputting obtained pieces of related information | |
| CN105006234B (en) | A kind of K sings processing method and processing device | |
| JP2018519538A (en) | Karaoke processing method and system | |
| US20080184870A1 (en) | System, method, device, and computer program product providing for a multiple-lyric karaoke system | |
| CN110390925B (en) | Method for synchronizing voice and accompaniment, terminal, Bluetooth device and storage medium | |
| KR101796428B1 (en) | Information management system and information management method | |
| CN105808710A (en) | Remote karaoke terminal, remote karaoke system and remote karaoke method | |
| WO2013150874A1 (en) | Content delivery system, server apparatus and terminal apparatus | |
| CN102065340B (en) | System and method for implementing multimedia synchronous interaction | |
| CN114257905B (en) | Audio processing method, computer-readable storage medium, and electronic device | |
| JP7149193B2 (en) | karaoke system | |
| CN110047497B (en) | Background audio signal filtering method and device and storage medium | |
| US20030126973A1 (en) | Data processing method of a karaoke system based on a network system | |
| CN102394860A (en) | Signal transmission system, method, computer program product and computer readable storage media | |
| CN107704230A (en) | A kind of wheat sequence controlling method and control device | |
| CN207966489U (en) | A kind of requesting songs system | |
| WO2015106576A1 (en) | Audio-based data label distribution system and method | |
| KR101573868B1 (en) | Method for displaying music lyrics automatically, server for recognizing music lyrics and system for displaying music lyrics automatically comprising the server | |
| JP2010186081A (en) | Karaoke delivery system | |
| US20160088363A1 (en) | Music editing method using video streaming service and music editing apparatus used therefor | |
| CN105260173B (en) | A kind of document handling method and electronic equipment | |
| JP7149203B2 (en) | karaoke system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180206 |
|
| WD01 | Invention patent application deemed withdrawn after publication |