TW201627886A - Accompaniment visual effect system and method for processing accompaniment visual effect - Google Patents

Abstract

The present invention relates to an accompaniment visual effect system and a method for processing accompaniment visual effect. The system includes a controller and a visual effect outputting device. The controller obtains visual effect data collection corresponding to a multimedia file when playing the multimedia file. The visual effect data collection includes at least two versions of visual effect tags, and each tag defines time configuration data and visual effect configuration data. The controller detects a current singing status and obtains a matched visual effect tag from a version of visual effect data collection corresponding to the current singing status and produces a synchronous visual effect signal according to the matched visual effect tag. The visual effect outputting device outputs the visual effect signal. According to the above system and method, the visual effect an vary synchronously with the timeline and rich visual effect is provided. In addition, the version of visual effect can be switched automatically according to the singing status of the singer.

Description

Accompaniment visual effects system and vocal visual effects processing method

The invention relates to the field of visual special effects technology, in particular to a vocal visual special effect system and a vocal visual special effect processing method.

Karaoke is a multimedia accompaniment system where singers can participate in singing with pre-recorded multimedia music. Karaoke can beautify and refine the voice of the singer through sound processing. When combined with music accompaniment, it becomes a sound song of the same body. This accompaniment method brings great convenience and pleasure to the singing enthusiasts, and becomes a way for people to entertain and entertain, and is now called KTV.

In the existing karaoke multimedia playing system, generally including a multimedia video output device, an audio output device, and a host. Some karaoke systems also support lighting effects, but most of these lighting effects are selected from a variety of pre-set effects, either static or loop changes, not only related to the currently playing songs. Very low, it has nothing to do with the singer singing and not singing.

In view of this, it is necessary to provide a vocal visual effect system and a vocal visual effect processing method, which can provide a richer visual effect, especially to visualize the beat of the music.

An embodiment of the present invention provides a vocal visual effects system, including: a control host and a visual effect output device; and the control host acquires a visual effect corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file with an external device a data set, the visual effect data set includes at least two versions of visual special effects tags, each version of the visual special effects tags respectively include time setting materials and special effect setting materials; the control host synchronously detects the singing state of the singer, according to The different singing states of the singer respectively obtain visual visual effect tags matching the current time from the visual special effect tags of the corresponding versions in the visual special effects data set and generate visual special effect signals synchronously played with the multimedia files; the visual special effect output device The visual effects are synchronously output according to the visual effect signal.

In an embodiment, the system further includes a singing state sensing device, the singing state sensing device sensing the singing state data of the artist, and transmitting the singing state data to the control host in an instant, the singing state The data includes at least one of a microphone switch state, a button state, a singer voice frequency, a singer volume, and a singer action feature; and the control host determines the singing state according to the singing state data sent by the singing state sensing device.

In an embodiment, the system further includes a singing state sensing device, the singing state sensing device sensing the singing state data of the artist, determining the singing state according to the singing state data, and instantly speaking the singing state Sending to the control host, the singing state data includes at least one of a microphone switch state, a microphone button state, a singer voice frequency, a singer volume, and a singer action feature.

In an embodiment, the visual effect data set further includes version setting data, and the version setting data sets a correspondence between the version of the visual effect label and the singing state.

In one embodiment, the visual effect output device is a multimedia video output device, and the system further includes a visual special effect superimposing device, which is respectively connected to the control host and the multimedia video output device, and the visual special effect superimposing device is used. And superimposing the visual effect signal on the multimedia video main screen of the multimedia file, and transmitting the superimposed video signal to the multimedia video output device output.

In one embodiment, the visual effects device includes an array of LED lights that cover the walls, roof, and ground of the room.

In an embodiment, the controlling host acquires the visual effect data set corresponding to the multimedia file, and the control host sends the corresponding visual special effect data set to the cloud server system according to the identifier of the multimedia file. And receiving the visual effects data set returned by the cloud server system.

In an embodiment, the controlling host acquiring the visual effect data set corresponding to the multimedia file further includes: the control host transmitting the identity authentication information to the cloud server system, so that the cloud server system Verifying whether the control host has permission to acquire a visual effects data set; the cloud server system returns a visual special effect data set requested by the control host when the control host has permission to acquire a visual special effects data set .

In an embodiment, the system further includes an external device connected to the control host; the external device sends the identifier of the corresponding multimedia file to the control when the multimedia file is played or the multimedia file is added to the playlist. a host; after receiving the identifier of the multimedia file, the control host sends a request for acquiring the corresponding visual special effect data set to the cloud server system.

In an embodiment, the control host further receives user personalized information sent by the cloud server system, where the visual effect data set further includes a video replacement special effect label, where the video replacement special effect label includes time setting data, The shape data of the area defining the predetermined shape in the main picture of the multimedia video and the category data corresponding to the shape data, the control host further replacing the content in the area of the predetermined shape with the category data User personalized information.

In an embodiment, the control host further acquires different versions of the visual effects data sets according to the selection instruction input by the user.

In an embodiment, the obtaining, by the control host, the visual effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the visual special effects data set embedded in the multimedia file.

In an embodiment, the special effect setting data is: video, vector animation, or intermediate data for generating a video or a vector animation, and the intermediate data is generated according to a predetermined agreement or language.

In one embodiment, the visual effect described by the special effect setting data is a visual expression of a music beat in a time interval set by the corresponding time setting data, and the special effect setting data is based on the speed, height, and low of the corresponding music beat. , strong and weak and many other features are designed.

In one embodiment, the control host is a smart electronic device, and the smart electronic device is connected to the visual effect output device via a wireless network, where the smart electronic device includes a built-in microphone, and the smart electronic device The specific software is installed, and the specific software transmits the sound emitted by the external device through the built-in microphone, and performs feature sampling and feature analysis on the recorded sound to identify the identifier of the song played by the external device, and according to the The identifier obtains the visual effect data set from the cloud server.

The embodiment of the present invention further provides a vocal visual effect processing method, including: when playing a multimedia file, or when playing an multimedia file by an external device, acquiring a visual special effect data set corresponding to the multimedia file, where the visual special effect data set is The utility model comprises at least two versions of visual special effects labels, each version of the visual special effects label comprises time setting data and special effect setting materials respectively; synchronously detecting the singing state of the singer, respectively, according to different singing states of the singer, respectively from the visual special effects data set A visual effect label matching the current time is obtained in the corresponding version of the visual effect label and a visual effect signal synchronized with the multimedia file is generated; and the visual effect is synchronously output according to the visual effect signal.

In an embodiment, the method further includes: the singing state sensing device sensing the singing state data of the artist, and transmitting the singing state data to the control host in an instant, the singing state data including a microphone switch state, a button At least one of a state, a singer voice frequency, a singer volume, and a singer action feature;

The control host determines the singing state according to the singing state data sent by the singing state sensing device.

In an embodiment, the method further includes: the singing state sensing device sensing the singing state data of the artist, determining the singing state according to the singing state data, and immediately transmitting the singing state to the control host, The singing state data includes at least one of a microphone switch state, a microphone button state, a singer voice frequency, a singer volume, and a singer motion feature.

In an embodiment, the visual effect data set further includes version setting data, where the version setting data sets a correspondence between the version of the visual effect label and the singing state; the method further includes: The correspondence switches the version of the visual effect.

In an embodiment, the method further includes: superimposing the visual effect signal on the multimedia video main screen of the multimedia file, and transmitting the superimposed video signal to the multimedia video output device for output.

In one embodiment, the visual effects device includes an array of LED lights that cover the walls, roof, and ground of the room.

In an embodiment, the obtaining the visual effect data set corresponding to the multimedia file comprises: sending, according to the identifier of the multimedia file, a request for acquiring the corresponding visual special effect data set to the cloud server system; and receiving the The visual effect data set returned by the cloud server system.

In an embodiment, the obtaining the visual special effects data set corresponding to the multimedia file further includes: sending the identity authentication information to the cloud server system, so that the cloud server system system verifies whether the image is acquired. The permission of the special effect data set; the cloud server system returns to the visual effect data set requested by the control host when the authentication is passed.

In an embodiment, the method further includes: receiving an identifier of the multimedia file sent by the external device when the multimedia file is played or when the multimedia file is added to the playlist; and the step of acquiring the visual special effect data set corresponding to the multimedia file Executing after receiving the identifier of the multimedia file sent by the external device.

In an embodiment, the method further includes: receiving user personalized information sent by the cloud server system, where the visual effect data set further includes a video replacement special effect label, where the video replacement special effect label includes time setting data, Forming the shape data of the area defining the predetermined shape in the main screen of the multimedia video and the category data corresponding to the shape data; and replacing the content in the area of the predetermined shape with the user personality corresponding to the category data Information.

In an embodiment, the method further includes: acquiring different versions of the visual effects data sets according to the selection instruction input by the user.

In an embodiment, the obtaining the visual effect data set corresponding to the multimedia file comprises: parsing, from the multimedia file, the visual special effects data set embedded in the multimedia file.

In an embodiment, the special effect setting data is: video, vector animation, or intermediate data for generating a video or a vector animation, and the intermediate data is generated according to a predetermined agreement or language.

In one embodiment, the visual effect described by the special effect setting data is a visual expression of a music beat in a time interval set by the corresponding time setting data, and the special effect setting data is based on the speed, height, and low of the corresponding music beat. , strong and weak and many other features are designed.

The beneficial effects of the above technical solution are: in addition to normal audio and video, the control host also generates a visual effect synchronized with the timeline. Moreover, depending on the singer's singing status, the corresponding version of the visual effects is automatically switched to provide a richer visual effects for the multimedia accompaniment system.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

The specific embodiments, structures, features and functions of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

First embodiment

Referring to FIG. 1 , it is a schematic structural diagram of a vocal visual effect system provided by a first embodiment of the present invention. As shown in FIG. 1, the vocal visual effects system 100 includes a singing state sensing device 15, a control host 10, and a visual effects output device 11.

The singing state sensing device 15 can be an electronic device, and is provided with a sensor for sensing the singing state data of the artist and transmitting the singing state data to the control host 10 in real time. The singing state data includes at least one of a microphone switch state, a button state, a singer voice frequency, a singer volume, and a singer action feature. It can be understood that different singing state data should be sensed through different devices. For example, the state of the button is detected by the button of the entity, and the state of the microphone switch is detected by the switching signal, and the frequency and volume of the sound need to be analyzed through the audio data. Detection, and the singer's action characteristics need to be analyzed by analyzing the singer's video or analyzing the trajectory of the device held or worn by the singer.

The singing state sensing device 15 may be a dedicated electronic device, that is, an electronic device whose main purpose is to transmit the singing state data to the control host 10 without implementing other functions. Due to its single function, the singing state sensing device 15 can be made small at this time, so that it can be attached to other devices that are often required to be used by hand, such as the microphone 101.

The singing state sensing device 15 may also be integrated with other electronic devices such as a microphone. When a microphone is integrated with the singing state sensing device, the appearance is the same as that of the general microphone. The difference is that, in addition to transmitting the singing voice of the singer 112, the singing state sensing device 15 also synchronizes the singing state data to the control host 10. .

The singing state sensing device 15 and the control host can be connected by wireless or wired. After sensing the singing status data, the singing state sensing device 15 can synchronize it to the control host 10. The above-mentioned singing state data may be instantaneously sampled and sent to the control host 10 in synchronization, or may be synchronized to the control host 10 after being sampled and averaged multiple times in each sampling period. It can be understood that even if the sampling average is over a sampling period, when the sampling period is small, the transmission of the singing state data can be considered to be instantaneous.

Further, in addition to the synchronized singing state data, the singing state sensing device 15 can also calculate the corresponding singing state from the singing state data according to a predetermined rule, and directly send the singing state to the control host 10. Thus, it is not necessary to control the host 10 to calculate the singing state based on the singing state data again.

Specific examples of the control host 10 include, but are not limited to, a personal computer, a multimedia player, a single chip microcomputer, a data player, a smart phone, and a dedicated control chip.

The visual effect output device 11 can be any display device capable of outputting video signals, such as a single display screen, a display screen array composed of multiple display screens, a single luminaire (such as an LED lamp), a luminaire array composed of a plurality of luminaires, and a single projection. An instrument, a projector array of multiple projectors, and the like.

In a specific example, the visual effect output device 11 includes an array of LED lights, each of which can output different lights according to different signals input, and the lights of all the LED lights together constitute an overall visual effect. . It can be understood that the form of visual effects is not subject to any restrictions. The LED array described above can cover all the walls, roofs and floors of the room, so that the visual effects of the display can fully enclose the room and maximize the visual effects of the scene.

In a specific example, the visual effect output device 11 includes one or more display screens, each of which can display the same display signal, or can be separately controlled to display different display signals. The display of all the display screens together constitute the overall visual effect.

In a specific example, the visual effect output device 11 includes one or more projectors, each of which can display the same display signal, or can be separately controlled to display different display signals. The display of all projectors together constitutes an overall visual effect.

Various types of visual effects output devices 11 can also be used in combination. For example, the visual effects output device 11 can include both an array of LED lights and one or more projectors or display screens.

The control host 10 and the visual effect output device 11 can be connected by wire or wirelessly, and when connected by wire, for example, through a digital video interface (DVI interface), a high definition multimedia interface (HDMI interface), video The graphic array interface (VGA interface) is connected, so that the video signal can be directly transmitted. If the control host 10 and the visual effect output device 11 are connected wirelessly, the video special effect output device 11 needs to have a wireless module and a signal conversion module. The wireless module is used for transmitting and receiving wireless data, and the signal conversion module is used for The received wireless data is converted into a video signal of a predetermined format.

The control host 10 acquires a visual special effects data set corresponding to the multimedia file when playing the multimedia file or when the external device plays the multimedia file. It can be understood that if the visual effect data set is acquired when the external device plays the multimedia file, the external device needs to send a signal to the control host 10 when playing the multimedia file, and the identifier of the multimedia file to be played is included in the signal.

The above-mentioned external device and control host 10 can be connected to each other through a wired network or a wireless network, and a specific application running in the host 10 can be monitored to listen to a specific network. The external device can send the identifier of the played multimedia file and the time when the multimedia file starts to be played to the specific network. In this way, the control host 10 can receive the identifier of the multimedia file sent by the external device and the time when the multimedia file starts to be played. In addition, the control host 10 and the external device can also be connected to the same server system, and when the external device plays the multimedia file, the identification information of the played multimedia file and the time of starting the playback can be submitted to the server system, and the server The system pushes the above information to the control host 10 or the control host 10 actively queries the server system to obtain the identifier of the multimedia file and the time when the multimedia file starts to be played.

Whether the control host 10 plays the multimedia file by itself or the external device plays the multimedia file, after the multimedia file starts playing, the control host 10 acquires the visual special effects data set corresponding to the multimedia file being played.

The visual effect data set described above may be stored in the control host 10 or stored in the cloud server system.

The visual effects data set may include a plurality of visual effects labels, each visual effect label including time setting data and special effect setting materials. The time setting data sets the effective time interval of the corresponding visual effect label, and the special effect setting data is used to set the manner of generating the visual special effect and other parameters.

It can be understood that the visual effect label here refers to the logical association between the time setting data and the special effect setting data, but does not mean that the specific data structure and storage structure of the visual special effect label, that is, the time setting data of the same visual special effect label. And the settings of the special effects are not limited to being saved.

The storage method of the special effect setting data set may be stored in the form of a file, or may be stored in a database. The special effects setting data set is pre-created by the manual or automated processing system for each song.

If each visual effect label is used to represent a beat, then in a specific implementation, the visual effect data set can be as follows: [00:00.00] special effect setting data 1 [00:24.88] special effect setting data 2 [01: 27.05] Special effect setting data 3 [02:30.39] Special effect setting data 4 ... ...

Each time setting data, such as [00:24.88], is the starting time of the visual effect of one shot, and the visual effect ends naturally after the playing.

If a visual effect label contains multiple beat visual effects or contains static visual effects, then in a specific embodiment, the visual effects data set can be as follows: [00:00.00] special effect setting data 1 [00:24.88 ] Special effect setting data 2 [01:27.05] Special effect setting data 3 [02:30.39] Special effect setting data 4 ... ...

For the special effect setting data in this format, two adjacent time starting points constitute a time interval. For example, the time interval formed by [00:00.00]-[00:24.88] is the effective time interval of the special effect setting data 1. .

It can be understood that the data format of the visual effect label is not limited thereto, and the time setting data may also include more information, for example, directly specifying the time interval, as follows: [00:00.00-00:23.86] effect setting data 1 [00: 24.88-01:00.90] Effect setting data 2 [01:27.05-03:29.00] Effect setting data 3 [03:30.39-05:38.86] Effect setting data 4

The first time in square brackets is the start time, and the latter time is the end time. In this way, a discontinuous time interval can be defined, and its adaptability is more flexible than just including the start time. In this case, no visual effects are triggered outside of all time intervals (eg at 01:10.00).

In addition, the start time plus the length of time can be used to define the effective time interval of each visual effect label, which can be as follows: [00:00.00, 00:55.00] Effect setting data 1 [00:24.00, 01:03.00] Effect setting Data 2 [01:28.00, 03:02.00] Effect setting data 3 [04:30.00, 01:08.00] Effect setting data 4

It can be seen from the above data definition that the effective time interval of the visual effect corresponding to the special effect setting data 1 and the special effect setting data 2 overlaps. Therefore, in the present embodiment, two different visual special effects can be in the same time interval. coexist.

Further, corresponding to the same time interval, there may be multiple visual effects, which may be the same type of visual effects, such as multiple lighting effects, or multiple video overlay effects, or multiple different types of visual effects. For example, it includes both lighting effects and video effects. At this time, the effect setting data set can be as follows: [00:00.00, 00:55.00] Effect setting data 1-1, effect setting data 1-2 [00:24.00, 01:03.00] Effect setting data 2 [01:28.00 , 03:02.00] Effect setting data 3 [04:30.00, 08:08.00] Effect setting data 4-1, effect setting data 4-2.

It can be understood that the setting manner of the above first visual effect label is equivalent to the following manner: [00:00.00, 00:55.00] Special effect setting data 1-1 [00:00.00, 00:55.00] Special effect setting data 1-2

That is, the visual effect label including a plurality of special effects is split into a plurality of visual effect labels having the same effective time interval.

It can be understood that the examples of the visual effects data sets listed above are described by taking one version as an example. However, at least two versions of visual special effects labels may be included in the same visual special effects data set. For example: [Version 1] [00:00.00] Effect setting data 1 [Version 1] [00:24.88] Effect setting data 2 [Version 1] [01:27.05] Effect setting data 3 [Version 1] [02:30.39] Effect setting data 4 [Version 2] [00:00.00] Effect setting data 5 [Version 2] [01:27.05] Effect setting data 4 [Version 2] [02:30.39] Effect setting data 1 ... ...

As can be seen from the above example, the visual effect label corresponding to [00:00:00] has two versions: version 1 and version 2, and the visual effect label corresponding to [00:24.88] has only one version: version 1. That is, although at least two versions of visual effects labels may be included in the visual effects data set, it is not meant that there must be at least two different versions of visual effects labels in all time intervals. In summary, there are at least two versions of visual effects labels in all time intervals; or only a visual effect label with at least two versions in a partial time interval, and only one version of the visual effects label in other time intervals.

In each of the above embodiments, the time is represented by time: minute: second, but the present invention is not limited to this method. For example, any unit such as seconds, milliseconds, minutes, etc. can be directly used. To characterize. Taking the start time 00:24.00 as an example, the number of seconds converted is 1440, and the number of milliseconds is 14.40 million, which is 24 in minutes. The time data recorded in the time setting data may also be the result of various reversible operations on the time value, and may even perform an encryption operation. Taking the above number of seconds 1440 as an example, for example, it can be divided by 2 to obtain 720. That is, 720 is stored in the time setting data, but it actually expresses 1440 seconds. It can be understood that after this operation, in order to calculate the effective time interval of a visual effect label, a reverse operation is required to obtain an actual time interval.

It can be understood that no matter what kind of processing, the essence is still to define a time starting point or time interval in the visual effect label, therefore, all of these methods should be included in the scope of the above time setting data.

The effect setting data is the original file of video, animation, picture, and text.

The effect setting data can be used to set the way to generate visual effects and other parameters. Visual effects here can include static effects as well as dynamic effects. Static effects, for example, can include effects such as light color, light brightness, display patterns, and display text. Dynamic effects include, for example, various animations such as color changes, brightness changes, pattern changes, text changes, animations, or combinations thereof. Dynamic effects can be matched to a single shot, or a series of consecutive beats. The animation effects described above, for example, may include superimposed animation effects on the main screen of the chorus multimedia video, such as displaying full-screen flowers, rain, snow, heart-shaped cakes, and the like. The effect setting data may also be information for other formats for obtaining visual effects, such as the identifier of the visual effects resource file. The visual effect resource file here may be pre-stored in the memory connected to the control host 10 or stored in the cloud server. The control host 10 can read the visual special effect resource file corresponding to the identifier of the visual special effect resource file in the memory, or initiate a network request to download the visual special effect resource file from the cloud server.

Preferably, the visual special effect set by the special effect setting data is related to the beat of the music, and the time node of the beat is controlled by the time setting data described above. In general, the visual effects set by the special effects setting data, for each beat of the music, it is better to output an obvious visual special effect change in the visual special effects, and the magnitude, speed, range and the like of the visual special effect change are It is related to the characteristics of the beat (by analyzing the audio parameters such as volume and frequency). Therefore, through visual effects, it is possible to reflect the changes in music, so that in addition to sound, music can also give people a richer stimulation through visual effects. In other words, the visual effect of the present embodiment visualizes the beat of the music and enhances the rhythm of the music.

In this embodiment, the control host 10 synchronously detects the singing state of the singer, and obtains a visual effect label matching the current time from the visual effect label of the corresponding version of the visual effect data set according to different singing states of the singer and generates and The visual effect signal of the multimedia file is synchronously played.

In a specific implementation manner, when it is detected that the microphone is turned off, the first version of the visual effect label is acquired and the corresponding visual effect is outputted correspondingly, and the first version of the visual special effect label, for example, sets a visual effect that changes the tempo more moderately. When it is detected that the microphone is turned on, the second version of the visual effect label is acquired and the corresponding visual effect is output correspondingly, and the second version of the visual special effect label, for example, sets a visual effect in which the changing rhythm is consistent with the beat of the music.

In a specific implementation manner, when it is detected that the singer's singing volume is lower than a predetermined value, the first version of the visual effect label is obtained and the corresponding visual effect is output correspondingly, and the first version of the visual special effect label, for example, the setting change The rhythm is more soothing visual effect; when it is detected that the singer's singing volume is higher than the predetermined value, the second version of the visual special effect label is obtained and the corresponding visual effect is output correspondingly, and the second version of the visual special effect label, for example, sets the changing rhythm A visual effect that is more obvious, has a wider range of changes, and has a larger range of changes.

In a specific implementation manner, when it is detected that the singer's voice frequency is lower than a predetermined value, the first version of the visual effect label is acquired and the corresponding visual effect is output correspondingly, and the first version of the visual special effect label is set to a color tone, for example. a shallow visual effect; when detecting that the singer's voice frequency is higher than a predetermined value, acquiring a second version of the visual effect label and correspondingly outputting a corresponding visual effect, and the second version of the visual special effect label, for example, setting the color is relatively bright Visual effects.

In the above specific example, the control host 10 determines which version of the visual effect is acquired according to a predetermined rule, but the embodiment is not limited to this manner. For example, the visual effect data set further includes a singing status response tag, where the singing status response tag includes time setting data and version setting data, and the time setting data sets an effective time interval of the singing status response tag, and the version setting The data sets a correspondence between the version of the visual effect tag and the singing state.

The control host 10 obtains the matching singing state response tag according to the current time, and obtains the visual effect label of the corresponding version according to the correspondence defined by the version setting data in the matching singing state response tag.

For example, in the first time interval, when it is detected that the microphone is turned off, the first version of the visual effect label is acquired and the corresponding visual effect is output correspondingly, and the first version of the visual special effect label, for example, sets a visually responsive rhythm. Special effects; when it is detected that the microphone is turned on, the second version of the visual effect label is obtained and the corresponding visual effect is output correspondingly, and the second version of the visual special effect label, for example, sets a visual effect in which the changing rhythm is consistent with the beat of the music. And in the second time interval, when detecting that the microphone is turned off, acquiring the second version of the visual effect label and correspondingly outputting the corresponding visual effect, the second version of the visual special effect label, for example, setting the changing rhythm and the beat of the music. Consistent visual effects; when it is detected that the microphone is turned on, the first version of the visual effect label is obtained and the corresponding visual effect is output correspondingly, and the first version of the visual special effect label, for example, sets a visual effect that changes the rhythm more slowly.

In this way, the correspondence between the version of the visual effects label and the singing state can be completely customized, and a richer visual effect function can be provided.

Correspondingly, the visual effect output device 11 outputs a visual effect synchronized with the multimedia file according to the visual effect signal of the control host 10.

According to the technical solution of the embodiment, in addition to the normal audio and video, the control host also generates a visual special effect synchronized with the time line, and the visual effects will change synchronously with the time line, and the change is more abundant. Moreover, depending on the singer's singing status, the corresponding version of the visual effects is automatically switched to provide a richer visual effects for the multimedia accompaniment system.

Second embodiment

2 is a schematic structural diagram of a vocal visual effect system 200 according to a second embodiment of the present invention. As shown in FIG. 2, the vocal visual effect system 200 of the present embodiment is similar to the vocal visual effects system 100 of FIG. 1, and is further distinguished by: an audio output device 12 and a karaoke panel 13.

The audio output device 12 may include, for example, an audio output device such as a speaker or a power amplifier.

The karaoke panel 13 provides a karaoke interface. The user can, for example, sing a song through the touch screen, and the selected song is submitted to the control host 10, and the control host 10 plays the audio corresponding to the selected song according to the list to be played and/ Or the video file, the audio signal is output by the audio output device 12.

According to the technical solution of the embodiment, the control host 10 controls both the output of the visual effects and the host of the karaoke system. That is, the vocal visual effect system of the present embodiment is particularly suitable for use in an application scenario of a KTV.

In addition, referring to FIG. 3, in the present embodiment, the singing state sensing device 15 is connected to the control host 10 in a wireless manner.

Third embodiment

Referring to FIG. 4, it is a schematic diagram of a vocal visual effect system 300 according to a third embodiment of the present invention. As shown in FIG. 4, the vocal visual effects system 300 of the present embodiment is similar to the vocal visual effects system 200 of FIG. 2, except that it also includes a multimedia video output device 14.

The multimedia video output device 14 is, for example, a television, a projector or a display screen. The multimedia video output device 14 is configured to output a chorus multimedia video home screen of the multimedia file. When the control host 10 plays the multimedia file, the multimedia video main screen is sent to the multimedia video output device 14 for output.

According to the technical solution of the embodiment, the visual effect is output through the visual effect output device 11, and the multimedia video main picture is output through the multimedia video output device 14, and the two do not affect each other.

Further, it will be appreciated that the multimedia video output device 14 can still be used to output visual effects. Of course, the visual effects are superimposed on the main screen of the multimedia video.

That is, the visual effects set in the special effect setting data may include visual effects respectively output by a plurality of types of devices. For example, the lighting effects are output by the LED light array, and the video overlay effects are output by the multimedia video output device 14.

Fourth embodiment

Referring to FIG. 5, it is a schematic diagram of a vocal visual effect system 400 according to a fourth embodiment of the present invention. The vocal visual effects system 400 of the present embodiment is similar to the vocal visual effects system 300 of FIG. 4, except that it also includes a cloud server system 20.

Specifically, the cloud server system 20 includes a database 22 and a server 24. The database 22 is used to store visual effects data sets of different songs. The server 24 is configured to return a visual effect data set to the client according to the request of the client (such as the control host 10).

FIG. 6 shows a block diagram of an embodiment of the above-described server 24. As shown in FIG. 6, the server includes a memory 102, a memory controller 104, one or more (only one shown) processor 106, a peripheral interface 108, and a network module 110. These components communicate with one another via one or more communication bus/signal lines.

It can be understood that the structure shown in FIG. 6 is merely illustrative, and the above server may further include more or less elements than those shown in FIG. 6, or have a configuration different from that shown in FIG. 6. The elements shown in Figure 6 can be implemented in hardware, software, or a combination thereof.

The memory 102 can be used to store software programs and modules, such as the program instructions/modules corresponding to the methods and devices in the embodiments of the present invention. The processor 106 runs the software programs and modules stored in the memory 102, thereby The above methods are implemented by performing various functional applications and data processing.

The memory 102 can include high speed random memory and can also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 102 can further include memory disposed remotely relative to processor 106, the remote registers being connectable to the server via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof. Access to the memory 102 by the processor 106 and other possible components can be performed under the control of the memory controller 104.

Peripheral interface 108 couples various input/output devices to processor 106. The processor 106 runs various software in the memory 102, instructs the server to perform various functions, and performs data processing. In some embodiments, peripheral interface 108, processor 106, and memory controller 104 can be implemented in a single wafer. In other instances, they can be implemented separately from separate wafers.

The network module 110 is configured to receive and send network signals. The above network signals may include wireless signals or wired signals. In one example, the network signal is a wired network signal. At this time, the network module 110 may include components such as a processor, a random memory, a converter, a crystal oscillator, and the like. In one embodiment, the network signal is a wireless signal (eg, an RF signal). At this time, the network module 110 is essentially a radio frequency module, which receives and transmits electromagnetic waves, and realizes mutual conversion between electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The radio frequency module can include various existing circuit components for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a user identity module (SIM) card, a memory, and the like. The RF module can communicate with various networks such as the Internet, intranets, wireless networks or with other devices over a wireless network. The wireless network described above may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code. Wideband code division multiple access (W-CDMA), Code division access (CDMA), time division multiple access (TDMA), wireless fidelity (Wireless, Fidelity, WiFi) (such as the Institute of Electrical and Electronics Engineers Standard IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), Voice over internet protocal (VoIP), Worldwide Interoperability for Microwave Access ( Worldwide Interoperability for Microwave Access, Wi-Max), other agreements for mail, instant messaging and short messages, and any other suitable communication protocols, even those that are not currently under development.

The software program and module described above include an operating system 122 and a visual effects service module 124. The operating system 122 may include various software components and/or drivers for managing system tasks (eg, memory management, storage device control, power management, etc.) and may communicate with various hardware or software components to provide other software. The operating environment of the component. The visual effects service module 124 runs on the basis of the operating system 122 for implementing the transmission control function of the visual special effects data set of the vocal visual effects system, which is described in detail below.

The visual effect service module 124 includes an identity verification module 126, a special effect transmission module 128, and an information transmission module 130.

The identity verification module 126 is configured to perform identity verification on the user side. In a specific implementation, each control host 10 stores identity authentication information, such as an encrypted string of host IDs. Before initiating the visual effect data set acquisition request to the visual effect service module 124, the control host 10 may initiate a login request to send the identity authentication information to the server 24. Correspondingly, the identity verification module 126 of the server 24 decrypts the identity authentication information according to the predetermined encryption algorithm and the key, and verifies whether the host ID has the permission to acquire the visual effect data set. For example, the payment identifier corresponding to the host ID is retrieved. If the host ID does not pay the usage fee of the visual effect data set, the host ID does not have the permission to acquire the visual special effect data set, and the identity authentication of the control host 10 is not transparent. Accordingly, the effect transmission module 128 rejects the request to control the host 10 to obtain the visual effects data set.

If a host ID has permission to obtain a visual effects data set, the effect transmission module 128 returns a corresponding visual effect data set according to the request of the control host 10. It can be understood that the control host 10 can initiate the above-mentioned login verification request and the visual effect data set acquisition request when starting a certain song or other multimedia file, or after the song enters the playlist, and the identifier of the song to be played. It is included in the request for obtaining the visual effects data set mentioned above.

It can be understood that it takes a certain time to download the visual special effects data set from the server 24. Therefore, if the visual effect data set is started to be downloaded when the song starts playing, it needs to be considered when the visual special effects data set is downloaded and the visual special effect is played. Remove the impact of download time on the timeline. Specifically, if the download of the visual effects data set is completed and the playback starts at time T after the song is played, the timeline of the visual effects will start from time T instead of starting from the beginning to synchronize with the timeline of the multimedia file. This requires the control host 10 to record the time when the multimedia file starts to play and the time when the visual effect data set is downloaded. The time difference between the two is the time T described above.

Once each multimedia file is added to the to-be-played list, the control host 10 can begin downloading the corresponding visual effects data set. In this way, only the visual effects data set of the first multimedia file in the playlist needs to adjust the timeline, and the visual effect data set of all subsequent songs can be downloaded in the background while other songs are played, therefore, During the playback, the visual effects data set has been downloaded, and the visual effects can be played synchronously with the video and audio without adjusting the timeline.

It can be understood that when the song is paused, the control panel synchronization will also pause the visual effects.

The information transmission module 130 is configured to transmit some additional information in addition to the visual effects data set. Specifically, the information transmission module 130 can be used to transmit personalized messages of the user. It can be understood that in order for the information transmission module 130 to transmit the personalized information of the user, the information transmission module 130 needs to know the identity information of the current user.

In a specific implementation manner, the control host 10 itself includes a login module for allowing the user to input a username and password for the login operation, and the control host 10 can receive the user name and password input by the user. Upload it to the cloud server for login verification. If the login verification is passed, the identity information of the currently logged-in user can be included in the network request every time a network request is sent to the cloud server, thereby transmitting the information. The module 130 can transmit the personalized information of the user according to the identity information uploaded by the control host 10.

In another specific implementation manner, the control host 10 does not directly transmit the identity information of the user, but only transmits the identification word of the control host 10 itself. In this way, it is necessary for the cloud server to uniquely determine the corresponding user by controlling the identity of the host 10 itself. That is, if the control host 10 uploads only the identification word of the control host 10 itself, it is necessary to establish a binding relationship between the control host 10 and the current user in advance.

For example, a two-dimensional code is set on the control host 10, in the KTV room in which the control host 10 is located, or on the screen of the television set 14 connected to the control host 10. The QR code may include an encryption of the ID of the control host 10. String. When the user scans the QR code in a specific application, the application initiates a network request to the predetermined URL, and the identifier of the current user of the program is included with the encrypted string. Sent to the server 24. After receiving the network request, the server 24 parses out the user identification information and the host ID, and establishes a binding relationship between the two. Correspondingly, the information transmission module 130 can transmit the personalized information of the user, for example, an avatar, a name, and other information edited by the user to the control host 10.

It can be understood that to achieve replacement of the current multimedia video content, the control host 10 needs to know when and where at the multimedia video home screen the replacement operation is performed. In an embodiment, the control host 10 can perform a face recognition operation, and when the face is recognized in the played multimedia video screen, the face can be replaced with the current user's face.

In another method, the visual effect data set includes a video replacement special effect label, and the video replacement special effect label includes time setting data, and the shape data of the area defined by the predetermined shape in the main screen of the multimedia video. And category information corresponding to the shape data. The video replacement effect label can be manually predetermined. The shape data defines an area to be replaced by video or text, and the category data defines a category of information to be replaced in a certain area, for example, a user personalized information that is replaced with a user image or a user name or any other category. In this manner, the visual effects data set includes, in addition to the visual effects tags used to generate the synchronized visual effects as described in the above embodiments, a video replacement effect tag for generating a video replacement effect synchronized with the timeline.

Thus, the control host 10 can display the personalized information of the user on the main screen or in the LED array. For example, replace the avatar in the main screen with the avatar of the user, or replace the text in the main screen with the user name. It can be understood that in order to prevent leakage of user information, it is necessary to implement the unbinding operation between the user and the control host 10 after the user leaves the current user room.

In one embodiment, whenever the control host 10 is rebooted, an unbinding request is sent to the server 24 to release all user bindings to the control host 10. This solution is based on the fact that all vocal visual effects systems are restarted before they are used by different users.

In another embodiment, the binding relationship between the control host 10 and the user can be released by the user using the application used in the binding. Therefore, user information leakage can be avoided.

According to the vocal visual effect system of the embodiment, the visual special effects data set is stored in the cloud server system 20, which ensures that the visual special effect data set can be accessed only by authorized users, and the security of the visual special effect data set is improved.

Fifth embodiment

Referring to FIG. 7, a schematic diagram of a vocal visual effect system 500 according to a fifth embodiment of the present invention is shown. The vocal visual effects system 500 of the present embodiment is similar to the vocal visual effects system 400 of FIG. 5, except that it also includes special effects devices 26.

In the present embodiment, the processing of the video special effects is not directly implemented by the control host 10, but is implemented by the specially designed special effect device 26. Specifically, the special effect device 26 generates a corresponding video signal according to the special effect data, and superimposes the special effect video signal on the main screen, or outputs the image to the LED array for display.

The special effect device 26 is a stand-alone electronic device having a lighting and/or video display function and having a special effect processing function, and is connected to the control host 10 by wire or wirelessly.

According to the vocal visual effect system of the present embodiment, the video special effect is realized by the specially designed special effect device 26, which can reduce the complexity of the control host 10.

Sixth embodiment

Referring to FIG. 8, which is a schematic diagram of a vocal visual effect system 600 according to a fifth embodiment of the present invention. The sound-sensing visual effects system 600 of the present embodiment is similar to the sound-sensing effect system 500 shown in FIG. 7, except that it also includes an external device 40.

In this embodiment, the external device 40 is, for example, a host in a conventional multimedia playing system, which implements a song control function of a song and a song. However, it is further connected to the control host 10 than the conventional multimedia playback system. Whenever the external device 40 plays a song or a song is added to the playlist, the external device 40 transmits the identification of the song to the control host 10.

It can be understood that in order for the external device 40 to send specific information to the control host 10, a specific application design development interface (API) can be disclosed in the control host 10, so that the external device 40 can be called to the control host 10. Send the above information. Whenever the external device 40 plays a song, the external device 40 can submit the identification of the song and the time when the playback starts to the control host 10 through the API described above. Of course, in order to implement the API call, the external device 40 needs to modify the program in the existing external device 40 so that the information is synchronized with the control host 10 through the API when needed.

Correspondingly, the control host 10 requests the cloud server system 20 to acquire the visual effect data set according to the identifier of the song. It will be appreciated that the control host 10 can also perform authentication operations as described in the previous embodiments. After obtaining the visual special effects data set, the control host 10 generates a corresponding video special effect signal according to the visual special effect label in the visual special effect data set, and sends the generated visual special effect signal to the special effect device 26. Of course, considering the delay of the network download, the control host 10 can also perform the time adjustment of the visual effects, that is, apply a forward offset to the time defined by the time setting data, so that the timeline and the file of the visual effects are played. The progress is synchronized.

The effect device 26 superimposes the visual effect signal on the main screen of the multimedia video output device 14 and/or outputs it to the visual effect output device 11.

According to the vocal visual effect system of the present embodiment, by slightly improving the program in the external device 40 in the existing multimedia playing system, the visual effect synchronized with the song can be added, which can be compatible with the existing multimedia playing system to the greatest extent. Equipment to avoid the cost of equipment upgrades.

Although the above embodiment is described by taking the KTV system as an example, the above vocal visual effects system can also be applied to multimedia classrooms, dance halls, and park entertainment facilities.

In particular, when the control host 10 is a smart electronic device (such as a smart phone), the software installed in the smart electronic device can wirelessly control the visual effect output device 11 or wirelessly access the visual effects on the network. At the same time, the songs played through the external device 40 are recorded through the built-in microphone, and the songs placed by the external device 40 are directly recognized through feature sampling and feature matching, so that the songs can be obtained without communication with the external device 40. Identify and then download the corresponding visual effects data set to play visual effects in sync with the song.

Seventh embodiment

Referring to FIG. 9, which is a flowchart of a method for obtaining a visual effect data set according to a seventh embodiment of the present invention. As shown in FIG. 9, the method of the present implementation includes the following steps:

Step S101, playing a multimedia file;

The multimedia file can be played, for example, by the control host 10 or by the external 40.

Step S102: Acquire a visual special effects data set corresponding to the multimedia file.

The visual effects data set may include, for example, the above-mentioned visual special effects labels, and each visual special effects label includes time setting materials and special effect setting materials. Of course, regardless of the content of the visual effects data set, the acquisition process is similar.

Specifically, step S102 may include: step S1022, parsing, from the multimedia file, the visual special effect data set embedded in the multimedia file.

According to this method, the visual effects data set is embedded in the multimedia file and can be saved together with the multimedia file to reduce the complexity of the system.

In addition, step S102 may further include: step S1024, downloading the visual special effects data set from the cloud server.

With further reference to FIG. 10, step S1024 may specifically include the following steps:

Step S201: Send identity authentication information to the cloud server system, so that the cloud server system can verify whether the permission to obtain the visual special effect data set is obtained;

Step S202, sending, according to the identifier of the multimedia file, a request for acquiring the corresponding visual special effect data set to the cloud server system;

Step S203, receiving the visual special effect data set returned by the cloud server system;

In this way, the visual effects data set is stored in the cloud server system 20, which ensures that only authorized users can access the visual effects data set and improve the security of the visual effects data set.

According to the method of the embodiment, when the multimedia file is played, a visual special effect data set corresponding to the multimedia file is further acquired, and the visual special effect data set can be used to output a visual special effect signal that is played together with the multimedia file, thereby simultaneously outputting the visual special effect. .

Eighth embodiment

Referring to FIG. 11 , it is a flowchart of replacing personalized information of a user in a visual special effect according to an eighth embodiment of the present invention. As shown in FIG. 11, the method of this embodiment includes the following steps:

In step S301, the identity information of the user or the information for confirming the identity of the user is sent to the cloud server system.

For example, the control host 10 allows the user to enter a username and password to log in. Thus, after verifying through the login, the control host 10 can send the identity information of the user together with the network request requesting the visual effect data set. Give the cloud server system. The control host 10 may also only send its own identification word to the cloud server system. At this time, the user needs to initiate a binding request to the cloud server system through another terminal (such as a mobile phone) to establish a binding relationship between the current user of the terminal and the control host 10, and thus, the identification by the control host 10 is performed. The word can also uniquely identify the corresponding user.

Step S302: Receive user personalized information sent by the cloud server system.

The visual effect data set further includes a video replacement special effect label corresponding to the time setting data, where the video replacement special effect label includes a time setting data, a shape data of an area defined by a predetermined shape in the main screen of the multimedia video, and the The category data corresponding to the shape data.

Step S303, replacing the content in the area of the predetermined shape with the user personalized information corresponding to the category data.

According to the technical solution of the embodiment, the specific content in the multimedia file can be replaced with the personalized information of the user, and the replacement operation can also be synchronized with the timeline.

Ninth embodiment

Referring to FIG. 12, it is a flowchart of a vocal visual effect processing method according to a ninth embodiment of the present invention. As shown in FIG. 12, the method of this embodiment includes the following steps:

Step S401: Acquire a visual special effect data set corresponding to the multimedia file when the multimedia file is played, or when the multimedia file is played by the external device, where the visual special effect data set includes at least two versions of visual special effect labels, each of which The version of the visual effects label includes time setting data and special effect setting data;

Step S402, synchronously detecting the singing state of the singer, obtaining a visual special effect label matching the current time from the visual special effect label of the corresponding version of the visual special effect data set according to different singing states of the singer, and generating synchronization with the multimedia file. Visual effects signal for playback; and

Step S403, synchronously outputting visual effects according to the visual effect signal.

The technical solution of the embodiment has the beneficial effects that in addition to the normal audio and video, the control host also generates a visual special effect synchronized with the time line, and the visual effects will change synchronously with the time line, and the change is more abundant. Moreover, depending on the singer's singing status, the corresponding version of the visual effects is automatically switched to provide a richer visual effects for the multimedia accompaniment system.

In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, such as a non-volatile memory such as a compact disk, a hard disk, or a flash memory. The computer executable instructions are for causing a computer or similar computing device to perform the method of the above embodiments.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. The present invention has been disclosed in the preferred embodiments, but is not intended to limit the present invention, and any person skilled in the art. The equivalents of the technical solutions disclosed above may be modified or modified to equivalent variations, without departing from the technical scope of the present invention, in accordance with the technical essence of the present invention. Any of the above-described modifications, equivalent changes and modifications of the above embodiments are still within the scope of the technical solutions of the present invention.

100, 200, 300, 400, 500, 600‧‧‧ vocal visual effects system
10‧‧‧Control host
11‧‧‧Visual effects output device
12‧‧‧Operation output device
13‧‧‧Voice panel
14‧‧‧Multimedia video output equipment
15‧‧‧Singing state sensing device
20‧‧‧Cloud Server System
22‧‧‧Database
24‧‧‧Server
26‧‧‧ Special effects equipment
40‧‧‧External equipment
101‧‧‧ microphone
112‧‧‧Singer
102‧‧‧ memory
104‧‧‧Storage Controller
106‧‧‧ Processor
108‧‧‧ peripheral interface
110‧‧‧Network Module
122‧‧‧Operating system
124‧‧‧Visual Effects Service Module
126‧‧‧identity verification module
128‧‧‧Special effect transmission module
130‧‧‧Information Transmission Module

1 is a schematic structural diagram of a vocal visual effect system provided by a first embodiment of the present invention; [FIG. 2] is a schematic structural diagram of a vocal visual effect system provided by a second embodiment of the present invention; [FIG. 3] is a second implementation FIG. 4 is a schematic structural diagram of a vocal visual effect system provided by a third embodiment of the present invention; [FIG. 5] is a vocal visual effect system provided by a fourth embodiment of the present invention; [FIG. 6] is a block diagram of a cloud server in a vocal visual effect system of a fourth embodiment; [FIG. 7] is a schematic structural diagram of a vocal visual effect system provided by a fifth embodiment of the present invention; 8 is a schematic structural diagram of a vocal visual effect system provided by a sixth embodiment of the present invention; [FIG. 9] is a flowchart of a method for acquiring a visual special effect data set provided by a seventh embodiment of the present invention; [FIG. 10] FIG. A flowchart of some steps in the method; [FIG. 11] is a replacement of the user in the visual effect provided by the eighth embodiment of the present invention. Information of the flowchart; [12] based flowchart illustrating a method of processing visual effects provided accompaniment ninth embodiment of the present invention.

100‧‧‧Singing visual effects system

10‧‧‧Control host

11‧‧‧Visual effects output device

15‧‧‧Singing state sensing device

101‧‧‧ microphone

112‧‧‧Singer

Claims (10)

A vocal visual effect system, comprising: a control host and a visual effect output device; the control host acquires a visual special effect data set corresponding to the multimedia file when playing a multimedia file or when playing an multimedia file by an external device, The visual effects data set includes at least two versions of visual special effects labels, and each version of the visual special effects labels respectively includes time setting materials and special effect setting materials; the control host synchronously detects the singing state of the singer, according to the singer's Obtaining a visual effect label matching the current time from the visual effect label of the corresponding version of the visual effect data set and generating a visual special effect signal synchronously played with the multimedia file; the visual effect output device according to the Visual effects signal sync output visual effects. The vocal visual effect system of claim 1, further comprising: a singing state sensing device, wherein the singing state sensing device senses the singing state data of the artist, and sends the singing state data to the instant. The control host, the singing state data includes at least one of a microphone switch state, a button state, a singer voice frequency, a singer volume, and a singer motion feature; the control host sends a sing according to the singing state sensing device The status data determines the singing status. The vocal visual effect system of claim 1, further comprising: a singing state sensing device, wherein the singing state sensing device senses a singing state data of the artist, and determines the singing according to the singing state data. a state, and the singing state is immediately sent to the control host, and the singing state data includes at least one of a microphone switch state, a microphone button state, a singer voice frequency, a singer volume, and a singer motion feature. The vocal visual effect system of any one of claims 1-3, wherein the visual effect data set further includes version setting data, and the version setting data sets a version and a version of the visual special effect label. The correspondence between the singing states. The vocal visual effect system of claim 1, wherein the control host acquires a visual effect data set corresponding to the multimedia file, comprising: the control host according to the identifier of the multimedia file to a cloud server The system sends a request for obtaining the corresponding visual effect data set; and receiving the visual special effects data set returned by the cloud server system. The vocal visual effect system of claim 5, wherein the controlling host acquires the visual special effect data set corresponding to the multimedia file, further comprising: the control host transmitting the identity authentication information to the cloud server a system for causing the cloud server system to verify whether the control host has permission to acquire a visual effects data set; the cloud server system only when the control host has permission to acquire a visual effects data set Returns a set of visual effects data requested by the control host. A vocal effect processing method includes: when playing a multimedia file, or when playing an multimedia file by an external device, acquiring a visual special effect data set corresponding to the multimedia file, where the visual special effect data set includes at least two The version of the visual effects label, each version of the visual effects label includes time setting data and special effect setting data; synchronously detecting the singing state of the singer, respectively, according to the different singing state of the singer, respectively, from the visual effect data corresponding to the version of the visual A visual effect label matching the current time is obtained in the special effect label and a visual special effect signal synchronized with the multimedia file is generated; and the visual special effect is synchronously output according to the visual special effect signal. The method for processing a vocal visual effect according to the seventh aspect of the invention, further comprising: a singing state sensing device, wherein the singing state sensing device senses a singing state data of the artist, and sends the singing state data immediately Giving the control host, the singing state data includes at least one of a microphone switch state, a button state, a singer voice frequency, a singer volume, and a singer action feature; the control host sends the spoofing state sensing device according to the The singing state data determines the singing state. The method for processing a vocal visual effect according to the seventh aspect of the invention, further comprising: a singing state sensing device, wherein the singing state sensing device senses a singing state data of the artist, and determining, according to the singing state data, The singing state is sent to the control host in real time, and the singing state data includes at least one of a microphone switch state, a microphone button state, a singer voice frequency, a singer volume, and a singer motion feature. The method for processing a vocal visual effect according to any one of claims 7-9, wherein the visual effect data set further includes version setting data, and the version setting data sets a version of the visual effect label and a correspondence between the singing states; the method further comprising: switching a version of the visual effect according to the correspondence.