WO2024222447A1

WO2024222447A1 - Special effect video generation method and apparatus, electronic device, and storage medium

Info

Publication number: WO2024222447A1
Application number: PCT/CN2024/086757
Authority: WO
Inventors: 莫鸿鑫; 覃童; 刘畅
Original assignee: 北京字跳网络技术有限公司
Priority date: 2023-04-28
Filing date: 2024-04-09
Publication date: 2024-10-31
Also published as: CN118869901A

Abstract

Embodiments of the present disclosure provide a special effect video generation method and apparatus, an electronic device, and a storage medium. The method comprises: displaying an application interface; in response to a first trigger operation for a special effect component, obtaining area information, the area information representing a target area feature of a target area; displaying a target special effect sticker in the application interface, wherein the special effect content of the target special effect sticker is determined on the basis of the area information; and generating a special effect video on the basis of the target special effect sticker.

Description

Special effects video generation method, device, electronic device and storage medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application No. 202310485260.1, filed on April 28, 2023, entitled “Special Effects Video Generation Method, Device, Electronic Device and Storage Medium”, the disclosure of which is incorporated herein by reference in its entirety.

Technical Field

The embodiments of the present disclosure relate to the field of Internet of Things technology, and in particular to a special effect video generation method, device, electronic device and storage medium.

Background Art

Currently, processing videos to generate special effects videos with corresponding virtual special effects is a common application scenario of video editing functions. Various applications and platforms implement the above-mentioned function of generating special effects videos by providing users with preset special effects props.

Summary of the invention

The embodiments of the present disclosure provide a special effect video generation method, device, electronic device and storage medium.

In a first aspect, an embodiment of the present disclosure provides a method for generating a special effects video, including:

Displaying an application interface; in response to a first trigger operation for a special effect component, obtaining area information, wherein the area information represents target area characteristics of a target area; displaying a target special effect sticker in the application interface, wherein the special effect content of the target special effect sticker is determined based on the area information; and generating a special effect video based on the target special effect sticker.

In a second aspect, an embodiment of the present disclosure provides a special effects video generating device, including:

Display module, used to display the application interface;

A processing module, configured to obtain region information in response to a first trigger operation on the special effect component, wherein the region information represents a target region feature of the target region;

A generation module is used to display target special effect stickers in the application interface and generate special effect videos based on the target special effect stickers, wherein the special effect content of the target special effect stickers is determined based on the area information.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

A processor, and a memory communicatively connected to the processor;

The memory stores computer-executable instructions;

The processor executes the computer-executable instructions stored in the memory to implement the special effects video generation method described in the first aspect and various possible designs of the first aspect.

In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the special effects video generation method described in the first aspect and various possible designs of the first aspect is implemented.

In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the special effects video generation method described in the first aspect and various possible designs of the first aspect.

In a sixth aspect, an embodiment of the present disclosure provides a computer program, which, when executed by a processor, implements the special effects video generation method as described in the first aspect and various possible designs of the first aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

FIG1 is a diagram of an application scenario of a special effects video generation method provided by an embodiment of the present disclosure;

FIG2 is a flow chart of a method for generating special effects video according to an embodiment of the present disclosure;

FIG3 is a flow chart of a specific implementation method of step S102 in the embodiment shown in FIG2 ;

FIG4 is a schematic diagram of a process for generating a special effects video provided by an embodiment of the present disclosure;

FIG5 is a schematic diagram of another process of generating a special effects video provided by an embodiment of the present disclosure;

FIG6 is a schematic diagram of displaying a second mark provided by an embodiment of the present disclosure;

FIG7 is a schematic diagram showing a third mark provided by an embodiment of the present disclosure;

FIG8 is a schematic diagram of a process flow of generating a second identifier and/or a third identifier provided by an embodiment of the present disclosure;

FIG9 is a flow chart of interaction between a terminal device and a server provided in an embodiment of the present disclosure;

FIG10 is another flow chart of interaction between a terminal device and a server provided in an embodiment of the present disclosure;

FIG11 is a second flow chart of a method for generating special effect videos provided in an embodiment of the present disclosure;

FIG12 is a schematic diagram of a process of responding to a first editing operation provided by an embodiment of the present disclosure;

FIG13 is a third flow chart of the special effects video generation method provided by an embodiment of the present disclosure;

FIG14 is a schematic diagram of a process for setting a display position in a frame corresponding to each initial image provided by an embodiment of the present disclosure;

FIG15 is a schematic diagram of a process of setting special effect content corresponding to each initial image provided by an embodiment of the present disclosure;

FIG16 is a structural block diagram of a special effect video generating device provided by an embodiment of the present disclosure;

FIG17 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure;

FIG. 18 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure.

DETAILED DESCRIPTION

In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

In the solutions in the related art, when the special effects props are selected and triggered by the user, the content of the displayed special effects stickers is fixed, and personalized special effects content suitable for the user cannot be generated, resulting in low efficiency in generating special effects videos and small amount of information.

According to the special effect video generation method, device, electronic device and storage medium provided by the embodiments of the present disclosure, an application interface is displayed; in response to a first trigger operation on a special effect component, regional information is obtained, wherein the regional information represents the target region characteristics of the target region; a target special effect sticker is displayed in the application interface, wherein the special effect content of the target special effect sticker is determined based on the regional information; and a special effect video is generated based on the target special effect sticker. After the special effect component is triggered, a special effect video determined by the regional information of the target region representing the target region characteristics is displayed in the application interface. content, thereby realizing dynamic mapping between regional information and the special effect content of the target special effect sticker triggered by the terminal device, so that the special effect video generated based on the target special effect sticker can match the regional features without the need for manual editing or input by the user, thereby improving the efficiency of video generation and enriching the amount of information in the special effect video.

The application scenarios of the embodiments of the present disclosure are explained below:

The special effect video generation method provided by the embodiment of the present disclosure can be applied to the application scenarios of video editing and generation. Specifically, it can be applied to the video editing scenario of generating regional position-related special effects. Regional position-related special effects include, for example, location punch-in special effects, scenery sharing special effects, etc. The specific implementation method of the above special effects will be described in detail in the subsequent embodiments. Figure 1 is an application scenario diagram of the special effect video generation method provided by the embodiment of the present disclosure. As shown in Figure 1, the method provided by the embodiment of the present disclosure can be applied to a terminal device, such as a smart phone. An application (Application, APP) capable of realizing the image editing function of adding special effects to the initial image is running on the terminal device. In the application interface of the application, a special effect component for adding virtual special effects to the initial image is provided. When the user operates the terminal device to click on the special effect component, the special effect component is triggered, and then the corresponding special effect sticker is displayed in the application interface, such as the "glasses" sticker shown in the figure, to achieve the purpose of adding special effects to the initial image.

In the related art, for the above-mentioned typical video editing application scenarios, the content of the special effect stickers displayed after the special effect component is triggered is fixed, such as the "glasses" special effect in the above example. Its special effect content is fixed. However, in other application scenarios, such as video editing with themes such as "location check-in" and "scenery sharing", the video special effects with the above-mentioned fixed content cannot meet the user's personalized image editing needs, nor can they automatically generate personalized special effect content. In this case, the user can only manually insert text or logo information into the initial picture to meet the personalized needs of image editing, resulting in low generation efficiency of special effect videos and small amount of information. The disclosed embodiments provide a special effect video generation method to solve the above problems.

Referring to FIG. 2 , FIG. 2 is a flow chart of a special effect video generation method provided in an embodiment of the present disclosure. The method of this embodiment can be applied in a terminal device, and the special effect video generation method includes:

Step S101: Display the application interface.

Step S102: in response to a first trigger operation on the special effect component, obtaining region information, where the region information represents target region features of the target region.

Step S103: Displaying a target special effect sticker in the application interface, wherein the special effect content of the target special effect sticker is determined based on the area information.

Step S104: Generate a special effects video based on the target special effects sticker.

Exemplarily, referring to the schematic diagram of the application scenario shown in FIG1 , the execution subject of the method provided in the embodiment of the present application may be a terminal device, such as a smart phone, and the terminal device implements the special effect video generation method provided in the present embodiment by running the target application. Specifically, after the terminal device runs the target application, the application interface of the target application is displayed through the display screen. Furthermore, a special effect component is provided in the application interface. After the user triggers the special effect component by operating the terminal device through a first trigger operation such as clicking or long pressing, the target special effect sticker corresponding to the special effect component is displayed in the application interface. Among them, the special effect content of the target special effect sticker is determined based on the regional information, and the regional information characterizes the target area characteristics of the target area. In one possible implementation method, the regional information can be determined based on image data manually loaded by the user. Exemplarily, the specific implementation method of step S102 includes:

Step S1021: In response to a first trigger operation on the special effect component, image data is acquired.

Step S1022: extract features from the image data to obtain region information.

The area information includes at least one of the following: the area location of the target area, the geomorphic features of the target area, and the target object information in the target area.

Exemplarily, after the terminal device responds to the first trigger operation for the special effect component, it obtains image data, and the image data may include a video or a picture. Taking the image data as a picture as an example, after the terminal device loads the image data in response to the user instruction, it extracts the features of the target area of the target area shown in the picture, that is, the area information. Among them, the area information can be the area location, landform features and target object information. Among them, the area location refers to the location point where the target area is located, and it can also refer to the area range of the target area, or a combination of the two. The landform feature refers to the landform of the target area, such as grassland and glacier. The target object information in the target area refers to a certain specified target object located in the target area, or the characteristics of the target object, such as the type and appearance characteristics of the target object. Specifically, for example, the target object information is the feature information describing the "sunflower" in the target area, and further, the target object information can also be the feature information describing "flower" or "red sunflower". The specific implementation method can be set as needed, and will not be repeated here one by one. Furthermore, the image content in the image data includes a target area. After the terminal device extracts features from the image data, it obtains at least one of the area position corresponding to the target area represented by the image data, the topographic features of the target area, and the target object information of the target area. For example, the area information includes descriptive information representing "grassland", and more specifically, the area information includes the character string "grassland"; for another example, the area information includes descriptive information representing "A region", and more specifically, the area information includes the character string "A region", and the area information may also directly include specific location coordinates. Of course, in another possible In the implementation, the regional information can simultaneously represent the regional location and landform features, such as "grassland in area A". The specific implementation of the regional information can be set as needed and will not be described in detail here.

In a possible implementation, the special effect content of the target special effect sticker includes the first identifier. Specifically, as shown in FIG3 , the specific implementation steps of step S103 include:

Step 1031: In response to a first trigger operation on the special effect component, a first logo is displayed in the application interface.

Exemplarily, after responding to the first trigger operation on the special effect component, the terminal device obtains the area information input by the user, or the area information obtained by the user's request, and determines the target area category of the corresponding target area according to the area information. Then, the text, icon and other information corresponding to the target area category or the identification mark of the target area category, i.e., the first mark, is obtained; and the first mark representing the target area category is displayed in the application interface.

Figure 4 is a schematic diagram of a process for generating a special effects video provided by an embodiment of the present disclosure. As shown in Figure 4, exemplarily, in a possible implementation method, the application interface is a camera viewfinder interface, and a special effects component C1 (shown as C1 in the figure) is provided in the camera viewfinder interface. When the user clicks on the special effects component C1, the terminal device obtains the area information, and based on the area information, determines the corresponding target area category (A area), and then displays the first identification "A area, here I come" generated based on the target area category in the camera viewfinder interface, that is, the special effects content of the target special effects sticker. Afterwards, the terminal device responds to the third trigger operation on the camera viewfinder interface to capture image data. The image data may include a single-frame picture, multiple-frame pictures or videos captured by the camera of the terminal device. In one possible implementation, after the process of capturing the image data is completed, the terminal device directly renders the image data and the target special effect stickers to generate a final special effect video; in another possible implementation, after the process of capturing the image data is completed, the terminal device returns to the image editing page to preview the superimposed display effect of the image data and the target special effect stickers. The user can further edit the image data or the target special effect stickers to change the content of the special effect image. After the editing is completed, the image data and the target special effect stickers are fused and rendered to generate the final special effect video.

In the process of shooting image data, the target special effect stickers are displayed in the camera viewfinder interface at the same time, so that the user can preview the content of the final special effect video while shooting image data, thereby improving the efficiency of video editing.

FIG5 is a schematic diagram of another process of generating a special effect video provided by an embodiment of the present disclosure. As shown in FIG5, exemplarily, in a possible implementation, the application interface is an image editing interface, and in the image editing interface, a special effect component C2 (shown as C2 in the figure) and an album component (shown as C3 in the figure) are set. By triggering the album component, the pre-generated image data is loaded, and the image data includes a video or at least one frame of a picture. Specifically, for example, when the user clicks on the album component, selects a frame of image, multiple frames of image or a video from the opened album page, the terminal device determines it as image data and displays the image data in the image editing interface; before or after this, the special effect component C2 is triggered, for example, the user clicks on the special effect component C2, and then the terminal device obtains the corresponding target area category (area B) based on the area information, and then the terminal device displays the content of the image data in the first layer in the application interface, specifically, for example, one of the methods of playing a video, displaying the first frame of a video, displaying a frame of image, and displaying multiple frames of images in a carousel, and the first identification "Area B, I'm here" generated based on the target area category is displayed in the second layer of the application interface, wherein, optionally, the first layer is located below the second layer, that is, the target special effect sticker covers the content of the image data, so that the target special effect sticker has a better display effect. At this time, the terminal device previews the superimposed display effect of the image data and the target special effect stickers. The user can further edit the image data or the target special effect stickers to change the content of the special effect image. After the editing is completed, the generation instructions entered by the user are executed, and the terminal device renders the image data and the target special effect stickers to generate the final special effect video.

In a possible implementation, as shown in FIG3 , after step S1031, the method further includes:

Step S1032: Displaying a second identifier in the application interface according to the target area category.

Specifically, the special effect content of the target special effect sticker also includes a second identifier, which represents the cumulative triggering number of target events corresponding to the target area category, and the target event includes the terminal device generating the corresponding video special effect based on the target special effect sticker. For example, in one possible implementation, among the many terminal devices running the target application (APP), when the terminal device D1 triggers the above-mentioned target special effect sticker by calling the special effect component in the target application and generates the corresponding video special effect, it is regarded as triggering a target event. Since the triggering of the above-mentioned target event is based on the target area category, that is, when the target area category is different, the special effect content of the target special effect sticker is different. Therefore, the target area category is the input parameter of the above-mentioned target event, and the target area category has a one-to-one correspondence with the target event. When the terminal device D1 is located in the target area category, after the above-mentioned target event is triggered, the cumulative triggering number of the target event corresponding to the target area category is increased by 1.

In specific implementation, for example, when the terminal device triggers the target event, it sends a notification message to the server. The server obtains the notification message carrying the same area information to obtain the cumulative trigger data. Then the server responds to the data request sent by the terminal device and sends the cumulative trigger quantity to the terminal device, so that the terminal device can generate a second identifier based on the cumulative trigger quantity corresponding to the target area category. In another possible implementation, the target event can also be a target event for the terminal device based on the target special effect. The sticker generates corresponding video effects and publishes the video effects. Exemplarily, publishing refers to uploading the special effects video to the server corresponding to the target application so that other users can watch the video effects in the target application.

Furthermore, the terminal device generates a corresponding second identifier according to the cumulative number of triggers, and displays the second identifier in the application interface. Figure 6 is a schematic diagram of displaying a second identifier provided by an embodiment of the present disclosure. As shown in Figure 6, in the application interface, based on the time sequence, the first identifier, that is, the character string "A area, I am here", is displayed at the first moment, and then, the character string "The total number of people who check in in area A: 65535" is displayed at the second moment, that is, the content of the second identifier. It is characterized in that in the target area category (such as area A or area B in the embodiment shown in Figure 4 or Figure 5), the cumulative number of triggering the target event (such as publishing a special effects video based on the target special effects sticker) is 65535 times. Among them, in other possible implementations, the first identifier and the second identifier can also appear at the same time, and the second identifier can always be located at the same position in the application interface, or it can be located at different positions in the application interface as time changes.

Step S1033: Displaying a third identifier in the application interface according to the target area category.

Among them, exemplarily, the special effect content of the target special effect sticker also includes a third identifier, which represents the ranking of the target area category in all area categories based on the cumulative trigger number. The third identifier corresponds to the second identifier. In a possible implementation, the third identifier is generated based on the second identifier. Specifically, for example, among the many terminal devices running the target application, when the terminal device D1 triggers the above-mentioned target special effect sticker by calling the special effect component in the target application and generates the corresponding video special effect, it is regarded as triggering a target event. When the terminal device D1 is located in area A (target area category), after the above-mentioned target event is triggered, the cumulative trigger number of the target event corresponding to area A is increased by 1. At the same time, after the terminal devices located in other areas trigger the above-mentioned target event, the cumulative trigger number of other areas will also increase. Therefore, different areas correspond to a dynamically changing cumulative trigger number, and based on the cumulative trigger number, the target area category has a ranking sequence in all areas (including the target area category and other areas), such as a ranking sequence based on the cumulative trigger number from most to least.

In a specific implementation, exemplarily, the ranking sequence corresponding to all the above-mentioned areas, and/or the ranking of the target area category in the ranking sequence, can be obtained by the server after obtaining the cumulative trigger data corresponding to all the areas by comparing the cumulative trigger data of all the areas. Thereafter, the server responds to the data request sent by the terminal device and sends the ranking sequence corresponding to all the areas, and/or the ranking of the target area category in the ranking sequence to the terminal device, so that the terminal device can generate a third identifier based on the ranking sequence corresponding to all the areas, and/or the ranking of the target area category in the ranking sequence.

Further, the terminal device generates a third identifier according to the ranking sequence of the cumulative number of triggers, and/or the ranking of the target area category in the ranking sequence, and displays the third identifier in the application interface. Figure 7 is a schematic diagram of displaying a third identifier provided by an embodiment of the present disclosure. As shown in Figure 7, in the application interface, based on the time sequence, the first identifier is displayed at the first moment, the second identifier is displayed at the second moment, and the third identifier is displayed at the third moment; the third identifier includes the ranking of each area (area A, area B, area C, etc.) in all areas based on the cumulative number of triggers. As shown in the figure, area B ranks first, area A ranks second, and area C ranks third. On this basis, the second identifier can be displayed at the same time, that is, on the basis of displaying the ranking, the cumulative number of triggers corresponding to each area is displayed. In other possible implementations, the third identifier can also be displayed after the first identifier or the second identifier is displayed, or while the first identifier or the second identifier is displayed, which will not be repeated here. Among them, the third identifier can always be located at the same position in the application interface, or it can be located at different positions in the application interface as time changes.

It should be noted that the above-mentioned steps S1032 and S1033 can be executed simultaneously with step S1031, or can be executed sequentially or simultaneously after step S1031. The execution order between step S1032 and step S1033 can be set based on needs, and no specific restrictions are made here.

Further, the generation process of the second identifier and/or the third identifier is further introduced below. FIG. 8 is a schematic flow chart of a generation process of a second identifier and/or a third identifier provided in an embodiment of the present disclosure. Exemplarily, as shown in FIG. 8, before displaying the second identifier and/or the third identifier, the following steps are also included:

Step S1020A: Send a first data request to the server, where the first data request includes first information representing the target special effect sticker and second information representing the target area category.

Step S1020B: receiving event data returned by the server, the event data including at least the cumulative number of triggers of the target event corresponding to the target area, and/or the ranking of the target area category among all area categories based on the cumulative number of triggers.

Step S1020C: Generate a second identifier and/or a third identifier based on the event data.

Optionally, after generating the second identifier and/or the third identifier, the method further includes: in response to a second trigger operation, displaying the second identifier and/or the third identifier in the application interface. That is, in a possible implementation, the first identifier and/or the second identifier is in an invisible state after being generated in the initial state; after the terminal device receives and responds to the second trigger operation, the second identifier and/or the third identifier is displayed in the application interface.

FIG9 is a flowchart of an interaction between a terminal device and a server provided by an embodiment of the present disclosure. As shown in FIG9 , for example, a terminal device D1 located in area A (target area category) triggers After the above-mentioned target event, a first data request is sent to the corresponding server (i.e., the server of the target application) through the target application. The first data request includes first information representing the target special effect sticker prop_1 and second information representing area A. After receiving the first data request, the server obtains the notification information for the target special effect sticker prop_1 sent by all terminal devices in area A (including the target terminal device and other terminal devices) based on the first information and the second information therein, and obtains the cumulative trigger quantity Data_1 (shown as Data_1 in the figure) of the target event corresponding to area A (i.e., the event for generating a special effect video based on the target special effect sticker prop_1), and sends the obtained cumulative trigger quantity Data_1 to the terminal device D1. The terminal device D1 generates a second identifier through the cumulative trigger quantity Data_1.

FIG10 is another interactive flow chart between a terminal device and a server provided in an embodiment of the present disclosure. Exemplarily, while obtaining the cumulative trigger quantity Data_1 of the target event corresponding to the A area, the server asynchronously obtains the cumulative trigger quantity of the target event corresponding to other areas, such as the cumulative trigger quantity Data_2 corresponding to the B area (shown as Data_2 in the figure) and the cumulative trigger quantity Data_3 corresponding to the C area (shown as Data_3 in the figure) through the notification information for the target special effect sticker prop_1 sent by the terminal devices in other areas. And the cumulative trigger quantities of all multiple areas are ranked to obtain event data, and then the event data is sent to the terminal device D1, and the terminal device D1 generates a second identifier and/or a third identifier through the event data. Among them, the event data at least includes the cumulative triggering number of the target event corresponding to the target area, and/or the ranking of the target area category in all area categories based on the cumulative triggering number. In a possible implementation method, the event data includes a ranking sequence Array_data, which stores the area ranking sequence and the cumulative triggering number corresponding to each area, for example, the ranking sequence Array_data = {A = a; B = c; C = c}, wherein A, B, and C are the area identifiers representing area A, area B, and area C, respectively, a, b, and c are the cumulative triggering numbers of different areas, and a=>b=>c (or a<=b<=c). Of course, in other possible implementation methods, the ranking sequence Array_data may also only include the area ranking sequence, for example, Array_data = {A; B; C}. The server sends the ranking sequence Array_data (event data) corresponding to the target event to the terminal device, and the terminal device generates a second identifier and/or a third identifier through the ranking sequence Array_data.

After that, after the target special effect sticker is displayed in the application interface, based on the generation instruction input by the user, the terminal device can render the target special effect sticker into the corresponding initial picture or initial video, thereby generating a special effect video. The rendering process is an existing technology and will not be described here. After that, optionally, after the special effect video is generated, based on the previous introduction, the terminal device can further send a notification message to the server so that the server can update the cumulative trigger quantity and ranking sequence, thereby realizing the dynamic update of the special effect content of the target special effect sticker in the special effect video.

By displaying an application interface; in response to a first trigger operation on a special effect component, displaying a target special effect sticker in the application interface, wherein the special effect content of the target special effect sticker is determined based on the regional information; and generating a special effect video based on the target special effect sticker. After the special effect component is triggered, the special effect content determined by the regional information when the terminal device triggers the target special effect sticker is displayed in the application interface, thereby achieving a dynamic mapping between the regional information and the special effect content of the target special effect sticker triggered by the terminal device, thereby enabling the special effect video generated based on the target special effect sticker to match the regional information, without the need for manual editing by the user, thereby improving the efficiency of video generation and enriching the amount of information in the special effect video.

Referring to FIG. 11 , FIG. 11 is a flow chart of the special effect video generation method provided in the embodiment of the present disclosure. In this embodiment, based on the embodiment shown in FIG. 2 , a process of modifying and setting the target special effect sticker is further added. The special effect video generation method includes:

Step S201: Display the application interface.

Step S202: In response to a first trigger operation on the special effect component, a target special effect sticker is displayed in the application interface, wherein the special effect content of the target special effect sticker is determined based on the area information.

Step S203: In response to the first editing operation on the target special effect sticker, the special effect content of the target special effect sticker is set to a fourth identifier, wherein the fourth identifier represents a custom area category.

Step S204: Displaying a fourth logo in the application interface.

Exemplarily, after responding to the first trigger operation for the special effect component, the terminal device first displays the corresponding target special effect sticker in the application interface according to the regional information (the specific method for obtaining the regional information can be found in the introduction in the previous embodiment), such as the first identification, the second identification, the third identification, etc. in the embodiment shown in Figure 2. The specific implementation method has been described in detail in the embodiment shown in Figure 2 and will not be repeated here. Since the target area category corresponding to the regional information implemented by the location coordinates has a multi-level feature, that is, the same device can be located in the corresponding city A, in the A_1 district in the city A, or in the A_1_1 park in the A_1 district (that is, the regional information can correspond to multiple regional levels); therefore, the regional level corresponding to the first identification of the terminal device based on the device regional information may not match the regional level of interest to the user, resulting in the problem of regional level misalignment. In order to solve the above problem, in this embodiment, the terminal device responds to the first editing operation input by the user to modify the special effect content of the target special effect sticker, thereby realizing the modification of the regional level. Specifically, for example, based on the previous steps, the content of the displayed target special effect sticker includes the first identifier, and the content of the first identifier is the string "A City"; afterwards, the terminal device responds to the first editing operation and modifies the content of the first identifier to "A_1_1 Park" (the fourth identifier). Since the fourth identifier is generated based on the user's operation and corresponds to the first identifier representing the target area category where the area information is located, the fourth identifier represents the Define the area category. The specific content of the custom area category can be determined according to the specific input of the user, and will not be repeated here.

Step S205: Based on the custom area category, a fifth identifier and/or a sixth identifier is displayed in the application interface, wherein the fifth identifier represents the cumulative number of triggers of the target event corresponding to the custom area category; and the sixth identifier represents the ranking of the custom area category in all areas based on the cumulative number of triggers.

Furthermore, based on the first editing instruction, after obtaining the custom area category, the terminal device can also display the fifth identifier and/or the sixth identifier corresponding to the fourth identifier in the application interface, wherein the fifth identifier represents the cumulative number of triggers of the target event corresponding to the custom area category; the sixth identifier represents the ranking of the custom area category in all areas based on the cumulative number of triggers. The fifth identifier is equivalent to the second identifier in the previous embodiment, and the sixth identifier is equivalent to the identifier in the previous embodiment. The difference is that the second identifier and the third identifier are generated based on the target area category, while the fifth identifier and the sixth identifier are generated based on the custom area category. Accordingly, the generation method of the fifth identifier and the sixth identifier is also based on the custom area category, by sending a data request to the server and receiving the time information sent by the server. Specifically, the specific implementation method of step S205 includes:

Step S2051: Send a second data request, where the second data request includes first information representing the target special effect sticker and second information representing the custom area category;

Step S2052: receiving event data returned by the server, the event data including at least the cumulative number of triggers of the target event corresponding to the custom area category, and/or the ranking of the custom area category in all areas based on the cumulative number of triggers;

Step S2053: Generate a fifth identifier and/or a sixth identifier according to the event data, and display them.

The specific method for generating the fifth identifier and/or the sixth identifier mentioned above can refer to the specific implementation method for generating the second identifier and/or the third identifier in the embodiment shown in FIG8 , which will not be described in detail here.

Figure 12 is a schematic diagram of a process of responding to a first editing operation provided by an embodiment of the present disclosure. As shown in Figure 12, when the first identifier (the content is "I am in area A"), the second identifier (the content is "65,535 check-ins") and the third identifier (the content is "Area A: Nationally ranked 3") are displayed in the application interface, the terminal device responds to the first editing operation input by the user and modifies the first identifier to the fourth identifier (the content is "I am in A_1_1 Park"). After that, the terminal device obtains the corresponding custom area category "A_1_1 Park" based on the content of the fourth identifier, and based on the custom area category "A_1_1 Park", the second identifier is modified to the fifth identifier (the content is "305 check-ins") and the third identifier is modified to the sixth identifier (the content is "A_1_1 Park: Nationally ranked 1402"), and displayed in the application interface, thereby achieving the content setting and update of the target special effect sticker. In the above process, only the first identifier needs to be modified. After the modification, the second and third identifiers will be automatically matched and corrected based on the change in the area (the target area category becomes a custom area category), without the need for manual modification, thereby improving image editing efficiency.

Step S206: Generate a special effects video based on the target special effects sticker.

In this embodiment, the specific implementation of steps S201-S202 and step S206 is consistent with the specific implementation of steps S101-S103 in the embodiment shown in FIG. 2 . For detailed discussion, please refer to the discussion in steps S101-S103, which will not be repeated here.

In this embodiment, the special effect content of the target special effect sticker is modified based on the first editing operation so that the regional level represented by the target special effect sticker can match the regional level of interest to the user, thereby avoiding the problem of regional level misalignment, improving the accuracy of the information displayed in the special effect video, and meeting the personalized needs of users.

Referring to FIG. 13 , FIG. 13 is a flow chart of the special effect video generation method provided in the embodiment of the present disclosure. In this embodiment, based on the embodiment shown in FIG. 2 or FIG. 11 , the scheme for setting the position and content of the target special effect sticker is further refined. The special effect video generation method includes:

Step S301: Display the application interface.

Step S302: In response to a first trigger operation on the special effect component, a target special effect sticker is displayed in the application interface, wherein the special effect content of the target special effect sticker is determined based on the area information.

Step S303: In response to the second editing operation on the target special effect sticker, set the display position of the target special effect sticker in the special effect video, and/or the special effect content of the target special effect sticker in the special effect video.

Exemplarily, the second editing operation is an operation for setting the display position and/or special effect content of the target special effect sticker in the special effect video. The second editing operation may include coordinate information, through which the display position of the target special effect sticker in the special effect video is set; the second editing operation may include content information, such as a string, through which the special effect content of the target special effect sticker is set, for example, the special effect content of the target special effect sticker is changed from the first identifier to the fourth identifier.

In a possible implementation, the special effect video is generated based on at least two frames of initial pictures and target special effect stickers, and the terminal device obtains at least two pre-generated frames of initial pictures and target special effect stickers, and renders them to obtain the special effect video. In this case, exemplarily, the second editing operation includes at least two first sub-editing operations for the initial picture, and the first sub-editing operation is used to edit a single frame of the initial picture, so that the target special effect sticker appears in different positions in at least two frames of the initial picture. A possible implementation of step S303 includes:

Step S3031: In the first sub-editing operation for the initial picture, the display position in the frame corresponding to each initial picture should be set so that when the special effect video is played, the target special effect stickers are displayed at the display position in the frame corresponding to each initial picture.

FIG14 is a schematic diagram of a process for setting the display position in the frame corresponding to each initial image provided by an embodiment of the present disclosure. As shown in FIG14 , the initial images used to generate the special effect video include initial image P1, initial image P2, and initial image P3. The second editing operation includes three first sub-editing operations, namely, operation op_01 for initial image P1 (shown as op_01 in the figure), operation op_02 for initial image P2 (shown as op_02 in the figure), and operation op_03 for initial image P3 (shown as op_03 in the figure). Each first sub-editing operation corresponds to a click operation. After the terminal device responds to each first sub-editing operation, the corresponding click coordinates are obtained respectively. According to each click coordinate, the corresponding display positions o1, o2, and o3 in the frame are obtained respectively. After the settings are made based on the display positions in the above frames, in the video editing stage, that is, when the application interface is the video editing interface, in the process of displaying the above initial image P1, initial picture P2 and initial picture P3 in sequence or in a loop based on preset intervals in the video editing interface, the target special effect stickers are also simultaneously displayed in the corresponding display positions in the frames of each initial picture. The display content in the above video editing interface is equivalent to a preview of the special effects video, that is, when the special effects video is played, the target special effects stickers are respectively displayed at the display positions in the frames corresponding to each initial picture.

In the steps of this embodiment, the terminal device responds to the second editing instruction and sets the appearance position of the target special effect sticker in each initial picture, so that in the generated special effect video, the target special effect sticker can achieve dynamic movement based on the image frame dimension. This can avoid the problem of the target special effect sticker blocking the key target in the image (such as the human body and face), and improve the visual effect of the special effect video.

Exemplarily, the second editing operation includes at least two second sub-editing operations for the initial picture. Another possible implementation of step S303 includes:

Step S3032: In response to the second sub-editing operation for the initial picture, set the special effect content of the target special effect sticker in at least one frame of the initial picture, so that when the special effect video is played, the target special effect sticker is displayed based on the special effect content corresponding to each initial picture.

Exemplarily, similar to the first sub-editing operation, the second sub-editing operation is for the initial picture, and is used to change the special effect content of the target special effect sticker in the initial picture. In a possible implementation, the second sub-editing operation is implemented in the same way as the first editing operation in the previous embodiment, for example, it is used to modify the first identifier corresponding to the target special effect sticker to the fourth identifier, so that each frame of the initial picture Like special effect content corresponding to different target special effect stickers.

FIG15 is a schematic diagram of a process for setting special effect content corresponding to each initial image provided by an embodiment of the present disclosure. As shown in FIG15 , the initial images used to generate special effect videos include initial images P1, initial images P2, and initial images P3. The second editing operation includes three second sub-editing operations, namely, operation op_11 (shown as op_11 in the figure) for initial image P1, operation op_12 (shown as op_12 in the figure) for initial image P2, and operation op_13 (shown as op_13 in the figure) for initial image P3. Each second sub-editing operation corresponds to a string input operation. After the terminal device responds to each second sub-editing operation, the corresponding special effect content is set in each initial image. As shown in the figure, the special effect content of the target special effect sticker in the initial image P1 includes the string "A City", the special effect content of the target special effect sticker in the initial image P1 includes the string "A_1 District", and the special effect content of the target special effect sticker in the initial image P3 includes the string "A_1_1 Park". The generated special effects video is rendered based on the initial image P1, the initial image P2 and the initial image P3 in combination with the target special effects stickers. When the special effects video is played, the target special effects stickers are respectively displayed based on the special effects content corresponding to each initial picture, that is, the character string "A City" is displayed in the video screen corresponding to the initial image P1, the character string "A_1 District" is displayed in the video screen corresponding to the initial image P2, and the character string "A_1_1 Park" is displayed in the video screen corresponding to the initial image P3.

In the steps of this embodiment, the terminal device responds to the second editing instruction to set the special effect content of the target special effect sticker in each initial picture, so that in the generated special effect video, the target special effect sticker can realize dynamic content transformation based on the image frame dimension, thereby improving the information richness and information display efficiency in the special effect video.

Step S304: Generate a special effects video based on the target special effects sticker.

In this embodiment, the specific implementation of steps S301-S302 and step S304 is consistent with the specific implementation of steps S101-S103 in the embodiment shown in FIG2 . For detailed discussion, please refer to the discussion in steps S101-S103, which will not be repeated here. At the same time, it should be noted that the solution provided in this embodiment can also be implemented on the basis of the embodiment shown in FIG11 , that is, after sequentially executing steps S201-S205 in the embodiment shown in FIG11 , steps S303-S304 in this embodiment are executed to further set the display position and/or special effect content of the target special effect sticker, which can be set according to specific needs, which will not be repeated here.

Corresponding to the special effects video generation method of the above embodiment, FIG16 is a structural block diagram of a special effects video generation device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Referring to FIG16 , the special effects video generation device 4 includes:

Display module 41, used to display the application interface;

A processing module 42, configured to obtain region information in response to a first trigger operation on the special effect component, wherein the region information represents a target region having target region characteristics;

The generation module 43 is used to display the target special effect stickers in the application interface and generate a special effect video based on the target special effect stickers, wherein the special effect content of the target special effect stickers is determined based on the area information.

In one embodiment of the present disclosure, the processing module 42 is specifically used to: acquire image data in response to a first trigger operation on the special effect component; perform feature extraction on the image data to obtain area information, wherein the area information includes the area location and/or topographic features of the target area.

In one embodiment of the present disclosure, the special effect content of the target special effect sticker includes a first identifier; when the generation module 43 displays the target special effect sticker in the application interface, it is specifically used to: determine the target area category of the target area based on the area information; generate the first identifier based on the target area category; and display the first identifier in the application interface.

In one embodiment of the present disclosure, the special effect content of the target special effect sticker also includes a second identifier, which represents the cumulative triggering number of the target event corresponding to the target area category, and the target event includes the terminal device generating the corresponding video special effect based on the target special effect sticker; when the generation module 43 displays the target special effect sticker in the application interface, it is also used to: display the second identifier in the application interface.

In one embodiment of the present disclosure, the special effect content of the target special effect sticker also includes a third identifier, and the third identifier represents the ranking of the target area category in all area categories based on the cumulative number of triggers; when the generation module 43 displays the target special effect sticker in the application interface, it is also used to: display the third identifier in the application interface.

In one embodiment of the present disclosure, the generation module 32 is also used to: send a first data request to a server, wherein the first data request includes first information representing the target special effect sticker and second information representing the target area category; receive event data returned by the server, wherein the event data includes at least the cumulative number of triggers of the target event corresponding to the target area, and/or the ranking of the target area in all areas based on the cumulative number of triggers; and generate a second identifier and/or a third identifier based on the event data.

In one embodiment of the present disclosure, the generation module 32 is further used to: in response to a first editing operation on the target special effect sticker, set the special effect content of the target special effect sticker to a fourth identifier, wherein the fourth identifier represents a custom area category; display the target special effect sticker in the application interface; The fourth logo.

In one embodiment of the present disclosure, the generation module 32 is also used to: display a fifth identifier and/or a sixth identifier in the application interface based on the custom area category; wherein the fifth identifier represents the cumulative number of triggers of the target event corresponding to the custom area category; and the sixth identifier represents the ranking of the custom area category in all area categories based on the cumulative number of triggers.

In one embodiment of the present disclosure, the generation module 32 is also used to: in response to a second editing operation on the target special effect sticker, set the display position of the target special effect sticker in the special effect video, and/or the special effect content of the target special effect sticker in the special effect video.

In one embodiment of the present disclosure, the special effects video is generated based on at least two frames of initial pictures and the target special effects stickers, and the second editing operation includes at least two first sub-editing operations for the initial pictures; the generation module 32, in response to the second editing operation for the target special effects stickers, sets the display position of the target special effects stickers in the special effects video, and is specifically used to: in response to the first sub-editing operation for the initial pictures, set the display position in the frame corresponding to each of the initial pictures, so that when the special effects video is played, the target special effects stickers are respectively displayed at the display position in the frame corresponding to each of the initial pictures.

In one embodiment of the present disclosure, the special effects video is generated based on at least two frames of initial pictures and the target special effects stickers, the second editing operation includes at least two second sub-editing operations for the initial pictures, and the generation module 32 is also used to: in response to the second sub-editing operation for the initial picture, set the special effects content of the target special effects stickers in at least one frame of the initial picture, so that when the special effects video is played, the target special effects stickers are displayed based on the special effects content corresponding to each of the initial pictures.

In one embodiment of the present disclosure, the generation module 33 is also used to: obtain pre-generated image data, the image data including a video or at least one frame of a picture; display the content of the image data on a first layer within the application interface; when the generation module 33 displays the target special effect stickers within the application interface, it is also used to: display the target special effect stickers on a second layer of the application interface, wherein the first layer is located below the second layer.

In one embodiment of the present disclosure, the application interface is a camera viewfinder interface, and the generation module 33 is also used for at least one of the following: in response to a third trigger operation on the camera viewfinder interface, capturing image data, wherein the image data is used to generate the special effects video in combination with the target special effects stickers; and in the process of capturing the image data, displaying the target special effects stickers in the viewfinder interface.

The display module 41, the processing module 42 and the generating module 43 are connected. The special effect video generating device 4 provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be described in detail in this embodiment.

FIG17 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. As shown in FIG17 , the electronic device 5 includes:

A processor 51, and a memory 52 communicatively connected to the processor 51;

The memory 52 stores computer executable instructions;

The processor 51 executes the computer-executable instructions stored in the memory 52 to implement the special effect video generation method in the embodiments shown in Figures 2 to 15.

Optionally, the processor 51 and the memory 52 are connected via a bus 53 .

The relevant instructions can be understood by referring to the relevant descriptions and effects corresponding to the steps in the embodiments corresponding to Figures 2 to 15, and no further details will be given here.

An embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the special effects video generation method provided by any one of the embodiments corresponding to Figures 2 to 15 of the present disclosure.

The present disclosure provides a computer program product, including a computer program. When the computer program is executed by a processor, the special effect video generation method in the embodiments shown in FIG. 2 to FIG. 15 is implemented.

Referring to FIG. 18 , it shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 18 is only an example and should not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

As shown in FIG. 18 , the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. Input/Output (I/O) An interface 905 is also connected to the bus 904 .

Typically, the following devices may be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 18 shows an electronic device 900 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be stored in any suitable manner. Media transmission includes but is not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

The functions described above may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

In a first aspect, according to one or more embodiments of the present disclosure, a method for generating a special effect video is provided, comprising:

According to one or more embodiments of the present disclosure, obtaining regional information in response to a first trigger operation on a special effects component includes: acquiring image data in response to a first trigger operation on the special effects component; performing feature extraction on the image data to obtain regional information, wherein the regional information includes the regional location and/or topographic features of the target area.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker includes a first identifier; displaying the target special effect sticker in the application interface includes: determining the target area category of the target area according to the area information; generating the first identifier according to the target area category; and displaying the first identifier in the application interface.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker also includes a second identifier, which represents the cumulative triggering number of the target event corresponding to the target area category, and the target event includes a terminal device generating a corresponding video special effect based on the target special effect sticker; displaying the target special effect sticker in the application interface also includes: displaying the second identifier in the application interface.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker also includes a third identifier, and the third identifier represents the ranking of the target area category in all area categories based on the cumulative number of triggers; displaying the target special effect sticker in the application interface also includes: displaying the third identifier in the application interface.

According to one or more embodiments of the present disclosure, the method also includes: sending a first data request to a server, the first data request including first information characterizing the target special effect sticker and second information characterizing the target area category; receiving event data returned by the server, the event data including at least the cumulative number of triggers of the target event corresponding to the target area, and/or the ranking of the target area in all areas based on the cumulative number of triggers; generating a second identifier and/or a third identifier based on the event data.

According to one or more embodiments of the present disclosure, the method also includes: in response to a first editing operation on the target special effect sticker, setting the special effect content of the target special effect sticker to a fourth identifier, wherein the fourth identifier represents a custom area category; and displaying the fourth identifier in the application interface.

According to one or more embodiments of the present disclosure, the method further includes: based on the custom area category, displaying a fifth identifier and/or a sixth identifier in the application interface; wherein the fifth identifier represents the cumulative number of triggers of the target event corresponding to the custom area category; and the sixth identifier represents the ranking of the custom area category in all area categories based on the cumulative number of triggers.

According to one or more embodiments of the present disclosure, the method further includes: in response to a second editing operation on the target special effect sticker, setting the display position of the target special effect sticker in the special effect video, and/or the special effect content of the target special effect sticker in the special effect video.

According to one or more embodiments of the present disclosure, the special effects video is generated based on at least two frames of initial pictures and the target special effects stickers, and the second editing operation includes at least two first sub-editing operations for the initial pictures; the display position of the target special effects stickers in the special effects video is set in response to the second editing operation for the target special effects stickers, including: in response to the first sub-editing operation for the initial pictures, the display position in the frame corresponding to each of the initial pictures is set, so that when the special effects video is played, the target special effects stickers are respectively displayed at the display position in the frame corresponding to each of the initial pictures.

According to one or more embodiments of the present disclosure, the special effect video is generated based on at least two frames of initial pictures and the target special effect stickers, the second editing operation includes at least two second sub-editing operations for the initial picture, and the method further includes: in response to the second sub-editing operations for the initial picture An editing operation is performed to set the special effect content of the target special effect sticker in at least one frame of the initial picture, so that when the special effect video is played, the target special effect sticker is displayed based on the special effect content corresponding to each of the initial pictures.

According to one or more embodiments of the present disclosure, the method also includes: obtaining pre-generated image data, the image data including a video or at least one frame of a picture; displaying the content of the image data on a first layer within the application interface; displaying the target special effect stickers within the application interface includes: displaying the target special effect stickers on a second layer of the application interface, wherein the first layer is located below the second layer.

According to one or more embodiments of the present disclosure, the application interface is a camera viewfinder interface, and the method further includes at least one of the following: in response to a third trigger operation on the camera viewfinder interface, capturing image data, wherein the image data is used to generate the special effects video in combination with the target special effects stickers; and during the process of capturing the image data, displaying the target special effects stickers in the viewfinder interface.

In a second aspect, according to one or more embodiments of the present disclosure, a special effect video generating device is provided, including:

A display module is used to display an application interface; a processing module is used to obtain area information in response to a first trigger operation on a special effect component, wherein the area information represents a target area having target area characteristics; a generation module is used to display target special effect stickers in the application interface, and generate a special effect video based on the target special effect stickers, wherein the special effect content of the target special effect stickers is determined based on the area information.

According to one or more embodiments of the present disclosure, the processing module is specifically used to: acquire image data in response to a first trigger operation on a special effect component; perform feature extraction on the image data to obtain area information, wherein the area information includes the area location and/or topographic features of the target area.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker includes a first identifier; when the generation module displays the target special effect sticker in the application interface, it is specifically used to: determine the target area category of the target area according to the area information; generate the first identifier according to the target area category; and display the first identifier in the application interface.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker also includes a second identifier, which represents the cumulative triggering number of the target event corresponding to the target area category, and the target event includes the terminal device generating the corresponding video special effect based on the target special effect sticker. When the generation module displays the target special effect sticker in the application interface, it is also used to: display the second logo in the application interface.

According to one or more embodiments of the present disclosure, the special effect content of the target special effect sticker also includes a third identifier, and the third identifier represents the ranking of the target area category in all area categories based on the cumulative number of triggers; when the generation module displays the target special effect sticker in the application interface, it is also used to: display the third identifier in the application interface.

According to one or more embodiments of the present disclosure, the generation module is also used to: send a first data request to a server, wherein the first data request includes first information representing the target special effect sticker and second information representing the target area category; receive event data returned by the server, wherein the event data includes at least the cumulative number of triggers of the target event corresponding to the target area, and/or the ranking of the target area in all areas based on the cumulative number of triggers; and generate a second identifier and/or a third identifier based on the event data.

According to one or more embodiments of the present disclosure, the generation module is also used to: in response to a first editing operation on the target special effect sticker, set the special effect content of the target special effect sticker to a fourth identifier, wherein the fourth identifier represents a custom area category; and display the fourth identifier in the application interface.

According to one or more embodiments of the present disclosure, the generation module is also used to: display a fifth identifier and/or a sixth identifier in the application interface based on the custom area category; wherein the fifth identifier represents the cumulative number of triggers of the target event corresponding to the custom area category; and the sixth identifier represents the ranking of the custom area category in all area categories based on the cumulative number of triggers.

According to one or more embodiments of the present disclosure, the generation module is also used to: in response to a second editing operation on the target special effect sticker, set the display position of the target special effect sticker in the special effect video, and/or the special effect content of the target special effect sticker in the special effect video.

According to one or more embodiments of the present disclosure, the special effects video is generated based on at least two frames of initial pictures and the target special effects stickers, and the second editing operation includes at least two first sub-editing operations for the initial pictures; when the generation module sets the display position of the target special effects stickers in the special effects video in response to the second editing operation for the target special effects stickers, it is specifically used to: in response to the first sub-editing operation for the initial pictures, set the display position in the frame corresponding to each of the initial pictures, so that when the special effects video is played, the target special effects stickers are respectively displayed at the display position in the frame corresponding to each of the initial pictures.

According to one or more embodiments of the present disclosure, the special effect video is based on at least two frames of initial pictures. and the target special effect sticker is generated, the second editing operation includes at least two second sub-editing operations for the initial picture, and the generation module is also used to: in response to the second sub-editing operation for the initial picture, set the special effect content of the target special effect sticker in at least one frame of the initial picture, so that when the special effect video is played, the target special effect sticker is displayed based on the special effect content corresponding to each of the initial pictures.

According to one or more embodiments of the present disclosure, the generation module is also used to: obtain pre-generated image data, the image data including a video or at least one frame of a picture; display the content of the image data on the first layer within the application interface; when the generation module 33 displays the target special effect stickers within the application interface, it is also used to: display the target special effect stickers on the second layer of the application interface, wherein the first layer is located below the second layer.

According to one or more embodiments of the present disclosure, the application interface is a camera viewfinder interface, and the generation module is further used for at least one of the following: in response to a third trigger operation on the camera viewfinder interface, capturing image data, wherein the image data is used to generate the special effects video in combination with the target special effects stickers; and in the process of capturing the image data, displaying the target special effects stickers in the viewfinder interface.

In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

The memory stores computer-executable instructions;

In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the special effects video generation method described in the first aspect and various possible designs of the first aspect is implemented.

The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. The above features are replaced with (but not limited to) technical features with similar functions disclosed in this disclosure to form a technical solution.

In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

Although the subject matter has been described in language specific to structural features and/or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

A special effects video generation method, comprising:

Display the application interface;

In response to a first trigger operation on the special effect component, obtaining region information, wherein the region information represents a target region feature of the target region;

Displaying a target special effect sticker in the application interface, wherein the special effect content of the target special effect sticker is determined based on the area information;

Based on the target special effect sticker, a special effect video is generated.
The method according to claim 1, wherein the obtaining of the region information in response to the first trigger operation on the special effect component comprises:

In response to a first trigger operation on the special effect component, acquiring image data;

Perform feature extraction on the image data to obtain region information, wherein the region information includes at least one of the following:

The area location of the target area, the geomorphic features of the target area, and the target object information in the target area.
The method according to claim 1 or 2, wherein the special effect content of the target special effect sticker includes a first identifier;

The displaying of the target special effect sticker in the application interface includes:

Determining a target area category of the target area according to the area information;

generating the first identifier according to the target area category;

The first identifier is displayed in the application interface.
The method according to claim 3, wherein the special effect content of the target special effect sticker further includes a second identifier, the second identifier represents the cumulative triggering number of target events corresponding to the target area category, and the target event includes a terminal device generating a corresponding video special effect based on the target special effect sticker;

The displaying of the target special effect sticker in the application interface also includes:

The second identifier is displayed in the application interface.
The method according to claim 4, wherein the special effect content of the target special effect sticker further includes a third identifier, wherein the third identifier represents a ranking of the target area category among all area categories based on a cumulative number of triggers;

The displaying of the target special effect sticker in the application interface also includes:

The third identifier is displayed in the application interface.
The method according to any one of claims 3 to 5, wherein the method further comprises:

Sending a first data request to a server, wherein the first data request includes first information representing the target special effect sticker and second information representing the target area category;

receiving event data returned by the server, the event data including at least a cumulative number of triggers of target events corresponding to the target area category, and/or a ranking of the target area category among all area categories based on the cumulative number of triggers;

A second identifier and/or a third identifier is generated according to the event data.
The method according to any one of claims 1 to 6, wherein the method further comprises:

In response to a first editing operation on the target special effect sticker, setting the special effect content of the target special effect sticker to a fourth identifier, wherein the fourth identifier represents a custom area category;

The fourth identifier is displayed in the application interface.
The method according to claim 7, wherein the method further comprises:

Based on the custom area category, displaying a fifth identifier and/or a sixth identifier in the application interface;

The fifth identifier represents the cumulative triggering quantity of the target event corresponding to the custom area category;

The sixth identifier represents the ranking of the user-defined area category among all area categories based on the cumulative number of triggers.
The method according to any one of claims 1 to 8, wherein the method further comprises:

In response to a second editing operation on the target special effect sticker, a display position of the target special effect sticker in the special effect video and/or a special effect content of the target special effect sticker in the special effect video are set.
The method according to claim 9, wherein the special effect video is generated based on at least two frames of initial pictures and the target special effect stickers, and the second editing operation includes at least two first sub-editing operations for the initial pictures;

In response to the second editing operation on the target special effect sticker, setting the display position of the target special effect sticker in the special effect video includes:

In response to the first sub-editing operation for the initial picture, the display position in the frame corresponding to each of the initial pictures is set so that when the special effect video is played, the target special effect stickers are respectively displayed at the display position in the frame corresponding to each of the initial pictures.
The method according to claim 9 or 10, wherein the special effect video is generated based on at least two frames of the initial picture and the target special effect sticker, the second editing operation includes at least two second sub-editing operations for the initial picture, and the method further includes:

In response to the second sub-editing operation for the initial picture, the special effect content of the target special effect sticker in at least one frame of the initial picture is set, so that when the special effect video is played, the target special effect sticker is displayed based on the special effect content corresponding to each of the initial pictures.
The method according to any one of claims 1 to 11, wherein the method further comprises:

Acquire pre-generated image data, wherein the image data includes a video or at least one frame of a picture;

Displaying the content of the image data in a first layer within the application interface;

The displaying of the target special effect sticker in the application interface includes:

The target special effect sticker is displayed in a second layer of the application interface, wherein the first layer is located below the second layer.
The method according to any one of claims 1 to 12, wherein the application interface is a camera viewfinder interface, and the method further comprises at least one of the following:

In response to a third trigger operation on the camera viewfinder interface, capturing image data, wherein the image data is used to generate the special effect video in combination with the target special effect sticker;

During the process of capturing image data, the target special effect sticker is displayed in the viewfinder interface.
A special effects video generating device, comprising:

Display module, used to display the application interface;

A processing module, configured to obtain region information in response to a first trigger operation on the special effect component, wherein the region information represents a target region having target region characteristics;

A generation module is used to display target special effect stickers in the application interface and generate special effect videos based on the target special effect stickers, wherein the special effect content of the target special effect stickers is determined based on the area information.
An electronic device comprises: a processor, and a memory communicatively connected to the processor;

The memory stores computer-executable instructions;

The processor executes the computer-executable instructions stored in the memory to implement the special effect video generation method according to any one of claims 1 to 13.
A computer-readable storage medium storing a computer The computer executes the instructions, and when the processor executes the instructions, the special effects video generation method as described in any one of claims 1 to 13 is implemented.
A computer program product comprises a computer program, which, when executed by a processor, implements the special effects video generation method according to any one of claims 1 to 13.
A computer program, which, when executed by a processor, implements the special effects video generation method according to any one of claims 1 to 13.