WO2023284567A1

WO2023284567A1 - Video editing method and device

Info

Publication number: WO2023284567A1
Application number: PCT/CN2022/103387
Authority: WO
Inventors: 谭艳曲
Original assignee: 北京达佳互联信息技术有限公司
Priority date: 2021-07-13
Filing date: 2022-07-01
Publication date: 2023-01-19
Also published as: CN113518187B; CN113518187A

Abstract

The present disclosure provides a video editing method and device. The video editing method comprises: receiving video editing user instructions, the video editing user instructions comprising: a user instruction for selecting an object in a first video frame of a video, a user instruction for editing the object in the first video frame, and a user instruction for selecting a video frame of the video; when determined that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video other than the first video frame, in response to the video editing user instructions, and in the first video frame and the at least one video frame, editing the object; and when determined that the user instruction for selecting a video frame of the video is a user instruction for selecting a plurality of video frames of the video including the first video frame, in response to the video editing user instructions, and in the plurality of video frames, editing the object.

Description

Video editing method and device

Related Application Cross Reference

This application is based on a Chinese patent application with application number 202110788670.4 and a filing date of July 13, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present disclosure relates to the technical field of video editing, and more specifically, to a video editing method and device.

Background technique

With the rapid development of electronic technology, in order to meet the needs of users for video editing, more and more video clip editing tools have been developed. Users can use video clip editing tools to manually edit any video frame of the video, and the video clip editing tool responds to the user's editing operations, performs editing processing on the video frame and saves it as a new video frame to cover the original video frames to form a new video.

Contents of the invention

An exemplary embodiment of the present disclosure is to provide a video editing method and apparatus capable of automatically performing an editing process required by a user with respect to an object designated by the user in a plurality of video frames.

According to a first aspect of an embodiment of the present disclosure, there is provided a video editing method, including: receiving a video editing user instruction, wherein the video editing user instruction includes: a user instruction for selecting an object in the first video frame of the video , a user instruction for editing the object in the first video frame, and a user instruction for selecting a video frame of the video, wherein the user instruction for selecting a video frame of the video is: A user instruction for selecting at least one video frame of the video except the first video frame, or a user instruction for selecting a plurality of video frames including the first video frame of the video; The user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, and in response to the video editing user instruction, between the first video frame and all In the at least one video frame, perform the editing process on the object; determine that the user instruction for selecting a video frame of the video is a plurality of video frames including the first video frame for selecting the video In response to the video editing user instruction, the editing process is performed on the object in the plurality of video frames.

In some embodiments, the user instruction to select a video frame of the video is received before or after the user instruction to select an object in a first video frame; the user instruction to select a video frame of the video An instruction is received before or after a user instruction for editing the object in the first video frame.

In some embodiments, the editing process includes at least one of the following items: editing process of the object itself, editing process of inserting information related to the object in the video frame.

In some embodiments, the method further includes: presenting video frames of the video to a user; the user instruction for selecting at least one video frame of the video other than the first video frame includes at least one of the following instructions An instruction: a user instruction for directly selecting the at least one video frame from the displayed video frames, and a user instruction for selecting a start frame and an end frame of the at least one video frame from the displayed video frames; The user instruction for selecting a plurality of video frames including the first video frame of the video includes at least one of the following instructions: a user instruction for directly selecting the plurality of video frames from displayed video frames , and a user instruction for selecting a start frame and an end frame of the plurality of video frames from the presented video frames.

In some embodiments, the method further includes: displaying the video frames of the video and the time points corresponding to each displayed video frame to the user; The user instruction of at least one video frame includes: a user instruction for selecting a video frame within a time period of the video, wherein the video frame within the time period is the at least one video frame; The user instruction for a plurality of video frames including the first video frame of the video includes: a user instruction for selecting video frames within a time period of the video, wherein the video frames within the time period are The plurality of video frames.

In some embodiments, the method further comprises: identifying video frames in the video in which the object occurs; presenting to the user the identified video frames in which the object occurs; and/or presenting to the user the identified occurrences The time period and/or duration of the video frame of the object.

In some embodiments, the user instruction for selecting at least one video frame of said video other than the first video frame comprises: for selecting said at least one video frame from among displayed video frames in which said object appears A user instruction for selecting a plurality of video frames of the video including the first video frame includes: a user instruction for selecting the plurality of video frames from the displayed video frames in which the object appears instruction.

In some embodiments, the method further includes: generating the edited video.

In some embodiments, the step of generating the edited video includes: in response to a user instruction for selecting a video frame of the video, at least A user instruction of a video frame, saving the edited first video frame and the at least one video frame respectively as new video frames, and replacing the original first video frame and the at least one video frame in the video A video frame to form a new video; in response to a user instruction for selecting a video frame of the video to be a user instruction for selecting a plurality of video frames including the first video frame of the video, through The edited multiple video frames are respectively saved as new video frames, and the multiple original video frames in the video are replaced to form a new video.

In some embodiments, the editing process is an editing process of inserting information related to the object at a specific position in the video frame relative to the object; in the first video frame and the at least one video frame, The step of performing the editing process on the object includes: for each video frame of the first video frame and the at least one video frame, in response to insufficient Insert information related to the object, disable the operation of inserting the information in the video frame; or insert the information at other corresponding positions in the video frame, or in the video frame relative to the object Inserting the resized information at a specific position of the , so that the information can be completely displayed in the video frame,

In the plurality of video frames including the first video frame, the step of performing the editing process on the object includes: for each video frame in the plurality of video frames, responding to the Inserting the information related to the object at a specific position relative to the object is insufficient, disabling the operation of inserting the information in the video frame; or inserting the information at other corresponding positions in the video frame, Or insert the size-adjusted information at a specific position in the video frame relative to the object, so that the information can be completely displayed in the video frame.

In some embodiments, the method further includes: storing the object and/or the editing process in a componentized manner for subsequent invocation.

According to a second aspect of an embodiment of the present disclosure, there is provided a video editing device, including: a user instruction receiving unit configured to receive a video editing user instruction, wherein the video editing user instruction includes: a first a user instruction for an object in a video frame, a user instruction for editing the object in a first video frame, and a user instruction for selecting a video frame of the video, wherein the user instruction for selecting the video The user instruction of the video frame is: a user instruction for selecting at least one video frame of the video except the first video frame, or a user instruction for selecting a plurality of video frames including the first video frame of the video A user instruction of a frame; the editing processing unit is configured to determine that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, responding Based on the video editing user instruction, the editing process is performed on the object in the first video frame and the at least one video frame; In response to a user instruction for a plurality of video frames including the first video frame of the video, the editing process is performed on the object in the plurality of video frames in response to the video editing user instruction.

In some embodiments, the device further includes: a presentation unit configured to present the video frames of the video to the user; wherein, for selecting at least one video frame of the video except the first video frame The user instruction includes at least one of the following instructions: a user instruction for directly selecting the at least one video frame from the displayed video frames, and a starting point for selecting the at least one video frame from the displayed video frames frame and end frame user instruction; the user instruction for selecting a plurality of video frames including the first video frame of the video includes at least one instruction in the following instructions: for directly selecting the selected video frame from the displayed video frame A user instruction for the plurality of video frames, and a user instruction for selecting a start frame and an end frame of the plurality of video frames from the displayed video frames.

In some embodiments, the device further includes: a display unit configured to display the video frames of the video and the time points corresponding to each displayed video frame to the user; The user instruction of at least one video frame other than a video frame includes: a user instruction for selecting a video frame within a time period of the video, wherein the video frame within the time period is the at least one video frame frame; the user instruction for selecting a plurality of video frames of the video including the first video frame includes: a user instruction for selecting video frames within a time period of the video, wherein, at the time The video frames in the segment are the plurality of video frames.

In some embodiments, the device further includes: an identification unit configured to identify a video frame in which the object appears in the video; a presentation unit configured to present the identified video frame in which the object appears to the user and/or, presenting to the user the identified time period and/or duration of the video frame in which the object appears.

In some embodiments, the device further includes: a video generating unit configured to generate the edited video.

In some embodiments, in response to the user instruction for selecting a video frame of the video being a user instruction for selecting at least one video frame of the video other than the first video frame, the video generation unit will pass through the The edited first video frame and the at least one video frame are respectively saved as new video frames, and the original first video frame and the at least one video frame in the video are replaced to form a new video; In response to the user instruction for selecting a video frame of the video being a user instruction for selecting a plurality of video frames including the first video frame of the video, the video generation unit converts all the video frames after the editing process The plurality of video frames are respectively saved as new video frames, and the original video frames in the video are replaced to form a new video.

In some embodiments, the editing process is an editing process of inserting information related to the object at a specific position in the video frame relative to the object; the editing processing unit for the first video frame and the at least one video each of the frames, in response to insufficient insertion of the information related to the object at a particular location in the video frame relative to the object, disabling the insertion of the information in the video frame; or, Inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object, so that said information can be placed in the video frame is fully displayed,

The editing processing unit, for each video frame in the plurality of video frames including the first video frame, responds to the fact that a specific position in the video frame relative to the object is not enough to insert information related to the object information, disabling the operation of inserting said information in the video frame; or inserting said information at other corresponding positions in this video frame, or inserting an adjusted The information of the size, so that the information can be completely displayed in the video frame.

In some embodiments, the device further includes: a storage unit configured to store the object and/or the editing process in a componentized manner for subsequent invocation.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, including: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions are executed by the at least one processor , prompting the at least one processor to execute the video editing method as described above.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-volatile computer-readable storage medium, when instructions in the computer-readable storage medium are executed by at least one processor, the at least one processor is prompted to perform the above The video editing method described.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a computer program product, including computer instructions, when the computer instructions are executed by at least one processor, the above video editing method is realized.

According to the embodiment of the present disclosure, the user only needs to perform an editing operation on an object in a video frame in the interactive interface and select at least one other video frame to be processed, and the present disclosure can automatically perform editing operations on the object in these video frames The editing process required by the user does not require the user to find the object frame by frame and manually perform the same editing operation on the object, which can not only meet the user's video editing needs, but also improve the editing efficiency and greatly reduce the user's operation quantity.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings here are incorporated into the specification and constitute a part of the specification, show embodiments consistent with the disclosure, and are used together with the description to explain the principle of the disclosure, and do not constitute an improper limitation of the disclosure.

FIG. 1 shows a flowchart of a video editing method according to an exemplary embodiment of the present disclosure;

FIG. 2 shows a structural block diagram of a video editing device according to an exemplary embodiment of the present disclosure;

FIG. 3 shows a structural block diagram of an electronic device according to an exemplary embodiment of the present disclosure.

detailed description

In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

It should be noted that the terms "first" and "second" in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.

What needs to be explained here is that "at least one of several items" appearing in this disclosure all means to include "any one of the several items", "a combination of any of the several items", The three categories of "the whole of the several items" are juxtaposed. For example, "including at least one of A and B" includes the following three parallel situations: (1) including A; (2) including B; (3) including A and B. Another example is "execute at least one of step 1 and step 2", which means the following three parallel situations: (1) execute step 1; (2) execute step 2; (3) execute step 1 and step 2.

FIG. 1 shows a flowchart of a video editing method according to an exemplary embodiment of the present disclosure.

The video editing method of an exemplary embodiment of the present disclosure may be executed by an electronic device including at least one processor. Referring to FIG. 1 , the method includes the following steps S101, S102, and S103.

In step S101, a video editing user instruction is received.

Here, the video editing user instruction includes: a user instruction for selecting an object in the first video frame of the video, a user instruction for editing the object in the first video frame, and a user instruction for selecting the object in the first video frame. A user instruction describing a video frame of a video. Wherein, the user instruction for selecting a video frame of the video is: a user instruction for selecting at least one video frame of the video except the first video frame, or a user instruction for selecting the video frame including the first video frame. A user command for multiple video frames within a video frame.

In step S102, determine that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, and respond to the video editing user instruction , performing the editing process on the object in the first video frame and the at least one video frame.

In step S103, when it is determined that the user instruction for selecting a video frame of the video is a user instruction for selecting a plurality of video frames including the first video frame of the video, and in response to the video editing user Instructing to perform the editing process on the object in the plurality of video frames.

The present disclosure does not limit the sequence of receiving user instructions. As an example, the user instruction for selecting a video frame of the video may be received by the electronic device before or after the user instruction for selecting an object in the first video frame. . As an example, the user instruction for selecting a video frame of the video may be received by the electronic device before or after the user instruction for editing the object in the first video frame.

As an example, the object may be a display object in a video frame. It should be understood that the present disclosure does not limit the number of the objects, that is, the number of the objects may be one or more.

As an example, the electronic device may display the first video frame to the user in response to a user instruction to select the first video frame from the video frames of the video, and receive a user instruction to select an object in the first video frame and edit the object. instruction.

It should be understood that the editing process may include various appropriate editing processes performed on the object itself or relative to the object, which is not limited in the present disclosure. As an example, the editing processing may include, but not limited to, at least one of the following: editing processing of the object itself, and editing processing of inserting information related to the object in a video frame.

As an example, the information related to the object may include but not limited to at least one of the following types: picture, video, text, audio, and dynamic picture.

As an example, the editing process of inserting information related to the object in the video frame may include: inserting information related to the object at a specific position (ie, the relative position of the object) in the video frame relative to the object. Editing of information. As an example, the specific location relative to the object may be on and/or near the object. For example, the specific position relative to the object may be a position at a distance from the object on the left side of the object. For example, when an editing process is received that inserts information related to an object at a specific position in a video frame relative to the object, the position of the information relative to the object (i.e., the specific position ) and said information.

It should be understood that the editing process may include various appropriate editing processes performed on the object itself, which is not limited in the present disclosure. For example, the editing process may include, but is not limited to, at least one of the following: resizing operations, resizing operations, beautifying operations, slimming operations, blurring operations, and occlusion operations.

Regarding the user instruction for selecting an object in the first video frame, in one example, in the electronic device, each displayed object in the first video frame may be highlighted (for example, an outline or an occupied area is highlighted) for the user to select; then, the electronic device receives the user's selection operation (for example, a click operation) on one or more highlighted display objects in the first video frame. In another example, the electronic device may receive the user's circle selection operation on one or more display objects in the first video frame, and highlight the display objects circled by the user for user confirmation. The contour or occupied area of the circled display object is highlighted, and an adjustment operation on the contour or occupied area by the user can be received. In addition, as another example, the electronic device may identify each display object in the video frame, and generate an option list including options related to the identified display object for the user to select, for example, the option may be the name of the identified object or schematic.

As an example, the video editing method of the exemplary embodiment of the present disclosure may further include: presenting all or part of video frames of the video to the user.

As an example, the electronic device may deframe the video selected by the user, and display all or part of the video frames of the video obtained through the deframe processing to the user, so that the user may select a desired video frame from the displayed video frames .

As an example, the user instruction for selecting at least one video frame of the video other than the first video frame may include at least one of the following instructions: for directly selecting the at least one video frame from displayed video frames and user instructions for selecting a start frame and an end frame of the at least one video frame from the presented video frames. It should be understood that the at least one video frame is a video frame between the start frame and the end frame.

As an example, the user instruction for selecting a plurality of video frames including the first video frame of the video may include at least one of the following instructions: for directly selecting the plurality of video frames from displayed video frames and a user instruction for selecting a start frame and an end frame of the plurality of video frames from the displayed video frames.

As an example, the video editing method according to the exemplary embodiment of the present disclosure may further include: the electronic device presents all or part of the video frames of the video to the user, and a time point corresponding to each displayed video frame. As an example, when displaying video frames of a video, a time point corresponding to each video frame may be displayed at a position corresponding to each displayed video frame, for example, video frame 1 corresponds to a time point (that is, duration) t1, Video frame 2 corresponds to time point t2, video frame 3 corresponds to time point t3, video frame 4 corresponds to time point t4, video frame 5 corresponds to time point t5, . . . In order for the user to know the interval between the video frames, execute the user instruction for selecting the video frame of the video.

As an example, the user instruction for selecting at least one video frame of the video other than the first video frame may include: a user instruction for selecting video frames within a time period of the video, wherein the The video frames within the time period are the at least one video frame. For example, the user instruction for selecting a video frame within a time period of the video may include: a user operation for selecting a start time point and an end time point of the time period.

As an example, the user instruction for selecting a plurality of video frames of the video including the first video frame may include: a user instruction for selecting video frames within a time period of the video, wherein the The video frames in the time period are the plurality of video frames.

As an example, the video editing method according to an exemplary embodiment of the present disclosure may further include: the electronic device identifying a video frame in which the object appears in the video; and presenting the identified video frame in which the object appears to the user, and/or Or, the identified time period and/or duration of the video frame in which the object appears is displayed to the user.

Furthermore, as an example, when presenting the identified video frame in which the object appears, the object may be highlighted in the presented video frame.

As an example, the user instruction for selecting at least one video frame of the video other than the first video frame may include: for the user to select the at least one video frame from the displayed video frames in which the object appears. instruction. As an example, the user instruction for selecting a plurality of video frames of the video including the first video frame may include: a user instruction for selecting the plurality of video frames from a displayed video frame in which the object appears instruction.

As an example, the electronic device may start from the first video frame, and search backward for the video frame in which the object appears in the video frames of the video and display it; or, start from the first video frame, and search forward for the video frame A video frame in which the object appears in the video frame is displayed; or, a video frame in which the object appears can be searched from all video frames of the video and displayed.

In step S102, determining that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, in response to the video editing user instruction, In the first video frame and the at least one video frame, the editing process is performed on the object.

It should be understood that the present disclosure does not limit the order of editing processing of the first video frame and the at least one video frame, for example, when the user instruction for selecting a video frame of the video is used in the first video frame When a user instruction to perform editing processing on the object is received before, the electronic device may respond to the video editing user instruction and simultaneously perform the editing processing on the object in the first video frame and the at least one video frame . For example, when a user instruction for selecting a video frame of the video is received after a user instruction for editing the object in the first video frame, the electronic device may respond to the user instruction for editing the object in the first video frame. The user instruction for editing the object in the video frame first performs the editing process on the object in the first video frame; then, in response to the user instruction for selecting the video frame of the video, in the first video frame In the at least one video frame, the editing process is performed on the object.

In step S103, it is determined that the user instruction for selecting a video frame of the video is a user instruction for selecting a plurality of video frames including the first video frame of the video, and in response to the video editing user instruction, In the plurality of video frames, the editing process is performed on the object.

Specifically, the user only needs to perform an editing operation on the object on one video frame, and select other video frames that need to be processed in the same way, and then the other video frames selected by the user can be automatically combined with the one video frame. The same editing process, in other words, does not require the user to search for the object frame by frame for these video frames, and repeat the same editing operation as on the one video frame, while greatly reducing the user's operation and workload. Meet user needs.

As an example, the electronic device may first identify the object in a video frame other than the first video frame selected by the user, and then perform the editing process on the object.

As an example, the electronic device may perform picture content understanding on the object range defined by the user on the first video frame to determine the object. For example, there are character A, character B, and character C in the first video frame. "Character A" is defined on the frame as an object to be locked, and a text commentary label of the object "Character A" is inserted in the first video frame, for example, the label may be a bubble picture containing text therein , and the user specifies a time period for displaying the label of "person A" on the video timeline, that is, the label of "person A" needs to be displayed in each video frame within the time period. Correspondingly, "person A" can be identified as the object from each video frame in the time period, and then the tag can be inserted for "person A". It can be seen that the present disclosure can not only automatically perform the processing required by the user on at least one video frame, but also provide the user with the function of automatically identifying the object in the video frame specified by the user in other video frames.

As an example, the editing process may be an editing process of inserting information related to the object at a specific position in the video frame relative to the object, and may be for each of the first video frame and the at least one video frame A video frame, when the specific position relative to the object in the video frame is not enough to insert the information related to the object (in other words, the information cannot be completely displayed after the information is inserted), disable the The operation of inserting said information into a video frame; or, inserting said information at other corresponding positions in said video frame, or inserting said information with a size adjusted at a specific position in said video frame relative to said object , so that the information can be completely displayed in the video frame.

As an example, the editing process may be an editing process of inserting information related to the object at a specific position in the video frame relative to the object, and may target the plurality of video frames including the first video frame For each video frame in , when the specific position in the video frame relative to the object is insufficient to insert the information related to the object, disable the operation of inserting the information in the video frame; or, in Inserting the information at other corresponding positions in the video frame, or inserting the resized information at a specific position in the video frame relative to the object, so that the information can be viewed in the video frame full display.

In addition, as an example, for each of the first video frame and the at least one video frame, if inserting information related to the object at a specific position in the video frame relative to the object will If other main objects in the video frame are blocked, the operation of inserting the information in the video frame is disabled; or, insert the information in other corresponding positions in the video frame or in the video frame relative to the The resized information is inserted at a specific position of the object so that the information does not obscure other main objects in the video frame.

In addition, as an example, for each video frame in the plurality of video frames including the first video frame, if a video frame related to the object is inserted at a specific position in the video frame relative to the object If the information will occlude other main objects in the video frame, disable the operation of inserting the information in the video frame; or, insert the information at other corresponding positions in the video frame or relatively in the video frame The resized information is inserted at a specific position of the object so that the information does not occlude other main objects in the video frame.

In addition, as an example, the video editing method according to the exemplary embodiment of the present disclosure may further include: the electronic device generates the edited video.

As an example, in response to the user instruction for selecting a video frame of the video being a user instruction for selecting at least one video frame of the video except the first video frame, the electronic device may pass through the editing process The last first video frame and the at least one video frame are respectively saved as new video frames, and the original first video frame and the at least one video frame in the video are replaced to form a new video.

As an example, in response to the user instruction for selecting a video frame of the video being a user instruction for selecting a plurality of video frames including the first video frame of the video, the electronic device may pass through the editing process The subsequent multiple video frames are respectively saved as new video frames, and the original multiple video frames in the video are replaced to form a new video.

As an example, the video editing method according to the exemplary embodiment of the present disclosure may further include: the electronic device stores the object and/or the editing process in a component form for subsequent calling. For example, the electronic device may generate a corresponding control for the object, for example, the control may be displayed as a name or a schematic diagram of the object; the electronic device may generate a corresponding control for the editing process, for example, the control may Displayed as the name or processing effect of the editing process, when the user performs editing operations on other videos, controls for the object and/or controls for the editing process can be provided for the user to select. If there are controls for the object and controls for the editing process, the electronic device can automatically perform the editing process for the object in the corresponding video frame. In order to reduce the user's operations of searching for a video frame including the object and locating and editing the object in the video frame when editing different videos.

As an example, the video editing method according to an exemplary embodiment of the present disclosure may further include: the electronic device converting the edited video, or the edited first video frame and the at least one video frame, or the edited The multiple video frames including the first video frame are uploaded to the server. In this example, the electronic device may be the client on which the user resides. For example, when the editing process is to insert a tag for the object, the electronic device uploads the edited video frame to the server, and can apply the edited video frame to more scenarios: such as search, artificial intelligence picture Compare and abstract to improve the precision of search results for video content.

FIG. 2 illustrates a structural block diagram of a video editing device according to an exemplary embodiment of the present disclosure.

As shown in FIG. 2 , a video editing device 10 according to an exemplary embodiment of the present disclosure includes: a user instruction receiving unit 101 , and an editing processing unit 102 .

The user instruction receiving unit 101 is configured to receive a video editing user instruction, wherein the video editing user instruction includes: a user instruction for selecting an object in the first video frame of the video, for selecting an object in the first video frame The user instruction for editing the object and the user instruction for selecting the video frame of the video, wherein the user instruction for selecting the video frame of the video is: for selecting the video except the first video A user instruction of at least one video frame other than the video frame, or a user instruction for selecting a plurality of video frames of the video including the first video frame.

The editing processing unit 102 is configured to determine that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, and responding to the video editing The user instruction is to perform the editing process on the object in the first video frame and the at least one video frame; it is determined that the user instruction for selecting the video frame of the video includes the second video frame for selecting the video A user instruction of a plurality of video frames including one video frame, in response to the video editing user instruction, the editing process is performed on the object in the plurality of video frames.

As an example, a user instruction for selecting a video frame of the video may be received before or after a user instruction for selecting an object in a first video frame; a user instruction for selecting a video frame of the video, It may be received before or after a user instruction to edit said object in the first video frame.

As an example, the editing processing may include at least one of the following items: editing processing of the object itself, editing processing of inserting information related to the object in a video frame.

As an example, the video editing device 10 may further include: a display unit (not shown), the display unit is configured to display video frames of the video to the user; The user instruction of a video frame may include at least one of the following instructions: a user instruction for directly selecting the at least one video frame from the displayed video frames, and a user instruction for selecting the at least one video frame from the displayed video frames. A user instruction of the start frame and the end frame of the video frame; the user instruction for selecting a plurality of video frames including the first video frame of the video may include at least one of the following instructions: A user instruction for directly selecting the plurality of video frames in the video frame, and a user instruction for selecting a start frame and an end frame of the plurality of video frames from displayed video frames.

As an example, the video editing device 10 may further include: a display unit (not shown), configured to display the video frames of the video and the time points corresponding to the displayed video frames to the user.

As an example, the user instruction for selecting at least one video frame of the video other than the first video frame may include: a user instruction for selecting video frames within a time period of the video, wherein the The video frames within the time period are the at least one video frame.

As an example, the video editing device 10 may further include: an identification unit (not shown) and a presentation unit (not shown), the identification unit is configured to identify the video frame in which the object appears in the video; the presentation unit is configured to The identified video frame in which the object appears is presented to the user, and/or the time period and/or duration of the identified video frame in which the object appears is presented to the user.

As an example, the user instruction for selecting at least one video frame of the video other than the first video frame may include: for the user to select the at least one video frame from the displayed video frames in which the object appears. Instructions; user instructions for selecting a plurality of video frames of the video including the first video frame may include: user instructions for selecting the plurality of video frames from among the displayed video frames in which the object appears .

As an example, the video editing device 10 may further include: a video generating unit (not shown), and the video generating unit is configured to generate the edited video.

As an example, in response to the user instruction for selecting a video frame of the video being a user instruction for selecting at least one video frame of the video except the first video frame, the video generating unit may pass through the editing The processed first video frame and the at least one video frame are saved as new video frames respectively, and replace the original first video frame and the at least one video frame in the video to form a new video; in response to The user instruction for selecting a video frame of the video is a user instruction for selecting a plurality of video frames including the first video frame of the video, and the video generation unit may convert the edited The multiple video frames are respectively saved as new video frames, and the multiple original video frames in the video are replaced to form a new video.

As an example, the editing process may be an editing process of inserting information related to the object at a specific position in the video frame relative to the object; wherein, the editing processing unit 102 may target the first video frame and the at least each of a video frame, in response to insufficient insertion of the information related to the object at a particular location in the video frame relative to the object, disabling the insertion of the information in the video frame; Alternatively, inserting the information at other corresponding positions in the video frame, or inserting the resized information at a specific position in the video frame relative to the object, so that the information can be displayed in the video frame The frame is fully displayed.

As an example, the editing process may be an editing process of inserting information related to the object at a specific position in the video frame relative to the object; wherein, the editing processing unit 102 may target the In each of the plurality of video frames within the video frame, in response to insufficient insertion of information related to the object at a particular location in the video frame relative to the object, disabling insertion of the information in the video frame or inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object so that said information can is fully displayed in this video frame.

As an example, the video editing device 10 may further include: a storage unit (not shown), configured to store the object and/or the editing process in a componentized manner for subsequent calling.

With regard to the device in the above embodiments, the specific manner in which each unit executes operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Also, it should be understood that each unit in the video editing device 10 according to an exemplary embodiment of the present disclosure may be implemented as hardware components and/or software components. Those skilled in the art may implement each unit, for example, by using a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC) according to the defined processing performed by each unit.

FIG. 3 shows a structural block diagram of an electronic device according to an exemplary embodiment of the present disclosure. 3, the electronic device 20 includes: at least one memory 201 and at least one processor 202, the at least one memory 201 stores a set of computer-executable instructions, when the set of computer-executable instructions is executed by at least one processor 202 , executing the video editing method described in the above exemplary embodiments.

As an example, the electronic device 20 may be a PC computer, a tablet device, a personal digital assistant, a smart phone, or other devices capable of executing the above-mentioned set of instructions. Here, the electronic device 20 is not necessarily a single electronic device, but can also be any assembly of devices or circuits capable of individually or jointly executing the above-mentioned instructions (or instruction sets). Electronic device 20 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces locally or remotely (eg, via wireless transmission).

In electronic device 20, processor 202 may include a central processing unit (CPU), a graphics processing unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example and not limitation, processor 202 may also include analog processors, digital processors, microprocessors, multi-core processors, processor arrays, network processors, and the like.

The processor 202 can execute instructions or codes stored in the memory 201, wherein the memory 201 can also store data. Instructions and data may also be sent and received over the network via the network interface device, which may employ any known transmission protocol.

The memory 201 can be integrated with the processor 202, for example, RAM or flash memory is arranged in an integrated circuit microprocessor or the like. Additionally, storage 201 may comprise a separate device, such as an external disk drive, storage array, or any other storage device usable by the database system. Memory 301 and processor 202 may be operatively coupled, or may communicate with each other, such as through an I/O port, network connection, etc., such that processor 202 can read files stored in the memory.

In addition, the electronic device 20 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device 20 may be connected to each other via a bus and/or a network.

According to an exemplary embodiment of the present disclosure, there may also be provided a computer-readable storage medium storing instructions, wherein, when the instructions are executed by at least one processor, at least one processor is prompted to execute the method described in the above-mentioned exemplary embodiments. Video editing method. Examples of computer readable storage media herein include: Read Only Memory (ROM), Random Access Programmable Read Only Memory (PROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Random Access Memory (RAM) , Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Flash Memory, Non-volatile Memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM , DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or Optical Memory, Hard Disk Drive (HDD), Solid State Hard disks (SSD), memory cards (such as MultiMediaCards, Secure Digital (SD) or Extreme Digital (XD) cards), magnetic tapes, floppy disks, magneto-optical data storage devices, optical data storage devices, hard disks, solid-state disks, and any other means configured to store a computer program and any associated data, data files and data structures in a non-transitory manner and to provide said computer program and any associated data, data files and data structures to the processor or the computer to enable the processor or the computer to execute the computer program. The computer program in the above-mentioned computer-readable storage medium can run in an environment deployed in computer equipment such as a client, a host, an agent device, a server, etc. In addition, in one example, the computer program and any associated data and data files and data structures are distributed over network-connected computer systems so that the computer programs and any associated data, data files and data structures are stored, accessed and executed in a distributed fashion by one or more processors or computers.

According to an exemplary embodiment of the present disclosure, a computer program product may also be provided, and instructions in the computer program product may be executed by at least one processor to implement the video editing method described in the above exemplary embodiments.

Other embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

A method of video editing, comprising:

receiving a video editing user instruction, wherein the video editing user instruction includes: a user instruction for selecting an object in the first video frame of the video, a user instruction for editing the object in the first video frame , and a user instruction for selecting a video frame of the video, wherein the user instruction for selecting a video frame of the video is: for selecting at least one video frame of the video except the first video frame or a user instruction for selecting a plurality of video frames of the video including the first video frame;

Determining that the user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video except the first video frame, in response to the video editing user instruction, in the first video performing the editing process on the object in the frame and the at least one video frame;

determining that the user instruction for selecting a video frame of the video is a user instruction for selecting a plurality of video frames of the video including the first video frame, in response to the video editing user instruction, in the multiple In video frames, the editing process is performed on the object.
The method of claim 1 , wherein the user instruction to select a video frame of the video is received before or after the user instruction to select an object in the first video frame;

A user instruction for selecting a video frame of the video is received before or after a user instruction for editing the object in the first video frame.
The method according to claim 1, wherein said editing process comprises at least one of: editing process of said object itself, editing process of inserting information related to said object in a video frame.
The method of claim 1, further comprising: presenting a video frame of the video to a user;

The user instruction for selecting at least one video frame other than the first video frame of the video includes at least one of the following instructions: a user instruction for directly selecting the at least one video frame from the displayed video frames , and user instructions for selecting a start frame and an end frame of the at least one video frame from the displayed video frames;

The user instruction for selecting a plurality of video frames including the first video frame of the video includes at least one of the following instructions: a user instruction for directly selecting the plurality of video frames from displayed video frames , and a user instruction for selecting a start frame and an end frame of the plurality of video frames from the presented video frames.
The method according to claim 1, further comprising: displaying the video frames of the video and the time points corresponding to each displayed video frame to the user;

Wherein, the user instruction for selecting at least one video frame of the video except the first video frame includes: a user instruction for selecting video frames within a time period of the video, wherein, at the time a video frame within a segment is said at least one video frame;

The user instruction for selecting a plurality of video frames of the video including the first video frame includes: a user instruction for selecting video frames within a time period of the video, wherein The video frames are the plurality of video frames.
The method according to claim 1, further comprising:

identifying video frames in which the object occurs in the video;

Presenting the identified video frame where the object appears to the user; and/or presenting to the user the time period and/or duration of the identified video frame where the object appears.
The method of claim 6 , wherein the user instruction for selecting at least one video frame of the video other than the first video frame comprises selecting the selected video frame from the displayed video frames in which the object appears. a user instruction describing at least one video frame;

The user instruction for selecting a plurality of video frames of the video including the first video frame includes a user instruction for selecting the plurality of video frames from the displayed video frames in which the object appears.
The method according to claim 1, further comprising:

A video after the editing process is generated.
The method according to claim 8, wherein the step of generating the edited video comprises:

In response to the user instruction for selecting a video frame of the video being a user instruction for selecting at least one video frame of the video except for the first video frame, the edited first video frame and the at least one video frame are respectively saved as new video frames, and the original first video frame and the at least one video frame in the video are replaced to form a new video;

In response to the user instruction for selecting a video frame of the video being a user instruction for selecting a plurality of video frames including the first video frame of the video, the plurality of video frames after the editing process The video frames are respectively saved as new video frames, and the multiple original video frames in the video are replaced to form a new video.
The method according to claim 1, wherein the editing process is an editing process of inserting information related to the object at a specific position in the video frame relative to the object;

In the first video frame and the at least one video frame, the step of performing the editing process on the object includes:

for each of the first video frame and the at least one video frame, in response to insufficient insertion of information related to the object at a particular location in the video frame relative to the object,

disable the insertion of said information in that video frame; or,

Inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object, so that said information can be placed in the video frame is fully displayed;

In the plurality of video frames including the first video frame, the step of performing the editing process on the object includes:

for each video frame of the plurality of video frames, in response to insufficient insertion of information related to the object at a particular location in the video frame relative to the object,

disable the insertion of said information in that video frame; or,

Inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object, so that said information can be placed in the video frame is fully displayed.
The method according to claim 1, said method further comprising:

The object and/or the editing process are componentized and stored for subsequent calls.
A video editing device comprising:

The user instruction receiving unit is configured to receive a video editing user instruction, wherein the video editing user instruction includes: a user instruction for selecting an object in the first video frame of the video, and an instruction for selecting an object in the first video frame The user instruction for editing the object and the user instruction for selecting the video frame of the video, wherein the user instruction for selecting the video frame of the video is: for selecting the video except the first video a user instruction of at least one video frame out of frame, or a user instruction for selecting a plurality of video frames including a first video frame of said video;

an editing processing unit configured to determine that a user instruction for selecting a video frame of the video is a user instruction for selecting at least one video frame of the video other than the first video frame, in response to the video editing User instruction, in the first video frame and the at least one video frame, perform the editing process on the object; determine that the user instruction for selecting the video frame of the video is used to select the video including the second A user instruction of a plurality of video frames including one video frame, in response to the video editing user instruction, the editing process is performed on the object in the plurality of video frames.
The device of claim 12, wherein the user instruction to select a video frame of the video is received before or after the user instruction to select an object in the first video frame;

A user instruction for selecting a video frame of the video is received before or after a user instruction for editing the object in the first video frame.
The apparatus according to claim 12, wherein said editing process comprises at least one of: editing process of said object itself, editing process of inserting information related to said object in a video frame.
The device according to claim 12, further comprising: a display unit configured to display video frames of the video to a user;

Wherein, the user instruction for selecting at least one video frame other than the first video frame of the video includes at least one instruction of the following instructions: for directly selecting the at least one video frame from the displayed video frames user instructions, and user instructions for selecting a start frame and an end frame of the at least one video frame from the displayed video frames;

The user instruction for selecting a plurality of video frames including the first video frame of the video includes: at least one instruction in the following instructions: the user is used to directly select the plurality of video frames from the displayed video frames instructions, and user instructions for selecting a start frame and an end frame of the plurality of video frames from the displayed video frames.
The device according to claim 12, further comprising: a display unit configured to display the video frames of the video and the time points corresponding to the displayed video frames to the user;

Wherein, the user instruction for selecting at least one video frame of the video except the first video frame includes: a user instruction for selecting video frames within a time period of the video, wherein, at the time a video frame within a segment is said at least one video frame;

The user instruction for selecting a plurality of video frames of the video including the first video frame includes: a user instruction for selecting video frames within a time period of the video, wherein The video frames are the plurality of video frames.
The apparatus of claim 12, further comprising:

an identification unit configured to identify video frames in which the object appears in the video;

The display unit is configured to display to the user the identified video frame where the object appears; and/or, display to the user the time period and/or duration of the identified video frame where the object appears.
The apparatus of claim 17 , wherein the user instruction for selecting at least one video frame of the video other than the first video frame comprises selecting the selected video frame from the displayed video frames in which the object appears. a user instruction describing at least one video frame;

The user instruction for selecting a plurality of video frames of the video including the first video frame includes a user instruction for selecting the plurality of video frames from the displayed video frames in which the object appears.
The apparatus of claim 12, further comprising:

A video generating unit configured to generate the edited video.
The apparatus of claim 19, wherein,

In response to the user instruction for selecting a video frame of the video being a user instruction for selecting at least one video frame of the video except the first video frame, the video generating unit will pass through the edited first video frame A video frame and the at least one video frame are respectively saved as new video frames, and the original first video frame and the at least one video frame in the video are replaced to form a new video;

In response to the user instruction for selecting a video frame of the video being a user instruction for selecting a plurality of video frames including the first video frame of the video, the video generation unit converts all the video frames after the editing process The plurality of video frames are respectively saved as new video frames, and the original video frames in the video are replaced to form a new video.
The apparatus according to claim 12, wherein the editing process is an editing process of inserting information related to the object at a specific position in a video frame relative to the object;

The editing processing unit, for each of the first video frame and the at least one video frame, in response to insufficient insertion of information related to the object at a specific position in the video frame relative to the object,

disable the insertion of said information in that video frame; or,

Inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object, so that said information can be placed in the video frame is fully displayed,

The editing processing unit, for each video frame in the plurality of video frames including the first video frame, responds to the fact that a specific position in the video frame relative to the object is not enough to insert information related to the object information,

disable the insertion of said information in that video frame; or,

Inserting said information at other corresponding positions in the video frame, or inserting said information resized at a specific position in the video frame relative to said object, so that said information can be placed in the video frame is fully displayed.
The apparatus of claim 12, further comprising:

The storage unit is configured to store the object and/or the editing process in a componentized manner for subsequent calling.
An electronic device, characterized in that it comprises:

at least one processor;

at least one memory storing computer-executable instructions,

Wherein, the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to execute the video editing method according to any one of claims 1-11.
A non-transitory computer-readable storage medium, characterized in that when the instructions in the computer-readable storage medium are executed by at least one processor, the at least one processor is prompted to perform any one of claims 1 to 11. A video editing method as described.
A computer program product, comprising computer instructions, characterized in that, when the computer instructions are executed by at least one processor, the video editing method according to any one of claims 1 to 11 is realized.