JP4565048B1 - Video editing apparatus and video editing method - Google Patents

Abstract

A video editing apparatus that realizes a high-quality image editing service via a network, is easy to use, and can charge an appropriate and fair service fee.
A video editing apparatus according to the present invention performs simulated editing that simulates editing performed on a high-resolution video on a low-resolution video having a lower resolution than that of the high-resolution video, and performs specific simulation editing. In a video editing device that is connected via a network to a client that generates editing commands that describe the actual content, editing that is substantially the same as the simulated editing content is automatically performed on the high-resolution video by the editing command. And a charging unit that obtains a service charge related to the editing in advance using an edit command and notifies the client of the calculated service charge before the remote server edits the high-resolution video. It is characterized by that.
[Selection] Figure 4

Description

  The present invention relates to a video editing apparatus and a video editing method, and more particularly, to a video editing apparatus and a video editing method for providing a video editing service via a network.

  Recently, with the development of a high-speed wide area computer network, so-called SaaS (Software as a Service) technology for providing various computer use services using a remote computer has become widespread. In the SaaS technology, a terminal computer (hereinafter referred to as a client) at hand of a user only inputs information necessary for processing and outputs a processing result, and most of information processing during that time is performed by a remote computer (hereinafter referred to as a remote computer). Called a server).

  On the other hand, with the recent increase in the quality of broadcast video, the computer processing load associated with video editing has increased significantly. Examples of video editing include incorporating another small screen into a part of the screen to create a so-called picture-in-picture video, processing to superimpose a character superposition on the video, and defocusing to blur part of the screen There are processing.

  In order to edit these images with high quality, that is, high resolution and a large number of pixels, a video editing device consisting of dedicated software and a high-performance computer is required. The equipment for use is generally expensive. If each broadcaster producing company (hereinafter referred to as a program producer) has a video editing device, the cost of the program producer cannot be ignored.

  If this video editing device is constructed as a video editing system using the SaaS technology, the cost burden on the program producer can be reduced. That is, if the device main body that performs high-definition video editing processing is configured as a remote server so that information input for editing can be performed from a plurality of clients (located on the program producer side), Since the cost is distributed, the cost burden of each program producer can be reduced.

  Also, remote server construction, maintenance, and video editing services are performed by a provider (hereinafter referred to as a service provider) that is separate from the program producer, and the program producer pays only the usage fee for the video editing service. In this form, the cost burden on the program producer is further reduced. In this embodiment, since the service provider performs maintenance / update of the hardware and software of the remote server, the program producer does not need to perform troublesome work related to maintenance / update.

  On the other hand, construction of an appropriate billing system is indispensable for service providers who own and maintain remote servers. As a conventional charging method for using this type of remote server, there is a method based on the actual usage time of the CPU (hereinafter referred to as the actual CPU time method). In the actual CPU time method, the fee is determined based on the actual operation time of the CPU, so that the service provider can reliably collect the fee according to the operation time of the remote server.

  However, the CPU operating time of the remote server varies depending on the editing content of the video. When a program producer performs complicated editing and processing on a video, the CPU operating time becomes long and the fee increases. The content of the video editing is determined by the editing specifications input by the program producer via the client. However, the program creator cannot accurately estimate the CPU operating time of the remote server in advance from the input specifications. In other words, the program producer applies to the service provider for use without knowing the exact fee. This is uneasy for program producers who use the service, and is not necessarily a preferable form. Even if you try to set video editing specifications according to the program production budget, it is not possible to accurately grasp in advance the correspondence between the degree of specification changes and fees, so it is possible to set specifications according to the budget. Have difficulty.

  As described above, the actual CPU time method is a charging method that is more advantageous to the service provider than the program producer.

  On the other hand, a billing method (hereinafter referred to as a video time method) is also conceivable in which a fee is determined according to the duration of the video to be edited regardless of the content of editing. With this billing method, for example, the same 30-minute broadcast video program has the same charge no matter how complicated editing is performed. This billing method is a safe method for program producers because the fee can be accurately grasped from the video time. However, if the editing specification becomes complicated, the CPU operating time becomes long even if the video time is the same. However, in the video time method, the service provider can charge only the same fee. Thus, the video time method is a billing method that is more advantageous to the program producer than the service provider.

  The present invention has been made in view of the above circumstances, and realizes a high-quality image editing service via a network, is easy to use for program producers, and is fair and appropriate for both program producers and service providers. An object of the present invention is to provide a video editing apparatus and a video editing method capable of charging a service fee.

In order to solve the above problems, a video editing apparatus according to the present invention performs simulated editing simulating editing performed on a high-resolution video on a low-resolution video having a resolution lower than that of the high-resolution video, and In a video editing apparatus connected via a network to a client that generates an editing command that describes the specific contents of simulated editing, a command receiving unit that receives the editing command from the client, and the received editing command A remote server that automatically performs edits substantially the same as the contents of the simulated edit on the high-resolution video, and a service related to the edit before the remote server edits the high-resolution video The service charge obtained in advance using the edit command that received the charge, and the service charge obtained is determined in the class. Comprising a charging unit for notifying the Ant, wherein the charging unit is closed and editing commands, the database and the processing remote server is actually measured in advance to execute the editing commands to a processor that includes time previously associated When the edit command is received from the client, the processing time corresponding to each edit command received with reference to the database is extracted, and the total processing of the processor when the received edit command is executed Estimating time, obtaining the service fee for editing the high-resolution video from the estimated total processing time and a predetermined service fee per unit processing time of the processor, and notifying the client, the charging unit when the type of the editing command is changed, a new If serial editing commands are used, or if the processing speed of the remote server is changed, can update the database with the actual processing time when the editing command is actually executed, It is characterized by that.

  According to the video editing system and the video editing method of the present invention, while realizing a high-quality image editing service via a network, it is convenient for program producers and appropriate for both program producers and service providers. A fair service charge can be charged.

The figure which shows the system configuration example of a video editing system. The 1st figure which illustrates the concept of the edit in this embodiment. The 2nd figure which illustrates the concept of editing in this embodiment. The block diagram which shows the detailed structural example of a video editing apparatus and a client. The flowchart which shows the process example of the video editing method containing the accounting method in this embodiment. The figure which shows the concept of the edit command used in this embodiment. The figure which shows the concept of the database used by this embodiment. The figure explaining supplementarily the flow of service charge calculation.

  Embodiments of the present invention will be described with reference to the accompanying drawings.

(1) System Overview FIG. 1 is a diagram showing a system configuration example of a video editing system 1 according to an embodiment of the present invention. In the video editing system 1, a plurality of clients 5 and a video editing device 2 are connected through a wide area network 10 such as the Internet.

  The client 5 is a terminal device configured by, for example, a personal computer, and is a device managed by the program producers A, B, C, and the like. The program producers here include a broadcaster of a wireless television broadcast, a cable television broadcaster, a program production company, and the like.

  On the other hand, the video editing apparatus 2 includes a server (remote server 3) capable of processing high-quality high-resolution video such as so-called high-definition video at high speed, a charging unit 4, and the like.

  The video editing device 2 is a device managed by a service provider, and the service provider installs the video editing device 2 (particularly the remote server 3) in a building or the like that has been subjected to various countermeasures such as earthquake resistance and fire resistance. . The remote server 3 “edits” the high-definition and high-resolution video provided by the program producer based on the specifications provided by the program producer, and displays the edited high-definition and high-definition video. Provides a service to return to the creator.

  Here, the concept of “editing” in the present embodiment will be briefly described. Normally, when a program producer shoots in a studio, outdoors, etc., he / she cuts an unnecessary part or connects necessary scenes, and performs primary editing on the live video shot so as to be within broadcast time. Thereafter, specific video processing, that is, secondary editing is performed on the primary edited video. Examples of secondary editing include creating a so-called picture-in-picture image by overlaying another small screen on a part of the screen, blurring a part of the screen, and overlaying appropriate characters on a part of the screen. There are various kinds of video processing such as superimposing character processing.

  FIG. 2 is a diagram illustrating the concept of picture-in-picture video. In this example, a sub-picture (FIG. 2B) is incorporated into a part of the main picture (FIG. 2A) to generate a picture-in-picture picture (FIG. 2C).

  FIG. 3 is a diagram illustrating an example of blurring processing and character superimposition. A blur process is applied to the center of the original video (Fig. 3 (a)), and the upper and lower parts of the original video are superimposing characters such as "Tanaka's family" and "Two children are girls or boys?" Is processed to generate the edited video (FIG. 3B).

  “Edit” in the present embodiment is mainly this secondary edit. Hereinafter, simply “edit” refers to this secondary edit.

  It is efficient to perform the editing work (secondary editing work) as described above in an interactive form based on experience and sensibility while actually watching the video. However, today's high-definition and high-resolution digital video has an enormous number of pixels, and it is very expensive for a computer as an editing device if the above-described editing operation is performed directly on a high-definition and high-resolution video. Processing power is required.

  Therefore, in the video editing system 1 according to the present embodiment, the client 5 owned by the program producer has a low-resolution video in which the resolution of the high-quality high-resolution video is reduced (this low-resolution video may be referred to as a proxy video). It is assumed that interactive editing is performed. Then, the editing contents obtained as a result of the interactive editing are sent as editing specifications to the remote server 3 which is a high-performance computer included in the video editing device 2, and the remote server 3 is based on the sent editing specifications. The actual editing process for high-definition, high-resolution video is automatically performed. The editing specifications sent from the client 5 to the remote server 3 are described as a group of editing commands, as will be described later.

  In this way, by allowing the remote server 3 to share the actual editing processing for high-quality and high-resolution video, it is possible to perform interactive editing even with the client 5 configured with a low-cost personal computer.

  On the other hand, it is indispensable for the editing service provider who manages the remote server 3 to construct a system that can charge the service fee appropriately. The video editing apparatus 2 according to the present embodiment has a charging unit 4, and the charging unit 4 calculates a service charge related to editing and notifies the client 5.

(3) Specific Example of Video Editing Method Including Charging Method Specific processing of the video editing system 1 including the charging method performed by the charging unit 4 will be described below.

  FIG. 4 is a block diagram illustrating a specific configuration example of the video editing device 2 and the client 5 included in the video editing system 1. FIG. 5 is a flowchart illustrating an example of video editing processing performed by the video editing system 1.

  The video editing apparatus 2 includes a remote server 3, a charging unit 4, and a transmission / reception unit (command reception unit) 20. Among these, the remote server 3 includes a high-resolution video storage unit 30, a high-resolution video editing unit 31, and a low-resolution video (proxy video) generation unit 32. The charging unit 4 includes a database 40, a charge calculation unit 41, and a database update unit 42.

  The operation of each unit will be described with reference to the flowchart shown in FIG. 5, steps ST11 to ST19 are processes performed by the client 5, and steps ST21 to ST29 are processes performed by the video editing apparatus 2.

  In step ST11, a high-quality, high-resolution video (hereinafter simply referred to as a high-resolution video) that has been photographed by the program producer and further subjected to primary editing such as cutting unnecessary portions is transmitted from the client 5 to the remote server 3. After this transmission, the client 5 does not use the high resolution video.

  The high resolution video transmitted from the client 5 is stored in the high resolution video storage unit 30 of the remote server 3 (step ST21). Next, the low-resolution video generation unit 32 of the remote server 3 generates a proxy video (low-resolution video) with reduced resolution by compressing and encoding the high-resolution video (step ST22), and transmits it to the client 5 (step ST22). ST23). The proxy video has a degraded image quality compared to the original high-resolution video, but the data amount is small.

  The client 5 stores the received proxy video in the low resolution video (proxy video) storage unit 50 (step ST12).

  The client 5 displays the stored proxy video on the display device of the user interface 53, and interactively edits the proxy video while using the function of the low resolution video editing unit 51 (step ST13). The content of the edit on the proxy video is substantially the same as the content of the edit on the final high-resolution video, except that the editing target is not a high-resolution video but a low-resolution proxy video. There is only. In other words, editing for proxy video simulates editing for high-resolution video and is called simulated editing.

  The simulation editing operation is performed on a video of a length of 30 minutes or one hour of a program, and is continuously performed on the client 5 side until the entire simulation editing for the proxy video is completed. . During the simulated editing by the client 5, the work is performed in a state separated from the video editing apparatus 2, so that the editing work can be efficiently performed without being interrupted by communication with the video editing apparatus 2.

  A user (program producer's editor in charge) performs interactive interactive simulation editing using the user interface 53. For example, while watching a proxy video, a desired scene is selected, and a character super is inserted at a desired position of the selected scene image. At this time, the font type, color, size, etc. of the character are selected and specified from a menu or the like. In addition, when performing blur processing on a video, the position and range of the video to be subjected to blur processing are specified, and image processing such as blur processing is selected and specified from a menu or the like.

  In parallel with the simulation editing work, the editing command generation unit 52 of the client 5 generates an editing command describing the specific contents of the simulation editing (step ST14). The edit command is a description including attribute information that can specify individual edit contents.

  FIG. 6 is a diagram schematically illustrating an example of an edit command. For example, the edit command A for performing picture-in-picture processing is time information (for example, t1 to t2) for specifying the scene of the original video (1) to be edited, as illustrated in FIG. Time information (for example, t3 to t4) for specifying the scene of the video (2) to be embedded in the original video, coordinate information (x, y) of the original video in which the embedded video is embedded, and the size of the embedded video (X dots × Y dots) And so on.

  Further, the edit command B for performing the character super processing is time information (for example, t5 to t6) for specifying the scene of the original video (1) that is the target of character super insertion, as illustrated in FIG. 6B. It includes character text to be inserted (for example, “Mr. Tanaka's family”), coordinate information (x, y) of the original video on which characters are superimposed, and attribute information such as character size and color, character type, and the like.

  Further, as illustrated in FIG. 6C, the editing command C for performing the blurring process includes time information (for example, t5 to t6) for specifying the scene of the original video (1) that is the target of the blurring process, and the blurring process. Range (for example, coordinates (x1, y2) to coordinates (x2, y2) of the original video), and attribute information such as the degree of blurring (for example, “medium” of large, medium, and small). The

  Each editing command shown in FIG. 6 is merely an example for explaining the concept of the editing command, and is not limited to these. In short, each editing command only needs to be a description that can reproduce the contents of the simulated editing faithfully in the high-resolution video when they are applied to the high-resolution video.

  When the simulated editing for one program is completed, a group of editing commands corresponding to each editing content is generated. This group of editing commands is a specification for editing a high-resolution video performed by the remote server 3 of the video editing device 2.

  The generated group of editing commands is transmitted from the transmission / reception unit 54 of the client 5 (step ST15) and received by the transmission / reception unit 20 of the video editing apparatus 2 (step ST24).

  The received editing command is sent to the charge calculation unit 41 of the charging unit 4, and before the editing process is executed by the remote server 3, the service charge related to the editing process is calculated by the charge calculation unit 41.

  The fee calculation unit 41 refers to the database 40 and extracts the processing time corresponding to the received group of editing commands from the database 40 (step ST25).

  FIG. 7 is a diagram illustrating an example of the database 40. In the database 40, an edit command that is assumed to be generated by the client 5 and a processing time that is expected to be taken when the processor (CPU) included in the remote server 3 executes the edit command are associated in advance. It is a database. The processing time for each editing command can be obtained by actually measuring the processing time of the processor in advance at the remote server 3.

  The simulated editing performed by the client 5 may include editing having parameters different from the conventional ones and editing contents different from the conventional types. For such a new editing command, editing is performed on the remote server 3 using a new editing command on a trial basis, and the database update unit 42 included in the accounting unit 4 includes the actual measurement result of the processing time. Add to. Alternatively, for a new editing command, an approximate estimated value of the processing speed is stored in the database 40, and the database 40 is updated when the actual processing speed value for the editing command is obtained. May be.

  When the hardware or software of the remote server 3 is upgraded, the processing speed for each editing command also changes. Even in such a case, the database update unit 42 can update the processing time after the version upgrade.

  FIG. 8 is a diagram for supplementarily explaining the flow of service charge calculation processing using the database 40.

  When the processing time corresponding to each editing command obtained by the simulation editing is extracted from the database 40, the total processing time is obtained by adding the extracted processing times. On the other hand, a charge 43 per unit processing time is stored in advance in an appropriate memory of the charging unit 4. The charging unit 4 multiplies the calculated total processing time (for example, Yms) and the charge per unit processing time (for example, X yen per 1 ms), and the remote server 3 displays the same editing contents as the simulated editing in the high-resolution video. A service charge (for example, X · Y yen) when it is performed on is calculated (step ST26).

  The calculated service fee is transmitted to the client 5 (steps ST27 and ST16) and displayed on the user interface 53 (for example, a display device) of the client 5.

  When approving the displayed service fee (YES in step ST17), the program producer's editor in charge inputs an instruction to execute editing on the high-resolution video via the user interface 53 (step ST18).

  This editing execution instruction is sent to the high resolution editing unit 31 of the remote server 3. The high resolution editing unit 31 performs editing on the high resolution video using the editing command already received in step ST24 (step ST28). This editing process is automatically performed by the remote server 3 without any human intervention because the specification has already been determined.

  The edited high resolution video is sent from the remote server 3 to the client 5 (step ST29, step ST19).

  On the other hand, when the service fee is not approved (NO in step ST17), the process returns to step ST13, and the editing person changes the contents of the simulation editing for the proxy video. Then, an editing command corresponding to the changed simulation editing specification is generated again. The charging unit 4 of the video editing apparatus 2 recalculates the service fee based on the changed specifications and re-presents it to the client 5.

  As described above, in the video editing apparatus 2 according to the present embodiment, the service fee is quickly and highly accurately determined based on the editing specification (a group of editing commands) sent from the client 5 before the editing processing in the remote server 3 is executed. Can be calculated (estimated) and provided to the client 5. Therefore, the program producer can request the video editing process from the service provider without worrying about the difference between the budget and the billing amount.

  When the editing specification is transmitted to the service provider, the service fee for the editing specification is instantaneously calculated without any human intervention and is presented to the client 5, so that the flexible editing specification corresponding to the program production budget can be provided. Formulation is possible. For example, when the presented service fee is too high relative to the budget, it is possible to make an edit content suitable for the budget by performing a modification that further simplifies the edit content. On the other hand, when the presented service fee is lower than the budget, it is possible to make an option of enhancing the editing contents and performing more attractive video editing for the viewer.

  On the other hand, as a service charge calculation method, a calculation method based on the video time or the number of video frames to be edited can be considered. Therefore, high estimation accuracy cannot be expected. Also, a method of estimating the editing processing time for the high resolution video on the remote server 3 from the processing time of the simulated editing performed on the client 5 is conceivable, but the processing time of each client 5 depends on the performance of the computer used. This method cannot expect high estimation accuracy.

  On the other hand, in the video editing apparatus 2 according to the present embodiment, the service fee is charged by a database that associates each editing command corresponding to the editing specification with the processor actual processing time of the remote server 3 when the editing command is executed. Calculated. For this reason, it is possible to calculate an appropriate service fee corresponding to the editing specification with high accuracy and promptly.

  Further, since the service fee is calculated by the product of the total processing time of the remote server 3 obtained from the database and the fee per unit processing time, for example, when the cost of the remote server 3 is reduced, the unit processing Flexible operation such as lowering the service charge by reducing the charge per hour is also possible.

  As described above, according to the video editing device 2 and the video editing method according to the present embodiment, a high-quality image editing service via a network is realized, and the program producer is user-friendly and easy to use. Both service providers and service providers can be charged an appropriate and fair service fee.

  Note that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, the constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Video editing system 2 Video editing apparatus 3 Remote server 4 Charging unit 5 Client 20 Transmission / reception unit (reception unit)
31 High-resolution video editing unit 40 Database 41 Charge calculation unit

Claims (5)

A client that performs simulated editing simulating editing performed on a high-resolution video on a low-resolution video having a resolution lower than that of the high-resolution video and generates an editing command that describes specific contents of the simulated editing , And a video editing device connected via a network,
A command receiving unit for receiving the editing command from the client;
A remote server that automatically performs substantially the same editing as the contents of the simulated editing on the high-resolution video by the received editing command;
Before the remote server edits the high-resolution video, a charging unit that obtains the service fee related to the editing in advance using the edit command and notifies the client of the determined service fee;
With
The billing unit is
A database in which an edit command and a processing time actually measured by causing the processor included in the remote server to execute the edit command in advance are associated in advance;
When the editing command is received from the client, the processing time corresponding to each editing command received with reference to the database is extracted, and the total processing time of the processor when the received editing command is executed is calculated. Estimate
Obtaining the service fee for editing the high-resolution video from the estimated total processing time and a predetermined service fee per unit processing time of the processor, and notifying the client;
The billing unit is
Actual processing when the editing command is actually executed when the type of the editing command is changed, when the new editing command is used, or when the processing speed of the remote server is changed The database can be updated using time,
A video editing apparatus characterized by that. The billing unit is
The service charge per unit time is configured to be changeable,
The video editing apparatus according to claim 1. A client that performs simulation editing that simulates editing performed on a high-resolution video on a low-resolution video that has a lower resolution than the high-resolution video and generates an editing command that describes the specific contents of the simulated editing. Receiving the editing command via a network;
A remote server automatically performing editing substantially the same as the contents of the simulated editing on the high resolution video using the received editing command;
Before the remote server performs the editing, a charging unit obtains in advance using the editing command that has received a service fee related to the editing; and
Notifying the client of the determined service fee;
With
In the step of obtaining the service fee in advance,
When the editing command is received from the client, each of the editing command and the processing time actually measured by causing the processor included in the remote server to execute the editing command in advance is referenced with reference to the database. Extract the processing time corresponding to the edit command,
Estimating the total processing time of the processor when the received editing command is executed;
Obtaining the service fee for editing the high-resolution video from the estimated total processing time and a predetermined service fee per unit processing time of the processor;
In the database, when the type of the editing command is changed, when the new editing command is used, or when the processing speed of the remote server is changed, the editing command is actually executed. Can be updated using the actual processing time when
A video editing method characterized by that. The service fee per unit time can be changed.
The video editing method according to claim 3, wherein: In a video editing method of a video editing system in which a client and a video editing device are connected via a network,
The client
Simulate editing that simulates editing performed on high-resolution video is performed on low-resolution video having a lower resolution than the high-resolution video,
An edit command that describes the specific contents of the simulated edit is generated,
Transmitting the generated editing command to the video editing device via the network, and
A remote server provided in the video editing device,
Using the editing command received from the client, the high-resolution video is automatically edited substantially the same as the contents of the simulated editing,
A charging unit provided in the video editing device,
Before the remote server performs the editing, a service fee related to the editing is obtained in advance using the editing command received from the client,
Notifying the client of the calculated service fee;
With steps,
In the step of obtaining the service fee in advance,
When the editing command is received from the client, each of the editing command and the processing time actually measured by causing the processor included in the remote server to execute the editing command in advance is referenced with reference to the database. Extract the processing time corresponding to the edit command,
Estimating the total processing time of the processor when the received editing command is executed;
Obtaining the service fee for editing the high-resolution video from the estimated total processing time and a predetermined service fee per unit processing time of the processor;
In the database, when the type of the editing command is changed, when the new editing command is used, or when the processing speed of the remote server is changed, the editing command is actually executed. Can be updated using the actual processing time when
A video editing method characterized by that.

Images