JP6847138B2 - A video distribution system, video distribution method, and video distribution program that distributes videos containing animations of character objects generated based on the movements of actors. - Google Patents

Description

The disclosure in the present specification relates to a video distribution system, a video distribution method, and a video distribution program that distribute a video including an animation of a character object generated based on the movement of an actor.

Conventionally, there has been known a video distribution system that generates an animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object. Such a moving image distribution system is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

There is also known a content distribution system that displays a gift object corresponding to an item purchased by the viewing user on a display screen in response to a request from a viewing user who views the content. For example, in the video distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-121998 (Patent Document 2), a viewing user purchases a gift item and presents the purchased gift item to a performer (content distributor). Can be provided as. According to the publication, it is desirable that the gift object be displayed in the background area of the distribution screen so as not to interfere with the moving image.

JP 2015-184689 Japanese Unexamined Patent Publication No. 2012-121998

Displaying the gift object in duplicate with the video may lead to a deterioration of the viewing experience of the viewing user. For example, if the main part of the video is hidden by a gift object, the viewer may feel that the video has been blocked. This problem can be exacerbated, especially if a large number of gift objects are displayed in duplicate with the video. Therefore, in Patent Document 2, the gift object is not displayed in the content display area where the moving image is displayed, but is displayed in the background area outside the content display area.

An object of the present disclosure is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. One of the more specific purposes of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display a gift object in duplicate with a video without deteriorating the viewing experience of the viewing user. is there.

The video distribution system according to one aspect is a video distribution system that distributes a video including an animation of a character object generated based on the movement of an actor, and includes one or more computer processors, said one or more computer processors. Is set to the decoration object when the decoration object for which the first display request is made by the viewing user who views the moving image is selected by a user other than the viewing user by executing a computer-readable command. The decorative object is displayed in the moving image in association with the portion of the character object determined based on the mounting position information.

In one aspect, the selection of the decorative object is made by a person other than the viewing user.

In one aspect, the selection of the decorative object is made by a supporter who supports the distribution of the moving image.

In one aspect, the selection of the decorative object is made by the actor.

In one embodiment, the one or more computer processors respond to the video by receiving a second display request from a viewing user viewing the video requesting the display of a first object different from the decorative object. The first object is displayed.

In one aspect, the second display request includes a display position designation parameter that specifies the display position of the first object, and the first object is designated by the display position designation parameter in the moving image. It is displayed at the position.

In one aspect, a movement direction parameter that specifies the movement direction of the first object is included, and the first object is displayed in the moving image to move in the direction specified by the movement direction parameter. ..

In one aspect, the second display request includes a trajectory parameter that specifies the trajectory of the first object, and the first object moves on the trajectory specified by the trajectory parameter in the moving image. Is displayed.

In one aspect, an object display prohibition period is set within the distribution period of the moving image, and the first object and the decorative object are displayed on the moving image at a timing other than the object display prohibiting period in the distribution period of the moving image. ..

In one aspect, when the second display request is received during the object display prohibition period, the first object is displayed in the moving image after the object display prohibition period has elapsed.

In one aspect, the one or more computer processors receive a purchase request to purchase the decorative object from the viewing user, perform payment processing in response to the purchase request, and the decorative object until the end of distribution of the moving image. If is not selected, the payment process is cancelled.

In one aspect, the one or more computer processors receive a purchase request to purchase the decorative object from the viewing user, perform payment processing in response to the purchase request, and the decorative object until the end of distribution of the moving image. If not selected, points are given to the viewing user.

In one aspect, the one or more computer processors accept a purchase request to purchase the decoration object from the viewing user, and in response to the purchase request, the decoration is added to a possession list which is a list of objects owned by the viewing user. In response to the addition of the object and the reception of the first display request requesting the display of the decoration object from the viewing user, the decoration object is deleted from the possession list, and the decoration object ends the distribution of the moving image. Adds the decoration object to the possession list if it is not selected by the time.

In one aspect, the one or more computer processors provide the viewing user with purchase information for purchasing a gift object that can be purchased in connection with the video, the gift object including the decorative object. The gift object includes a unique gift object that can be purchased only in the moving image and a common gift object that can be purchased in a moving image other than the moving image. ..

One aspect relates to a moving image distribution method that distributes a moving image including an animation of a character object generated based on the movement of an actor by executing a computer-readable instruction by one or more computer processors. The video distribution method includes a step of receiving a first display request for requesting display of a decoration object from a viewing user who watches the video, and a decoration object when the decoration object is selected by a user other than the viewing user. The present invention includes a step of displaying the decorative object in the moving image in association with the portion of the character object determined based on the mounting position information set in.

One aspect relates to a video distribution program that distributes a video including an animation of a character object generated based on the movement of an actor. The distribution program includes a step of receiving a first display request for requesting the display of a decoration object from a viewing user who views the moving image to one or a plurality of computer processors, and the decoration object is selected by a user other than the viewing user. In this case, the step of displaying the decorative object in the moving image in association with the portion of the character object determined based on the mounting position information set in the decorative object is executed.

According to the embodiment of the present invention, the gift object can be displayed in duplicate with the moving image without deteriorating the viewing experience of the viewing user.

It is a block diagram which shows the moving image distribution system by one Embodiment. It is a schematic diagram which shows typically the equipment of the studio which produces the moving image distributed by the moving image distribution system of FIG. It is a figure explaining the possession list stored in the moving image distribution system of FIG. It is a figure explaining the candidate list stored in the moving image distribution system of FIG. It is a figure which shows the example of the moving image which is displayed on the client apparatus 10a in one Embodiment. FIG. 5 includes an animation of the character object. It is a figure which shows the example of the moving image which is displayed on the client apparatus 10a in one Embodiment. FIG. 6 usually includes an object. It is a figure which shows the example of the moving image which is displayed on the client apparatus 10a in one Embodiment. FIG. 7 includes decorative objects. It is a schematic diagram which shows the example of the decoration object selection screen for selecting a desired selection decoration object from the decoration objects included in a candidate list. It is a flow figure which shows the flow of the moving image distribution processing in one Embodiment. It is a flow diagram which shows the flow of the process of displaying a normal object in one Embodiment. It is a flow chart which shows the flow of the process of displaying a decorative object in one Embodiment. It is a figure for demonstrating the object display prohibition period set for the moving image distributed in the moving image distribution system of FIG.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same or similar components are designated by the same reference numerals in a plurality of drawings.

A moving image distribution system according to an embodiment will be described with reference to FIGS. 1 to 4. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 is a schematic diagram schematically showing equipment of a studio in which a video distributed by the video distribution system 1 is produced. 3 and 4 are diagrams for explaining information stored in the moving image distribution system 1.

The video distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are connected to each other so as to be able to communicate with each other via the network 50. The server device 20 is configured to deliver a moving image including a character animation, as will be described later. The characters included in this moving image may be motion-controlled in the virtual space.

This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. The first viewing user who is the user of the client device 10a, the second viewing user who is the user of the client device 10b, and the third viewing user who is the user of the client device 10c view the distributed moving image by each client device. be able to. The video distribution system 1 may include a number of client devices less than three, or may include more than three client devices.

The client devices 10a to 10c are information processing devices such as smartphones. In addition to smartphones, the client devices 10a to 10c may be mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various information processing devices capable of reproducing moving images other than these. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I / F, a display, a sensor unit including various sensors such as a gyro sensor, a sound collecting device such as a microphone, and a storage for storing various information. May be good.

In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I / F 22, and a storage 23.

The computer processor 21 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage 23 or other storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a set of a plurality of physically separate computer processors. In the present specification, the program described as being executed by the computer processor 21 or the instructions contained in the program may be executed by a single computer processor or may be executed by a plurality of computer processors in a distributed manner. May be good. Further, the program executed by the computer processor 21 or the instructions included in the program may be executed by a plurality of virtual computer processors.

The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The server device 20 can send and receive data to and from other devices via the communication I / F 22.

The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than those capable of storing data. Various programs can be stored in the storage 23. At least a part of the program and various data that can be stored in the storage 23 may be stored in a storage (for example, a storage 60) that is physically separate from the server device 20.

Many of the components of the studio unit 30 are arranged in, for example, the studio room R shown in FIG. As shown in the figure, in the studio room R, actors A1 and A2 are performing. The studio unit 30 is configured to detect the movements and facial expressions of the actors A1 and A2 and output the detected information to the server device 20.

Both the actor A1 and the actor A2 are objects whose movements and facial expressions are captured by a group of sensors described later provided in the studio unit 30. Actors A1 and A2 are, for example, humans, animals, or moving objects performing. The actor A1 and the actor A2 may be, for example, robots capable of independent movement. The number of actors in the studio room R may be 1 or 3 or more.

The studio unit 30 includes six motion sensors 31a to 31f mounted on the actor A1, a controller 33a held by the left hand of the actor A1, a controller 33b held by the right hand of the actor A1, and a fitting 37b. It has a camera 37a attached to the head of the actor A1 via the camera 37a. The studio unit 30 also includes six motion sensors 32a to 32f mounted on the actor A2, a controller 34a held on the left hand of the actor A2, a controller 34b held on the right hand of the actor A2, and a fitting 38b. It has a camera 38a attached to the head of the actor A2 via the camera 38a. A microphone for acquiring audio data may be attached to each of the fittings 37b and the fittings 38b. This microphone can acquire the utterances of the actors A1 and A2 as voice data. The microphone may be a wearable microphone mounted on the actors A1 and A2 via the fittings 37b and 38b, and may be a mounting type microphone installed on the floor, wall, or ceiling of the studio room R. It may be. In addition to the above components, the studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39. A supporter computer 40 is installed in the adjacent room separated from the studio room R by a glass window. The server device 20 may be installed in the same room where the supporter computer 40 is installed.

The motion sensors 31a to 31f and the motion sensors 32a to 32f cooperate with the base station 35a and the base station 35b to detect their own positions and orientations. In one embodiment, the base station 35a and the base station 35b are multi-axis laser emitters. The base station 35a scans the laser light, for example, around a vertical axis after emitting a flashing light for synchronization. The base station 35b scans the laser beam, for example, around a horizontal axis. The motion sensors 31a to 31f and the motion sensors 32a to 32f may each include a plurality of optical sensors that detect the incident of blinking light and laser light from the base station 35a and the base station 35b, respectively. The motion sensors 31a to 31f and the motion sensors 32a to 32f have the time difference between the incident timing of the blinking light and the incident timing of the laser light, the light receiving time at each optical sensor, the incident angle of the laser light detected by each optical sensor, and the incident angle of the laser light detected by each optical sensor, respectively. If necessary, it may detect its own position and orientation based on information other than these. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station 35a and the base station 35b may be, for example, a base station provided by HTC CORPORATION.

The detection information indicating the position and orientation of each motion sensor calculated by each of the motion sensors 31a to 31f and the motion sensors 32a to 32f is transmitted to the server device 20. This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b emit flashing light and scan the laser light at regular intervals, the detection information of each motion sensor is updated at each interval.

In the illustrated embodiment, the actor A1 is equipped with six motion sensors 31a to 31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are attached to the left wrist, right wrist, left instep, right instep, waist, and crown of the actor A1, respectively. The motion sensors 31a to 31f may be attached to the actor A1 via an attachment. The actor A2 is equipped with six motion sensors 32a to 32f. The motion sensors 32a to 32f can be mounted on the actor A2 at the same positions as the motion sensors 31a to 31f. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f can be attached to various parts of the actor A1, and the motion sensors 32a to 32f can be attached to various parts of the actor A2. The number of motion sensors mounted on the actors A1 and A2 may be 5 or less, or 7 or more. In this way, by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f mounted on each part of the body of the actor A1 and the actor A2, the movement of the body of the actor A1 and the actor A2 is detected. be able to.

In one embodiment, a large number of infrared LEDs are mounted on each of the plurality of motion sensors mounted on the actor A1 and the actor A2, and the light from the infrared LEDs is provided on the floor or wall of the studio room R. The position and orientation of each of the motion sensors may be detected by detecting with an infrared camera. A visible light LED may be used instead of the infrared LED, and the position and orientation of each of the motion sensors may be detected by detecting the light from the visible light LED with a visible light camera. In this way, each of the plurality of motion sensors mounted on the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and the light from the light emitting unit is provided in the studio room R as a light receiving unit (for example). For example, the position and orientation of each of the motion sensors may be detected by detecting with an infrared camera or a visible light camera).

In one embodiment, a plurality of reflection markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflection marker is attached to each of the actor A1 and the actor A2 with an adhesive tape or the like. The position and orientation of the reflection marker can be detected by photographing the actors A1 and A2 to which the reflection marker is attached in this way to generate imaging data, and performing image processing on the imaging data.

The controller 33a and the controller 33b output a control signal corresponding to the operation of the actor A1 to the server device 20. Similarly, the controller 34a and the controller 34b output a control signal corresponding to the operation of the actor A2 to the server device 20.

The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining the setting information of the virtual camera for constructing the virtual space included in the moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional Cartesian coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36a transmits tracking information indicating its position and orientation to the tracking information server device 20. Similarly, the position and orientation of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating its position and orientation to the tracking information server device 20.

The camera 37a is attached to the head of the actor A1 as described above. For example, the camera 37a is arranged so that the face of the actor A1 can be imaged. The camera 37a continuously images the face of the actor A1 and acquires the image data of the face of the actor A1. Similarly, the camera 38a is attached to the head of the actor A2. The camera 38a is arranged so that the face of the actor A2 can be imaged, continuously images the face of the actor A2, and acquires the image capturing data of the face of the actor A2. The camera 37a transmits the image capturing data of the face of the actor A1 to the server device 20, and the camera 38a transmits the imaging data of the face of the actor A1 to the server device 20. The camera 37a and the camera 38a may be 3D cameras capable of detecting the depth of a person's face.

The display 39 is configured to display information received from the support computer 40. The information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other information. The display 39 is arranged at a position visible to the actors A1 and A2.

In the illustrated embodiment, the supporter computer 40 is installed in a room adjacent to the studio room R. Since the room in which the supporter computer 40 is installed and the studio room R are separated by a glass window, the operator of the supporter computer 40 (sometimes referred to as "supporter" in the present specification) is the actor A1 and the actor A2. Can be visually recognized. In the illustrated embodiment, the supporter B1 and the supporter B2 are present as operators of the supporter computer 40.

The supporter computer 40 may be configured so that the settings of the components of the studio unit 30 can be changed according to the operations of the supporter B1 and the supporter B2. The supporter computer 40 can, for example, set the scanning interval by the base station 35a and the base station 35b, set the position or orientation of the tracking sensor 36a and the tracking sensor 36b, and change various settings of various other devices. .. At least one of the supporter B1 and the supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39.

The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components (not shown). For example, the studio unit 30 may include a projector. The projector can project a moving image delivered to the client device 10a or other client devices onto the screen S.

Next, in one aspect, the information stored in the storage 23 will be described. In the illustrated embodiment, the storage 23 stores model data 23a, object data 23b, possession list 23c, candidate list 23d, and various information necessary for generation and distribution of distribution moving images other than the above.

The model data 23a is model data for generating a character animation. The model data 23a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data indicating the skeleton of the character (sometimes referred to as “skeleton data”) and surface data indicating the shape and texture of the surface of the character. The model data 23a can include a plurality of model data different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data. In the illustrated embodiment, the model data 23a has at least two types of model data that are different from each other in order to generate the character object corresponding to the actor A1 and the character object corresponding to the actor A2. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

The object data 23b includes asset data for constructing a virtual space constituting a moving image. The object data 23b is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and various objects displayed in the moving image other than these. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

In addition to the above, the object data 23b may include a gift object to be displayed in the moving image based on a display request from the viewing user of the client devices 10a to 10c. Gift objects can include effect objects, regular objects, and decoration objects. The viewing user can purchase the desired gift object.

The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is, for example, an object that imitates confetti. The object imitating confetti may be displayed on the entire viewing screen, whereby the impression of the entire viewing screen before and after the display can be changed. Effect objects may appear to overlap with character objects, but differ from decorative objects in that they are not displayed in association with a particular part of the character object.

A normal object is an object that becomes a digital gift from a viewing user to an actor (for example, actor A1 or actor A2), for example, an object that imitates a stuffed animal or a bouquet. In one aspect, the normal object is displayed on the moving image display screen so as not to come into contact with the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. Ordinary objects may appear to overlap objects other than character objects in virtual space. Ordinary objects may appear to overlap with character objects, but differ from decorative objects in that they are not displayed in association with a particular part of the character object. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with a part other than the head including the face of the character object and does not overlap with the head of the character object. Is displayed.

A decoration object is an object displayed on a display screen in association with a specific part of a character object. In one aspect, the decorative object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decorative object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by the three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with the position information in the three-dimensional coordinate space. For example, in the character's head, the specific parts are the front left side of the head, the front right side, the back left side, the back right side, the center front side, the center back side, the left eye, the right eye, the left ear, the right ear, and the entire hair. It may be determined.

The decorative object is, for example, an accessory (catcher, necklace, earring, etc.) attached to the character object, clothes (T-shirt, etc.), a costume, and an object that can be attached to other character objects. The object data 23b corresponding to the decoration object may include mounting position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decorative object can indicate to which part of the character object the decorative object is mounted. For example, when the decoration object is a Katyusha, the mounting position information of the decoration object may indicate that the decoration object is mounted on the "head" of the character object. When the mounting position information on which the decorative object is mounted is specified as a position in the three-dimensional coordinate space, the mounting position information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the mounting position information indicating the position where the decorative object indicating "Kachusha" is mounted may be associated with two parts of the character object, "the left side behind the head" and "the right side behind the head". That is, the decorative object indicating the "alice band" may be attached to both the "left side behind the head" and the "right side behind the head". When the decorative object is a T-shirt, the mounting position information of the decorative object may indicate that the decorative object is mounted on the "body" of the character object.

A display time may be set for each of the gift objects according to the type of the gift object. In one aspect, the display time of the decorative object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decorative object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

The possession list 23c is a list showing the gift objects possessed by the viewing user of the moving image. An example of the holding list 23c is shown in FIG. As shown in the figure, in the possession list 23c, an object ID that identifies a gift object possessed by the viewing user is stored in association with the account information of the viewing user (for example, the user ID of the viewing user). The viewing users include, for example, first viewing users to third viewing users of the client devices 10a to 10c.

The candidate list 23d is a list of decorative objects for which a display request has been made by the viewing user. As will be described later, the viewing user who owns the decorative object can make a display request for the decorative object. In the candidate list 23d, the object ID that identifies the decoration object is stored in association with the account information of the viewing user who has requested the display of the decoration object. The candidate list 23d may be created for each distributor. The candidate list 23d may be stored, for example, in association with the distributor identification information that identifies the distributor (actor A1, actor A2, supporter B1, and / or supporter B2).

Next, the functions realized by the computer processor 21 will be described more specifically. The computer processor 21 executes a computer-readable instruction included in the distribution program to execute the body motion data generation unit 21a, the face motion data generation unit 21b, the animation generation unit 21c, the video generation unit 21d, and the video distribution unit 21e. It functions as a display request processing unit 21f, a decorative object selection unit 21g, and an object purchase processing unit 21h. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, the computer processor mounted on the supporter computer 40.

The body motion data generation unit 21a generates first body motion data of each part of the body of the actor A1 based on the detection information of the motion sensors 31a to 31f, and detects each of the motion sensors 32a to 32f. Based on the information, the second body motion data which is a digital representation of the position and orientation of each part of the body of the actor A2 is generated. In the present specification, the first body motion data and the second body motion data may be collectively referred to simply as "body motion data". Body motion data is generated at any time over time. For example, body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data can represent the body movements of the actors A1 and A2 as digital data in chronological order. In the illustrated embodiment, since the motion sensors 31a to 31f and the motion sensors 32a to 32f are attached to the left and right limbs, hips, and head of each of the actors A1 and A2, the motion sensors 31a to 31f and the motion sensors 31a to 31f Based on the detection information of the motion sensors 32a to 32f, it is possible to digitally represent the positions and orientations of the actors A1 and the actors A2 over time. The body motion data can define, for example, the position and rotation angle of the bones constituting the rig data included in the model data 23a.

The face motion data generation unit 21b generates first face motion data which is a digital representation of the face movement of the actor A1 based on the image data of the camera 37a, and also based on each image data of the camera 38a. Generates second face motion data, which is a digital representation of the face movement of actor A2. In the present specification, the first face motion data and the second face motion data may be collectively referred to simply as "face motion data". Face motion data is generated at any time with the passage of time. For example, face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data can digitally represent the facial movements (changes in facial expressions) of the actor A2 and the actor A2 in time series.

The animation generation unit 21c applies the body motion data generated by the body motion data generation unit 21a and the face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. It is configured to generate animations for character objects that move in virtual space and have changing facial expressions. Specifically, the animation generation unit 21c generates an animation of a character object that moves in synchronization with the movement of the body and facial expression of the actor A1 based on the first body motion data and the first face motion data related to the actor A1. Based on the second body motion data and the second face motion data related to the actor A2, it is possible to generate an animation of a character object that moves in synchronization with the movement of the body and facial expression of the actor A2. In the present specification, the character object generated based on the movement and facial expression of actor A1 is referred to as "first character object", and the character object generated based on the movement and facial expression of actor A2 is referred to as "second character object". There is a case.

The moving image generation unit 21d constructs a virtual space using the object data 23b, and creates the virtual space, the animation of the first character object corresponding to the actor A1, and the animation of the second character object corresponding to the actor A2. Generate a video that contains. The first character object is arranged in the virtual space so as to match the position of the actor A1 with respect to the tracking sensor 36a, and the second character object is arranged in the virtual space so as to match the position of the actor A2 with respect to the tracking sensor 36a. Will be done. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first character object and the second character object in the virtual space can be changed.

In one aspect, the moving image generation unit 21d constructs a virtual space based on the tracking information of the tracking sensor 36a. For example, the moving image generation unit 21d determines the setting information of the virtual camera (position in the virtual space, gaze position, gaze direction, and angle of view) based on the tracking information of the tracking sensor 36a, and is based on the setting information of the virtual camera. The drawing area of the entire virtual space is defined, and moving image information for displaying the drawing area of this virtual space is generated.

The moving image generation unit 21d replaces the tracking information of the tracking sensor 36a, or based on the tracking information of the tracking sensor 36b in addition to the tracking information of the tracking sensor 36a, the first character object and the second character in the virtual space. It may be configured to determine the position and orientation of the object and the setting information of the virtual camera.

The moving image generation unit 21d can synthesize the sounds of the actors A1 and A2 acquired from the microphone of the studio unit 30 with the generated moving images.

As described above, the moving image generation unit 21d has the animation of the first character object that moves in synchronization with the movement of the body and facial expression of the actor A1, and the second character that moves in synchronization with the movement of the body and facial expression of the actor A2. It is possible to generate an animation of an object and generate a moving image for distribution in which the sounds of actors A1 and A2 are combined with this animation.

The video distribution unit 21e distributes the video generated by the video generation unit 21d. This moving image is distributed to the client devices 10a to 10c and other client devices via the network 50. The received moving image is reproduced in the client device 10a to the client device 10c.

This moving image may be distributed to a client device (not shown) installed in the studio room R, and may be projected onto the screen S from this client device via a short focus projector. Further, this moving image may be distributed to the supporter computer 40. As a result, the supporter B1 and the supporter B2 can confirm the viewing screen of the distributed moving image.

FIG. 5 shows a display example of a moving image distributed from the server device 20 to the client device 10a and reproduced in the client device 10a. As shown in the figure, the display image 70 of the moving image delivered from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and an object 72 indicating a table in the virtual space. There is. The object 72 is not a gift object, but one of the objects for constructing the virtual space included in the object data 23b. The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The character object 71A is motion-controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The character object 71B is motion-controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move in the screen in synchronization with the movement of the body and facial expression of the actor A1, and the character object 71B is controlled to move in the screen in synchronization with the movement of the body and facial expression of the actor A2. Is controlled by.

As described above, the distribution moving image from the server device 20 may be distributed to the supporter computer 40. The moving image delivered to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 by watching the moving image being played on the supporter computer 40. In one aspect, when the supporter B1 and the supporter B2 want to change the angles of the character object 71A and the character object 71B in the moving image being distributed, the supporter computer 40 tracks an instruction signal instructing the change of the orientation of the tracking sensor 36a. It can be transmitted to the sensor 36a. The direction of the tracking sensor 36a can be changed according to the instruction signal. For example, the tracking sensor 36a is rotatably attached to a stand via a rotation mechanism having an actuator built around its axis, and when the tracking sensor 36a receives an instruction signal instructing the change of its orientation, the tracking sensor 36a is said to be rotatably attached. The actuator of the rotation mechanism may be driven based on the instruction signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one embodiment, the supporter B1 and the supporter B2 transmit an instruction for using the tracking information from the tracking sensor 36b instead of the tracking information from the tracking sensor 36a from the supporter computer 40 to the tracking sensor 36a and the tracking sensor 36b. May be good.

In one aspect, when the supporter B1 and the supporter B2 see the moving image being played on the supporter computer 40 and determine that an instruction to the actor A1 or the actor A2 is necessary, the supporter B1 and the supporter B2 send a message indicating the instruction to the supporter computer 40. This message can be input and output to the display 39. For example, the supporter B1 and the supporter B2 can instruct the actor A1 or the actor A2 to change the standing position through the message displayed on the display 39.

The display request processing unit 21f receives a display request for the gift object from the client device of the viewing user, and performs processing according to the display request. Each viewing user can send a gift object display request to the server device 20 by operating his / her own client device. For example, the first viewing user can send a gift object display request to the server device 20 by operating the client device 10a. The display request of the gift object may include the user ID of the viewing user and the identification information (object ID) that identifies the object for which the display is requested.

As mentioned above, the gift object may include an effect object, a normal object, and a decoration object. The effect object and the normal object are examples of the first object. A display request that requests the display of an effect object or a normal object is an example of a second display request.

In one aspect, when the display request processing unit 21f receives a display request for a specific effect object from the viewing user, the display request processing unit 21f displays the effect object for which the display is requested on the display image 70 of the moving image based on the display request. Perform processing. For example, when a display request for an effect object corresponding to confetti is made, the display request processing unit 21f displays an effect object 73 indicating confetti based on the display request as shown in FIG. 6. Image 70 To display.

In one aspect, when the display request processing unit 21f receives a display request for a specific normal object from the viewing user, the display request processing unit 21f performs a process for displaying the normal object requested to be displayed on the moving image 70 based on the display request. .. For example, when a display request for a normal object showing a teddy bear is made, the display request processing unit 21f displays a display image of the normal object 74 showing the stuffed bear based on the display request, as shown in FIG. Display on 70.

The display request of the normal object 74 may include a display position specification parameter that specifies the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position specified by the display position designation parameter in the virtual space. For example, the display position specification parameter can specify the display position of the normal object 74 above the object 72 indicating the table. By using the display position specification parameter, the viewing user sees the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70, and specifies the position where the normal object is to be displayed. can do.

In one aspect, the normal object 74 may be displayed to move within the moving image display image 70. For example, the normal object 74 may be displayed so as to fall from the top to the bottom of the screen. In this case, the normal object 74 may be displayed in the display image 70 while falling from the start of the fall to the floor of the virtual space constituting the moving image 70, and may disappear from the display image 70 after falling on the floor. .. The viewing user can see the falling normal object 74 from the start of the fall to the end of the fall. The moving direction of the normal object 74 in the screen can be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 so as to move from left to right, right to left, upper left to lower left, or other directions of the moving image 70. The normal object 74 can move in various orbits. For example, the normal object 74 can move on a linear orbit, a circular orbit, an elliptical orbit, a spiral orbit, or any other orbit. In the display request of the normal object, the viewing user specifies a movement direction parameter that specifies the movement direction of the normal object 74 and a trajectory in which the normal object 74 moves, in addition to the display position specification parameter or instead of the display position specification parameter. At least one of the orbital parameters can be included. In one embodiment, among the effect object and the normal object, those whose size in the virtual space is smaller than the reference size (for example, a piece of confetti of the effect object 73) are attached to the character object 71A and the character object 71B. Part or all of them may be duplicated and displayed. In one embodiment, among the effect object and the normal object, the one whose size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) is displayed at a position that does not overlap with the character object. .. In one embodiment, the effect object and the normal object whose size in the virtual space is larger than the reference size (for example, the normal object 74 (plush toy bear)) is at least one of the character object 71A and the character object 71B. If it overlaps with, it is displayed after the character object that is displayed in duplicate.

In one aspect, when the display request processing unit 21f receives a display request for a specific decorative object from the viewing user, the display request processing unit 21f adds the decorative object for which the display is requested to the candidate list 23d based on the display request. The display request for the decorative object is an example of the first display request. For example, the display request processing unit 21f stores the identification information (object ID) for identifying a specific decorative object requested to be displayed by the viewing user in the candidate list 23d in association with the user ID of the viewing user. (See Fig. 4). When a plurality of display requests for the decoration object are made, the user ID of the viewing user who made the display request and the decoration object ID of the decoration object whose display request is requested by the viewing user are used for each of the plurality of display requests. Are associated with each other and stored in the candidate list 23d.

In one aspect, the decoration object selection unit 21g displays the selected decoration object on the moving image display image 70 in response to the selection of one or more of the decoration objects included in the candidate list 23d. Perform the process to make it. In the present specification, the decoration object selected from the candidate list 23d may be referred to as a "selected decoration object".

The selection of the decorative object from the candidate list 23d is made, for example, by the supporter B1 and the supporter B2 operating the supporter computer 40. In one aspect, the supporter computer 40 displays a decorative object selection screen. FIG. 8 shows an example of the decorative object selection screen 80 in one aspect. The decorative object selection screen 80 is displayed, for example, on the display of the supporter computer 40. The decoration object selection screen 80 displays each of the plurality of decoration objects included in the candidate list 23d in tabular form, for example. As shown in the figure, in the decoration object selection screen 80 in one aspect, the first column 81 for displaying the type of the decoration object, the second column 82 for displaying the image of the decoration object, and the character object to which the decoration object is associated. It has a third column 83, which displays the site of the above. Further, on the decoration object selection screen 80, selection buttons 84a to 84c for selecting each decoration object are displayed. In this way, the decoration object selection screen 80 displays the decoration objects that are candidates for the selection decoration object.

Supporter B1 and supporter B2 can select one or more of the decorative objects included in the decorative object selection screen 80. For example, the supporter B1 and the supporter B2 can select the Katyusha by selecting the selection button 84a. When it is detected by the decoration object selection unit 21g that the cutie is selected, the display request processing unit 21f displays the selection decoration object 75 indicating the selected cutie on the moving image display screen 70 as shown in FIG. Let me. The selection decoration object 75 is displayed on the display image 70 in association with a specific part of the character object. The selection decoration object 75 may be displayed so as to be in contact with the specific part of the character object. For example, since the selection decoration object 75 indicating the Katyusha is associated with the head of the character object, it is attached to the head of the character object 71A as shown in FIG. 7. The decorative object may be displayed on the display screen 70 so as to move along with the movement of the specific portion of the character object. For example, when the head of the character object 71A with the alice band moves, the selection decoration object 75 indicating the alice band is also attached to the head of the character object 71A as if the alice band was attached to the head of the character object 71A. Moves.

As described above, the object data 23b may include mounting position information indicating which part of the character object the decorative object is associated with. In one aspect, the decoration object selection unit 21g is mounted on a portion of the decoration objects included in the candidate list 23d that overlaps with the portion indicated by the mounting position information of the decoration object already mounted on the character object. The object may not be selectable as the selection decoration object 75. For example, the Katyusha associated with the "left side behind the head" and the "right side behind the head" and the hair accessory associated with the "left side behind the head" overlap because the "left side behind the head" overlaps. It cannot be installed at the same time. On the other hand, the Katyusha associated with "left behind the head" and "right behind the head" and the earrings associated with "left ear (of the head)" and "right ear (of the head)" Since specific parts of the character object do not overlap, they can be attached at the same time.

The selection decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selection decoration object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

In one embodiment, the decoration object selection screen 80 may be configured so as not to include information that can identify the user who owns each decoration object or the user who has made a display request for each decoration object. This makes it possible to prevent the chooser from giving preferential treatment to a specific user when selecting a decorative object.

In one embodiment, the decoration object selection screen 80 may display information about the user who owns each decoration object or, for each decoration object, the user who has made a display request for the decoration object. For example, for each decoration object, the number of times the user who made the display request of the decoration object has made the display request of the decoration object and the number of times selected (for example, the number of times the decoration object display request has been made 5 times so far). Information indicating that two of them have been selected), the number of times the user has viewed at least one of the moving images of the character object 71A and the character object B, and the moving image of the user in the moving image distribution system 1 (character object 71A and the character). Number of views (regardless of whether object B appears), amount of gift object purchased by the user, number of times the user purchased the object, points that can be used in the video distribution system 1 owned by the user, video distribution of the user Various information about the level in the system 1 and the user who requested the display of each decoration object other than these may be displayed. According to the embodiment, the decoration object can be selected based on the behavior and viewing history of the user who has requested the display of the decoration object in the video distribution system 1 so far.

In one embodiment, the display of decorative objects may be constrained to eliminate duplication. For example, with respect to the character object 71A, if the decoration object associated with the specific part is already selected, the selection of another decoration object associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, if the Katyusha associated with the "head" of the character object 71B is already selected, the other decorations associated with the "head". The object (for example, the decorative object representing the "hat" associated with the head) is not displayed on the decorative object selection screen 80, or the selection button for selecting the decorative object representing the hat is selected on the selection screen 80. It may be made unselectable in. According to the embodiment, it is possible to prevent the decorative object from being duplicated in a specific part of the character object.

The decorative object selection screen 80 may be displayed on another device in place of the supporter computer 40 or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decorative object based on the decorative object selection screen 80 displayed on the display 39 or the screen S. The selection of the decorative object by the actor A1 and the actor A2 can be made, for example, by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b.

In one aspect, the object purchase processing unit 21h receives the purchase information of each of the plurality of gift objects that can be purchased in connection with the video in response to the request from the viewing user of the video, and the client device (for example, the viewing user) of the viewing user. It is transmitted to the client device 10a). The purchase information for each gift object includes the type of gift object (effect object, regular object, or decoration object), the image of the gift object, the price of the gift object, and the information required to purchase other gift objects. Can be included. The viewing user can select the gift object to be purchased based on the purchase information of the gift object displayed on the client device 10a. The gift object to be purchased may be selected by operating the client device 10a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs payment processing based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. In this case, the object ID of the purchased gift object is stored in the possession list 23c in association with the user ID of the purchased viewing user.

The gift objects that can be purchased may vary from video to video. The gift objects that can be purchased may be available for purchase in a plurality of videos. That is, the gift object that can be purchased may include a unique gift object that is unique to each video and a common gift object that can be purchased in a plurality of videos. For example, the effect object indicating confetti may be a common gift object that can be purchased in a plurality of moving images.

In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased becomes the video being viewed in response to the completion of the payment process for purchasing the effect object. It may be displayed automatically. If a normal object is purchased while watching a predetermined video, the normal gift object to be purchased is the video being watched in response to the completion of the payment process for purchasing the normal object, as described above. May be displayed automatically.

In another aspect, a payment completion notification is transmitted to the client device 10a in response to the completion of the payment process in the object purchase processing unit 21h for the effect object to be purchased, and the effect object purchased in the client device 10a. A confirmation screen may be displayed for confirming with the viewing user whether or not to request the display of. When the viewing user chooses to make a display request for the purchased effect object, the display request requesting the display of the purchased effect object is sent from the viewing user's client device to the display request processing unit 21f. The display request processing unit 21f may perform a process of displaying the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to request the display of the purchased normal object may be displayed on the client device 10a in the same manner as described above.

Next, with reference to FIGS. 9 to 11, a moving image distribution process according to one aspect will be described. FIG. 9 is a flow chart showing a flow of video distribution processing in one embodiment, FIG. 10 is a flow chart showing a flow of processing for displaying a normal object in one embodiment, and FIG. 11 is a flow chart showing a flow of processing for displaying a normal object in one embodiment. It is a flow chart which shows the flow of the process of displaying a decoration object in. In the video distribution process, it is assumed that actors A1 and A2 are performing in the studio room R.

First, in step S11, body motion data that is a digital representation of the body movements of actors A1 and A2 and face motion data that is a digital representation of the facial movements (facial expressions) of actors A1 and A2 are generated. To. The body motion data is generated by, for example, the body motion data generation unit 21a, and the face motion data is generated by the face motion data generation unit 21b, for example.

Next, in step S12, by applying the body motion data and face motion data of the actor A1 to the model data for the actor A1, the animation of the first character object that moves in synchronization with the movement of the body and facial expression of the actor A1. Is generated. Similarly, by applying the body motion data and face motion data of the actor A2 to the model data for the actor A2, an animation of the second character object that moves in synchronization with the movement of the body and facial expression of the actor A2 is generated. .. This animation is generated, for example, by the animation generation unit 21c described above.

Next, in step S13, a moving image including the animation of the first character object corresponding to the actor A1 and the animation of the second character object corresponding to the actor A2 is generated. The audio of actor A1 and actor A2 may be combined with this moving image. The animation of the first character object and the animation of the second character object may be arranged in the virtual space. This moving image is generated, for example, by the moving image generation unit 21d described above.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the client devices 10a to 10c and other client devices via the network 50. This moving image may be distributed to the supporter computer 40 and projected on the screen S in the studio room R. The video is continuously distributed over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time.

Next, the process proceeds to step S15, and it is determined whether or not the termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the supporter computer 40 has given an instruction to end the distribution, or other conditions. If the end condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the moving image including the animation synchronized with the movements of the actors A1 and A2 is continued. If it is determined that the end condition for the video is satisfied, the distribution process of the video is terminated.

Next, with reference to FIG. 10, the display processing of the normal object performed during the distribution of the moving image will be described. The normal object display process is performed in parallel with the moving image distribution process shown in FIG.

During the distribution of the moving image, it is determined in step S21 whether or not the display request for the normal object is made. For example, the first viewing user selects one or a plurality of specific normal objects from the normal objects owned by the first viewing user, and makes a display request requesting the display of the selected normal objects from the client device 10a to the server device 20. Can be sent to. As described above, a display request for the predetermined normal object may be generated in response to the purchase processing or the settlement processing of the predetermined normal object.

When a display request for a normal object is made, the display process proceeds to step S22. In step S22, based on the display request, a process for displaying the normal object for which the display is requested is displayed on the moving image being distributed is performed. For example, when a display request is made for the normal object 74 during distribution of a predetermined moving image, the normal object 74 for which the display request is made is displayed in the display screen 70 of the moving image as shown in FIG. ..

If the display request for the normal object is not made, the display process for the normal object ends. The display process of the normal object shown in FIG. 10 is repeated during the distribution period of the moving image.

The display process of the effect object can also be performed in the same procedure as the display process of the normal object described above. For example, when a display request is made for the effect object 73 during distribution of a predetermined moving image, the effect object 73 for which the display request is made is displayed in the display screen 70 of the moving image as shown in FIG. .. The effect object 73 shown in FIG. 6 is an object that imitates confetti. The effect object 73 that imitates a blizzard is displayed so as to overlap (or touch) the character object 71A and the character object 71B, but is not associated with a specific part of the character object 71A and the character object 71B. It differs from decorative objects in that it is.

Next, with reference to FIG. 11, the display processing of the decorative object performed during the distribution of the moving image will be described. The display processing of the decorative object is performed in parallel with the distribution processing of the moving image shown in FIG. Further, the display processing of the decorative object may be performed in parallel with the display processing of the normal object shown in FIG.

During the distribution of the moving image, it is determined in step S31 whether or not the display request for the decorative object is made. For example, the first viewing user selects a first decoration object from his / her own decoration objects, and transmits a display request requesting the display of the selected first decoration object from the client device 10a to the server device 20. can do.

When a display request for the first decorative object is made, the display process proceeds to step S32. In step S32, the first decorative object for which display is requested is added to the candidate list based on the display request. The candidate list is a list of objects that are candidates for decoration objects displayed in the moving image being distributed, and is, for example, the above-mentioned candidate list 23d.

Next, in step S33, it is determined whether or not a specific decorative object is selected from the decorative objects stored in the candidate list.

When a specific decoration object is selected, in step S34, the selected specific decoration object (“selected decoration object”) is deleted from the candidate list, and the selected decoration is displayed on the display screen of the video being distributed. Processing to display the object is performed. For example, when the decorative object 75 is selected from the candidate list during the distribution of the moving image 70 shown in FIG. 5, as shown in FIG. 7, the selected decorative object 75 is displayed in the display image 70. Is displayed. The first decorative object for which the display request is made in step S31 is displayed in the display image 70 if it is selected from the candidate list during the distribution of the moving image, but is not displayed in the display image 70 if it is not selected.

If the decoration object is not selected from the candidate list in step S33, or if the display processing of the selected decoration object is completed in step S34, the decoration object display processing proceeds to step S35. In step S35, it is determined whether or not the distribution of the moving image being distributed has been completed. In this step S35, the determination may be made based on the same criteria as in step S15, for example. If it is determined in step S35 that the distribution has not been completed, the decoration object display process returns to step S31, and the processes of steps S31 to S35 are repeatedly executed. If it is determined that the distribution is completed, the display process of the decorative object proceeds to step S36.

In step S36, processing is performed on the decorative object (which may be referred to as “non-selected object” in the present specification) left in the candidate list at the end of the distribution of the moving image. In the present specification, the process performed in step S36 may be referred to as a non-selected object process.

The non-selected object is purchased by the viewing user and is requested to be displayed during the distribution of the video. Therefore, the non-selected object process executed in step S36 may be a process of refunding the purchase cost of the non-selected object to the viewing user who has requested the display of the non-selected object. In another aspect, the non-selected object process may be a process for canceling the settlement process for purchasing the non-selected object. In another aspect, the non-selected object process may be a process of giving a decorative object different from the non-selected object to the viewing user who has requested the display of the non-selected object.

In another aspect, the non-selected object processing may be a processing of giving points that can be used by the video distribution system 1 to the user of the non-selected object, instead of refunding the purchase cost or canceling the payment processing. The video distribution system 1 may be configured to consume points in order to watch the video. The points given to the user of the non-selected object by the non-selected object processing may be points that can be used for viewing the moving image in the moving image distribution system 1.

In another aspect, the non-selected object process may be a process of adding a non-selected object as an object owned by the first viewing user in the possessed list. As a result, the first viewing user can receive the return of the non-selected object.

In another aspect, the non-selected object processing may be a process for holding the candidate list at the end of the distribution of the moving image until the same distributor next distributes the moving image. As a result, the distributor can take over the candidate list used at the time of the previous video distribution at the time of the next video distribution. This inherited candidate list includes decorative objects (ie, non-selected objects) that were requested to be displayed during the previous video distribution but were not actually displayed in the video. As a result, the next video distribution is performed using the candidate list including the non-selected objects at the time of the previous video distribution. This non-selected object may be selected in the next video distribution and displayed in the video.

After the process in step S36 is completed, the display process of the decorative object ends.

In one embodiment, an object display prohibition section in which the display of the gift object is prohibited may be provided in the moving image distribution. FIG. 12 is a diagram schematically illustrating an object display prohibited section. FIG. 12 shows that the moving image is delivered between the time t1 and the time t2. That is, the time t1 is the video distribution start time, and the time t2 is the video distribution end time. Of the moving image distribution period, the object display prohibition period 81 is between the time t3 and the time t4. Even if the display request r1 of the gift object is made in the object display prohibition period 81, the gift object is not displayed in the display image of the moving image in the object display prohibition period 81. Specifically, when a display request is made for an effect object or a normal object among the gift objects in the object display prohibition period 81, the effect object or the normal object for which this display is requested is being delivered in the object display prohibition period 81. Is not displayed in the moving image, but is displayed in the moving image after the object display prohibition period 81 has elapsed (that is, after the time t4). Further, when a decoration object is selected from the candidate list in the object display prohibition period 81, the selected decoration object is not displayed in the video being distributed in the object display prohibition period 81, and the object display prohibition period 81 is displayed. It will be displayed in the video at the time after the lapse of. The display request for the decorative object may be accepted within the object display prohibition period 81. That is, when a display request for a decorative object is made during the object display prohibition period 81, the decorative object for which the display request is made may be added to the candidate list even within the object display prohibition period 81.

According to the above embodiment, the gift object includes three types of a decoration object, a normal object, and an effect object. Of these, only the decorative object is displayed in association with the character object. In a moving image in which an animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of the viewing user. For example, in the moving images shown in FIGS. 5 to 7, it is considered that the character object 71A and the character object 71B attract attention. In the above embodiment, even if there is a display request for the decoration object displayed in association with the character object 71A and the character object 71B, the decoration object is displayed in the moving image until the decoration object is selected from the candidate list 23d. By not doing so, it is possible to prevent the decorative object from being cluttered around the character object or overlapping the character object. As a result, deterioration of the viewing experience of the viewing user can be prevented.

In the conventional video distribution system, regardless of the type of gift object, the gift object is displayed on the video in response to a request for display on the video. Therefore, if the duplicate display of the gift object in the moving image is allowed, a large number of gift objects are displayed in the moving image, and the viewing experience of the user who watches the moving image is deteriorated. In the above embodiment, by providing the gift object with the category of the decoration object displayed in association with the character object, the number of display (display amount) of the decoration object displayed in association with the character object which is the main part of the moving image. Can be suppressed.

The normal object 74 among the gift objects is displayed in the moving image in response to a display request from the viewing user. In the above embodiment, the normal object 74 is displayed on the moving image display screen 70 so as not to come into contact with or overlap with the character object 71A and the character object 71B, so that the character object 71A and the character object 71B can be visually recognized. The effect on sex is small. According to such an aspect, it is possible to prevent deterioration of the viewing experience of the user due to deterioration of the visibility of the character object.

Among the gift objects, the effect object 73 and the normal object 74 are displayed in the moving image in response to a display request from the viewing user. In the above embodiment, since the effect object 73 and the normal object 74 are displayed on the display screen 70 for a shorter time than the decorative object 75, the influence on the visibility of the character object 71A and the character object 71B is small. According to such an aspect, it is possible to prevent deterioration of the viewing experience of the user due to deterioration of the visibility of the character object.

In the above embodiment, the decoration object is selected from the candidate list 23d by a person who is not the viewing user who requested the display of the decoration object (for example, supporter B1, supporter B2, actor A1, or actor A2). , It is possible to suppress the number of decorative objects displayed.

According to the above embodiment, the gift object is not displayed in the moving image during the object display prohibition period 81. As a result, the created video can be viewed without being disturbed by the gift object. For example, by setting the time zone during which the actors A1 and A2 perform visually in the moving image to the object display prohibition period 81, the performance by the actors can be shown to the viewer without being hindered by the first object and the decorative object. Can be done.

According to the above embodiment, it is considered that the viewing user who watches the moving image including the character object such as the character object 71A and the character object 71B is attached to the character object. Therefore, the satisfaction level is increased by having the character object attached to the decoration object rather than the effect object or the normal object. In this way, the decorative object to which the character object can be attached can provide the user with an incentive to repeatedly watch the moving image including the character object.

In the moving image distribution system 1 according to the above embodiment, the user can give a decorative object to the character. As a result, it is possible to provide a system having a high degree of originality as compared with a system in which such a decorative object cannot be given, and it is possible to provide a service having a high degree of originality by the system. As a result, more users can be attracted to the video distribution system 1, so that the number of times the video is viewed on the video distribution system 1 can be increased.

The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist thereof. For example, the delivered moving image may be shot and generated in a place other than the studio room R. For example, the shooting for generating the delivered video may be performed at the home of the actor or supporter.

In the processing procedure described in the present specification, particularly the processing procedure described using the flow chart, a part of the steps (steps) constituting the processing procedure is omitted, as a step constituting the processing procedure. It is possible to add steps that are not specified and / or to change the order of the steps, and the processing procedure in which such omissions, additions, and changes in order are made does not deviate from the gist of the present invention. It is included in the scope of the invention.

The inventions described in the claims at the time of filing the original application of the present application are added below.
[1]
A video distribution system that distributes videos that include animations of character objects generated based on the movements of actors.
Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
When the decoration object for which the first display request is made is selected by the viewing user who views the moving image, the decoration is associated with the part of the character object determined based on the mounting position information set in the decoration object. Display the object in the video,
Video distribution system.
[2]
The selection of the decorative object is made by a person other than the viewing user.
The video distribution system described in [1].
[3]
The selection of the decorative object is made by a supporter who supports the distribution of the video.
The video distribution system according to [1] or [2].
[4]
The selection of the decorative object is made by the actor.
The video distribution system according to [1] or [2].
[5]
In response to the reception of the second display request requesting the display of the first object different from the decoration object from the viewing user who views the moving image, the one or more computer processors respond to the first object in the moving image. To display,
The video distribution system according to any one of [1] to [4].
[6]
The first object is displayed in the moving image so as not to come into contact with the character object.
The video distribution system described in [5].
[7]
The second display request includes a display position specification parameter that specifies the display position of the first object.
The first object is displayed at a position specified by the display position designation parameter in the moving image.
The video distribution system according to [5] or [6].
[8]
The second display request includes a movement direction parameter that specifies the movement direction of the first object.
The first object is displayed in the moving image so as to move in the direction specified by the moving direction parameter.
The video distribution system according to any one of [5] to [7].
[9]
The second display request includes a trajectory parameter that specifies the trajectory of the first object.
The first object is displayed in the moving image to move on the orbit specified by the orbit parameter.
The video distribution system according to any one of [5] to [8].
[10]
An object display prohibition period is set within the distribution period of the video, and the object display prohibition period is set.
The first object and the decorative object are displayed on the moving image at a timing other than the object display prohibition period during the distribution period of the moving image.
The video distribution system according to any one of [5] to [9].
[11]
When the second display request is received during the object display prohibition period, the first object is displayed in the moving image after the object display prohibition period has elapsed.
The video distribution system according to [10].
[12]
The one or more computer processors
Accepting a purchase request to purchase the decorative object from the viewing user,
Settlement is processed according to the purchase request,
If the decorative object is not selected by the end of the video distribution, the payment process is cancelled.
The video distribution system according to any one of [1] to [10].
[13]
The one or more computer processors
Accepting a purchase request to purchase the decorative object from the viewing user,
Settlement is processed according to the purchase request,
If the decorative object is not selected by the end of the video distribution, points are awarded to the viewing user.
The video distribution system according to any one of [1] to [10].
[14]
The one or more computer processors
Accepting a purchase request to purchase the decorative object from the viewing user,
In response to the purchase request, the decoration object is added to the possession list, which is a list of objects possessed by the viewing user.
In response to receiving the first display request requesting the display of the decoration object from the viewing user, the decoration object is deleted from the possession list.
If the decoration object is not selected by the end of distribution of the video, the decoration object is added to the possession list.
The video distribution system according to any one of [1] to [10].
[15]
The one or more computer processors provide the viewing user with purchase information for purchasing a gift object that can be purchased in connection with the video.
The gift object includes the decorative object.
The gift object includes a unique gift object that can be purchased only in the video and a common gift object that can be purchased in videos other than the video.
The video distribution system according to any one of [1] to [14].
[16]
A video distribution method that distributes a video containing an animation of a character object generated based on the movement of an actor by executing a computer-readable instruction by one or more computer processors.
A process of receiving a first display request for requesting the display of a decorative object from a viewing user who views the moving image,
When the decoration object is selected, a step of displaying the decoration object in the moving image in association with a part of the character object determined based on the mounting position information set in the decoration object.
Video distribution method with.
[17]
A video distribution program that distributes videos that include animations of character objects generated based on the movements of actors.
For one or more computer processors
A process of receiving a first display request for requesting the display of a decorative object from a viewing user who views the moving image,
When the decoration object is selected, a step of displaying the decoration object in the moving image in association with a part of the character object determined based on the mounting position information set in the decoration object.
A video distribution program that executes.

1 Video distribution system

Claims (6)

A video distribution system that distributes videos that include animations of character objects generated based on the movements of actors.
Equipped with one or more computer processors
The one or more computer processors
The video is delivered to the client device of the viewing user, and the video is delivered to the client device of the viewing user.
A display request for displaying a decorative object on the video from the viewing user during distribution of the video, which includes identification information for identifying the viewing user, is received.
The number of times the viewing user has viewed a moving image including the animation of the character object of the actor, the number of times the viewing user has viewed the object information about the decoration object that has received the display request, and the number of times the viewing user has purchased the decoration object on the display device visible to the actor. , And viewing user information indicating at least one of the purchase amounts of the decorative object, is displayed during the distribution of the moving image.
Video distribution system. The computer processor causes the decorative object to be displayed on the moving image when the decorative object is selected by a supporter or an actor who supports the distribution of the moving image during the distribution of the moving image.
The video distribution system according to claim 1. The decorative object is displayed on the display device as selectable by the actor.
The video distribution system according to claim 1 or 2. The mounting position information is set in the decorative object, and the mounting position information is set.
The decorative object is displayed in the moving image in association with a part of the character object determined based on the mounting position information.
The video distribution system according to any one of claims 1 to 3. A video distribution method that distributes a video containing an animation of a character object generated based on the movement of an actor by executing a computer-readable instruction by one or more computer processors.
The process of delivering the video to the client device of the viewing user,
A process of receiving a display request for displaying a decorative object on the moving image from the viewing user during distribution of the moving image and including a display request including identification information for identifying the viewing user.
The number of times the viewing user has viewed a moving image including the animation of the character object of the actor, the number of times the viewing user has viewed the object information regarding the decoration object that has received the display request, and the number of times the viewing user has purchased the decoration object on the display device visible to the actor. , And the process of displaying viewing user information indicating at least one of the purchase amounts of the decorative object.
Video distribution method with. A video distribution program that distributes videos that include animations of character objects generated based on the movements of actors.
For one or more computer processors
The process of delivering the video to the client device of the viewing user,
A process of receiving a display request for displaying a decorative object on the moving image from the viewing user during distribution of the moving image and including a display request including identification information for identifying the viewing user.
The number of times the viewing user has viewed a moving image including the animation of the character object of the actor, the number of times the viewing user has viewed the object information regarding the decoration object that has received the display request, and the number of times the viewing user has purchased the decoration object on the display device visible to the actor. , And the process of displaying viewing user information indicating at least one of the purchase amounts of the decorative object.
A video distribution program that executes.

Images