KR20240149763A - System for providing service for generating 3d character sample for one source multi use - Google Patents

Abstract

The present invention relates to a system for providing a 3D character sample generation service for OSMU (One Source Multi Use). The problem to be solved is to use a character design program of a metaverse platform to generate a 2D character into a 3D character at once and to provide a 3D character sample and a preliminary simulation of the 3D character sample, thereby reducing unnecessary time and cost required for 3D character modeling in the past, and to enable a quick judgment on whether to proceed with a character business linked to OSMU (One Source Multi Use) after the fact, and to maximize the efficiency of investment in, production consultation on, and the like for character-linked businesses.
For example, the present invention discloses a 3D character sample generation service providing system, which includes a 2D image data acquisition unit that acquires 2D image data including a character object; a 3D character data generation unit that performs 3D modeling work on the character object included in the 2D image data through a character design program of a metaverse platform to create a 3D character model, and sets motions to the created 3D character model to create 3D character data capable of demonstrating motions; and a 3D character simulation performance unit that performs a simulation on the 3D character data.

Description

{SYSTEM FOR PROVIDING SERVICE FOR GENERATING 3D CHARACTER SAMPLE FOR ONE SOURCE MULTI USE}

An embodiment of the present invention relates to a system for providing a three-dimensional character sample generation service for OSMU (One Source Multi Use).

Typically, when creating a 3D character, you need to go through 3D modeling work, which involves adding three-dimensional graphic elements based on a 2D designed character image.

To elaborate on the workflow for this, there are typically two types of workflows.

The first method is to create a two-dimensional character image through an analog sketch of the worker, then create a two-dimensional character design through a digital program, and then complete a three-dimensional character model by converting the two-dimensional character created in this way into three-dimensional digital data.

The second method is to design the character directly using a 2D digital program and then create a 3D character model through a 3D digital conversion process.

However, the conventional method for creating 3D characters has the disadvantage that, in the process of 3Dizing a 2D character design, a new creation (ex. 3D avatar) is created with a three-dimensional effect (three-dimensional shape) that is essentially different from the characteristics of a 2D character. This process takes 2 to 3 months and incurs considerable costs (ex. professional labor costs, etc.).

In particular, despite these time and cost disadvantages, there is a risk that the appearance of the completed 3D character cannot be confirmed until the production work is completed.

When conducting a character business linked to OSMU (One Source Multi Use), the above production time and cost cannot help but act as inefficient factors. In particular, if the business is not conducted after the character production process, time and cost may be wasted.

Publication date of patent publication No. 10-2023-0060432 (publication date: May 4, 2023) Patent Registration No. 10-2498056 (Registration Date: February 6, 2023) Patent Registration No. 10-1165017 (Registration Date: July 5, 2012)

An embodiment of the present invention provides a 3D character sample creation service system for OSMU that can maximize the efficiency of investment in, production consultation on, and other aspects of character-linked businesses by reducing unnecessary time and cost required for 3D character modeling in the past by utilizing a character design program of a metaverse platform to create a 2D character as a 3D character at once and providing a 3D character sample and a preliminary simulation of the 3D character sample, and enabling a quick judgment on whether to proceed with a character business linked to OSMU (One Source Multi Use).

A system for providing a 3D character sample generation service for OSMU (One Source Multi Use) according to an embodiment of the present invention includes: a 2D image data acquisition unit for acquiring 2D image data including a character object; a 3D character data generation unit for performing 3D modeling work on the character object included in the 2D image data through a character design program of a metaverse platform to generate a 3D character model, and setting motions for the generated 3D character model to generate 3D character data capable of demonstrating motions; and a 3D character simulation performance unit for performing a simulation on the 3D character data.

In addition, the two-dimensional image data acquisition unit may include a shooting image data acquisition unit that acquires image data captured by a camera as the two-dimensional image data when the person object is a real person; and a graphic image data acquisition unit that receives graphic image data having a two-dimensional character image designed for a virtual person and acquires the graphic image data as the two-dimensional image data when the person object is a virtual person.

In addition, the three-dimensional character data generation unit may include an image preprocessing unit that performs image preprocessing to extract only a face portion of a character object included in the two-dimensional image data; a feature point detection unit that detects feature points for a face portion of a character object on which image preprocessing has been performed; a three-dimensional character face generation unit that performs three-dimensional modeling work and retouching work based on the feature points extracted by the feature point extraction unit to generate a three-dimensional character face; a three-dimensional character body setting unit that sets a three-dimensional body type to be applied to the three-dimensional character; a three-dimensional character clothing setting unit that sets a clothing type for a three-dimensional character model that combines the three-dimensional character face and the three-dimensional body; a three-dimensional character camera shot setting unit that sets a camera shot for the three-dimensional character model on which the clothing has been set; and a three-dimensional character motion setting unit that selects at least one motion concept from among a plurality of motion concepts prepared in advance and applies motion data according to the selected motion concept to the three-dimensional character model on which the camera shot has been set, thereby completing the three-dimensional character data capable of demonstrating motions.

In addition, the 3D character simulation performing unit may include a virtual space simulation performing unit that performs a simulation in which a 3D character model included in the 3D character data demonstrates preset movements in a virtual space; and an augmented reality simulation performing unit that performs a simulation in which a 3D character model included in the 3D character data is superimposed on a physical object in a captured screen displayed through a camera and demonstrates preset movements.

In addition, the augmented reality simulation performing unit comprises: a physical object recognition unit that recognizes a physical object including goods and books having a predefined shape within an image captured by a camera; an augmented reality execution unit that simulates a three-dimensional character model by overlapping the area of the recognized physical object when the predefined physical object is recognized through the physical object recognition unit; an augmented reality playback control unit that provides a playback control interface for performing a playback position adjustment, playback stop, and playback position movement at a preset time unit in a playback stop state for a virtual image in which the three-dimensional character model is simulated; an augmented reality viewer control unit that provides a viewer control interface for performing a rotation viewer function of the three-dimensional character model; And the three-dimensional character model may be simulated in a virtual image, and a capture execution interface may be provided that is activated in a playback stop state through the augmented reality playback control unit, and when capture is executed through the capture execution interface, the physical object recognized through the physical object recognition unit and the three-dimensional character model whose playback has been stopped through the augmented reality playback control unit may be extracted and synthesized, respectively, to provide composite image data in which the three-dimensional character model taking a specific pose on the physical object is applied.

According to the present invention, by utilizing a character design program of a metaverse platform to create a 2D character as a 3D character at once and providing a 3D character sample and a preliminary simulation of the 3D character sample, unnecessary time and cost required for 3D character modeling in the past are reduced, and not only is it possible to quickly determine whether to proceed with a character business linked to OSMU (One Source Multi Use) after the fact, but also to provide a 3D character sample creation service system for OSMU that can maximize the efficiency of investment, production consultation, etc. for a character-linked business.

FIG. 1 is a block diagram showing the overall configuration of a three-dimensional character sample generation service providing system for OSMU according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the configuration of a two-dimensional image data acquisition unit according to an embodiment of the present invention.
FIG. 3 is a drawing illustrating an example of two-dimensional image data that can be acquired through a two-dimensional image data acquisition unit according to an embodiment of the present invention.
Figure 4 is a block diagram showing the configuration of a three-dimensional image character generation unit according to an embodiment of the present invention.
FIG. 5 is a drawing illustrating a process for creating a three-dimensional character model through a three-dimensional image character creation unit according to an embodiment of the present invention.
FIGS. 6 and 7 are drawings showing examples of three-dimensional character models generated according to embodiments of the present invention.
Figure 8 is a block diagram showing the configuration of a three-dimensional character simulation performing unit according to an embodiment of the present invention.
Figure 9 is a block diagram showing the configuration of an augmented reality simulation performing unit according to an embodiment of the present invention.
FIGS. 10 and 11 are exemplary drawings illustrating the augmented reality method and the playback and capture functions of a three-dimensional character model simulated through an augmented reality simulation performing unit according to an embodiment of the present invention.

The terms used in this specification will be briefly explained, and the present invention will be described in detail.

The terms used in the present invention are selected from the most widely used general terms possible while considering the functions of the present invention, but they may vary depending on the intention of engineers working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meanings thereof will be described in detail in the description of the relevant invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the overall contents of the present invention, rather than simply the names of the terms.

When a part of the specification is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise specifically stated. In addition, terms such as "part", "module", etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software, or a combination of hardware and software.

Hereinafter, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily practice the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are assigned similar drawing reference numerals throughout the specification.

FIG. 1 is a block diagram showing the entire configuration of a three-dimensional character sample generation service providing system for OSMU according to an embodiment of the present invention, FIG. 2 is a block diagram showing the configuration of a two-dimensional image data acquisition unit according to an embodiment of the present invention, FIG. 3 is a diagram showing an example of two-dimensional image data that can be acquired through a two-dimensional image data acquisition unit according to an embodiment of the present invention, FIG. 4 is a block diagram showing the configuration of a three-dimensional image character generation unit according to an embodiment of the present invention, FIG. 5 is a diagram showing a process of generating a three-dimensional character model through a three-dimensional image character generation unit according to an embodiment of the present invention, FIGS. 6 and 7 are diagrams showing examples of three-dimensional character models generated according to an embodiment of the present invention, FIG. 8 is a block diagram showing the configuration of a three-dimensional character simulation performing unit according to an embodiment of the present invention, FIG. 9 is a block diagram showing the configuration of an augmented reality simulation performing unit according to an embodiment of the present invention, and FIGS. 10 and 11 are diagrams showing an augmented reality method and a reproduction and capture function of a three-dimensional character model simulated through an augmented reality simulation performing unit according to an embodiment of the present invention.

Referring to FIG. 1, a 3D character sample generation service providing system (1000) for OSMU according to an embodiment of the present invention may include at least one of a 2D image data acquisition unit (100), a 3D character data generation unit (200), and a 3D character simulation performance unit (300).

Here, OSMU is one of the strategies of the cultural industry that maximizes the value of content by transforming and selling a single content in various ways such as movies, animations, character products, records, and goods. In this example, prior to proceeding with the business, data is generated and provided that enables preliminary simulation of 3D characters with only simple information such as photos, images, and concepts as well as stories and topics, thereby reducing time waste and cost burden that may occur up to the investment and production consultation processes, thereby increasing the efficiency of business progress.

The above two-dimensional image data acquisition unit (100) can acquire two-dimensional image data including various human objects. In this embodiment, human objects can include real people, virtual people, personified animal characters, personified object characters, etc., and a more detailed description thereof will be provided later.

To this end, the two-dimensional image data acquisition unit (100) may include at least one of a photographed image data acquisition unit (110) and a graphic image data acquisition unit (120), as illustrated in FIG. 2.

The above-mentioned video data acquisition unit (110) can acquire video data captured by a camera as two-dimensional image data when the person object is a real person.

For example, when selecting a character for an OSMU (One Source Multi Use) project and using real people such as celebrities, influencers, and politicians as the target, a picture of the person can be taken using a camera to obtain image data (2D image data).

The above graphic image data acquisition unit (120) can receive graphic image data having a two-dimensional character image designed for a virtual person when the character object is a virtual person and acquire it as two-dimensional image data.

For example, in selecting characters for an OSMU (One Source Multi Use) project, if the target is character images related to virtual people, anthropomorphic animal characters, anthropomorphic object characters, etc., scan files or image files of the designed 2D character images are provided, and graphic image data (2D image data) can be obtained through digital image conversion of the provided files.

In this way, the two-dimensional image data acquisition unit (100) can secure information about a two-dimensional character by acquiring two-dimensional image data in the form of image data and/or graphic image data.

The above 3D character data generation unit (200) can generate a 3D character model by performing 3D modeling work on a character object included in 2D image data through a character design program of a metaverse platform, and can create 3D character data capable of demonstrating movement by setting movement to the generated 3D character model.

In the case of a character design program according to this embodiment, a 3D character can be easily and quickly created in a single operation by utilizing a program that creates a 3D avatar used in a metaverse platform called 'Zepeto', for example.

This 3D character data generation unit (200) may include at least one of an image preprocessing unit (210), a feature point detection unit (220), a 3D character face generation unit (230), a 3D character body setting unit (240), a 3D character clothing setting unit (250), a 3D character camera shot setting unit (260), and a 3D character movement setting unit (270), as illustrated in FIG. 4.

The above image preprocessing unit (210) can perform preprocessing work on facial image data.

For example, you can extract only the desired face part from the entire 2D image data or perform pre-correction work on the brightness, color, etc. of the photo.

In addition, after extracting only the face part of the character object, an image tilting operation can be performed further so that accurate facial feature points can be extracted. The image tilting operation rotates the face part of the photo on a two-dimensional plane so that elements that make up the face, such as the eyes, nose, mouth, eyebrows, and ears, do not tilt on the two-dimensional plane, which can help extract facial feature points more accurately.

The above feature point detection unit (220) can detect feature points based on deep learning technology for the face portion of a human object for which image preprocessing has been performed.

To explain more specifically, it has a learning module to recognize the eyes, nose, mouth, chin, etc. of the face based on deep learning learning, and can extract facial feature information using a machine learning module. By detecting facial data with a pre-built deep learning learning model, the accuracy of the deep learning model applied to a new image can be cross-validated, and the main features of the detected facial features can be derived.

This facial feature extraction process first performs a preprocessing process, and then each of the following facial detection algorithms can be applied to extract feature points from candidate object information extracted in the labeling operation.

Eye feature detection can detect whether there is a symmetrical object among the objects above the horizontal center line and to the left of the vertical center line using vertical and horizontal coordinates for the facial objects extracted after performing the labeling operation. If there are two or more symmetrical objects, the symmetrical pair located below the symmetrical objects and below the threshold value can be extracted as the eye feature area.

In addition, nose feature detection can extract objects that exist between the eyes and both eyes among the labeled computed objects after detecting eye features, and whose vertical coordinate difference is less than a threshold value as the nose region.

And, among the objects that have been labeled after the extraction of nose features, the mouth feature extraction can extract objects that are located below the nose area and within the outer endpoints of the two eye coordinates as the mouth area.

In addition, in order to classify facial feature information in detail, the shape and length information of face shape, eye size, eye tail height, eyebrow shape, eyebrow length, eyebrow tail height, forehead height, forehead width, nose length, nostril size, lip thickness, mouth size, lip tail height, infatuation (distance between eyes and eyebrows), philtrum (distance between nose and upper lip), and glabella (distance between eyebrows) can be extracted and used for detailed classification.

The above 3D character face generation unit (230) can generate a 3D character face by performing 3D modeling work and retouching work based on the feature points extracted by the feature point extraction unit (220).

As described above, by generating a 3D character face (avatar face) based on facial contour information and facial feature point information, a 3D mesh resembling the object can be generated by performing a 3D modeling task based on feature point information extracted from the face portion of a character object included in the input 2D image data.

The above 3D character face generation unit (230) can substitute the main features (feature-points) of the face detected from the input image data into the symmetrical points (match-points) of the 3D face mesh prepared in the library if it is determined that the accuracy of the deep learning learning model has been minimized even when applied to a new image.

The library according to this embodiment stores various types of 3D facial graphic data according to the concept of the initially input and recognized 2D character and/or the final 3D character to be implemented, and the simple story for character creation, the theme, the character style, and other meta-information, so that a draft of a 3D character face can be created quickly, accurately, and easily by reflecting the extracted 3D feature information.

Meanwhile, the 3D character face generation unit (230) enables retouching work on a 3D modeled character face, thereby enabling more accurate and detailed implementation of the features of the original 2D character face.

The above 3D character body setting unit (240) can set a 3D body type to be applied to a 3D character.

For example, as shown in FIG. 5, you can select one of body type 1 (slim style), body type 2 (chubby style), and body type 3 (fat style), and you can select a detailed type for each body type. That is, among the slim styles, you can select one of the long arm or leg types, short types, and thick types. In this way, you can quickly create a three-dimensional body shape close to a two-dimensional character's body by selecting and setting various detailed three-dimensional body types prepared in the library.

The 3D body type setting according to the present embodiment is to select an avatar body type to be applied to a 3D character face. In the present embodiment, the purpose is to provide a rough 3D character sample or draft and a preliminary simulation thereof for a 2D character rather than to derive a final result for a 3D character model. To achieve this purpose, the body of the 3D character can be produced by selecting various body types stored in a library.

The above 3D character costume setting unit (250) can set a costume type for a 3D character model that combines a 3D character face and a 3D body.

In this embodiment, the 3D character costume can be implemented in the fashion style shown in the 2D character image, but can be changed in various ways during the process of creating the 3D character model to reflect the concept or other elements of the final result.

For example, as shown in Fig. 5, after selecting a desired costume type from among various costumes such as costume type 1 (copyright-free famous brand costume), costume type 2 (copyright-free metaverse character costume), and costume type 3 (costume designed by the creator), one can select various pre-prepared costume designs from among the selected costume types to finally apply the costume to the 3D character model.

The above 3D character camera shot setting unit (260) can set a camera shot for a 3D character model with set clothing.

For example, as shown in FIG. 5, at least one shot type can be selected from among camera shots of the upper body, knees, and full body, but this is only an example, and can be categorized and selected in various ways according to field size, camera level, camera view angle, and movement.

The above 3D character motion setting unit (270) can select at least one motion concept from among a plurality of motion concepts prepared in advance and apply motion data according to the selected motion concept to a 3D character model with a camera shot set to complete 3D character data capable of demonstrating motion.

For example, as shown in FIG. 5, at least one of the movement concepts such as dance, performance, and comic can be selected, but this is only an example, and it is possible to select a movement concept including various keywords and corresponding motion data such as challenge, daily life, lovely, party, stylish, friendship shot, emotional, comfortable, cute, and active.

Meanwhile, the motion concept according to the present embodiment can be applied not only to the concept of a 3D character model moving in a specific motion over time, but also to the concept of a motion taking a specific pose, and accordingly, separate pose selection is also possible.

The face, body, and clothing of the 3D character described above can all be customized by the artist through retouching.

The above 3D character simulation performing unit (300) can perform a simulation on 3D character data.

This 3D character simulation performing unit (300) may include at least one of a virtual space simulation performing unit (310) and an augmented reality simulation performing unit (320), as illustrated in FIG. 8.

The above virtual space simulation execution unit (310) can perform a simulation in which a 3D character model included in the 3D character data demonstrates preset movements within a virtual space.

For example, as illustrated in Fig. 6, a simulation can be performed in which a 3D character model demonstrates the motion (movement) set as described above in a pre-prepared virtual space.

Additionally, as illustrated in Fig. 7, a simulation may be performed that provides a result in the form of two or more 3D character models taking a specific pose in a pre-prepared virtual space.

The above augmented reality simulation execution unit (320) can perform an augmented reality-based simulation in which a 3D character model included in the 3D character data is superimposed on a physical object in a captured screen displayed through a camera and demonstrates a preset movement.

As shown in FIG. 9, this augmented reality simulation execution unit (320) may include at least one of a physical object recognition unit (321), an augmented reality execution unit (322), an augmented reality playback control unit (323), an augmented reality viewer control unit (324), and an augmented reality capture execution unit (325).

In this embodiment, for OSMU (One Source Multi Use) that conducts various types of business using a single material called a 3D character model, it is necessary to check a rough image of the 3D character applied to a real product, and the augmented reality simulation execution unit (320) is configured to support this.

The above physical object recognition unit (321) can recognize physical objects including goods and books with predefined shapes in an image captured by a camera.

More specifically, it can be used to recognize various goods whose shapes are predefined, such as T-shirts, pants, shoes, cups, and candles, in a non-marker recognition method within a camera image, and it can also recognize books, which are products (or physical objects) with different characteristics from goods.

The above augmented reality execution unit (322) enables augmented reality-based simulation by overlapping a 3D character model generated through the 3D character data generation unit (200) on the area of the corresponding physical object when a predefined physical object (goods, books, etc.) is recognized through the physical object recognition unit (321).

For example, as illustrated in FIG. 10, when a clothing (T-shirt) is recognized among physical objects whose shapes are predefined according to an embodiment viewed through a camera shooting screen, a virtual image of a pre-made 3D character model is output on the shooting screen in an augmented reality manner within the area of the clothing (T-shirt), and a simulation can be performed in which the output 3D character model demonstrates a pre-set motion (movement).

The above augmented reality playback control unit (323) can provide a playback control interface (323a) for performing playback position adjustment, playback stop, and playback position movement in preset time units in a playback stop state for a virtual image in which a 3D character model is simulated.

The above playback control interface (323a) may be provided in a form including a playback slider and a playback control virtual button as illustrated in FIG. 11, and when a playback operation command for moving the virtual button horizontally is input, a virtual image corresponding to the point where the virtual button is located may be played (simulated). In addition, when a playback stop command, such as touching the virtual button more than twice or selecting a separate stop button, is input, the simulation for the motion demonstration may be stopped with the motion of the 3D character model temporarily stopped. Also, when the simulation is stopped and you touch the right screen more than twice based on the vertical center line of the screen, the playback position moves forward in units of n seconds (n seconds can be set to various values such as 0.5 seconds, 1 second, 3 seconds, 5 seconds, or 10 seconds), but the screen may not play after moving and may be displayed as stopped at that time. When you touch the left screen more than twice based on the vertical screen, the playback position may move backward in units of n seconds (n seconds can be set to various values such as 0.5 seconds, 1 second, 3 seconds, 5 seconds, or 10 seconds).

Meanwhile, instead of the 3D character model being output as one on the screen, if a specific pattern is to be formed, it may be output as multiple pieces with a certain arrangement pattern (grid pattern, line pattern, circular pattern, etc.).

The above augmented reality viewer control unit (324) can provide a viewer control interface (324a) for performing a rotation viewer function of a 3D character model as illustrated in FIG. 11.

The above viewer control interface (324a) can rotate a three-dimensional character model in the up, down, left, and right directions when the simulation is stopped, and the viewing position of the three-dimensional character model can change according to the rotation, so that the viewer angle can be varied and finely adjusted for the three-dimensional character model.

The above augmented reality capture execution unit (325) performs a capture function for a virtual image in which a 3D character model is simulated, as illustrated in FIG. 11, and provides a capture execution interface (325a) that is activated in a playback stop state through the augmented reality playback control unit (323), and when the capture is executed, a physical object recognized through the physical object recognition unit (321) and a 3D character model whose playback is stopped through the augmented reality playback control unit (323) are respectively extracted and synthesized to provide a synthesized image data in which a 3D character model that assumes a specific pose on a physical object is applied.

More specifically, the capture execution interface (325a) is activated when the playback of the 3D character model is stopped via the playback control interface (323a) and displayed (output) on the playback control virtual button of the playback control interface (323a). When the button is selected (touched), the capture function is executed to extract the physical object in the shooting video screen, i.e., the T-shirt image, and extract the simulated 3D character model, i.e., the 3D character data, and then synthesize the extracted image.

At this time, the 3D character model is in a specific pose due to playback stop and is rotated at a specific angle through viewer rotation to ensure the most natural appearance possible when the 3D character is applied to the T-shirt.

The above explains the application to T-shirts (clothing), but it can be applied in various ways, such as characters for various goods, book covers, illustrations, etc., and it allows you to virtually preview the results to be applied.

According to this embodiment, by utilizing character design programs of various metaverse platforms, such as 'Zepeto', 2D characters can be created as 3D characters at once, and based on this, 3D character samples and preliminary simulations of 3D character samples can be provided, so that not only can unnecessary time and cost required for 3D character modeling in the past be reduced, but also it is expected that the efficiency of investment in character-linked businesses, production consultations, etc. can be maximized by enabling a quick judgment on whether to proceed with a character business linked to OSMU (One Source Multi Use).

The above is only one embodiment for implementing a three-dimensional character sample generation service providing system for OSMU (One Source Multi Use) according to the present invention, and the present invention is not limited to the above embodiment, and as claimed in the following claims, it will be understood that the technical spirit of the present invention encompasses a range in which various modifications can be implemented without departing from the gist of the present invention.

1000: 3D Character Sample Generation Service Provider System for OSMU
100: 2D image data acquisition unit
110: Video data acquisition unit
120: Graphic image data acquisition section
200: 3D character data generation section
210: Image preprocessing unit
220: Feature point detection unit
230: 3D character face generation section
240: 3D character body setting section
250: 3D character costume setting section
260: 3D Character Camera Shot Setting
270: 3D character movement setting section
300: 3D Character Simulation Unit
310: Virtual space simulation execution department
320: Augmented Reality Simulation Performance Department
321: Physical Object Recognition Unit
322: Augmented Reality Execution Unit
323: Augmented Reality Playback Control Unit
323a: Playback Control Interface
324: Augmented Reality Viewer Control Unit
324a: Viewer Control Interface
325: Augmented Reality Capture Execution Unit
325a: Capture execution interface

Claims (4)

A two-dimensional image data acquisition unit that acquires two-dimensional image data including a character object;
A 3D character data generation unit that performs 3D modeling work on a character object included in the above 2D image data through a character design program of a metaverse platform to create a 3D character model, and sets movements to the created 3D character model to create 3D character data capable of demonstrating movements; and
A system for providing a 3D character sample generation service for OSMU (One Source Multi Use), characterized by including a 3D character simulation performing unit that performs a simulation on the above 3D character data.
In the first paragraph,
The above two-dimensional image data acquisition unit is,
When the person object is a real person, a shooting image data acquisition unit that acquires the image data captured by the camera as the two-dimensional image data; and
A system for providing a 3D character sample generation service for OSMU (One Source Multi Use), characterized in that it includes a graphic image data acquisition unit that receives graphic image data having a 2D character image designed for a virtual character when the character object is a virtual character and acquires the graphic image data as the 2D image data.
In the first paragraph,
The above 3D character data generation unit,
An image preprocessing unit that performs image preprocessing to extract only the face portion of a person object included in the above two-dimensional image data;
A feature point detection unit that detects feature points on the face of a human object for which image preprocessing has been performed;
A 3D character face generation unit that generates a 3D character face by performing 3D modeling work and retouching work based on the feature points extracted from the above feature point extraction unit;
3D character body setting section that sets the 3D body type to be applied to the 3D character;
A 3D character costume setting unit that sets a costume type for a 3D character model that combines the 3D character face and the 3D body;
A 3D character camera shot setting unit for setting a camera shot for a 3D character model with a set costume; and
A system for providing a 3D character sample generation service for OSMU (One Source Multi Use), characterized by including a 3D character motion setting unit for selecting at least one motion concept from a plurality of pre-prepared motion concepts and applying motion data according to the selected motion concept to a 3D character model with a camera shot set to complete the 3D character data capable of demonstrating motions.
In the first paragraph,
The above 3D character simulation execution unit is,
A virtual space simulation execution unit that performs a simulation in which a 3D character model included in the 3D character data demonstrates preset movements within a virtual space; and
A system for providing a 3D character sample generation service for OSMU (One Source Multi Use), characterized by including an augmented reality simulation performing unit that performs a simulation in which a 3D character model included in the 3D character data is superimposed on a physical object in a shooting screen displayed through a camera and demonstrates a preset movement.