TW202221652A - Method, device, computer equipment and storage medium for reconstruction of human face - Google Patents

Abstract

The present disclosure provides a method, device, computer equipment and storage medium for reconstruction of human face, wherein the method comprises: generating a first real face model based on a target image; fitting the first real face model with pre-generated multiple second real face models, to obtain fitting coefficients corresponding to the multiple second real face models respectively; generating a target virtual face model corresponding to the target image, based on the fitting coefficients corresponding to the multiple second real face models respectively, and virtual face models with a predetermined style corresponding to the multiple second real face models respectively.

Description

Method, device, computer equipment and storage medium for reconstructing human face

The present invention relates to the technical field of image processing, and in particular, to a method, device, computer equipment and storage medium for reconstructing a human face.

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application claims the priority of the Chinese patent application filed on November 25, 2020, with the application number of 202011342169.7 and the invention titled "A method, device, computer equipment and storage medium for face reconstruction". manner is incorporated herein.

Usually, a three-dimensional model of a virtual face can be established according to a real face or one's own preferences, so as to realize the reconstruction of the face, which has a wide range of applications in the fields of games, animation, and virtual social interaction. For example, in a game, the player can use the face reconstruction system provided by the game program to generate a virtual face 3D model according to the real face included in the image provided by the player, and use the generated virtual face 3D model to make more substitutions Sense of participation in the game.

At present, when performing face reconstruction based on real faces in portrait images, face contour features are usually extracted based on face images, and then the extracted face contour features are matched with the pre-generated virtual three-dimensional model. However, due to the low matching degree between the face contour features and the pre-generated virtual 3D model, the generated virtual face 3D model and the real face image have a low matching degree. The similarity between them is low.

The embodiments of the present disclosure provide at least a method, an apparatus, a computer device, and a storage medium for reconstructing a human face.

In a first aspect, an embodiment of the present disclosure provides a method for reconstructing a face, including: generating a first real face model based on a target image; performing a fitting process on the face model to obtain fitting coefficients corresponding to a plurality of second real face models respectively; based on the fitting coefficients corresponding to the plurality of second real face models respectively, and The face models respectively correspond to virtual face models with preset styles, and a target virtual face model corresponding to the target image is generated.

In this embodiment, the fitting coefficient is used as a medium to establish a plurality of associations between the second real face models and the first real face The association between the virtual face model and the target virtual face model established based on the first real face model enables the target virtual face model determined based on the fitting coefficient to have both the preset style and the first real face The features of the original face corresponding to the model, the generated target virtual face model, and the original face corresponding to the first real face model have a higher degree of similarity.

In an optional implementation manner, the fitting coefficients corresponding to the plurality of second real face models and the virtual people with preset styles corresponding to the plurality of second real face models respectively. face model, generating a target virtual face model corresponding to the target image, including: based on the fitting coefficients corresponding to the plurality of second real face models respectively, and the corresponding corresponding virtual face models The skeleton data is used to determine the target skeleton data; based on the target skeleton data, the target virtual face model is generated.

In an optional implementation manner, generating the target virtual face model based on the target skeleton data includes: based on the target skeleton data, and standard skeleton data and standard skin data in the standard virtual face model. The standard skin data is subjected to position transformation processing to generate target skin data; based on the target bone data and the target skin data, the target virtual face model is generated.

In this embodiment, the target skin data and the correlation between the standard skeleton data and the standard skin data in the standard virtual face model can be used, so that the obtained target virtual face model can better match the target skeleton data with the standard skin data. The target skin data is fitted, so that in the target virtual face model composed of the target skeleton data, the target virtual face model caused by the change of the skeleton data shows less abnormal convexity or concave.

In an optional implementation manner, the skeleton data corresponding to the virtual face model includes at least one of the following data: skeleton rotation data, skeleton position corresponding to each face skeleton in the multiple face skeletons of the virtual face model; data, and bone scaling data; the target bone data includes at least one of the following data: target bone position data, target bone scaling data, and target bone rotation data.

In this embodiment, the skeleton data can be used to more accurately characterize the skeleton data corresponding to each of the multiple face bones, and the target virtual face model can be more accurately determined by using the target skeleton data.

In an optional embodiment, the determining of the target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively includes: Based on the fitting coefficients corresponding to the plurality of second real face models, interpolation processing is performed on the bone position data corresponding to the plurality of virtual face models to obtain the target bone position data.

In an optional embodiment, the determining of the target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively includes: Based on the fitting coefficients corresponding to the plurality of second real face models, interpolation processing is performed on the skeleton scaling data corresponding to the plurality of virtual face models, to obtain the target skeleton scaling data.

In an optional embodiment, the determining of the target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively includes: Converting the skeleton rotation data corresponding to the plurality of virtual face models respectively into quaternions, and performing regularization processing on the quaternions corresponding to the plurality of virtual face models respectively, to obtain a regularized quaternion; based on The fitting coefficients respectively corresponding to the plurality of second real face models are interpolated for the regularization quaternions corresponding to the plurality of virtual face models respectively, so as to obtain the target bone rotation data.

In this embodiment, the target skeleton data can be used to adjust the virtual face model more accurately, so that the skeleton details in the obtained target virtual face model are more detailed and more similar to the skeleton details of the original face, so that the target The virtual face model has a higher similarity with the original face.

In an optional embodiment, generating the first real face model based on the target image includes: acquiring a target image including an original face; performing a three-dimensional analysis of the original face included in the target image. face reconstruction to obtain the first real face model.

In this embodiment, the face features of the original face in the target image can be more accurately and comprehensively represented by using the first real face model obtained by reconstructing the original face in three dimensions.

In an optional implementation manner, for each second real face model in the plurality of second real face models, the second real face model is generated according to the following manner: obtaining multiple data including the reference face; a reference image; for each reference image in the multiple reference images, perform three-dimensional face reconstruction on the reference face included in the reference image, and obtain the corresponding image of the reference image. Describe the second real face model.

In this embodiment, using a plurality of reference images can cover a wider range of face shape features as much as possible. Therefore, based on each reference image in the plurality of reference images, the second real person is obtained by performing three-dimensional face reconstruction. The face model can also cover a wider range of facial features as far as possible.

In an optional implementation manner, the first real face model is fitted with a plurality of pre-generated second real face models to obtain the fitting corresponding to the plurality of second real face models respectively. The coefficients include: performing least squares processing on a plurality of the second real face models and the first real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively.

In this embodiment, by using the fitting coefficient, the fitting situation when the first real face model is fitted by using a plurality of second real face models can be accurately represented.

In a second aspect, an embodiment of the present disclosure further provides an apparatus for reconstructing a human face, including:

a first generation module for generating a first real face model based on the target image;

a processing module, configured to perform fitting processing on the first real face model by using a plurality of pre-generated second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively;

The second generation module is configured to be based on the fitting coefficients corresponding to the plurality of second real face models and the virtual face models with preset styles corresponding to the plurality of second real face models respectively , and generate a target virtual face model corresponding to the target image.

In an optional embodiment, the second generation module is based on the fitting coefficients corresponding to the plurality of second real face models and the The virtual face model of the preset style, when generating the target virtual face model corresponding to the target image, is used for: based on the fitting coefficients corresponding to the plurality of second real face models respectively, and a plurality of The skeleton data corresponding to the virtual face models are determined to determine the target skeleton data; based on the target skeleton data, the target virtual face model is generated.

In an optional embodiment, when the second generation module generates the target virtual face model based on the target skeleton data, it is used for: based on the target skeleton data and the standard virtual face model. The relationship between the standard bone data and the standard skin data, the standard skin data is subjected to position transformation processing to generate target skin data; based on the target bone data and the target skin data, the target virtual data is generated. face model.

In an optional implementation manner, the skeleton data corresponding to the virtual face model includes at least one of the following data: skeleton rotation data, skeleton position corresponding to each face skeleton in the multiple face skeletons of the virtual face model; data, and bone scaling data; the target bone data includes at least one of the following data: target bone position data, target bone scaling data, and target bone rotation data.

In an optional implementation manner, the second generation module determines based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively. When the target skeleton data is used, it is used to: perform interpolation processing on the skeleton position data corresponding to the plurality of virtual face models based on the fitting coefficients corresponding to the plurality of second real face models respectively, to obtain the target skeleton position data .

In an optional implementation manner, the second generation module determines based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively. When the target skeleton data is used, it is used to: perform interpolation processing on the skeleton scaling data corresponding to the plurality of virtual face models based on the fitting coefficients corresponding to the plurality of second real face models respectively, to obtain the target skeleton scaling data .

In an optional implementation manner, the second generation module determines based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively. When the target skeleton data is used, it is used to: convert the skeleton rotation data corresponding to the plurality of virtual face models respectively into quaternions, and perform regularization processing on the quaternions corresponding to the plurality of virtual face models respectively, obtaining a regularized quaternion; based on the fitting coefficients corresponding to the multiple second real face models respectively, perform interpolation processing on the regularized quaternions corresponding to the multiple virtual face models respectively, to obtain the target bone rotation material.

In an optional embodiment, when generating the first real face model based on the target image, the first generation module is used to: acquire a target image including the original face; The original face is reconstructed in three dimensions to obtain the first real face model.

In an optional embodiment, the processing module generates the second real face model for each second real face model in the plurality of second real face models according to the following manner: obtaining the second real face model includes: multiple reference images of the reference face; for each reference image in the multiple reference images, perform three-dimensional face reconstruction on the reference face included in the reference image to obtain the reference image the corresponding second real face model.

In an optional embodiment, the processing module uses a plurality of pre-generated second real face models to perform fitting processing on the first real face model, and obtains a plurality of second real face models corresponding to When the fitting coefficient is , it is used to: perform least squares processing on a plurality of the second real face models and the first real face models to obtain the corresponding fitting coefficients of the plurality of second real face models respectively. Combined coefficient.

In a third aspect, an optional implementation manner of the present disclosure further provides a computer device, a processor, and a memory, where the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the memory The machine-readable instructions stored in the machine-readable instructions, when the machine-readable instructions are executed by the processor, the machine-readable instructions are executed by the processor to execute the above-mentioned first aspect, or any one of the possible first aspects. steps in the implementation.

In a fourth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program executes the first aspect or any one of the first aspects when the computer program is run. steps in a possible implementation.

For a description of the effects of the above-mentioned apparatus for reconstructing a human face, computer equipment, and a computer-readable storage medium, please refer to the description of the above-mentioned method for reconstructing a human face, which will not be repeated here.

In order to make the above-mentioned objects, features and advantages of the present disclosure more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only These are some, but not all, embodiments of the present disclosure. The elements of the disclosed embodiments generally described and illustrated herein may be arranged and designed in a variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the disclosure as claimed, but is merely representative of selected embodiments of the disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present disclosure.

After research, it is found that the method of face reconstruction can establish a three-dimensional model of virtual face according to the real face or one's own preferences. Among them, when performing face reconstruction based on the real face in the portrait image, the feature extraction of the real face in the portrait image is usually performed first to obtain the face contour features, and then the face contour features are combined with the pre-generated face contour features. The features in the virtual 3D model are matched, and based on the matching results, the facial contour features are fused with the virtual 3D model to obtain a virtual 3D model of the face corresponding to the real face in the portrait image. Since the matching accuracy is low when the face contour features are matched with the features in the pre-generated virtual three-dimensional model, the matching error between the virtual three-dimensional model and the face contour features is relatively large, and it is easy to cause the matching results based on the matching results. The problem of low similarity between the virtual face 3D model obtained by fusing the face contour feature and the face virtual 3D model and the face in the portrait image.

In view of the defects of the above solutions, the embodiments of the present disclosure provide a method for reconstructing a human face, which can generate a target virtual face model with a preset style, and the target virtual face model has a relatively high difference between the real face and the real face. similarity.

In order to facilitate the understanding of this embodiment, a method for reconstructing a face disclosed by an embodiment of the present disclosure is first introduced in detail. The execution subject of the method for reconstructing a face provided by the embodiment of the present disclosure is generally a computer device with a certain computing capability. , the computer equipment includes, for example: terminal equipment or server or other processing equipment, the terminal equipment can be user equipment (User Equipment, UE), mobile equipment, user terminal, terminal, cellular phone, cordless phone, personal digital assistant ( Personal Digital Assistant, PDA), handheld devices, computing devices, in-vehicle devices, wearable devices, etc. In some possible implementations, the method for reconstructing a human face can be implemented by the processor calling computer-readable instructions stored in the memory.

The following describes the method for reconstructing a human face provided by the embodiments of the present disclosure.

FIG. 1 is a flowchart of a method for reconstructing a face provided by an embodiment of the present disclosure. As shown in FIG. 1 , the method includes steps S101 to S103, wherein:

S101: Generate a first real face model based on the target image;

S102: Perform fitting processing on the first real face model by using a plurality of pre-generated second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively;

S103: Generate a target virtual face model corresponding to the target image based on the fitting coefficients corresponding to the plurality of second real face models and the virtual face models with preset styles corresponding to the plurality of second real face models respectively face model.

In the embodiment of the present disclosure, a process of fitting a first real face model with multiple pre-generated real face models is used to obtain fitting coefficients corresponding to a second real face model, and the fitting coefficients are used as a medium to establish multiple The relationship between a second real face model and the first real face model, and then use the fitting coefficient and the virtual faces with preset styles corresponding to the plurality of second real face models respectively. model, and generate a target virtual face model corresponding to the target image. This method makes the target virtual face model determined based on the fitting coefficient and the virtual face model not only has a preset style, but also has the characteristics of the original face corresponding to the first real face model, that is, the generated target There is a high degree of similarity between the virtual face model and the original face corresponding to the first real face model.

The above steps S101 to S103 will be described in detail below.

For the above step S101, the target image is, for example, an acquired image including a human face. Any of the included faces can be used as the original face.

When the method for reconstructing a face provided by the embodiment of the present disclosure is applied to different scenarios, the method for acquiring the target image is also different.

For example, when the method for reconstructing a human face is applied to a game, an image containing the face of the game player can be acquired through an image acquisition device installed in the game device, or an image containing the face of the game player can be selected from the album of the game device. The image of the face of the game player, and the acquired image including the face of the game player is used as the target image.

For another example, when the method for reconstructing a face is applied to a terminal device such as a mobile phone, an image including the user's face can be collected by the camera of the terminal device, or an image including the user's face can be selected from the album of the terminal device. , or receive images containing the user's face from other applications installed in the terminal device.

For another example, when the method for reconstructing a human face is applied to a live broadcast scene, a video frame image containing a human face can be obtained from multiple frames of video frame images included in the video stream of the live broadcast device; The video frame image is used as the target image. Here, for example, the target image may have multiple frames; for example, the multiple-frame target image may be obtained by sampling a video stream.

When generating the first real face model based on the target image, for example, the following methods can be used: obtaining a target image including the original face; performing three-dimensional face reconstruction on the original face included in the target image to obtain the first real face model. Real face model.

Here, when performing 3D face reconstruction on the original face included in the target image, for example, three-dimensional deformable face models (3 Dimensions Morphable Models, 3DMM) can be used to obtain the first real face model corresponding to the original face . Wherein, the first real face model includes, for example, position information of each key point in the preset camera coordinate system among the multiple key points of the original face in the target image.

For the above step S102, the second real face model is generated based on the reference image including the reference face. Wherein, the reference faces in different reference images may be different; exemplarily, multiple people with different at least one item in gender, age, skin color, degree of fatness and thinness, etc. may be selected, and the information of each person may be obtained for each of the multiple people. face image, and use the acquired face image as a reference image. In this way, the plurality of second real face models obtained based on the plurality of reference images can cover a relatively wide range of face shape features as much as possible.

The reference face includes, for example, N faces corresponding to N different individual objects, (N is an integer greater than 1). In the case of acquiring multiple reference images including the reference face, for example, N photos corresponding to the N different individual objects can be obtained by separately photographing N different individual objects, and each photo Each corresponds to a reference face, and the N photos are used as reference images; or, N reference images are determined from a plurality of images including different faces that have been photographed in advance.

Exemplarily, for each second real face model in the plurality of second real face models, the method for generating the second real face model includes: acquiring a plurality of reference images including a reference face; For each reference image in the plurality of reference images, three-dimensional face reconstruction is performed on the reference face included in the reference image to obtain a second real face model corresponding to the reference image.

Wherein, the method for performing 3D face reconstruction on the reference face is similar to the above-mentioned method for performing 3D face reconstruction on the original face, and will not be repeated here. The obtained second real face model includes position information of each key point in the preset camera coordinate system among the multiple key points of the reference face in the reference image. Here, the coordinate system of the second real face model and the coordinate system of the first real face model may be the same coordinate system.

When using multiple pre-generated second real face models to perform fitting processing on the first real face model, to obtain the fitting coefficients corresponding to the multiple second real face models, for example, the following method may be used: The second real face model and the first real face model are subjected to least squares processing to obtain fitting coefficients corresponding to the plurality of second real face models respectively.

，將第二真實人臉模型對應的模型資料表示為

，其中，

表示N個第二真實人臉模型中的第i個第二真實人臉模型。 Exemplarily, in the case of generating N second real face models in advance, the model data corresponding to the first real face model can be expressed as

, the model data corresponding to the second real face model is expressed as

,in,

Indicates the i-th second real face model among the N second real face models.

對

至

中的每一項進行最小二乘處理，可以得到N個擬合值，該擬合值表示為

。其中，

表徵第i個第二真實人臉模型對應的擬合值。利用N個擬合值，可以確定擬合係數Alpha，例如可以用係數矩陣表示，也即

。 use

right

to

Each item in the least squares process can be obtained to get N fitting values, which are expressed as

. in,

Indicates the fitting value corresponding to the ith second real face model. Using the N fitted values, the fitting coefficient Alpha can be determined, for example, it can be represented by a coefficient matrix, that is,

.

Here, in the process of fitting the first real face model through multiple second real face models, it is necessary to make the data obtained after the weighted summation of multiple second real face models through multiple fitting coefficients As close as possible to the data of the first real face model.

The fitting coefficient can also be regarded as an expression coefficient of each second real face model when the first real face model is expressed by using a plurality of second real face models. That is, by using the fitting values corresponding to the expression coefficients of the plurality of second real face models respectively, the second real face model can be transformed and fitted to the first real face model.

For the above step S103, the preset style may be, for example, a cartoon style, an ancient style, or an abstract style, and may be specifically set according to actual needs. Exemplarily, for the case where the preset style is a cartoon style, the virtual face model with the preset style may be, for example, a virtual face model with a certain cartoon style.

Wherein, the method for acquiring multiple virtual face models with preset styles corresponding to multiple second real face models respectively includes, for example, at least one of the following (a1) and (a2).

(a1) Taking obtaining a virtual face model corresponding to a second real face model as an example, a virtual face image with reference face features and a preset style can be designed and produced based on the reference image, and the virtual face image can be designed and produced based on the reference image. The virtual face in the face image is subjected to three-dimensional modeling, and the skeleton data and skin data of the virtual face model in the virtual face image are obtained.

The skeleton data includes skeleton rotation data, skeleton scaling data, and skeleton position data of a plurality of bones preset for the virtual face in the preset coordinate system. Here, for example, multiple bones can be divided into multiple levels; for example, it includes a root (root) bone, facial bones, and facial detail bones; wherein the facial bones can include eyebrow bones, nasal bones, zygomatic bones, mandibular bones, and mouth bones, etc. ; For example, the detailed bones of the facial features can further divide the bones of different facial features in detail. Specific settings can be made according to different styles of virtual image requirements, which are not limited here.

The skinning data includes position information of a plurality of position points on the surface of the virtual face in a preset coordinate system and information about the relationship between each position point and at least one of the plurality of bones.

The virtual model obtained by performing three-dimensional modeling on the virtual face in the virtual face image is used as the virtual face model corresponding to the second real face model.

(a2) Pre-generate standard virtual face models with preset styles. The standard virtual face model also includes standard bone data, standard skin data, and an association relationship between the standard bone data and the standard skin data. Based on the reference face, design and modify the standard skeleton data in the standard virtual face model, so that the modified standard virtual face model has the preset style and also includes the reference face in the reference image. Then, based on the relationship between the standard bone data and the standard skin data, the standard skin data is adjusted, and the feature information of the reference face can also be added to the standard skin data. Based on the modified standard The skeleton data and the modified standard skin data are used to generate a virtual face model corresponding to the second real face model.

Here, the specific data representation of the virtual face model may refer to the description in the above (a1), which will not be repeated here.

Referring to FIG. 2 , an embodiment of the present disclosure further provides a virtual human with a preset style based on fitting coefficients corresponding to a plurality of second real face models respectively, and a preset style corresponding to the plurality of second real face models respectively The skeleton data of the face model, and the method for generating the target virtual face model corresponding to the target image, including:

S201: Determine target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively.

The bone data includes at least one of the following data: bone rotation data, bone position data, and bone scaling data corresponding to each face bone in the multiple face bones of the virtual face model.

In a possible implementation manner, based on the fitting coefficients corresponding to the plurality of second real faces, interpolation processing may be performed on the skeleton data corresponding to the plurality of virtual face models respectively to obtain the target skeleton data. The obtained target bone data includes at least one of the following: target bone position data, target bone scaling data, and target bone rotation data.

The target bone position data includes, for example, the three-dimensional coordinate value of the center point of the bone in the model coordinate system; the target bone scaling data includes, for example, the scaling ratio of the target bone relative to the bones in the standard virtual face model; the target bone rotation data includes, for example, the bone The rotation angle of the axis in the model coordinate system.

Exemplarily, the target skeleton data is determined based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models, for example, the following (b1) to (b3) can be used. to achieve at least one of them.

(b1) Based on the fitting coefficients corresponding to the plurality of second real face models respectively, perform interpolation processing on the skeleton position data corresponding to the plurality of virtual face models respectively to obtain the target skeleton position data.

(b2) Based on the fitting coefficients corresponding to the multiple second real face models respectively, perform interpolation processing on the skeleton scaling data corresponding to the multiple virtual face models respectively, to obtain the target skeleton scaling data.

(b3) Converting the skeleton rotation data corresponding to the plurality of virtual face models respectively into quaternion data, and performing regularization processing on the quaternions corresponding to the plurality of virtual face models respectively, to obtain Regularized quaternion: Based on the fitting coefficients corresponding to the multiple second real face models, the regularized quaternions corresponding to the multiple virtual face models are interpolated to obtain the target bone rotation data.

In a specific implementation, for the above-mentioned methods (b1) and (b2), in the case of acquiring the bone position data and the bone scaling data, it also includes determining each level of bones and the corresponding bones of each level based on multiple second real face models. local coordinate system. Among them, when the face model is layered at the bone level, for example, the bone level can be determined directly according to the biological bone layering method, or the bone level can be determined according to the requirements of face reconstruction. The specific layering method can be determined according to the actual situation. The situation is determined and will not be repeated here.

。 After each bone level is determined, a bone coordinate system corresponding to each bone level can be established based on each bone level. Exemplarily, each level of bones can be represented as

.

在對應的骨骼坐標系下的三維座標值；骨骼縮放資料可以包括虛擬人臉模型中的各層級骨骼

在對應的骨骼坐標系下用於表徵骨骼縮放程度的百分比，例如為80%、90%或100%。 At this time, the bone position data may include the bones of each level in the virtual face model

The three-dimensional coordinate value in the corresponding bone coordinate system; the bone scaling data can include the bones of each level in the virtual face model

The percentage used to represent the scale of the bone in the corresponding bone coordinate system, such as 80%, 90% or 100%.

，將第i個虛擬人臉模型對應的骨骼縮放資料表示為

。此時，骨骼位置資料

包含多個層級骨骼分別對應的骨骼位置資料，且骨骼縮放資料

包含多個層級骨骼分別對應的骨骼縮放資料。 In a possible implementation, the bone position data corresponding to the i-th virtual face model is represented as

, the bone scaling data corresponding to the i-th virtual face model is expressed as

. At this point, the bone position data

Contains bone position data corresponding to multiple levels of bones, and bone scaling data

Contains the bone scaling data corresponding to multiple levels of bones.

。基於M個第二真實人臉模型對應的擬合係數，對M個虛擬人臉模型對應的位置骨骼資料

進行插值處理，得到目標骨骼位置資料。 At this time, the corresponding fitting coefficient is

. Based on the fitting coefficients corresponding to the M second real face models, the position skeleton data corresponding to the M virtual face models

Perform interpolation processing to obtain the target bone position data.

進行加權求和處理，實現插值處理的過程。此時，目標骨骼位置資料

滿足下述公式（1）：

（1）。 Exemplarily, for example, the fitting coefficient can be used as the weight corresponding to each virtual face model, and the bone position data corresponding to the virtual face model can be

Perform weighted summation processing to realize the process of interpolation processing. At this point, the target bone position data

The following formula (1) is satisfied:

(1).

，可以將M個第二真實人臉模型分別對應的擬合係數，作為對應虛擬人臉模型的權重，對M個虛擬人臉模型分別對應的骨骼縮放資料進行加權求和處理，以實現對M個虛擬人臉模型進行插值處理；在該種情況下，目標骨骼縮放資料

滿足下述公式（2）：

（2）。 Similarly, based on the fitting coefficients corresponding to the M second real face models, interpolation processing is performed on the bone scaling data corresponding to the M virtual face models to obtain the target bone scaling data, wherein the ith virtual face model is The corresponding bone scaling data is expressed as

, the fitting coefficients corresponding to the M second real face models can be used as the weights of the corresponding virtual face models, and the bone scaling data corresponding to the M virtual face models can be weighted and summed, so as to realize the M A virtual face model is interpolated; in this case, the target skeleton scales the data

The following formula (2) is satisfied:

(2).

。由於骨骼旋轉資料所包含的旋轉角存在萬向節鎖死的問題，故將骨骼旋轉資料轉換為四元數，並且對四元數正則化，得到正則化四元數數資料，表示為

，以防止直接對四元數進行加權求和處理時產生過擬合的現象。 For the above method (b3), the bone rotation data may include vector values used to represent the degree of rotation coordinate transformation of each bone in the virtual face model in the corresponding bone coordinate system, for example, including a rotation axis and a rotation angle. In a possible implementation, the bone rotation data corresponding to the ith virtual face model is represented as

. Since the rotation angle contained in the bone rotation data has the problem of gimbal locking, the bone rotation data is converted into a quaternion, and the quaternion is regularized to obtain the regularized quaternion data, which is expressed as

, in order to prevent over-fitting when the quaternion is directly weighted and summed.

進行插值處理時，也可以將M個第二真實人臉模型對應的擬合係數作為權重，對M個虛擬人臉模型對應的正則化四元數進行加權求和；在該種情況下，目標骨骼旋轉資料

滿足下述公式（3）：

（3）。 Based on the fitting coefficients corresponding to the M second real face models, the regularization quaternion corresponding to the M virtual face models

When performing interpolation processing, the fitting coefficients corresponding to the M second real face models can also be used as weights, and the regularization quaternions corresponding to the M virtual face models can be weighted and summed; in this case, the target Bone rotation data

The following formula (3) is satisfied:

(3).

、目標骨骼縮放資料

以及目標骨骼旋轉資料

，即可確定目標骨骼資料，其表示為

。示例性地，可以將該目標骨骼資料以向量形式表示為

。 Based on the target bone position data obtained in (b1), (b2) and (b3) above

, target bone scaling data

and target bone rotation data

, the target skeleton data can be determined, which is expressed as

. Exemplarily, the target skeleton data can be represented in vector form as

.

Following the above S201, the method for generating the target virtual face model corresponding to the target image further includes:

S202: Generate a target virtual face model based on the target skeleton data.

Referring to FIG. 3, a specific method for generating a target virtual face model corresponding to a first real face model based on target skeleton data provided by an embodiment of the present disclosure includes:

S301: Based on the target skeleton data and the relationship between the standard skeleton data and the standard skin data in the standard virtual face model, perform position transformation processing on the standard skin data to generate target skin data;

S302: Generate a target virtual face model based on the target skeleton data and the target skin data.

Wherein, the association relationship between the standard skeleton data and the standard skin data in the standard virtual face model is, for example, the association relationship between the standard skeleton data corresponding to each level of bones and the standard skin data. Based on this association, the skin can be bound to the bones in the virtual face model.

Using the target skeleton data and the relationship between the standard skeleton data and the standard skin data in the standard virtual face model, position transformation can be performed on the skin data corresponding to the positions of multiple levels of bones, so that the generated target skin data The position of the corresponding level of bone in the file can be consistent with the position in the corresponding target bone data.

Here, the relationship between the bone data in the standard virtual face model and the standard skin data includes: the coordinate value of each position point in the standard skin deformation data in the model coordinate system, the bone position data of the bone, the bone scaling The relationship between the data and at least one of the bone rotation data.

When using the target skeleton data and the relationship between the standard skeleton data and the standard skin data in the standard virtual face model to perform position transformation processing on the skin data corresponding to the positions of multiple levels of bones, when the target skeleton data is determined In other words, when at least one of the target bone position data, target bone scaling data and target bone rotation data of the target bone is determined, the above-mentioned relationship can be used to determine that after the bone is transformed from the standard bone data to the target bone data , the new coordinate values of each position point in the standard skinning data under the model coordinate system, so as to obtain the target virtual face model based on the new coordinate value of each position point in the standard skinning data under the model coordinate system Target skin data.

Using the target bone data, it is possible to determine the bones of each level used to construct the target virtual face model; and using the target skin data, it is possible to determine the skin that binds the model to the bones, thereby forming the target virtual face model.

The method of determining the target virtual face model may be to directly establish the target virtual face model based on the target skeleton data and target skin data; Corresponding skeleton data of each level, and then use the target skin data to build the target virtual face model. The specific method for establishing the target virtual face model can be determined according to the actual situation, and will not be repeated here.

中的原始人臉A對應的目標虛擬人臉模型

的具體過程的說明。 The embodiments of the present disclosure also provide the method for reconstructing a face provided by the embodiments of the present disclosure to obtain a target image

The target virtual face model corresponding to the original face A in

description of the specific process.

包括下述步驟（c1）至（c5）： Determine the target virtual face model

It includes the following steps (c1) to (c5):

(c1) Preparing materials; including: preparing materials for standard virtual face models; and preparing materials for virtual pictures.

。 When preparing the material of the standard virtual face model, take the cartoon style as the default style as an example, first set a cartoon style standard virtual face model

.

~

；收集的24張虛擬圖片中的虛擬人臉

~

對應的男生、女生的數量均衡，並且盡可能包含較廣泛的五官特徵分佈。 Collect 24 dummy pictures when preparing material for dummy pictures

~

;Virtual faces in 24 virtual pictures collected

~

The corresponding number of boys and girls is balanced, and the distribution of facial features is as wide as possible.

中原始人臉A生成第一真實人臉模型

；以及利用虛擬圖片中的虛擬人臉

~

生成第二真實人臉模型

~

。 (c2) face model reconstruction; including: using the target image

The original face A in the middle generates the first real face model

; and using virtual faces in virtual images

~

Generate a second real face model

~

.

時，首先對目標圖像中的人臉進行轉正剪裁，然後利用預先訓練好的RGB重建神經網路，生成原始人臉A對應的第一真實人臉模型

。同樣的，利用預先訓練好的RGB重建神經網路，可以確定虛擬人臉

~

分別對應的第二真實人臉模型

~

。 After determining the original face A, generate the first real face model

When , firstly, the face in the target image is straightened and cropped, and then the neural network is reconstructed using the pre-trained RGB to generate the first real face model corresponding to the original face A.

. Similarly, using a pre-trained RGB reconstruction neural network, the virtual face can be determined

~

The corresponding second real face models

~

.

~

後，還包括：利用預設的風格，利用人工調整的方式，確定第二真實人臉模型

~

分別對應的具有預設風格的虛擬人臉模型

~

。 In determining the second real face model

~

After that, it also includes: using a preset style and using a manual adjustment method to determine the second real face model

~

Corresponding virtual face models with preset styles

~

.

=

。 (c3) Fitting processing, which includes: performing fitting processing on the first real face model by using a plurality of second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively

=

.

。 When using multiple second real face models to fit the first real face model, the method of least squares is selected for fitting, and 24-dimensional coefficients are obtained.

.

(c4) Determining target bone data; wherein, when determining the target bone data, the following steps (c4-1) and (c4-2) are also included.

下具有預設風格的虛擬人臉模型

~

分別對應的骨骼位置資料

、骨骼縮放資料

以及骨骼旋轉資料

。 (c4-1) Read the skeleton data; among them, the skeleton data includes: bones at all levels

A virtual face model with preset styles

~

Corresponding skeleton position data

, bone scaling data

and bone rotation data

.

對預設風格的虛擬人臉模型

~

對應的骨骼資料進行差值處理，生成目標骨骼資料

，該目標骨骼資料包括目標骨骼位置資料

、目標骨骼縮放資料

以及目標骨骼旋轉資料

。 (c4-2) Using fitting coefficients

Virtual face model for preset styles

~

The corresponding skeleton data is subjected to differential processing to generate target skeleton data

, the target bone data includes the target bone position data

, target bone scaling data

and target bone rotation data

.

(c5) Generate the target virtual face model.

中，並利用目標蒙皮資料，可以確定將模型綁定至骨骼上的蒙皮，然後利用預先確定的標準虛擬人臉模型中標準骨骼資料與標準蒙皮資料之間的關聯關係，生成與第一真實人臉模型對應的目標虛擬人臉模型。 Use the target bone data to determine the bones of each level used to construct the target virtual face model, and replace the target bone data with the standard virtual face model

, and use the target skin data to determine the skin that binds the model to the skeleton, and then use the pre-determined relationship between the standard skeleton data and the standard skin data in the standard virtual face model to generate a A target virtual face model corresponding to a real face model.

Referring to FIG. 4 , an example of specific materials used in multiple processes included in the above-mentioned specific examples provided in the embodiments of the present disclosure. Wherein, a in Figure 4 represents the target image, 41 represents the original face A; in Figure 4 b represents a schematic diagram of a cartoon-style standard virtual face model; in Figure 4 c represents the generated corresponding to the first real face model Schematic diagram of the target virtual face model.

Here, it is worth noting that the above steps (c1) to (c5) are only a specific example of a method for reconstructing a human face, and do not limit the method for reconstructing a human face provided by the embodiments of the present disclosure.

Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.

Based on the same inventive concept, an apparatus for reconstructing a face corresponding to the method for reconstructing a face is also provided in the embodiment of the present disclosure, because the principle of solving the problem by the apparatus in the embodiment of the present disclosure is the same as the above-mentioned method for reconstructing a face in the embodiment of the present disclosure. Similar, therefore, the implementation of the apparatus may refer to the implementation of the method, and repeated descriptions will not be repeated.

Referring to FIG. 5 , an embodiment of the present disclosure provides an apparatus for reconstructing a human face. The apparatus includes a first generating module 51 , a processing module 52 and a second generating module 53 .

The first generating module 51 is configured to generate a first real face model based on the target image.

The processing module 52 is configured to perform fitting processing on the first real face model by using a plurality of pre-generated second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively.

The second generation module 53 is configured to be based on the fitting coefficients corresponding to the plurality of second real face models, and a plurality of virtual models with preset styles corresponding to the plurality of second real face models respectively. A face model, generating a target virtual face model corresponding to the target image.

In an optional embodiment, the second generation module 53 is based on the fitting coefficients corresponding to the plurality of second real face models and the corresponding fitting coefficients of the plurality of second real face models respectively. A virtual face model with a preset style, when generating a target virtual face model corresponding to the target image, is used for: based on the fitting coefficients corresponding to the plurality of second real face models respectively, and a plurality of The skeleton data corresponding to the virtual face models are determined, and the target skeleton data is determined; the target virtual face model is generated based on the target skeleton data.

In an optional embodiment, when the second generation module 53 generates the target virtual face model based on the target skeleton data, it is used for: based on the target skeleton data and the standard virtual face model. The relationship between the standard bone data and the standard skin data, the standard skin data is subjected to position transformation processing to generate target skin data; based on the target bone data and the target skin data, the target is generated. Virtual face model.

In an optional embodiment, the skeleton data of the virtual face model includes at least one of the following data: bone rotation data and bone position data corresponding to each face bone in the multiple face bones of the virtual face model. and bone scaling data; the target bone data includes at least one of the following data: target bone position data, target bone scaling data, and target bone rotation data.

In an optional implementation manner, the target skeleton data includes the target skeleton position data, and the second generation module 53 is based on the fitting coefficients corresponding to the plurality of second real face models, and the number of Each of the skeleton data corresponding to the virtual face models, when determining the target skeleton data, is used for: based on the fitting coefficients corresponding to the plurality of second real face models respectively, for the corresponding skeleton data of the plurality of virtual face models Interpolate the bone position data to obtain the target bone position data.

In an optional implementation manner, the target skeleton data includes the target skeleton scaling data, and the second generation module 53 is based on the corresponding fitting coefficients and the multiple second real face models respectively. Each of the skeleton data corresponding to the virtual face models, when determining the target skeleton data, is used for: based on the fitting coefficients corresponding to the plurality of second real face models respectively, for the corresponding skeleton data of the plurality of virtual face models Interpolate the bone scaling data to obtain the target bone scaling data.

In an optional implementation manner, the target skeleton data includes the target skeleton rotation data, and the second generation module 53 is based on the corresponding fitting coefficients and the multiple second real face models respectively. The skeleton data corresponding to each of the virtual face models, when determining the target skeleton data, is used for: converting the skeleton rotation data corresponding to the plurality of virtual face models respectively into quaternions, and analyzing the plurality of virtual face models. Perform regularization processing on the quaternions corresponding to the face models to obtain a regularized quaternion; based on the fitting coefficients corresponding to the plurality of second real face models, respectively Interpolate the quaternion to obtain the target bone rotation data.

In an optional embodiment, when the first generation module 51 generates the first real face model based on the target image, it is used to: obtain a target image including the original face; The included original face is subjected to three-dimensional face reconstruction to obtain the first real face model.

In an optional embodiment, the processing module 52 generates the second real face model for each second real face model in the plurality of second real face models according to the following manner: obtaining the second real face model. including multiple reference images of the reference face; for each reference image in the multiple reference images, perform three-dimensional face reconstruction on the reference face included in the reference image to obtain the reference image Like the corresponding second real face model.

In an optional embodiment, the processing module 52 uses a plurality of pre-generated second real face models to perform fitting processing on the first real face model, and obtains a plurality of second real face models respectively. When the corresponding fitting coefficient is used, it is used to: perform least squares processing on a plurality of the second real face models and the first real face models, so as to obtain the corresponding fitting coefficients.

For the description of the processing flow of each module in the apparatus and the interaction flow between the modules, reference may be made to the relevant descriptions in the above method embodiments, which will not be described in detail here.

As shown in FIG. 6 , an embodiment of the present disclosure further provides a computer device including a processor 61 and a memory 62 .

The memory 62 stores machine-readable instructions executable by the processor 61, and the processor 61 is used to execute the machine-readable instructions stored in the memory 62. When the machine-readable instructions are executed by the processor 61, the processor 61 executes the following: The following steps: generate a first real face model based on the target image; use multiple pre-generated second real face models to perform fitting processing on the first real face model to obtain multiple second real face models corresponding fitting coefficients; based on the fitting coefficients corresponding to the plurality of second real face models respectively, and the virtual face models with preset styles corresponding to the plurality of second real face models respectively, A target virtual face model corresponding to the target image is generated.

The above-mentioned memory 62 includes a memory 621 and an external memory 622; the memory 621 here is also called an internal memory, which is used to temporarily store the computing data in the processor 61 and the data exchanged with the external memory 622 such as a hard disk, The processor 61 exchanges data with the external memory 622 through the memory 621 .

For the specific execution process of the above instruction, reference may be made to the method for reconstructing a human face described in the embodiments of the present disclosure, and details are not described herein again.

Embodiments of the present disclosure further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the method for reconstructing a human face described in the above method embodiments is executed. Wherein, the storage medium may be a volatile or non-volatile computer-readable storage medium.

An embodiment of the present disclosure further provides a computer program product, the computer program product carries a program code, and the instructions included in the program code can be used to execute the method for reconstructing a human face described in the above method embodiments. For details, please refer to the implementation of the above method For example, it will not be repeated here.

Wherein, the above-mentioned computer program product can be specifically realized by means of hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the system and device described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here. In the several embodiments provided by the present disclosure, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or elements may be combined or may be Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed to multiple network units . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a processor-executable non-volatile computer-readable storage medium. Based on such understanding, the technical solutions of the present disclosure can be embodied in the form of software products in essence, or the parts that contribute to the prior art or the parts of the technical solutions. The computer software products are stored in a storage medium, including several The instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present disclosure. The aforementioned storage media include: flash drives, mobile hard drives, Read-Only Memory (ROM), Random Access Memory (RAM), magnetic disks or CD-ROMs, etc. that can store program codes medium.

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present disclosure, and are used to illustrate the technical solutions of the present disclosure rather than limit them. The protection scope of the present disclosure is not limited thereto, although referring to the foregoing The embodiments describe the present disclosure in detail. Those of ordinary skill in the art should understand that: any person skilled in the art can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed by the present disclosure. Changes can be easily thought of, or equivalent replacements are made to some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be covered in the present disclosure. within the scope of protection. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

51: The first generation module 52: Processing modules 53: Second generation module 61: Processor 62: Memory 621: Memory 622: External memory S101: the step of generating the first real face model based on the target image S102: using a plurality of pre-generated second real face models to perform fitting processing on the first real face models, to obtain a step of respectively corresponding fitting coefficients of a plurality of second real face models S103: Generate a target virtual face model corresponding to the target image based on the fitting coefficients corresponding to the plurality of second real face models and the virtual face models with preset styles corresponding to the plurality of second real face models respectively The steps of the face model S201: the step of determining the target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively S202: the step of generating the target virtual face model based on the target skeleton data S301: Based on the target skeleton data and the relationship between the standard skeleton data and the standard skin data in the standard virtual face model, perform position transformation processing on the standard skin data to generate the target skin data S302: the step of generating the target virtual face model based on the target skeleton data and the target skin data

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings required in the embodiments, which are incorporated into the specification and constitute a part of the specification. The drawings illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the technical solutions of the present disclosure. It should be understood that the following drawings only show some embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. Other related figures are obtained from these figures. FIG. 1 shows a flowchart of a method for reconstructing a human face provided by an embodiment of the present disclosure; 2 shows a flowchart of a method for generating a target virtual face model corresponding to a target image provided by an embodiment of the present disclosure; 3 shows a flowchart of a specific method for generating a target virtual face model corresponding to a first real face model based on target skeleton data provided by an embodiment of the present disclosure; FIG. 4 shows an example of multiple faces and face models involved in the method for reconstructing a face provided by an embodiment of the present disclosure; FIG. 5 shows a schematic diagram of an apparatus for reconstructing a human face provided by an embodiment of the present disclosure; FIG. 6 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.

S101: the step of generating the first real face model based on the target image

S102: using a plurality of pre-generated second real face models to perform fitting processing on the first real face models, to obtain a step of respectively corresponding fitting coefficients of a plurality of second real face models

S103: Generate a target virtual face model corresponding to the target image based on the fitting coefficients corresponding to the plurality of second real face models and the virtual face models with preset styles corresponding to the plurality of second real face models respectively The steps of the face model

Claims (13)

A method of reconstructing a human face, comprising: generating a first real face model based on the target image; Perform fitting processing on the first real face model by using a plurality of pre-generated second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively; Based on the fitting coefficients corresponding to the plurality of second real face models respectively, and the virtual face models with preset styles corresponding to the plurality of second real face models respectively, the target image is generated The corresponding target virtual face model. The method for reconstructing a face according to claim 1, wherein the fitting coefficients corresponding to the plurality of second real face models and the plurality of second real face models Respectively corresponding virtual face models with preset styles, generating a target virtual face model corresponding to the target image, including: Determine the target skeleton data based on the fitting coefficients corresponding to the plurality of second real face models and the skeleton data corresponding to the plurality of virtual face models respectively; Based on the target skeleton data, the target virtual face model is generated. The method for reconstructing a face according to item 2 of the scope of the application, wherein the generating the target virtual face model based on the target skeleton data includes: Based on the target skeleton data and the relationship between the standard skeleton data and the standard skin data in the standard virtual face model, position transformation is performed on the standard skin data to generate target skin data; Based on the target skeleton data and the target skin data, the target virtual face model is generated. The method for reconstructing a human face as described in item 2 or 3 of the scope of application, wherein, The skeleton data corresponding to the virtual face model includes at least one of the following data: Bone rotation data corresponding to each face skeleton in the multiple face skeletons of the virtual face model, bone position data, and Bone scaling data; The target bone data includes at least one of the following data: target bone position data, target bone scaling data, and Target bone rotation data. The method for reconstructing a face according to item 4 of the scope of the application, wherein the fitting coefficients corresponding to the plurality of second real face models and the corresponding fitting coefficients of the plurality of virtual face models respectively Bone data, determine the target bone data, including: Based on the fitting coefficients corresponding to the plurality of second real face models, interpolation processing is performed on the bone position data corresponding to the plurality of virtual face models to obtain the target bone position data. The method for reconstructing a face according to claim 4 or 5, wherein the fitting coefficients corresponding to the plurality of second real face models and the plurality of virtual face models respectively Corresponding bone data, determine the target bone data, including: Based on the fitting coefficients corresponding to the plurality of second real face models respectively, interpolation processing is performed on the bone scaling data corresponding to the plurality of virtual face models to obtain the target bone scaling data. The method for reconstructing a face according to any one of the claims 4 to 6, wherein the fitting coefficients corresponding to the plurality of second real face models and a plurality of the virtual human The skeleton data corresponding to the face model respectively determine the target skeleton data, including: Convert the bone rotation data corresponding to the multiple virtual face models into quaternions, and performing regularization processing on the quaternions corresponding to the plurality of virtual face models respectively to obtain a regularized quaternion; Based on the fitting coefficients corresponding to the plurality of second real face models, interpolation processing is performed on the regularization quaternions corresponding to the plurality of virtual face models to obtain the target bone rotation data. The method for reconstructing a face according to any one of the claims 1 to 7, wherein the generating the first real face model based on the target image includes: Get the target image including the original face; Performing three-dimensional face reconstruction on the original face included in the target image to obtain the first real face model. The method for reconstructing a human face according to any one of claims 1 to 8 of the claimed scope, wherein, for each second real face model in the plurality of second real face models, the generated face is generated in the following manner Describe the second real face model: Obtain multiple reference images including reference faces; For each reference image in the plurality of reference images, perform three-dimensional face reconstruction on the reference face included in the reference image to obtain the second real face model corresponding to the reference image . The method according to any one of items 1 to 9 in the scope of the patent application, wherein the first real face model is fitted by using a plurality of pre-generated second real face models to obtain a plurality of The fitting coefficients corresponding to the second real face models include: Least square processing is performed on a plurality of the second real face models and the first real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively. A device for reconstructing a human face, comprising: a first generation module for generating a first real face model based on the target image; a processing module, configured to perform fitting processing on the first real face model by using a plurality of pre-generated second real face models to obtain fitting coefficients corresponding to the plurality of second real face models respectively; The second generation module is configured to be based on the fitting coefficients corresponding to the plurality of second real face models and the virtual face models with preset styles corresponding to the plurality of second real face models respectively , and generate a target virtual face model corresponding to the target image. A computer device includes a processor and a memory, the memory stores machine-readable instructions executable by the processor, the processor is configured to execute the machine-readable instructions stored in the memory, the machine When the readable instructions are executed by the processor, the processor executes the method for reconstructing a face according to any one of the claims 1 to 10 of the scope of the application. A computer-readable storage medium stores a computer program thereon, and when the computer program is run by a computer device, the computer device executes the method for reconstructing a human face described in any one of items 1 to 10 of the patent application scope.

Images