JP2002200050A - Skin color meter, skin color diagnostic machine, and face image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a diagnostic machine which precisely measures color components contributing to the skin color, such as the melanin component, hemoglobin component, etc., and diagnoses the skin color of a subject based on the measurement, a make-up system which can display a face image after making-up as desired, and an advice system which can advise a customer based on the measurement. SOLUTION: The surface reflected light component of a nose component is removed using polarized light and color components such as the melanin component, the hemoglobin component, etc., are calculated on the inner light component.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for observing the skin color of the skin, especially the face. The present invention diagnoses a customer's skin condition by observing the customer's skin color, outputs the diagnosis result, and outputs the result when basic makeup is performed based on the diagnosis result. The present invention relates to a device for giving advice on whether to perform makeup.

[0002]

2. Description of the Related Art It is known that human flesh color is mainly affected by the amount of melanin and hemoglobin. Brown skin has a large amount of melanin and white skin has a small amount of hemoglobin. It is also known that skin with good reddish color has a large amount of hemoglobin, particularly hemoglobin component with high oxygen partial pressure, and skin with poor reddish color has a small amount of hemoglobin component, and skin color is known to be different depending on the degree of blood circulation.

As a method for measuring the amount of melanin component and hemoglobin component, the applicant has proposed a method of applying light of a predetermined wavelength to the skin (skin) and detecting the reflected light thereof ( JP-A-10-127585). According to the method proposed in this publication, three or more different wavelengths are applied to the skin to detect the reflected light, and the characteristics based on the melanin component amount of the skin, the hemoglobin component amount, and the oxygen based on the absorption coefficient of melanin and hemoglobin differ for each wavelength. It is intended to diagnose the condition of the skin by obtaining a characteristic based on the degree of saturation.

[0004]

In the technique proposed by the present applicant, first, it is necessary to irradiate three different wavelengths and detect the intensity of the reflected light in each wavelength region. In particular, it is necessary to prepare a light source of each wavelength, and the device configuration becomes enormous. Also, in this proposal, there is a description that the measurement system is configured to treat the surface reflected light component as noise, but specifically how to remove the surface reflected light,
There is no proposal on detecting internal scattered reflected light.

[0005] Further, the group of Tsumura et al., Based on a model in which melanin and hemoglobin are distributed in layers in the skin, and the two components are independent of each other based on Lambert-Beer's law, are used to convert a face image into independent components. We propose a method to calculate the pigment component by analyzing by analysis (“Prediction of change of complexion based on independent component analysis of skin image”, 1997a Optical Society of Japan 30aE02 and “Complex color based on skin pigment component” And its evaluation ”Color Forum JAPAN2000 No.5
８8).

However, even in this proposal, the surface reflected light reflected on the surface of the skin does not represent the skin color due to melanin and hemoglobin contained in the epidermis and dermis of the skin, and therefore, the photographed face image is simply processed. Thus, there is a problem that accurate measurement of melanin and hemoglobin components is not possible due to the influence of surface reflected light.

[0007] Further, there is no mention of providing basic makeup based on the amount of melanin component and hemoglobin component of the face image processed by this image processing, or giving advice on what kind of makeup face to make. There is no.

[0008] The present invention provides a melanin component which contributes to skin color,
An object of the present invention is to provide a skin color measurement device capable of performing highly accurate measurement of a pigment component such as a hemoglobin component. It is another object of the present invention to provide a skin color diagnosis device that diagnoses a subject's skin color based on a measurement and a face image processing device that can display a face image after desired makeup. It is another object of the present invention to provide an advice system capable of giving makeup advice to a customer based on the measurement.

[0009]

Means for Solving the Problems A layered model in which the skin contains melanin in the layer on the epidermis side and hemoglobin in the layer on the dermis side, and each component is independent and based on Lambert-Beer's law, By performing principal component analysis or the like, the melanin component and hemoglobin component and their relative coefficients (amounts) can be calculated. Independent component analysis is a method of analyzing signals in which signals from mutually independent information sources are mixed, separating and extracting the original independent signals, and analyzing signals from various information sources such as living bodies. It is used to
Principal component analysis refers to an analysis method of analyzing the mutual relation of measured data and summarizing the data into some principal components, or synthesizing them into principal components.

Considering the color component vectors of the separated flesh color, -log (C) = q (1) .C (1) + q (2) .C (2) + C (3) where: C: a certain coordinate Color component vectors C (1) and C (2) at (l, m): color component vectors of the first and second component dyes q (1) and q (2): color components of the first and second component dyes Relative coefficient C (3): can be expressed by a stationary vector generated by the skin structure or other pigments.

Assuming that the color vectors of R, G, and B are r, g, and b for the RGB color signals, the color vector C of a pixel at a certain point is C = [-logr, -logg, -logb]. Becomes Here, independent component analysis, principal component analysis, or factor analysis is performed to calculate a color component vector and its relative coefficient,
By obtaining C (1), C (2), q (1), and q (2), the amount of the melanin component and the amount of the hemoglobin component in the skin color of the subject can be obtained, thereby evaluating the skin of the subject. It is possible. If the number of color signals to be detected is increased, the color component vector and the relative coefficient of the third component (and higher order components) can be extracted from C (3). .

Here, the surface reflected light component reflected on the skin surface is caused by unevenness on the skin surface, and becomes noise in the above-described analysis for separating the melanin component and the hemoglobin component. This is because the surface reflection light cannot be treated additively in the color density expression system.

According to the present invention, a surface reflected light component which is a noise component is removed by using polarized light.

The surface reflected light reflected on the surface of the skin is reflected while the polarization plane of the incident light is maintained. On the other hand, the internally reflected light scattered inside the skin includes light of various polarization planes.

Here, assuming that the incident light is incident on the polarizing plate as light having a vertical polarization plane, the light reflected on the surface of the skin is reflected while maintaining the incident vertical polarization plane.
On the other hand, the internally reflected light of the skin is reflected including light of various polarization planes. Therefore, when the reflected light is passed through a polarizing plate that allows only the polarized light in the vertical direction to pass, the reflected light including the surface reflected light and the internal reflected light can be detected. On the other hand, when the light passes through a polarizing plate that allows only the polarized light in the horizontal direction to pass, the light having the same polarization plane as the incident light is blocked, so that only the internally reflected light can be detected. Thereby, by detecting the reflected light by passing the incident light and the reflected light through the polarizing plate, the surface reflected light reflected on the skin surface can be excluded.

The extraction of the melanin and hemoglobin components by the internal reflection light excluding the surface reflection light using the polarized light is as follows.

R excluding surface reflected light using polarized light,
Assuming that the intensity vectors of the G and B colors are R, G and B, respectively, r ', g' and b ', the color component vector C of a pixel at a certain point is C = [-logr', -logg ', -Logb'], and by performing an independent component analysis, a principal component analysis, or a factor analysis, a melanin component, a hemoglobin component, and a relative coefficient thereof can be calculated based on only internal reflected light.

In addition to the method using a polarizing plate, the surface reflected light can be removed by diffused light illumination. In such a case, it is practical to use a simpler and more stable method of using a polarizing plate capable of stably removing the surface reflected light.

By excluding the surface reflected light,
The amount of the melanin component and the amount of the hemoglobin component of the skin of the subject can be accurately detected. The method of the present invention is applied to other pigment components other than the melanin component and the hemoglobin component, for example, the virbilin component and the carotene component, if necessary. It is known that the pigment components constituting the skin color each exhibit a characteristic absorption spectrum, and by detecting reflected light at a wavelength corresponding to a desired pigment component, the component amount and the relative coefficient can be obtained. . Based on this, evaluation diagnosis, makeup simulation and advice of the subject's skin are performed.

Since at least the amount of the melanin component and the hemoglobin component and the relative coefficient thereof are obtained by the above-described method, the skin color can be evaluated and diagnosed based on the contribution of the melanin component and the hemoglobin component to the detected flesh color. For example, the amount of the melanin component and the amount of the hemoglobin component are obtained from the face image of the subject, and compared with the average value in the database, it is possible to determine whether the skin is fair-skinned or dark-skinned. Also, the amount of hemoglobin component is
The spectral characteristics indicate whether there is much hemoglobin with a high oxygen partial pressure (arterial blood type) or there are many hemoglobins with a low oxygen partial pressure (venous type), so that it can be used as a health check. Also, when the skin color is dark, it is determined whether there is a large amount of melanin component or a large amount of hemoglobin component having a low oxygen partial pressure, and whether the melanin component due to sunburn etc. is large or it looks dark due to fatigue etc. Can be determined.

Further, makeup advice can be given based on the determined amounts of the melanin component and the hemoglobin component of the subject.

The amount of melanin component was determined by measuring the skin color of the subject.
The amount of the hemoglobin component is determined. Separately, the subject's wishes are heard by interviewing the subject. This interview asks what kind of skin color, for example, a whiter color or a browner color, is desired. By the way, data on what kind of basic cosmetics should be used and what kind of skin color will be obtained is constructed as a database. This data is based on data on how the amount of melanin component and hemoglobin component in skin color changes when applied to the skin and which basic cosmetics are used. And data on how the skin color changes after three months, and the image processing apparatus displays the changing skin color as a prediction based on such data and the subject's wishes and the subject's measurement data. . In addition, it is possible to give advice on what other basic cosmetics should be used based on the measured information on the skin color of the subject.

That is, a first aspect of the present invention is a skin color measuring apparatus, which is characterized by the fact that light from a light source is reflected by spectral data of reflected light from skin.
Using polarized light, reflected light detecting means for detecting the surface reflected light component reflected on the surface of the skin and the internally reflected light component reflected inside the skin separately, and forming the skin color of the subject from the internal reflected light component There is provided processing means for obtaining at least one dye component, and means for outputting the obtained dye component.

For example, the pigment component is a melanin component,
It is selected from the group consisting of a hemoglobin component, a virbilin component and a carotene component.

A second aspect of the present invention is a skin color diagnostic apparatus. The present invention is characterized in that spectral data of light reflected from skin by light from a light source is reflected on the skin by using polarized light. Reflected light detecting means for detecting the surface reflected light component reflected on the surface of the subject and the internally reflected light component reflected inside the skin, and from the internally reflected light component, a melanin component and a hemoglobin component constituting a subject's skin color. There is provided a processing means for obtaining, and an evaluation means for evaluating the skin condition of the subject from the relationship between the obtained melanin component and hemoglobin component and outputting an evaluation result.

It is preferable that the evaluation means compares the melanin component and the hemoglobin component obtained from the subject with existing data, and evaluates the skin condition of the subject based on the comparison result. The existing data is preferably an average measurement value for a group of the same age as the subject, but may be a past measurement value of the same subject.

A third aspect of the present invention is a face image processing apparatus, which is characterized in that light from a light source is reflected on the skin by using spectral data of polarized light by using polarization. A photographing unit that divides into a surface reflected light component reflected on the surface of the skin and an internal reflected light component reflected inside the skin and detects it as face image data of the subject, and forms a skin color of the subject from the internally reflected light component A processing unit for obtaining a melanin component and a hemoglobin component; a unit for inputting a subject's desire for skin color; a database in which data on changes in the melanin component and the hemoglobin component when basic makeup is applied; Image processing means for processing face image data of a subject based on data selected from the database as desired;
Display means for displaying the face image output from the image processing means.

Preferably, the apparatus further comprises means for outputting basic cosmetics data for performing basic makeup corresponding to the data selected from the database according to the input of the subject.

The basic makeup refers to a makeup using a milky lotion, lotion, or the like containing components such as a whitening agent that changes the color of the skin itself and a blood circulation promoter. On the other hand, makeup that changes the apparent skin color using a foundation or the like is called makeup.

[0030]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A skin color measuring device, a skin color diagnosing device and a face image processing device according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram of the flesh color measuring apparatus according to the first embodiment of the present invention. FIG. 2 is a diagram for explaining detection of internal light in the skin color measuring device according to the first embodiment of the present invention. FIG. 3 is a diagram for explaining detection of surface light in the skin color measuring device according to the first embodiment of the present invention. FIG.
FIG. 6 is a block diagram of a skin color diagnosis apparatus according to a second embodiment of the present invention. FIG. 5 is a block diagram of the face image processing apparatus according to the third embodiment of the present invention.

The first embodiment of the present invention is a skin color measuring apparatus, as shown in FIG. 1, which converts the spectral data of the light reflected by the skin from the light source on the surface of the skin using polarized light. Polarizing plates 50, 51, and 52 as reflected light detecting means for separately detecting a reflected surface reflected light component and an internally reflected light component scattered and reflected inside the skin, and camera device 1
And an internal light detecting unit 2 and an analyzing unit 3 as processing means for obtaining a melanin component or a hemoglobin component constituting the skin color of the subject from the internal reflected light component, and outputs the obtained melanin component or hemoglobin component. It is a skin color measuring device 10.

The second embodiment of the present invention is a skin color diagnostic apparatus, as shown in FIG.
Is a skin color diagnostic apparatus 20 including an evaluation unit 12 as an evaluation unit that evaluates a skin condition of a subject based on a relationship between a melanin component and a hemoglobin component output from and outputs an evaluation result. The evaluation unit 12 compares the melanin component and the hemoglobin component obtained from the subject with existing data recorded in the average database 11, and evaluates the skin condition of the subject based on the comparison result.

The third embodiment of the present invention relates to a face image processing apparatus, as shown in FIG.
0 is a database storing data on changes in the melanin component and hemoglobin component when the subject's wishes for the skin color are input and basic makeup is obtained by obtaining the melanin component and hemoglobin component constituting the subject's skin color. A change state database 21; a change simulation section 22 as image processing means for processing face image data of the subject based on the data selected from the change state database 21 in accordance with the input of the subject; The face image processing device 30 includes a display unit 23 as a display unit that displays the face image output from the unit 22. The data of the basic cosmetics for performing the basic makeup corresponding to the data selected from the change state database 21 in accordance with the input of the subject is output.

Hereinafter, embodiments of the present invention will be described in more detail.

(First Embodiment) A first embodiment of the present invention will be described with reference to FIGS. The skin color measuring device 10 of the first embodiment of the present invention removes the surface light component of the skin, which is a noise component in the measurement of the melanin component amount and the hemoglobin component amount, which hindered the measurement, and performs the measurement using the internal light component. Thus, an accurate value can be obtained.

That is, as shown in FIG.
When the light whose polarization plane has been adjusted by passing through it passes through the surface of the skin and comes out after repeating scattering inside several times, the light adjusted by the polarizing plate 50 is internally reflected. As a result, the light having various polarizations, that is, internal light, goes out.

As shown in FIG. 3, when light whose polarization plane is adjusted by transmitting through the polarizing plate 50 is reflected on the surface of the skin, the polarization direction adjusted by the polarizing plate 50 is preserved. You. In the example of FIG. 3, the light adjusted to the vertical polarization by the polarizing plate 50 is surface-reflected, and is then reflected again as light having the vertical polarization, that is, surface light.

By utilizing the property that the surface light and the internal light can be distinguished by the polarization as described above, the light transmitted through the polarizing plates 51 and 52 is photographed by the camera device 1 as shown in FIG. An image taken through the polarizing plate 51 is defined as an image a. An image taken through the polarizing plate 52 is taken as an image b. Here, when you want to get the internal light image,
Image composition is performed as a 2 × image b. That is, since only the element of the internal light is included in the image b, all of the light captured as the image b becomes the internal light image as it is. However, since about half of the internal light is shielded by the polarizing plate 52, the light amount of the image b is doubled for the purpose of compensating for the shielded light.

With respect to the internal light component from which the skin surface reflection component, which is a noise component, has been removed, the analyzing unit 3
By performing the analysis of the melanin component amount and the hemoglobin component amount described above, these accurate values can be obtained.

(Second Embodiment) A skin color diagnosis apparatus according to a second embodiment of the present invention will be described. The skin color diagnostic apparatus 20 shown in FIG.
Is composed of an average value database 11 and an evaluation unit 12. Paying attention to the amount of melanin component and the amount of hemoglobin component output from the analysis unit 3 of the skin color measuring device 10, the color is black if the amount of melanin component is large, and the skin is less reddish if the amount of hemoglobin component is small. Can be. Thus, the evaluation unit 12 can evaluate the skin color of the subject from the difference between the average value of the melanin component amount and the average value of the hemoglobin component amount. This average value is stored in the average value database 11.

For example, image analysis is performed to determine whether the bear under the eyes is merely rich in melanin, whether there are many hemoglobins that are tired and have low oxygen partial pressure (venous blood type), or because of bruising, or merely a shadow. Can be determined by As a result, a skin health check can be performed. Table 1 shows specific examples of skin color diagnosis based on the amounts of the melanin component and the hemoglobin component.

[0042]

[Table 1]

(Third Embodiment) A face image processing apparatus according to a third embodiment of the present invention will be described. The face image processing device 30 shown in FIG. 5 includes a change state database 21, a change simulation unit 22, and a display unit 23. The change simulation unit 22 receives the face image of the subject, the amounts of the melanin component and the hemoglobin component output by the analysis unit 3 of the skin color measurement device 10, and the subject's desire for the skin color.

As shown in Table 2, the face image impression database is a database in which information for defining the words of the desired skin of the subject and the directions of the corresponding image processing is recorded. According to the desire of the skin impression such as “clean”, “clear”, “lively” and “healthy”, the operator can change the change ratio of the melanin component and the hemoglobin component to obtain the simulation result displayed in the image. You can change the impression of the skin color. A specific example of the change ratio is shown below.

[0045]

[Table 2]

The change simulation unit 22 refers to the biological change database of the change state database 21 and
Obtain biochange information. This biological change information is information on changes in the amount of melanin component and the amount of hemoglobin component that occur when a basic cosmetic of a type suitable for the defined image processing direction is used for a predetermined period, and the predetermined period is, for example, The period is one month, two months, or three months. Here, Table 3 shows a specific example of the biological change database. The change ratio of the average density of a predetermined area of each component image (reference is 0 month) is shown.

[0047]

[Table 3]

Based on such a biotransformation database, an image of which basic cosmetics are used and how much biotransformation is made by simulation is displayed in an image, and it is determined interactively while looking at the screen whether or not the desired condition is met. To decide.

The makeup effect database is a database in which information on makeup effects when makeup is applied using various cosmetics is recorded, and is arbitrarily added as a part of the change state database. If necessary, refer to this makeup effect database, and apply makeup to the skin color that has changed according to the increase or decrease in the amount of melanin component and hemoglobin component after using the basic cosmetics for a predetermined period of time. The effect information is obtained, and the apparent correction of the skin color which is still insufficient due to the change in the color of the skin itself due to the basic makeup is performed.

The change simulation unit 22 displays the simulation result on the display unit 23. The operator
Through a dialogue with the subject, the difference from the hope is analyzed. If the displayed simulation result is as desired by the subject, the basic cosmetic used in the simulation is determined as the basic cosmetic suitable for the subject. If the simulation result is different from the test subject's desire, the basic cosmetic data to be used is changed and the change simulation is executed again. In this way, the basic cosmetics that meet the wishes of the subject are determined.

[0051]

As described above, according to the present invention,
Highly accurate measurement of pigment components such as melanin components and hemoglobin components that contribute to skin color can be performed. Further, it is possible to realize a diagnosis device that diagnoses the skin color of the subject based on the measurement and a makeup system that can display a face image after desired makeup. Further, it is possible to realize an advise system that can give advice to a customer based on the measurement.

[Brief description of the drawings]

FIG. 1 is a block diagram of a skin color measuring device according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining detection of internal light in the skin color measuring device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining detection of surface light in the skin color measurement device according to the first embodiment of the present invention.

FIG. 4 is a block diagram of a skin color diagnosis apparatus according to a second embodiment of the present invention.

FIG. 5 is a block diagram of a face image processing apparatus according to a third embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 1 camera device 2 internal light detection unit 3 analysis unit 10 skin color measurement device 11 average value database 12 evaluation unit 20 skin color diagnosis device 21 change state database 22 change simulation unit 23 display unit 30 face image processing device 50, 51, 52 polarizing plate

[Procedure amendment]

[Submission date] March 22, 2002 (2002.3.2.
2)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] 0010

[Correction method] Change

[Correction contents]

Considering the color component vectors of the separated flesh color, C = q (1) · C (1) + q (2) · C (2) + C (3) where C: a certain coordinate (l, m) )), Color component vectors C (1) and C (2): color component vectors of the first and second component dyes q (1) and q (2): relative coefficients of the first and second component dyes C ( 3): It can be represented by a stationary vector generated by the skin structure and other pigments.

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Tokumichi Tsumura 1-33 Yayoi-cho, Inage-ku, Chiba-shi, Chiba Pref. Chiba Univ. −33 Chiba University, Faculty of Science and Technology, Department of Information and Image Engineering (72) Inventor Yoichi Miyake 1-33, Yayoi-cho, Inage-ku, Chiba City, Chiba Pref. DA66

Claims (6)

[Claims] 1. Spectral data of light reflected by skin from light from a light source is separated into a surface reflected light component reflected on the skin surface and an internal reflected light component reflected inside the skin using polarized light. A flesh color measuring device comprising: a reflected light detecting means for detecting and detecting at least one pigment component constituting a skin color of a subject from an internal reflected light component; and a means for outputting the determined pigment component. 2. The skin color measurement device according to claim 1, wherein the pigment component is selected from the group consisting of a melanin component, a hemoglobin component, a virbilin component, and a carotene component. 3. The spectral data of the light reflected by the skin from the light source is divided into a surface reflected light component reflected on the skin surface and an internal reflected light component reflected inside the skin using polarized light. Reflected light detecting means for detecting the skin condition of the subject from the internal reflected light component; andmeans for calculating the melanin component and the hemoglobin component constituting the skin color of the subject from the internal reflected light component. A skin color diagnostic apparatus comprising: an evaluation unit configured to evaluate and output an evaluation result. 4. The skin color diagnostic apparatus according to claim 3, wherein the evaluation means compares the melanin component and the hemoglobin component obtained from the subject with existing data, and evaluates the skin condition of the subject based on the comparison result. 5. Spectral data of light reflected by skin from light from a light source is separated into a surface reflected light component reflected on the skin surface and an internal reflected light component reflected inside the skin using polarized light. Imaging means for detecting the subject's face image data, processing means for obtaining the melanin component and hemoglobin component constituting the subject's skin color from the internal reflected light component, means for inputting the subject's desire for the skin color, and basic makeup. A database storing data relating to changes in melanin component and hemoglobin component when subjected to, and an image for processing the subject's face image data based on the data selected from the database in accordance with the input of the subject according to the wishes of the subject A face image processing apparatus comprising: processing means; and display means for displaying a face image output from the image processing means. 6. The face image according to claim 5, further comprising: means for outputting data of basic cosmetics for performing basic makeup corresponding to the data selected from the database according to the input of the subject's request. Processing equipment.