More Web Proxy on the site http://driver.im/

article

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin

Authors:

Norimichi Tsumura,

Nobutoshi Ojima,

Mitsuhiro Shiraishi,

Hideto Shimizu,

Hirohide Nabeshima,

Syuuichi Akazaki,

Yoichi MiyakeAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 22, Issue 3

Pages 770 - 779

https://doi.org/10.1145/882262.882344

Published: 01 July 2003 Publication History

Abstract

This paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is removed by a simple color vector analysis in the optical density domain as an inverse lighting technique. The image without shading is analyzed by a previously introduced technique that extracts hemoglobin and melanin components by independent component analysis. Experimental results using UV-B irradiation and the application of methyl nicotinate on the arms support the physiological validity of the analysis and the effectiveness of the proposed shading removal. We synthesized the way facial images changed due to tanning or alcohol consumption, and compared the synthesized images with images of actual changes in skin color. The comparison shows an excellent match between the synthesized and actual images of changes due to tanning and alcohol consumption. We also proposed a technique to synthesize the change of texture in pigment due to aging or the application of cosmetics. The pyramid-based texture analysis/synthesis technique was used for the spatial processing of texture. Using the proposed technique, we could realistically change the skin color and texture of a 50 year-old woman to that of a 20 year-old woman.

Supplementary Material

MP4 File (tsumura_ojima_imagedbased.mp4)

Download
45.65 MB

References

[1]

BLANZ V. AND VETTER T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH'99, 187--194.

Digital Library

[2]

DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.-P., SAROKIN W., AND SAGAR M. 2000. Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH 2000, 145--156.

Digital Library

[3]

DREW M. S., CHEN C., HORDLEY S. D., AND FINLAYSON G, D. 2002. Sensor transforms for invariant image enhancement. In Proceeding of IS&T /SID's Tenth Color Imaging Conference, IS&T and SID, 325--330.

[4]

DUDA R. O. AND HART, P. E. 1973. Pattern Classification and Scene Analysis. Wiley & Sons, Inc.

[5]

FREEFBERG I. M., EISEN A. Z., WOLFF K., AUSTEN F. K, GOLDSMITH L. A., KATZ S. I., AND FITSPATRICK T. B. 1999 Fitzpatrick's Dermatology in General Medicine, McGraw Hill

[6]

GEMERT M. J. C. V, JACQUES S. L., STERBORG H. J. C. M, AND STAR W. M. 1989. Skin Optics. IEEE Trans. Biomed. Eng., 36 1146--1154.

[7]

HANRAHAN P. AND KRUEGER W. 1993. Reflection from layered surfaces due to subsurface scattering. In Proceedings of ACM SIGGRAPH '93, ACM Press / Computer Graphics Proceedings, Annual Conference Series, ACM, 187--194.

Digital Library

[8]

HEEGER D. J. AND BERGEN J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 95, 229--238.

Digital Library

[9]

HIRAOKA M., FIRBANK M., ESSENPREIS M., COPE M., ARRIGE S. R., ZEE P. V. D., AND DELPY D. T. 1993. A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys. Med. Biol. 38, 1859--1876.

[10]

HUNT, R. W. G. H. 1995. The Reproduction of Colour, Fifth edition, Fountain Press.

[11]

HYVARINEN A., KARHUNEN J., AND OJA E. 2001. Independent Component Analysis, Wiley Inter-Science.

[12]

HYVARINEN A. AND OJA E. 1997. A fast fixed-point algorithm for independent component analysis. Neural Computation 9, 1483--1492.

Digital Library

[13]

ICC (International Color Consortium) 1998. Spec ICC.1:1998-09, File Format for Color Profiles. ICC.

[14]

IEC 61966-2-1 1999. Multimedia Systems and Equipment - Colour Measurement and Management - Part 2--1: Colour Management - Default RGB Colour Space -sRGB, IEC.

[15]

ISHII T., YASUDA T., YOKOI S., AND TORIWAKI J. 1993. A generation model for human skin texture. In Proceedings of CG International., Springer-Verlag, 139--150.

[16]

JENSEN H. W., MAESHNER S. R., LEVOY M., AND HANRAHAN P. 2001. A practical model of subsurface light transport. In Proceedings of ACM SIGGRAPH 2001, 551--518.

Digital Library

[17]

JENSEN H. W. AND BUHLER J. 2002. A rapid hierarchical rendering technique for translucent materials. In Proceedings of SIGGRAPH 2002 576--581.

Digital Library

[18]

KLINKER G. J., SHAFER S. A. AND KANADE T. 1990. A Physical Approach to Color Image Understanding", International Journal on Computer Vision, 4(1) 7--38.

Digital Library

[19]

MARSHNER S. R. AND GREENBERG D. P. 1997. Inverse lighting for photography. In Proceeding of Fifth IS&T/SID Color Imaging Conference, IS&T and SID, 262--265.

[20]

MARSHNER S. R. 1998. Inverse Rendering for Computer Graphics. Ph.D. thesis, Cornell.

Digital Library

[21]

MARSCHNER S. R., WESTIN S. H., LAFORTUNE E. P. F., TORRANCE K. E., AND GREENBERG D. P. 1999. Imagebased BRDF measurement including human skin. In Proceedings of 10th Eurographics Workshop on Rendering, 139--152.

Digital Library

[22]

NUMATA K., RI K., AND KIRA K., 1999. "E-Make"; A real-time HD skin-make-up machine. IEICE Technical report 23, 76, 11--16. http://www.nhk.or.jp/strl/open2001/en/tenji/id17/index.html.

[23]

OJIMA N., MINAMI T., AND KAWAI M. 1997. Transmittance measurement of cosmetic layer applied on skin by using image processing. In Proceeding of The 3rd Scientific Conference of the Asian Societies of Cosmetic Scientists, 114.

[24]

OJIMA N., YOSHIDA K., OSANAI O., AND AKAZAKI S. 2002. Image synthesis of cosmetic applied skin based on optical properties of foundation layers. In Proceedings of International Congress of Imaging Science, 467--468.

[25]

RAMAMOORTHI R. AND HANRAHAN P. 2001. A signal processing framework for inverse rendering. In Proceedings of ACM SIGGRAPH 2001, 117--128.

Digital Library

[26]

SATO Y. AND IKEUCHI K. 1994. Temporal-color space analysis of reflection. Journal of Optical Society of America A 11, 11, 2990--3002.

[27]

TOMINAGA S. AND WANDELL B. 1989. The standard reflectance model and illuminant estimation. Journal of Optical Society of America A, Vol. 6, No.4, 576--584.

[28]

TSUMURA N., KAWABUCHI M., HANEISHI H., AND MIYAKE Y. 2001. Mapping pigmentation in human skin from multi-channel visible spectrum image by inverse optical scattering technique. Journal of Imaging Science and Technology 45, 5, 444--450.

[29]

TSUMURA N., HANEISHI H., AND MIYAKE Y. 1999. Independent component analysis of skin color image. Journal of Optical Society of America A 16, 9, 2169--2176.

Cited By

Wang DChahl J(2024)Simulating cardiac signals on 3D human models for photoplethysmography developmentFrontiers in Robotics and AI10.3389/frobt.2023.126653510Online publication date: 10-Jan-2024
https://doi.org/10.3389/frobt.2023.1266535
Xiong ZFu SZhu YZhu CMa XFan M(2024)“It is hard to remove from my eye”: Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) PerformersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642261(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642261
Fei FCheng YZhu YZheng QLi SPan GShi B(2024)SPLiT: Single Portrait Lighting Estimation via a Tetrad of Face IntrinsicsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332845346:2(1079-1092)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3328453
Show More Cited By

Index Terms

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision representations
        Image representations
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin
SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

This paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is ...
Illumination Invariant Measuring of Skin Pigmentation
CGIV '14: Proceedings of the 2014 11th International Conference on Computer Graphics, Imaging and Visualization

This paper proposes a new method for measuring concentration of skin pigmentation using nothing but a standard RGB camera. Since RGB signals are easily affected by change in illumination, all conventional methods require a prior knowledge about the ...
Hemoglobin and melanin quantification on skin images
ICIAR'12: Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part II

In this paper, we propose and compare four different approaches for quantification of hemoglobin and melanin on skin color image. The first method is to extract erythema/melanin indices based on skin absorbance theories. The second method is based on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 22, Issue 3

July 2003

683 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/882262

Issue’s Table of Contents

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2003

Published in TOG Volume 22, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

146
Total Citations
View Citations
3,545
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)8

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang DChahl J(2024)Simulating cardiac signals on 3D human models for photoplethysmography developmentFrontiers in Robotics and AI10.3389/frobt.2023.126653510Online publication date: 10-Jan-2024
https://doi.org/10.3389/frobt.2023.1266535
Xiong ZFu SZhu YZhu CMa XFan M(2024)“It is hard to remove from my eye”: Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) PerformersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642261(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642261
Fei FCheng YZhu YZheng QLi SPan GShi B(2024)SPLiT: Single Portrait Lighting Estimation via a Tetrad of Face IntrinsicsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332845346:2(1079-1092)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3328453
Okubo TOno KTsumura N(2023)Improving driving ability using biofeedback by monitoring the mental situation by RGB cameraOptical Diagnostics and Sensing XXIII: Toward Point-of-Care Diagnostics10.1117/12.2648008(10)Online publication date: 16-Mar-2023
https://doi.org/10.1117/12.2648008
Jung GKim SLee JYoo S(2023)Deep learning-based optical approach for skin analysis of melanin and hemoglobin distributionJournal of Biomedical Optics10.1117/1.JBO.28.3.03500128:03Online publication date: 1-Mar-2023
https://doi.org/10.1117/1.JBO.28.3.035001
Liu XZhang YMa XKuang H(2023)A Network of Generating High Quality Hemoglobin Images2023 IEEE 3rd International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA)10.1109/ICIBA56860.2023.10165577(787-791)Online publication date: 26-May-2023
https://doi.org/10.1109/ICIBA56860.2023.10165577
Thong WJoniak PXiang A(2023)Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.00452(4880-4890)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.00452
Dimauro GGriseta MCamporeale MClemente FGuarini AMaglietta R(2023)An intelligent non-invasive system for automated diagnosis of anemia exploiting a novel datasetArtificial Intelligence in Medicine10.1016/j.artmed.2022.102477136:COnline publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.artmed.2022.102477
Lu WChiu CChan YGuo TLin CWang PLin PMulio ALi P(2022)An In Vivo Study to Evaluate the Efficacy of Blue Shark (Prionace glauca) Cartilage Collagen as a CosmeticMarine Drugs10.3390/md2010063320:10(633)Online publication date: 5-Oct-2022
https://doi.org/10.3390/md20100633
Nagasawa KYamamoto SArai WHakkaku KKoopipat CHirai KTsumura N(2022)Fabrication of a Human Skin Mockup with a Multilayered Concentration Map of Pigment Components Using a UV PrinterJournal of Imaging10.3390/jimaging80300738:3(73)Online publication date: 15-Mar-2022
https://doi.org/10.3390/jimaging8030073
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents