More Web Proxy on the site http://driver.im/

Article

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin

Authors:

Norimichi Tsumura,

Nobutoshi Ojima,

Mitsuhiro Shiraishi,

Hideto Shimizu,

Hirohide Nabeshima,

Syuuichi Akazaki,

Yoichi MiyakeAuthors Info & Claims

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

Pages 770 - 779

https://doi.org/10.1145/1201775.882344

Published: 01 July 2003 Publication History

Abstract

This paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is removed by a simple color vector analysis in the optical density domain as an inverse lighting technique. The image without shading is analyzed by a previously introduced technique that extracts hemoglobin and melanin components by independent component analysis. Experimental results using UV-B irradiation and the application of methyl nicotinate on the arms support the physiological validity of the analysis and the effectiveness of the proposed shading removal. We synthesized the way facial images changed due to tanning or alcohol consumption, and compared the synthesized images with images of actual changes in skin color. The comparison shows an excellent match between the synthesized and actual images of changes due to tanning and alcohol consumption. We also proposed a technique to synthesize the change of texture in pigment due to aging or the application of cosmetics. The pyramid-based texture analysis/synthesis technique was used for the spatial processing of texture. Using the proposed technique, we could realistically change the skin color and texture of a 50 year-old woman to that of a 20 year-old woman.

Supplementary Material

MP4 File (tsumura_ojima_imagedbased.mp4)

Download
45.65 MB

References

[1]

BLANZ V. AND VETTER T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH'99, 187--194.

Digital Library

[2]

DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.-P., SAROKIN W., AND SAGAR M. 2000. Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH 2000, 145--156.

Digital Library

[3]

DREW M. S., CHEN C., HORDLEY S. D., AND FINLAYSON G, D. 2002. Sensor transforms for invariant image enhancement. In Proceeding of IS&T /SID's Tenth Color Imaging Conference, IS&T and SID, 325--330.

[4]

DUDA R. O. AND HART, P. E. 1973. Pattern Classification and Scene Analysis. Wiley & Sons, Inc.

[5]

FREEFBERG I. M., EISEN A. Z., WOLFF K., AUSTEN F. K, GOLDSMITH L. A., KATZ S. I., AND FITSPATRICK T. B. 1999 Fitzpatrick's Dermatology in General Medicine, McGraw Hill

[6]

GEMERT M. J. C. V, JACQUES S. L., STERBORG H. J. C. M, AND STAR W. M. 1989. Skin Optics. IEEE Trans. Biomed. Eng., 36 1146--1154.

[7]

HANRAHAN P. AND KRUEGER W. 1993. Reflection from layered surfaces due to subsurface scattering. In Proceedings of ACM SIGGRAPH '93, ACM Press / Computer Graphics Proceedings, Annual Conference Series, ACM, 187--194.

Digital Library

[8]

HEEGER D. J. AND BERGEN J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 95, 229--238.

Digital Library

[9]

HIRAOKA M., FIRBANK M., ESSENPREIS M., COPE M., ARRIGE S. R., ZEE P. V. D., AND DELPY D. T. 1993. A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys. Med. Biol. 38, 1859--1876.

[10]

HUNT, R. W. G. H. 1995. The Reproduction of Colour, Fifth edition, Fountain Press.

[11]

HYVARINEN A., KARHUNEN J., AND OJA E. 2001. Independent Component Analysis, Wiley Inter-Science.

[12]

HYVARINEN A. AND OJA E. 1997. A fast fixed-point algorithm for independent component analysis. Neural Computation 9, 1483--1492.

Digital Library

[13]

ICC (International Color Consortium) 1998. Spec ICC.1:1998-09, File Format for Color Profiles. ICC.

[14]

IEC 61966-2-1 1999. Multimedia Systems and Equipment - Colour Measurement and Management - Part 2--1: Colour Management - Default RGB Colour Space -sRGB, IEC.

[15]

ISHII T., YASUDA T., YOKOI S., AND TORIWAKI J. 1993. A generation model for human skin texture. In Proceedings of CG International., Springer-Verlag, 139--150.

[16]

JENSEN H. W., MAESHNER S. R., LEVOY M., AND HANRAHAN P. 2001. A practical model of subsurface light transport. In Proceedings of ACM SIGGRAPH 2001, 551--518.

Digital Library

[17]

JENSEN H. W. AND BUHLER J. 2002. A rapid hierarchical rendering technique for translucent materials. In Proceedings of SIGGRAPH 2002 576--581.

Digital Library

[18]

KLINKER G. J., SHAFER S. A. AND KANADE T. 1990. A Physical Approach to Color Image Understanding", International Journal on Computer Vision, 4(1) 7--38.

Digital Library

[19]

MARSHNER S. R. AND GREENBERG D. P. 1997. Inverse lighting for photography. In Proceeding of Fifth IS&T/SID Color Imaging Conference, IS&T and SID, 262--265.

[20]

MARSHNER S. R. 1998. Inverse Rendering for Computer Graphics. Ph.D. thesis, Cornell.

Digital Library

[21]

MARSCHNER S. R., WESTIN S. H., LAFORTUNE E. P. F., TORRANCE K. E., AND GREENBERG D. P. 1999. Imagebased BRDF measurement including human skin. In Proceedings of 10th Eurographics Workshop on Rendering, 139--152.

Digital Library

[22]

NUMATA K., RI K., AND KIRA K., 1999. "E-Make"; A real-time HD skin-make-up machine. IEICE Technical report 23, 76, 11--16. http://www.nhk.or.jp/strl/open2001/en/tenji/id17/index.html.

[23]

OJIMA N., MINAMI T., AND KAWAI M. 1997. Transmittance measurement of cosmetic layer applied on skin by using image processing. In Proceeding of The 3rd Scientific Conference of the Asian Societies of Cosmetic Scientists, 114.

[24]

OJIMA N., YOSHIDA K., OSANAI O., AND AKAZAKI S. 2002. Image synthesis of cosmetic applied skin based on optical properties of foundation layers. In Proceedings of International Congress of Imaging Science, 467--468.

[25]

RAMAMOORTHI R. AND HANRAHAN P. 2001. A signal processing framework for inverse rendering. In Proceedings of ACM SIGGRAPH 2001, 117--128.

Digital Library

[26]

SATO Y. AND IKEUCHI K. 1994. Temporal-color space analysis of reflection. Journal of Optical Society of America A 11, 11, 2990--3002.

[27]

TOMINAGA S. AND WANDELL B. 1989. The standard reflectance model and illuminant estimation. Journal of Optical Society of America A, Vol. 6, No.4, 576--584.

[28]

TSUMURA N., KAWABUCHI M., HANEISHI H., AND MIYAKE Y. 2001. Mapping pigmentation in human skin from multi-channel visible spectrum image by inverse optical scattering technique. Journal of Imaging Science and Technology 45, 5, 444--450.

[29]

TSUMURA N., HANEISHI H., AND MIYAKE Y. 1999. Independent component analysis of skin color image. Journal of Optical Society of America A 16, 9, 2169--2176.

Cited By

HASEGAWA SENOMOTO KMIZUTANI TOKANO YTANAKA TSAKAI O(2024)Skin Diagnostic Method Using Fontana-Masson Stained Images of Stratum Corneum CellsIEICE Transactions on Information and Systems10.1587/transinf.2023EDP7256E107.D:8(1070-1078)Online publication date: 1-Aug-2024
https://doi.org/10.1587/transinf.2023EDP7256
Ha HHwang IMonzon NCho JKim DBaek SMuñoz AGutierrez DKim M(2024)Polarimetric BSSRDF Acquisition of Dynamic FacesACM Transactions on Graphics10.1145/368776743:6(1-11)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687767
Fei FCheng YZhu YZheng QLi SPan GShi B(2024)SPLiT: Single Portrait Lighting Estimation via a Tetrad of Face IntrinsicsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332845346:2(1079-1092)Online publication date: Feb-2024
https://doi.org/10.1109/TPAMI.2023.3328453
Show More Cited By

Index Terms

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision representations
        Image representations
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin

This paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is ...
Illumination Invariant Measuring of Skin Pigmentation
CGIV '14: Proceedings of the 2014 11th International Conference on Computer Graphics, Imaging and Visualization

This paper proposes a new method for measuring concentration of skin pigmentation using nothing but a standard RGB camera. Since RGB signals are easily affected by change in illumination, all conventional methods require a prior knowledge about the ...
Hemoglobin and melanin quantification on skin images
ICIAR'12: Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part II

In this paper, we propose and compare four different approaches for quantification of hemoglobin and melanin on skin color image. The first method is to extract erythema/melanin indices based on skin absorbance theories. The second method is based on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

July 2003

683 pages

ISBN:1581137095

DOI:10.1145/1201775

Conference Chair:
Alyn P. Rockwood
Colorado School of Mines

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH03

Sponsor:

SIGGRAPH

SIGGRAPH03: Special Interest Group on Computer Graphics and Interactive Techniques

July 27 - 31, 2003

California, San Diego

Acceptance Rates

SIGGRAPH '03 Paper Acceptance Rate 81 of 424 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
3,843
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)3

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

HASEGAWA SENOMOTO KMIZUTANI TOKANO YTANAKA TSAKAI O(2024)Skin Diagnostic Method Using Fontana-Masson Stained Images of Stratum Corneum CellsIEICE Transactions on Information and Systems10.1587/transinf.2023EDP7256E107.D:8(1070-1078)Online publication date: 1-Aug-2024
https://doi.org/10.1587/transinf.2023EDP7256
Ha HHwang IMonzon NCho JKim DBaek SMuñoz AGutierrez DKim M(2024)Polarimetric BSSRDF Acquisition of Dynamic FacesACM Transactions on Graphics10.1145/368776743:6(1-11)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687767
Fei FCheng YZhu YZheng QLi SPan GShi B(2024)SPLiT: Single Portrait Lighting Estimation via a Tetrad of Face IntrinsicsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332845346:2(1079-1092)Online publication date: Feb-2024
https://doi.org/10.1109/TPAMI.2023.3328453
Shuai CCai RDissanayake BNewman AGuan DSng DLi LKot A(2024)Controllable and Gradual Facial Blemishes Retouching Via Physics-Based Modelling2024 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME57554.2024.10688234(1-6)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICME57554.2024.10688234
Li XGuarnera GLin AGhosh A(2024)Practical Measurement and Neural Encoding of Hyperspectral Skin Reflectance2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00116(1301-1309)Online publication date: 18-Mar-2024
https://doi.org/10.1109/3DV62453.2024.00116
Jung GLee JKim S(2024)Integrated deep learning approach for generating cross-polarized images and analyzing skin melanin and hemoglobin distributionsBiomedical Engineering Letters10.1007/s13534-024-00409-914:6(1355-1364)Online publication date: 26-Jul-2024
https://doi.org/10.1007/s13534-024-00409-9
Zuena JPytlarz J(2023)Understanding Color Memory: A Study of Skin Tone Perception in Hue, Intensity, and ChromaSMPTE Motion Imaging Journal10.5594/JMI.2023.3277107132:6(19-30)Online publication date: Jul-2023
https://doi.org/10.5594/JMI.2023.3277107
Kumar VPaul K(2023)Fundus Imaging-Based Healthcare: Present and FutureACM Transactions on Computing for Healthcare10.1145/35865804:3(1-34)Online publication date: 8-Sep-2023
https://dl.acm.org/doi/10.1145/3586580
Jung GKim SLee JYoo S(2023)Generation of skin tone and pigmented region‐modified images using a pigment discrimination model trained with an optical approachSkin Research and Technology10.1111/srt.1348629:10Online publication date: 28-Sep-2023
https://doi.org/10.1111/srt.13486
Aliaga CXia MXie XJarabo ABraun GHery C(2023)A Hyperspectral Space of Skin Tones for Inverse Rendering of Biophysical Skin PropertiesComputer Graphics Forum10.1111/cgf.1488742:4Online publication date: 26-Jul-2023
https://doi.org/10.1111/cgf.14887
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents