KR102364929B1 - Electronic device, sever, and system for tracking skin changes - Google Patents

Abstract

An electronic device according to an embodiment disclosed in this document includes a housing, a display disposed on one surface of the housing, a camera exposed through the display or disposed in a designated area of the housing, and storing images captured by the camera. a memory, and a processor connected to the display, the camera, and the memory, wherein the processor is configured to: photograph a first image in response to a user input, and obtain a second image obtained by changing the first image to a specified angle and extracting at least a partial region of the second image, changing the color of the at least partial region to a specified level, analyzing features included in the at least partial region, and displaying it in a specified pattern, , the images stored in the memory and the at least partial region on which the designated pattern is displayed may be sequentially output to the display. In addition to this, various embodiments identified through the specification are possible.

Description

ELECTRONIC DEVICE, SEVER, AND SYSTEM FOR TRACKING SKIN CHANGES

The present invention relates to an electronic device, server, and system for tracking skin changes. Specifically, the present invention relates to a technique for tracking changes in the skin of a user.

As the spread of electronic devices (eg, smart phones) expands and technologies applied to electronic devices are advanced, people's lifestyles are becoming easier and more convenient. For example, when a user photographs a face through a camera, the electronic device may analyze the condition of the skin, the number of troubles, and the like. The analysis result can be output through the display, and the user can immediately check the skin condition through this.

delete

Registered Patent No. 10-2036043

However, it may not be easy to continuously analyze the skin condition of a specific area (eg, forehead, cheeks) because the location and angle at which the user photographs their skin are different every time. In addition, since the electronic device analyzes and outputs only the image immediately after photographing, it may be impossible for the user to check the skin change from the past to the time of photographing.

Embodiments disclosed in this document are intended to provide an electronic device for solving the above-described problems and problems posed in this document.

An electronic device according to an embodiment disclosed in this document includes a housing, a display disposed on one surface of the housing, a camera exposed through the display or disposed in a designated area of the housing, and storing images captured by the camera. a memory, and a processor connected to the display, the camera, and the memory, wherein the processor is configured to: photograph a first image in response to a user input, and obtain a second image obtained by changing the first image to a specified angle and extracting at least a partial region of the second image, changing the color of the at least partial region to a specified level, analyzing features included in the at least partial region, and displaying it in a specified pattern, , the images stored in the memory and the at least partial region on which the designated pattern is displayed may be sequentially output to the display.

In addition, the server according to an embodiment disclosed in this document includes a memory for storing images, and a processor connected to the memory, wherein the processor: When receiving a first image from an electronic device, the first image to obtain a second image obtained by changing ? to a specified angle, extract at least a partial region of the second image, change a color of the at least partial region to a specified level, and features included in the at least partial region (features) may be analyzed and displayed as a designated pattern, and images stored in the memory and the at least partial region on which the designated pattern is displayed may be transmitted to the electronic device.

In addition, the system for tracking skin changes according to an embodiment disclosed in this document includes an electronic device for photographing a first image, and a server for receiving the photographed first image from the electronic device, the server is: obtains a second image obtained by changing the first image to a specified angle, extracts at least a partial area of the second image, changes a color of the at least partial area to a specified level, and at least some of the Analyze features included in a region and display them as a specified pattern, and transmit pre-stored images and the at least partial region in which the specified pattern is displayed to the electronic device, wherein the electronic device includes: the pre-stored images and the at least some regions on which the designated pattern is displayed may be sequentially output.

According to the embodiments disclosed in this document, it is possible to observe a continuous skin change.

In addition, according to the embodiments disclosed in this document, a skin condition for each body part may be analyzed.

Also, according to the embodiments disclosed in this document, the skin condition may be analyzed regardless of the position and angle of the photographed body part.

In addition, various effects directly or indirectly identified through this document may be provided.

1 illustrates a system for tracking skin changes according to an embodiment.
2 is a hardware block diagram of an electronic device and a server according to an exemplary embodiment.
3 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
4 illustrates an image changed to a specified angle according to an exemplary embodiment.
5 illustrates an extracted region according to an exemplary embodiment.
6 illustrates an operation of changing a color of an extracted area to a specified level according to an exemplary embodiment.
7 illustrates an operation of displaying a specified pattern according to an exemplary embodiment.
8 illustrates an operation of outputting images in a specified order according to an exemplary embodiment.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included. In connection with the description of the drawings, like reference numerals may be used for like components.

1 illustrates a system 1000 for tracking skin changes according to an embodiment.

Referring to FIG. 1 , a system 1000 may include an electronic device 100 and a server 200 .

The electronic device 100 may include a housing 110 , a display 120 , and a camera 130 .

The housing 110 may protect the components included in the electronic device 100 from external impact by forming the exterior of the electronic device 100 .

The display 120 may be disposed on one surface of the housing 110 . According to an embodiment, the display 120 may receive a user input. For example, when a user touches a finger on the display 120 , the display 120 may perform an operation corresponding to the touch by recognizing the user's touch. In another embodiment, the display 120 may provide various contents to the user by outputting an image, a video, or the like.

The camera 130 may be exposed through the display 120 or disposed in a designated area of the housing 110 . The camera 130 may capture images and videos of people, backgrounds, and objects in response to a user input. The captured images and moving pictures may be stored in the electronic device 100 .

According to an embodiment, the electronic device 100 may capture a first image (eg, a face) in response to a user input (eg, a screen touch). After acquiring the second image by changing the first image to a specified angle, the electronic device 100 may extract at least a partial region (eg, a ball) from the second image. When at least a partial region is extracted, the electronic device 100 may change the color of the at least partial region to a specified level. For example, the brightness of the at least partial area may be increased or decreased.

In addition, the electronic device 100 may analyze the features included in the at least partial region and display it in a designated pattern. For example, when there is trouble or redness in the at least some areas, the electronic device 100 may display a pattern for emphasizing trouble or redness on the image. When the specified pattern is displayed, the electronic device 100 may sequentially output pre-stored images and an image in which the specified pattern is displayed.

Since a conventional electronic device diagnoses a skin condition based on an image at the time of photographing, only the skin condition at the time of photographing may be provided to the user. However, since the electronic device 100 according to an embodiment of the present invention sequentially outputs images that have been analyzed and stored in the past, the user can recognize a change in his or her skin condition. In addition, since the electronic device 100 according to an embodiment of the present invention normalizes the composition by changing the photographed image to a specified angle, it is possible to check the skin condition of a certain area regardless of the user's position or face angle.

The server 200 may communicate with the electronic device 100 by wire and/or wirelessly. For example, the electronic device 100 may transmit captured images to the server 200 through BLE, Wi-Fi, or the like, and the server 200 may analyze the received images.

According to an embodiment, the server 200 may extract a specific area (eg, cheek) from the image received from the electronic device 100 , analyze the skin condition of the extracted area, and transmit it to the electronic device 100 . there is. The electronic device 100 may sequentially output images received from the server 200 , and the user may recognize a change in his or her skin condition. In this document, except for the operation of taking a picture through the camera 130 , operations performed by the electronic device 100 and the server 200 may be compatible.

According to an embodiment, the electronic device 100 and/or the server 200 may continuously analyze the user's skin condition through artificial intelligence (AI). For example, the analysis data may be stored in the electronic device 100 and/or the server 200 , and when the user's skin is photographed later, the stored data may be used for skin analysis.

2 is a hardware block diagram of the electronic device 100 and the server 200 according to an embodiment.

Referring to FIG. 2 , the electronic device 100 may include a housing 110 , a display 120 , a camera 130 , a memory 140 , and a processor 150 .

The memory 140 may store images captured by the camera 130 . According to an embodiment, the memory 140 may store data related to a pre-analyzed skin condition. For example, the memory 140 may store the number of pores, the degree of trouble and redness, and the like.

The processor 150 may be electrically connected to the display 120 , the camera 130 , and the memory 140 to control the components. For example, the processor 150 may extract a specific area (eg, a ball) after changing the image captured by the camera 130 to a specified angle. The processor 150 may analyze the features included in the extracted area and display it as a designated pattern. For example, the processor 150 may emphasize redness by displaying a red spread pattern in a redness area.

According to an embodiment, the processor 150 may sequentially output data previously stored in the memory 140 and the extracted region. The pre-stored data may be data obtained by analyzing the same region (eg, cheek) as the extracted region (eg, cheek), through which the user can check a change in his or her skin condition.

The server 200 may include a memory 210 and a processor 220 . The memory 210 may store images transmitted from the electronic device 100 . According to an embodiment, the memory 210 may store data analyzed by the processor 220 . For example, the memory 210 may store the number of pores analyzed by the processor 220 , the degree of trouble and redness, and the like.

The processor 220 may analyze images stored in the memory 210 and/or images transmitted from the electronic device 100 . Operations performed by the processor 150 of the electronic device 100 and operations performed by the processor 220 of the server 200 may be substantially similar, and data analyzed by the processor 220 of the server 200 is It may be stored in the memory 210 or transmitted to the electronic device 100 .

In this document, components having the same reference numerals as those of the electronic device 100 and the server 200 illustrated in FIGS. 1 and 2 may have the same descriptions as those described in FIGS. 1 and 2 .

3 is a flowchart illustrating an operation of the electronic device 100 according to an embodiment.

Referring to FIG. 3 , in operation 301 , the electronic device 100 may capture a first image (eg, a user's face). For example, when the user touches the display 120 while the camera 130 faces the user's face, the electronic device 100 may photograph the user's face.

In operation 302, the electronic device 100 may acquire the second image by changing the position and/or angle of the captured image (eg, the first image). In this case, the second image may be an image generated by being normalized to a preset composition or a composition designated by a user.

For example, when a front picture of a face is taken, the electronic device 100 may acquire a side picture by changing the position and angle of the front picture. In this case, the electronic device 100 may change the first image into the second image by using any one of interpolation and 3-D deep learning using a body part included in the first image as a landmark. In this document, a body part may mean, for example, an eye, a nose, or the tip of a mouth.

In operation 303, the electronic device 100 may extract at least a partial region from the second image. According to an embodiment, the electronic device 100 may extract a region spaced apart by a specified distance based on a body part included in the second image. For example, the electronic device 100 may extract various regions from the second image as a patch region. Specifically, from the front photo, the eye area, nose, mouth area, forehead, chin, cheeks or both cheeks (cheek side), and nasolabial fold area (the area from the nose ball to the mouth) can be extracted. Also, both cheeks or both cheeks (wider side), side chin, side eye area, and side mouth can be extracted from the side photo. However, the present embodiment is not limited thereto.

In operation 304, the electronic device 100 may change the color of the extracted area to a specified level. For example, the electronic device 100 may brighten or darken the contrast of the extracted area to a specified level.

In operation 305, the electronic device 100 may analyze the features included in the extracted region and display it as a designated pattern. For example, the electronic device 100 may emphasize redness by displaying a red spread pattern in a redness area. In another embodiment, the electronic device 100 may emphasize the pores by enlarging and displaying the pores.

In operation 306, the electronic device 100 may sequentially output pre-stored data and the extracted region. For example, the electronic device 100 may generate a panoramic image or a moving picture by combining pre-stored data and the extracted region. The pre-stored data may be data obtained by analyzing the same area (eg, cheek) as the extracted area (eg, cheek), and the user can check the change in his or her skin condition through this.

The operations performed by the electronic device 100 illustrated in FIG. 3 are exemplary, and various embodiments of the present disclosure are not limited to the sequence illustrated in FIG. 3 . For example, the electronic device 100 may photograph a body part (eg, a leg, etc.) other than the user's face, and may analyze and output the photographed skin of the body part. Also, some of the operations illustrated in FIG. 3 may be omitted, and may be performed by the server 200 instead of the electronic device 100 .

4 illustrates an image changed to a specified angle according to an exemplary embodiment. FIG. 4 is a diagram for explaining in detail operation 302 shown in FIG. 3 .

Referring to FIG. 4 , the electronic device 100 may acquire second images 410 and 420 by changing the position and/or angle of the first image. For example, when the camera captures the front of the user's face, the electronic device 100 may acquire the front face image. The electronic device 100 may acquire the side image 410 illustrated in FIG. 4 by changing the position and/or angle of the front face image. In a state in which the side image 410 is acquired, the electronic device 100 may analyze troubles, redness, and the like on the cheeks.

According to an embodiment, the electronic device 100 may change the position and/or angle of the first image by any one of interpolation and 3-D deep learning based on a body part included in the first image. For example, the electronic device 100 may change the position and/or angle of the first image centering on the eye, nose, and mouth, which may be feature points of the user's face. According to an embodiment of the present invention, by changing the position and angle of the first image, the skin condition may be analyzed regardless of the photographing angle and position.

According to an embodiment, the electronic device 100 may enlarge a partial area of the first image. For example, when the camera 130 captures the front face of the user, the electronic device 100 may obtain a front face image. After changing the position and/or angle of the front face image, the electronic device 100 may enlarge a partial area to acquire the ball image 420 shown in FIG. 4 . In a state in which the ball image 420 is acquired, the electronic device 100 may analyze troubles, redness, and the like in the cheeks.

According to an embodiment of the present invention, pictures taken at different times and spaces can be normalized by changing the first image to a specified composition.

5 illustrates an extracted region according to an exemplary embodiment. FIG. 5 is a diagram for explaining in detail operation 303 illustrated in FIG. 3 .

Referring to FIG. 5 , the electronic device 100 may extract at least a partial region of the second image 510 . For example, when the second image 510 is a face image, the electronic device 100 may extract areas around the forehead 511 , around the eyes 512a and 512b , the nose 513 , and around the mouth 514 , etc. . The extracted area can be used for skin analysis.

According to an embodiment, the electronic device 100 may extract a region spaced apart by a specified distance based on a body part included in the second image 510 . For example, when the second image 510 is a face image, the electronic device 100 may extract regions 512a and 512b spaced apart from the eye by about 3 mm. In another embodiment, the electronic device 100 may extract an area 514 spaced apart from the center of the mouth by about 5 mm. The embodiments shown in FIG. 5 are exemplary, and various embodiments of the present invention are not limited to those shown in FIG. 5 . For example, a body part centered in the second image 510 and a separation distance may be different from those shown in FIG. 5 .

According to an embodiment, the electronic device 100 may use several images to extract a designated area from among the photographed body parts. For example, in order to extract both cheeks, the electronic device 100 may use a left face photo and a right face photo.

According to an embodiment, the order of the regions to be extracted may be sequential. For example, the forehead 511, the eye area (512a, 512b), the nose 513, the mouth area 514 may be extracted in order or may be extracted in reverse order. When the order of the extracted regions is sequential, the extracted regions may not overlap.

6 illustrates an operation of changing a color of an extracted area to a specified level according to an exemplary embodiment. FIG. 6 is a diagram for explaining in detail operation 304 shown in FIG. 3 .

Referring to FIG. 6 , upper images 610a, 620a, 630a, 640a, and 650a represent original images, and lower images 610b, 620b, 630b, 640b, and 650b represent images after color change. The upper images 610a , 620a , 630a , 640a , and 650a may be images pre-stored in a memory or images during photographing. The lower images 610b, 620b, 630b, 640b, and 650b may have the same color since the color has been changed to a specified level.

According to an embodiment, the electronic device 100 may change a color based on any one of several images. For example, as shown in FIG. 6 , the electronic device 100 may change the colors of the original images 610a , 620a , 630a , 640a , and 650a to have the same color as the lower left image 610b . Accordingly, the upper images 610a, 620a, 630a, 640a, and 650a may have different colors, but the lower images 610b, 620b, 630b, 640b, and 650b may all have the same color.

As an embodiment, the electronic device 100 may change the color based on the average value of the colors of the upper images 610a, 620a, 630a, 640a, and 650a. Accordingly, the upper images 610a, 620a, 630a, 640a, and 650a may have different colors, but the lower images 610b, 620b, 630b, 640b, and 650b may all have the same color.

According to an embodiment, if the number of images added increases as the photographing is continuously performed, the number of reference images also increases, and accordingly, the average value of the colors of the images may be changed. Accordingly, when photographing is continuously performed, the colors of the lower images 610b, 620b, 630b, 640b, and 650b may also be entirely changed.

According to an embodiment, when there is no reference color among several images, the electronic device 100 may correct the color based on the statistically calculated color.

This color correction can be performed through image processing by adjusting the average and/or variance of each data in the Lab format. However, the present embodiment is not limited thereto.

7 illustrates an operation of displaying a specified pattern according to an exemplary embodiment. FIG. 7 is a diagram for explaining in detail operation 305 illustrated in FIG. 3 .

Referring to FIG. 7 , the electronic device 100 may display a designated pattern by analyzing features included in the extracted region 710 . For example, when there is redness and trouble in the extracted area 710 , the electronic device 100 may display the spread pattern 710a to emphasize redness and trouble.

In this case, the electronic device 100 may process the color of the image of the extracted region 710 to analyze redness and trouble through the image emphasizing the red energy of the image.

Redness and trouble may be distinguished by the intensity of red energy in the color-processed image. That is, the red energy of redness may have a lower intensity than that of trouble. Accordingly, redness and trouble can be distinguished and displayed. However, the present embodiment is not limited thereto.

As another example, when there are pores in the extracted area 710 , the electronic device 100 may emphasize the pores by performing edge enhancement processing on the image to display the pores ( 710b ). However, the present embodiment is not limited thereto.

According to an embodiment, the electronic device 100 may quantitatively analyze the skin state of the extracted region 710 . For example, the electronic device 100 may digitize the number of pores, the number of dots, the number of troubles, etc. in the extracted region 710 and output the numerical values to the display.

8 illustrates an operation of outputting images in a specified order according to an exemplary embodiment. FIG. 8 is a diagram for explaining in detail operation 306 shown in FIG. 3 .

Referring to FIG. 8 , the electronic device 100 may sequentially output pre-stored images 810 , 820 , 830 , and 840 and an image 850 at the time of photographing. For example, the images 810 , 820 , 830 , and 840 in FIG. 8 are images stored in a memory and may represent a past skin condition of the cheek. The image 850 is an image 850 at the time of photographing and may represent the current skin condition of the cheek. Since the electronic device 100 sequentially outputs the pre-stored images 810 , 820 , 830 , and 840 and the image 850 at the time of photographing, the user can check the skin change from the past to the present as well as the current skin condition. .

According to an embodiment, the electronic device 100 may generate a panoramic image or a moving picture by merging pre-stored images 810 , 820 , 830 , and 840 with images 850 at the time of shooting. The user can easily check his or her skin change through the panoramic image or video.

According to an embodiment, the electronic device 100 may output both qualitative and quantitative numerical values while sequentially outputting the images 810 , 820 , 830 , 840 , and 850 .

In this case, the qualitative and quantitative values may be determined for each of a plurality of items. For example, the images 810, 820, 830, 840, and 850 are at least one of wrinkles, blemishes, troubles, pores, oil, moisture, sebum, pigment, homogeneity (skin texture), blemishes, dead skin cells and skin tone, and elasticity. It can be judged for one item.

For example, in the case of the eyes, at least one of wrinkles, skin tone, elasticity, blemishes, and blemishes may be judged, and in the case of both cheeks (wider side), oil, moisture, homogeneity, blemishes, troubles, pores and skin tone It may be determined with respect to at least one of the items. In the case of the lips, wrinkles, moisture, elasticity, and troubles can be judged. As such, the evaluation items and the number of evaluation items may be changed according to the characteristics of the part of the image. However, the present embodiment is not limited thereto.

For example, the electronic device 100 may output scores analyzed by artificial intelligence (AI) and/or scores analyzed by an expert together on the images. Alternatively, the artificial intelligence may learn this by using the score analyzed by the expert as training data, and the artificial intelligence may derive and output the final score. Alternatively, a final score reflecting the expert's score and the artificial intelligence score may be derived and outputted together on the images.

According to an embodiment, a questionnaire may be collected in order to analyze the degree to which the user perceives a change in his or her skin. The collected collection is stored in the memory 140 and may be utilized during skin analysis later.

Various embodiments disclosed in this document may be applied to various types of electronic devices. The electronic device may include, for example, a TV, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, and a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise.

As used herein, “A or B”, “at least one of A and B”, “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. that one (eg first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively” When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be implemented as software including one or more instructions stored in a storage medium or an external memory readable by a machine. For example, the processor of the device may call at least one of the one or more instructions stored from the storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices (eg, It can be distributed (eg downloaded or uploaded) directly or online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims (15)

In an electronic device,
housing,
a display disposed on one surface of the housing;
a camera exposed through the display or disposed in a designated area of the housing;
a memory for storing images captured by the camera; and
a processor connected to the display, the camera, and the memory;
The processor is:
Taking a first image in response to a user input, wherein the first image includes a side image,
Obtaining a second image obtained by changing the first image to a specified angle by using a body part included in the first image as a landmark,
At least a partial region of the second image is extracted based on a body part included in the second image, and if the second image is a side image, the body part is both cheeks or both cheeks, side chin, and side eye area and at least one of a side mouth;
changing the color of the at least some area to a specified level,
Analyzes features included in the at least some regions and displays them in a designated pattern,
Merging the plurality of images stored in the memory and the at least partial region in which the specified pattern is displayed, generating a panoramic image or moving picture representing the skin change of the user from the past to the present, and sequentially outputting it on the display,
An electronic device for outputting a score analyzed by an artificial intelligence or an expert for a plurality of items through the images stored in the memory on the images together.
According to claim 1,
The processor changes the first image to the specified angle by any one of interpolation and 3-D deep learning based on a body part included in the first image.
According to claim 1,
The at least partial area is an area spaced apart by a specified distance based on a body part included in the second image.
According to claim 1,
and the processor changes a color of the at least partial region based on any one color among images stored in the memory.
According to claim 1,
and the processor changes a color of the at least partial region based on an average value of colors of images stored in the memory.
According to claim 1,
and the processor enlarges the sizes of the features and outputs them on the display.
According to claim 1,
and the processor outputs the number of features to the display.
The method according to claim 1,
The plurality of items are
It may be at least one of wrinkles, blemishes, troubles, pores, oil, moisture, sebum, pigment, homogeneity, blemishes, dead skin cells, skin tone and elasticity,
The score includes a first score analyzed by the expert and a second score derived by the artificial intelligence,
The artificial intelligence is
After learning using the first score as training data, the electronic device derives the second score for the images stored in the memory.
in the server,
memory for storing images, and
a processor connected to the memory;
The processor is:
Upon receiving the first image from the electronic device, a second image obtained by changing the first image to a specified angle by using a body part included in the first image as a landmark is obtained, wherein the first image includes a side image, ,
At least a partial region of the second image is extracted based on a body part included in the second image, and if the second image is a side image, the body part is both cheeks or both cheeks, side chin, and side eye area and at least one of a side mouth;
changing the color of the at least some area to a specified level,
Analyzes features included in the at least some regions and displays them in a designated pattern,
Merging the plurality of images stored in the memory and the at least partial region on which the specified pattern is displayed, generating a panoramic image or moving picture representing the skin change of the user from the past to the present, and transmitting it to the electronic device,
A server that transmits scores analyzed by artificial intelligence or experts for a plurality of items through the images stored in the memory.
10. The method of claim 9,
The processor changes the first image to the specified angle by any one of interpolation and 3-D deep learning based on a body part included in the first image.
10. The method of claim 9,
The server, wherein the at least partial region is a region spaced apart by a specified distance based on the body part included in the second image.
10. The method of claim 9,
The processor changes the color of the at least partial region based on any one color of the images stored in the memory.
10. The method of claim 9,
The processor is configured to change the color of the at least partial region based on an average value of the colors of the images stored in the memory.
10. The method of claim 9,
The plurality of items are
It may be at least one of wrinkles, blemishes, troubles, pores, oil, moisture, sebum, pigment, homogeneity, blemishes, dead skin cells, skin tone and elasticity,
The score includes a first score analyzed by the expert and a second score derived by the artificial intelligence,
The artificial intelligence is
After learning using the first score as training data, the server derives the second score for the images stored in the memory.
In a system for tracking skin changes,
The system is
an electronic device for capturing a first image; and
and a server for receiving the photographed first image from the electronic device,
The server is:
The first image includes a side image,
Obtaining a second image obtained by changing the first image to a specified angle by using a body part included in the first image as a landmark,
At least a partial region of the second image is extracted based on a body part included in the second image, and if the second image is a side image, the body part is both cheeks or both cheeks, side chin, and side eye area and at least one of a side mouth;
changing the color of the at least some area to a specified level,
Analyzes features included in the at least some regions and displays them in a designated pattern,
Transmitting the pre-stored images and the at least partial region on which the specified pattern is displayed to the electronic device,
The electronic device includes:
Merging the pre-stored images and the at least partial area on which the specified pattern is displayed, generating and sequentially outputting a panoramic image or a video representing the user's skin change from the past to the present,
A system for outputting a score analyzed for a plurality of items by an artificial intelligence or an expert through the pre-stored images together on the images.

Images