CN116473520B - Electronic equipment and skin analysis method and device thereof - Google Patents
Electronic equipment and skin analysis method and device thereof Download PDFInfo
- Publication number
- CN116473520B CN116473520B CN202310566310.9A CN202310566310A CN116473520B CN 116473520 B CN116473520 B CN 116473520B CN 202310566310 A CN202310566310 A CN 202310566310A CN 116473520 B CN116473520 B CN 116473520B
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- images
- skin
- video stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 117
- 238000000034 method Methods 0.000 claims description 25
- 238000012549 training Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 12
- 206010000496 acne Diseases 0.000 claims description 5
- 239000011148 porous material Substances 0.000 claims description 3
- 230000037303 wrinkles Effects 0.000 claims description 3
- 206010014970 Ephelides Diseases 0.000 claims description 2
- 208000003351 Melanosis Diseases 0.000 claims description 2
- 206010040954 Skin wrinkling Diseases 0.000 claims description 2
- 238000005286 illumination Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 6
- 238000013527 convolutional neural network Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 208000002874 Acne Vulgaris Diseases 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 230000003796 beauty Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013210 evaluation model Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000001303 quality assessment method Methods 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
- 238000012372 quality testing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
- A61B5/444—Evaluating skin marks, e.g. mole, nevi, tumour, scar
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Dermatology (AREA)
- Signal Processing (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Psychiatry (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Image Analysis (AREA)
Abstract
Description
技术领域Technical Field
本申请涉及美容领域,尤其涉及一种电子设备及其肤质分析方法和装置。The present application relates to the field of beauty, and in particular to an electronic device and a skin quality analysis method and device thereof.
背景技术Background Art
现有的皮肤分析方法,一般通过AI算法,直接对输入的人脸图像进行处理分析,得出肤质各项参数(粗糙度,斑点,毛孔,皱纹,痘痘等)。在该方法作用的过程中,图像质量对分析结果的影响非常大,同一个人,即使在同一时间段进行测量分析,因图像质量,例如清晰度,距离摄像头远近,偏转角度,光照等因素的影响,其分析结果间亦会有较大差异。这种因图像质量参差不齐带来的波动性,使得肤质分析的有效性,不同人测量的结果,同人不同次测量的结果之间的可比性不强。Existing skin analysis methods generally use AI algorithms to directly process and analyze the input face images to obtain various skin quality parameters (roughness, spots, pores, wrinkles, acne, etc.). During the process of this method, the image quality has a great impact on the analysis results. Even if the same person is measured and analyzed in the same time period, the analysis results will vary greatly due to factors such as image quality, such as clarity, distance from the camera, deflection angle, and lighting. This volatility caused by uneven image quality makes the effectiveness of skin quality analysis, the results of measurements of different people, and the results of different measurements of the same person not very comparable.
发明内容Summary of the invention
本申请旨在至少解决现有技术中存在的技术问题之一。The present application aims to solve at least one of the technical problems existing in the prior art.
为解决上述技术问题,本申请的技术方案是:In order to solve the above technical problems, the technical solution of this application is:
第一方面,本申请提供一种肤质分析方法,应用于一电子设备,所述肤质分析方法包括步骤:In a first aspect, the present application provides a skin quality analysis method, which is applied to an electronic device, and the skin quality analysis method comprises the steps of:
控制摄像装置采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;Controlling the camera device to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;Selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image of the video stream as at least one frame of target image;
根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及Performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出所述肤质分析结果。The skin quality analysis result is outputted.
第二方面,本申请提供一种电子设备,包括处理器、存储器和摄像装置,所述摄像装置和所述存储器分别与所述处理器电性连接,所述存储器中存储有计算机程序,所述处理器运行所述计算机程序而执行肤质分析方法的步骤:In a second aspect, the present application provides an electronic device, including a processor, a memory, and a camera device, wherein the camera device and the memory are electrically connected to the processor, respectively, and a computer program is stored in the memory, and the processor runs the computer program to perform the steps of the skin quality analysis method:
控制摄像装置采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;Controlling the camera device to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;Selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image of the video stream as at least one frame of target image;
根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及Performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出所述肤质分析结果。The skin quality analysis result is outputted.
第三方面,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序能够被一处理器运行而执行肤质分析方法的步骤:In a third aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program can be run by a processor to perform the steps of the skin quality analysis method:
控制摄像装置采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;Controlling the camera device to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;Selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image of the video stream as at least one frame of target image;
根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及Performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出所述肤质分析结果。The skin quality analysis result is outputted.
第四方面,本申请还提供一种肤质测量装置,包括:In a fourth aspect, the present application also provides a skin quality measurement device, comprising:
采集控制模块,用于控制摄像装置采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;An acquisition control module, used to control the camera device to acquire a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
图像选择模块,用于从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;An image selection module, used to select at least one frame of image that meets the image quality requirement from the plurality of frames of image in the video stream as at least one frame of target image;
肤质分析模块,用于根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及a skin quality analysis module, configured to perform skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出控制模块,用于输出所述肤质分析结果。The output control module is used to output the skin quality analysis result.
与现有技术相比,本申请的有益效果在于:Compared with the prior art, the beneficial effects of this application are:
从而,开放环境下,实时采集视频流,而非静置采集图片,做到高效、无感采集,提升用户体验;而且,所有用于肤质分析的图像,能控制在同一质量水平之上,提升肤质分析结果的稳定性及可比性,去除因图像本身质量问题所带来的噪声问题,提高肤质分析准确度。Therefore, in an open environment, video streams can be collected in real time rather than statically collecting pictures, achieving efficient and seamless collection and improving user experience. Moreover, all images used for skin analysis can be controlled at the same quality level, improving the stability and comparability of skin analysis results, removing noise problems caused by image quality problems themselves, and improving the accuracy of skin analysis.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本申请一实施例中的电子设备的模块示意图。FIG. 1 is a schematic diagram of a module of an electronic device in an embodiment of the present application.
图2为本申请一实施例中的肤质分析方法的流程示意图。FIG. 2 is a schematic flow chart of a skin quality analysis method in one embodiment of the present application.
图3为本申请一实施例中对帧图像进行打标的各种情形的统计示例。FIG. 3 is a statistical example of various situations of marking frame images in an embodiment of the present application.
图4为本申请另一实施例中的肤质分析方法的流程示意图。FIG. 4 is a schematic flow chart of a skin quality analysis method in another embodiment of the present application.
图5为本申请一实施例提供的肤质分析装置的模块示意图。FIG. 5 is a schematic diagram of a module of a skin quality analysis device provided in an embodiment of the present application.
具体实施方式DETAILED DESCRIPTION
下面详细描述本申请的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本申请,而不能理解为对本申请的限制。Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
在本申请中,除非另有明确的规定和限定,术语“相连”、“连接”、“固定”等术语应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或成一体;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本申请中的具体含义。In this application, unless otherwise clearly specified and limited, the terms "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
请参考图1,图1为本申请一实施例中的电子设备1的模块示意图。所述电子设备1用于执行肤质分析。所述电子设备1可以是但不限于皮肤分析仪、具有皮肤检测功能的美容仪或者智能终端,或者具有视频采集功能的摄像装置与具有数据分析功能的皮肤分析装置所组成的皮肤分析系统,或者其它能够实现视频采集和数据分析功能的设备,在此不做限定。具体地,所述电子设备1包括存储器11和处理器12。所述存储器11与所述处理器12电性连接。所述存储器11中存储有计算机程序。所述处理器12运行所述计算机程序而执行肤质分析方法的步骤。所述电子设备1还包括摄像装置13。所述摄像装置13与所述处理器12电性连接。所述摄像装置13可以包括一个摄像头或者由多个摄像头组成的摄像头系统,只要在做肤质测试时能够面对用户皮肤,及时准确的采集到图像数据即可,在此不做限定。本实施例中,当所述电子设备1为集成了视频采集功能和数据分析功能的设备时,所述摄像装置13包括前置摄像头。可以理解的是,在其它实施例中,所述摄像装置13不仅包括前置摄像头,还可以包括后置摄像头,而且,根据不同情形,用于采集目标皮肤处视频流的摄像头可以在前置摄像头和后置摄像头之间切换。Please refer to Figure 1, which is a module schematic diagram of an electronic device 1 in an embodiment of the present application. The electronic device 1 is used to perform skin quality analysis. The electronic device 1 can be, but is not limited to, a skin analyzer, a beauty instrument or intelligent terminal with a skin detection function, or a skin analysis system composed of a camera with a video acquisition function and a skin analysis device with a data analysis function, or other devices capable of realizing video acquisition and data analysis functions, which are not limited here. Specifically, the electronic device 1 includes a memory 11 and a processor 12. The memory 11 is electrically connected to the processor 12. A computer program is stored in the memory 11. The processor 12 runs the computer program to execute the steps of the skin quality analysis method. The electronic device 1 also includes a camera 13. The camera 13 is electrically connected to the processor 12. The camera 13 may include a camera or a camera system composed of multiple cameras, as long as it can face the user's skin when doing skin quality testing and collect image data in a timely and accurate manner, which is not limited here. In this embodiment, when the electronic device 1 is a device integrating video acquisition function and data analysis function, the camera 13 includes a front camera. It is understandable that, in other embodiments, the camera device 13 includes not only a front camera but also a rear camera, and, depending on different situations, the camera used to capture the video stream at the target skin can be switched between the front camera and the rear camera.
请参考图2,图2为本申请一实施例中的肤质分析方法的流程示意图。所述肤质分析方法可以应用到上述电子设备1上以实现肤质分析。可以理解的是,所述肤质分析方法的部分步骤可以做增删或者顺序调换,在此不做限定。具体地,所述肤质分析方法包括:Please refer to Figure 2, which is a schematic diagram of the process of the skin quality analysis method in one embodiment of the present application. The skin quality analysis method can be applied to the above-mentioned electronic device 1 to implement skin quality analysis. It is understandable that some steps of the skin quality analysis method can be added or deleted or the order can be changed, which is not limited here. Specifically, the skin quality analysis method includes:
步骤S210:控制摄像装置13采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像。Step S210: Control the camera device 13 to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period.
步骤S220:从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像。Step S220: selecting at least one frame of image that meets the image quality requirement from the plurality of frame images of the video stream as at least one frame of target image.
步骤S230:根据所述至少一帧目标图像进行肤质分析得到肤质分析结果。Step S230: performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result.
步骤S240:输出所述肤质分析结果。Step S240: outputting the skin quality analysis result.
本申请中,肤质分析方法的步骤为:首先控制摄像装置13采集目标皮肤处的视频流,然后根据采集的视频流样本信息提取多帧图像,再从所述多帧图像中选择出符合图像质量要求的帧图像进行肤质分析。从而,开放环境下,实时采集视频流,而非静置采集图片,做到高效、无感采集,提升用户体验;而且,所有用于肤质分析的图像,能控制在同一质量水平之上,提升肤质分析结果的稳定性及可比性,去除因图像本身质量问题所带来的噪声问题,提高肤质分析准确度。In this application, the steps of the skin quality analysis method are: first, control the camera device 13 to collect the video stream at the target skin, then extract multiple frames of images according to the collected video stream sample information, and then select the frame images that meet the image quality requirements from the multiple frames for skin quality analysis. Thus, in an open environment, the video stream is collected in real time instead of statically collecting pictures, so as to achieve efficient and non-sensing collection and improve the user experience; moreover, all images used for skin quality analysis can be controlled at the same quality level, so as to improve the stability and comparability of the skin quality analysis results, remove the noise problems caused by the quality problems of the image itself, and improve the accuracy of skin quality analysis.
其中,所述处理器12控制所述摄像装置13采集目标皮肤处的预设时间段内的视频流,所述预设时间段的时长可以根据实际需要进行设置,例如,5秒钟、10秒钟,或15秒钟等,在此不做限定。可以理解的是,视频流的时长越长,视频流所包括的帧图像就越多,因此,选出高质量图像的概率就越大。当然,这也伴随着运算数据量的增大。因此,实际应用中,需要在高质量图像和运算数据量之间做一定的取舍。Among them, the processor 12 controls the camera device 13 to collect the video stream within a preset time period at the target skin. The duration of the preset time period can be set according to actual needs, for example, 5 seconds, 10 seconds, or 15 seconds, etc., which is not limited here. It can be understood that the longer the duration of the video stream, the more frame images the video stream includes, and therefore, the greater the probability of selecting a high-quality image. Of course, this is also accompanied by an increase in the amount of computing data. Therefore, in practical applications, it is necessary to make a certain trade-off between high-quality images and the amount of computing data.
由于所述视频流的若干帧图像各自生成的时间不同,不同时间的拍摄参数可能会发生轻微的变化,因此,在不同拍摄参数下所拍摄的不同帧图像各自的图像质量也不尽相同,有的帧图像的图像质量相对好些,有的帧图像的图像质量相对差些。因此,从所述视频流的若干帧图像中选择出符合图像质量要求至少一帧图像,每帧图像作为一帧目标图像,可以剔除掉不符合质量要求的帧图像对肤质分析所产生的噪声,可以进一步提高肤质分析的准确性。Since the multiple frames of the video stream are generated at different times, the shooting parameters at different times may change slightly. Therefore, the image quality of different frames shot under different shooting parameters is also different. Some frames have relatively good image quality, while some frames have relatively poor image quality. Therefore, at least one frame that meets the image quality requirements is selected from the multiple frames of the video stream, and each frame is used as a target image. The noise generated by the frames that do not meet the quality requirements for skin quality analysis can be eliminated, which can further improve the accuracy of skin quality analysis.
一些实施例中,从所述视频流的若干帧图像中选择出符合图像质量要求至少一帧图像的方式可以有多种,在此不做限定。In some embodiments, there may be multiple ways to select at least one frame of image that meets the image quality requirement from a plurality of frames of image in the video stream, which are not limited here.
以下详细介绍其中两种选择方式。Two of these options are described in detail below.
第一种方式为:The first method is:
所述从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像,包括:The step of selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image in the video stream as at least one frame of target image comprises:
从所述视频流中提取多帧图像;Extracting multiple frames of images from the video stream;
将所述多帧图像分别进行评分,以得到每帧图像的图像质量评分;Scoring the multiple frames of images respectively to obtain an image quality score for each frame of image;
根据每帧图像的图像质量评分从所述多帧图像中选出符合图像质量要求的至少一帧图像作为所述至少一帧目标图像。At least one frame of image that meets the image quality requirement is selected from the multiple frames of image according to the image quality score of each frame of image as the at least one frame of target image.
从而,第一种方式需要首先对提取出的所述多帧图像中的每一帧图像进行图像质量评分,在得到提取出的所述多帧图像中的每一帧图像的图像质量评分后,可以择优选出至少一帧图像作为所述至少一帧目标图像。Therefore, the first method needs to first perform an image quality score on each frame of the multiple frames extracted. After obtaining the image quality score of each frame of the multiple frames extracted, at least one frame of the image can be selected as the at least one target image.
一些实施例中,所述根据每帧图像的图像质量评分从所述多帧图像中选出符合图像质量要求的至少一帧图像作为所述至少一帧目标图像,包括:In some embodiments, the step of selecting at least one frame of image that meets the image quality requirement from the multiple frames of image according to the image quality score of each frame of image as the at least one frame of target image includes:
根据每帧图像的图像质量评分从所述多帧图像中选择出图像质量评分最高的一帧或者图像质量评分相对最高的至少两帧图像作为所述至少一帧目标图像;或者,According to the image quality score of each frame of image, one frame with the highest image quality score or at least two frames of image with the relatively highest image quality scores are selected from the multiple frames of image as the at least one frame of target image; or
根据每帧图像的图像质量评分从所述多帧图像中随机选择出符合图像质量要求的至少一帧图像作为所述至少一帧目标图像。At least one frame of image that meets the image quality requirement is randomly selected from the multiple frames of image according to the image quality score of each frame of image as the at least one frame of target image.
从而,通过以上第一种方式,可以择优选出所述视频流的多帧图像中图像质量最好或者相对最好的帧图像作为目标图像,可以进一步提高肤质分析准确度。Therefore, through the first method above, the frame image with the best or relatively best image quality among the multiple frames of the video stream can be selected as the target image, which can further improve the accuracy of skin quality analysis.
第二种方式为:The second method is:
所述从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像,包括:The step of selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image in the video stream as at least one frame of target image comprises:
从所述视频流中提取多帧图像;Extracting multiple frames of images from the video stream;
对所述多帧图像从第一帧图像开始进行依序评分,并在对每一帧图像评分而得到图像质量评分后,判断该帧图像的图像质量评分是否满足图像质量要求,如果该帧图像的图像质量评分满足图像质量要求,则确定该帧图像为目标图像;Scoring the multiple frames of images in sequence starting from the first frame of image, and after scoring each frame of image to obtain an image quality score, determining whether the image quality score of the frame of image meets the image quality requirement, and if the image quality score of the frame of image meets the image quality requirement, determining the frame of image to be a target image;
如果该帧图像的图像质量评分不满足图像质量要求,则对所述多帧图像中的下一帧图像进行评分,直至确定出图像质量评分满足图像质量要求的目标图像。If the image quality score of the frame image does not meet the image quality requirement, the next frame image in the multiple frames of images is scored until a target image whose image quality score meets the image quality requirement is determined.
例如,首先对所述多帧图像中的第一帧图像进行评分,以得到该第一帧图像的图像质量评分;For example, firstly, a first frame of the multiple frames of images is scored to obtain an image quality score of the first frame of the image;
判断该第一帧图像的图像质量评分是否满足图像质量要求,如果该第一帧图像的图像质量评分满足图像质量要求,则确定该第一帧图像为目标图像;Determining whether the image quality score of the first frame image meets the image quality requirement, and if the image quality score of the first frame image meets the image quality requirement, determining that the first frame image is the target image;
如果该第一帧图像的图像质量评分不满足图像质量要求,则对所述多帧图像中的第二帧图像进行评分,以得到该第二帧图像的图像质量评分;If the image quality score of the first frame image does not meet the image quality requirement, scoring the second frame image in the multiple frames of images to obtain the image quality score of the second frame image;
再次判断该第二帧图像的图像质量评分是否满足图像质量要求,如果该第二帧图像的图像质量评分满足图像质量要求,则确定该第二帧图像为目标图像;Determining again whether the image quality score of the second frame image meets the image quality requirement, and if the image quality score of the second frame image meets the image quality requirement, determining that the second frame image is the target image;
如果该第二帧图像的图像质量评分不满足图像质量要求,则对所述多帧图像中的第三帧图像进行评分;如此重复,直至确定出图像质量评分满足图像质量要求的目标图像。If the image quality score of the second frame image does not meet the image quality requirement, the third frame image in the multiple frames of images is scored; and this process is repeated until a target image whose image quality score meets the image quality requirement is determined.
从而,第二种方式中,从第一帧图像开始进行图像质量评分并进行判断该第一帧图像的图像质量评分是否满足图像质量要求,如果第一帧图像满足图像质量要求,则将该第一帧图像作为目标图像;此时,如果目的是只选择一帧目标图像进行肤质分析,则可以结束目标图像的选择流程,不用再对所述多帧图像中的第二帧图像、第三帧图像等再进行图像质量评分以及是否符合图像质量要求的判断。因此,可以极大程序的减少数据运算量。如果在确定了一帧目标图像后,还需要确定第二帧目标图像、第三帧目标图像等时,则继续执行类似判断过程,直到选出定第二帧目标图像、第三帧目标图像等时,结束目标图像的选择流程。Thus, in the second method, the image quality score is performed starting from the first frame image and it is judged whether the image quality score of the first frame image meets the image quality requirements. If the first frame image meets the image quality requirements, the first frame image is used as the target image. At this time, if the purpose is to select only one frame of target image for skin quality analysis, the target image selection process can be terminated, and there is no need to perform image quality scores on the second frame image, the third frame image, etc. in the multiple frames of images and judge whether they meet the image quality requirements. Therefore, the amount of data calculation can be greatly reduced. If after determining one frame of target image, it is necessary to determine the second frame of target image, the third frame of target image, etc., then continue to perform a similar judgment process until the second frame of target image, the third frame of target image, etc. are selected, and then the target image selection process is terminated.
一些实施例中,如果在将所述多帧图像都进行图像质量评分以及是否符合图像质量要求的判断后,仍然没有选择出符合图像质量要求的帧图像作为目标图像,则从所述视频流中再提取与该多帧图像不同的下一组多帧图像,并再次进行该下一组多帧图像的图像质量评分以选择满足图像质量要求的目标图像,直至选择出满足图像质量要求的目标图像。In some embodiments, if after the multiple frame images have been scored for image quality and judged whether they meet the image quality requirements, a frame image that meets the image quality requirements has not been selected as the target image, then the next group of multiple frame images that are different from the multiple frame images are extracted from the video stream, and the image quality of the next group of multiple frame images is scored again to select a target image that meets the image quality requirements, until a target image that meets the image quality requirements is selected.
一些实施例中,从视频流中提取一组多帧图像,例如,一组多帧图像可以是连续的10帧图像,可以是从所述视频流的起始位置选择的一组多帧图像,再次提取下一组多帧图像是从所述一组多帧图像的末尾端开始提取,例如,从第11帧图像开始的连续的10帧图像,如此重复,直至确定出图像质量评分满足图像质量要求的目标图像。在其它实施例中,从视频流中提取一组多帧图像,可以是从所述视频流的任意位置选择一组多帧图像,再次提取下一组多帧图像是从所述一组多帧图像不重合的另一位置开始提取,总之只要保证下一组帧图像与该一组多帧图像的帧图像不重复即可。例如,一组多帧图像可以是从第21帧图像开始的连续的10帧图像,下一组多帧图像可以是从第41帧图像开始的连续的10帧图像。In some embodiments, a group of multi-frame images is extracted from a video stream, for example, a group of multi-frame images may be a group of 10 consecutive frames, or may be a group of multi-frame images selected from the starting position of the video stream, and the next group of multi-frame images is extracted from the end of the group of multi-frame images, for example, 10 consecutive frames starting from the 11th frame image, and this is repeated until a target image whose image quality score meets the image quality requirement is determined. In other embodiments, a group of multi-frame images is extracted from a video stream, and a group of multi-frame images may be selected from any position of the video stream, and the next group of multi-frame images is extracted from another position that does not overlap with the group of multi-frame images, in short, as long as the next group of frame images is guaranteed not to overlap with the frame images of the group of multi-frame images. For example, a group of multi-frame images may be a group of 10 consecutive frames starting from the 21st frame image, and the next group of multi-frame images may be a group of 10 consecutive frames starting from the 41st frame image.
一些实施例中,对每帧图像进行图像质量评分,包括:In some embodiments, performing an image quality score on each frame of image includes:
将每帧图像从至少一个维度进行质量打标以得到至少一个打标结果,其中,所述至少一个维度包括清晰度、光照度和正面度的其中至少一种;以及,Performing quality marking on each frame of image from at least one dimension to obtain at least one marking result, wherein the at least one dimension includes at least one of clarity, illumination, and frontality; and
根据每帧图像的打标结果得到每帧图像的图像质量评分。The image quality score of each frame of image is obtained according to the marking result of each frame of image.
可以理解的是,在其它实施例中,所述至少一个维度还可以包括其它维度,在此不做限定。It can be understood that, in other embodiments, the at least one dimension may also include other dimensions, which are not limited here.
请参考图3,图3为本申请一实施例中对帧图像进行打标的各种情形的统计示例。Please refer to FIG. 3 , which is a statistical example of various situations of marking frame images in an embodiment of the present application.
图3示出了每帧图像进行打标的三个维度,分别是清晰度、正面度和光照度。其中,每个维度都包括合格和不合格的情形。当满足合格的情形时,对该帧图像的该维度打标为第一标签,当满足不合格的情形时,对该帧图像的该维度打标为第二标签。所述第一标签和所述第二标签各自代表不同的含义。例如,在清晰度维度下,所述第一标签为1清晰、所述第二标签为0不清晰。对清晰度合格的定义为人脸清晰,美学特征可分辨。对清晰度不合格的情形则包括:明显模糊、痘痣细纹不可辨别、面部局部模糊等。在正面度维度下,所述第一标签为1正、所述第二标签为0不正。对正面度合格的定义为人脸正面成像、无偏斜遮挡。对正面度不合格的情形则包括:低头抬头、左右偏、不全或者有遮挡、明显表情等。在光照度维度下,所述第一标签为1光照良好、所述第二标签为0光照不良。对光照度合格的定义为光照充分、均匀、无强光点、色偏不影响斑痣痘判断。对光照度不合格的情形则包括:光照度太强或太暗、光照不均、偏红或偏绿、有强光点等。FIG3 shows three dimensions for marking each frame of image, namely, clarity, frontality and illumination. Each dimension includes qualified and unqualified situations. When the qualified situation is met, the dimension of the frame image is marked as the first label, and when the unqualified situation is met, the dimension of the frame image is marked as the second label. The first label and the second label each represent different meanings. For example, in the clarity dimension, the first label is 1 clear and the second label is 0 unclear. The definition of qualified clarity is that the face is clear and the aesthetic features are distinguishable. The situations of unqualified clarity include: obvious blur, indistinguishable acne, moles and fine lines, and partial blur of the face. In the frontality dimension, the first label is 1 positive and the second label is 0 unpositive. The definition of qualified frontality is frontal imaging of the face and no deflection and occlusion. The situations of unqualified frontality include: bowing and raising the head, left and right deviation, incomplete or blocked, obvious expression, etc. In the illumination dimension, the first label is 1 good lighting and the second label is 0 poor lighting. The definition of qualified illumination is that the illumination is sufficient and uniform, there is no strong light spot, and the color deviation does not affect the judgment of spots, moles and acne. The situations of unqualified illumination include: the illumination is too strong or too dark, the illumination is uneven, it is reddish or greenish, there are strong light spots, etc.
一些实施例中,对每帧图像输出打标结果,包括:In some embodiments, outputting a marking result for each frame of image includes:
对每帧图像输出至少一个维度的打标结果,其中,每个维度的打标结果表明了该帧图像在该维度上的表现良好的概率值。Output at least one dimension of labeling results for each frame of image, wherein the labeling result of each dimension indicates the probability value of the frame of image performing well in the dimension.
例如,一示例中,对目标图像进行图像质量评价的示例如下:For example, in one example, an example of image quality evaluation of a target image is as follows:
一帧图像经图像质量评价模型的输出为On=(Pqo,Pzo,Pgo),其中Pqo,Pzo,Pgo分别表示清晰度、正面度,光照度良好的概率值,取值范围为[0,1]。例如,Pqo值为0.7,表示帧图像清晰的概率为0.7;Pzo=0.3,表示帧图像正面的概率为0.3(即不正面),Pgo=0.5,表示帧图像光照良好的概率为0.5(介于良好与不良之间)。The output of the image quality assessment model for a frame of image is On = (Pqo, Pzo, Pgo), where Pqo, Pzo, and Pgo represent the probability values of clarity, frontality, and good illumination, respectively, and the value range is [0, 1]. For example, a Pqo value of 0.7 means that the probability of a frame image being clear is 0.7; Pzo = 0.3 means that the probability of a frame image being frontal is 0.3 (i.e., not frontal); and Pgo = 0.5 means that the probability of a frame image being well illuminated is 0.5 (between good and bad).
一些实施例中,根据每帧图像的打标结果得到每帧图像的图像质量评分,包括:In some embodiments, the image quality score of each frame of image is obtained according to the marking result of each frame of image, including:
对帧图像的各维度的评估概率做综合打分。Make a comprehensive score for the evaluation probability of each dimension of the frame image.
例如,上述示例中,对该帧图像的综合得分=(Pqo+Pzo+Pgo)/3*100%。该综合得分就是每帧图像的图像质量评分。可以理解的是,在其它实施例中,在得到每帧图像在每个维度上表现良好的概率值后,帧图像的各维度的评估概率做综合打分可以不限于上述求平均分的方式,还可以是对每个维度做加权系数,再求均值,或者其它方式,在此不做限定。For example, in the above example, the comprehensive score of the frame image = (Pqo+Pzo+Pgo)/3*100%. The comprehensive score is the image quality score of each frame image. It is understandable that in other embodiments, after obtaining the probability value of each frame image performing well in each dimension, the evaluation probability of each dimension of the frame image is used for comprehensive scoring, which may not be limited to the above-mentioned method of finding the average score, but may also be a weighted coefficient for each dimension, and then find the average, or other methods, which are not limited here.
一些实施例中,选出符合图像质量要求的至少一帧图像,包括:In some embodiments, selecting at least one frame of image that meets the image quality requirement includes:
将每帧图像的图像质量评分与系统设置阀值进行比较,超过所述系统设置阀值表示合格,低于所述系统设置阀值则表示不合格,需要继续从帧图像中进行选择,直至选出符合图像质量要求的至少一帧图像作为至少一帧目标图像。The image quality score of each frame image is compared with the system setting threshold. If it exceeds the system setting threshold, it is qualified, and if it is lower than the system setting threshold, it is unqualified. It is necessary to continue selecting from the frame images until at least one frame image that meets the image quality requirements is selected as at least one target image.
一些实施例中,所述将每帧图像从至少一个维度进行质量打标以得到至少一个打标结果之前,所述方法还包括:In some embodiments, before performing quality marking on each frame of image from at least one dimension to obtain at least one marking result, the method further includes:
输入若干训练图像,所述若干训练图像涵盖所述至少一个维度的不同情形;Inputting a plurality of training images, wherein the plurality of training images cover different situations of the at least one dimension;
根据所述若干训练图像进行智能评分模型的训练;Training an intelligent scoring model according to the plurality of training images;
在所述智能评分模型训练完成后,对每帧图像进行图像质量评分为将每帧图像输入所述智能评分模型以进行图像质量评分。After the training of the intelligent scoring model is completed, the image quality scoring of each frame of image is performed by inputting each frame of image into the intelligent scoring model to perform image quality scoring.
一些实施例中,智能评分模型的训练过程如下:In some embodiments, the training process of the intelligent scoring model is as follows:
1、数据打标。将所有训练图像按上述方法打标分类,并对所有训练图像分类得到样本训练样本和测试样本。其中,每张图像的打标,Ln=(Pq,Pz,Pg),Ln表示第n张图像的标签,其中Pq,Pz,Pg分别表示图像在清晰度、正面度,光照度维度上的取值,取值为0或1,其中,0表示不清晰、不正或光照不良,1表示清晰、正或光照良好。举例,图像清晰、不正,光照不良,则该图像标签为(1,0,0)。1. Data labeling. Label and classify all training images according to the above method, and classify all training images to obtain sample training samples and test samples. Among them, the label of each image, Ln = (Pq, Pz, Pg), Ln represents the label of the nth image, where Pq, Pz, Pg represent the values of the image in the dimensions of clarity, frontality, and illumination, respectively, and the values are 0 or 1, where 0 represents unclear, incorrect, or poorly illuminated, and 1 represents clear, correct, or well-illuminated. For example, if the image is clear, incorrect, and poorly illuminated, the image label is (1, 0, 0).
2、CNN(卷积神经网络)模型搭建。搭建CNN人脸图像评价的三分类(清晰,正面,光照)模型,设置模型损失函数与优化器,并对模型参数进行初始化。2. Build a CNN (convolutional neural network) model. Build a three-classification (clear, frontal, and illumination) CNN face image evaluation model, set the model loss function and optimizer, and initialize the model parameters.
模型训练:训练样本输入CNN模型,依据损失函数与优化器设置,对模型参数进行多轮学习迭代,直至模型收敛。Model training: The training samples are input into the CNN model, and the model parameters are subjected to multiple rounds of learning iterations according to the loss function and optimizer settings until the model converges.
模型评价:测试样本输入训练得到的CNN模型,将模型预测得到的分类结果与标签进行对比,评价模型预测的精度,精度大于控制阀值(例如,99%),则模型训练完成,否则调整模型训练与模型评价中学习参数或迭代次数,进行重新训练。Model evaluation: Test samples are input into the trained CNN model, and the classification results predicted by the model are compared with the labels to evaluate the accuracy of the model prediction. If the accuracy is greater than the control threshold (for example, 99%), the model training is completed. Otherwise, the learning parameters or number of iterations in the model training and model evaluation are adjusted and retraining is performed.
3、模型精度定义。假设模型所有预测为正样本(清晰且正面且光照良好)且预测正确的个数为m,该样本集中所有正样本为n,则模型精度为m/n。3. Definition of model accuracy: Assume that all predictions of the model are positive samples (clear, positive and well-lit) and the number of correct predictions is m, and the number of positive samples in the sample set is n, then the model accuracy is m/n.
之所以选择精度作为模型评价指标,是希望确保筛选出的正样本图像的错误率较小,而保障筛选出来的图像有较高的质量。The reason why accuracy is chosen as the model evaluation indicator is to ensure that the error rate of the screened positive sample images is small and the screened images are of high quality.
4、模型保存部署。将训练得到模型进行保存并部署于实际运行的系统中。4. Save and deploy the model. Save the trained model and deploy it in the actual running system.
可以理解的是,再其它实施例中,可以通过其它算法训练并得到上述智能评分模型,在此不做限定。It is understandable that in other embodiments, the above intelligent scoring model can be obtained by training with other algorithms, which is not limited here.
一些实施例中,所述根据所述至少一帧目标图像进行肤质分析得到肤质分析结果,包括:In some embodiments, performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result includes:
提取每个所述目标图像内的关键点信息,所述关键点信息包括法令纹、黑眼圈、毛孔、皱纹、黑头、雀斑中的至少一种;以及,Extracting key point information in each of the target images, wherein the key point information includes at least one of nasolabial folds, dark circles, pores, wrinkles, blackheads, and freckles; and,
根据所述至少一帧目标图像内的关键点信息评估肤质好坏以得到肤质分析结果。The skin quality is evaluated according to the key point information in the at least one frame of the target image to obtain a skin quality analysis result.
一些实施例中,所述至少一帧目标图像具有一帧目标图像和具有至少两帧图标图像两种情况。当所述目标图像为一帧目标图像时,针对该目标图像进行肤质分析,以得到所述肤质分析结果。当所述目标图像为多帧目标图像时,针对所述多帧目标图像分别进行肤质分析而得到多个分析结果,并根据所述多个分析结果综合分析后得到所述肤质分析结果。In some embodiments, the at least one target image frame includes one target image frame and at least two icon images. When the target image is a one-frame target image, skin quality analysis is performed on the target image to obtain the skin quality analysis result. When the target image is a multi-frame target image, skin quality analysis is performed on the multi-frame target images respectively to obtain multiple analysis results, and the skin quality analysis result is obtained after comprehensive analysis based on the multiple analysis results.
一些实施例中,所述方法还包括:In some embodiments, the method further comprises:
输出所述至少一帧目标图像的图像质量评分。Output the image quality score of the at least one frame of target image.
一些实施例中,当所述至少一帧目标图像为一帧目标图像时,输出该帧目标图像的图像质量评分。In some embodiments, when the at least one frame of target image is a frame of target image, an image quality score of the frame of target image is output.
另一些实施例中,当所述至少一帧目标图像为两帧或者多帧目标图像时,可以输出该两帧或者多帧目标图像的综合的图像质量评分。In some other embodiments, when the at least one frame of target image is two or more frames of target image, a comprehensive image quality score of the two or more frames of target image may be output.
请参考图4,图4为本申请另一实施例中的肤质分析方法的流程示意图。Please refer to FIG. 4 , which is a flow chart of a skin quality analysis method in another embodiment of the present application.
步骤S410:控制摄像装置13采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像。Step S410: Control the camera device 13 to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period.
步骤S420:从所述视频流中提取图像。Step S420: extracting images from the video stream.
步骤S430:对所提取的图像进行图像质量评分。Step S430: performing image quality scoring on the extracted image.
步骤S440:判断图像质量评分是否大于系统设置阀值,如果是,则进入步骤S450,否则,进入步骤S410。Step S440: Determine whether the image quality score is greater than a system-set threshold, if so, proceed to step S450, otherwise, proceed to step S410.
步骤S450:根据所述至少一帧目标图像进行肤质分析得到肤质分析结果。Step S450: performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result.
步骤S460:输出所述肤质分析结果以及输出所述图像质量评分。Step S460: output the skin quality analysis result and the image quality score.
本申请进行肤质分析的总体思路是:采集总的视频流,然后从该视频流中提取连续的多帧图像,然后根据图片质量检测AI算法对连续多帧照片的人脸图像标签进行提取、图像打分,并存储输出图像质量评分。对不符合图像质量要求的图像进行淘汰。如果在该多帧图像中更没有找到符合质量要求的图像,则重新从该视频流中提取连续的多帧图像,在进行图像标签的提取以及对评估结果的打分,直至筛选出符合图像质量要求的图像作为目标图像。然后,对目标图像进行肤质分析采用皮肤肤质分析AI算法。从而,本申请通过串联图像质量检测AI算法和皮肤肤质分析AI算法,实现了在高质量图像基础上进行肤质分析,使得分析结果更稳定,不同次测量结果可比性更强。The overall idea of skin quality analysis in this application is: collect the total video stream, then extract continuous multi-frame images from the video stream, and then extract the face image labels of the continuous multi-frame photos according to the picture quality detection AI algorithm, score the images, and store the output image quality scores. Images that do not meet the image quality requirements are eliminated. If no images that meet the quality requirements are found in the multi-frame images, continuous multi-frame images are extracted from the video stream again, and the image labels are extracted and the evaluation results are scored until the image that meets the image quality requirements is screened out as the target image. Then, the skin quality analysis AI algorithm is used to analyze the skin quality of the target image. Thus, this application realizes skin quality analysis based on high-quality images by connecting the image quality detection AI algorithm and the skin quality analysis AI algorithm in series, so that the analysis results are more stable and the results of different measurements are more comparable.
本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序能够被一处理器运行而执行所述的肤质分析方法的步骤:The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program can be run by a processor to perform the steps of the skin quality analysis method:
控制摄像装置13采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;Controlling the camera device 13 to collect a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;Selecting at least one frame of image that meets the image quality requirement from the plurality of frames of image of the video stream as at least one frame of target image;
根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及Performing skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出所述肤质分析结果。The skin quality analysis result is outputted.
另外,存储器11可以包括:闪存盘、只读存储器(英文:Read-Only Memory,简称:ROM)、随机存取器(英文:Random Access Memory,简称:RAM)、磁盘或光盘等。所述处理器12可以是通用处理器、数字信号处理器、专用集成电路、现成可编程门阵列或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。处理器可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。处理器可以是图像处理器、微处理器或者该处理器也可以是任何常规的处理器等。结合本发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,例如处理器12可读取存储器中的应用程序、计算机指令或数据,结合其硬件完成电子设备1所执行的上述方法的步骤。In addition, the memory 11 may include: a flash disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. The processor 12 may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a readily available programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The processor may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The processor may be an image processor, a microprocessor, or the processor may also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present invention may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, for example, the processor 12 may read an application, a computer instruction, or data in the memory, and complete the steps of the above method executed by the electronic device 1 in combination with its hardware.
请参考图5,本申请还提供一种肤质分析装置500,所述肤质分析装置500包括:Please refer to FIG. 5 , the present application further provides a skin quality analysis device 500, the skin quality analysis device 500 comprising:
采集控制模块510,用于控制摄像装置采集目标皮肤处的视频流,所述视频流包括预设时间段内的若干帧图像;An acquisition control module 510 is used to control the camera device to acquire a video stream at the target skin, wherein the video stream includes a plurality of frame images within a preset time period;
图像选择模块520,用于从所述视频流的若干帧图像中选出符合图像质量要求的至少一帧图像作为至少一帧目标图像;An image selection module 520, configured to select at least one frame of image that meets the image quality requirement from the plurality of frames of image in the video stream as at least one frame of target image;
肤质分析模块530,用于根据所述至少一帧目标图像进行肤质分析得到肤质分析结果;以及A skin quality analysis module 530, configured to perform skin quality analysis according to the at least one frame of target image to obtain a skin quality analysis result; and
输出控制模块540,用于输出所述肤质分析结果。The output control module 540 is used to output the skin quality analysis result.
在本申请所提供的几个实施例中,应该理解到,所揭露的肤质分析装置500,可通过其它的方式实现。例如,以上所描述的肤质分析装置500的实施例仅仅是示意性的,例如所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided in the present application, it should be understood that the disclosed skin quality analysis device 500 can be implemented in other ways. For example, the embodiment of the skin quality analysis device 500 described above is only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical or other forms.
综上所述可知本申请乃具有以上所述的优良特性,得以令其在使用上,增进以往技术中所未有的效能而具有实用性,成为一极具实用价值的产品。In summary, it can be seen that the present application has the above-mentioned excellent characteristics, which can enhance the performance unprecedented in the prior art and become a product with great practical value.
以上所述仅为本申请的较佳实施例而已,并不用以限制本申请,凡在本申请的思想和原则之内所作的任何修改、等同替换或改进等,均应包含在本申请的保护范围之内。The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions or improvements made within the ideas and principles of the present application should be included in the protection scope of the present application.
Claims (8)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310566310.9A CN116473520B (en) | 2023-05-18 | 2023-05-18 | Electronic equipment and skin analysis method and device thereof |
JP2023219108A JP7492793B1 (en) | 2023-05-18 | 2023-12-26 | Electronic device, skin quality analysis method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310566310.9A CN116473520B (en) | 2023-05-18 | 2023-05-18 | Electronic equipment and skin analysis method and device thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116473520A CN116473520A (en) | 2023-07-25 |
CN116473520B true CN116473520B (en) | 2024-10-29 |
Family
ID=87223306
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310566310.9A Active CN116473520B (en) | 2023-05-18 | 2023-05-18 | Electronic equipment and skin analysis method and device thereof |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP7492793B1 (en) |
CN (1) | CN116473520B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109831680A (en) * | 2019-03-18 | 2019-05-31 | 北京奇艺世纪科技有限公司 | A kind of evaluation method and device of video definition |
CN110858879A (en) * | 2018-08-23 | 2020-03-03 | 浙江宇视科技有限公司 | Video stream processing method, device and computer readable storage medium |
CN113313050A (en) * | 2021-06-15 | 2021-08-27 | 北京美丽年华文化有限公司 | Skin intelligent detection system based on video streaming |
CN113780212A (en) * | 2021-09-16 | 2021-12-10 | 平安科技(深圳)有限公司 | User identity verification method, device, equipment and storage medium |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7697026B2 (en) * | 2004-03-16 | 2010-04-13 | 3Vr Security, Inc. | Pipeline architecture for analyzing multiple video streams |
US10517521B2 (en) * | 2010-06-07 | 2019-12-31 | Affectiva, Inc. | Mental state mood analysis using heart rate collection based on video imagery |
GB2519620B (en) * | 2013-10-23 | 2015-12-30 | Imagination Tech Ltd | Skin colour probability map |
US10524725B2 (en) * | 2014-06-06 | 2020-01-07 | Koninklijke Philips N.V. | Device, system and method for detecting apnoea of a subject |
DE112016002564T5 (en) | 2015-06-08 | 2018-03-22 | Sony Corporation | IMAGE PROCESSING DEVICE, IMAGE PROCESSING AND PROGRAM |
CN105426850B (en) * | 2015-11-23 | 2021-08-31 | 深圳市商汤科技有限公司 | Associated information pushing device and method based on face recognition |
CN107040795A (en) * | 2017-04-27 | 2017-08-11 | 北京奇虎科技有限公司 | The monitoring method and device of a kind of live video |
WO2019126470A1 (en) * | 2017-12-22 | 2019-06-27 | Google Llc | Non-invasive detection of infant bilirubin levels in a smart home environment |
CN110390263A (en) * | 2019-06-17 | 2019-10-29 | 宁波江丰智能科技有限公司 | A kind of method of video image processing and system |
CN110378228A (en) * | 2019-06-17 | 2019-10-25 | 深圳壹账通智能科技有限公司 | Video data handling procedure, device, computer equipment and storage medium are examined in face |
CN110570366A (en) * | 2019-08-16 | 2019-12-13 | 西安理工大学 | Image inpainting method based on dual discriminative deep convolutional generative adversarial network |
CN113674224B (en) * | 2021-07-29 | 2024-11-08 | 浙江大华技术股份有限公司 | A monitoring point management method and device |
JP2023053733A (en) | 2021-10-01 | 2023-04-13 | パナソニックIpマネジメント株式会社 | Imaging Guidance Device, Imaging Guidance Method and Program |
CN114298295A (en) | 2021-12-30 | 2022-04-08 | 上海阵量智能科技有限公司 | Chip, accelerator card, electronic device and data processing method |
CN116129013A (en) * | 2023-02-20 | 2023-05-16 | 上海科技大学 | A method, device and storage medium for generating virtual human animation video |
-
2023
- 2023-05-18 CN CN202310566310.9A patent/CN116473520B/en active Active
- 2023-12-26 JP JP2023219108A patent/JP7492793B1/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110858879A (en) * | 2018-08-23 | 2020-03-03 | 浙江宇视科技有限公司 | Video stream processing method, device and computer readable storage medium |
CN109831680A (en) * | 2019-03-18 | 2019-05-31 | 北京奇艺世纪科技有限公司 | A kind of evaluation method and device of video definition |
CN113313050A (en) * | 2021-06-15 | 2021-08-27 | 北京美丽年华文化有限公司 | Skin intelligent detection system based on video streaming |
CN113780212A (en) * | 2021-09-16 | 2021-12-10 | 平安科技(深圳)有限公司 | User identity verification method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
JP2024166053A (en) | 2024-11-28 |
JP7492793B1 (en) | 2024-05-30 |
CN116473520A (en) | 2023-07-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021082272A1 (en) | Method for determining cardiac cycles and ultrasonic device | |
CN106845374A (en) | Pedestrian detection method and detection means based on deep learning | |
CN111723773B (en) | Method and device for detecting carryover, electronic equipment and readable storage medium | |
CN111191576A (en) | Personnel behavior target detection model construction method, intelligent analysis method and system | |
CN113361513B (en) | Mobile terminal tongue picture acquisition method, device and equipment | |
CN113688741A (en) | A sports training evaluation system and method based on the coordination of event camera and visual camera | |
CN109784230A (en) | A kind of facial video image quality optimization method, system and equipment | |
CN102314591B (en) | Method and equipment for detecting static foreground object | |
CN111226226A (en) | Motion-based object detection method, object detection device and electronic equipment | |
WO2020103462A1 (en) | Video search method and apparatus, computer device, and storage medium | |
CN114100103A (en) | A system and method for skipping rope counting detection based on key point recognition | |
CN113537071A (en) | Static and dynamic target detection method and device based on event camera | |
CN112115950B (en) | Wine label recognition method, wine information management method, device, equipment and storage medium | |
CN116473520B (en) | Electronic equipment and skin analysis method and device thereof | |
CN111669575B (en) | Method, system, electronic device, medium and terminal for testing image processing effect | |
CN113111847A (en) | Automatic monitoring method, device and system for process circulation | |
Liu et al. | A novel method for temporal action localization and recognition in untrimmed video based on time series segmentation | |
US20220284563A1 (en) | Method for discovering defects in products by detecting abnormalities in images, electronic device, and storage medium | |
CN111859019B (en) | Method and related device for obtaining page switching response time | |
CN107818287B (en) | Passenger flow statistics device and system | |
CN111553408B (en) | Automatic test method for video recognition software | |
CN111062337B (en) | People stream direction detection method and device, storage medium and electronic equipment | |
CN110458171B (en) | License plate recognition method and related device | |
CN114596625A (en) | Fish school track monitoring system based on edge calculation | |
CN113141433A (en) | Method and device for testing screen sensitivity and processor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |