CN108509893A - Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition - Google Patents
Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition Download PDFInfo
- Publication number
- CN108509893A CN108509893A CN201810264552.1A CN201810264552A CN108509893A CN 108509893 A CN108509893 A CN 108509893A CN 201810264552 A CN201810264552 A CN 201810264552A CN 108509893 A CN108509893 A CN 108509893A
- Authority
- CN
- China
- Prior art keywords
- micro
- expression
- movie
- television play
- classification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0282—Rating or review of business operators or products
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Development Economics (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Game Theory and Decision Science (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention discloses the video display methods of marking based on micro- Expression Recognition, storage medium and intelligent terminal, the method includes：Micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, exports analysis result；The classification of currently playing movie and television play is obtained, and obtains micro- expression data corresponding to the classification of current movie and television play from preset micro- expression data library；It is given a mark automatically to the movie and television play according to analysis result and micro- expression data of acquisition, and exports final scoring.Micro- expression when the present invention is by user's viewing is analyzed, and is scored automatically video display according to the variation of micro- expression, and scoring is manually entered without user so that marking result is truer, effectively avoids malice, false the case where giving a mark.
Description
Technical field
The present invention relates to consumer electrical product technical fields, and in particular to a kind of video display scoring based on micro- Expression Recognition
Method, storage medium and intelligent terminal.
Background technology
With the development of TV and video display industry, people are also higher and higher for the quality requirement of movie and television play, different
People is also not quite similar for the fancy grade of movie and television play, and therefore, major network site of cinema and TV is also all proposed the function of scoring for video display,
Facilitate the interaction and reference between user.
Overwhelming majority video display scoring website all uses ten point system, such as numerous websites such as bean cotyledon and time to have oneself at present
Algorithm come counting user give a certain portion's film marking.But most of websites are still using the people for being manually entered scoring at present
Work scoring system causes final such that the score that everyone gives is excessively subjective, or even has false, malice marking
Film scoring is untrue.
Therefore, the existing technology needs to be improved and developed.
Invention content
The technical problem to be solved in the present invention is, for the drawbacks described above of the prior art, provides a kind of based on micro- expression
Video display methods of marking, storage medium and the intelligent terminal of identification, it is intended to solve video display scoring in the prior art using defeated manually
Enter the mode of scoring so that scoring is excessively subjective, leads to problems such as to score untrue.
The technical proposal for solving the technical problem of the invention is as follows：
A kind of video display methods of marking based on micro- Expression Recognition, wherein the method includes：
Micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, exports analysis result；
The classification of currently playing movie and television play is obtained, and obtains the classification institute of current movie and television play from preset micro- expression data library
Corresponding micro- expression data；
It is given a mark automatically to the movie and television play according to analysis result and micro- expression data of acquisition, and exports final scoring.
The video display methods of marking based on micro- Expression Recognition, wherein micro- expression when acquisition user's viewing, and
Micro- expression is identified and is analyzed, output analysis result specifically includes：
Facial image when camera user in real viewing in intelligent terminal；
The facial image is detected, and marks micro- facial expression image sequence；
The feature of micro- facial expression image sequence is extracted, and the classification belonging to micro- expression is gone out according to the feature recognition of extraction；
It is for statistical analysis to the classification and quantity of micro- expression, export analysis result.
The video display methods of marking based on micro- Expression Recognition, wherein the analysis result includes：User's viewing process
In micro- expression type and the actual ratio shared by each micro- expression；The type of micro- expression includes：Happy, surprised,
Detest, is sad, frightened and indignation.
The video display methods of marking based on micro- Expression Recognition, wherein the class for obtaining currently playing movie and television play
Not, and before obtaining micro- expression data corresponding to the classification of current movie and television play in preset micro- expression data library further include：
Pre-establish a micro- expression data library for obtaining corresponding micro- expression data according to currently playing movie and television play classification；
Micro- expression data library includes：Shared by theoretical micro- expression type and each micro- expression corresponding to each movie and television play
Theoretical proportions；
The movie and television play classification includes：Comedy class, adventure, terrified class, crime class, science fiction class, swordsman's class and love class.
The video display methods of marking based on micro- Expression Recognition, wherein the class for obtaining currently playing movie and television play
Not, and from preset micro- expression data library the micro- expression data obtained corresponding to the classification of current movie and television play specifically includes：
Intelligent terminal obtains the classification of currently playing movie and television play；
Corresponding micro- expression data is searched from micro- expression data according to the type of acquired movie and television play；
It obtains in micro- expression data the micro- expression type of theory corresponding to the current movie and television play classification for including and each is micro-
Theoretical proportions shared by expression.
The video display methods of marking based on micro- Expression Recognition, wherein described according to the micro- of analysis result and acquisition
Expression data automatically gives a mark to the movie and television play, and exports final scoring and specifically include：
By shared by the type of micro- expression during the user's viewing analyzed and each micro- expression actual ratio with obtain
The theoretical proportions shared by theoretical micro- expression type and each micro- expression in the micro- expression data taken are compared；
If the type of micro- expression during user's viewing is consistent with theoretical micro- expression type just, and shared by each micro- expression
Actual ratio be equal to each micro- expression shared by theoretical proportions, then passing score is chosen as to the movie and television play automatically；It is addressed
Lattice score is 6 points.
The video display methods of marking based on micro- Expression Recognition, wherein described according to the micro- of analysis result and acquisition
Expression data automatically gives a mark to the movie and television play, and exports final scoring and further include：
If the type of micro- expression during user's viewing is higher than theoretical micro- expression type, and the reality shared by each micro- expression
Ratio then increases score to the scoring of the movie and television play higher than the theoretical proportions shared by each micro- expression on passing score；
If the type of micro- expression during user's viewing is less than theoretical micro- expression type, and the reality shared by each micro- expression
Ratio then reduces score to the scoring of the movie and television play less than the theoretical proportions shared by each micro- expression on passing score.
The video display methods of marking based on micro- Expression Recognition, wherein the method further includes：
The viewing duration of active user is obtained, if the viewing duration of active user is less than preset standard duration, the user's
Micro- expression can not be used for scoring to movie and television play.
A kind of storage medium is stored thereon with a plurality of instruction, wherein and described instruction is suitable for being loaded and being executed by processor,
With the step of realizing video display methods of marking described in any one of the above embodiments based on micro- Expression Recognition.
A kind of intelligent terminal, wherein including：Processor, the storage medium being connect with processor communication, the storage medium
Suitable for storing a plurality of instruction；The processor is suitable for calling the instruction in the storage medium, to execute realization any of the above-described
The step of described video display methods of marking based on micro- Expression Recognition.
Beneficial effects of the present invention：Micro- expression when the present invention is by user's viewing is analyzed, and according to micro- table
The variation of feelings automatically scores to video display, and scoring is manually entered without user so that marking result is truer, effectively avoids
Maliciously, the case where false marking.
Description of the drawings
Fig. 1 is the flow chart of the first preferred embodiment of the video display methods of marking the present invention is based on micro- Expression Recognition.
Fig. 2 is the flow chart of micro- expression recognition method of the present invention.
Fig. 3 is the flow chart of the second preferred embodiment of the video display methods of marking the present invention is based on micro- Expression Recognition.
Fig. 4 is the functional schematic block diagram of the intelligent terminal of the present invention.
Specific implementation mode
To make the objectives, technical solutions, and advantages of the present invention clearer and more explicit, develop simultaneously embodiment pair referring to the drawings
The present invention is further described.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and do not have to
It is of the invention in limiting.
The mode to be scored for movie and television play due to major network site of cinema and TV in the prior art is substantially or use is manually defeated
Enter the method for scoring, so that scoring has too big subjectivity, causes the scoring of film untrue.Although some websites
Scoring algorithm is more complicated, but still there is the case where false, malice is given a mark.To solve the above-mentioned problems, the present invention provides
A kind of video display methods of marking based on micro- Expression Recognition, as shown in Figure 1, Fig. 1 is that the present invention is based on the video display of micro- Expression Recognition to comment
Divide the flow chart of the first preferred embodiment of method.The video display methods of marking based on micro- Expression Recognition includes the following steps：
Step S100, micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, output analysis knot
Fruit.
Preferably, the step S100 is specifically included：
Facial image when camera user in real viewing in intelligent terminal；
The facial image is detected, and marks micro- facial expression image sequence；
The feature of micro- facial expression image sequence is extracted, and the classification belonging to micro- expression is gone out according to the feature recognition of extraction；
It is for statistical analysis to the classification and quantity of micro- expression, export analysis result.
When it is implemented, the present invention installation one on intelligent terminal in advance is used to shoot the camera of user's facial image,
Preferably, the invention discloses the specific flow charts of micro- Expression Recognition, as shown in Figure 2.
Step 210 obtains facial image.When user is in viewing, the camera on the intelligent terminal will be clapped in real time
Take the photograph facial image when user's viewing.
Step 220, facial image pretreatment.The present invention uses Adaboost（Iterative algorithm）Algorithm detects micro- facial expression image
In face, and cut, realize that the size of image normalizes using bilinearity difference arithmetic, by pretreated face
Image size is 180 × 180 pixels, consistent by pretreated image pixel, is conducive in subsequent step to micro- expression
Extraction.
Step 230, the micro- expressive features of extraction.The present invention is detected facial image, and marks micro- facial expression image sequence
Row.Regression model is established using Birnbaum-Saunders distribution curves in the present embodiment, to mark the micro- facial expression image sequence of face
Row, including the start frame Apex1 that the micro- expression of face occurs, thus duration and end frame Apex2 complete the micro- table of face
Feelings detect.Further, the present invention carries the dynamic space-time textural characteristics of the micro- expression sequence of face using CBP-TOP algorithms
It takes.And 8 frame images of the micro- expression sequence of face are divided into 16 × 16 non-overlapping blocks, extract CBP-TOP in each sub-block
Feature, and the statistics with histogram of CBP-TOP features is carried out to the sub-block, finally the feature histogram of all sub-blocks is connected into whole
Thus the feature histogram of a micro- expression sequence of face extracts the dynamic space-time textural characteristics of the micro- expression sequence of face, that is, obtains
The micro- expression sequence of face is in the deformation data of X/Y plane, and the movable information in XT planes and YT planes.The CBP-TOP is special
Sign is textural characteristics existing for image itself, and extraction process is calculated by CBP codes.
Step 240, feature judge.The present invention is trained and is predicted using ELM graders, is first to verify CBP-
Second the validity of TOP algorithms is to carry out Classification and Identification to the feature of the micro- expression sequence of face, judges that the feature of extraction belongs to actually
In any class face micro- expression, the classification belonging to micro- expression is identified.In the recognition methods of above-mentioned micro- expression, the CBP-
TOP algorithms are as follows：
CBP-TOP=Σx,y,tI{fj(x,y,t)=i},i=0,...,nj-1;j=0,1,2---(1),]]>
Wherein：Nj is the model number that CBP operators are generated in j-th of plane, and j=0,1,2 indicates XY, XT and YT plane respectively,
Fj (x, y, t) indicates central pixel point (x, y, t) in the decimal value of the CBP codes of j-th of plane, and the definition of function I (f) is such as
Under：
I(f)=1,if f is True0,if f is False---(2).]]>
Step 250, output analysis result.Intelligent terminal is during can be to user's viewing after the type for identifying micro- expression
The micro- expression type and quantity occurred is counted, and exports analysis result.The analysis result includes：During user's viewing
Micro- expression type and the actual ratio shared by each micro- expression.Preferably, by the type of micro- expression point in the present embodiment
For happy, surprised, detest, sad, frightened and indignation.The method of above-mentioned micro- Expression Recognition is more accurate, so that intelligence
Terminal can accurately extract micro- expression from facial image, and be identified and classify, and judge that micro- expression particularly belongs to
Which kind of.
Further, the classification of currently playing movie and television play step S200, is obtained, and from preset micro- expression data library
Obtain micro- expression data corresponding to the classification of current movie and television play.
Preferably, the step S200 is specifically included：
Intelligent terminal obtains the classification of currently playing movie and television play；
Corresponding micro- expression data is searched from micro- expression data according to the type of acquired movie and television play；
It obtains in micro- expression data the micro- expression type of theory corresponding to the current movie and television play classification for including and each is micro-
Theoretical proportions shared by expression.
When it is implemented, the present invention also establishes one for according to currently playing movie and television play classification in intelligent terminal in advance
Obtain micro- expression data library of corresponding micro- expression data.Micro- expression data library includes：Corresponding to each movie and television play
Theoretical proportions shared by theoretical micro- expression type and each micro- expression, i.e., it is pre-defined for different types of movie and television play, it uses
The theoretical proportions shared by micro- expression type and each micro- expression that family will appear, for being commented movie and television play in subsequent step
The reference divided.Movie and television play classification in the present invention includes：Comedy class, adventure, terrified class, crime class, science fiction class, swordsman's class with
And love class.
When user is in viewing, intelligent terminal obtains currently playing movie and television play classification, and according to movie and television play classification from pre-
If micro- expression data library in search theoretical ratio shared by theoretical micro- expression type and each micro- expression corresponding to the category
Example.For example, if currently playing movie and television play is science fiction class movie and television play, the theoretical micro- expression of that science fiction class movie and television play is surprised and pleasant
This two class, and the theoretical proportions shared by surprised micro- expression are 40%, the theoretical proportions shared by pleasant micro- expression are 20%.
Further, step S300, according to analysis result and micro- expression data of acquisition automatically to the movie and television play into
Row marking, and export final scoring.
Preferably, the step S300 is specifically included：
By shared by the type of micro- expression during the user's viewing analyzed and each micro- expression actual ratio with obtain
The theoretical proportions shared by theoretical micro- expression type and each micro- expression in the micro- expression data taken are compared；
If the type of micro- expression during user's viewing is consistent with theoretical micro- expression type just, and shared by each micro- expression
Actual ratio be equal to each micro- expression shared by theoretical proportions, then passing score is chosen as to the movie and television play automatically.
When it is implemented, the present invention pre-sets a standard conditions, micro- expression type when user's viewing and each
When ratio shared by micro- expression meets the standard conditions, then the movie and television play is chosen as passing score.It is described in the present invention
Passing score is 6 points（Total score ten point system）.Specifically, the present invention respectively by the type of micro- expression during user's viewing and
Actual ratio and the theoretical micro- expression type obtained from micro- expression data shared by each micro- expression and each micro- table
Theoretical proportions shared by feelings are compared, and whether micro- expression to judge user is eligible, meets, makes 6 scores.
For example, the micro- expression of theory of comedy class movie and television play is pleasant, if micro- expression of user's pleasure reaches 60% and can comment
6 points；The micro- expression of theory of adventure movie and television play is surprised, if the surprised micro- expression of user reaches 60% and can comment 6 points；It is terrified
The theoretical micro- expression of class movie and television play is frightened and surprised, if micro- expression of user's terror reaches 40% and surprised micro- expression reaches
20% can comment 6 points；The theoretical micro- expression of crime class movie and television play is to detest, is frightened and surprised, if micro- expression that user detests reaches
10%, frightened micro- expression, which reaches 20%, and micro- expression for detesting reaches 30% can comment 6 points；The micro- table of theory of science fiction class movie and television play
Feelings are surprised and pleasant, if the surprised micro- expression of user reaches 40% and pleasant micro- expression reaches 20% and can comment 6 points；Swordsman
The micro- expression of theory of class movie and television play is surprised, if the surprised micro- expression of user reaches 60% and can comment 6 points；Love class movie and television play
The micro- expression of theory be pleasant or sad, if user is pleasant or sad micro- expression reaches 60% and can comment 6 points.Each type
Film in ratio shared by micro- expression can be voluntarily configured according to actual conditions.
Further, if the type of micro- expression during user's viewing is higher than theoretical micro- expression type, and each is micro-
Actual ratio shared by expression is higher than the theoretical proportions shared by each micro- expression, then to the scoring of the movie and television play in passing score
（6 points）Upper increase score；If the type of micro- expression during user's viewing is less than theoretical micro- expression type, and each micro- table
Actual ratio shared by feelings is less than the theoretical proportions shared by each micro- expression, then to the scoring of the movie and television play in passing score（6
Point）Upper reduction score, final scoring are 0-10 points.
It scores to be further reduced false, malice, the present invention can also obtain user when user carries out viewing
Viewing duration, if the viewing duration of active user is less than preset standard duration, also user does not watch complete video display, should
Micro- expression of user can not be used for scoring to movie and television play, to ensure that the user of all scorings is effective and true.This
Outside, the present invention also carries out data encryption processing to the scoring of micro- expression of user and user, to ensure the safety of user data
Property.
Further, the invention also discloses the second preferred embodiments of the video display scoring based on micro- Expression Recognition.Such as Fig. 3
It is shown, it the described method comprises the following steps：
Step 310, acquisition facial image.Intelligent terminal adopts the facial image of viewing user using preset camera
Collection.
Step 320, micro- Expression Recognition.Micro- expressive features are identified from the facial image of acquisition.
Step 330 records various micro- expression classifications and ratio.
Step 340 judges whether film terminates.When being, step 350 is executed；When no, step 310 is executed.
Step 350, analyzing processing.Shared by the type of micro- expression during user's viewing and each micro- expression
Theoretical proportions shared by actual ratio and the theoretical micro- expression type obtained from micro- expression data and each micro- expression into
Row compares, and whether micro- expression to judge user is eligible, and scores automatically.
Step 360, output film scoring.
Based on above-described embodiment, the invention also discloses a kind of intelligent terminals, as shown in figure 4, including：Processor
(processor) 10 the storage medium (memory) 20, being connect with processor 10；Wherein, the processor 10 is for calling institute
The program instruction in storage medium 20 is stated, to execute the method that above-described embodiment is provided, such as is executed：
Micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, exports analysis result；
The classification of currently playing movie and television play is obtained, and obtains the classification institute of current movie and television play from preset micro- expression data library
Corresponding micro- expression data；
It is given a mark automatically to the movie and television play according to analysis result and micro- expression data of acquisition, and exports final scoring.
The embodiment of the present invention also provides a kind of storage medium, and computer instruction, the calculating are stored on the storage medium
Machine instruction makes computer execute the method that the various embodiments described above are provided.
In conclusion a kind of video display methods of marking, storage medium and intelligence based on micro- Expression Recognition provided by the invention
Terminal, method include：Micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, output analysis knot
Fruit；The classification of currently playing movie and television play is obtained, and obtains the classification institute of current movie and television play from preset micro- expression data library
Corresponding micro- expression data；It is given a mark automatically to the movie and television play according to analysis result and micro- expression data of acquisition, and
The final scoring of output.Micro- expression when the present invention is by user's viewing is analyzed, and automatic according to the variation of micro- expression
It scores video display, scoring is manually entered without user so that marking result is truer, and malice, falseness is effectively avoided to beat
The case where dividing.
It should be understood that the application of the present invention is not limited to the above for those of ordinary skills can
With improvement or transformation based on the above description, all these modifications and variations should all belong to the guarantor of appended claims of the present invention
Protect range.
Claims (10)
1. a kind of video display methods of marking based on micro- Expression Recognition, which is characterized in that the method includes：
Micro- expression when user's viewing is obtained, and micro- expression is identified and is analyzed, exports analysis result；
The classification of currently playing movie and television play is obtained, and obtains the classification institute of current movie and television play from preset micro- expression data library
Corresponding micro- expression data；
It is given a mark automatically to the movie and television play according to analysis result and micro- expression data of acquisition, and exports final scoring.
2. according to the video display methods of marking based on micro- Expression Recognition described in claim 1, which is characterized in that the acquisition is used
Micro- expression when the viewing of family, and micro- expression is identified and is analyzed, output analysis result specifically includes：
Facial image when camera user in real viewing in intelligent terminal；
The facial image is detected, and marks micro- facial expression image sequence；
The feature of micro- facial expression image sequence is extracted, and the classification belonging to micro- expression is gone out according to the feature recognition of extraction；
It is for statistical analysis to the classification and quantity of micro- expression, export analysis result.
3. according to the video display methods of marking based on micro- Expression Recognition described in claim 2, which is characterized in that the analysis knot
Fruit includes：Actual ratio shared by the type of micro- expression during user's viewing and each micro- expression；Micro- expression
Type includes：Happy, surprised, detest, sad, frightened and indignation.
4. according to the video display methods of marking based on micro- Expression Recognition described in claim 1, which is characterized in that the acquisition is worked as
The classification of the movie and television play of preceding broadcasting, and obtain from preset micro- expression data library micro- table corresponding to the classification of current movie and television play
Further include before feelings data：
Pre-establish a micro- expression data library for obtaining corresponding micro- expression data according to currently playing movie and television play classification；
Micro- expression data library includes：Shared by theoretical micro- expression type and each micro- expression corresponding to each movie and television play
Theoretical proportions；
The movie and television play classification includes：Comedy class, adventure, terrified class, crime class, science fiction class, swordsman's class and love class.
5. according to the video display methods of marking based on micro- Expression Recognition described in claim 1, which is characterized in that the acquisition is worked as
The classification of the movie and television play of preceding broadcasting, and obtain from preset micro- expression data library micro- table corresponding to the classification of current movie and television play
Feelings data specifically include：
Intelligent terminal obtains the classification of currently playing movie and television play；
Corresponding micro- expression data is searched from micro- expression data according to the type of acquired movie and television play；
It obtains in micro- expression data the micro- expression type of theory corresponding to the current movie and television play classification for including and each is micro-
Theoretical proportions shared by expression.
6. according to the video display methods of marking based on micro- Expression Recognition described in claim 1, which is characterized in that the basis point
Analysis result and micro- expression data of acquisition automatically give a mark to the movie and television play, and export final scoring and specifically include：
By shared by the type of micro- expression during the user's viewing analyzed and each micro- expression actual ratio with obtain
The theoretical proportions shared by theoretical micro- expression type and each micro- expression in the micro- expression data taken are compared；
If the type of micro- expression during user's viewing is consistent with theoretical micro- expression type just, and shared by each micro- expression
Actual ratio be equal to each micro- expression shared by theoretical proportions, then passing score is chosen as to the movie and television play automatically；It is addressed
Lattice score is 6 points.
7. according to the video display methods of marking based on micro- Expression Recognition described in claim 6, which is characterized in that the basis point
Analysis result and micro- expression data of acquisition automatically give a mark to the movie and television play, and export final scoring and further include：
If the type of micro- expression during user's viewing is higher than theoretical micro- expression type, and the reality shared by each micro- expression
Ratio then increases score to the scoring of the movie and television play higher than the theoretical proportions shared by each micro- expression on passing score；
If the type of micro- expression during user's viewing is less than theoretical micro- expression type, and the reality shared by each micro- expression
Ratio then reduces score to the scoring of the movie and television play less than the theoretical proportions shared by each micro- expression on passing score.
8. according to the video display methods of marking based on micro- Expression Recognition described in claim 1, which is characterized in that the method is also
Including：
The viewing duration of active user is obtained, if the viewing duration of active user is less than preset standard duration, the user's
Micro- expression can not be used for scoring to movie and television play.
9. a kind of storage medium is stored thereon with a plurality of instruction, which is characterized in that described instruction is suitable for being loaded and being held by processor
Row, the step of to realize video display methods of marking of the claims 1-8 any one of them based on micro- Expression Recognition.
10. a kind of intelligent terminal, which is characterized in that including：Processor, the storage medium being connect with processor communication, it is described to deposit
Storage media is suitable for storing a plurality of instruction；The processor is suitable for calling the instruction in the storage medium, above-mentioned to execute realization
The step of video display methods of marking of the claim 1-8 any one of them based on micro- Expression Recognition.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810264552.1A CN108509893A (en) | 2018-03-28 | 2018-03-28 | Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition |
| PCT/CN2018/109820 WO2019184299A1 (en) | 2018-03-28 | 2018-10-11 | Microexpression recognition-based film and television scoring method, storage medium, and intelligent terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810264552.1A CN108509893A (en) | 2018-03-28 | 2018-03-28 | Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108509893A true CN108509893A (en) | 2018-09-07 |
Family
ID=63378942
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810264552.1A Pending CN108509893A (en) | 2018-03-28 | 2018-03-28 | Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108509893A (en) |
| WO (1) | WO2019184299A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109145880A (en) * | 2018-10-09 | 2019-01-04 | 深圳市亿联智能有限公司 | A kind of high intelligent film marking mode |
| CN109583970A (en) * | 2018-12-14 | 2019-04-05 | 深圳壹账通智能科技有限公司 | Advertisement placement method, device, computer equipment and storage medium |
| CN109784185A (en) * | 2018-12-18 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Client's food and drink evaluation automatic obtaining method and device based on micro- Expression Recognition |
| CN109784977A (en) * | 2018-12-18 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Service methods of marking, device, computer equipment and storage medium |
| CN109785066A (en) * | 2019-01-17 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Products Show method, apparatus, equipment and storage medium based on micro- expression |
| CN109872183A (en) * | 2019-01-16 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Intelligent Service evaluation method, computer readable storage medium and terminal device |
| CN110175526A (en) * | 2019-04-28 | 2019-08-27 | 平安科技（深圳）有限公司 | Dog Emotion identification model training method, device, computer equipment and storage medium |
| WO2019184299A1 (en) * | 2018-03-28 | 2019-10-03 | 深圳创维－Rgb电子有限公司 | Microexpression recognition-based film and television scoring method, storage medium, and intelligent terminal |
| CN112115756A (en) * | 2020-03-22 | 2020-12-22 | 张冬梅 | Block chain management platform for content analysis |
| CN114842539A (en) * | 2022-05-30 | 2022-08-02 | 山东大学 | Micro-expression discovery method and system based on attention mechanism and one-dimensional convolution sliding window |
| CN117391746A (en) * | 2023-10-25 | 2024-01-12 | 上海瀚泰智能科技有限公司 | Intelligent hotel customer perception analysis method and system based on confidence network |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112633215A (en) * | 2020-12-29 | 2021-04-09 | 安徽兰臣信息科技有限公司 | Embedded image acquisition device for recognizing behavior and emotion of children |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103530788A (en) * | 2012-07-02 | 2014-01-22 | 纬创资通股份有限公司 | Multimedia evaluating system, multimedia evaluating device and multimedia evaluating method |
| CN103716661A (en) * | 2013-12-16 | 2014-04-09 | 乐视致新电子科技（天津）有限公司 | Video scoring reporting method and device |
| CN104299225A (en) * | 2014-09-12 | 2015-01-21 | 姜羚 | Method and system for applying facial expression recognition in big data analysis |
| CN107437052A (en) * | 2016-05-27 | 2017-12-05 | 深圳市珍爱网信息技术有限公司 | Blind date satisfaction computational methods and system based on micro- Expression Recognition |
| CN107590459A (en) * | 2017-09-11 | 2018-01-16 | 广东欧珀移动通信有限公司 | The method and apparatus for delivering evaluation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104298682B (en) * | 2013-07-18 | 2018-02-23 | 广州华久信息科技有限公司 | A kind of evaluation method and mobile phone of the information recommendation effect based on Facial Expression Image |
| CN108509893A (en) * | 2018-03-28 | 2018-09-07 | 深圳创维－Rgb电子有限公司 | Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition |
-
2018
- 2018-03-28 CN CN201810264552.1A patent/CN108509893A/en active Pending
- 2018-10-11 WO PCT/CN2018/109820 patent/WO2019184299A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103530788A (en) * | 2012-07-02 | 2014-01-22 | 纬创资通股份有限公司 | Multimedia evaluating system, multimedia evaluating device and multimedia evaluating method |
| CN103716661A (en) * | 2013-12-16 | 2014-04-09 | 乐视致新电子科技（天津）有限公司 | Video scoring reporting method and device |
| CN104299225A (en) * | 2014-09-12 | 2015-01-21 | 姜羚 | Method and system for applying facial expression recognition in big data analysis |
| CN107437052A (en) * | 2016-05-27 | 2017-12-05 | 深圳市珍爱网信息技术有限公司 | Blind date satisfaction computational methods and system based on micro- Expression Recognition |
| CN107590459A (en) * | 2017-09-11 | 2018-01-16 | 广东欧珀移动通信有限公司 | The method and apparatus for delivering evaluation |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019184299A1 (en) * | 2018-03-28 | 2019-10-03 | 深圳创维－Rgb电子有限公司 | Microexpression recognition-based film and television scoring method, storage medium, and intelligent terminal |
| CN109145880A (en) * | 2018-10-09 | 2019-01-04 | 深圳市亿联智能有限公司 | A kind of high intelligent film marking mode |
| CN109583970A (en) * | 2018-12-14 | 2019-04-05 | 深圳壹账通智能科技有限公司 | Advertisement placement method, device, computer equipment and storage medium |
| CN109784185A (en) * | 2018-12-18 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Client's food and drink evaluation automatic obtaining method and device based on micro- Expression Recognition |
| CN109784977A (en) * | 2018-12-18 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Service methods of marking, device, computer equipment and storage medium |
| CN109872183A (en) * | 2019-01-16 | 2019-06-11 | 深圳壹账通智能科技有限公司 | Intelligent Service evaluation method, computer readable storage medium and terminal device |
| CN109785066A (en) * | 2019-01-17 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Products Show method, apparatus, equipment and storage medium based on micro- expression |
| CN110175526A (en) * | 2019-04-28 | 2019-08-27 | 平安科技（深圳）有限公司 | Dog Emotion identification model training method, device, computer equipment and storage medium |
| CN112115756A (en) * | 2020-03-22 | 2020-12-22 | 张冬梅 | Block chain management platform for content analysis |
| CN114842539A (en) * | 2022-05-30 | 2022-08-02 | 山东大学 | Micro-expression discovery method and system based on attention mechanism and one-dimensional convolution sliding window |
| CN117391746A (en) * | 2023-10-25 | 2024-01-12 | 上海瀚泰智能科技有限公司 | Intelligent hotel customer perception analysis method and system based on confidence network |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019184299A1 (en) | 2019-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108509893A (en) | Video display methods of marking, storage medium and intelligent terminal based on micro- Expression Recognition | |
| US11830230B2 (en) | Living body detection method based on facial recognition, and electronic device and storage medium | |
| CN107862315B (en) | Subtitle extraction method, video searching method, subtitle sharing method and device | |
| US20170278135A1 (en) | Image recognition artificial intelligence system for ecommerce | |
| CN103618918A (en) | Method and device for controlling display of smart television | |
| CN107742107A (en) | Facial image sorting technique, device and server | |
| Bianco et al. | Predicting image aesthetics with deep learning | |
| CN112116582B (en) | Method for detecting and identifying cigarettes in inventory or display scene | |
| CN109657715B (en) | Semantic segmentation method, device, equipment and medium | |
| Wang et al. | A benchmark for clothes variation in person re‐identification | |
| WO2021042850A1 (en) | Item recommending method and related device | |
| Parde et al. | Face and image representation in deep CNN features | |
| CN117271831B (en) | Sports video intelligent classification method and system based on multi-attribute learning | |
| WO2014100936A1 (en) | Method, platform, and system for manufacturing associated information library of video and for playing video | |
| CN113297420A (en) | Video image processing method and device, storage medium and electronic equipment | |
| Parde et al. | Deep convolutional neural network features and the original image | |
| Mohseni et al. | Recognizing induced emotions with only one feature: A novel color histogram-based system | |
| CN111046213B (en) | Knowledge base construction method based on image recognition | |
| CN112200844A (en) | Method, device, electronic equipment and medium for generating image | |
| Nodari et al. | A mobile visual search application for content based image retrieval in the fashion domain | |
| CN108960186B (en) | Advertising machine user identification method based on human face | |
| CN108875572A (en) | The pedestrian's recognition methods again inhibited based on background | |
| CN113469138A (en) | Object detection method and device, storage medium and electronic equipment | |
| CN110348898A (en) | A kind of information-pushing method and device based on human bioequivalence | |
| CN110458810A (en) | A kind of more classification and Detection method and devices of skin quality based on Face datection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180907 |
|
| RJ01 | Rejection of invention patent application after publication |