CN107944052A - The information processing method and electronic equipment of a kind of electronic equipment - Google Patents
The information processing method and electronic equipment of a kind of electronic equipment Download PDFInfo
- Publication number
- CN107944052A CN107944052A CN201711392221.8A CN201711392221A CN107944052A CN 107944052 A CN107944052 A CN 107944052A CN 201711392221 A CN201711392221 A CN 201711392221A CN 107944052 A CN107944052 A CN 107944052A
- Authority
- CN
- China
- Prior art keywords
- character image
- character
- personage
- electronic equipment
- photo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/178—Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application provides the information processing method and electronic equipment of a kind of electronic equipment, the described method includes：Obtain the Target Photo collection in the electronic equipment；Concentrated from the Target Photo and determine each character image, and each character image to determining is analyzed, and obtains the corresponding character features of each character image；Obtain one and refer to character image；Based on described with reference to the corresponding character features of character image, and the character features corresponding to each character image, the character relation between personage and the personage with reference to corresponding to character image corresponding to each character image is determined.As can be seen here, utilize application scheme, it can effectively determine that electronic equipment Target Photo concentrates the character relation between involved each personage, during so as in the photo retrieval for be applied to application scheme electronic equipment, electronic equipment can be supported to carry out more intelligent photo retrieval based on character relation, and then the precision of electronic equipment retrieval photo can be lifted.
Description
Technical field
The invention belongs to the information processing method and electricity in the intelligent field of electronic equipment, more particularly to a kind of electronic equipment
Sub- equipment.
Background technology
At present, the application in the electronic equipment such as smart mobile phone, tablet computer is increasingly abundanter, and it is therein main to take pictures
One of using.With the progress of electronic equipment memory techniques, the extension of memory space, the photo of user's storage on an electronic device
More and more, simultaneously, the difficulty that user obtains required photo from photograph collection is also increasing.
Required photo, some intelligence of the prior art are obtained from the huge photograph collection of number of pictures for ease of user
The electronic equipments such as mobile phone have provided the inquiry of photo, search function to the user, however, current electronic equipment is only capable of from photo pair
The photo that photo is angularly concentrated in time for answering, place is simply divided, and is correspondingly only capable of support from time, place etc.
Angle realizes rough photo inquiry, causes photo inquiry, the intelligence degree of retrieval relatively low, can not realize more accurately photo
Inquiry.
The content of the invention
In view of this, the purpose of the application is the information processing method and electronic equipment for providing a kind of electronic equipment, uses
Photo, the precision of lifting electronic equipment retrieval photo are retrieved in a manner of more intelligent in supporting electronic equipment.
For this reason, the following technical solution of disclosure：
The information processing method of a kind of electronic equipment, the described method includes：
Obtain the Target Photo collection in the electronic equipment；
Concentrated from the Target Photo and determine each character image, and each character image to determining divides
Analysis, obtains the corresponding character features of each character image；
Obtain one and refer to character image；
Based on described with reference to the corresponding character features of character image, and the personage corresponding to each character image is special
Sign, determines that the personage between personage and the personage with reference to corresponding to character image corresponding to each character image is closed
System.
The above method, it is preferred that the described pair of each character image determined is analyzed, and obtains each figure map
As corresponding character features, including：
Facial Feature Analysis is carried out to each character image determined and face compares, obtains each character image
Gender, age, the frequency of occurrences in the pictures and the group photo frequency of corresponding personage；
Character activities analysis is carried out to each character image determined, obtains personage corresponding to each character image
Activity Type.
The above method, it is preferred that the acquisition one refers to character image, including：
Obtain the current self-timer character image of the electronic equipment and refer to character image as described；
Alternatively, obtain the self-timer character image that the Target Photo is concentrated refers to character image as described；
Alternatively, obtain the character image that user specifies refers to character image as described.
The above method, it is preferred that described based on the corresponding character features of the reference character image, and each individual
Character features corresponding to object image, determine personage corresponding to each character image and described right with reference to character image institute
Character relation between the personage answered, including：
Based on personage's gender, age, the activity class with reference to character image and corresponding to each character image
Type, the frequency of occurrences in the pictures and group photo frequency, determine personage corresponding to each character image with it is described
The character relation between personage with reference to corresponding to character image.
The above method, it is preferred that further include：
Picture query instruction is obtained, the picture query instruction includes piece identity's information towards the character relation
And/or the Activity Type information of personage；
Go out the people including meeting piece identity's information and/or Activity Type information from the Target Photo Integrated query
The picture of thing.
A kind of electronic equipment, including：
First acquisition unit, for obtaining the Target Photo collection in the electronic equipment；
Characteristic analysis unit, each character image is determined for being concentrated from the Target Photo, and each to what is determined
A character image is analyzed, and obtains the corresponding character features of each character image；
Second acquisition unit, character image is referred to for obtaining one；
Character relation determination unit, for referring to the corresponding character features of character image based on described, and it is described each
Character features corresponding to character image, determine the personage corresponding to each character image with described with reference to character image institute
Character relation between corresponding personage.
Above-mentioned electronic equipment, it is preferred that the characteristic analysis unit, analyzes each character image determined,
The corresponding character features of each character image are obtained, are specifically included：
Facial Feature Analysis is carried out to each character image determined and face compares, obtains each character image
Gender, age, the frequency of occurrences in the pictures and the group photo frequency of corresponding personage；
Character activities analysis is carried out to each character image determined, obtains personage corresponding to each character image
Activity Type.
Above-mentioned electronic equipment, it is preferred that the second acquisition unit, is specifically used for：
Obtain the current self-timer character image of the electronic equipment and refer to character image as described；
Alternatively, obtain the self-timer character image that the Target Photo is concentrated refers to character image as described；
Alternatively, obtain the character image that user specifies refers to character image as described.
Above-mentioned electronic equipment, it is preferred that the character relation determination unit, is specifically used for：
Based on personage's gender, age, the activity class with reference to character image and corresponding to each character image
Type, the frequency of occurrences in the pictures and group photo frequency, determine personage corresponding to each character image with it is described
The character relation between personage with reference to corresponding to character image.
Above-mentioned electronic equipment, it is preferred that further include：
Picture query unit, for obtaining picture query instruction, the picture query instruction includes closing towards the personage
Piece identity's information of system and/or the Activity Type information of personage；And go out from the Target Photo Integrated query including meeting
State the picture of the personage of piece identity's information and/or Activity Type information.
Understand that this application provides the information processing method and electronic equipment of a kind of electronic equipment, institute based on above scheme
The method of stating includes：Obtain the Target Photo collection in the electronic equipment；Concentrated from the Target Photo and determine each figure map
Picture, and each character image to determining is analyzed, and obtains the corresponding character features of each character image；Obtain one
With reference to character image；Based on described with reference to the corresponding character features of character image, and corresponding to each character image
Character features, determine between personage and the personage with reference to corresponding to character image corresponding to each character image
Character relation.It can be seen from the above that using application scheme, it can effectively determine that electronic equipment Target Photo concentrates involved each one
Character relation between thing, so that when during the photo that application scheme is applied to electronic equipment is retrieved, can support electronic equipment
More intelligent photo retrieval is carried out based on character relation, and then the precision of electronic equipment retrieval photo can be lifted.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
The embodiment of invention, for those of ordinary skill in the art, without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is the flow chart of the information processing method embodiment one for a kind of electronic equipment that the application provides；
Fig. 2 is the flow chart of the information processing method embodiment two for a kind of electronic equipment that the application provides；
Fig. 3 is the flow chart of the information processing method embodiment three for a kind of electronic equipment that the application provides；
Fig. 4 is the structure diagram for a kind of electronic equipment example IV that the application provides；
Fig. 5 is the structure diagram for a kind of electronic equipment embodiment six that the application provides.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment, belongs to the scope of protection of the invention.
This application provides the information processing method and electronic equipment of a kind of electronic equipment, for by determining electronic equipment
Target Photo concentrates the character relation between involved each personage so that supports electronic equipment to be based on character relation with more intelligent
Mode retrieve photo, the precision of lifting electronic equipment retrieval photo.Below by the side by multiple embodiments to the application
Case is described in detail.
With reference to figure 1, Fig. 1 is the flow chart of the information processing method embodiment one for a kind of electronic equipment that the application provides,
Wherein, the electronic equipment can be, but not limited to, smart mobile phone, tablet computer, digital camera, laptop, desk-top
The various terminal equipments such as machine, all-in-one machine, as shown in Figure 1, the described information processing method of the present embodiment comprises the following steps：
Target Photo collection in step 101, the acquisition electronic equipment.
The Target Photo collection can be a photograph album in the electronic equipment, multiple photograph albums or whole photograph albums, or
It can also be that a certain Part of photos taken in some photograph album, the present embodiment are not construed as limiting this in the electronic equipment.
Since the application is intended to by determining that electronic equipment Target Photo concentrates the character relation between involved each personage,
Make it possible to support electronic equipment to retrieve photo in a manner of more intelligent based on character relation, therefore, in this step, specifically may be used
When receiving for indicating to determine that Target Photo concentrates the instruction of character relation, the Target Photo in the electronic equipment is obtained
Collection.
Wherein, it is described be used for indicate determine Target Photo concentrate character relation instruction can by electronic equipment meet it is pre-
Automatic trigger during fixed condition, for example be redefined for when Target Photo is concentrated and increased the photo including character image newly, by electricity
Sub- equipment automatic trigger is used to indicate to determine that Target Photo concentrates the described instruction of character relation, or presets and set by electronics
The instruction of standby periodic triggers (such as at interval of the once instruction of one week automatic trigger).
In addition, it is described to be used to indicate to determine that Target Photo concentrates the instruction of character relation be by electronic equipment
User is triggered by performing corresponding operating on equipment interface, such as, user is chosen in electronic equipment based on its actual demand
Some/multiple/whole photograph album, and be used to indicate to determine selected phase to trigger by operating respective keys for the photograph album chosen
Instruction of character relation etc. in volume.
Step 102, concentrate from the Target Photo and determine each character image, and each character image to determining
Analyzed, obtain the corresponding character features of each character image.
On the basis of the Target Photo collection is obtained, specifically using corresponding face recognition technology such as feature based
Human face detection tech, the human face detection tech based on template matches or human face detection tech based on statistics etc., from the target
Identify whether it includes character image in each photo that pictures include, and including when determine and extract to provide
Character image included by body.
On this basis, it can continue through and character features analysis is carried out to each character image determined, to obtain
State the character features corresponding to each character image.
Step 103, acquisition one refer to character image.
It is described to refer to character image, for carrying out personage as each personage subsequently involved to Target Photo concentration
Reference foundation when relation determines, that is to say, that it is follow-up, it can come using the personage with reference to corresponding to character image as reference
Determine that the Target Photo concentrates the personage between involved each personage and the personage with reference to corresponding to character image to close
System.
For an electronic equipment, under preferable case, it may be selected described in user's image conduct of electronic equipment
With reference to character image, in specific implementation, the current self-timer character image of electronic equipment or the Target Photo can be concentrated
Self-timer character image regards as the equipment user's image for belonging to electronic equipment, then, accordingly can be by described in acquisition
The self-timer character image that the current self-timer character image of electronic equipment or the Target Photo are concentrated, described personage is referred to realize
The acquisition of image.
In addition, can also be using the character image that user specifies as the reference man in the case where user specifies
Object image, for example, the character image in a certain photo that user is specified from a certain photograph album of the electronic equipment is as described in
With reference to character image etc..
Step 104, based on described with reference to the corresponding character features of character image, and corresponding to each character image
Character features, determine between personage and the personage with reference to corresponding to character image corresponding to each character image
Character relation.
After the reference character image is obtained, equally corresponding character features point can be carried out with reference to character image to described
Analysis, obtains the character features with reference to corresponding to character image.On this basis, can continue to refer to character image based on described
Corresponding character features, and the character features corresponding to each character image, determine that each character image institute is right
Character relation between the personage and the personage with reference to corresponding to character image that answer, such as set membership, conjugal relation, friend
Relation, Peer Relationships etc..
Understood based on above scheme, using the information processing method of the present embodiment, can effectively determine electronic equipment target
Character relation in pictures between involved each personage, so as to be retrieved in the photo that application scheme is applied to electronic equipment
When middle, electronic equipment can be supported to carry out more intelligent photo retrieval based on character relation, and then electronic equipment retrieval can be lifted
The precision of photo.
With reference to figure 2, Fig. 2 is the flow chart of the information processing method embodiment two for a kind of electronic equipment that the application provides,
The information processing method for the electronic equipment that the present embodiment continues to provide the application is described in further detail, as shown in Fig. 2, this reality
Applying method described in example can be realized by following processing procedure：
Target Photo collection in step 201, the acquisition electronic equipment.
The Target Photo collection can be a photograph album in the electronic equipment, multiple photograph albums or whole photograph albums, or
It can also be that a certain Part of photos taken in some photograph album, the present embodiment are not construed as limiting this in the electronic equipment.
Since the application is intended to by determining that electronic equipment Target Photo concentrates the character relation between involved each personage,
Make it possible to support electronic equipment to retrieve photo in a manner of more intelligent based on character relation, therefore, in this step, specifically may be used
When receiving for indicating to determine that Target Photo concentrates the instruction of character relation, the Target Photo in the electronic equipment is obtained
Collection.
Wherein, it is described be used for indicate determine Target Photo concentrate character relation instruction can by electronic equipment meet it is pre-
Automatic trigger during fixed condition, for example be redefined for when Target Photo is concentrated and increased the photo including character image newly, by electricity
Sub- equipment automatic trigger is used to indicate to determine that Target Photo concentrates the described instruction of character relation, or presets and set by electronics
The instruction of standby periodic triggers (such as at interval of the once instruction of one week automatic trigger).
In addition, it is described to be used to indicate to determine that Target Photo concentrates the instruction of character relation be by electronic equipment
User is triggered by performing corresponding operating on equipment interface, such as, user is chosen in electronic equipment based on its actual demand
Some/multiple/whole photograph album, and be used to indicate to determine selected phase to trigger by operating respective keys for the photograph album chosen
Instruction of character relation etc. in volume.
Step 202, concentrate from the Target Photo and determine each character image, to each character image for determining into
Row Facial Feature Analysis and face compare, and obtain the gender of personage corresponding to each character image, age, in the picture
The frequency of occurrences and group photo frequency of concentration.
On the basis of the Target Photo collection is obtained, using the face of corresponding face recognition technology such as feature based
Detection technique, the human face detection tech based on template matches or human face detection tech based on statistics etc., from the Target Photo
Concentrate and identify whether it includes character image in each photo for including, and including when determine and extract specific institute
Including character image.
Determined and after extracting each character image being concentrated from the Target Photo, can be to each figure map for extracting
Compare as carrying out Facial Feature Analysis and face, such as the human face analysis based on facial geometric feature or based on mask feature
Human face analysis etc., and compare with reference to face, draw the gender of personage corresponding to each character image, age, described
The character features such as the frequency of occurrences and group photo frequency in pictures.
Step 203, carry out character activities analysis to each character image determined, obtains each character image institute
The Activity Type of corresponding personage.
Gender, age, the frequency of occurrences in the pictures except analyzing the personage corresponding to each character image
And the group photo character features such as frequency, in the present embodiment, character activities analysis also is carried out to each character image determined, with this
Obtain the Activity Type of the personage corresponding to each character image.
Wherein, can be by analyzing, identifying the information such as activity scene and figure action corresponding to character image, to determine
The Activity Type of personage corresponding to each character image, specifically, such as, analyzing the activity scene corresponding to character image is
Home scenarios, Outdoor Scene or operative scenario, and figure action is dining, dancing or work etc., are determined with this
The Activity Type of personage corresponding to each character image, the Activity Type can accordingly be but not limited to home-use
Meal, open air such as are had a dinner party, dance, working at all kinds.
Step 204, acquisition one refer to character image.
It is described to refer to character image, for carrying out personage as each personage subsequently involved to Target Photo concentration
Reference foundation when relation determines, that is to say, that it is follow-up, it can come using the personage with reference to corresponding to character image as reference
Determine that the Target Photo concentrates the personage between involved each personage and the personage with reference to corresponding to character image to close
System.
For an electronic equipment, under preferable case, it may be selected described in user's image conduct of electronic equipment
With reference to character image, in specific implementation, the current self-timer character image of electronic equipment or the Target Photo can be concentrated
Self-timer character image regards as the equipment user's image for belonging to electronic equipment, then, accordingly can be by described in acquisition
The self-timer character image that the current self-timer character image of electronic equipment or the Target Photo are concentrated, described personage is referred to realize
The acquisition of image.
In addition, can also be using the character image that user specifies as the reference man in the case where user specifies
Object image, for example, the character image in a certain photo that user is specified from a certain photograph album of the electronic equipment is as described in
With reference to character image etc..
Step 205, based on personage's gender with reference to character image and corresponding to each character image, year
Age, Activity Type, the frequency of occurrences in the pictures and group photo frequency, determine the people corresponding to each character image
Character relation between thing and the personage with reference to corresponding to character image.
After the reference character image is obtained, above-mentioned character features analysis mode can be equally used, analyzes the reference
Gender, age, the frequency of occurrences in the pictures and the group photo frequency of personage corresponding to character image, and activity class
The character features such as type.So as on this basis, be based on described with reference to corresponding to character image and each character image
Personage's gender, age, Activity Type, the frequency of occurrences in the pictures and the group photo information such as frequency, described in determining
The character relation between personage and the personage with reference to corresponding to character image corresponding to each character image.
For example, it is assumed that the age of the personage with reference to corresponding to character image is the young and middle-aged age, gender man, then such as
Personage's age corresponding to a certain character image of fruit is child's age, and assumes that the character image of the personage frequently occurs in house
In individual's scene such as front yard, while assume that the gender of the personage is female, then can be by the personage with reference to corresponding to character image
It is judged as father and daughter's relation with the character relation of the personage；Analogously, if the image of the personage frequently occurs in family etc.
In private scene, gender female, and be of the similar age with the personage with reference to corresponding to character image, then it can refer to personage by described
The character relation of personage and the personage corresponding to image are judged as conjugal relation；If the image of the personage appears in work etc.
In occasion, and it is of the similar age with the personage with reference to corresponding to character image, then can determine whether both is Peer Relationships.
Using the information processing method of the present embodiment, can effectively determine each involved by electronic equipment Target Photo concentration
Character relation between personage, so that when during the photo that application scheme is applied to electronic equipment is retrieved, can support electronics to set
It is standby that more intelligent photo retrieval is carried out based on character relation, and then the precision of electronic equipment retrieval photo can be lifted.
With reference to figure 3, Fig. 3 is the flow chart of the information processing method embodiment three for a kind of electronic equipment that the application provides,
In the present embodiment, as shown in figure 3, the method can also comprise the following steps：
Step 206, obtain picture query instruction, and the picture query instruction includes personage's body towards the character relation
Part information and/or the Activity Type information of personage.
On the basis of determining that electronic equipment Target Photo concentrates the character relation between involved each personage, electricity can be supported
Sub- equipment carries out photo inspection based on the character relation determined such as father and daughter's relation, conjugal relation, friends, Peer Relationships etc.
Rope.
Subsequently, can when the user of electronic equipment exists, and the demand for retrieving required photo is concentrated from the Target Photo
By performing corresponding operating at the interface of electronic equipment, to trigger the picture query instruction, which is used to indicate that electronics is set
It is standby from the Target Photo Integrated query, retrieve photo needed for user.Wherein, the picture query instruction can be set by electronics
Standby user is provided when electronic equipment is in speech retrieval pattern in a manner of voice typing, such as to electronic equipment typing
Phonetic order of " inquiry daughter photo ", " inquiry colleague photo " etc.；Alternatively, it can also be set by the user of electronic equipment in electronics
It is standby to be provided in a manner of word inputs when be in character search pattern, for example, to electronic equipment input " inquiring about daughter's photo ", " look into
Literal order of inquiry colleague photo " etc..
Here, it is necessary to illustrate, since personage of the application between the personage corresponding to each character image is analyzed is closed
When being, except by the use of the gender of each personage, age, the frequency of occurrences in the pictures and group photo frequency etc. information as dividing
Foundation is analysed, also uses the Activity Type of each personage as analysis foundation, so that, electronic equipment can not only distinguish the target
Character relation in pictures between involved each personage, additionally it is possible to distinguish the Activity Type of each personage, then, accordingly,
The electronic equipment being capable of the looking into Target Photo concentration progress photo of the Activity Type based on character relation and/or personage
Ask, retrieval.
In consideration of it, the picture query instruction can be included towards piece identity's information of the character relation and/or people
The Activity Type information of thing, so that, user can only include personage's body by sound/character typing mode to electronic equipment typing
The picture query instructions such as " the inquiry daughter photo " of part information, " inquiry colleague photo ", or can also be to electronic equipment typing
The only picture query instruction such as " inquiry have a dinner party photo " including character activities type information, " inquiry work photo ", or may be used also
With not only included to electronic equipment typing piece identity's information again " inquire about daughter's dancing photo " including character activities type information,
The picture query instruction of " inquiry wife's dining photo " etc..
Step 207, go out including meeting piece identity's information and/or Activity Type from the Target Photo Integrated query
The picture of the personage of information.
After the picture query instruction is obtained, included piece identity's information in being instructed based on the picture query
And/or the Activity Type information of personage, photo retrieval is carried out to the Target Photo collection, finally concentrates and examines from the Target Photo
Rope goes out each photo for the Activity Type information for meeting piece identity's information and/or personage, such as, retrieve daughter's dancing
Each photo, or each photo etc. of wife's dining.
The present embodiment, which is realized, carries out more intelligent photo retrieval, energy based on character relation and/or character activities type
The precision of enough effectively lifting electronic equipment retrieval photos.
Here, it is necessary to explanation, in actual implementation the application, application scheme can be based solely on, from character relation,
The dimension of character activities type carries out photo retrieval, alternatively, time, place will can also be in the prior art based on from pictures
The scheme of photo is retrieved, is combined with the scheme based on character relation, character activities type retrieval photo in the application, with full
Sufficient user carries out the demand of photo inquiry, retrieval from multiple dimensions such as time, place, character relation, character activities type.
With reference to figure 4, Fig. 4 is the structure diagram for a kind of electronic equipment example IV that the application provides, wherein, the electricity
It is each that sub- equipment can be, but not limited to, smart mobile phone, tablet computer, digital camera, laptop, desktop computer, all-in-one machine etc.
Kind terminal device, as shown in figure 4, electronic equipment includes described in the present embodiment：
First acquisition unit 100, for obtaining the Target Photo collection in the electronic equipment.
The Target Photo collection can be a photograph album in the electronic equipment, multiple photograph albums or whole photograph albums, or
It can also be that a certain Part of photos taken in some photograph album, the present embodiment are not construed as limiting this in the electronic equipment.
Since the application is intended to by determining that electronic equipment Target Photo concentrates the character relation between involved each personage,
Make it possible to support electronic equipment to retrieve photo in a manner of more intelligent based on character relation, therefore, can specifically receive
During for indicating to determine that Target Photo concentrates the instruction of character relation, the Target Photo collection in the electronic equipment is obtained.
Wherein, it is described be used for indicate determine Target Photo concentrate character relation instruction can by electronic equipment meet it is pre-
Automatic trigger during fixed condition, for example be redefined for when Target Photo is concentrated and increased the photo including character image newly, by electricity
Sub- equipment automatic trigger is used to indicate to determine that Target Photo concentrates the described instruction of character relation, or presets and set by electronics
The instruction of standby periodic triggers (such as at interval of the once instruction of one week automatic trigger).
In addition, it is described to be used to indicate to determine that Target Photo concentrates the instruction of character relation be by electronic equipment
User is triggered by performing corresponding operating on equipment interface, such as, user is chosen in electronic equipment based on its actual demand
Some/multiple/whole photograph album, and be used to indicate to determine selected phase to trigger by operating respective keys for the photograph album chosen
Instruction of character relation etc. in volume.
Characteristic analysis unit 200, each character image is determined for being concentrated from the Target Photo, and to determining
Each character image is analyzed, and obtains the corresponding character features of each character image.
On the basis of the Target Photo collection is obtained, specifically using corresponding face recognition technology such as feature based
Human face detection tech, the human face detection tech based on template matches or human face detection tech based on statistics etc., from the target
Identify whether it includes character image in each photo that pictures include, and including when determine and extract to provide
Character image included by body.
On this basis, it can continue through and character features analysis is carried out to each character image determined, to obtain
State the character features corresponding to each character image.
Second acquisition unit 300, character image is referred to for obtaining one.
It is described to refer to character image, for carrying out personage as each personage subsequently involved to Target Photo concentration
Reference foundation when relation determines, that is to say, that it is follow-up, it can come using the personage with reference to corresponding to character image as reference
Determine that the Target Photo concentrates the personage between involved each personage and the personage with reference to corresponding to character image to close
System.
For an electronic equipment, under preferable case, it may be selected described in user's image conduct of electronic equipment
With reference to character image, in specific implementation, the current self-timer character image of electronic equipment or the Target Photo can be concentrated
Self-timer character image regards as the equipment user's image for belonging to electronic equipment, then, accordingly can be by described in acquisition
The self-timer character image that the current self-timer character image of electronic equipment or the Target Photo are concentrated, described personage is referred to realize
The acquisition of image.
In addition, can also be using the character image that user specifies as the reference man in the case where user specifies
Object image, for example, the character image in a certain photo that user is specified from a certain photograph album of the electronic equipment is as described in
With reference to character image etc..
Character relation determination unit 400, for referring to the corresponding character features of character image based on described, and it is described each
Character features corresponding to a character image, determine that the personage corresponding to each character image refers to character image with described
Character relation between corresponding personage.
After the reference character image is obtained, equally corresponding character features point can be carried out with reference to character image to described
Analysis, obtains the character features with reference to corresponding to character image.On this basis, can continue to refer to character image based on described
Corresponding character features, and the character features corresponding to each character image, determine that each character image institute is right
Character relation between the personage and the personage with reference to corresponding to character image that answer, such as set membership, conjugal relation, friend
Relation, Peer Relationships etc..
Understood based on above scheme, using the electronic equipment of the present embodiment, can effectively determine electronic equipment Target Photo
The character relation between involved each personage is concentrated, so that in application scheme to be applied to the photo retrieval of electronic equipment
When, electronic equipment can be supported to carry out more intelligent photo retrieval based on character relation, and then electronic equipment retrieval can be lifted and shone
The precision of piece.
Continue that the electronic equipment that the application provides is described in further detail in ensuing embodiment five, the present embodiment
In, the characteristic analysis unit 200 in the electronic equipment, is specifically used for：
Concentrated from the Target Photo and determine each character image, it is special to carry out face to each character image determined
Sign analysis and face compare, and obtain the gender of personage, age, going out in the pictures corresponding to each character image
Existing frequency and group photo frequency；Character activities analysis is carried out to each character image determined, obtains each character image
The Activity Type of corresponding personage.
On the basis of the Target Photo collection is obtained, using the face of corresponding face recognition technology such as feature based
Detection technique, the human face detection tech based on template matches or human face detection tech based on statistics etc., from the Target Photo
Concentrate and identify whether it includes character image in each photo for including, and including when determine and extract specific institute
Including character image.
Determined and after extracting each character image being concentrated from the Target Photo, can be to each figure map for extracting
Compare as carrying out Facial Feature Analysis and face, such as the human face analysis based on facial geometric feature or based on mask feature
Human face analysis etc., and compare with reference to face, draw the gender of personage corresponding to each character image, age, described
The character features such as the frequency of occurrences and group photo frequency in pictures.
Gender, age, the frequency of occurrences in the pictures except analyzing the personage corresponding to each character image
And the group photo character features such as frequency, in the present embodiment, character activities analysis also is carried out to each character image determined, with this
Obtain the Activity Type of the personage corresponding to each character image.
Wherein, can be by analyzing, identifying the information such as activity scene and figure action corresponding to character image, to determine
The Activity Type of personage corresponding to each character image, specifically, such as, analyzing the activity scene corresponding to character image is
Home scenarios, Outdoor Scene or operative scenario, and figure action is dining, dancing or work etc., are determined with this
The Activity Type of personage corresponding to each character image, the Activity Type can accordingly be but not limited to home-use
Meal, open air such as are had a dinner party, dance, working at all kinds.
Corresponding, the character relation determination unit 400, is specifically used for：
Based on personage's gender, age, the activity class with reference to character image and corresponding to each character image
Type, the frequency of occurrences in the pictures and group photo frequency, determine personage corresponding to each character image with it is described
The character relation between personage with reference to corresponding to character image.
After obtaining with reference to character image, above-mentioned character features analysis mode can be equally used, analysis is described to refer to personage
Gender, age, the frequency of occurrences in the pictures and the group photo frequency of personage corresponding to image, and Activity Type etc.
Character features.So that on this basis, can be based on the people with reference to character image and corresponding to each character image
Physical property not, the age, Activity Type, the frequency of occurrences in the pictures and the group photo information such as frequency, it is described each to determine
The character relation between personage and the personage with reference to corresponding to character image corresponding to character image.
For example, it is assumed that the age of the personage with reference to corresponding to character image is the young and middle-aged age, gender man, then such as
Personage's age corresponding to a certain character image of fruit is child's age, and assumes that the character image of the personage frequently occurs in house
In individual's scene such as front yard, while assume that the gender of the personage is female, then can be by the personage with reference to corresponding to character image
It is judged as father and daughter's relation with the character relation of the personage；Analogously, if the image of the personage frequently occurs in family etc.
In private scene, gender female, and be of the similar age with the personage with reference to corresponding to character image, then it can refer to personage by described
The character relation of personage and the personage corresponding to image are judged as conjugal relation；If the image of the personage appears in work etc.
In occasion, and it is of the similar age with the personage with reference to corresponding to character image, then can determine whether both is Peer Relationships.
Using the electronic equipment of the present embodiment, it can effectively determine that electronic equipment Target Photo concentrates involved each personage
Between character relation so that by application scheme be applied to electronic equipment photo retrieval in when, can support electronic equipment base
More intelligent photo retrieval is carried out in character relation, and then the precision of electronic equipment retrieval photo can be lifted.
With reference to figure 5, Fig. 5 is the structure diagram for a kind of electronic equipment embodiment six that the application provides, in the present embodiment,
The electronic equipment can also include：
Picture query unit 500, for obtaining picture query instruction, the picture query instruction is included towards the personage
Piece identity's information of relation and/or the Activity Type information of personage；And go out from the Target Photo Integrated query including meeting
The picture of the personage of piece identity's information and/or Activity Type information.
On the basis of determining that electronic equipment Target Photo concentrates the character relation between involved each personage, electricity can be supported
Sub- equipment carries out photo inspection based on the character relation determined such as father and daughter's relation, conjugal relation, friends, Peer Relationships etc.
Rope.
Subsequently, can when the user of electronic equipment exists, and the demand for retrieving required photo is concentrated from the Target Photo
By performing corresponding operating at the interface of electronic equipment, to trigger the picture query instruction, which is used to indicate that electronics is set
It is standby from the Target Photo Integrated query, retrieve photo needed for user.Wherein, the picture query instruction can be set by electronics
Standby user is provided when electronic equipment is in speech retrieval pattern in a manner of voice typing, such as to electronic equipment typing
Phonetic order of " inquiry daughter photo ", " inquiry colleague photo " etc.；Alternatively, it can also be set by the user of electronic equipment in electronics
It is standby to be provided in a manner of word inputs when be in character search pattern, for example, to electronic equipment input " inquiring about daughter's photo ", " look into
Literal order of inquiry colleague photo " etc..
Here, it is necessary to illustrate, since personage of the application between the personage corresponding to each character image is analyzed is closed
When being, except by the use of the gender of each personage, age, the frequency of occurrences in the pictures and group photo frequency etc. information as dividing
Foundation is analysed, also uses the Activity Type of each personage as analysis foundation, so that, electronic equipment can not only distinguish the target
Character relation in pictures between involved each personage, additionally it is possible to distinguish the Activity Type of each personage, then, accordingly,
The electronic equipment being capable of the looking into Target Photo concentration progress photo of the Activity Type based on character relation and/or personage
Ask, retrieval.
In consideration of it, the picture query instruction can be included towards piece identity's information of the character relation and/or people
The Activity Type information of thing, so that, user can only include personage's body by sound/character typing mode to electronic equipment typing
The picture query instructions such as " the inquiry daughter photo " of part information, " inquiry colleague photo ", or can also be to electronic equipment typing
The only picture query instruction such as " inquiry have a dinner party photo " including character activities type information, " inquiry work photo ", or may be used also
With not only included to electronic equipment typing piece identity's information again " inquire about daughter's dancing photo " including character activities type information,
The picture query instruction of " inquiry wife's dining photo " etc..
After the picture query instruction is obtained, included piece identity's information in being instructed based on the picture query
And/or the Activity Type information of personage, photo retrieval is carried out to the Target Photo collection, finally concentrates and examines from the Target Photo
Rope goes out each photo for the Activity Type information for meeting piece identity's information and/or personage, such as, retrieve daughter's dancing
Each photo, or each photo etc. of wife's dining.
The present embodiment, which is realized, carries out more intelligent photo retrieval, energy based on character relation and/or character activities type
The precision of enough effectively lifting electronic equipment retrieval photos.
It should also be noted that, in actual implementation the application, application scheme can be based solely on, from character relation, people
The dimension of thing Activity Type carries out photo retrieval, alternatively, in the prior art can also will be based on the time, place is examined from pictures
The scheme of rope photo, is combined with the scheme based on character relation, character activities type retrieval photo in the application, to meet
User carries out the demand of photo inquiry, retrieval from multiple dimensions such as time, place, character relation, character activities type.
Each embodiment in this specification is described by the way of progressive, what each embodiment stressed be with
The difference of other embodiment, between each embodiment identical similar part mutually referring to.
For convenience of description, describe to be divided into various modules when system above or device with function or unit describes respectively.
Certainly, the function of each unit can be realized in same or multiple softwares and/or hardware when implementing the application.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can
Realized by the mode of software plus required general hardware platform.Based on such understanding, the technical solution essence of the application
On the part that contributes in other words to the prior art can be embodied in the form of software product, the computer software product
It can be stored in storage medium, such as ROM/RAM, magnetic disc, CD, including some instructions are used so that a computer equipment
(can be personal computer, server, either network equipment etc.) performs some of each embodiment of the application or embodiment
Method described in part.
Finally, it is to be noted that, herein, the relational terms of such as first, second, third and fourth or the like
It is used merely to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying these
There are any actual relationship or order between entity or operation.Moreover, term " comprising ", "comprising" or its is any
Other variations are intended to non-exclusive inclusion, so that process, method, article or equipment including a series of elements
Not only include those key elements, but also including other elements that are not explicitly listed, or further include as this process, side
Method, article or the intrinsic key element of equipment.In the absence of more restrictions, limited by sentence "including a ..."
Key element, it is not excluded that also there are other identical element in the process, method, article or apparatus that includes the element.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
1. the information processing method of a kind of electronic equipment, it is characterised in that the described method includes：
Obtain the Target Photo collection in the electronic equipment；
Concentrated from the Target Photo and determine each character image, and each character image to determining is analyzed, and is obtained
To the corresponding character features of each character image；
Obtain one and refer to character image；
The corresponding character features of character image, and the character features corresponding to each character image are referred to based on described,
Determine the character relation between personage and the personage with reference to corresponding to character image corresponding to each character image.
2. according to the method described in claim 1, it is characterized in that, the described pair of each character image determined is analyzed,
The corresponding character features of each character image are obtained, including：
Facial Feature Analysis is carried out to each character image determined and face compares, it is right to obtain each character image institute
Answer gender, age, the frequency of occurrences in the pictures and the group photo frequency of personage；
Character activities analysis is carried out to each character image determined, obtains the work of personage corresponding to each character image
Dynamic type.
3. according to the method described in claim 1, it is characterized in that, described obtain one refers to character image, including：
Obtain the current self-timer character image of the electronic equipment and refer to character image as described；
Alternatively, obtain the self-timer character image that the Target Photo is concentrated refers to character image as described；
Alternatively, obtain the character image that user specifies refers to character image as described.
It is 4. according to the method described in claim 2, it is characterized in that, described based on described special with reference to the corresponding personage of character image
Sign, and the character features corresponding to each character image, determine the personage corresponding to each character image and institute
The character relation between the personage with reference to corresponding to character image is stated, including：
Based on personage's gender with reference to character image and corresponding to each character image, the age, Activity Type,
The frequency of occurrences and group photo frequency in the pictures, determine the personage corresponding to each character image and the reference man
The character relation between personage corresponding to object image.
5. according to the method described in claim 4, it is characterized in that, further include：
Obtain picture query instruction, picture query instruction include towards the character relation piece identity's information and/or
The Activity Type information of personage；
Go out the personage's including meeting piece identity's information and/or Activity Type information from the Target Photo Integrated query
Picture.
6. a kind of electronic equipment, it is characterised in that including：
First acquisition unit, for obtaining the Target Photo collection in the electronic equipment；
Characteristic analysis unit, each character image, and each individual to determining are determined for being concentrated from the Target Photo
Object image is analyzed, and obtains the corresponding character features of each character image；
Second acquisition unit, character image is referred to for obtaining one；
Character relation determination unit, for based on the corresponding character features of the reference character image, and each personage
Character features corresponding to image, determine the personage corresponding to each character image with described with reference to corresponding to character image
Personage between character relation.
7. electronic equipment according to claim 6, it is characterised in that the characteristic analysis unit, it is each to what is determined
Character image is analyzed, and is obtained the corresponding character features of each character image, is specifically included：
Facial Feature Analysis is carried out to each character image determined and face compares, it is right to obtain each character image institute
Answer gender, age, the frequency of occurrences in the pictures and the group photo frequency of personage；
Character activities analysis is carried out to each character image determined, obtains the work of personage corresponding to each character image
Dynamic type.
8. electronic equipment according to claim 6, it is characterised in that the second acquisition unit, is specifically used for：
Obtain the current self-timer character image of the electronic equipment and refer to character image as described；
Alternatively, obtain the self-timer character image that the Target Photo is concentrated refers to character image as described；
Alternatively, obtain the character image that user specifies refers to character image as described.
9. electronic equipment according to claim 7, it is characterised in that the character relation determination unit, is specifically used for：
Based on personage's gender with reference to character image and corresponding to each character image, the age, Activity Type,
The frequency of occurrences and group photo frequency in the pictures, determine the personage corresponding to each character image and the reference man
The character relation between personage corresponding to object image.
10. electronic equipment according to claim 9, it is characterised in that further include：
Picture query unit, for obtaining picture query instruction, the picture query instruction is included towards the character relation
Piece identity's information and/or the Activity Type information of personage；And go out from the Target Photo Integrated query including meeting the people
The picture of the personage of thing identity information and/or Activity Type information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711392221.8A CN107944052A (en) | 2017-12-21 | 2017-12-21 | The information processing method and electronic equipment of a kind of electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711392221.8A CN107944052A (en) | 2017-12-21 | 2017-12-21 | The information processing method and electronic equipment of a kind of electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107944052A true CN107944052A (en) | 2018-04-20 |
Family
ID=61941001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711392221.8A Pending CN107944052A (en) | 2017-12-21 | 2017-12-21 | The information processing method and electronic equipment of a kind of electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107944052A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815298A (en) * | 2019-01-28 | 2019-05-28 | 腾讯科技（深圳）有限公司 | A kind of character relation net determines method, apparatus and storage medium |
| CN112069982A (en) * | 2020-09-03 | 2020-12-11 | Oppo广东移动通信有限公司 | Target image acquisition method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102332034A (en) * | 2011-10-21 | 2012-01-25 | 中国科学院计算技术研究所 | Portrait picture retrieval method and device |
| CN104731880A (en) * | 2015-03-09 | 2015-06-24 | 小米科技有限责任公司 | Image ordering method and device |
| CN105138681A (en) * | 2015-09-15 | 2015-12-09 | 成都品果科技有限公司 | Picture search method and system based on space coordinate positioning |
| CN105354308A (en) * | 2015-11-09 | 2016-02-24 | 惠州Tcl移动通信有限公司 | Photo preview processing method and system for mobile terminal |
| US20160275340A1 (en) * | 2014-07-30 | 2016-09-22 | International Business Machines Corporation | Facial Image Bucketing with Expectation Maximization and Facial Coordinates |
| CN106250439A (en) * | 2016-07-26 | 2016-12-21 | 四川长虹电器股份有限公司 | Cohesion display systems and method between photo personage |
| CN106796709A (en) * | 2013-12-20 | 2017-05-31 | 英特尔公司 | Social circle and relation identity |
-
2017
- 2017-12-21 CN CN201711392221.8A patent/CN107944052A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102332034A (en) * | 2011-10-21 | 2012-01-25 | 中国科学院计算技术研究所 | Portrait picture retrieval method and device |
| CN106796709A (en) * | 2013-12-20 | 2017-05-31 | 英特尔公司 | Social circle and relation identity |
| US20160275340A1 (en) * | 2014-07-30 | 2016-09-22 | International Business Machines Corporation | Facial Image Bucketing with Expectation Maximization and Facial Coordinates |
| CN104731880A (en) * | 2015-03-09 | 2015-06-24 | 小米科技有限责任公司 | Image ordering method and device |
| CN105138681A (en) * | 2015-09-15 | 2015-12-09 | 成都品果科技有限公司 | Picture search method and system based on space coordinate positioning |
| CN105354308A (en) * | 2015-11-09 | 2016-02-24 | 惠州Tcl移动通信有限公司 | Photo preview processing method and system for mobile terminal |
| CN106250439A (en) * | 2016-07-26 | 2016-12-21 | 四川长虹电器股份有限公司 | Cohesion display systems and method between photo personage |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815298A (en) * | 2019-01-28 | 2019-05-28 | 腾讯科技（深圳）有限公司 | A kind of character relation net determines method, apparatus and storage medium |
| CN112069982A (en) * | 2020-09-03 | 2020-12-11 | Oppo广东移动通信有限公司 | Target image acquisition method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200142928A1 (en) | Mobile video search | |
| Kim et al. | An efficient algorithm for video sequence matching using the modified Hausdorff distance and the directed divergence | |
| US20200393915A1 (en) | Pictorial symbol prediction | |
| US12001495B2 (en) | Matchmaking video chatting partners | |
| CN103399896B (en) | The method and system of incidence relation between identification user | |
| JP2006190296A (en) | Method and apparatus for providing information by using context extracted from multimedia communication system | |
| US11681749B2 (en) | Automated ranking of video clips | |
| CN105653636A (en) | Information processing method and apparatus as well as information processing apparatus | |
| CN105302315A (en) | Image processing method and device | |
| Ali et al. | Automated attendance management systems: systematic literature review | |
| CN104767963A (en) | Method and device for representing information of persons participating in video conference | |
| US20230013116A1 (en) | Multimodal entity identification | |
| CN102855317A (en) | Multimode indexing method and system based on demonstration video | |
| Solomon Mathialagan et al. | Vip: Finding important people in images | |
| TW202242715A (en) | Identity recognition method electronic equipment and computer-readable storage medium | |
| CN110169055A (en) | A kind of method and apparatus generating shot information | |
| CN110022397B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN103984931B (en) | A kind of information processing method and the first electronic equipment | |
| CN112995757B (en) | Video clipping method and device | |
| US11120334B1 (en) | Multimodal named entity recognition | |
| CN107944052A (en) | The information processing method and electronic equipment of a kind of electronic equipment | |
| CN108009251A (en) | A kind of image file searching method and device | |
| CN110377808A (en) | Document processing method, device, electronic equipment and storage medium | |
| CN109521888A (en) | A kind of input method, device and medium | |
| CN108287873B (en) | Data processing method and related product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180420 |
|
| RJ01 | Rejection of invention patent application after publication |