[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN109829368A - Recognition methods, device, computer equipment and the storage medium of palm feature - Google Patents

Recognition methods, device, computer equipment and the storage medium of palm feature Download PDF

Info

Publication number
CN109829368A
CN109829368A CN201811583897.XA CN201811583897A CN109829368A CN 109829368 A CN109829368 A CN 109829368A CN 201811583897 A CN201811583897 A CN 201811583897A CN 109829368 A CN109829368 A CN 109829368A
Authority
CN
China
Prior art keywords
palm
key point
coordinate
finger
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811583897.XA
Other languages
Chinese (zh)
Other versions
CN109829368B (en
Inventor
刘翔
王福晴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Priority to CN201811583897.XA priority Critical patent/CN109829368B/en
Publication of CN109829368A publication Critical patent/CN109829368A/en
Application granted granted Critical
Publication of CN109829368B publication Critical patent/CN109829368B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Collating Specific Patterns (AREA)

Abstract

The present invention proposes a kind of recognition methods of palm feature, which comprises the trigger event of monitoring palm feature identification obtains palm image when detecting the trigger event;The first key point in the palm image at middle fingertip and the middle coordinate for referring to the second key point at root are extracted in the plane coordinate system constructed in advance, the coordinate according to first key point and the second key point judges that the finger of palm in the palm image is directed toward;The coordinate that little finger of toe refers to the third key point at root is extracted, the palm feature for judging the palm image is directed toward according to the coordinate of first key point, the coordinate of the third key point and the finger.The palm feature of the left and right attribute of palm may be implemented in the present invention, solves the problems, such as the identification of the attribute to same people right-hand man in the prior art, and the identification of palm feature of the invention, which can aid in, more accurately identifies palm print information.

Description

Recognition methods, device, computer equipment and the storage medium of palm feature
Technical field
The present invention relates to technical field of information processing more particularly to a kind of recognition methods of palm feature, device, computer Equipment and storage medium.
Background technique
Palm-print identifying arithmetic is a kind of newer biometrics identification technology proposed in recent years.Palmmprint refers to finger tips To the palm image of wrist.Wherein many features can be used to carry out identification: as main line, wrinkle, tiny texture, Ridge tip, bifurcation etc..Personal recognition is also a kind of non-offensive recognition methods, and user is easier to receive, set to acquisition It is standby of less demanding.
Most important feature is streakline feature in palmmprint, and several streak lines clearest in these streakline features are substantially It is not changed with all one's life of people.The feature of palmmprint includes streakline feature, point feature textural characteristics, further includes geometry spy Sign: such as the distribution of the width of palm, length and geometry and palm different zones.Information included in palmmprint more than The abundant information that one piece of fingerprint includes, completely can be true using the streakline feature of palmmprint, point feature, textural characteristics, geometrical characteristic Determine a person's identity.Therefore, the application range of personal recognition will be increasingly wider, how to improve the precision of palm-print identifying arithmetic The problem of as requiring study.
Currently, the upper palm-print identifying arithmetic of market is difficult accurately to judge the direction of hand and the left and right attribute of hand, to the palm Being individually identified for same people right-hand man of line identification causes difficulty.
Therefore, existing technical solution can not identify the specific object of palm, cause the accuracy of personal recognition inadequate Height, recognizer are complicated and unreliable.
Summary of the invention
The present invention provide a kind of palm feature recognition methods and corresponding device, mainly realizing the present invention can be real The palm feature of the left and right attribute of existing palm, solves the problems, such as the identification of the attribute to same people right-hand man in the prior art, this The identification of the palm feature of invention, which can aid in, more accurately identifies palm print information.
The computer equipment that the present invention also provides a kind of for executing the recognition methods of palm feature of the invention and readable Storage medium.
To solve the above problems, the present invention uses the technical solution of following various aspects:
In a first aspect, the present invention provides a kind of recognition methods of palm feature, which comprises
The trigger event for monitoring the identification of palm feature obtains palm image when detecting the trigger event;
Extracted in the plane coordinate system constructed in advance the first key point in the palm image at middle fingertip and Middle finger refers to the coordinate of the second key point at root, and the coordinate according to first key point and the second key point judges the hand The finger for slapping palm in image is directed toward;
The coordinate that little finger of toe refers to the third key point at root is extracted, is closed according to the coordinate of first key point, the third The coordinate of key point and the finger are directed toward the palm feature for judging the palm image.
Specifically, the coordinate according to first key point and the second key point judges hand in the palm image The finger of the palm is directed toward, and is specifically included:
Read the coordinate (X1, Y1) of first key point and the coordinate (X2, Y2) of second key point;
If Y1 > the Y2, judge that the finger of palm in the palm image is oriented to the positive direction for being directed toward Y-axis;
If Y1 < the Y2, judge that the finger of palm in the palm image is oriented to the negative direction for being directed toward Y-axis.
Specifically, the little finger of toe that extracts refers to the coordinate of the third key point at root, according to first key point coordinate, The coordinate of the third key point and the finger are directed toward the palm feature for judging the palm image, comprising:
Read the coordinate (X3, Y3) of the third key point;
When finger be oriented to be directed toward Y-axis positive direction, and the abscissa X1 of first key point be less than the third pass The abscissa X3 of key point, alternatively, when the abscissa X1 that finger is oriented to the negative direction and first key point of being directed toward Y-axis is greater than The abscissa X3 of the third key point then judges that the palm feature is otherwise the right hand for left hand.
Specifically, further include:
The coordinate that index finger refers to the 4th key point at root is extracted, according to the 4th key point and the third key point Benchmark line judges the tilt angle of palm in the palm image, according to the tilt angle rotate the palm image with The benchmark line is adjusted to horizontal position.
Specifically, further include:
Make the perpendicular bisector of the benchmark line using the midpoint E of the benchmark line as starting point;
Palm center region is closed on the perpendicular bisector of the benchmark line and takes a point C (X, Y), so that the length L etc. of CE In the half of the benchmark line, using point C as palm centre of the palm point.
Preferably, further includes:
To postrotational palm image, with C (X, Y) for midpoint, with point p1 (X-L, Y-L), p2 (X+L, Y-L), p3 (X-L, Y+L) and p4 (X+L, Y+L) is that vertex determines palm center region;
The palm print characteristics point in the palm center region is extracted, to carry out personal recognition to the palm print characteristics point.
Specifically, when the trigger event of the hand identification is the sliding pressing operation acted on terminal screen, institute It states the coordinate according to first key point, the coordinate of the third key point and finger direction and judges the palm figure After the palm feature of picture, further includes:
According to the left and right attribute of the palm identified, the virtual key on terminal screen is adjusted to the left and right of the palm The corresponding screen side of attribute.
Second aspect, the present invention provide a kind of left and right property recognition means of palm, which comprises
Monitoring modular, when detecting the trigger event, obtains hand for monitoring the trigger event of palm feature identification Slap image;
First judgment module, for being extracted in the plane coordinate system constructed in advance in the palm image at middle fingertip The first key point and middle finger refer to the coordinate of the second key point at root, according to first key point and the second key point Coordinate judge palm in the palm image finger be directed toward;
Second judgment module refers to the coordinate of the third key point at root for extracting little finger of toe, according to first key point Coordinate, the third key point coordinate and the finger be directed toward and judge the palm feature of the palm image.
The third aspect, the present invention provide a kind of computer readable storage medium, deposit on the computer readable storage medium Computer program is contained, the knowledge of palm feature described in any one of first aspect is realized when which is executed by processor The step of other method.
Fourth aspect, the present invention provide a kind of computer equipment, including memory and processor, store in the memory There is computer-readable instruction, when the computer-readable instruction is executed by the processor, so that the processor executes such as the The step of recognition methods of palm feature described in any one of one side claim.
Compared with the existing technology, technical solution of the present invention at least has following advantage:
1, the present invention provides a kind of recognition methods of palm feature, the trigger event identified by monitoring palm feature, when When detecting the trigger event, palm image is obtained;It is extracted in the plane coordinate system constructed in advance in the palm image The first key point and middle finger at middle fingertip refer to the coordinate of the second key point at root, according to first key point and The coordinate of second key point judges that the finger of palm in the palm image is directed toward;It extracts little finger of toe and refers to the third key point at root Coordinate judges the hand according to the coordinate of first key point, the coordinate of the third key point and the finger direction Slap the palm feature of image.The palm feature of the left and right attribute of palm may be implemented in the present invention, solves in the prior art to same The identification problem of the attribute of one people right-hand man, the identification of palm feature of the invention can aid in more accurately identification palmmprint letter Breath.
2, the present invention can adjust the virtual key on terminal screen to institute according to the left and right attribute of the palm identified State the corresponding screen side of left and right attribute of palm.For example, when the present invention is applied to game relevant APP, it can timely basis The palm of the contact mobile terminal identified or the left and right attribute of finger, adjust the position of virtual key.When user uses a left side When hand operates, then corresponding virtual key is adjusted to the left area of the screen of mobile terminal;When user is operated using the right hand When, then corresponding virtual key is adjusted the reaction speed that user is improved to the right area of the screen of mobile terminal and Service speed promotes user experience.
Detailed description of the invention
Fig. 1 is the recognition methods flow chart of palm feature in one embodiment;
Fig. 2 is the schematic diagram in one embodiment according to the palm picture construction plane right-angle coordinate;
Fig. 3 is the schematic diagram that the horizontal position of palm is adjusted in one embodiment;
Fig. 4 is the identification device structural block diagram of palm feature in another embodiment;
Fig. 5 is the internal structure block diagram of computer equipment in one embodiment.
The object of the invention is realized, the embodiments will be further described with reference to the accompanying drawings for functional characteristics and advantage.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described.
In some processes of the description in description and claims of this specification and above-mentioned attached drawing, contain according to Multiple operations that particular order occurs, but it should be clearly understood that these operations can not be what appears in this article suitable according to its Sequence is executed or is executed parallel, and the serial number of operation such as S11, S12 etc. be only used for distinguishing each different operation, serial number It itself does not represent and any executes sequence.In addition, these processes may include more or fewer operations, and these operations can To execute or execute parallel in order.It should be noted that the description such as " first " herein, " second ", is for distinguishing not Same message, equipment, module etc., does not represent sequencing, does not also limit " first " and " second " and be different type.
It will appreciated by the skilled person that unless expressly stated, singular " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or wirelessly coupling.It is used herein to arrange Diction "and/or" includes one or more associated wholes for listing item or any cell and all combinations.
It will appreciated by the skilled person that unless otherwise defined, all terms used herein (including technology art Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Should also Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art The consistent meaning of meaning, and unless idealization or meaning too formal otherwise will not be used by specific definitions as here To explain.
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description in which the same or similar labels are throughly indicated same or similar element or has same or like function Element.Obviously, described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on this Embodiment in invention, those skilled in the art's every other implementation obtained without creative efforts Example, shall fall within the protection scope of the present invention.
Referring to Fig. 1, the embodiment of the present invention provides a kind of recognition methods of palm feature, as shown in Figure 1, the method packet Include following steps:
The trigger event that S11, monitoring palm feature identify obtains palm image when detecting the trigger event.
In the embodiment of the present invention, the trigger event of the hand identification includes but is not limited to that user clicks pressing for personal recognition The event of key and gesture operation etc. for carrying out personal recognition.
After detecting the trigger event, starting camera obtains images to be recognized, passes through algorithm of target detection SSD (Single Shot MultiBox Detector) algorithm detects the palm image in the images to be recognized.SSD be using Single detector of the VGG19 network as feature extractor.Customized convolutional layer is added after the network, and uses convolution kernel Execute prediction.
In a kind of possible design, the step of algorithm of target detection, is as follows:
First, one width picture (200x200) of input, is entered into the good sorter network of pre-training and obtains difference greatly Small Feature Mapping has modified traditional VGG16 network;
Wherein, convolutional layer is converted by the FC6 of VGG16 and FC7 layers;
Remove all Dropout layer and FC8 layers;
It is added to Atrous algorithm (hole algorithm);
Pool5 is transformed into 3x3-S1 from 2x2-S2;
Second, extracting Conv4_3, Conv7, Conv8_2, Conv9_2, Conv10_2, Conv11_2 layers of feature Map, then each point respectively on map layers of these feature constructs the BB of 6 different scale sizes, then distinguishes It is detected and is classified, generate multiple BB;
Third, the different feature map BB obtained is combined, press down by NMS (non-maxima suppression) method System falls a part overlapping or incorrect BB, generates final BB set, i.e. testing result.The inspection of target applied by the present invention Analysis On Multi-scale Features figure level-one convolution is used in method of determining and calculating to be detected.
S12, the first key point in the palm image at middle fingertip is extracted in the plane coordinate system constructed in advance And middle finger refers to the coordinate of the second key point at root, the coordinate according to first key point and the second key point judges institute The finger for stating palm in palm image is directed toward.
Referring to FIG. 2, Fig. 2 is the schematic diagram according to the palm picture construction plane right-angle coordinate.The present invention is implemented In example, need to construct plane right-angle coordinate.Flat square seat a little is constructed for origin specifically, taking in the palm image Mark system, wherein the selection of origin can be selected according to actual needs, is not specifically limited herein.
In the embodiment of the present invention, after acquiring the palm image, described first is extracted according to critical point detection algorithm Key point, such as the M in the T and the second key point such as Fig. 2 in Fig. 2.The mode specifically detected are as follows: to Cascade CNN model It is trained, training data is the training picture for having marked finger tip and having referred to root position.After good to CNN model training, The hand image newly inputted is detected using the model.The present invention is by comparing first key point and second pass The coordinate value of key point judges that the finger of palm in the palm image is directed toward.
Specifically, with continued reference to FIG. 2, reading the first key point T's in rectangular coordinate system shown in Fig. 2 The coordinate (X2, Y2) of coordinate (X1, Y1) and the second key point M.If Y1 > the Y2, judge in the palm image The finger of palm is oriented to the positive direction for being directed toward Y-axis, then is_up mark is True;If Y1 < the Y2 judges the palm The finger of palm is oriented to the negative direction for being directed toward Y-axis in image, then is_up mark is False.
S13, extract little finger of toe and refer to the coordinate of the third key point at root, according to first key point coordinate, described the The coordinate of three key points and the finger are directed toward the palm feature for judging the palm image.
In the embodiment of the present invention, the palm feature is the left and right attribute of palm.The present invention can be closed according to described first The coordinate of key point, the coordinate of the third key point and the finger are directed toward the left and right attribute for judging the palm.
With continued reference to FIG. 2, reading the coordinate (X3, Y3) of the third key point;Y-axis is being directed toward just when finger is oriented to Direction, and the abscissa X1 of first key point is less than the abscissa X3 of the third key point, alternatively, when finger is oriented to The negative direction of direction Y-axis and the abscissa X1 of first key point are greater than the abscissa X3 of the third key point, then judge The palm feature is left hand, is otherwise the right hand.
In a kind of possible design, the present invention can also identify the left and right attribute of finger, such as pass through each of right-hand man The left and right attribute of the profile information identification finger of a finger.
The present invention identifies that the left and right attribute of palm or finger can be applied to the adjustment of virtual key position.Specifically , the virtual key on terminal screen can be adjusted to the left and right of the palm according to the left and right attribute of the palm identified The corresponding screen side of attribute.For example, in a kind of possible application scenarios, by the recognition methods of palm of the invention or so attribute Applied to Games Software, the palmmprint of the palm of user or the fingerprint of finger can be monitored in real time, the palmmprint or finger according to palm Fingerprint judge the left and right attribute of palm or finger, according to the left and right attribute of palm or finger intelligently by virtual push button adjust to The corresponding region of mobile terminal screen, for example, when monitoring that active user touches the screen of mobile terminal using left-hand finger, then Corresponding virtual push button is adjusted to the left area of mobile terminal screen, it is convenient for the user to operate, avoid user frequently more hand-off Refer to operate mobile terminal.
It, can also be according to the palm Character adjustment hand after the palm feature for judging palm in the embodiment of the present invention The horizontal position of the palm.Specifically, the present invention can extract the coordinate for the 4th key point that index finger refers at root, according to the described 4th The benchmark line of key point and the third key point judges the tilt angle of palm in the palm image, is inclined according to described Rake angle rotates the palm image so that the benchmark line is adjusted to horizontal position.
Referring to FIG. 3, Fig. 3 is the schematic diagram for adjusting the horizontal position of palm.As shown in figure 3, the in Fig. 3 the described 4th closes Key point is A point, and the third key point is B point.It is crucial according to the 4th key point and the third in the embodiment of the present invention The line AB of point judges the tilt angle of palm, according to the position of the declining angle rectification palm, specifically closes the described 4th Key point and the line AB of the third key point rotate to horizontal position i.e. and realize the correction of palm image, the palm image Correction purpose be for the palm in the palm image to be adjusted convenient for the personal recognition of subsequent palm.
With continued reference to FIG. 3, the present invention, which is also based on palm image adjusted, further realizes palm segmentation to mention Take palm center region.Specifically, making the perpendicular bisector of the benchmark line using the midpoint E of the benchmark line as starting point;Institute It states to close on the perpendicular bisector of benchmark line at palm center region and takes a point C (X, Y), so that the length L of CE is equal to the benchmark The half of line, using point C as palm centre of the palm point.To postrotational palm image, with C (X, Y) for midpoint, with point p1 (X-L, Y-L), p2 (X+L, Y-L), p3 (X-L, Y+L) and p4 (X+L, Y+L) are that vertex determines palm center region;Extract the hand The palm print characteristics point of central area is slapped, to carry out personal recognition to the palm print characteristics point.The present invention is partitioned into the palm It is convenient for preferably carrying out personal recognition to be subsequent in heart district domain.
Referring to FIG. 4, in another embodiment, the present invention provides a kind of identification devices of palm feature, comprising:
Monitoring modular 11, when detecting the trigger event, is obtained for monitoring the trigger event of palm feature identification Palm image.
In the embodiment of the present invention, the trigger event of the hand identification includes but is not limited to that user clicks pressing for personal recognition The event of key and gesture operation etc. for carrying out personal recognition.
After detecting the trigger event, starting camera obtains images to be recognized, passes through algorithm of target detection SSD (Single Shot MultiBox Detector) algorithm detects the palm image in the images to be recognized.SSD be using Single detector of the VGG19 network as feature extractor.Customized convolutional layer is added after the network, and uses convolution kernel Execute prediction.
In a kind of possible design, the step of algorithm of target detection, is as follows:
First, one width picture (200x200) of input, is entered into the good sorter network of pre-training and obtains difference greatly Small Feature Mapping has modified traditional VGG16 network;
Wherein, convolutional layer is converted by the FC6 of VGG16 and FC7 layers;
Remove all Dropout layer and FC8 layers;
It is added to Atrous algorithm (hole algorithm);
Pool5 is transformed into 3x3-S1 from 2x2-S2;
Second, extracting Conv4_3, Conv7, Conv8_2, Conv9_2, Conv10_2, Conv11_2 layers of feature Map, then each point respectively on map layers of these feature constructs the BB of 6 different scale sizes, then distinguishes It is detected and is classified, generate multiple BB;
Third, the different feature map BB obtained is combined, press down by NMS (non-maxima suppression) method System falls a part overlapping or incorrect BB, generates final BB set, i.e. testing result.The inspection of target applied by the present invention Analysis On Multi-scale Features figure level-one convolution is used in method of determining and calculating to be detected.
First judgment module 12, for extracting middle fingertip in the palm image in the plane coordinate system constructed in advance First key point and middle finger at place refer to the coordinate of the second key point at root, crucial according to first key point and second The coordinate of point judges that the finger of palm in the palm image is directed toward.
Referring to FIG. 2, Fig. 2 is the schematic diagram according to the palm picture construction plane right-angle coordinate.The present invention is implemented In example, need to construct plane right-angle coordinate.Flat square seat a little is constructed for origin specifically, taking in the palm image Mark system, wherein the selection of origin can be selected according to actual needs, is not specifically limited herein.
In the embodiment of the present invention, after acquiring the palm image, described first is extracted according to critical point detection algorithm Key point, such as the M in the T and the second key point such as Fig. 2 in Fig. 2.The mode specifically detected are as follows: to Cascade CNN model It is trained, training data is the training picture for having marked finger tip and having referred to root position.After good to CNN model training, The hand image newly inputted is detected using the model.The present invention is by comparing first key point and second pass The coordinate value of key point judges that the finger of palm in the palm image is directed toward.
Specifically, with continued reference to FIG. 2, reading the first key point T's in rectangular coordinate system shown in Fig. 2 The coordinate (X2, Y2) of coordinate (X1, Y1) and the second key point M.If Y1 > the Y2, judge in the palm image The finger of palm is oriented to the positive direction for being directed toward Y-axis, then is_up mark is True;If Y1 < the Y2 judges the palm The finger of palm is oriented to the negative direction for being directed toward Y-axis in image, then is_up mark is False.
Second judgment module 13 refers to the coordinate of the third key point at root for extracting little finger of toe, crucial according to described first The coordinate of point, the coordinate of the third key point and the finger are directed toward the palm feature for judging the palm image.
In the embodiment of the present invention, the palm feature is the left and right attribute of palm.The present invention can be closed according to described first The coordinate of key point, the coordinate of the third key point and the finger are directed toward the left and right attribute for judging the palm.
With continued reference to FIG. 2, reading the coordinate (X3, Y3) of the third key point;Y-axis is being directed toward just when finger is oriented to Direction, and the abscissa X1 of first key point is less than the abscissa X3 of the third key point, alternatively, when finger is oriented to The negative direction of direction Y-axis and the abscissa X1 of first key point are greater than the abscissa X3 of the third key point, then judge The palm feature is left hand, is otherwise the right hand.
In a kind of possible design, the present invention can also identify the left and right attribute of finger, such as pass through each of right-hand man The left and right attribute of the profile information identification finger of a finger.
The present invention identifies that the left and right attribute of palm or finger can be applied to the adjustment of virtual key position.Specifically , the virtual key on terminal screen can be adjusted to the left and right of the palm according to the left and right attribute of the palm identified The corresponding screen side of attribute.For example, in a kind of possible application scenarios, by the recognition methods of palm of the invention or so attribute Applied to Games Software, the palmmprint of the palm of user or the fingerprint of finger can be monitored in real time, the palmmprint or finger according to palm Fingerprint judge the left and right attribute of palm or finger, according to the left and right attribute of palm or finger intelligently by virtual push button adjust to The corresponding region of mobile terminal screen, for example, when monitoring that active user touches the screen of mobile terminal using left-hand finger, then Corresponding virtual push button is adjusted to the left area of mobile terminal screen, it is convenient for the user to operate, avoid user frequently more hand-off Refer to operate mobile terminal.
It, can also be according to the palm Character adjustment hand after the palm feature for judging palm in the embodiment of the present invention The horizontal position of the palm.Specifically, the present invention can extract the coordinate for the 4th key point that index finger refers at root, according to the described 4th The benchmark line of key point and the third key point judges the tilt angle of palm in the palm image, is inclined according to described Rake angle rotates the palm image so that the benchmark line is adjusted to horizontal position.
Referring to FIG. 3, Fig. 3 is the schematic diagram for adjusting the horizontal position of palm.As shown in figure 3, the in Fig. 3 the described 4th closes Key point is A point, and the third key point is B point.It is crucial according to the 4th key point and the third in the embodiment of the present invention The line AB of point judges the tilt angle of palm, according to the position of the declining angle rectification palm, specifically closes the described 4th Key point and the line AB of the third key point rotate to horizontal position i.e. and realize the correction of palm image, the palm image Correction purpose be for the palm in the palm image to be adjusted convenient for the personal recognition of subsequent palm.
With continued reference to FIG. 3, the present invention, which is also based on palm image adjusted, further realizes palm segmentation to mention Take palm center region.Specifically, making the perpendicular bisector of the benchmark line using the midpoint E of the benchmark line as starting point;Institute It states to close on the perpendicular bisector of benchmark line at palm center region and takes a point C (X, Y), so that the length L of CE is equal to the benchmark The half of line, using point C as palm centre of the palm point.To postrotational palm image, with C (X, Y) for midpoint, with point p1 (X-L, Y-L), p2 (X+L, Y-L), p3 (X-L, Y+L) and p4 (X+L, Y+L) are that vertex determines palm center region;Extract the hand The palm print characteristics point of central area is slapped, to carry out personal recognition to the palm print characteristics point.The present invention is partitioned into the palm It is convenient for preferably carrying out personal recognition to be subsequent in heart district domain.
In another embodiment, the embodiment of the present invention provides a kind of computer readable storage medium, and the computer can It reads to be stored with computer program on storage medium, palm described in any one technical solution is realized when which is executed by processor The recognition methods of feature.Wherein, the computer readable storage medium include but is not limited to any kind of disk (including floppy disk, Hard disk, CD, CD-ROM and magneto-optic disk), ROM (Read-Only Memory, read-only memory), RAM (Random AcceSS Memory, immediately memory), EPROM (EraSable Programmable Read-Only Memory, erasable programmable Read-only memory), EEPROM (Electrically EraSable Programmable Read-Only Memory, electrically erasable Programmable read only memory), flash memory, magnetic card or light card.It is, storage equipment includes by equipment (for example, calculating Machine, mobile phone) with any medium for the form storage or transmission information that can be read, it can be read-only memory, disk or CD etc..
A kind of computer readable storage medium provided in an embodiment of the present invention is, it can be achieved that the triggering that monitoring palm feature identifies Event obtains palm image when detecting the trigger event;The palm is extracted in the plane coordinate system constructed in advance The first key point and middle finger in image at middle fingertip refer to the coordinate of the second key point at root, crucial according to described first Point and the coordinate of the second key point judge that the finger of palm in the palm image is directed toward;It extracts little finger of toe and refers to that the third at root is closed The coordinate of key point is directed toward according to the coordinate of first key point, the coordinate of the third key point and the finger and judges The palm feature of the palm image.Lead to the damage of fitness equipment in the physical training style of user's mistake and influence user's body to be good for The problem of health.The left and right attribute of palm may be implemented in the present invention, and the left and right attribute based on palm can more accurately identify palmmprint Information.In addition, the present invention can adjust the virtual key on terminal screen to institute according to the left and right attribute of the palm identified State the corresponding screen side of left and right attribute of palm.For example, when the present invention is applied to game relevant APP, it can timely basis The palm of the contact mobile terminal identified or the left and right attribute of finger, adjust the position of virtual key.When user uses left hand When operation, then corresponding virtual key is adjusted to the left area of the screen of mobile terminal;When user is operated using the right hand, Then corresponding virtual key is adjusted and improves the reaction speed and operation of user to the right area of the screen of mobile terminal Speed promotes user experience.
In addition, the present invention provides a kind of computer equipments, as shown in figure 5, the computer in another embodiment Equipment includes the devices such as processor 303, memory 305, input unit 307 and display unit 309.Those skilled in the art can To understand, the structure devices shown in Fig. 5 do not constitute the restriction to all computer equipments, may include more or more than illustrating Few component, or the certain components of combination.Memory 305 can be used for storing application program 301 and each functional module, processor 303 operations are stored in the application program 301 of memory 305, thereby executing the various function application and data processing of equipment.It deposits Reservoir 305 can be built-in storage or external memory, or including both built-in storage and external memory.Built-in storage can wrap Include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory or random access memory.External memory may include hard disk, floppy disk, ZIP disk, USB flash disk, tape Deng.Memory disclosed in this invention includes but is not limited to the memory of these types.Memory 305 disclosed in this invention As an example rather than as restriction.
Input unit 307 is used to receive the input of signal, and receives the keyword of user's input.Input unit 307 can Including touch panel and other input equipments.Touch panel collects the touch operation of user on it or nearby and (for example uses Family uses the operations of any suitable object or attachment on touch panel or near touch panel such as finger, stylus), and root According to the corresponding attachment device of preset driven by program;Other input equipments can include but is not limited to physical keyboard, function One of key (such as broadcasting control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.Display unit 309 can be used for showing the information of user's input or be supplied to the information of user and the various menus of computer equipment.Display is single The forms such as liquid crystal display, Organic Light Emitting Diode can be used in member 309.Processor 303 is the control centre of computer equipment, benefit With the various pieces of various interfaces and the entire computer of connection, by running or executing the software being stored in memory 303 Program and/or module, and the data being stored in memory are called, perform various functions and handle data.Shown in Fig. 5 One or more processors 303 are able to carry out, realize monitoring modular 11, first judgment module 12 and second shown in Fig. 4 The function of judgment module 13.
In one embodiment, the computer equipment includes memory 305 and processor 303, the memory 305 In be stored with computer-readable instruction, when the computer-readable instruction is executed by the processor, so that the processor 303 The step of executing a kind of recognition methods of palm feature described in above embodiments.
A kind of computer equipment provided in an embodiment of the present invention, it can be achieved that monitoring palm feature identification trigger event, when When detecting the trigger event, palm image is obtained;It is extracted in the plane coordinate system constructed in advance in the palm image The first key point and middle finger at middle fingertip refer to the coordinate of the second key point at root, according to first key point and The coordinate of second key point judges that the finger of palm in the palm image is directed toward;It extracts little finger of toe and refers to the third key point at root Coordinate judges the hand according to the coordinate of first key point, the coordinate of the third key point and the finger direction Slap the palm feature of image.Lead to the damage of fitness equipment in the physical training style of user's mistake and influences asking for user's body health Topic.The left and right attribute of palm may be implemented in the present invention, and the left and right attribute based on palm can more accurately identify palm print information.Separately Outside, the present invention can adjust the virtual key on terminal screen to the palm according to the left and right attribute of the palm identified The corresponding screen side of left and right attribute.It, can be in time according to identifying for example, when the present invention is applied to game relevant APP Contact mobile terminal palm or finger left and right attribute, adjust the position of virtual key.When user uses left-handed operation, Then corresponding virtual key is adjusted to the left area of the screen of mobile terminal;It, then will be right when user is operated using the right hand The virtual key answered, which is adjusted, improves the reaction speed and service speed of user to the right area of the screen of mobile terminal, Promote user experience.
The recognition methods of above-mentioned palm feature may be implemented in computer readable storage medium provided in an embodiment of the present invention Embodiment, concrete function realize the explanation referred in embodiment of the method, and details are not described herein.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, which can be stored in a computer-readable storage and be situated between In matter, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium above-mentioned can be The non-volatile memory mediums such as magnetic disk, CD, read-only memory (Read-Only Memory, ROM) or random storage note Recall body (Random Access Memory, RAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited In contradiction, all should be considered as described in this specification.
The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously Limitations on the scope of the patent of the present invention therefore cannot be interpreted as.It should be pointed out that for those of ordinary skill in the art For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to guarantor of the invention Protect range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.

Claims (10)

1. a kind of recognition methods of palm feature, which is characterized in that the described method includes:
The trigger event for monitoring the identification of palm feature obtains palm image when detecting the trigger event;
The first key point in the palm image at middle fingertip and middle finger are extracted in the plane coordinate system constructed in advance Refer to that the coordinate of the second key point at root, the coordinate according to first key point and the second key point judge the palm figure The finger of palm is directed toward as in;
Extract the coordinate that little finger of toe refers to the third key point at root, coordinate, the third key point according to first key point Coordinate and the finger be directed toward and judge the palm feature of the palm image.
2. the recognition methods of palm feature according to claim 1, which is characterized in that described according to first key point And second key point coordinate judge palm in the palm image finger be directed toward, specifically include:
Read the coordinate (X1, Y1) of first key point and the coordinate (X2, Y2) of second key point;
If Y1 > the Y2, judge that the finger of palm in the palm image is oriented to the positive direction for being directed toward Y-axis;
If Y1 < the Y2, judge that the finger of palm in the palm image is oriented to the negative direction for being directed toward Y-axis.
3. the recognition methods of palm feature according to claim 2, which is characterized in that it is described extract little finger of toe refer at root the The coordinate of three key points is directed toward according to the coordinate of first key point, the coordinate of the third key point and the finger Judge the palm feature of the palm image, comprising:
Read the coordinate (X3, Y3) of the third key point;
When finger be oriented to be directed toward Y-axis positive direction, and the abscissa X1 of first key point be less than the third key point Abscissa X3, alternatively, when the abscissa X1 that finger is oriented to the negative direction and first key point of being directed toward Y-axis be greater than it is described The abscissa X3 of third key point then judges that the palm feature is otherwise the right hand for left hand.
4. the recognition methods of palm feature according to claim 1, which is characterized in that further include:
The coordinate that index finger refers to the 4th key point at root is extracted, according to the benchmark of the 4th key point and the third key point Line judges the tilt angle of palm in the palm image, rotates the palm image according to the tilt angle with by institute It states benchmark line and is adjusted to horizontal position.
5. the recognition methods of palm feature according to claim 4, which is characterized in that further include:
Make the perpendicular bisector of the benchmark line using the midpoint E of the benchmark line as starting point;
Palm center region is closed on the perpendicular bisector of the benchmark line and takes a point C (X, Y), so that the length L of CE is equal to institute The half for stating benchmark line, using point C as palm centre of the palm point.
6. the recognition methods of palm feature according to claim 5, which is characterized in that further include:
To postrotational palm image, with C (X, Y) for midpoint, with point p1 (X-L, Y-L), p2 (X+L, Y-L), p3 (X-L, Y+L) And p4 (X+L, Y+L) is that vertex determines palm center region;
The palm print characteristics point in the palm center region is extracted, to carry out personal recognition to the palm print characteristics point.
7. the recognition methods of palm feature according to claim 1, which is characterized in that when the triggering thing of the hand identification It is described to be closed according to the coordinate of first key point, the third when part is the sliding pressing operation acted on terminal screen The coordinate of key point and the finger are directed toward after the palm feature for judging the palm image, further includes:
According to the left and right attribute of the palm identified, the virtual key on terminal screen is adjusted to the left and right attribute of the palm Corresponding screen side.
8. a kind of left and right property recognition means of palm, which is characterized in that the described method includes:
Monitoring modular, when detecting the trigger event, obtains palm figure for monitoring the trigger event of palm feature identification Picture;
First judgment module, for extracting in the palm image at middle fingertip in the plane coordinate system constructed in advance One key point and middle finger refer to the coordinate of the second key point at root, the seat according to first key point and the second key point Mark judges that the finger of palm in the palm image is directed toward;
Second judgment module refers to the coordinate of the third key point at root for extracting little finger of toe, the seat according to first key point Mark, the coordinate of the third key point and the finger are directed toward the palm feature for judging the palm image.
9. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program, the computer program realize the recognition methods of palm feature described in any one of claims 1 to 7 when being executed by processor The step of.
10. a kind of computer equipment, which is characterized in that including memory and processor, be stored with computer in the memory Readable instruction, when the computer-readable instruction is executed by the processor so that the processor execute as claim 1 to Described in any one of 7 claims the step of the recognition methods of palm feature.
CN201811583897.XA 2018-12-24 2018-12-24 Palm feature recognition method and device, computer equipment and storage medium Active CN109829368B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811583897.XA CN109829368B (en) 2018-12-24 2018-12-24 Palm feature recognition method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811583897.XA CN109829368B (en) 2018-12-24 2018-12-24 Palm feature recognition method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109829368A true CN109829368A (en) 2019-05-31
CN109829368B CN109829368B (en) 2024-02-20

Family

ID=66861044

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811583897.XA Active CN109829368B (en) 2018-12-24 2018-12-24 Palm feature recognition method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109829368B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851048A (en) * 2019-09-30 2020-02-28 华为技术有限公司 Method for adjusting control and electronic equipment
CN110993107A (en) * 2019-12-25 2020-04-10 新绎健康科技有限公司 Human body five-finger image processing method and device
CN112132099A (en) * 2020-09-30 2020-12-25 腾讯科技(深圳)有限公司 Identity recognition method, palm print key point detection model training method and device
CN112749512A (en) * 2021-01-18 2021-05-04 杭州易现先进科技有限公司 Method and system for optimizing gesture estimation and electronic device
CN113221891A (en) * 2021-05-12 2021-08-06 佛山育脉科技有限公司 Method and device for adjusting recognition angle of palm vein image
CN113392787A (en) * 2021-06-22 2021-09-14 中国工商银行股份有限公司 Palm image preprocessing method, device, equipment, medium and program product
CN113963158A (en) * 2021-11-25 2022-01-21 佳都科技集团股份有限公司 Palm vein image region-of-interest extraction method and device
CN114155296A (en) * 2021-11-19 2022-03-08 宁波芯然科技有限公司 Method for determining central area of palm image
CN117472189A (en) * 2023-12-27 2024-01-30 大连三通科技发展有限公司 Typing or touch control realization method with physical sense
CN117475539A (en) * 2023-12-28 2024-01-30 深圳市盛思达通讯技术有限公司 Entrance guard management method and system based on palm print recognition

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007052534A (en) * 2005-08-16 2007-03-01 Kddi Corp Palm print authentication device, palm print authentication program, palm print authentication method, palm print image extraction method, and portable telephone terminal with palm print authentication device
JP2008217307A (en) * 2007-03-02 2008-09-18 Kddi Corp Palm print authentication device, portable telephone terminal, program and palm print authentication method
JP2010026658A (en) * 2008-07-16 2010-02-04 Kddi Corp Palm position detection device, palm print authentication device, cellphone terminal, program and palm position detection method
JP2010113530A (en) * 2008-11-06 2010-05-20 Nippon Hoso Kyokai <Nhk> Image recognition device and program
CN102073843A (en) * 2010-11-05 2011-05-25 沈阳工业大学 Non-contact rapid hand multimodal information fusion identification method
CN102163282A (en) * 2011-05-05 2011-08-24 汉王科技股份有限公司 Method and device for acquiring interested area in palm print image
US20120281890A1 (en) * 2011-05-06 2012-11-08 Fujitsu Limited Biometric authentication device, biometric information processing device, biometric authentication system, biometric authentication server, biometric authentication client, and biometric authentication device controlling method
CN103955674A (en) * 2014-04-30 2014-07-30 广东瑞德智能科技股份有限公司 Palm print image acquisition device and palm print image positioning and segmenting method
CN104123537A (en) * 2014-07-04 2014-10-29 西安理工大学 Rapid authentication method based on handshape and palmprint recognition
CN104580143A (en) * 2014-11-09 2015-04-29 李若斌 Security authentication method based on gesture recognition, terminal, server and system
US20170064551A1 (en) * 2000-06-09 2017-03-02 Air America Secure Mobile Device

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170064551A1 (en) * 2000-06-09 2017-03-02 Air America Secure Mobile Device
JP2007052534A (en) * 2005-08-16 2007-03-01 Kddi Corp Palm print authentication device, palm print authentication program, palm print authentication method, palm print image extraction method, and portable telephone terminal with palm print authentication device
JP2008217307A (en) * 2007-03-02 2008-09-18 Kddi Corp Palm print authentication device, portable telephone terminal, program and palm print authentication method
JP2010026658A (en) * 2008-07-16 2010-02-04 Kddi Corp Palm position detection device, palm print authentication device, cellphone terminal, program and palm position detection method
JP2010113530A (en) * 2008-11-06 2010-05-20 Nippon Hoso Kyokai <Nhk> Image recognition device and program
CN102073843A (en) * 2010-11-05 2011-05-25 沈阳工业大学 Non-contact rapid hand multimodal information fusion identification method
CN102163282A (en) * 2011-05-05 2011-08-24 汉王科技股份有限公司 Method and device for acquiring interested area in palm print image
US20120281890A1 (en) * 2011-05-06 2012-11-08 Fujitsu Limited Biometric authentication device, biometric information processing device, biometric authentication system, biometric authentication server, biometric authentication client, and biometric authentication device controlling method
CN103955674A (en) * 2014-04-30 2014-07-30 广东瑞德智能科技股份有限公司 Palm print image acquisition device and palm print image positioning and segmenting method
CN104123537A (en) * 2014-07-04 2014-10-29 西安理工大学 Rapid authentication method based on handshape and palmprint recognition
CN104580143A (en) * 2014-11-09 2015-04-29 李若斌 Security authentication method based on gesture recognition, terminal, server and system

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851048A (en) * 2019-09-30 2020-02-28 华为技术有限公司 Method for adjusting control and electronic equipment
CN110993107B (en) * 2019-12-25 2023-06-09 新绎健康科技有限公司 Human body five-finger image processing method and device
CN110993107A (en) * 2019-12-25 2020-04-10 新绎健康科技有限公司 Human body five-finger image processing method and device
CN112132099A (en) * 2020-09-30 2020-12-25 腾讯科技(深圳)有限公司 Identity recognition method, palm print key point detection model training method and device
CN112749512B (en) * 2021-01-18 2024-01-26 杭州易现先进科技有限公司 Gesture estimation optimization method, system and electronic device
CN112749512A (en) * 2021-01-18 2021-05-04 杭州易现先进科技有限公司 Method and system for optimizing gesture estimation and electronic device
CN113221891A (en) * 2021-05-12 2021-08-06 佛山育脉科技有限公司 Method and device for adjusting recognition angle of palm vein image
CN113392787A (en) * 2021-06-22 2021-09-14 中国工商银行股份有限公司 Palm image preprocessing method, device, equipment, medium and program product
CN114155296A (en) * 2021-11-19 2022-03-08 宁波芯然科技有限公司 Method for determining central area of palm image
CN113963158A (en) * 2021-11-25 2022-01-21 佳都科技集团股份有限公司 Palm vein image region-of-interest extraction method and device
CN117472189A (en) * 2023-12-27 2024-01-30 大连三通科技发展有限公司 Typing or touch control realization method with physical sense
CN117472189B (en) * 2023-12-27 2024-04-09 大连三通科技发展有限公司 Typing or touch control realization method with physical sense
CN117475539A (en) * 2023-12-28 2024-01-30 深圳市盛思达通讯技术有限公司 Entrance guard management method and system based on palm print recognition
CN117475539B (en) * 2023-12-28 2024-04-12 深圳市盛思达通讯技术有限公司 Entrance guard management method and system based on palm print recognition

Also Published As

Publication number Publication date
CN109829368B (en) 2024-02-20

Similar Documents

Publication Publication Date Title
CN109829368A (en) Recognition methods, device, computer equipment and the storage medium of palm feature
CN104216642B (en) A kind of terminal control method
CN106537305B (en) Method for classifying touch events and touch sensitive device
CN105825524B (en) Method for tracking target and device
CN103065134B (en) A kind of fingerprint identification device and method with information
US9582737B2 (en) Context-sensitive gesture classification
CN107679446B (en) Human face posture detection method, device and storage medium
CN107609489B (en) Handwriting writing path evaluation device and method and electronic equipment
CN109891491A (en) Interactive display
US20130293467A1 (en) User input processing with eye tracking
CN103294257B (en) The apparatus and method for being used to guide handwriting input for handwriting recognition
CN105980973A (en) User-authentication gestures
WO2014127697A1 (en) Method and terminal for triggering application programs and application program functions
CN105068646B (en) The control method and system of terminal
CN114138121B (en) User gesture recognition method, device and system, storage medium and computing equipment
CN108664364A (en) A kind of terminal test method and device
CN109345553A (en) A kind of palm and its critical point detection method, apparatus and terminal device
CN104081328A (en) Smart touch screen key activation detection
CN105159475B (en) A kind of characters input method and device
CN110008824A (en) Palm grain identification method, device, computer equipment and storage medium
JP2013186698A (en) Handwriting management program and recording display device
CN112163400B (en) Information processing method and device
Sonoda et al. A letter input system based on handwriting gestures
CN104714736A (en) Control method and terminal for quitting full screen lock-out state
Półrola et al. Real-time hand pose estimation using classifiers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant