CN110675154A - Service providing method, device, equipment and medium based on face recognition - Google Patents
Service providing method, device, equipment and medium based on face recognition Download PDFInfo
- Publication number
- CN110675154A CN110675154A CN201910795256.9A CN201910795256A CN110675154A CN 110675154 A CN110675154 A CN 110675154A CN 201910795256 A CN201910795256 A CN 201910795256A CN 110675154 A CN110675154 A CN 110675154A
- Authority
- CN
- China
- Prior art keywords
- service
- image
- application program
- payment
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Computer Security & Cryptography (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Collating Specific Patterns (AREA)
Abstract
The invention discloses a service providing method, a device, equipment and a medium based on face recognition, wherein the method comprises the steps of collecting face images to obtain images for face recognition; obtaining characteristic information corresponding to the image; obtaining the identity information pointed by the image according to the feature information and a local face feature database; feeding back the identity information to the second application program so that the second application program can generate a service request and transmit the service request to a business server; the service server generates a payment request, transmits the payment request to the payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides the service pointed by the service request to a second application program pointed by the service request according to the processing result. The present invention provides a lightweight access scheme to service providers.
Description
Technical Field
The invention relates to the field of identity recognition and payment, in particular to a service providing method, device, equipment and medium based on face recognition.
Background
Biometric identification technology is technology for identifying an individual by using physiological characteristics or behavioral characteristics inherent to a human body through a computer. In the biometric technology, face recognition is widely used in identity recognition because of its convenience and rapidity. In most scenes, identity recognition based on face recognition has strong requirements on network environment, so that application scenes are limited.
Furthermore, in the prior art, the scheme of performing identity recognition based on face recognition is mostly a complete machine scheme, and can be implemented only by depending on complete machine equipment in cooperation with a front-end software service and a back-end software service, so that a corresponding business facilitator with weak development capability needs to pay high price and low price to support face recognition in a wireless or weak network environment, and has a strong appeal for light-weight access, and does not want to pay high price, but wants to realize local face recognition on the premise of low cost, and further provides services based on face recognition results.
Disclosure of Invention
In order to solve the technical problem that the requirement on the networking environment of identity recognition is too high and the requirement on lightweight access of a business service provider cannot be met in the prior art, embodiments of the present invention provide a service providing method, an apparatus, a device and a medium based on face recognition.
In one aspect, the present invention provides a service providing method based on face recognition, including:
the second application program generates an identity information acquisition request and transmits the identity information acquisition request to the first application program;
the first application program responds to the identity information acquisition request, acquires a face image to obtain an image for face recognition, processes the image to obtain characteristic information corresponding to the image, obtains identity information pointed by the image according to the characteristic information and a local face characteristic database, and feeds the identity information back to a second application program;
the second application program generates a service request according to the identity information and transmits the service request to a service server;
responding to the service request, the business server generates a payment request according to the service request, and transmits the payment request to a payment server;
the payment server carries out payment processing according to the payment request to obtain a processing result, and the processing result is fed back to the service server;
and the service server provides the service directed by the service request to a second application program directed by the service request according to the processing result.
In another aspect, the present invention provides a service providing method based on face recognition, including:
responding to an identity information acquisition request from a second application program, and acquiring a face image to obtain an image for face recognition;
processing the image for face recognition to obtain characteristic information corresponding to the image;
obtaining the identity information pointed by the image according to the feature information and a local face feature database;
feeding back the identity information to the second application program so that the second application program can generate a service request according to the identity information and transmit the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides the service pointed by the service request to a second application program pointed by the service request according to the processing result.
In another aspect, the present invention provides a service providing apparatus based on face recognition, the apparatus including:
the image acquisition module is used for responding to an identity information acquisition request from a second application program and acquiring a face image to obtain an image for face recognition;
the characteristic information acquisition module is used for processing the image for face recognition to obtain characteristic information corresponding to the image;
the identity information acquisition module is used for acquiring identity information pointed by the image according to the feature information and a local human face feature database;
the identity information feedback module is used for feeding back the identity information to the second application program so that the second application program can generate a service request according to the identity information and transmit the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides a service image pointed by the service request to a second application program pointed by the service request according to the processing result.
In another aspect, the present invention provides a service providing system based on face recognition, the system comprising:
the second application program module is used for generating an identity information acquisition request and transmitting the identity information acquisition request to the first application program;
the first application program module is used for responding to the identity information acquisition request, acquiring a face image to obtain an image for face recognition, processing the image to obtain characteristic information corresponding to the image, obtaining identity information pointed by the image according to the characteristic information and a local face characteristic database, and feeding the identity information back to the second application program module;
the second application program module is further configured to generate a service request according to the identity information, and transmit the service request to a service server;
the business server is used for generating a payment request according to the service request and transmitting the payment request to the payment server;
the payment server is used for performing payment processing according to the payment request to obtain a processing result and feeding the processing result back to the service server;
and the business server is also used for providing the service pointed by the service request to the second application program pointed by the service request according to the processing result.
In another aspect, the present invention provides a service providing device based on face recognition, which is characterized in that the device includes a processor and a memory, where at least one instruction, at least one program, a code set, or a set of instructions is stored in the memory, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement a service providing method based on face recognition.
In another aspect, the present invention provides a computer storage medium, wherein at least one instruction, at least one program, a set of codes, or a set of instructions is stored in the storage medium, and the at least one instruction, at least one program, set of codes, or set of instructions is loaded by a processor and executes a service providing method based on face recognition.
The invention provides a service providing method, a device, equipment and a medium based on face recognition. The invention realizes the identity information acquisition and payment functions based on the first application software and the payment server respectively, and the second application software and the service server which are used as service providers can directly use the payment function only by simply interacting with the first application software and the payment server respectively, thereby realizing a lightweight access scheme for the service providers, and having the capability of locally acquiring the identity information of users and further providing services for the users on the premise of not changing the existing service logic and replacing the existing equipment.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions and advantages of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic diagram of one possible implementation environment of a service providing method based on face recognition according to the present invention;
FIG. 2 is a flow chart of a service providing method based on face recognition according to the present invention;
FIG. 3 is a flow chart of the payment server completing the payment process according to the payment request to obtain the process result;
FIG. 4 is a schematic diagram of an execution logic of a service providing method based on face recognition according to the present invention;
FIG. 5 is a flow chart of a service providing method based on face recognition according to the present invention;
FIG. 6 is a flow chart of the present invention for acquiring a face image to obtain an image for face recognition;
FIG. 7 is a flow chart of in vivo examination of a target image according to the present invention;
FIG. 8 is a flowchart illustrating processing of the image for face recognition to obtain feature information according to the present invention;
fig. 9 is a block diagram of a service providing apparatus based on face recognition according to the present invention;
fig. 10 is a block diagram of a service providing system based on face recognition according to the present invention;
fig. 11 is a hardware structural diagram of an apparatus for implementing the method provided by the embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In order to make the objects, technical solutions and advantages disclosed in the embodiments of the present invention more clearly apparent, the embodiments of the present invention are described in further detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of the invention and are not intended to limit the embodiments of the invention.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present embodiment, "a plurality" means two or more unless otherwise specified.
In order to clearly explain the technical solutions described in the embodiments of the present invention, the embodiments of the present invention first explain related terms, technical background, and technical environment:
the embodiment of the invention provides a service providing method based on face recognition. First, the basic embodiment of the present invention provides one of feasible implementation environments of a service providing method based on face recognition.
Referring to fig. 1, the implementation environment includes: client 01, payment server 03 and business server 05. The payment server 03 is in communication connection with the service server 05.
The Client 01 is in communication connection with both the payment Server 03 and the service Server 05, and the Client 01 can communicate with the face recognition Server 03 and the service Server 05 respectively based on a Browser/Server mode (Browser/Server, B/S) or a Client/Server mode (Client/Server, C/S). The client 01 may include: the physical devices may also include software running in the physical devices, such as applications, and the like.
Specifically, at least two software, a first software and a second software, are run in the client 01, the first software is in communication connection with the payment server 03, and the second software is in communication connection with the service server 05.
The second software generates an identity information acquisition request and transmits the identity information acquisition request to the first software to obtain identity information fed back by the first software, generates a service request according to the identity information, and transmits the service request to the service server 05.
The first software responds to an identity information acquisition request of the second software, acquires an image for face recognition, processes the image to obtain feature information, obtains identity information pointed by the image according to the feature information and a local face feature database, and feeds the identity information back to the second software.
Further, the first software completes synchronous updating of the local facial feature database through interaction with the cloud database.
The service server 05 interacts with the payment server 03 according to the service request, so that the payment server 03 can pay according to the service request, and the payment result is fed back to the service server 05, so that the service server 05 can provide the service directed by the service request to the second software in response to the payment result.
In order to implement the method for providing a service based on face recognition, the client 01 at least includes a camera 101, a processor 102 and a memory 103. The camera 101 is used to capture images, such as depth images and color images; the memory 103 is used for storing data, such as images acquired by the camera 101, instruction programs required by the processor 102 when executing, and the like; the processor 102 is connected to the memory 103 and the camera 101 for controlling the camera 101 and executing a program of instructions stored within the memory 103. It is understood that the instruction storage 105 module inside the memory 103 already contains the first software and the second software for executing the service providing method based on face recognition, and the image collected by the camera 101 is stored in the image storage 104 module.
The payment server 03 and the service server 05 may each include a server operating independently, or a distributed server, or a server cluster composed of a plurality of servers.
Referring to fig. 2, a flow chart of a service providing method based on face recognition is shown, where the method may be implemented by using the implementation environment shown in fig. 1 as an execution subject, and the method may include:
s101, the second application program generates an identity information acquisition request and transmits the identity information acquisition request to the first application program.
Specifically, in the embodiment of the present invention, the first application program and the second application program may be executed in the same or different clients, and the first application program and the second application program may be independent executable programs, or may be a set of complete execution logic bodies in a certain independent executable program, and may be run in the clients in the form of a static link library, a dynamic link library, an installation package, and the like.
In the embodiment of the present invention, the first application corresponds to a first software in the implementation environment, which can provide an identity information obtaining service for one or more second applications; the second application corresponds to a second software in the implementation environment, and different second applications may provide different business services to the user.
And S103, the first application program responds to the identity information acquisition request, acquires a face image to obtain an image for face recognition, processes the image to obtain feature information corresponding to the image, obtains identity information pointed by the image according to the feature information and a local face feature database, and feeds the identity information back to a second application program.
And S105, the second application program generates a service request according to the identity information and transmits the service request to a service server.
In particular, the service request may include a user identification, a service identification, identity information and payment resources. The user identifier and the service identifier are used for instructing a business server to provide a service pointed by the service identifier to a second application program pointed by the user identifier, the payment resource and the identity information are used for instructing a payment server to complete payment, the payment resource is a cost required to be provided for enjoying the service, and the payment resource can be funds or virtual articles, such as red packets and virtual coins.
Specifically, the service server has a corresponding relationship with the second application program, and the service server is configured to provide the second application program with a service required by the second application program.
And S107, responding to the service request, generating a payment request by the service server according to the service request, and transmitting the payment request to a payment server.
In one possible embodiment, the payment server is configured to provide the service server with a payment service required for completing the service, for example, the payment server may provide a deduction service.
In a preferred embodiment, in order to reduce the probability of the service providing process being attacked and ensure the security of the service providing process as a whole, before the service server transmits the payment request to the payment server, the method further includes:
s1, acquiring related information of the second application program.
Specifically, the related information may be software information such as address information, domain name information, root user information, and the like of the second application program, device information of a device of the client where the second application program is located, current location information, networking information, and the like of the device of the client where the second application program is located. The related information in the embodiment of the present invention generally refers to information that can be used for determining the validity of the second application program, and is not limited to a specific implementation form thereof.
And S3, judging the legality of the second application program based on the related information of the second application program.
S5, if the code is legal, executing the step S107; otherwise, generating a service providing failure notice, feeding back the service providing failure notice to the second application program, and stopping the subsequent steps.
Specifically, the steps of obtaining the related information and performing validity judgment based on the related information can reduce the probability of successful response to an illegal service request. For example, if the related information is located in the blacklist of the service server, it is determined that the second application is an illegal application, and service is denied to the illegal application.
And S109, the payment server performs payment processing according to the payment request to obtain a processing result, and feeds the processing result back to the service server.
In one possible embodiment, the payment server performs payment processing according to the payment request to obtain a processing result, as shown in fig. 3, including:
s1091, the payment server determines a first account corresponding to the identity information according to the identity information in the payment request.
S1093, the payment server determines a second account and payment resources according to the payment request.
In different implementation scenarios, the second account may be determined according to one or a combination of the service server related information and the service identifier, where the second account is an account of the service provider.
In a preferred embodiment, the payment request further includes wind control data, where the wind control data may be obtained by the first application program, the second application program, and/or the service server, and correspondingly, before the determining, by the payment server, the second account and the payment resource according to the payment request, the method further includes:
and S10, judging whether the payment request is legal or not according to the wind control data and a preset legal judgment algorithm.
The wind control data in the embodiment of the invention includes, but is not limited to, time, place, payment resource type, payment resource value, identity information, service server related information and the like.
S30, if the code is legal, executing a step S1093; otherwise, generating a withholding failure notice.
Specifically, the steps of acquiring the wind control data and judging the validity based on the wind control data can reduce the probability of successful response to an illegal service request, and improve the transaction safety. For example, if the service server is a server providing dinner service for the user and the current time displayed by the wind control data is six am, it is obvious that the payment request is abnormal, and the response is rejected.
S1095, the payment server transfers the payment resource from the first account to the second account.
S1097, if the transfer is successful, generating a withholding success notification.
S1099, if the transfer fails, generating a withholding failure notice.
S1011, the service server provides the service pointed by the service request to the second application program pointed by the service request according to the processing result.
Specifically, if the processing result includes a withholding failure notification, the service server refuses to provide service to the second application program; and if the processing result comprises a withholding success notification, the service server provides service for the second application program.
In other embodiments of the present invention, the payment server and the first application program may also be communicatively connected, where the first application program is configured to obtain identity information of a user, and the payment server is configured to provide a payment service based on the identity information, so that in the embodiments of the present invention, support for a payment capability required by the service server is implemented by respectively setting necessary logic required for payment in the payment server and the first application program.
In a preferred embodiment, the payment server may further obtain feature information acquired by a first application program through communication with the first application program, and update a cloud database according to the feature information and identity information corresponding to the feature information, where the cloud database may generate a sub-database for each first application program, and the sub-database records corresponding relationships between the feature information and the identity information related to the corresponding first application program.
In a preferred embodiment, in order to reduce the probability of leakage of the local face feature database corresponding to the first application, the local face feature database is strongly correlated with the version corresponding to the first application, and if and only if the local face feature database is matched with the version corresponding to the first application, the local face feature database can feed back correct identity information corresponding to the feature information to the first application.
The embodiment of the invention discloses a service providing method based on face recognition, as shown in figure 4, the embodiment of the invention respectively realizes identity information acquisition and payment functions based on first application software and a corresponding payment server, and a second application software and a service server which are used as a service provider can directly use the payment function only by respectively corresponding to the first application software and the payment server, so that a lightweight access scheme is realized for the service provider, and the provider of the first application program and the payment server can complete access of the service provider only by providing related software packages for the service provider. Therefore, the method has the capability of locally acquiring the identity information of the user and providing service for the user on the premise of not changing the existing service logic and not changing the existing equipment.
In order to locally acquire the identity information of the user, the first application software and the payment server realize the synchronization of the local facial feature database through interaction, and the process is not aware of the second application software and the business server of the service provider, so that the burden of the service provider is further lightened, and the access cost of the service provider is reduced.
The embodiment of the invention can be widely applied to the scenes such as public transport, subway and the like with strong requirements on network or real-time performance. One feasible application scenario is given in the embodiment of the invention:
the application place is as follows: school canteens.
The service provided by the second application: and (6) buying rice.
The first application program: the method comprises the steps of locally acquiring an image of a rice buyer, identifying identity information of the rice buyer, acquiring identity information of a related user (a parent or other guardians) of the rice buyer in view of the fact that the rice buyer does not have payment capacity, and feeding back the identity information of the related user to a second application program as information pointed by the image.
The payment server: the meal fee of the associated user account is deducted.
A service server: and providing the meal buying service to the second application program.
Referring to fig. 5, a flowchart of a service providing method based on face recognition is shown, where the method may be implemented by using a first application program in the implementation environment of fig. 1 as an execution subject, and the method may include:
s201, in response to an identity information acquisition request from a second application program, acquiring a face image to obtain an image for face recognition.
In a feasible embodiment, a 3D camera can be called to collect a face image, and the 3D camera can obtain a color image containing face features and a depth image corresponding to the color image. In another feasible embodiment, the common shot image can be called to obtain a color image containing human face features, and a depth image corresponding to the color image is generated according to a preset algorithm.
In a preferred embodiment, acquiring a face image to obtain an image for face recognition, as shown in fig. 6, includes:
and S2011, collecting a plurality of images, obtaining at least one face image according to the plurality of images, and grading the face image.
Specifically, each image includes a color map and a depth map corresponding thereto.
In practical application, after a plurality of images of the same person are acquired, whether the face exists in the images can be detected firstly. And if no face exists, filtering the image to obtain at least one face image. Specifically, each face image may be scored, and the score is used for reflecting the quality of the face image.
In one possible embodiment, the score is calculated according to one or more of face size, face pose angle, blur degree of picture, brightness, contrast, background environment, and face condition.
And S2013, determining the face image with the score larger than a preset threshold value as a target image, and performing living body inspection on the target image.
In order to prevent an illegal user from using a face model to obtain a service, the embodiment of the invention performs a living body test at one end of a first application program. In one possible embodiment, the performing the in-vivo examination on the target image, as shown in fig. 7, includes:
s20131, determining the face image with the score larger than a preset threshold value as a target image, and obtaining face contour coordinates in a color map in the target image.
S20133, generating a face detection area in the depth map corresponding to the color map according to the face contour coordinates.
S20135, calculating standard deviations of all pixel points in the face detection area in the depth map.
S20137, if the standard deviation exceeds a preset threshold value, the biopsy is passed.
S2015, determining an image for face recognition from the target image through the live body examination.
Specifically, if there is only one target image passing through the in-vivo examination, it is determined as an image for face recognition; and if the number of the target images passing the living body examination is more than one, determining the target image with the highest score as the image for face recognition.
And S203, processing the image for face recognition to obtain characteristic information corresponding to the image.
In a possible embodiment, the processing the image for face recognition to obtain feature information, as shown in fig. 8, includes:
s2031, extracting the key point positions of the human face in the color image in the image for human face recognition by using a key point positioning method based on deep learning.
Specifically, the key points of the human face are five positions, namely a left eye, a right eye, a nose tip and a left mouth corner and a right mouth corner.
S2033, color space transformation is carried out on the color image to obtain a gray scale space image.
S2035, affine transformation is carried out on the gray level space image according to the positions of the face key points, so that the face key points are located at specific positions, and a target face image with a specific size is obtained.
S2037, extracting the features of the target face image through a pre-trained feature information extraction network to obtain a feature extraction result.
The feature extraction result may be used as feature information corresponding to the image. However, in order to further improve the security of the technical solution according to the embodiment of the present invention, in a preferred embodiment, the processing the image for face recognition to obtain feature information further includes:
s2039, adding random salt into the feature extraction result, and taking the feature extraction result after adding the random salt as the feature information corresponding to the image.
The characteristic information has certain safety due to the addition of the random salt information, the true identity information pointed by the characteristic information cannot be obtained even if the characteristic information is stolen, a random salt addition algorithm can refer to the prior art, and the embodiment of the invention is not described in detail.
And S205, obtaining the identity information pointed by the image according to the feature information and a local human face feature database.
Specifically, the first application program has a read-write permission for the local face feature database, the local face feature database is in communication connection with the first application program, supports access of the first application program, and can be dynamically changed in response to an instruction of the first application program.
In a preferred embodiment, in order to reduce the probability of the local facial feature database being attacked and improve the security of the local facial feature database, the capacity of the local facial feature database may be limited to prevent the local facial feature database from generating boundary leakage.
In a preferred embodiment, the local face feature database stores a correspondence between identity information and feature information, and may further store a picture corresponding to the feature information.
The local facial feature database may be updated, as shown in fig. 9, the embodiment of the present invention further includes:
and S100, acquiring the current version number of the local face feature database.
S300, acquiring the latest version number of the cloud database.
In particular, the cloud database may be maintained by a first application software related server that updates the cloud database by communicating with the first application software.
S500, if the latest version number is different from the current version number, updating the local human face feature database according to the cloud database.
In one possible embodiment, the local face database may be built based on SQLite, which is a lightweight database, a relational database management system that complies with ACID (Consistency) Isolation dual, which is contained in a relatively small C-base, with the significant advantage of low resource usage.
S207, feeding back the identity information to the second application program so that the second application program can generate a service request according to the identity information and transmit the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides the service pointed by the service request to a second application program pointed by the service request according to the processing result.
The embodiment of the invention describes an implementation scheme of the service providing method based on the face recognition by taking a first application program as a main body, and relevant logic related to feature extraction and identity information acquisition in the first application program can be written by using C language to improve the safety of the first application program. In a preferred embodiment, the first application program may be updated based on an obfuscation algorithm, so as to further improve the security of the first application program.
The present invention provides a service providing apparatus based on face recognition, as shown in fig. 9, the apparatus includes:
an image acquisition module 301, configured to, in response to an identity information acquisition request from a second application program, acquire a face image to obtain an image for face recognition;
a feature information obtaining module 303, configured to process the image for face recognition to obtain feature information corresponding to the image;
an identity information obtaining module 305, configured to obtain, according to the feature information and a local face feature database, identity information pointed by the image;
an identity information feedback module 307, configured to feed back the identity information to the second application program, so that the second application program generates a service request according to the identity information, and transmits the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides a service image pointed by the service request to a second application program pointed by the service request according to the processing result.
In another aspect, the present invention provides a service providing system based on face recognition, as shown in fig. 10, the system includes:
the second application program module 01 is used for generating an identity information acquisition request and transmitting the identity information acquisition request to the first application program;
the first application program module 02 is used for responding to the identity information acquisition request, acquiring a face image to obtain an image for face recognition, processing the image to obtain feature information corresponding to the image, obtaining identity information pointed by the image according to the feature information and a local face feature database, and feeding the identity information back to the second application program module;
the second application program module 01 is further configured to generate a service request according to the identity information, and transmit the service request to a service server;
the service server 03 is used for generating a payment request according to the service request and transmitting the payment request to the payment server;
the payment server 04 is used for performing payment processing according to the payment request to obtain a processing result, and feeding the processing result back to the service server;
the service server 03 is further configured to provide the service pointed by the service request to the second application program pointed by the service request according to the processing result.
Specifically, the embodiments of the service providing system and method based on face recognition are all based on the same inventive concept. For details, please refer to the method embodiment, which is not described herein.
The embodiment of the invention also provides a computer storage medium, and the computer storage medium can store a plurality of instructions. The instructions can be suitable for being loaded by a processor and executing the service providing method based on the face recognition, and the method at least comprises the following steps:
a service providing method based on face recognition, the method comprising:
the second application program generates an identity information acquisition request and transmits the identity information acquisition request to the first application program;
the first application program responds to the identity information acquisition request, acquires a face image to obtain an image for face recognition, processes the image to obtain characteristic information corresponding to the image, obtains identity information pointed by the image according to the characteristic information and a local face characteristic database, and feeds the identity information back to a second application program;
the second application program generates a service request according to the identity information and transmits the service request to a service server;
responding to the service request, the business server generates a payment request according to the service request, and transmits the payment request to a payment server;
the payment server carries out payment processing according to the payment request to obtain a processing result, and the processing result is fed back to the service server;
and the service server provides the service directed by the service request to a second application program directed by the service request according to the processing result.
Further, fig. 11 shows a hardware structure diagram of an apparatus for implementing the method provided by the embodiment of the present invention, and the apparatus may participate in forming or containing the device or system provided by the embodiment of the present invention. As shown in fig. 11, the device 10 may include one or more (shown as 102a, 102b, … …, 102 n) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 104 for storing data, and a transmission device 106 for communication functions. Besides, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of the I/O interface), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 11 is only an illustration and is not intended to limit the structure of the electronic device. For example, device 10 may also include more or fewer components than shown in FIG. 11, or have a different configuration than shown in FIG. 11.
It should be noted that the one or more processors 102 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuitry may be a single, stand-alone processing module, or incorporated in whole or in part into any of the other elements in the device 10 (or mobile device). As referred to in the embodiments of the application, the data processing circuit acts as a processor control (e.g. selection of a variable resistance termination path connected to the interface).
The memory 104 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the method described in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, so as to implement the above-mentioned service providing method based on face recognition. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 104 may further include memory located remotely from processor 102, which may be connected to device 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of such networks may include wireless networks provided by the communication provider of the device 10. In one example, the transmission device 106 includes a network adapter (NIC) that can be connected to other network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the device 10 (or mobile device).
It should be noted that: the precedence order of the above embodiments of the present invention is only for description, and does not represent the merits of the embodiments. And specific embodiments thereof have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device and server embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. A service providing method based on face recognition is characterized in that the method comprises the following steps:
the second application program generates an identity information acquisition request and transmits the identity information acquisition request to the first application program;
the first application program responds to the identity information acquisition request, acquires a face image to obtain an image for face recognition, processes the image to obtain characteristic information corresponding to the image, obtains identity information pointed by the image according to the characteristic information and a local face characteristic database, and feeds the identity information back to a second application program;
the second application program generates a service request according to the identity information and transmits the service request to a service server;
responding to the service request, the business server generates a payment request according to the service request, and transmits the payment request to a payment server;
the payment server carries out payment processing according to the payment request to obtain a processing result, and the processing result is fed back to the service server;
and the service server provides the service directed by the service request to a second application program directed by the service request according to the processing result.
2. A service providing method based on face recognition is characterized in that the method comprises the following steps:
responding to an identity information acquisition request from a second application program, and acquiring a face image to obtain an image for face recognition;
processing the image for face recognition to obtain characteristic information corresponding to the image;
obtaining the identity information pointed by the image according to the feature information and a local face feature database;
feeding back the identity information to the second application program so that the second application program can generate a service request according to the identity information and transmit the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides the service pointed by the service request to a second application program pointed by the service request according to the processing result.
3. The method of claim 2, wherein the method is implemented by a first application, the method further comprising:
the first application program has read-write permission to the local face feature database, the local face feature database supports access of the first application program, and the first application program dynamically changes in response to instructions of the first application program.
4. The method of claim 3, further comprising the step of updating a local database of facial features, the updating the local database of facial features comprising:
acquiring the current version number of the local face feature database;
acquiring the latest version number of a cloud database, wherein the cloud database stores data required by the first application program for inquiring identity information;
and if the latest version number is different from the current version number, updating the local human face feature database according to the cloud database.
5. The method of claim 2, wherein the method of acquiring a face image to obtain an image for face recognition comprises:
collecting a plurality of images, obtaining at least one face image according to the plurality of images, and grading the face image;
determining the face image with the score larger than a preset threshold value as a target image, and performing living body inspection on the target image;
an image for face recognition is determined from a target image through a living body examination.
6. The method of claim 2, wherein the processing the image for face recognition to obtain feature information comprises:
extracting the positions of key points of the human face in a color image in the image for human face recognition by using a key point positioning method based on deep learning;
carrying out color space transformation on the color image to obtain a gray scale space image;
carrying out affine transformation on the gray-scale space image according to the positions of the face key points to enable the face key points to be located at specific positions so as to obtain a target face image with a specific size;
and extracting the features of the target face image through a pre-trained feature information extraction network to obtain a feature extraction result.
7. A service providing apparatus based on face recognition, the apparatus comprising:
the image acquisition module is used for responding to an identity information acquisition request from a second application program and acquiring a face image to obtain an image for face recognition;
the characteristic information acquisition module is used for processing the image for face recognition to obtain characteristic information corresponding to the image;
the identity information acquisition module is used for acquiring identity information pointed by the image according to the feature information and a local human face feature database;
the identity information feedback module is used for feeding back the identity information to the second application program so that the second application program can generate a service request according to the identity information and transmit the service request to a service server; and the service server generates a payment request according to the service request, transmits the payment request to a payment server so that the payment server can carry out payment processing according to the payment request to obtain a processing result, feeds the processing result back to the service server, and provides the service pointed by the service request to a second application program pointed by the service request according to the processing result.
8. A service providing system based on face recognition, the system comprising:
the second application program module is used for generating an identity information acquisition request and transmitting the identity information acquisition request to the first application program;
the first application program module is used for responding to the identity information acquisition request, acquiring a face image to obtain an image for face recognition, processing the image to obtain characteristic information corresponding to the image, obtaining identity information pointed by the image according to the characteristic information and a local face characteristic database, and feeding the identity information back to the second application program module;
the second application program module is further configured to generate a service request according to the identity information, and transmit the service request to a service server;
the business server is used for generating a payment request according to the service request and transmitting the payment request to the payment server;
the payment server is used for performing payment processing according to the payment request to obtain a processing result and feeding the processing result back to the service server;
and the business server is also used for providing the service pointed by the service request to the second application program pointed by the service request according to the processing result.
9. A service providing device based on face recognition, characterized in that the device comprises a processor and a memory, wherein at least one instruction, at least one program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or instruction set is loaded and executed by the processor to implement a service providing method based on face recognition according to any one of claims 1-2, or to implement a service providing method based on face recognition according to any one of claims 3-5.
10. A computer storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement a method for providing a service based on face recognition according to any one of claims 1-2, or to implement a method for providing a service based on face recognition according to any one of claims 3-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910795256.9A CN110675154B (en) | 2019-08-27 | 2019-08-27 | Service providing method, device, equipment and medium based on face recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910795256.9A CN110675154B (en) | 2019-08-27 | 2019-08-27 | Service providing method, device, equipment and medium based on face recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110675154A true CN110675154A (en) | 2020-01-10 |
| CN110675154B CN110675154B (en) | 2023-10-13 |
Family
ID=69075601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910795256.9A Active CN110675154B (en) | 2019-08-27 | 2019-08-27 | Service providing method, device, equipment and medium based on face recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110675154B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111275448A (en) * | 2020-02-22 | 2020-06-12 | 腾讯科技（深圳）有限公司 | Face data processing method and device and computer equipment |
| CN111310142A (en) * | 2020-02-14 | 2020-06-19 | 江苏赛诺格兰医疗科技有限公司 | Service password authorization method based on face recognition, intranet network and system |
| CN113409056A (en) * | 2021-06-30 | 2021-09-17 | 深圳市商汤科技有限公司 | Payment method and device, local identification equipment, face payment system and equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1465022A (en) * | 2000-09-09 | 2003-12-31 | 佳技通信有限公司 | Internet commerce system and the method |
| US20160188974A1 (en) * | 2010-10-26 | 2016-06-30 | Bi2 Technologies, LLC | Mobile wireless hand-held identification system and method for identification |
| WO2017181769A1 (en) * | 2016-04-21 | 2017-10-26 | 腾讯科技（深圳）有限公司 | Facial recognition method, apparatus and system, device, and storage medium |
| CN107769928A (en) * | 2017-10-11 | 2018-03-06 | 深圳市金立通信设备有限公司 | A kind of terminal and computer-readable recording medium |
| US20180136929A1 (en) * | 2016-11-15 | 2018-05-17 | International Business Machines Corporation | Content driven automated upgrade of running web applications in on-premise environments |
| WO2018094584A1 (en) * | 2016-11-23 | 2018-05-31 | 刘洪文 | Payment and identity authentication system based on biometric feature recognition |
| CN108846306A (en) * | 2018-03-28 | 2018-11-20 | 中科博宏（北京）科技有限公司 | A kind of identity card Compare System and method based on deep learning recognition of face |
| CN109409895A (en) * | 2018-09-29 | 2019-03-01 | 深圳先牛信息技术有限公司 | A kind of payment mechanism and method of payment merging iris recognition and recognition of face |
| CN110099029A (en) * | 2018-01-30 | 2019-08-06 | 阿里健康信息技术有限公司 | A kind of auth method, terminal device and server |
-
2019
- 2019-08-27 CN CN201910795256.9A patent/CN110675154B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1465022A (en) * | 2000-09-09 | 2003-12-31 | 佳技通信有限公司 | Internet commerce system and the method |
| US20160188974A1 (en) * | 2010-10-26 | 2016-06-30 | Bi2 Technologies, LLC | Mobile wireless hand-held identification system and method for identification |
| WO2017181769A1 (en) * | 2016-04-21 | 2017-10-26 | 腾讯科技（深圳）有限公司 | Facial recognition method, apparatus and system, device, and storage medium |
| US20180136929A1 (en) * | 2016-11-15 | 2018-05-17 | International Business Machines Corporation | Content driven automated upgrade of running web applications in on-premise environments |
| WO2018094584A1 (en) * | 2016-11-23 | 2018-05-31 | 刘洪文 | Payment and identity authentication system based on biometric feature recognition |
| CN107769928A (en) * | 2017-10-11 | 2018-03-06 | 深圳市金立通信设备有限公司 | A kind of terminal and computer-readable recording medium |
| CN110099029A (en) * | 2018-01-30 | 2019-08-06 | 阿里健康信息技术有限公司 | A kind of auth method, terminal device and server |
| CN108846306A (en) * | 2018-03-28 | 2018-11-20 | 中科博宏（北京）科技有限公司 | A kind of identity card Compare System and method based on deep learning recognition of face |
| CN109409895A (en) * | 2018-09-29 | 2019-03-01 | 深圳先牛信息技术有限公司 | A kind of payment mechanism and method of payment merging iris recognition and recognition of face |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111310142A (en) * | 2020-02-14 | 2020-06-19 | 江苏赛诺格兰医疗科技有限公司 | Service password authorization method based on face recognition, intranet network and system |
| CN111275448A (en) * | 2020-02-22 | 2020-06-12 | 腾讯科技（深圳）有限公司 | Face data processing method and device and computer equipment |
| CN113409056A (en) * | 2021-06-30 | 2021-09-17 | 深圳市商汤科技有限公司 | Payment method and device, local identification equipment, face payment system and equipment |
| WO2023273043A1 (en) * | 2021-06-30 | 2023-01-05 | 深圳市商汤科技有限公司 | Payment method and apparatus, local recognition device, facial payment system, and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110675154B (en) | 2023-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110427917B (en) | Method and device for detecting key points | |
| CN107680684B (en) | Method and device for acquiring information | |
| EP3367664B1 (en) | Photographing method using external electronic device and electronic device supporting the same | |
| CN110866977B (en) | Augmented reality processing method, device, system, storage medium and electronic equipment | |
| CN108053046B (en) | Registration method and device, storage medium and electronic equipment | |
| CN108491823B (en) | Method and device for generating human eye recognition model | |
| CN110675154B (en) | Service providing method, device, equipment and medium based on face recognition | |
| EP3118803A1 (en) | Card registration method for payment service and mobile electronic device implementing the same | |
| EP3220339A1 (en) | Payment transaction method and electronic device therefor | |
| EP3439284A1 (en) | Electronic device and method for processing image | |
| CN110059624B (en) | Method and apparatus for detecting living body | |
| CN108399401B (en) | Method and device for detecting face image | |
| CN114363292A (en) | Network address generation method, communication method, system, device and storage medium | |
| CN108173811A (en) | The card register method of electronic device and the electronic device | |
| CN108491890B (en) | Image method and device | |
| CN106168850B (en) | Electronic device for displaying screen and control method thereof | |
| CN110674695B (en) | Service providing method, device, equipment and medium based on identity information identification | |
| CN113127829A (en) | Business processing method and system, wearable device and computer readable storage medium | |
| CN109145786B (en) | Picture identification method, device, equipment, medium and product | |
| CN108921138B (en) | Method and apparatus for generating information | |
| CN110610363A (en) | Method, apparatus and medium for providing service by autonomously controlling identity information | |
| CN112258647B (en) | Map reconstruction method and device, computer readable medium and electronic equipment | |
| CN108427947A (en) | A kind of image-recognizing method and electronic equipment | |
| CN109840132A (en) | Method of combination, device and the storage medium of container | |
| CN108537149A (en) | Image processing method, device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40019528 Country of ref document: HK |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |