CN110189204B

CN110189204B - Ordering method and device based on menu scanning

Info

Publication number: CN110189204B
Application number: CN201910472420.2A
Authority: CN
Inventors: 孙泽义
Original assignee: Zhejiang Koubei Network Technology Co Ltd
Current assignee: Zhejiang Koubei Network Technology Co Ltd
Priority date: 2019-05-31
Filing date: 2019-05-31
Publication date: 2022-02-11
Anticipated expiration: 2039-05-31
Also published as: CN110189204A

Abstract

The invention discloses a menu scanning-based ordering method and device. The method comprises the following steps: receiving user position information and menu pictures uploaded after a client scans a menu; determining service provider information according to the user position information; carrying out image recognition on the menu picture, generating menu information, and returning the menu information to the client; receiving ordering information sent by the client, and sending the ordering information to a service provider corresponding to the service provider information, wherein the ordering information is generated by the client according to the selection operation of the user on at least one dish in the menu information. The technical scheme of the invention enables the user to order food online without maintaining any information at the service provider; the method and the device have the advantages that the link between the server and the service providing terminal is opened, the problem that the link between the service providing terminal and the server is disconnected due to the fact that the service providing terminal does not maintain information is solved, a user cannot order food, and meanwhile the complicated process that the service providing terminal maintains the information is omitted.

Description

Ordering method and device based on menu scanning

Technical Field

The invention relates to the technical field of communication, in particular to a menu scanning-based ordering method and device.

Background

With the rapid development of internet technology, various application programs are generated, for an application program in a food ordering scene, an application program on a service provider side (referred to as a B-side application program for short) and an application program on a user side (referred to as a C-side application program for short) are developed, and a food ordering behavior involves the following links: the method comprises the steps of C-terminal application program-server-B-terminal application program, specifically, a service provider sets corresponding information on the B-terminal application program, and then a user orders at the C-terminal application program, so that the service provider is required to maintain the information, however, the information maintenance process is complicated, in addition, the service provider with a paper menu or a service provider accustomed to the paper menu is more reluctant to maintain the information at the B-terminal application program, so that a plurality of service providers do not use the B-terminal application program, links between the server and the service provider are disconnected, and ordering cannot be performed even if the C-terminal application program is installed on a terminal device of the user.

Disclosure of Invention

In view of the above problems, the present invention has been made to provide a menu scanning based ordering method and apparatus that overcomes or at least partially solves the above problems.

According to one aspect of the invention, a menu scanning-based ordering method is provided, which is implemented based on a server and comprises the following steps:

receiving user position information and menu pictures uploaded after a client scans a menu;

determining service provider information according to the user position information;

carrying out image recognition on the menu picture, generating menu information, and returning the menu information to the client;

receiving ordering information sent by a client, and sending the ordering information to a service provider corresponding to the service provider information, wherein the ordering information is generated by the client according to the selection operation of a user on at least one dish in the menu information.

Optionally, determining the service provider information according to the user location information further includes:

and searching the position information of the service providing end matched with the position information of the user, and determining the position information of the service providing end according to the position information of the service providing end.

Optionally, before sending the ordering information to the service provider corresponding to the service provider information, the method further includes: sending query information to at least one appointed service platform in a broadcasting mode to determine whether an access service platform of a service provider exists in the at least one appointed service platform;

sending the ordering information to the service provider corresponding to the service provider information further comprises:

if so, pushing the ordering information to an access service platform of the service provider so that the access service platform of the service provider sends the ordering information to the service provider corresponding to the information of the service provider;

if not, the ordering information is sent to the service provider corresponding to the service provider information through a preset service mode.

Optionally, before sending the ordering information to the service provider corresponding to the service provider information, the method further includes: judging whether the ordering information contains table code information or not;

if so, sending the ordering information to a service provider corresponding to the service provider information;

and if not, generating a meal taking identifier, and sending the ordering information and the meal taking identifier to a service provider corresponding to the service provider information.

Optionally, the method further comprises: receiving a bill receiving notification message returned by the service provider or the service provider through the accessed service platform, generating a first preset prompt message according to the bill receiving notification message, and returning the first preset prompt message to the client.

Optionally, the menu information includes: menu category, name of dish, price of dish, picture of dish.

According to another aspect of the present invention, there is provided a menu scanning-based ordering apparatus applied to a server, the apparatus including:

the first receiving module is suitable for receiving user position information and menu pictures uploaded after a client scans a menu;

the determining module is suitable for determining the information of the service provider according to the user position information;

the identification module is suitable for carrying out image identification on the menu picture, generating menu information and returning the menu information to the client;

the second receiving module is suitable for receiving the ordering information sent by the client, wherein the ordering information is generated by the client according to the selection operation of the user on at least one dish in the menu information;

and the sending module is suitable for sending the ordering information to the service provider corresponding to the service provider information.

Optionally, the determining module is further adapted to: and searching the position information of the service providing end matched with the position information of the user, and determining the position information of the service providing end according to the position information of the service providing end.

Optionally, the apparatus further comprises: the broadcasting module is suitable for sending query information to at least one specified service platform in a broadcasting mode so as to determine whether an access service platform of a service provider exists in the at least one specified service platform;

the sending module is further adapted to: if the access service platform of the service provider exists in the at least one appointed service platform, pushing the ordering information to the access service platform of the service provider so that the access service platform of the service provider sends the ordering information to the service provider corresponding to the information of the service provider;

and if the at least one appointed service platform does not have the access service platform of the service provider, sending the ordering information to the service provider corresponding to the service provider information in a preset service mode.

Optionally, the apparatus further comprises: the judging module is suitable for judging whether the ordering information contains the table code information;

the sending module is further adapted to: if the ordering information contains the table code information, the ordering information is sent to a service provider corresponding to the service provider information;

and if the ordering information does not contain the table code information, generating a meal taking identifier, and sending the ordering information and the meal taking identifier to a service provider corresponding to the service provider information.

Optionally, the apparatus further comprises: the third receiving module is suitable for receiving the order receiving notification message returned by the service provider or the service platform accessed by the service provider;

the generating module is suitable for generating first preset prompt information according to the order receiving notification message;

and the return module is suitable for returning the first preset prompt message to the client.

According to another aspect of the present invention, there is provided a computing device comprising: the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the menu scanning-based ordering method.

According to another aspect of the present invention, there is provided a computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to perform operations corresponding to the menu scan-based ordering method as described above.

According to another aspect of the present invention, there is provided a menu scanning-based ordering method, implemented on a client, the method including:

scanning the menu to obtain a menu picture;

uploading the menu picture and the user position information to a server, so that the server determines service providing end information according to the user position information, performs image recognition on the menu picture, generates menu information, and returns the menu information to the client;

receiving and displaying menu information returned by the server;

and monitoring the selection operation of the user on at least one dish in the menu information, generating ordering information according to the dish information of the at least one dish carried in the selection operation, and sending the ordering information to the server, wherein the ordering information is sent to a service provider corresponding to the service provider information by the server.

Optionally, before generating the meal ordering information according to the dish information of the at least one dish carried in the selecting operation, the method further includes: monitoring the input operation of inputting the table code information by a user;

generating the ordering information according to the dish information of the at least one dish carried in the selecting operation further comprises:

and generating ordering information according to the dish information and the table code information of at least one dish.

Optionally, after sending the ordering information to the server, the method further includes: and generating and displaying second preset prompt information.

Optionally, the method further comprises: and receiving and displaying first preset prompt information returned by the server.

Optionally, after generating the ordering information, the method further includes: the printing equipment of the service provider is connected with the printing equipment of the service provider in a Bluetooth mode, and the ordering information is sent to the printing equipment of the service provider to be printed.

According to another aspect of the present invention, there is provided a menu scanning-based ordering apparatus applied to a client, the apparatus including:

the scanning module is suitable for scanning the menu to obtain a menu picture;

the uploading module is suitable for uploading the menu picture and the user position information to the server so that the server can determine the information of the service providing terminal according to the user position information, perform image recognition on the menu picture, generate menu information and return the menu information to the client;

the display module is suitable for receiving and displaying the menu information returned by the server;

the generating module is suitable for monitoring the selection operation of the user on at least one dish in the menu information and generating the ordering information according to the dish information of the at least one dish carried in the selection operation;

and the sending module is suitable for sending the ordering information to the server, wherein the ordering information is sent to the service providing end corresponding to the service providing end information by the server.

Optionally, the apparatus further comprises: the monitoring module is suitable for monitoring the input operation of inputting the table code information by the user;

the generation module is further adapted to: and generating ordering information according to the dish information and the table code information of at least one dish.

Optionally, the apparatus further comprises: and the display module is suitable for generating and displaying second preset prompt information.

Optionally, the display module is further adapted to: and receiving and displaying first preset prompt information returned by the server.

Optionally, the apparatus further comprises: and the Bluetooth connection module is suitable for being connected with the printing equipment of the service provider in a Bluetooth mode, and sends the ordering information to the printing equipment of the service provider for printing.

According to the scheme provided by the invention, the server carries out image recognition on the menu picture uploaded after the client scans the menu, generates the menu information and returns the menu information to the client, so that the user can also order on line under the condition that the service providing end does not maintain any information; the link between the service providing end and the server is disconnected due to the fact that the service providing end does not maintain information, the server needs to determine the service providing end consumed by the user according to the user position information uploaded by the client, the ordering information is sent, the link between the server and the service providing end is opened, the ordering process is completed, the problem that the user cannot order due to the fact that the link between the server and the service providing end is disconnected due to the fact that the service providing end does not use a B-end application program is avoided, meanwhile, the complex process of maintaining information of the service providing end is omitted, meanwhile, consumption of offline resources of the service providing end can be reduced, and the number of paper menus of the service providing end is reduced.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 is a flow chart diagram illustrating a menu scanning based ordering method according to an embodiment of the invention;

FIG. 2 is a flow chart diagram illustrating a menu scanning based ordering method according to an embodiment of the invention;

FIG. 3 shows a signaling diagram of a menu scanning based ordering method according to one embodiment of the invention;

FIG. 4 is a schematic diagram of an ordering apparatus based on menu scanning according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of an ordering apparatus based on menu scanning according to an embodiment of the present invention;

FIG. 6 shows a schematic structural diagram of a computing device according to one embodiment of the invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Fig. 1 is a flowchart illustrating a menu scanning-based ordering method according to an embodiment of the present invention. The method is implemented based on a server, and as shown in fig. 1, the method comprises the following steps:

and step S100, receiving user position information and menu pictures uploaded after a client scans a menu.

Step S101, determining service provider information according to the user position information.

And S102, carrying out image recognition on the menu picture, generating menu information, and returning the menu information to the client.

And step S103, receiving ordering information sent by the client, and sending the ordering information to a service provider corresponding to the service provider information, wherein the ordering information is generated by the client according to the selection operation of the user on at least one dish in the menu information.

In an optional implementation manner of the present invention, determining the service provider information according to the user location information further includes: and searching the position information of the service providing end matched with the position information of the user, and determining the position information of the service providing end according to the position information of the service providing end.

In an optional implementation manner of the present invention, before sending the ordering information to the service provider corresponding to the service provider information, the method further includes: sending query information to at least one appointed service platform in a broadcasting mode to determine whether an access service platform of a service provider exists in the at least one appointed service platform;

sending the ordering information to the service provider corresponding to the service provider information further comprises: if so, pushing the ordering information to an access service platform of the service provider so that the access service platform of the service provider sends the ordering information to the service provider corresponding to the information of the service provider; if not, the ordering information is sent to the service provider corresponding to the service provider information through a preset service mode.

In an optional implementation manner of the present invention, before sending the ordering information to the service provider corresponding to the service provider information, the method further includes: judging whether the ordering information contains table code information or not;

sending the ordering information to the service provider corresponding to the service provider information further comprises: if so, sending the ordering information to a service provider corresponding to the service provider information; and if not, generating a meal taking identifier, and sending the ordering information and the meal taking identifier to a service provider corresponding to the service provider information.

In an alternative embodiment of the invention, the method further comprises: receiving a bill receiving notification message returned by the service provider or the service provider through the accessed service platform, generating a first preset prompt message according to the bill receiving notification message, and returning the first preset prompt message to the client.

In an alternative embodiment of the present invention, the menu information includes: menu category, name of dish, price of dish, picture of dish.

According to the method provided by the embodiment of the invention, the server carries out image recognition on the menu picture uploaded after the client scans the menu, generates the menu information and returns the menu information to the client, so that the user can also order on line under the condition that the service providing end does not maintain any information; the link between the service providing end and the server is disconnected due to the fact that the service providing end does not maintain information, the server needs to determine the service providing end consumed by the user according to the user position information uploaded by the client, the ordering information is sent, the link between the server and the service providing end is opened, the ordering process is completed, the problem that the user cannot order due to the fact that the link between the server and the service providing end is disconnected due to the fact that the service providing end does not use a B-end application program is avoided, meanwhile, the complex process of maintaining information of the service providing end is omitted, meanwhile, consumption of offline resources of the service providing end can be reduced, and the number of paper menus of the service providing end is reduced.

Fig. 2 is a flowchart illustrating a menu scanning-based ordering method according to an embodiment of the present invention. The method is implemented based on a client, and as shown in fig. 2, the method comprises the following steps:

and step S200, scanning the menu to obtain a menu picture.

Step S201, uploading the menu picture and the user position information to a server, so that the server determines the service provider information according to the user position information, performs image recognition on the menu picture, generates menu information, and returns the menu information to the client.

And step S202, receiving and displaying the menu information returned by the server.

And step S203, monitoring the selection operation of the user on at least one dish in the menu information, and generating ordering information according to the dish information of the at least one dish carried in the selection operation.

And step S204, sending the ordering information to a server, wherein the ordering information is sent to a service provider corresponding to the service provider information by the server.

In an optional embodiment of the present invention, before generating the ordering information according to the dish information of the at least one dish carried in the selecting operation, the method further comprises: monitoring the input operation of inputting the table code information by a user;

generating the ordering information according to the dish information of the at least one dish carried in the selecting operation further comprises: and generating ordering information according to the dish information and the table code information of at least one dish.

In an optional implementation manner of the present invention, after sending the ordering information to the server, the method further includes: and generating and displaying second preset prompt information.

In an alternative embodiment of the invention, the method further comprises: and receiving and displaying first preset prompt information returned by the server.

In an optional implementation manner of the present invention, after the generating the ordering information, the method further includes: the printing equipment of the service provider is connected with the printing equipment of the service provider in a Bluetooth mode, and the ordering information is sent to the printing equipment of the service provider to be printed.

According to the method provided by the embodiment of the invention, the client obtains the menu picture by scanning the menu, the menu picture is uploaded to the server, and the server performs image recognition on the menu picture to generate the menu information, so that the user can also order on line under the condition that the service providing terminal does not maintain any information; because the service providing end does not maintain information, a link between the service providing end and the server is disconnected, the client needs to upload user position information to the server, so that the server determines the service providing end consumed by the user according to the user position, sends ordering information, gets through the link between the server and the service providing end, and completes an ordering process; therefore, the complicated process of maintaining information by the service providing terminal is omitted, and the consumption of offline resources of the service providing terminal can be reduced, for example, the number of paper menus of the service providing terminal is reduced.

The inventor of the present invention finds that, in an existing ordering scenario, a merchant (service provider) and a user are usually involved, a merchant-side application (referred to as a B-side application) and a user-side application (referred to as a C-side application) are developed, and usually, the merchant configures information about the merchant in advance by using the B-side application, and then, the user scans a table code to enter an ordering page provided by the merchant by using the C-side application, or the user directly enters the ordering page provided by the merchant by using the C-side application to order, after the user orders, since the merchant has set merchant store information in advance, a server can send ordering information of the user to the merchant according to the store information provided by the merchant to complete ordering, that is, in the existing code scanning ordering scenario, the user and the merchant can order through the C-side application, The server is communicated with the application program at the B end.

Therefore, a merchant needs to maintain information of the merchant in real time by using the B-side application program, for example, store information of the merchant, dish information of various dishes, and the like, wherein the dish information includes a dish category, a dish name, a dish price, a dish picture, and the like, when the information of the merchant changes, for example, new dishes are added or part of the fewer dishes sold are deleted, the dish information needs to be updated, the information maintenance process is complicated, and even for some merchants who already have paper menus or are used to use the paper menus, the merchant is unwilling to maintain the information.

Therefore, the merchant does not install the B-side application program, that is, the merchant does not use the B-side application program to maintain the merchant information, and under the condition that the merchant does not configure information, even if the C-side application program is installed on the terminal device of the user, the user cannot see the merchant information on the C-side application program, the user cannot use the C-side application program to order, mainly, a link between the merchant and the server is disconnected, and the ordering information cannot reach the merchant. In order to enable a user to use a C-side application program to order on line even when a merchant does not install and use a B-side application program, the inventor of the present invention proposes a menu scanning-based ordering scheme by paying creative labor, and a specific implementation process of the scheme in an ordering scenario is described in detail below with reference to specific embodiments:

fig. 3 shows a signaling diagram of a menu scanning-based ordering method according to an embodiment of the present invention. As shown in fig. 3, the method comprises the steps of:

and step S300, the client scans the menu to obtain a menu picture, and uploads the menu picture and the user position information to the server.

The client in this embodiment is an application installed on the terminal device of the user and having a function of scanning a menu and capable of ordering food, and when the user enters a store of a merchant, the application can be opened and the menu provided by the merchant can be scanned by using the function of scanning the menu, the menu can be a paper menu, or a menu presented by an electronic screen by the merchant, and a menu picture corresponding to the menu can be obtained by scanning the menu, so that conversion from offline ordering to online ordering is started, the user can order food online, the user can conveniently know the ordered food, and the merchant does not need to inquire about which food is ordered.

The client in this embodiment further has a function of acquiring user location information, and specifically, the terminal device of the user provides a positioning function (for example, GPS positioning service), and can position the current location of the user in real time to obtain user location information, the client acquires user location information that the terminal device is positioned by the positioning function, and after obtaining a menu picture by scanning, the client uploads the menu picture and the user location information to the server. In this step, the client uploads the user location information to the server, so that the server determines merchant store information according to the user location information to complete the ordering process.

Step S301, the server receives the user position information and the menu picture uploaded by the client, searches for merchant store position information matched with the user position information, determines merchant store information according to the merchant store position information, performs image recognition on the menu picture, generates menu information, and returns the menu information to the client.

In this embodiment, the merchant does not use the B-side application to maintain any information, and therefore, the server cannot obtain information of merchant stores from the merchant, and in order to ensure that the ordering information can reach the merchant, the server needs to collect store information of each merchant store in advance, including: the method for collecting the information of the stores of the merchants is not listed here, and other methods enabling the server to collect the information of the stores of the merchants are within the protection scope of the present embodiment.

The server collects the merchant store information in advance, so that after receiving the user position information uploaded by the client, the server can determine the merchant store information of the merchant store by using the user position information, specifically, the merchant store position information is an embodiment of a merchant address, the user position information reflects the current position of the user, when the merchant store information is searched according to the user position information, the merchant store position information matched with the user position information can be searched firstly, the matching may be the same position information, or the merchant store position information may fall in a range with the user position information as the center and a preset threshold as the radius, and then the merchant store information is determined according to the searched merchant store position information. The corresponding merchant addresses of all the merchant stores are different, so that after the information of the merchant stores is determined according to the position information of the merchant stores, one merchant store can be uniquely determined. The merchant store information is determined in this embodiment, so as to get through a link between the server and the merchant, so that the order information can reach the merchant, and it is ensured that the user can complete ordering by using the C-side application program when the merchant does not use the B-side application program. If the merchant store information is not determined, after the server receives the ordering information sent by the client, the server cannot know which merchant the ordering information should be pushed to, and cannot complete ordering.

After receiving the uploaded menu picture, the server performs image recognition on the received menu picture, for example, corresponding text information may be recognized from the menu picture by using an OCR recognition technology, and certainly, a picture related to dishes in the menu picture may also be recognized. For the identification method of the menu picture, detailed description is not given here, and those skilled in the art can identify the menu picture based on the image identification technology in the existing method.

After the image recognition is completed, structured menu information can be generated, wherein the menu information comprises: the category of the dish, the name of the dish, the price of the dish, the description of the dish, the picture of the dish and the like. For example, the identified menu information is as follows: the dish information can be classified according to dish categories (such as fried dishes, stewed soup, snacks and drinks) after being recognized, corresponding menu information is obtained, and then the generated menu information is returned to the client side so that the client side can display the received menu information to a user.

Step S302, the client receives and displays the menu information returned by the server, monitors the selection operation of the user on at least one dish in the menu information, generates ordering information according to the dish information of the at least one dish carried in the selection operation, sends the ordering information to the server, and generates and displays second preset prompt information.

The client receives the menu information returned by the server and displays the menu information to the user, for example, a menu page containing the menu information can be displayed to the user, the user can order dishes by browsing the menu information in the menu page, the user selects at least one favorite dish from the menu information, the client needs to monitor the selection operation of the user on the at least one dish in the menu information in real time, after the selection operation is monitored, the ordering information is generated according to the dish information of the at least one dish carried in the selection operation, and the ordering information is sent to the server.

In an actual ordering scene, after a user selects dishes, the selected dishes can be added to a shopping cart, after the user selects all the dishes with key points, ordering information can be submitted by triggering an order-placing button, and after a client monitors that the user triggers the order-placing button, the ordering information is generated according to the dish information carried in the triggering operation. In this embodiment, the client scans the menu, so as to enter the initial step of ordering, and the client orders the food according to the menu information, and in this process, no food ordering page set by any merchant is entered, and the user orders the food at the client.

After sending the ordering information to the server, the client generates and displays a second preset prompting message, for example, prompting the user to wait for the order of the merchant.

Step S303, the server receives the ordering information sent by the client, and sends inquiry information to at least one appointed service platform in a broadcasting mode so as to determine whether an access service platform of a merchant store exists in the at least one appointed service platform; if so, pushing the ordering information to an access service platform of the merchant store, so that the access service platform of the merchant store sends the ordering information to the merchant store corresponding to the merchant store information; if not, sending the ordering information to a merchant store corresponding to the merchant store information in a preset service mode; the server receives an order receiving notification message returned by the merchant store or the merchant store through the accessed service platform, generates first preset prompt information according to the order receiving notification message, and returns the first preset prompt information to the client.

The server receives the ordering information sent by the client, before the ordering information is pushed to the merchant stores, whether the merchant stores have a service platform is determined to determine in what way the ordering information is pushed to the merchant stores is determined, specifically, query information can be sent to at least one specified service platform (for example, a silver box, a two-dimensional fire, a delicious food, and the like) in a broadcasting way, wherein the query information can include merchant store information such as a name of the merchant stores, after the query information broadcast by the server is received by the at least one specified service platform, whether the merchant has the service platform is determined according to the query information, and in a general case, if the merchant has the service platform, the merchant store information is stored in the service platform, so that whether the merchant stores have the service platform is determined according to whether the merchant store information is stored in the service platform, under the condition that the service platform does not inquire the information of the merchant stores, determining that the merchant stores are not accessed to the service platform; in the case that the service platform inquires about the information of the merchant store, the merchant store can be determined to be accessed to the service platform.

The server determines whether an access service platform of a merchant store exists in the at least one appointed service platform or not according to the query result returned by the at least one appointed service platform, if so, the ordering information is pushed to the access service platform of the merchant store, and the access service platform of the merchant store sends the ordering information to the merchant store corresponding to the merchant store information; if not, the ordering information is sent to the merchant stores corresponding to the merchant store information in a preset service mode, for example, the ordering information can be sent to the merchant stores corresponding to the merchant store information in other third-party application programs or short message modes.

In this embodiment, the server collects merchant store information in advance, for example, a mobile phone number and/or an account number of another third party application, for example, an account number of a word-of-mouth application (here, the word-of-mouth application is a C-terminal application), an account number of a pay-for-use application, and the like, and stores the merchant store information in association with the merchant store location information, and in the case that it is determined that the merchant store does not access any service platform, the mobile phone number and/or the account number of another third party application may be determined according to the merchant store location information, and the order information may be sent to the merchant store by pushing a message to another third party application, or the order information may be sent to the merchant store by sending a short message to a corresponding mobile phone number, and if the account number of the word-of-mouth application, the account number of the pay-for-use, and the mobile phone number of the other third party application are simultaneously queried, the order information is preferentially pushed by the word-of-mouth application, pushing ordering information through a Payment application program, and finally pushing ordering information through a short message.

If the server determines that the merchant store is accessed to the plurality of service platforms according to the query result returned by the at least one designated service platform, the server can randomly select one service platform from the plurality of service platforms accessed to the merchant store, push the ordering information to the selected service platform, and send the ordering information to the merchant store corresponding to the merchant store information through the service platform.

After ordering information is pushed to a merchant store, the merchant takes an order, if the server sends ordering information to the merchant store through a specified service platform, the merchant store sends order notification information to the specified service platform, the server is informed of the order taking by the specified service platform, and the server generates first preset prompt information according to the order taking notification information, wherein the first preset prompt information comprises the following steps: ordering information is pushed to a merchant through a specified service platform; if the server sends the ordering information to the merchant store in the preset service mode, the merchant store sends the order taking notification message to the server, for example, or sends the order taking notification message to the server in the preset service mode, and the first preset prompt information generated by the server according to the order taking notification message may be: the ordering information is pushed to the merchant in an XX mode, and after first preset prompt information is generated, the server returns the first preset prompt information to the client.

In an optional embodiment of the present invention, the menu page displayed to the user by the client may include a table code input box in addition to the menu information, the user may input a seated table code in the table code input box, the client needs to monitor an input operation of the table code information input by the user in real time, and after monitoring the input operation, the client generates the ordering information according to the dish information of at least one dish and the table code information.

In an optional implementation manner of the invention, before sending the ordering information to the merchant, the server needs to determine whether the ordering information contains table code information, the table code information can reflect the dishes ordered by the user corresponding to which table code the ordering information is, and is also a basis for the merchant to send the dishes to the user, and when the ordering information does not contain the table code information, it indicates that the merchant does not set the table code, and at this time, a meal taking identifier (the meal taking identifier needs to be sent to the client) needs to be generated.

And after the ordering information is sent to the merchant stores corresponding to the merchant store information, the ordering process of the user is completed.

Step S304, the client receives and displays the first preset prompt message returned by the server.

The server receives first preset prompt information returned by the server, and displays the first preset prompt information on the client, wherein the first preset prompt information is different due to different modes of sending ordering information to merchants, specifically, if the server sends the ordering information to the merchants through a specified service platform, the merchants send order receiving notification messages to the specified service platform, the specified service platform informs the servers of order receiving, and the first preset prompt information returned by the server can be: ordering information is pushed to a merchant through a specified service platform; if the server sends the ordering information to the merchant in the preset service mode, the merchant sends the order taking notification message to the server, for example, or sends the order taking notification message to the server in the preset service mode, the first preset prompt information returned by the server may be: ordering information has been pushed to the merchant in XX mode. After the user finishes, the user can pay and evaluate at the client, and sends the payment information and the evaluation information to the server, and the server finishes payment according to the payment information and stores the evaluation information.

In an optional implementation manner of the present invention, after the client generates the ordering information, the client may be connected to a printing device of a merchant store in a bluetooth manner, and the ordering information is sent to the printing device of the merchant store for printing, so as to further ensure that the ordering information can reach the merchant store.

According to the method provided by the embodiment of the invention, the client obtains the menu picture by scanning the menu, the menu picture is uploaded to the server, and the server performs image recognition on the menu picture to generate the menu information, so that the user can also order on line under the condition that no information is maintained by a merchant; the client uploads the user position information to the server so that the server determines a merchant store consumed by the user according to the user position, sends ordering information, gets through the link between the server and the merchant and completes the ordering process; therefore, the tedious process of maintaining information by the merchant is omitted, and the consumption of off-line resources of the merchant stores can be reduced, for example, the number of paper menus of the merchant is reduced.

Fig. 4 is a schematic structural diagram of a menu scanning-based ordering device according to an embodiment of the invention. The apparatus is applied to a server, and as shown in fig. 4, the apparatus includes: a first receiving module 400, a determining module 401, an identifying module 402, a second receiving module 403, and a sending module 404.

The first receiving module 400 is adapted to receive user location information and menu pictures uploaded after a client scans a menu;

a determining module 401 adapted to determine service provider information according to the user location information;

the identification module 402 is suitable for carrying out image identification on the menu picture, generating menu information and returning the menu information to the client;

a second receiving module 403, adapted to receive meal ordering information sent by the client, where the meal ordering information is generated by the client according to a selection operation of a user on at least one dish in the menu information;

the sending module 404 is adapted to send the ordering information to the service provider corresponding to the service provider information.

According to the device provided by the embodiment of the invention, the server carries out image recognition on the menu picture uploaded after the client scans the menu, generates the menu information and returns the menu information to the client, so that the user can also order on line under the condition that the service providing end does not maintain any information; the link between the service providing end and the server is disconnected due to the fact that the service providing end does not maintain information, the server needs to determine the service providing end consumed by the user according to the user position information uploaded by the client, the ordering information is sent, the link between the server and the service providing end is opened, the ordering process is completed, the problem that the user cannot order due to the fact that the link between the server and the service providing end is disconnected due to the fact that the service providing end does not use a B-end application program is avoided, meanwhile, the complex process of maintaining information of the service providing end is omitted, meanwhile, consumption of offline resources of the service providing end can be reduced, and the number of paper menus of the service providing end is reduced.

Fig. 5 is a schematic structural diagram of a menu scanning-based ordering device according to an embodiment of the invention. The apparatus is applied to a client, and as shown in fig. 5, the apparatus includes: the system comprises a scanning module 500, an uploading module 501, a display module 502, a generating module 503 and a sending module 504.

The scanning module 500 is adapted to scan a menu to obtain a menu picture;

the uploading module 501 is adapted to upload the menu picture and the user position information to the server, so that the server determines the service provider information according to the user position information, performs image recognition on the menu picture, generates menu information, and returns the menu information to the client;

a display module 502, adapted to receive and display menu information returned by the server;

the generating module 503 is adapted to monitor a selection operation of a user on at least one dish in the menu information, and generate meal ordering information according to the dish information of the at least one dish carried in the selection operation;

the sending module 504 is adapted to send the ordering information to the server, where the ordering information is sent by the server to the service provider corresponding to the service provider information.

According to the device provided by the embodiment of the invention, the client obtains the menu picture by scanning the menu, the menu picture is uploaded to the server, and the server performs image recognition on the menu picture to generate the menu information, so that the user can also order on line under the condition that the service providing terminal does not maintain any information; because the service providing end does not maintain information, a link between the service providing end and the server is disconnected, the client needs to upload user position information to the server, so that the server determines the service providing end consumed by the user according to the user position, sends ordering information, gets through the link between the server and the service providing end, and completes an ordering process; therefore, the complicated process of maintaining information by the service providing terminal is omitted, and the consumption of offline resources of the service providing terminal can be reduced, for example, the number of paper menus of the service providing terminal is reduced.

The embodiment of the application also provides a nonvolatile computer storage medium, wherein the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the menu scanning-based ordering method in any method embodiment.

Fig. 6 is a schematic structural diagram of a computing device according to an embodiment of the present invention, and the specific embodiment of the present invention does not limit the specific implementation of the computing device.

As shown in fig. 6, the computing device may include: a processor (processor)602, a communication Interface 604, a memory 606, and a communication bus 608.

Wherein:

the processor 602, communication interface 604, and memory 606 communicate with one another via a communication bus 608.

A communication interface 604 for communicating with network elements of other devices, such as clients or other servers.

The processor 602 is configured to execute the program 610, and may specifically execute relevant steps in the menu scanning-based ordering method embodiment described above.

In particular, program 610 may include program code comprising computer operating instructions.

The processor 602 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention. The computing device includes one or more processors, which may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

And a memory 606 for storing a program 610. Memory 606 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 610 may specifically be configured to enable the processor 602 to execute a menu scanning-based ordering method in any of the above-described method embodiments. For specific implementation of each step in the program 610, reference may be made to corresponding steps and corresponding descriptions in units in the menu scanning-based ordering embodiment, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of a menu scanning based ordering device in accordance with embodiments of the invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims

1. A menu scanning-based ordering method is realized based on a server and comprises the following steps:

determining information of a service providing end according to the user position information so as to establish a link between a server and the service providing end, wherein the service providing end is not provided with a corresponding application program, and the service providing end does not use application program maintenance information;

receiving ordering information sent by a client, and sending the ordering information to a service provider corresponding to the service provider information, wherein the ordering information is generated by the client according to selection operation of a user on at least one dish in menu information.

2. The method of claim 1, wherein said determining service provider information from user location information further comprises:

3. The method according to claim 1 or 2, wherein before sending the ordering information to the service provider corresponding to the service provider information, the method further comprises: sending query information to at least one appointed service platform in a broadcasting mode to determine whether an access service platform of a service provider exists in the at least one appointed service platform;

the step of sending the ordering information to the service provider corresponding to the service provider information further comprises:

and if not, sending the ordering information to a service provider corresponding to the service provider information in a preset service mode.

4. The method according to claim 1 or 2, wherein before sending the ordering information to the service provider corresponding to the service provider information, the method further comprises: judging whether the ordering information contains table code information or not;

the sending the ordering information to the service provider corresponding to the service provider information further comprises:

5. The method according to claim 1 or 2, wherein the method further comprises: receiving a bill receiving notification message returned by a service provider or a service platform accessed by the service provider, generating a first preset prompt message according to the bill receiving notification message, and returning the first preset prompt message to a client.

6. The method of claim 1 or 2, wherein the menu information comprises: menu category, name of dish, price of dish, picture of dish.

7. A menu scanning-based ordering method is realized based on a client, and comprises the following steps:

scanning the menu to obtain a menu picture;

uploading the menu picture and the user position information to a server, so that the server determines service providing end information according to the user position information to establish a link between the server and the service providing end, performs image recognition on the menu picture to generate menu information, and returns the menu information to the client, wherein the service providing end does not install a corresponding application program, and the service providing end does not use application program maintenance information;

receiving and displaying menu information returned by the server;

8. The method of claim 7, wherein prior to generating the ordering information from the dish information of the at least one dish carried in the selecting operation, the method further comprises: monitoring the input operation of inputting the table code information by a user;

the generating of the ordering information according to the dish information of the at least one dish carried in the selecting operation further comprises:

9. The method of claim 7 or 8, wherein after sending the ordering information to a server, the method further comprises: and generating and displaying second preset prompt information.

10. The method of claim 9, wherein the method further comprises: and receiving and displaying first preset prompt information returned by the server.

11. The method of claim 7, wherein after generating the ordering information, the method further comprises: and the ordering information is sent to the printing equipment of the service provider to be printed by being connected with the printing equipment of the service provider in a Bluetooth mode.

12. An ordering device based on menu scanning is applied to a server, and the device comprises:

the determining module is suitable for determining the information of the service providing terminal according to the user position information so as to establish a link between the server and the service providing terminal, wherein the service providing terminal does not install a corresponding application program, and the service providing terminal does not use the maintenance information of the application program;

the second receiving module is suitable for receiving ordering information sent by the client, wherein the ordering information is generated by the client according to the selection operation of the user on at least one dish in the menu information;

and the sending module is suitable for sending the ordering information to a service provider corresponding to the service provider information.

13. The apparatus of claim 12, wherein the determination module is further adapted to: and searching the position information of the service providing end matched with the position information of the user, and determining the position information of the service providing end according to the position information of the service providing end.

14. The apparatus of claim 12 or 13, wherein the apparatus further comprises: the broadcast module is suitable for sending query information to at least one specified service platform in a broadcast mode so as to determine whether an access service platform of a service provider exists in the at least one specified service platform;

the sending module is further adapted to: if the at least one appointed service platform has an access service platform of a service provider, pushing the ordering information to the access service platform of the service provider so that the access service platform of the service provider sends the ordering information to the service provider corresponding to the information of the service provider;

and if the at least one appointed service platform does not have an access service platform of the service provider, sending the ordering information to the service provider corresponding to the service provider information in a preset service mode.

15. The apparatus of claim 12 or 13, wherein the apparatus further comprises: the judging module is suitable for judging whether the ordering information contains table code information or not;

the sending module is further adapted to: if the ordering information contains table code information, the ordering information is sent to a service provider corresponding to the service provider information;

16. The apparatus of claim 12 or 13, wherein the apparatus further comprises: the third receiving module is suitable for receiving the order receiving notification message returned by the service provider or the service platform accessed by the service provider;

17. The apparatus of claim 12 or 13, wherein the menu information comprises: menu category, name of dish, price of dish, picture of dish.

18. An ordering device based on menu scanning is applied to a client, and the device comprises:

the scanning module is suitable for scanning the menu to obtain a menu picture;

the uploading module is suitable for uploading the menu picture and the user position information to a server so that the server determines service providing end information according to the user position information to establish a link between the server and the service providing end, performs image recognition on the menu picture to generate menu information, and returns the menu information to the client, wherein the service providing end does not install a corresponding application program, and the service providing end does not use application program maintenance information;

and the sending module is suitable for sending the ordering information to a server, wherein the ordering information is sent to a service provider corresponding to the service provider information by the server.

19. The apparatus of claim 18, wherein the apparatus further comprises: the monitoring module is suitable for monitoring the input operation of inputting the table code information by the user;

20. The apparatus of claim 18 or 19, wherein the apparatus further comprises: and the display module is suitable for generating and displaying second preset prompt information.

21. The apparatus of claim 20, wherein the display module is further adapted to: and receiving and displaying first preset prompt information returned by the server.

22. The apparatus of claim 18, wherein the apparatus further comprises: and the Bluetooth connection module is suitable for being connected with the printing equipment of the service provider in a Bluetooth mode, and sends the ordering information to the printing equipment of the service provider for printing.

23. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the operation corresponding to the menu scanning-based ordering method according to any one of claims 1-6.

24. A computer storage medium having stored therein at least one executable instruction for causing a processor to perform operations corresponding to the menu scan based ordering method of any one of claims 1-6.

25. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;

the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the operation corresponding to the menu scanning-based ordering method according to any one of claims 7-11.

26. A computer storage medium having stored therein at least one executable instruction for causing a processor to perform operations corresponding to the menu scan based ordering method of any one of claims 7-11.