JP2023030705A - Information processing method, information processing apparatus, program, and information processing system - Google Patents

Abstract

To provide an information processing method, an information processing apparatus, a program, and an information processing system in which accounting processing can be carried out with lessor burden and labor.SOLUTION: The present invention is directed to an information processing method including: acquiring article image data including image data of specific information for specifying a certain article and image data of a price of the certain article; generating data of an order reception image including an operation button for use in reception of an order of the certain article on the basis of the article image data; generating article data represented by the operation button and in which the certain article is associated with the price of the certain article on the basis of the article image data; displaying the order reception image corresponding to the data of the generated order reception image on a display screen so that an operation on the operation button can be received; discriminating whether the operation on the operation button included in the order reception image displayed on the display screen is carried out; and, if it is determined that the operation on the operation button is carried out, generating sales data on the basis of the article data of the certain article.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing method, an information processing apparatus, a program, and an information processing system.

In a cash register (cash register, commonly known as cash register) used for accounting in commercial facilities such as retail stores, product names and amounts are generally associated, and sales are recorded by operating buttons corresponding to ordered products. be. In Patent Literature 1, in a store terminal such as a tablet terminal, a user designates a range to read product names and prices in an image of a menu table, reads characters in the designated image range, and identifies products and prices. A technique for generating associated data and registering it in a menu information database is disclosed.

Japanese Patent No. 6099788

However, in the conventional technology, it is not possible to sufficiently reduce the user's operation troubles for accepting product orders and performing accounting processing at the register.

SUMMARY OF THE INVENTION An object of the present invention is to provide an information processing method, an information processing apparatus, a program, and an information processing system that enable the accounting processing of products with less effort.

In order to achieve the above object, the present invention
Acquiring product image data including image data of specific information specifying a product and image data of the price of the product,
generating order reception image data including an operation button for accepting an order for the certain product based on the product image data;
generating product data in which the product represented by the operation button and the price of the product are associated with each other based on the product image data;
displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to receive the operation of the operation button;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
In the information processing method, sales data of the certain product is generated based on the product data of the certain product when it is determined that the operation button has been operated.

According to the present invention, there is an effect that it becomes possible to perform the accounting processing of the product with less trouble.

1 is a block diagram showing the configuration of an information processing system according to an embodiment; FIG. It is a figure explaining a menu table. It is a figure explaining the setting of goods and amount of money. It is a figure explaining discount setting. It is a figure explaining discount application. 4 is a flowchart showing a control procedure of external setting control processing; It is a figure which shows the example of the order reception screen produced|generated. It is a figure explaining the flow of the operation|movement regarding accounting processing.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of an information processing system 100 of this embodiment.
The information processing system 100 includes an information processing device 1 and a register 4 (external device).

The information processing device 1 is a portable general-purpose terminal electronic device, such as a smart phone.
The information processing apparatus 1 includes a CPU 11 (Central Processing Unit) (processing unit), a storage unit 12, a display unit 13, an operation reception unit 14, an imaging unit 15, a communication unit 16 (first communication unit), and the like. Prepare.

The CPU 11 is a hardware processor that performs arithmetic processing and centrally controls the operation of the information processing apparatus 1 . The CPU 11 may be a single processor, or may have a plurality of processors, each of which performs common processing in parallel or different processing separately. At least this CPU 11 is included in the computer of this embodiment.

The storage unit 12 has a memory that stores data. The storage unit 12 includes a RAM that provides a working memory space to the CPU 11 and stores temporary data, and a non-volatile memory that stores the program 121, setting data, and the like. The RAM is, for example, a DRAM, and the non-volatile memory is, for example, a flash memory. The program 121 includes a program relating to the function of identifying characters from image data (OCR), and a cashier accounting assistance application which will be described later. The setting data stored in the non-volatile memory includes the order reception image data 122 for the order input operation used in the cash register assistance application, and the product name selected by the operation accepted through the order reception image data 122. , and the product list 123 that stores the sales amount corresponding to the product name.

The display unit 13 has a display screen, and displays information on the display screen under the control of the CPU 11 . The display screen is not particularly limited, but is, for example, a liquid crystal display (LCD). Moreover, the display unit 13 may have an LED lamp for notifying the status such as the operating state and the charging state.

The operation reception unit 14 receives an input operation from the outside such as a user, generates an input signal, and outputs the input signal to the CPU 11 . The operation reception unit 14 has, for example, a touch panel that overlaps the display screen. Also, the operation reception unit 14 may have a push button switch, a slide switch, or the like.

The photographing unit 15 is a digital camera that performs a photographing operation to generate and output image data. The imaging unit 15 has, for example, a lens (optical system) and two-dimensionally arranged CMOS sensors, and performs imaging in each of the RGB wavelength bands to generate color image data.

The communication unit 16 performs wireless communication with an external device. Wireless communication that can be controlled by the communication unit 16 includes telephone communication, wireless LAN (Local Area Network) such as WiFi, and short-range wireless communication such as Bluetooth (registered trademark). Each has an antenna that conforms to the communication frequency and polarization characteristics. Bluetooth is used here for communication with the register 4 . Although the Bluetooth standard is not particularly limited, for example, by adopting the Low Energy standard, power consumption can be kept low even if the connection state is maintained while the store is open.

The register 4 is a cash register (cash register) located in a store or the like and used for accounting. The register 4 includes a CPU 41 (control unit), a storage unit 42, a display unit 43, an operation reception unit 44, a communication unit 46 (second communication unit), a printing unit 47, a paper transport unit 48, and the like. Prepare.

The CPU 41 performs arithmetic processing and centrally controls the operation of the register 4 . The CPU 41 may have not only a general-purpose CPU but also a microcomputer or the like. Also, part of the arithmetic processing of the CPU 41 may be performed by a dedicated logic circuit or the like.

The storage unit 42 has a memory that stores data. The storage unit 42 may include a RAM that provides a working memory space to the CPU 41 and stores temporary data, and a non-volatile memory that stores the program 421, setting data, sales information, and the like. A non-volatile memory is, for example, a flash memory. The setting data may include input settings 422 indicating the relationship between the registered product name, product price, and the position of the reception button of the operation reception unit 44 corresponding thereto.

The display unit 43 has a display screen, and displays the amount of money and the like on the display screen under the control of the CPU 41 . The display screen is, for example, an LCD, but is not limited to this.

The operation reception unit 44 receives an input operation from the outside such as a user, generates an operation signal, and outputs the operation signal to the CPU 41 . The operation reception unit 44 is capable of inputting the sales amount of the product, the amount received from the customer, and the like. The operation reception unit 44 also includes a registration button that allows direct input of the sales of the product assigned in the input setting 422 as described above.

The communication unit 46 controls communication with an external device, here, the information processing apparatus 1 . The communication unit 46 can communicate with the information processing apparatus 1 according to a common communication standard, and here controls Bluetooth communication via an antenna (not shown).

The printing unit 47 prints and records sales information on receipt paper. The recording method of the printing unit 47 is not particularly limited, but may be, for example, a thermal transfer method.

The paper conveying unit 48 moves the receipt paper by an appropriate length at an appropriate timing, and supplies and discharges it to a position where print recording is performed. The paper conveying unit 48 has, for example, a rotating roller and a motor, and rotates the rotating roller to which a roll of receipt paper is attached by the motor to send out the receipt paper.

Next, accounting processing in the information processing system 100 of this embodiment will be described.
In the information processing system 100 , final accounting processing is performed by the register 4 . In the register 4, normal accounting processing is possible, and the operation of inputting the sales amount of each product is added, and if necessary, the exclusivity of consumption tax is calculated, added, or discounted. can be The price of the product may be associated with the product to be sold and registered in a specific key. Thus, the amount of the product may be added as the sales amount, but the amount itself may be input by directly operating (depressing) the numeric keypad. It should be noted that the goods may be services in addition to or instead of goods.

In addition, the register 4 can acquire sales data from the information processing device 1 via the communication section 46 . In the information processing device 1, the sales amount of the ordered product (certain product) and simple product information (specific information) are transmitted to the register 4 via the communication unit 16 by the operation of the program 121 related to the generation of sales data. be. The sales data is generated by the information processing apparatus 1 by displaying an order acceptance image created by importing (acquiring) photographed data (merchandise image data) of a menu table created for presentation to customers. It is done using the screen.

FIG. 2 is a diagram explaining the menu table M. As shown in FIG.
The menu table M, as shown in FIG. 2A, is a product image of the present embodiment. are shown in association with each other. The menu table M may be handwritten or a copy of a handwritten one, or may be created by a restaurant staff or the like in an arbitrary arrangement using an application program such as a drawing tool or a painting tool. good too.

Here, in the menu table M, menus such as a plurality of sets and set meals are described for each block, and some menus are displayed together with photographs. Namely, this menu table M is created so that the customer can easily select the product to be ordered, and the name of the product (display of the specific information) and the display of the price are clearly displayed in order to register the product in the register 4. It does not have to be created as text data or the like associated with each other.

After acquiring the menu image data by photographing the menu table M with the photographing unit 15 (camera) of the information processing apparatus 1, the OCR software of the program 121 or the like is used to display characters and numbers (including symbols indicating prices). ) can be identified, and character strings and number strings can be extracted as shown in FIG. 2(b). These character strings and number strings are candidates for operation buttons indicating product names.

FIG. 3 is a diagram illustrating setting of products and amounts. Here, of the menu image data shown in FIG. 2(b), only the "A set" portion located in the center of the upper row will be described. Setting processing is performed.

As shown in FIG. 3A, each of the extracted character strings and number strings is indicated as an operation button with a simple outer frame or a push button switch drawn in plan view. Among these, first, a screen for selecting a product name (menu name, specific information of a product) is displayed. An operation of selecting an operation button indicating one of the product names (for example, an operation of placing the cursor over the display range of the operation button with a pointing device such as a mouse and clicking, an operation of tapping the display range with a finger, etc.). When this operation is referred to as operation of the operation button (here, for example, "Soy sauce ramen (small)"), the amount corresponding to the product name (the price of a certain product) is displayed as shown in FIG. ) is displayed. Here, by selecting the one on the upper side of the two "950 yen", "950" is set in units of "yen" as the price of "soy sauce ramen (small)". That is, if the character/number string indicating the selected amount includes characters indicating a currency unit, etc., the currency unit may be appropriately identified. In addition, when subunits such as cents can be included in dollars and euros, these units (breaks) may be appropriately determined. As a result, a product is associated with the price of the product. Character strings (number strings) indicated as monetary amounts may be excluded from operation button candidates, but in consideration of cases such as when a single monetary amount is indicated for multiple products, select them again as monetary amounts. It may be left as an operation button candidate.

The process of accepting the operation of the operation button containing the product name (specific information) and the corresponding amount is repeated for all products. When the operation buttons for all the products and the price of the product are operated, and the selection end button E is operated by a pointing device or the like on the screen, as shown in FIG. The character string of the operation button is excluded from the display settings for the operation button.

FIG. 4 is a diagram for explaining discount setting. Here, of the menu image data shown in FIG. 2B, the portion of the menu relating to ramen located on the upper left side will be described.

As shown in FIG. 4(a), in addition to the normal product, the display of the changed amount related to the change (price change information) such as a temporary discount or premium such as "100 yen discount!!" can be included in the scope of Here, "100 yen discount" is displayed as the product name (specific information) and displayed as the operation button R1 (change button), and at the same time, "-100" is registered as the amount. Although a fixed amount discount example is shown here, a ratio may be specified for the discount. The discount should be applied to the amount of the most recently ordered product. In addition to the discount, there may be a surcharge or the like. This can be displayed and used, for example, when there is a late-night surcharge. In addition, as in the setting of the register 4, in the information processing device 1, the product may include services in addition to or instead of the product. By operating the confirmation button C, the display contents of the order acceptance image are confirmed.

This "100 yen discount" is limited to "11:00 AM to 11:30 AM". In the information processing apparatus 1, by reading this or based on the user's operation, the "100 yen discount" operation button may be made operable only during the discount period. As shown in FIG. 4B, the operation button R2 may be displayed in an inoperable state outside the target time, or the operation button R2 itself may be erased outside the target time.

FIG. 5 is a diagram for explaining discount application.
In the above description, it is assumed that the user inputs a discount of 100 yen. However, it is set so that the setting and display of the discounted amount can be automatically switched based on the setting of the product to be discounted and the time period. may In response to the display (second order reception image) in which the amount is set for the normal time period shown in FIG. Depending on whether the application condition is satisfied or not, the amount Rd of "salt ramen" and "miso ramen" is discounted by 100 yen (Fig. 5(b), first order acceptance image). A plurality of types of order reception image data are defined. The discounted price may be displayed in a different display color or background color or surrounded by a frame or the like so that the discounted price can be recognized. Alternatively, a specific sign, symbol, etc. indicating the discount/surcharge may be displayed along with the amount.

These plural types (here, two types) of data of order reception images may be collectively generated at the time of setting products and prices based on menu image data or the like. In addition, when the image data is display data such as HTML, a single data file may include a plurality of display patterns integrally and may be selectively displayed. The price setting of the product may be stored in correspondence with the price depending on whether there is a discount or a premium, or may be stored in correspondence with the original price and the discount/surcharge.

It should be noted that the product name and the price corresponding to the product name may be presumed instead of the user specifying all the product names and the corresponding prices. In this case, a number string, especially a number containing a currency unit is first estimated as an amount, and a position corresponding to the estimated amount, for example, a character string positioned horizontally is estimated as a product name. An estimation error or the like can be corrected by an input operation by the user.

FIG. 6 is a flowchart showing the control procedure by the CPU 11 of the external setting control process executed by the information processing apparatus 1. As shown in FIG. This external setting control process including the information processing method of the present embodiment is performed in advance, for example, before the opening of the store. It is started when an operation to start is accepted.

The CPU 11 obtains photographed data of the menu table M (step S101; image obtaining step, image obtaining means). The photographed data may be selected from a file list or the like, photographed data that has been photographed in advance and stored in the storage unit 12 or in a drive or folder on an external network. Guidance or the like may be performed so that the user is allowed to take an image using the image capturing unit 15 in .

The CPU 11 identifies and extracts characters (text portions) of the photographed data of the acquired menu table M, and generates text data having position information of the characters (step S102). The CPU 11 divides the text data for each description part, converts each position range into operation buttons, and displays them (step S103). In addition, the CPU 11 also displays a product selection end button E.

The CPU 11 determines whether or not the end selection button E for end of product selection has been operated (step S104). When it is determined that the product selection end button E has not been operated ("NO" in step S104), the CPU 11 determines whether or not the operation button generated in step S103 has been operated (step S105). When it is determined that the operation button has not been operated ("NO" in step S105), the processing of the CPU 11 returns to step S104.

When it is determined that the operation button has been operated ("YES" in step S105), the CPU 11 highlights (selects) the selected button display portion as the product name (step S106). The CPU 11 determines whether or not the operation button indicating the price of the highlighted product has been accepted (step S107). When it is determined that the operation of the operation button has not been accepted ("NO" in step S107), the CPU 11 repeats the processing of step S107.

When it is determined that the operation of the operation button has been accepted ("YES" in step S107), the CPU 11 reads the number from the text of the operation button for which the operation has been accepted, determines the amount as the amount, and predetermines the amount. store in association with the product name acquired in (step S108). At this time, the CPU 11 may display the combination of the amount and the product name in a modifiable state and wait for the correction operation and the approval operation. Also, if the product name and the price are not properly separated (for example, if “large serving” and “110 yen” are determined to be a series of text), the text can be separated from the product name and price. After registering as both, correction processing such as shortening the product name to only the "large serving" part may be performed. Only the number "110" can be extracted as the amount.

The CPU 11 confirms and displays the operation button on which the product is displayed, and cancels the button display of the operation button on which the amount is displayed (step S109). Then, the processing of CPU 11 returns to step S104.

When it is determined in the determination process of step S104 that the product selection end button E has been operated ("YES" in step S104), the CPU 11 displays the remaining (non-operated operation button) text on the button. All are released (step S111). The CPU 11 finalizes and generates the order reception image data 122 including the button display of the finalized product (step S112). It should be noted that the CPU 11 may perform processing such as rearranging the order reception image data 122 by removing blank spaces as appropriate before finalizing the order reception image data 122 . Also, it may be possible to accept an operation to delete a character string or the like that is not necessary for an order operation.
The processing of steps S102 to S112 constitutes an image generation step (image generation means of the program).

The CPU 11 collectively sets and stores the product name (specified information) and amount associated and stored in the process of step S108 as a product list 123 (step S113; list data generation step, list data generation means). Then, the CPU 11 terminates the external setting control process.

FIG. 7 is a diagram showing an example of an order reception screen generated by the external setting control process described above.
As shown in FIG. 7A, an image (order reception image O) is displayed on the order reception screen (display screen) according to the order reception image data generated by the external setting control process of FIG. In this order reception image O, the portion where the product name set by the external setting control process is displayed is included as selection operation buttons B1 to B3, and each selection operation button B1 to B3 can be operated at the time of ordering. . As in the case where the information processing device 1 is a smartphone, if the order reception images O for all the products cannot be displayed on the order reception screen at once due to the size of the screen, scroll display may be possible. Alternatively, it may be possible to split display into a plurality of pages. When split display is performed on a plurality of screens, operation buttons for changing the page to be displayed (for example, operation buttons B4 and B5 for "previous page" and "next page") may be additionally displayed. In addition, a subtotal button T (which may be a display of "accounting" or the like) for receiving a subtotal operation indicating the end of the order operation is added to the order reception screen (order reception image O).

In the order reception image О, the image of the product may be deleted as appropriate as it is not necessary for the order operation. positions may be rearranged appropriately. Further, font types, sizes, and the like representing characters and numbers may be uniformly predetermined.

Some of the character strings that are not directly related to the product name and have not been set as the product name may be necessary for grouping products, so they do not necessarily have to be uniformly deleted. Whether or not these character strings can be erased may be determined according to the user's input operation. Here, since the character string "A set" representing the group of set menus is the information required to specify the ordered product, this character string is not deleted but remains in the order reception image data. In addition, since the character string "Gyoza" is information specifying the contents of the A set, this character string may also be left in the order reception image data without being deleted, or may be unnecessary information for the clerk. may be erased.
Alternatively, on the other hand, the positional relationship in the original menu table M may be generally maintained, even for characters that are not necessary for spaces or accounting processing, without making changes such as deletion to a large extent. That is, the images included in the menu table M may be left in the order reception image O as they are. As a result, the sales setting operation can be performed with the positional relationship almost according to the menu table, so that the sales clerk does not have to struggle to find the product to be sold on the screen.

The information processing device 1 can accept an order by displaying an order acceptance image O including operation buttons capable of accepting operations on the generated order acceptance screen and detecting the operation of each operation button. Sales data of the ordered product is generated based on the product name of the product for which the order has been received and information on the price associated with the product name. The generated sales data is transmitted to the register 4 by the communication section 16 . If orders can be placed from a plurality of seats or tables, the sales data may include identification information for specifying the seats or tables and be transmitted.

Although not particularly limited, here, as shown in FIG. 7(b), the products and their prices sent to the register 4 as sales data are displayed in the ordered column. The register 4 receives the product name and price information and adds them to the accounting details. When the subtotal button T is operated, it is assumed that the order has been completed, and the accounting processing at the register 4 can be terminated. It should be noted that regardless of the operation of the subtotal button T, the accounting processing at the register 4 may be terminated.

In addition to the sales data received from the information processing apparatus 1, the transaction details may include sales data directly received by the register 4. FIG. If there is a standard product registered in the register 4, or if there is sales of non-regular menu items that have not been set in the information processing apparatus 1, sales are made directly to the register 4. An amount or the like may be input in some cases. Accounting processing is performed based on the finally entered sales amount, and a receipt is printed and output.

When the register 4 holds today's sales history, etc., the sales amount received from the information processing device 1 may be processed collectively, or may be processed according to the product name (specific information) received together. may be classified according to

FIG. 8 is a diagram for explaining the flow of operations related to accounting processing.
As shown in the sequence diagram of FIG. 8( a ), when the application activation operation by the user is received, the information processing device 1 activates the application, displays the order acceptance screen, and communicates with the register 4 . A connection is established.

When the user operates an operation button corresponding to an ordered product on the order reception screen, the information processing device 1 specifies the ordered product and its price. Then, sales data is generated based on the specified product and the price of the product, and the generated sales data is transmitted to the register 4 .

The register 4 performs overall accounting processing based on the sales data received from the information processing device 1 . At this time, if the sales have been/will be input separately at the register 4, the sales amount related to the received sales data and the sales amount related to the input operation to the register 4 are summed up (negative due to discount etc.). including forehead). After completing the exchange of charges with the customer, a receipt is printed and output.

FIG. 8B is a flow chart showing the control procedure by the CPU 11 of the sales setting control process executed by the information processing apparatus 1. As shown in FIG.
When the sales setting control process is started, the CPU 11 reads the order reception image data 122 and displays the order reception image O on the display screen (step S141; display control step, display control means). The CPU 11 establishes a Bluetooth communication connection with the register 4 (step S142).

The CPU 11 determines whether or not the operation of the subtotal button T has been accepted (step S143). When it is determined that the operation of the subtotal button T has not been accepted ("NO" in step S143), the CPU 11 determines whether the operation of the operation button for accepting the order of the product (menu) has been accepted. It discriminates (step S144; operation discriminating step, operation discriminating means). When it is determined that the operation of the operation button has not been accepted ("NO" in step S144), the processing of the CPU 11 returns to step S143.

When it is determined that the operation of the operation button has been accepted ("YES" in step S144), the CPU 11 refers to the product list 123 to identify the price of the product corresponding to the operated operation button. Sales data is generated and stored based on the specified contents. (Step S145; sales data generation step, sales data generation means). The CPU 11 transmits the generated sales data to the register 4 by Bluetooth via the communication section 16 (step S146). The CPU 11 causes the display unit 13 to display the content of the sales setting on the display screen (step S147). Then, the processing of CPU 11 returns to step S143.

Further, when it is determined in the determination process of step S143 that the operation of the subtotal button T has been accepted ("YES" in step S143), the CPU 11 notifies via the communication unit 16 via Bluetooth that the order has been completed. It is transmitted to the register 4 (step S151). The CPU 11 initializes the contents of the sales setting (step S152), and erases the contents of the sales displayed on the display screen (step S153). Then, the processing of CPU 11 returns to step S143.

Note that this process may be forcibly terminated by interrupt processing in response to a termination command of the cashier accounting assistance application or the like.

As described above, in the information processing method of the present embodiment, product image data including image data of specific information such as a product name that specifies a product and image data of the price of the product (photographed data of menu table M, etc.) ) (step S101), and based on the product image data, generate data for an order reception image O including selection operation buttons (B1 to B3) for accepting an order for a certain product (steps S102 to S112), Also, based on the data of the product image (menu table M), a product list 123 is generated in which the product represented by the selection operation buttons B1 to B3 and the price of the product are associated (step S113). The order reception image O corresponding to the data of the order reception image O is displayed on the display screen so as to accept the operation of the selection operation buttons B1 to B3 (step S141), and the order reception image O displayed on the display screen includes the order reception image O. It is determined whether or not the selection operation buttons B1 to B3 have been operated (step S144), and if it is determined that the selection operation buttons B1 to B3 have been operated, the product corresponding to the operated operation button is selected. Product data is acquired from the product list 123, and sales data for a certain product is generated based on the product data (step S145).
In this way, by making it possible to generate sales data using photographed data such as the menu table M, it is possible to easily perform accounting processing with less effort without registering products and amounts in the register 4 one by one. become. In particular, menus and prices are changed on a daily, weekly, or irregular basis. Accounting processing) becomes possible using a general-purpose information processing device 1 such as a smart phone, which makes it easier. In addition, since the order reception image O corresponding to the menu table M can be obtained, it is possible to reduce the time and effort required for the store clerk to search for the operation button for the ordered product.

Further, in this information processing method, in the order reception image O, the portion where the specific information is displayed is used as the operation button. Since the text part including the specific information is displayed almost as it is as the operation button, the processing is easy, and the user such as a salesclerk can easily and without error enter the sales according to the original menu table. can be done.

Also, in this information processing method, the text portion in the product image data is extracted, and the specific information and the price are set from the extracted text portion. That is, since the text portion is recognized and extracted from the photographed image data of the menu table and the product name and price are set, the user does not need to input the product name and price one by one to set the operation, thereby reducing labor. be.

Further, in this information processing method, when it is determined that the displayed operation button has been operated, the communication unit 16 transmits the sales data of the price of the corresponding product to the external device (register 4) (step S151). ). In this way, the sales input operation (sales setting) based on the menu image can be performed outside the register 4, and the sales input operation can be transmitted to the register 4. Therefore, the product registration operation is performed for the register 4. You can save time. Further, by enabling such sales input operation to be performed by a general-purpose external device capable of photographing the menu table M, the register 4 does not need to be equipped with a photographing mechanism, which increases the cost of the register 4. can be suppressed.

Further, the sales data to be transmitted to the external device (register 4) includes specific information of a certain product. That is, even if the product name is not accurately registered at the register 4, it is possible to obtain which product has been sold, so that the product name, etc., can be displayed on the receipt, even if it is simple, so that the customer's attention can be improved. Convenience can be improved. In addition, even if the sales history can be left at the register 4, it becomes easy to distinguish and organize which product is sold, so that the trouble of managing sales can be reduced.

Further, the data of the order reception image O includes an operation button R1 for accepting a premium or discount on the price of a certain product, and based on the product image data, the price premium or discount indicated by the operation button R1 is determined. and when it is determined that the operation button and the operation button R1 have been operated, the sales data of the certain product is generated based on the product data of the certain product and the change data. .
In this way, it is possible not only to simply add products and increase the amount, but also to process discounts, premiums, etc., so that it becomes possible to perform ordering operations from the information processing apparatus 1 more flexibly. .

Alternatively, the menu image data includes price change information (premium/discount amount, specific information of a certain product, and application conditions thereof) related to the premium or discount of a certain product, and the first image data reflecting the price change information. Generate order reception image data and second order reception image data that does not reflect price change information, and depending on whether the discount indicated by the price change information or the conditions for applying the discount are satisfied, The order reception image may be displayed on the display screen based on the data of the first order reception image or the data of the second order reception image.
That is, a set amount of money such as a discount or surcharge may be displayed instead of the original amount after automatically determining whether or not the application condition is satisfied. This prevents the user (clerk) from omitting or inappropriately applying the discount/surcharge, and also eliminates the need for the clerk to perform multiple operations, further simplifying the input operation when placing an order. .

The information processing apparatus 1 of the present embodiment also includes a CPU 11 . The CPU 11 acquires product image (image of the menu table M) data including display of specific information for specifying a product and display of the price of the product (step S101), and based on the product image data, data (order reception image data 122) having selection operation buttons B1 to B3 for accepting orders of (steps S102 to S112), and based on the product image data, selection operation button B1 A product list 123 is generated in which a product represented by ˜B3 and the price of the product are associated with each other (step S113). Further, the CPU 11 displays the order reception image O corresponding to the generated order reception image data 122 on the display screen so that the operation of the selection operation buttons B1 to B3 can be accepted (step S141). It is determined whether or not the selection operation buttons B1 to B3 included in the order reception image O have been operated (step S144), and if it is determined that the selection operation buttons B1 to B3 have been operated, the corresponding operation button The product data of the product is obtained from the product list 123 (step S145).
According to this information processing apparatus 1, by enabling an input operation to acquire information such as the price of the sold product from photographed data such as the menu table M, there is no need to register each product and the price in the register 4 (especially When there are many changes and replacements), it is possible to easily process sales (accounting processing, etc.) with less effort. In addition, since the order reception image O corresponding to the menu table M can be obtained, the information processing apparatus 1 reduces the time and effort required for the salesclerk to search for the sold product, and allows easy operation of the operation button corresponding to the product. can be done.

Also, by installing and executing the program 121 that enables the above-described sales input operation on a computer, accounting processing can be performed more easily.

Further, the information processing system 100 of the present embodiment includes the information processing device 1 described above, a communication unit 46 that performs communication, and a register 4 that includes the CPU 41 . When sales data is transmitted from the information processing device 1 to the register 4 via the communication unit 16 (step S151), the CPU 41 of the register 4 performs accounting processing including the received sales data.
As described above, in the information processing system 100, instead of registering all the products in the register 4, based on the contents easily and simply set based on the menu table M or the like in the external information processing device 1, Since sales can be easily input and set and transmitted to the register 4, sales of products (services) that are likely to be replaced or changed in price and that are difficult to manage with an identification code are included. Accounting processing can be performed more easily than before. In addition, since the function of the register 4 is not required to be greatly improved, the increase in cost can be suppressed.

It should be noted that the present invention is not limited to the above embodiments, and various modifications are possible.
For example, in the above-described embodiment, the menu table of the restaurant is photographed and used to generate the data of the order reception image O related to the sales operation, but the present invention is not limited to this. An internal document or the like used by a store clerk may be used. Also, the object to be photographed is not necessarily limited to a menu listing a plurality of product names. The object to be photographed may include only one product. In addition, when reflecting detailed changes in service contents or changes in prices at stores that provide other services, a service list or the like may be used to perform sales operations.

Further, in the above-described embodiment, the final account processing is performed at the register 4, but the present invention is not limited to this. Accounting processing may be performed only by the information processing device 1 . In this case, the information processing apparatus 1 may be connected to a normal printer or the like to print and record receipts instead of receipts.

Further, in the above embodiment, sales operations are performed one by one for each order, but the number of sales may be input. That is, in the above embodiment, when there are multiple orders for the same product, it is necessary to repeat the order operation for the product multiple times. The operation can be accepted, and the display of the order quantity may be made in parallel with the product name ordered. Alternatively, the sales data transmitted to the register 4 may be used to input the sales quantity at the register 4 . Similarly, the register 4 may perform processing such as adding a consumption tax, discounting, or surcharge to the sales content transmitted from the information processing device 1 .

Further, in the above-described embodiment, the specific information is transmitted from the information processing device 1 to the register 4 together with the sales amount, but the specific information does not necessarily have to be transmitted to the register 4 . As long as the fee can be calculated, the amount of information may be reduced to simplify the processing.

Further, in the above-described embodiment, the product name itself is explained as a button, but the specific form of the order reception screen may vary as appropriate, such as adding an operation button separately to the side of the product name. There may be.

Also, in the above embodiment, the communication is performed using Bluetooth, but the present invention is not limited to this. Communication may be performed by a wireless LAN such as WiFi, or may be infrared communication. If it is desired to reduce power consumption related to communication, the communication connection may be disconnected except when processing related to sales.

In the above embodiment, sales data is generated and transmitted to the register 4 when an order is placed. Not limited. The sales data may be collectively generated and transmitted to the register 4 after a plurality of order input operations are confirmed.

Also, the destination of the sales data relating to the order may not be limited to the register 4 . The sales data may be transmitted as the order data in accordance with the order receiving terminal device in the kitchen. That is, the generated and output sales data may be used not only for accounting processing, but also for preparing (cooking) and serving (serving) products. At this time, it may be possible to perform an input operation and a display operation indicating that the ordered product has already been provided to the customer, or alternatively, a paper order form may be printed out separately from the receipt. good too.
On the other hand, if it is used only for the purpose of accounting, regardless of the preparation of products and the provision of food and drinks, the sales data of the ordered (sold) products are collectively generated at the time of accounting, and registered in the register 4. information on the product and its price may be sent to the

Further, in the above-described embodiment, it is assumed that the salesclerk creates an order screen, actually operates the order, and performs accounting processing, but the present invention is not limited to this. The ordering operation may be made executable by installing an application on the order reception terminal or the user's terminal. In this case, instead of making unspecified terminals connectable to Bluetooth, they may be connected to the register 4 for communication via WiFi, 4G lines, 5G lines, or the like. Also, in this case, it is necessary to enter information that identifies the location of the customer, such as the seat number, when operating each terminal. A setting request is made, such as taking a picture with a camera and reading it.

In the above description, the storage unit 12 made up of a non-volatile memory such as a flash memory is used as an example of a computer-readable medium for storing the program 121 related to external setting control, sales setting control, etc. of the present invention. However, it is not limited to these. As other computer-readable media, it is possible to apply other non-volatile memories such as MRAM, HDDs (Hard Disk Drives), portable recording media such as CD-ROMs and DVD disks. A carrier wave is also applied to the present invention as a medium for providing program data according to the present invention via a communication line.
In addition, the specific configurations, contents and procedures of processing operations, etc. shown in the above embodiments can be changed as appropriate without departing from the scope of the present invention.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the embodiments described above, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims originally attached to the application form of this application is additionally described below. The claim numbers in the appendix are as in the claims originally attached to the filing of this application.

[Appendix]
<Claim 1>
Acquiring product image data including image data of specific information specifying a product and image data of the price of the product,
generating order reception image data including an operation button for accepting an order for the certain product based on the product image data;
generating product data in which the product represented by the operation button and the price of the product are associated with each other based on the product image data;
displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to receive the operation of the operation button;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
An information processing method for generating sales data of a certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed.
<Claim 2>
2. The information processing method according to claim 1, wherein in said order reception image, a portion where said specific information is displayed is said operation button.
<Claim 3>
Extracting the text part in the product image data,
3. The information processing method according to claim 1, wherein said specific information and said amount are set from said extracted text portion.
<Claim 4>
4. The information processing method according to any one of claims 1 to 3, further comprising transmitting sales data of the certain product to an external device by the first communication unit when it is determined that the operation has been performed.
<Claim 5>
The information processing method according to any one of claims 1 to 4, wherein the sales data of the certain product includes the specific information of the certain product.
<Claim 6>
The data of the order acceptance image includes a change button for accepting a premium or discount for the price of the certain product,
based on the product image data, generating change data that associates the certain product represented by the change button with a price premium or discount for the certain product;
If it is determined that the operation button and the change button have been operated, the sales data of the certain product is generated based on the product data and the change data of the certain product. or the information processing method according to item 1.
<Claim 7>
The product image data includes price change information related to the premium or discount of the product,
generating first order reception image data reflecting the price fluctuation information and second order reception image data not reflecting the price fluctuation information;
on the display screen based on the data of the first order reception image or the data of the second order reception image, depending on whether the discount indicated by the price change information or the discount application condition is satisfied The information processing method according to any one of claims 1 to 5, further comprising displaying the order acceptance image.
<Claim 8>
Acquiring product image data including image data of specific information specifying a product and image data of the price of the product,
generating order reception image data including an operation button for accepting an order for the certain product based on the product image data;
generating product data in which the product represented by the operation button and the price of the product are associated with each other based on the product image data;
displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to receive the operation of the operation button;
determining whether or not the operation button included in the order acceptance image displayed on the display screen has been operated;
An information processing apparatus comprising: a processing unit that generates sales data of a certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed.
<Claim 9>
the computer,
image acquisition means for acquiring product image data including image data of specific information for specifying a product and image data of the price of the product;
Image generating means for generating order reception image data including an operation button for accepting an order for the certain product, based on the product image data;
list data generating means for generating, based on the product image data, product data in which the product represented by the operation button and the price of the product are associated;
display control means for displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to accept the operation of the operation button;
operation determination means for determining whether or not the operation button included in the order acceptance image displayed on the display screen has been operated;
sales data generation means for generating sales data of the certain product based on the product data of the certain product when it is determined that the operation button has been operated;
A program that acts as a
<Claim 10>
an information processing apparatus according to claim 8;
a cash register comprising a second communication unit that communicates with the information processing device, and a control unit;
An information processing system comprising
The processing unit of the information processing device,
causing the first communication unit to transmit the sales data of the certain product to the cash register when it is determined that the operation has been performed;
The control unit of the cash register,
An information processing system that performs accounting processing including the sales data received via the second communication unit.

1 information processing device 11 CPU
12 storage unit 121 program 122 order reception image data 123 product list 13 display unit 14 operation reception unit 15 photographing unit 16 communication unit 4 register 41 CPU
42 storage unit 421 program 422 input setting 43 display unit 44 operation reception unit 46 communication unit 47 printing unit 48 paper transport unit 100 information processing system B1 to B3 selection operation buttons B4, B5 operation button C confirm button E selection end button M menu table O Order acceptance image T Subtotal button

Claims (10)

Acquiring product image data including image data of specific information specifying a product and image data of the price of the product,
generating order reception image data including an operation button for accepting an order for the certain product based on the product image data;
generating product data in which the product represented by the operation button and the price of the product are associated with each other based on the product image data;
displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to receive the operation of the operation button;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
An information processing method for generating sales data of a certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed. 2. The information processing method according to claim 1, wherein in said order reception image, a portion where said specific information is displayed is said operation button. Extracting the text part in the product image data,
3. The information processing method according to claim 1, wherein said specific information and said amount are set from said extracted text portion. 4. The information processing method according to any one of claims 1 to 3, further comprising transmitting sales data of the certain product to an external device by the first communication unit when it is determined that the operation has been performed. The information processing method according to any one of claims 1 to 4, wherein the sales data of the certain product includes the specific information of the certain product. The data of the order acceptance image includes a change button for accepting a premium or discount for the price of the certain product,
based on the product image data, generating change data that associates the certain product represented by the change button with a price premium or discount for the certain product;
If it is determined that the operation button and the change button have been operated, the sales data of the certain product is generated based on the product data and the change data of the certain product. or the information processing method according to item 1. The product image data includes price change information related to the premium or discount of the product,
generating first order reception image data reflecting the price fluctuation information and second order reception image data not reflecting the price fluctuation information;
on the display screen based on the data of the first order reception image or the data of the second order reception image, depending on whether the discount indicated by the price change information or the discount application condition is satisfied The information processing method according to any one of claims 1 to 5, further comprising displaying the order acceptance image. Acquiring product image data including image data of specific information specifying a product and image data of the price of the product,
generating order reception image data including an operation button for accepting an order for the certain product based on the product image data;
generating product data in which the product represented by the operation button and the price of the product are associated with each other based on the product image data;
displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to receive the operation of the operation button;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
An information processing apparatus comprising: a processing unit that generates sales data of a certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed. the computer,
image acquisition means for acquiring product image data including image data of specific information for specifying a product and image data of the price of the product;
Image generating means for generating order reception image data including an operation button for accepting an order for the certain product, based on the product image data;
list data generating means for generating, based on the product image data, product data in which the product represented by the operation button and the price of the product are associated;
display control means for displaying the order reception image corresponding to the data of the generated order reception image on a display screen so as to be able to accept the operation of the operation button;
operation determination means for determining whether or not the operation button included in the order acceptance image displayed on the display screen has been operated;
sales data generation means for generating sales data of the certain product based on the product data of the certain product when it is determined that the operation button has been operated;
A program that acts as a an information processing apparatus according to claim 8;
a cash register comprising a second communication unit that communicates with the information processing device, and a control unit;
An information processing system comprising
The processing unit of the information processing device,
causing the first communication unit to transmit the sales data of the certain product to the cash register when it is determined that the operation has been performed;
The control unit of the cash register,
An information processing system that performs accounting processing including the sales data received via the second communication unit.

Images