JP2016177755A - Order terminal equipment, order system, customer information generation method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide order terminal equipment, an order system, a customer information generation method, and a program capable of easily acquiring customer information such as an age group.SOLUTION: Order terminal equipment 1 includes: a learning result storage part 2; an image acquisition part 3; an age/sex estimation part 4; and a customer information generation part 5. The learning result storage part 2 stores learning result data about the feature information of a face image of each predetermined age group and sex. The image acquisition part 3 acquires the face image of a customer sitting in a seating position. An age/sex estimation part 4 compares the feature information of the face image of the customer acquired by the image acquisition part 3 with feature information stored in the learning result storage part 2 to estimate the age group and sex of the customer. The customer information generation part 5 generates customer information indicating the age group and sex of the customer on the basis of the age group and sex estimated by the age/sex estimation part 4.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an order terminal device, an order system, a customer information generation method, and a program, and more particularly to an order terminal device, an order system, a customer information generation method, and a program for generating customer information from an image.

  For example, in an environment where a product or service is provided to a customer such as a restaurant, it is important in marketing or the like to understand what customers are visiting. As a method for acquiring customer information such as a customer's age group, for example, a method in which a customer is presented with a membership card or a human resource such as a store clerk is conventionally used. However, in the case of a membership card, information cannot be obtained for customers who do not have a membership card, and there is a problem in terms of reliability and cost in the case of manual acquisition.

  By the way, in recent years, an order terminal device for receiving an order from a customer has been developed (Patent Document 1). The order terminal device described in Patent Literature 1 discloses that when a customer places an order, the customer's face photo is taken by a camera and the received order and photo are stored.

  Also, a technique described in Patent Document 2 is known as a technique for identifying a person from a captured image. In the technique described in Patent Document 2, a partial image including a face is extracted from a captured image, and a person in the captured image is identified by pattern matching between the extracted partial image and a separately acquired face image. Japanese Patent Laid-Open No. 2004-228561 discloses that when identifying, gender, age, occupation, and the like are estimated from an image, and the person is identified more accurately by using the estimation result.

JP 2004-206375 A JP 2002-305717 A

However, the techniques described in Patent Document 1 and Patent Document 2 cannot acquire customer information such as age groups.
The present invention has been made to solve such a problem, and provides an order terminal device, an order system, a customer information generation method, and a program capable of easily acquiring customer information such as an age group. There is.

  The ordering terminal device according to the present invention acquires learning result storage means for storing learning result data on feature information of face images for each predetermined age group and gender, and acquires a face image of a customer seated at a sitting position. Comparing the feature information of the face image of the customer acquired by the image acquisition means and the image acquisition means with the feature information stored in the learning result storage means to estimate the age group and sex of the customer An estimation unit; and a customer information generation unit configured to generate customer information indicating the age group and sex of the customer based on the age group and the gender estimated by the age-gender estimation unit.

  In addition, the order system according to the present invention acquires learning result storage means for storing learning result data about feature information of face images for each predetermined age group and gender, and acquires face images of customers seated at the sitting position. Comparing the feature information of the face image of the customer acquired by the image acquisition means and the image acquisition means with the feature information stored in the learning result storage means to estimate the age group and gender of the customer Gender estimating means, and customer information generating means for generating customer information indicating the age group and sex of the customer based on the age group and gender estimated by the age gender estimating means.

  Further, the customer information generation method according to the present invention includes an image acquisition step of acquiring a face image of a customer seated at a seating position, and feature information of the acquired face image of the customer using a predetermined age group and gender. An age-gender estimation step for estimating the age group and gender of the customer in comparison with the learning result data for the feature information of each facial image, and based on the estimated age group and gender, A customer information generation step for generating customer information indicating gender.

  Further, the program according to the present invention includes an image acquisition step of acquiring a face image of a customer seated at a sitting position, and feature information of the acquired face image of the customer according to a predetermined age group and face for each gender. Compared with the learning result data about the image feature information, the age and sex estimation step for estimating the age and sex of the customer, and the age and sex of the customer based on the estimated age and sex The computer executes a customer information generation step for generating customer information.

  ADVANTAGE OF THE INVENTION According to this invention, the order terminal device which can acquire customer information, such as an age group, an order system, a customer information generation method, and a program can be provided.

It is a figure which shows the outline | summary of the order terminal device concerning embodiment. It is a figure which shows the structure of the order system concerning embodiment. It is a perspective view which shows the external appearance of the order terminal device concerning embodiment. It is a figure which shows the hardware constitutions of the order terminal device main body concerning embodiment. It is a top view which shows typically an example of the imaging range of a camera in case the order terminal device concerning embodiment is prepared with respect to the table. It is a top view which shows typically an example of the imaging range of a camera when the order terminal device concerning embodiment is prepared with respect to the counter. It is a functional block diagram of the order terminal device concerning an embodiment. It is a flowchart which shows an example of the operation | movement regarding the production | generation process of the customer information in the order terminal device concerning embodiment.

(Outline of the embodiment of the present invention)
Prior to the description of the embodiment, an outline of the embodiment according to the present invention will be described. FIG. 1 is a diagram showing an outline of an order terminal device 1 according to an embodiment of the present invention. The order terminal device 1 includes a learning result storage unit 2, an image acquisition unit 3, an age / sex estimation unit 4, and a customer information generation unit 5.

The learning result storage unit 2 stores learning result data regarding the feature information of the face image for each predetermined age group and gender. The image acquisition unit 3 acquires the face image of the customer seated at the sitting position. The age and gender estimation unit 4 compares the feature information of the customer's face image acquired by the image acquisition unit 3 with the feature information stored in the learning result storage unit 2 to estimate the age group and sex of the customer. The customer information generation unit 5 generates customer information indicating the customer's age group and gender based on the age group and gender estimated by the age and gender estimation unit 4.
Therefore, according to such an order terminal device 1, an age group and sex are automatically estimated from a customer's image, and customer information based on an estimation result is generated. Therefore, according to the order terminal device 1, customer information such as an age group can be easily acquired.

(Embodiment 1)
Embodiments of the present invention will be described below with reference to the drawings. FIG. 2 is a diagram illustrating a configuration of the order system 10. As shown in FIG. 2, the order system 10 includes one or more order terminal devices 100 and an information collection server 200. The order terminal device 100 and the information collection server 200 are connected to each other via the network 300.

  The network 300 is a communication network (communication line) such as a LAN (Local Area Network) or the Internet, for example, and can be used when the order terminal device 100 and the information collection server 200 communicate with each other. In the present embodiment, the network 300 is a wireless communication network, but may be a wired communication network.

  The information collection server 200 is configured by a computer, for example. The information collection server 200 may be configured by a single computer, but need not be physically single, and may be configured by a plurality of distributed computers. The information collection server 200 collects, for example, order information and customer information transmitted from the order terminal device 100.

  The order terminal device 100 is a terminal device used when a customer orders a product or service by self-service. For example, the order terminal device 100 is prepared for each table and accepts an order from a customer seated at a seating position such as a chair arranged beside the table. Further, for example, the order terminal device 100 is prepared at a counter and accepts an order of a customer seated at a seating position such as a chair arranged along the counter. For example, the order terminal device 100 may be used at a restaurant such as a pub, or may be used at a karaoke shop or the like.

  FIG. 3 is a perspective view showing an external appearance of the order terminal device 100. FIG. 4 is a diagram illustrating a hardware configuration of the order terminal device main body 110.

  As shown in FIG. 3, the order terminal device 100 includes an order terminal device main body 110 and a cradle 120. The order terminal apparatus main body 110 includes a camera 111, a touch panel 112, a speaker 113, and an antenna 114. Further, the order terminal device main body 110 has a function as a computer, and includes a control unit 115 such as a CPU (Central Processing Unit) and a storage unit 116 such as a memory or a hard disk (see FIG. 4).

  The cradle 120 is a pedestal that removably supports the order terminal device main body 110. The cradle 120 is connected to, for example, an AC power supply via a power cable 130 and supplies power to the order terminal device main body 110 while the order terminal device main body 110 is mounted. Do not charge the battery. For this reason, the order terminal device 100 can accept orders from customers regardless of whether or not the order terminal device main body 110 is mounted on the cradle 120. Note that the cradle 120 may be further connected to a wired LAN and provided with a wired communication function.

  The camera 111 is a digital camera including a lens, a solid-state imaging device such as a CCD (Charge Coupled Device) sensor and a CMOS (Complementary Metal Oxide Semiconductor). In the present embodiment, the camera 111 is built in the order terminal apparatus main body 110, but may be built in the cradle 120 or may be externally attached to the order terminal apparatus 100.

  The camera 111 is provided so that the face of the customer seated at the seating position is the imaging range. In the present embodiment, in particular, the camera 111 is provided so that a plurality of customers' faces seated at a plurality of seating positions are set as an imaging range. Specifically, in this embodiment, the camera 111 is provided on the front side of the order terminal device main body 110, that is, the same surface as the surface on which the touch panel 112 is provided, and the order terminal device main body 110 is mounted on the cradle 120. When this is done, the faces of a plurality of customers seated at a plurality of seating positions are set as the imaging range. For this reason, the camera 111 can simultaneously image a plurality of customer faces. In addition, the camera 111 may be provided so that the face of one customer sitting at one seating position is set as the imaging range.

  More specifically, for example, when the order terminal device 100 is prepared for a table, the camera 111 is seated on all sides of the table with the order terminal device main body 110 mounted on the cradle 120. The position of all customer faces assumed when the customer is seated at the position is defined as an imaging range. FIG. 5 is a plan view schematically showing an example of an imaging range of the camera 111 when the order terminal device 100 is prepared for the table 500. In FIG. 5, the hatched area is an example of the imaging range of the camera 111. In the example shown in FIG. 5, the camera 111 images the face of the customer 502 in the store seated on a chair 501 provided beside the table 500 from the lateral direction of the customer 502. In the example shown in FIG. 5, the imaging range of the camera 111 includes all the seating positions on the side of the table 500, but not necessarily all the seating positions on the side of the table. The position of the face that is assumed when a customer is seated at each of a plurality of seating positions within a predetermined range may be set as the imaging range.

  Further, for example, when the order terminal device 100 is prepared for the counter, the camera 111 has one or more seats arranged along the counter in a state where the order terminal device main body 110 is mounted on the cradle 120. The face position assumed when the customer is seated at the position is defined as an imaging range. FIG. 6 is a plan view schematically showing an example of the imaging range of the camera 111 when the order terminal device 100 is prepared for the counter 600. In FIG. 6, the hatched area is an example of the imaging range of the camera 111. In the example illustrated in FIG. 6, the camera 111 captures the face of the customer 602 of the store seated on the chair 601 disposed along the counter 600 from the front of the customer 602.

  As described above, in the present embodiment, the imaging range of the camera 111 includes one or more customers' faces sitting on a table such as a table or a counter. When the camera 111 sets the customer's face as the imaging range, the order terminal device main body 110 does not necessarily have to be mounted on the cradle 120. In other words, the camera 111 only needs to set the face of the customer sitting at the sitting position as the imaging range in a state where the order terminal device 100 is installed at a predetermined location. For example, when the order terminal device 100 does not have the cradle 120 and the order terminal device 100 is fixed to a wall or the like, the camera 111 may set the customer's face as the imaging range at the fixed installation location. Therefore, although the order terminal device 100 is disposed at the end of the table 500 or the counter 600 in FIGS. 5 and 6, the order terminal device 100 may not necessarily be on the table 500 or the counter 600. It may be arranged on a nearby wall or table.

  The touch panel 112 is provided on the front surface of the order terminal device main body 110, displays information, and accepts an operation input from a customer. The touch panel 112 displays, for example, options for products or services provided by stores such as menus. The touch panel 112 receives, for example, an operation input (order operation) for selecting an option to be ordered from among product or service options. The speaker 113 outputs various audio signals such as voice guidance as sound. The antenna 114 is an antenna for the ordering terminal device main body 110 to perform wireless communication. For example, the antenna 114 transmits and receives signals to and from the information collection server 200.

  FIG. 7 is a functional block diagram of the order terminal device 100 according to the embodiment. The order terminal device 100 includes a learning result storage unit 151, a presentation information storage unit 152, an image acquisition unit 153, an age and sex estimation unit 154, a customer information generation unit 155, an information output unit 156, and an order reception unit 157. And a customer information transmission unit 158.

  Note that the image acquisition unit 153, the age and gender estimation unit 154, the customer information generation unit 155, the information output unit 156, the order reception unit 157, and the customer information transmission unit 158 cause the program to be executed under the control of the control unit 115, for example. Can be realized. More specifically, the program stored in the storage unit 116 is executed by being controlled by the control unit 115. In addition, each component is not limited to being realized by software by a program, but may be realized by any combination of hardware, firmware, and software. In addition, the learning result storage unit 151 and the presentation information storage unit 152 are realized by the storage unit 116, for example.

  The learning result storage unit 151 stores learning result data regarding the feature information of the face image for each predetermined age group and sex. The predetermined age groups are, for example, teens, 20s, 30s, 40s, 50s, 60 units, 70s, 80s, 90s, and the like. That is, the learning result data includes, for example, learning results data for teenage men, learning result data for teenage women, learning result data for men in their twenties, learning result data for women in their twenties, etc. It becomes data of. The age group may be set more finely or may be set more roughly. Moreover, the age ranges of the respective age groups may be different, such as 20 years old or less, 20 to 50 years old, 50 years old or more. Moreover, the age range of each age group may be one year old. The feature information is information about any feature of the face, such as information about wrinkles on the face and information about relative positions of face components such as eyes, nose, and mouth.

  The learning result data is data indicating feature information of face images for each predetermined age group and sex, which is learned by machine learning, for example. The learning result storage unit 151 stores, for example, data indicating feature information obtained by machine learning using facial image data of a plurality of persons whose gender and age group are known as teacher data. It is stored as learning result data about the feature information of the face image. The number of teacher data is determined according to the accuracy required for estimation. For example, the higher the estimation accuracy, the more face image data is used in machine learning to obtain learning result data.

  The presentation information storage unit 152 stores information to be presented to the customer. For example, the presentation information storage unit 152 stores information about products or services provided by stores or the like such as menu information.

  The image acquisition unit 153 acquires a customer face image captured by the camera 111. That is, the image acquisition unit 153 acquires the face image of the customer seated at the sitting position. Here, when the customer is seated at each of the plurality of seating positions, the image acquisition unit 153 acquires the face images of the plurality of customers seated at the plurality of seating positions. For example, the image acquisition unit 153 may acquire face images of a plurality of customers seated at a counter seat or may acquire face images of a plurality of customers seated at a table seat. The face image is an image including a customer's face portion. The image acquisition unit 153 outputs the acquired face image to the age and sex estimation unit 154. Note that, for example, the image acquisition unit 153 extracts an image including a customer's face portion from images output from the camera 111 using a known face recognition process, and cuts out an area including the customer's face portion. The image is output to the age gender estimation unit 154.

  The age and sex estimation unit 154 estimates the customer's age group and sex from the face image acquired by the image acquisition unit 153. Specifically, the age gender estimation unit 154 compares the feature information of the customer's face image acquired by the image acquisition unit 153 with the feature information stored in the learning result storage unit 151, and compares the age group and gender of the customer. Is estimated. For example, the age and gender estimation unit 154 determines which of the feature information for each age group and sex the facial image feature information acquired by the image acquisition unit 153 is the closest to is stored in the learning result storage unit 151. The age group and gender associated with the feature information determined to be the closest are estimated as the customer's age group and gender. Here, particularly when a customer is seated at each of a plurality of seating positions, the age and gender estimation unit 154 estimates the age group and gender of each of the plurality of customers.

  In the present embodiment, the age and sex estimation unit 154 repeats the estimation of the customer's age group and sex for a predetermined period. In addition, the age and gender estimation unit 154 calculates a final estimation result from a plurality of estimation results obtained repeatedly during a predetermined period, and notifies the customer information generation unit 155 of it. The start time of the predetermined period is, for example, the seating timing of the customer. Note that the seating timing may be given to the ordering terminal device 100 by an operation input to the touch panel 112 such as a store clerk, or seating may be determined by image recognition processing on an image captured by the camera 111. Further, the end time of the predetermined period may be, for example, the elapse of a predetermined time from the start time, or the settlement timing of the provided product or service. The start time and the end time of the predetermined period are not limited to these, and any time can be set. For example, the age and sex estimation unit 154 may calculate an average value or a mode value as a final estimation result. That is, the age-gender estimating unit 154 may set an average of a plurality of age groups estimated for a certain customer as the age group of the customer. Moreover, the age sex estimation part 154 is good also considering the mode value about the some sex estimated about a certain customer as the sex of the said customer. Thus, since the final estimation result is determined from a plurality of estimation results obtained by repeated estimation, it can be expected to improve the estimation accuracy.

  The age and gender estimation unit 154 may use a customer's face image that is within a predetermined distance from the ordering terminal device 100 among the customer's face images acquired by the image acquisition unit 153 as an estimation target. Specifically, for example, the age and gender estimation unit 154 estimates only the faces included in the face image acquired by the image acquisition unit 153 and whose size is included in a predetermined size range. And That is, when the size of the face is equal to or smaller than the predetermined size, it may be regarded as being a predetermined distance or more away from the camera 111 and excluded from the estimation target. By limiting the estimation target in this way, it is possible to prevent the customer information from being erroneously generated for a person who exists in the background of the customer who is the customer information generation target and is not the customer information generation target.

  The customer information generation unit 155 generates customer information indicating at least the age group and sex of the customer based on the age group and sex estimated by the age / sex estimation unit 154. Here, when a customer is seated at each of a plurality of seating positions, the customer information generated by the customer information generation unit 155 includes information for specifying a group. The information for specifying the group includes, for example, information indicating the number of people constituting the group.

  Therefore, when the image acquisition unit 153 acquires face images of a plurality of customers seated at a plurality of seating positions, the customer information generation unit 155 is estimated by the age and gender estimation unit 154 with these plurality of customers as one group. Based on the age group and gender, customer information indicating the number, age group and gender of the people making up this group is generated. That is, in this case, the customer information generation unit 155 generates information indicating the number of groups and the age group and sex of each person making up the group.

  For example, when the image acquisition unit 153 acquires face images of a plurality of customers sitting on a table seat, the customer information generation unit 155 determines each customer indicated by the acquired face image as one group, and identifies the group The above information is generated. Further, for example, when the image acquisition unit 153 acquires face images of a plurality of customers sitting at a counter seat, the customer information generation unit 155 determines each customer indicated by the acquired face image as one group, and the group The above-described information that identifies the above is generated.

Here, the customer information generation unit 155 selects, among a plurality of customers, customers who satisfy a predetermined condition for the face orientation indicated in the face image acquired by the image acquisition unit 153 as a customer constituting one group. Customer information may be generated. For example, in the case of a counter seat, all the persons included in the image acquired by the image acquisition unit 153 are not necessarily the same group. Here, it is assumed that customers in the same group have a conversation. Then, when a customer has a conversation with another customer of the same group, it is assumed that the customer faces his / her other customer. That is, for example, during a predetermined period, it is assumed that a group customer has a higher frequency of facing a customer of the same group than a frequency of facing a group customer or an individual customer. Therefore, for example, the customer information generation unit 155 may confirm the orientation of the customer's face during a predetermined period, and may specify the customers that make up the group among the customers indicated in the image acquired by the image acquisition unit 153. By doing in this way, even if it is a case where the image of the customer other than the customer of the same group is contained in the image acquired by the image acquisition part 153, the information which specifies a group appropriately can be produced | generated.
For example, the order terminal device 100 may be arranged so that the camera 111 captures only the customers in the same group when the customer visits the store.

  The information output unit 156 outputs information stored in the presentation information storage unit 152. The information output unit 156 may display and output information on the touch panel 112 or may output sound to the speaker 113. Moreover, the information output part 156 may output the information selected based on the customer information which the customer information generation part 155 produced | generated. That is, for example, the information output unit 156 may output a recommended menu corresponding to the customer's age group or gender indicated in the customer information.

  The order receiving unit 157 receives orders from customers. Specifically, the order receiving unit 157 receives an order by a customer operation input via a touch panel. For example, the customer performs an ordering operation for a desired product or service by performing a selection operation on a product or service option displayed on the touch panel 112.

  The customer information transmission unit 158 transmits the customer information generated by the customer information generation unit 155 to the information collection server 200. The customer information transmission unit 158 may transmit the customer information in association with the order received by the order reception unit 157.

  Next, the operation of the order terminal device 100 will be described for the customer information generation process. FIG. 8 is a flowchart illustrating an example of an operation related to the customer information generation process in the order terminal device 100.

  In step 10 (S10), the control unit 115 determines whether or not the customer information generation process start condition is satisfied. If the start condition is satisfied, the process proceeds to step 11. If the start condition is not satisfied, step 10 is repeated. The start condition is, for example, the seating of the customer. Note that the determination in step 10 corresponds to the determination of the start time of a predetermined period in which the estimation by the age sex estimation unit 154 described above is performed.

In step 11 (S11), the control unit 115 causes the camera 111 to start imaging. In step 12 (S12), the image acquisition unit 153 acquires the customer's face image captured by the camera 111.
Next, in step 13 (S13), the age and sex estimation unit 154 estimates the age group and sex of the customer from the face image acquired by the image acquisition unit 153.

  Next, in step 14 (S14), the control unit 115 determines whether or not the estimation process end condition is satisfied. When the end condition is satisfied, the process proceeds to step 15, and when the end condition is not satisfied, the process returns to step 12. The termination condition may be, for example, that a predetermined time has elapsed since it was determined to be Yes in Step 10, or a settlement timing of a provided product or service. Note that the determination in step 14 corresponds to the determination of the end time of a predetermined period in which the estimation by the age sex estimation unit 154 described above is performed.

  In step 15 (S15), the control unit 115 causes the camera 111 to finish imaging. In step 16 (S16), the age and sex estimation unit 154 determines the final estimation result. Thereafter, in step 17 (S17), the customer information generation unit 155 generates customer information based on the estimation result in step 16.

  Thus, according to the order terminal device 100 of the present embodiment, customer information indicating the customer's age group and gender can be automatically generated. Therefore, according to the order terminal device 100, customer information can be easily acquired. Moreover, according to the order terminal device 100, customer information can be generated as a group customer for the group customer. For this reason, more useful customer information in marketing etc. can be acquired. As described above, in the order terminal device 100 of the present embodiment, the customer information of each customer constituting the group is obtained from the face images of a plurality of customers seated at a plurality of seating positions acquired by the image acquisition unit 153. Is generated. For this reason, for example, even when all the group customers do not operate the order terminal device 100 during the order operation, customer information of each customer constituting the group can be generated.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and can be modified as appropriate without departing from the spirit of the present invention. For example, in the above-described embodiment, the estimation process is performed using a face image. However, the estimation process may be performed based on a body image including a face without being limited to the face image. In this case, for example, the learning result storage unit 151 stores learning result data regarding feature information of a body image including a face for each predetermined age group and sex. The image acquisition unit 153 acquires a body image including the customer's face. Moreover, the age sex estimation part 154 estimates the customer's age group and sex by comparing the feature information of the body image acquired by the image acquisition part 153 with the feature information stored in the learning result storage part 151. In this way, by making the image used for estimation a body image, the contour of the customer's posture and height, clothes, etc. can be used as feature information for estimation, so improvement in estimation accuracy is expected. it can.

  Further, in the above-described embodiment, the order terminal device has been described as including each configuration illustrated in FIG. 1 or FIG. 7, but a part of the configuration may be included in another device such as the information collection server 200. Good. That is, the order system including the order terminal device may include each configuration shown in FIG. 1 or FIG.

  Further, the present invention is not limited to an order terminal device, and may be applied to various automatic reception terminals such as a kiosk terminal.

  The program can be stored using various types of non-transitory computer readable media and supplied to a computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W and semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

DESCRIPTION OF SYMBOLS 1,100 Order terminal device 2 Learning result storage part 3 Image acquisition part 4 Age sex estimation part 5 Customer information generation part 10 Order system 110 Order terminal apparatus main body 111 Camera 112 Touch panel 113 Speaker 114 Antenna 115 Control part 116 Storage part 120 Cradle 130 Power cable 151 Learning result storage unit 152 Presentation information storage unit 153 Image acquisition unit 154 Age and gender estimation unit 155 Customer information generation unit 156 Information output unit 157 Order reception unit 158 Customer information transmission unit 200 Information collection server 300 Network

Claims (12)

Learning result storage means for storing learning result data on feature information of face images for each predetermined age group and gender;
Image acquisition means for acquiring a face image of the customer seated at the sitting position;
Comparing the feature information of the customer's face image acquired by the image acquisition means with the feature information stored in the learning result storage means, and age and sex estimation means for estimating the age group and sex of the customer;
An ordering terminal device comprising: customer information generating means for generating customer information indicating the age group and sex of the customer based on the age group and gender estimated by the age sex estimating means. The image acquisition means acquires face images of a plurality of customers seated at a plurality of seating positions,
The age gender estimating means estimates the age group and gender of each of the plurality of customers,
The customer information generating means includes the plurality of customers as one group, and a customer indicating the number, age group, and gender of people constituting the group based on the age group and sex estimated by the age-sex-estimating means. The order terminal device according to claim 1 which generates information. The customer information generation unit is configured to select, as a customer constituting one group, a customer who satisfies a predetermined orientation of the face direction indicated in the face image acquired by the image acquisition unit among the plurality of customers. The order terminal device according to claim 2 which generates information. The order terminal according to any one of claims 1 to 3, wherein the age and gender estimation means repeats estimation of the customer's age group and sex for a predetermined period, and calculates a final estimation result from a plurality of estimation results. apparatus. 5. The age-sex-estimating means targets a customer face image existing within a predetermined distance among the face images of the customer acquired by the image acquisition means. The order terminal device according to the item. The order terminal device according to claim 1, further comprising: an information output unit that outputs information selected based on customer information generated by the customer information generation unit. The learning result storage means stores learning result data about feature information of a body image including a face for each predetermined age group and gender,
The image acquisition means acquires a body image including a customer's face,
The age gender estimating means estimates the age group and gender of the customer by comparing the feature information of the body image acquired by the image acquisition means with the feature information stored in the learning result storage means. 7. The order terminal device according to any one of items 6 to 6. The order terminal device according to any one of claims 1 to 7, wherein the image acquisition unit acquires a face image of a customer sitting at a counter seat. The order terminal device according to claim 1, wherein the image acquisition unit acquires a face image of a customer sitting at a table seat. Learning result storage means for storing learning result data on feature information of face images for each predetermined age group and gender;
Image acquisition means for acquiring a face image of the customer seated at the sitting position;
Comparing the feature information of the customer's face image acquired by the image acquisition means with the feature information stored in the learning result storage means, and age and sex estimation means for estimating the age group and sex of the customer;
An order system comprising: customer information generation means for generating customer information indicating the age group and sex of the customer based on the age group and gender estimated by the age sex estimation unit. An image acquisition step of acquiring a face image of the customer seated at the sitting position;
Compare the acquired feature information of the customer's face image with learning result data on the feature information of the face image for each predetermined age group and gender, and estimate the age group and sex of the customer An estimation step;
A customer information generation method including: a customer information generation step of generating customer information indicating the age group and sex of the customer based on the estimated age group and sex. An image acquisition step of acquiring a face image of the customer seated at the sitting position;
Compare the acquired feature information of the customer's face image with learning result data on the feature information of the face image for each predetermined age group and gender, and estimate the age group and sex of the customer An estimation step;
A program for causing a computer to execute a customer information generation step of generating customer information indicating the age group and sex of the customer based on the estimated age group and sex.

Images