JP6098931B2 - Weight acquisition support device, weight acquisition method, program - Google Patents

Description

  The present invention relates to a weight acquisition support apparatus, a weight acquisition method, and a program for assisting in acquiring the weight of an object to be weighed.

  In recent years, with the spread of electronic balances that electrically measure weight, it is possible to accurately and easily obtain and record the weighing results of an object to be weighed simply by performing a simple weighing operation. In addition, for example, in Patent Document 1 below, the weight of a meal including a dish is measured before and after the meal, and the meal intake is automatically determined by subtracting the measurement result after the meal from the measurement result before the meal. The calculation technique is described.

Japanese Patent Laid-Open No. 11-161728

  However, the above technique is unsuitable when, for example, it is desired to know the weight of a dish finished as a dish (hereinafter referred to as a dish). That is, in order to know the weight of a dish, it is first necessary to measure the weight of a dish or the like on which the dish is to be served, and then to measure the weight of the same dish with the dish being served. In other words, despite knowing only the weight of the dish, at least two measurement operations are indispensable, and there is a problem that the measurement becomes complicated.

  The present invention has been made in view of such conventional problems, and a weight acquisition support apparatus and a weight acquisition method capable of accurately and easily acquiring a net weight of a weight acquisition object mixed in an object to be weighed. The purpose is to provide a program.

In order to solve the above-mentioned problem, in the present invention, for a plurality of objects, weight information storage means in which the weight and feature information on the appearance are stored in association with each other, the first object and the second object A first weight acquisition unit that acquires a total weight of an object to be weighed in a state where objects are mixed, and a captured image of the object to be measured in a state where the first object and the second object are mixed. And the second object in the photographed image of the object to be weighed acquired by the image acquisition means from the feature information on the appearance of the plurality of objects stored in the weight information storage means Is stored in advance in the weight information storage unit in association with the feature information on the appearance of the specific object that can be determined to match, and the feature information on the appearance of the specific object specified by the specification unit Get weight being Subtracting the weight of the specific object acquired by the second weight acquisition means from the total weight of the object to be measured acquired by the weight acquisition means of 2 and the first weight acquisition means, Weight calculating means for calculating a net weight of the first object, wherein the first object is a dish, and the second object is a container in which the dish is served, and unit weights of a plurality of dishes The calorie information storage means in which the amount of heat per shot and the captured image are stored in association with each other, and the captured image of the plurality of dishes stored in the calorie information storage means, acquired by the image acquisition means A second specifying means for specifying a photographed image of a specific dish that can be determined to match the dish in the photographed image of the object to be weighed, and a correspondence with the photographed image of the specific dish identified by the second identifying means; Before The first heat quantity acquisition means for acquiring the heat quantity per unit weight stored in advance in the heat quantity information storage means, and the net weight calculated by the weight calculation means are acquired by the first heat quantity acquisition means. And a second heat quantity acquisition means for acquiring the total heat quantity of the dish by multiplying the heat quantity .

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to acquire correctly and easily the net weight of the weight acquisition object mixed in a to-be-measured object.

It is an external appearance perspective view of the electronic kitchen scale which concerns on this invention. It is a block diagram of an electronic kitchen scale. It is a flowchart which shows the process sequence of a control part. It is a flowchart following FIG.

  Hereinafter, an embodiment of the present invention will be described. FIG. 1 is an external perspective view showing an electronic kitchen scale 1 having a function as a weight acquisition support device of the present invention.

  The electronic kitchen scale 1 of the present embodiment includes a weighing function as an electronic balance that electrically measures the weight of an arbitrary object to be measured, a net weight of a dish placed on a plate, and a calorie (calories) of the dish. ) Is automatically acquired.

  As shown in FIG. 1, the electronic kitchen scale 1 includes a scale main body 2 and a camera holding unit 4 fixed to the upper side of the scale main body 2 via support columns 3 and 3.

  An upper portion of the scale body 2 is provided with a weighing unit 5 on which a dish of objects to be weighed is placed, and a side portion of the scale body 2 is provided with a display unit 6 for displaying measurement results, a power switch, An operation unit 7 including a plurality of switches including a mode switch used for setting an operation mode is provided.

  The camera holding unit 4 is provided with a camera 8 for photographing the dish on which the weighing unit 5 is placed, located immediately above the center of the weighing unit 5. The shooting area of the camera 8 is set in advance over the entire weighing unit 5.

  FIG. 2 is a block diagram showing an outline of the electrical configuration of the electronic kitchen scale 1. The electronic kitchen scale 1 includes a control unit 11, a power supply unit 12, an electronic scale unit 13, a camera unit 14, a weight database 15, a calorie database 16, an image recognition engine 17, a weight calculation engine 18, a calorie calculation engine 19, and the display unit. 6 and the operation unit 7.

  The control unit 11 is realized by a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and other peripheral circuits, and the electronic kitchen is operated by the CPU operating according to a program stored in the ROM. Control scale 1.

  The power supply unit 12 is, for example, a rechargeable battery and a DC / DC converter, or a power supply circuit that adjusts the amount of electricity from a commercial power supply, and supplies power to each unit of the electronic kitchen scale 1.

  The electronic scale unit 13 includes a detector that detects the load applied to the weighing unit 5 of the scale body 2 by, for example, a load cell type or an electromagnetic type, and an A / D converter that converts the output signal of the detector into digital data. Is done. The electronic scale unit 13 measures the weight of the object placed on the weighing unit 5 and supplies the measurement result to the control unit 11.

The camera unit 14 is a part constituting the camera 8 and generates an image data based on an imaging signal output from the imaging device that captures an object to be measured via a photographing lens facing the weighing unit 5. And a plurality of stages of signal processing circuits. The image sensor is, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Meta 10xide Semiconductor) image sensor.
Then, the camera unit 14 supplies the generated image data, that is, the data of the captured image of the object to be measured to the control unit 11. Here, the object to be weighed is an arbitrary dish or a dish placed on the dish.

  The weight database 15 and the heat quantity database 16 are configured by a non-volatile semiconductor memory such as a flash memory or a storage medium such as a hard disk drive.

  In the weight database 15, image data of a large number of dishes whose weights are known and weight data of each dish are stored in association with each other. In the heat quantity database 16, image data of a large number of dishes and heat per unit weight of each dish (hereinafter referred to as unit heat quantity) data are stored in association with each other.

  The image recognition engine 17 includes an image processing processor, a work memory, and the like that perform various image recognition processes such as image binarization, contour extraction, pattern matching, and the like for a captured image of an object to be weighed.

  The image recognition engine 17 recognizes a dish, a dish part corresponding to the dish, or a dish part corresponding to the dish on the dish from the photographed image of the object to be weighed.

  Further, the image recognition engine 17 compares each of the images of a large number of dishes stored in the weight database 15 with the dish portion of the photographed image, and calculates the degree of coincidence of the features between the two. The image data of the same plate as the plate portion is searched, and the search result is supplied to the control unit 11.

  Further, the image recognition engine 17 compares each dish image stored in the calorie database 16 with the dish portion of the photographed image, and calculates the degree of coincidence of the features between the two dishes. The image data of the same dish as the portion is searched, and the search result is supplied to the control unit 11.

  The weight calculation engine 18 is based on the total weight of the object to be weighed supplied from the control unit 11 and the weight of the dish in the object to be weighed when the object to be weighed is a dish on the plate. The net weight of the dishes on the plate is calculated and the calculation result is supplied to the control unit 11.

  When the object to be weighed is a dish on a plate, the calorific value calculation engine 19 is arranged on the plate from the net weight of the dish supplied from the control unit 11 and the unit heat amount of the dish. The total amount of heat of the dish is calculated and the calculation result is supplied to the control unit 11.

  The display unit 6 includes a color liquid crystal panel fixed to the side of the scale body 2 and a drive circuit for the color liquid crystal panel, and displays characters and images based on character data and image data supplied from the control unit 11. To do.

  The operation unit 7 is realized by the plurality of switches described above and a detection circuit that detects an operation state of each switch by the user, and supplies operation information of each switch to the control unit 11.

  And in the electronic kitchen scale 1 provided with the above structure, normal mode and cooking measurement mode are prepared beforehand as operation mode.

  The normal mode is an operation mode for using a weighing function as a normal electronic scale, and is automatically set immediately after the user turns on the power.

  The dish measurement mode is an operation mode for automatically calculating the total calorie (calories) of dishes in the state of being placed on a plate or registering a photographed image and weight regarding a new plate in the weight database 15 described above. It is set as appropriate by the user's switch operation.

  Hereinafter, the operation of the electronic kitchen scale 1 when the dish measurement mode is set by the user will be described with reference to the flowcharts of FIGS. 3 and 4 showing the processing procedure of the control unit 11.

  As shown in FIG. 3, when the dish measurement mode is set, the control unit 11 first causes the user to set (select) whether the object to be photographed is a dish or a dish (step S1). Here, the dish is a dish placed on an arbitrary plate.

  Next, the control unit 11 causes the electronic scale unit 13 to measure the weight of the object to be weighed (step S2). With this processing, the control unit 11 immediately acquires the weight of the object to be weighed when the object is placed on the weighing unit 5 before the user sets the object to be imaged, and the user sets the object to be imaged. When the object to be weighed is placed on the weighing unit 5, the weight of the object to be weighed is acquired at that time.

  Next, when the weight of the object to be weighed can be acquired, the control unit 11 causes the camera unit 14 to take a photograph and obtains a photographed image of the object to be weighed (step S3).

  Thereafter, when the set object to be photographed (object to be weighed) is a dish (step S4: dish), the control unit 11 performs the processes of steps S5 to S12 described later, and when the object to be photographed is a dish. (Step S4: Cooking), the processing of Steps S13 to S30 described later shown in FIG. 4 is performed. Note that the determination of whether the subject to be photographed is a dish or a dish may be made based on a user operation, and the image recognition process described below can be used to determine whether the dish is to be recognized from the photographed image. Judgment is made if the portion of the edge that has low continuity with the handle or the color or shape of ingredients corresponding to a particular dish is included, otherwise it is a dish. You may make it determine automatically. In addition, when a dish recognized from the image is registered and the weight of the registered dish is different from the actually measured weight, it may be automatically determined that the dish is placed. .

  First, a case where the object to be photographed is a dish will be described. In this case, the control unit 11 sends the captured image data acquired in step S3 to the image recognition engine 17, and the image recognition engine 17 is subjected to a known image recognition technique including binarization and contour extraction. Is recognized (step S5).

  Furthermore, the control unit 11 causes the image recognition engine 17 to search for image data of a plate that can be determined to match the plate to be photographed from among a large number of image data stored in the weight database 15 (step S6). ).

  At this time, the image recognition engine 17 calculates the degree of coincidence of the features with the recognized dish portion for each of the images of the many dishes stored in the weight database 15 as described above. If there is image data for a dish that exceeds the specified level, the image data having the highest degree of coincidence is determined to be a dish that matches the dish to be photographed, and the record number indicating the data relating to that dish is displayed on the control unit. 11 is supplied. In addition, when there is no dish image data with a matching degree equal to or higher than the specified level, the image recognition engine 17 notifies the control unit 11 to that effect.

  When the image recognition engine 17 calculates the degree of coincidence of the features, for example, the degree of coincidence is acquired for a plurality of items such as the outer diameter shape of the dish, the size in the image, the hue, and the pattern, and An average value is calculated after weighting the degree of coincidence, and the final degree of coincidence is determined.

  And when the data regarding the plate | board which corresponds to the plate | board to be image | photographed do not exist in the weight database 15 (step S7: NO), the control part 11 is the image | photographed image acquired from step S3 (image which extracted only the plate | board part from the picked-up image). May be associated with the weight of the dish acquired in the process of step S2, and added to the weight database 15 as a new record (step S8). At that time, the control unit 11 causes the display unit 6 to display a message or the like informing the user that a new dish has been registered (not shown in FIG. 3). Thereby, the control part 11 complete | finishes a process.

  On the other hand, when the data relating to the dish to be photographed is present in the weight database 15 (step S7: YES), the control unit 11 determines the weight of the dish to be photographed and the weight of the dish acquired in the process of step S2. Is matched (step S9).

  Here, when both weights match (step S9: YES), the control unit 11 displays a message or the like on the display unit 6 informing the user that the dish to be imaged has already been registered. (Step S10), the process ends.

  If the weights of the two do not match (step S9: NO), the control unit 11 further determines whether or not to replace the registered weight of the pan to be photographed with the current measurement result. When the user is instructed by the operation and the replacement unnecessary is instructed (step S11: NO), the processing is ended as it is.

  On the other hand, when the user instructs replacement (step S11: YES), the control unit 11 replaces the weight of the pan to be imaged in the weight database 15 with the current measurement result (step S12), and then ends the process. To do.

  Therefore, the user can easily register a new dish in the weight database 15 or update the weight of a registered dish simply by setting a dish as an object to be photographed (object to be weighed) in the dish measurement mode. be able to.

  Next, after a photographed image of the object to be weighed is acquired in the process of step S3, when a dish is set as a photographing object by the user (step S4: dish), that is, a dish in which the photographed image is placed on a plate. A process in a case will be described.

  In this case, as shown in FIG. 4, the control unit 11 first sends the captured image data to the image recognition engine 17, and the image recognition engine 17 uses known image recognition techniques including binarization and contour extraction. The dish portion corresponding to the dish in the photographed image is recognized (step S13). In addition, the dish part recognized here is a part except the background part of the dish and the cooking part currently piled up on the dish among the picked-up images.

  Further, the control unit 11 causes the image recognition engine 17 to search the image data of the plate corresponding to the actual plate on which the dish is arranged from the image data of the plate registered in the weight database 15. More specifically, the image recognition engine 17 is made to search for image data including a region whose characteristics match the above-described dish portion from among a large number of dish image data stored in the weight database 15 (step S14). ).

  At this time, the image recognition engine 17 compares the image data of a large number of dishes stored in the weight database 15 with the above-described dish portion as described above, and determines the degree of coincidence of the features between the two. If there is image data with a degree of coincidence that exceeds the specified value, a record indicating that the dish with the largest degree of coincidence is a dish that matches the actual dish. The number is supplied to the control unit 11.

  The image recognition engine 17 notifies the control unit 11 when there is no image data with a matching degree equal to or higher than a specified level, and the matching level between the images is not higher than the specified level. For one or a plurality of image data that is equal to or greater than a predetermined value that can be determined to be approximate, a record number indicating data relating to the dish is supplied to the control unit 11.

  In the calculation of the degree of coincidence, the image recognition engine 17 also obtains the degree of coincidence for a plurality of items such as the outer diameter shape of the dish, the size in the image, the hue, the design, and the like. An average value is calculated after weighting, and the calculation result is used as the final matching degree.

  Then, when there is dish data that matches the dish to be imaged in the weight database 15 (step S15: YES), the control unit 11 acquires the weight of the dish from the weight database 15 (step S20).

  On the other hand, when there is no dish data that matches the dish to be photographed in the weight database 15 (step S15: NO), but there is dish data that can be determined to approximate (step S16: YES), the control unit 11 The following processing is performed.

  First, the control unit 11 reads the image data of one or a plurality of dishes that can be determined to be approximate (the degree of coincidence is a predetermined value or more) from the weight database 15, and lists the images of one or a plurality of dishes on the display unit 6. It is displayed (step S17). At this time, the control unit 11 causes the user to perform a predetermined switch operation so that the corresponding one corresponding to the actual dish is specified from among the displayed dishes, or corresponds to the actual dish in the displayed list. Instruct them that there is nothing to do.

  Here, when an arbitrary dish is designated by the user from the displayed dishes (step S18: YES), the control unit 11 acquires the weight of the designated dish from the weight database 15 (step S20). When there is an instruction that there is no corresponding item (step S18: NO), the control unit 11 ends the process at that time.

  Further, during the above processing, there is no dish data that matches the dish to be photographed in the weight database 15 (step S15: NO), and there is no dish data that can be determined to be approximate (step S16). : NO), the control unit 11 displays that the corresponding dish is not registered on the display unit 6 (step S19), and ends the process at that time.

  In addition, when there is no dish data that can be determined to be approximate, the dish portion occupies most of the entire area of the dish, for example, in addition to the case where the data corresponding to the dish is not registered. Including the case where the dish cannot be recognized. In such a case, the user may be made to search for the corresponding dish from all the dishes stored in the database without interrupting the process.

  Then, after acquiring the weight of the dish to be imaged in the process of step S20 described above, the control unit 11 continues to perform the following process.

  First, the control unit 11 causes the image recognition engine 17 to recognize the cooking portion in the above-described captured image by a known image recognition technique including binarization and contour extraction (step S21).

  Further, the control unit 11 causes the image recognition engine 17 to search for image data of a dish corresponding to the actual dish on the plate from among a plurality of dish image data stored in the calorific value database 16. . More specifically, the image recognition engine 17 is made to search for an image that can be determined to have the same characteristics as the above-described cooking portion from among a large number of cooking image data stored in the heat quantity database 16 (step S14).

  At this time, the image recognition engine 17 compares the image data of each of a large number of dishes stored in the calorific value database 16 with the above-mentioned dish portion as described above, and determines the degree of coincidence between the two features. If there is an image with a degree of coincidence that exceeds the specified value, the dish of the image data with the highest degree of coincidence is judged to be the dish that matches the actual dish, and the record number indicating the data related to that dish Is supplied to the control unit 11.

  Further, the image recognition engine 17 notifies the control unit 11 when there is no dish having a matching degree equal to or higher than a specified level, and the matching level between the images is not higher than the specified level. For one or a plurality of image data that is equal to or greater than a predetermined value that can be determined to be approximate, a record number indicating data relating to the dish is supplied to the control unit 11.

  In the above-described calculation of the degree of coincidence, the image recognition engine 17 obtains the degree of coincidence for a plurality of items such as a color histogram representing a color distribution and a brightness histogram, and weights the degree of coincidence for each item. The average value is calculated with and the calculated result is used as the final matching degree.

  And when the data of the cooking | cooking which corresponds to the imaging | photography of the imaging | photography object exist in the calorie | heat amount database 16 (step S23: YES), the control part 11 acquires the unit calorie | heat amount of the applicable dish from the calorie | heat amount database 16 (step S28).

  On the other hand, when there is no dish data that matches the dish to be photographed in the heat quantity database 16 (step S23: NO), but there is dish data that can be determined to approximate (step S24: YES), the control unit 11 The following processing is performed.

  First, the control unit 11 reads image data of one or more dishes that can be determined to be approximated (the degree of coincidence is equal to or greater than a predetermined value) from the calorific value database 16, and lists one or more images of the dishes on the display unit 6. It is displayed (step S25). At this time, the control unit 11 causes the user to perform a predetermined switch operation so that the list of dishes corresponding to the actual dish is designated, or the list of dishes displayed corresponds to the actual dish. Instruct them that there is nothing to do.

  Here, when an arbitrary dish is designated by the user from among the dishes displayed in the list (step S26: YES), the control unit 11 acquires a unit calorie of the designated dish from the calorie database 16 (step S28). . When there is an instruction that there is no corresponding item (step S26: NO), the control unit 11 ends the process at that time.

  Further, during the above processing, there is no dish data that matches the dish to be photographed in the calorie database 16 (step S23: NO), and there is no dish data that can be determined to be more approximate (step S24). : NO), the control unit 11 displays that the corresponding dish is not registered on the display unit 6 (step S27), and ends the process at that time.

  And after acquiring the unit calorie | heat amount from the calorie | heat amount database 16 by the process of step S28 mentioned above, the control part 11 calculates the weight (net weight) and the calorie | heat amount (total calorie | heat amount) for cooking, respectively (step S29). That is, the control unit 11 subtracts the weight of the dish acquired from the weight database 15 in the process of step S20 from the weight of the object to be weighed acquired in the process of step S2, that is, the total weight of the dish and the dish. Find the weight. Moreover, the control part 11 multiplies said unit calorie | heat amount to the weight of a dish, and acquires the total calorie | heat amount of a dish.

  Thereafter, the control unit 11 causes the calculated weight and heat amount of the dish to be displayed on the display unit 6 (step S30), thereby ending the process in the dish measurement mode.

  As described above, in the present embodiment, when the dish measurement mode is set, the weight is measured using the dish on the plate as the object to be weighed, while the object to be weighed is photographed. Obtained, searched the weight database 15 for an image of a specific dish that can be determined to match the dish portion of the acquired captured image, and acquired and acquired the weight of the specific dish stored corresponding to the corresponding image The net weight of the dish is obtained by subtracting the weight from the measurement result of the object to be weighed.

  Therefore, when the user wants to know the weight of the dish in the state of being served on the plate, the user simply puts the plate in that state on the weighing unit 5 and performs a very simple one-time measurement operation such as selecting the dish as a subject to be photographed. So, you can know the weight of cooking only accurately and easily.

  In addition, when a specific dish image that can be determined to match the dish portion of the photographed image cannot be retrieved in the weight database 15, a similar image is presented to the user as a candidate, and if there is a thing corresponding to the actual dish, The user is made to designate it, and the net weight of the dish is acquired using the dish of the designated image as the actual dish.

  At this time, for example, when the ratio of the area of the cooking portion to the whole area of the plate is high and an image of a specific plate cannot be searched in the weight database 15, if the plate portion is visible even a little, the user can select a candidate to select. You can narrow down. Therefore, even when the image of the specific dish that matches the actual dish cannot be searched in the weight database 15, the user only needs to perform the necessary and minimum operation, and more reliably without burdening the user. You can get the net weight of the dish.

  Moreover, in the dish measurement mode, when the weight of the dish placed on the plate is measured, photographing is automatically performed in response thereto. Therefore, no shooting operation is required in the measurement operation, and the weight of only the dish can be easily known.

  In addition, since the shooting area of the camera 8 is set in advance in the entire area of the weighing unit 5, a shot image suitable for cooking weighing can be obtained without placing a burden on the user such as setting the shooting area.

  Further, in the dish measurement mode, if a dish is selected as an object to be photographed while only the dish is placed in the weighing unit 5, an image and weight of an arbitrary dish are associated with each other and newly stored in the weight database 15. Therefore, the user can register a new dish in the weight database 15 by performing a very simple operation.

  Further, in the dish measurement mode, a specific dish image that can be determined to match the dish part image of the object to be weighed is searched in the calorific value database 16, and the unit calorie value of the specific dish stored in correspondence with the corresponding image. And the total amount of heat of the dish is acquired by multiplying the acquired amount of heat by the object to be weighed. Therefore, the user can easily know the total amount of heat of the dish at the same time as the weight of the dish in the state of being placed on the plate.

  In addition, when a specific dish image that can be determined to match the cooking portion of the captured image in the calorie database 15 cannot be searched, a similar image is presented to the user as a candidate, and if there is anything that corresponds to the actual dish, The user is made to designate it, and the dish of the designated image is used as an actual dish to acquire the total heat quantity of the dish. Therefore, the total calorie | heat amount of a dish can be acquired more reliably.

  In the present embodiment, for the sake of convenience, the description has been made on the assumption that the object to be weighed is a dish and a dish in a state of being served on the dish, but the object to be weighed is naturally a container other than a dish such as a bowl, and A dish in a container may be used. In that case, the captured image and the weight of the container other than the plate may be stored in advance in the weight database 15 in association with each other.

  Further, when a plurality of dishes on which dishes are arranged can be recognized from the photographed image of the object to be weighed, for example, the weight of each of the plurality of dishes is individually acquired from the weight database 15 and the weights are added. It is good also as a structure which acquires the total weight and total calorie | heat amount of all the dishes by subtracting a thing from the measurement result of a to-be-measured object.

  Here, in this embodiment, the case where this invention was implement | achieved in the electronic kitchen scale 1 which is a single apparatus was demonstrated. However, the present invention is not limited to this, and the present invention can also be realized by a system including a plurality of devices capable of transmitting and receiving data to and from each other regardless of wired or wireless communication.

  As an example of the above system, there is a system including an electronic scale capable of outputting measurement results to the outside, a digital camera, a mobile phone or a smartphone, and a server on the Internet, or a system in which the server is excluded from such a system. The digital camera can also be omitted if the digital camera is built in a mobile phone or a smartphone. In addition, there is a system consisting only of an electronic scale and a digital camera.

  In any system, USB (Universal Serial Bus), Bluetooth, or the like can be used for communication of weighing results (weight data) between the digital camera or mobile phone and the electronic balance. In addition, Wi-Fi or wireless LAN can be used for data communication between the mobile phone and the server.

  In a system including a server on the Internet, the present invention can be realized by a service on the Internet. In that case, if the server is provided with the weight database 15 and the calorie database 16 shown in FIG. 2 and the server realizes the image recognition engine 17, the weight calculation engine 18, and the calorie calculation engine 19, a higher level image can be obtained. Recognition processing is possible.

  Accordingly, it is possible to more accurately and quickly search for containers such as dishes and dishes in the weight database 15 and the calorie database 16, and as a result, the weight of dishes in the dish and the total The amount of heat can be acquired more accurately and at high speed.

  Further, the weight acquisition object (first object) in the present invention is not limited to the above-described dish, and may be any other object. For example, the weight acquisition object may be a human wearing clothes, and the present invention can also be applied to acquiring weight while wearing clothes.

  In this case, it is assumed that the electronic scale unit 13 described above has a measurement range that can be used as a weight scale, and the weight database 15 includes, for example, photographed images and weights of clothes purchased by the user or clothes already owned. Store them in association with each other.

  At the time of measurement, the weights of all the clothes that can be recognized from the photographed image are individually acquired from the weight database 15, and the final weight is acquired by subtracting the sum of those weights from the measurement result of the object to be weighed. What is necessary is just composition.

  As described above, if the present invention is applied to a weight scale constituted by a single device or system, a user can take a picture even if he / she is wearing a shirt or trousers only by being placed on the weight scale. It is possible to know the weight close to the actual weight excluding only the weight of clothes that can be recognized from the image.

As mentioned above, although embodiment of this invention and its modification were demonstrated, as long as these are in the range with which the effect of this invention is obtained, it can change suitably, and embodiment after change is also in a claim. It is included in the scope of the invention described and equivalent invention.
The invention described in the scope of the claims of the present application will be appended below.
[Claim 1]
A weight information storage means in which the weights of a plurality of objects and captured images are stored in association with each other, and a first weight for acquiring a total weight of the objects to be weighed in a state where the first object and the second object are mixed. A plurality of objects stored in the weight information storage unit; a weight acquisition unit; an image acquisition unit that acquires a captured image of the object to be weighed in a state where the first object and the second object are mixed; A specifying unit that specifies a captured image of a specific object that can be determined to match the second object in the captured image of the object to be weighed acquired by the image acquiring unit, and the specifying unit A second weight acquisition unit that acquires a weight stored in advance in the weight information storage unit in association with a photographed image of the specified specific object; and the target acquired by the first weight acquisition unit. From the total weight of the sample Wherein by obtained subtracting the weight of the particular object by second weight obtaining unit, weight obtaining assistance apparatus characterized by comprising a weight calculating means for calculating the net weight of the first object.
[Claim 2]
The first weight acquisition unit acquires a weight measured by a weighing unit that measures the weight of an arbitrary object, and the image acquisition unit captures an image captured by an imaging unit that captures a captured image of the arbitrary object. A weighing object for obtaining an image and obtaining a total weight by the first weight obtaining means, and a weighing object for obtaining a photographed image by the image obtaining means are the first object and the second object. The weight acquisition support apparatus according to claim 1, further comprising: a first control unit that controls a measurement operation by the weighing unit or a photographing operation by the imaging unit so that the same object to be weighed is included. .
[Claim 3]
The first control means controls to control the measurement operation by the measurement means or the photographing operation by the imaging means so that the measurement operation by the measurement means and the timing of the photographing operation by the imaging means are the same. 3. The weight acquisition support apparatus according to claim 2, wherein
[Claim 4]
In response to the total weight of the weighing object being measured by the weighing means, the first control means automatically takes a photographed image of the weighing object by the imaging means, or 4. The weight acquisition support apparatus according to claim 3, wherein the weighing means automatically measures the total weight of the object to be measured in response to the photographed image of the object being photographed by the imaging means. .
[Claim 5]
In response to the acquisition of the total weight of the object to be weighed by the first weight acquisition means and the acquisition of the weight of the specific object by the second weight acquisition means, the weight calculation means by the weight calculation means The weight acquisition support apparatus according to claim 1, further comprising second control means for calculating a net weight of the first object.
[Claim 6]
The weighing unit that functions as the weighing unit and places the weighing object on the measurement of the weight of the weighing object, and is provided integrally with the weighing unit that functions as the photographing unit. The weight acquisition support apparatus according to claim 2, further comprising: an imaging unit in which a predetermined range corresponding to the position and size is set as an imaging range.
[Claim 7]
It further comprises storage control means for storing the weight of an arbitrary object measured by the weighing means in the weight information storage means in association with the captured image of the arbitrary object acquired by the imaging means. The weight acquisition assistance apparatus in any one of Claims 1 thru | or 6.
[Claim 8]
The specifying unit recognizes a specific part corresponding to the second object from a photographed image of the object to be measured acquired by the image acquisition unit, and the recognized specific part is stored in the weight information storage unit. 8. The captured image of a specific object that can be determined to match the second object is identified by comparing with each of the captured images of a plurality of objects. Weight acquisition support device.
[Claim 9]
The first object is a dish, and the second object is a container in which the dish is served, and calorie information in which calorie per unit weight of a plurality of dishes and captured images are stored in association with each other. A specific dish that can be determined to match the dish in the photographed image of the object to be weighed acquired by the image acquiring means from among the photographed images of a plurality of dishes stored in the storage means and the calorie information storage means A second specifying means for specifying the photographed image of the image and an amount of heat per unit weight stored in advance in the heat quantity information storage means in association with the photographed image of the specific dish specified by the second specifying means The first calorie acquisition means for acquiring the total calorie of the dish by multiplying the net weight calculated by the weight calculation means by the calorie acquired by the first calorie acquisition means. Weight acquisition support apparatus according to any of the second of claims 1 to 8, further comprising a heat acquisition means for.
[Claim 10]
A step of obtaining a total weight of the object to be weighed in a state where the first object and the second object are mixed, and photographing of the object to be weighed in a state where the first object and the second object are mixed. A captured image of the object to be weighed out of the captured images of the plurality of objects stored in the weight information storage means in which the step of acquiring an image and the weights and captured images of the plurality of objects are stored in association with each other in advance. Identifying a captured image of a specific object that can be determined to be coincident with the second object, and acquiring a weight stored in the weight information storage means in association with the captured image of the specific object; And a step of calculating a net weight of the first object by subtracting a weight of the specific object from a total weight of the object to be weighed.
[Claim 11]
The computer obtains the total weight of the object to be weighed in a state where the first object and the second object are mixed, and the object to be weighed in the state where the first object and the second object are mixed. The object to be weighed is selected from among a plurality of object photographic images stored in weight information storage means in which a process for obtaining a photographic image of an object and the weights of the plurality of objects and the photographic images are stored in association with each other. Processing for identifying a captured image of a specific object that can be determined to match the second object in the captured image of the image, and acquiring the weight stored in the weight information storage unit in association with the captured image of the specific object And a process for obtaining a net weight of the first object by subtracting a weight of the specific object from a total weight of the object to be weighed.

DESCRIPTION OF SYMBOLS 1 Kitchen scale 2 Scale main body 3 Support | pillar 4 Camera holding part 5 Weighing part 6 Display part 7 Operation part 8 Camera 11 Control part 12 Power supply part 13 Electronic scale part 14 Camera part 15 Weight database 16 Calorimetric database 17 Image recognition engine 18 Weight calculation engine 19 Calorie calculation engine

Claims (10)

For a plurality of objects, weight information storage means in which the weight and feature information on the appearance are stored in association with each other in advance,
First weight acquisition means for acquiring a total weight of an object to be weighed in a state where the first object and the second object are mixed;
Image acquisition means for acquiring a captured image of the object to be weighed in a state where the first object and the second object are mixed;
A specification that can be determined to match the second object in the photographed image of the object to be weighed acquired by the image acquisition unit from the feature information on the appearance of the plurality of objects stored in the weight information storage unit Identifying means for identifying feature information on the appearance of the object,
Second weight acquisition means for acquiring a weight stored in advance in the weight information storage means in association with feature information on the appearance of the specific object specified by the specification means;
The net weight of the first object is obtained by subtracting the weight of the specific object acquired by the second weight acquisition means from the total weight of the object to be measured acquired by the first weight acquisition means. and a weight calculating means for calculating,
The first object is a dish, and the second object is a dish with the dish;
A calorie information storage means in which calorific values per unit weight of a plurality of dishes and captured images are stored in association with each other,
A photographed image of a specific dish that can be determined to match the dish in the photographed image of the object to be weighed acquired by the image acquisition means from among the photographed images of the plurality of dishes stored in the calorific value information storage means. A second identifying means for identifying;
First heat quantity acquisition means for acquiring a heat amount per unit weight stored in advance in the heat quantity information storage means in association with a photographed image of the specific dish specified by the second specification means;
Second heat quantity acquisition means for acquiring the total heat quantity of the dish by multiplying the net weight calculated by the weight calculation means by the heat quantity acquired by the first heat quantity acquisition means;
A weight acquisition support apparatus , further comprising: The first weight acquisition means acquires the weight measured by the weighing means for measuring the weight of an arbitrary object,
The image acquisition means acquires a photographed image photographed by a photographing means for photographing an arbitrary object,
The object to be weighed for obtaining the total weight by the first weight obtaining means and the object to be weighed for obtaining the photographed image by the image obtaining means include the same object including the first object and the second object. The weight acquisition support apparatus according to claim 1, further comprising a first control unit that controls a measurement operation by the weighing unit or a photographing operation by the photographing unit so as to be a weighing object.   The first control means controls to control the measuring operation by the measuring means or the photographing operation by the photographing means so that the timing of the measuring operation by the measuring means is the same as the timing of the photographing operation by the photographing means. 3. The weight acquisition support apparatus according to claim 2, wherein   In response to the total weight of the weighing object being measured by the weighing means, the first control means causes the photographing means to automatically take a photographed image of the weighing object, or 4. The weight acquisition support apparatus according to claim 3, wherein a total weight of the weighing object is automatically measured by the weighing means in response to a photographed image of the weighing object being taken by the photographing means. .   In response to the acquisition of the total weight of the object to be weighed by the first weight acquisition means and the acquisition of the weight of the specific object by the second weight acquisition means, the weight calculation means by the weight calculation means The weight acquisition support apparatus according to claim 1, further comprising second control means for calculating a net weight of the first object. A weighing unit that functions as the weighing means and places the object to be weighed when measuring the weight of the object to be weighed;
An imaging unit that functions as the imaging unit, is provided integrally with the weighing unit, and has a predetermined range according to the position and size of the weighing unit as an imaging range;
Weight acquisition support apparatus according to any one of claims 2 to 4, further comprising a.   A photographed image of an arbitrary object acquired by the photographing means is used as characteristic information on the appearance of the object, and the photographed image and the weight of the object measured by the weighing means are associated with each other and stored in the weight information storage means. The weight acquisition support apparatus according to claim 1, further comprising storage control means for causing the storage control means to operate.   The specifying unit recognizes a specific part corresponding to the second object from a photographed image of the object to be measured acquired by the image acquisition unit, and the recognized specific part is stored in the weight information storage unit. 8. The feature information on the appearance of a specific object that can be determined to match the second object is identified by comparison with each of the feature information on the appearance of a plurality of objects. The weight acquisition assistance apparatus in any one of. Obtaining a total weight of an object to be weighed in a state where the first object and the second object are mixed;
Obtaining a captured image of the object to be weighed in a state where the first object and the second object are mixed;
Photographing the object to be weighed from the feature information on the appearance of the plurality of objects stored in the weight information storage means in which the weight and the feature information on the appearance are stored in association with each other in advance. Identifying feature information on the appearance of a particular object that can be determined to match the second object in the image;
Obtaining a weight stored in the weight information storage means in association with feature information on the appearance of the specific object;
By subtracting the weight of the particular object from the total weight of the objects to be weighed, seen including a step of calculating the net weight of the first object,
The first object is a dish, and the second object is a dish with the dish;
The dish in the photographed image of the object to be weighed out of the photographed images of the plurality of dishes stored in the calorie information storage means in which the amount of heat per unit weight of the dishes and the photographed image are stored in association with each other. Identifying a shot image of a particular dish that can be determined to match
Obtaining a calorie per unit weight stored in the calorie information storage means in association with the photographed image of the specific dish;
Obtaining the total calorific value of the dish by multiplying the net weight by the calorific value; and
Further weight acquisition support method comprising including Mukoto a. On the computer,
Processing for obtaining the total weight of the objects to be weighed in a state where the first object and the second object are mixed;
Processing for obtaining a captured image of the object to be weighed in a state where the first object and the second object are mixed;
Photographing the object to be weighed from the feature information on the appearance of the plurality of objects stored in the weight information storage means in which the weight and the feature information on the appearance are stored in association with each other in advance. A process of identifying feature information on the appearance of a specific object that can be determined to match the second object in the image;
A process of acquiring the weight stored in the weight information storage means in association with the feature information on the appearance of the specific object;
Obtaining a net weight of the first object by subtracting the weight of the specific object from the total weight of the object to be weighed ,
The first object is a dish, and the second object is a dish with the dish;
The dish in the photographed image of the object to be weighed out of the photographed images of the plurality of dishes stored in the calorie information storage means in which the amount of heat per unit weight of the dishes and the photographed image are stored in association with each other. Processing to identify a shot image of a specific dish that can be determined to match
A process of acquiring the amount of heat per unit weight stored in the heat amount information storage means in association with the photographed image of the specific dish;
A process for obtaining a total heat value of the dish by multiplying the net weight by the heat value;
Program characterized Rukoto further execute a.

Images