CN108665134A - Device and method for monitoring food preparation - Google Patents
Device and method for monitoring food preparation Download PDFInfo
- Publication number
- CN108665134A CN108665134A CN201710596762.6A CN201710596762A CN108665134A CN 108665134 A CN108665134 A CN 108665134A CN 201710596762 A CN201710596762 A CN 201710596762A CN 108665134 A CN108665134 A CN 108665134A
- Authority
- CN
- China
- Prior art keywords
- food
- data
- preparation
- image
- received
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 235000013305 food Nutrition 0.000 title claims abstract description 149
- 238000002360 preparation method Methods 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012544 monitoring process Methods 0.000 title claims abstract description 19
- 239000002994 raw material Substances 0.000 claims description 22
- 238000009826 distribution Methods 0.000 claims description 11
- 238000009529 body temperature measurement Methods 0.000 claims description 9
- 230000000050 nutritive effect Effects 0.000 claims description 8
- 230000003595 spectral effect Effects 0.000 claims description 8
- 238000003860 storage Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 3
- 239000004744 fabric Substances 0.000 claims 1
- 238000004519 manufacturing process Methods 0.000 claims 1
- 235000013550 pizza Nutrition 0.000 description 19
- 230000015654 memory Effects 0.000 description 16
- 238000001228 spectrum Methods 0.000 description 15
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 235000015220 hamburgers Nutrition 0.000 description 6
- 235000013351 cheese Nutrition 0.000 description 5
- 244000291564 Allium cepa Species 0.000 description 4
- 235000002732 Allium cepa var. cepa Nutrition 0.000 description 4
- 235000021189 garnishes Nutrition 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 239000000126 substance Substances 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 235000021110 pickles Nutrition 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 235000015067 sauces Nutrition 0.000 description 2
- 235000013580 sausages Nutrition 0.000 description 2
- 235000001674 Agaricus brunnescens Nutrition 0.000 description 1
- 241000972773 Aulopiformes Species 0.000 description 1
- 244000106835 Bindesalat Species 0.000 description 1
- 235000000318 Bindesalat Nutrition 0.000 description 1
- 235000007688 Lycopersicon esculentum Nutrition 0.000 description 1
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- 235000004348 Perilla frutescens Nutrition 0.000 description 1
- 244000124853 Perilla frutescens Species 0.000 description 1
- 240000003768 Solanum lycopersicum Species 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- -1 carbon water Compound Chemical class 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 235000013575 mashed potatoes Nutrition 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 210000000653 nervous system Anatomy 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 235000019515 salmon Nutrition 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/02—Food
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- A—HUMAN NECESSITIES
- A21—BAKING; EDIBLE DOUGHS
- A21D—TREATMENT, e.g. PRESERVATION, OF FLOUR OR DOUGH, e.g. BY ADDITION OF MATERIALS; BAKING; BAKERY PRODUCTS; PRESERVATION THEREOF
- A21D13/00—Finished or partly finished bakery products
- A21D13/40—Products characterised by the type, form or use
- A21D13/41—Pizzas
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
- G01K13/00—Thermometers specially adapted for specific purposes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
- G01K13/00—Thermometers specially adapted for specific purposes
- G01K13/10—Thermometers specially adapted for specific purposes for measuring temperature within piled or stacked materials
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/12—Hotels or restaurants
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01K—MEASURING TEMPERATURE; MEASURING QUANTITY OF HEAT; THERMALLY-SENSITIVE ELEMENTS NOT OTHERWISE PROVIDED FOR
- G01K2207/00—Application of thermometers in household appliances
- G01K2207/02—Application of thermometers in household appliances for measuring food temperature
- G01K2207/06—Application of thermometers in household appliances for measuring food temperature for preparation purposes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N2021/8472—Investigation of composite materials
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
- G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Food Science & Technology (AREA)
- Theoretical Computer Science (AREA)
- Human Resources & Organizations (AREA)
- General Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Pathology (AREA)
- Tourism & Hospitality (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- General Business, Economics & Management (AREA)
- Medicinal Chemistry (AREA)
- Educational Administration (AREA)
- Entrepreneurship & Innovation (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Primary Health Care (AREA)
- Game Theory and Decision Science (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- General Preparation And Processing Of Foods (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Analysis (AREA)
Abstract
Disclose the device and method for monitoring food preparation.The device may include imager and controller.Controller can be configured as executing the method having steps of:Receive the relevant data of order;The image of food is received from imager;Data based on the pre-stored received from database analyze the image received, to extract the product data of preparation;The product data for the preparation extracted are compared with the relevant data of order;And the accordance of food and required quality level is determined based on the comparison of the product data of the preparation to being extracted and the relevant data of order.
Description
Cross reference to related applications
This application claims in submission on March 29th, 2017 and entitled " APPARATUS AND METHOD FOR QUALITY
The U.S. Provisional Patent Application the 62/478,050th of CONTROL OF A PREPARATION OF A FOOD PRODUCT "
Equity, in being hereby incorporated by reference in its entirety by reference.
Background of invention
Nowadays the quality control of food is also by professional's (for example, cook) even if in large commercial kitchen
It is checked manually to complete.However, the inspection of people, for most experienced professional person, and it is subjective and can
Can be inconsistent.In addition, when the food (for example, pizza) for verifying supply includes the raw material of all orders, human eye may
It is too slow and inaccurate, and may be not enough to timely and accurately determine that order is correctly prepared.
In addition, preparing important some aspects (such as, temperature) for monitoring and controlling entire food can not pass through
The inspection of people carrys out correct assessment in real time.
Therefore, it is necessary to the fast and accurately automation equipments and method for monitoring food preparation.
Summary of the invention
The device and method that the embodiment of the present invention can relate to the quality control for food and prepare monitoring.Such as it is eating
The food prepared in the Room or restaurant chain mechanism kitchen can be checked automatically, to find out food whether by what client provided ordered by basis
Singly prepare.Device may include imager and controller.Controller can be configured as executing the method having steps of:It receives
The relevant data of order;The image of food is received from imager;Data based on the pre-stored received from database are to being received
To image analyzed, to extract the product data of preparation;The product data for the preparation extracted and order are relevant
Data are compared;And determine the accordance of food and required quality level based on this comparison.
In some embodiments, the data presorted may include the preparation extracted from the image of the food previously checked
Product data.In some embodiments, the relevant data of order may include at least one of the following:The type of food is being eaten
The distribution of visible one or more raw material and at least one raw material on food on product.
In some embodiments, analysis is carried out to the image received to may include in the product data for the preparation extracted
It is at least one during identification is following:The type of food, the visible one or more raw material and at least one on the surface of food
Distribution of the kind raw material on the surface of food.
In some embodiments, controller is also configured to:Receive the multiple images of food;It is extracted from each image
The product data of preparation;Receive the relevant data of corresponding order about each image;Receive the quality about each image
It is horizontal;And it will be about the product data for the preparation of each image extracted and the relevant data of corresponding order and quality
Horizontal storage is in the database.
In some embodiments, determine that the accordance of food and required quality level may include determining extracted system
Whether standby product data, which indicate the product, has the quality for being higher than scheduled quality level.
In some embodiments, device may also include thermometer, and controller is also configured to:Receive the temperature of food
Spend measurement result;And wherein, it is required and also to determine whether the food has based on the temperature measurement result received
Quality.
In some embodiments, device may also include spectrometer, and controller is also configured to:It is received from spectrometer
Data related with the spectrum of food;And also determine that the food is based on the relevant data of frequency spectrum with food received
It is no that there is required quality.In some embodiments, the description of food further includes ripe degree, and with the spectrum phase of food
The data of pass may indicate that ripe degree.In some embodiments, the description of food may also include nutritive value, the spectrum with food
Relevant data may indicate that nutritive value of food.
Brief description
About subject of the present invention, it is highlighted and is distinctly claimed in the conclusion part of specification.So
And when being read together with attached drawing, by reference to described in detail below, can best about the tissue of operation and method and its
Objects, features and advantages understand the present invention, in the accompanying drawings:
Figure 1A is the schematic diagram of the device for monitoring food preparation according to some embodiments of the present invention;
Figure 1B is the diagram of the device for monitoring food preparation according to some embodiments of the present invention;
Fig. 2 is the flow chart for the method that according to some embodiments of the present invention prepared by monitoring food;And
Fig. 3 be according to some embodiments of the present invention in method prepared by monitoring food for collecting pre-stored data
Additional step flow chart.
It should be appreciated that in order to illustrate it is simple and clear, element shown in figure is not drawn necessarily to scale.For example, being
For the sake of clear, the size of some elements can be amplified relative to other elements.In addition, in the case where being deemed appropriate, it is attached
Icon note can be repeated in figure with the corresponding or similar element of instruction.
The detailed description of the present invention
In the following detailed description, numerous specific details are set forth in order to provide thorough understanding of the present invention.However, this
Field technology personnel will be understood that, can put into practice the present invention without these specific details.In other examples, not having
Well-known method, regulation and component, module, unit and/or circuit are described in detail, so as not to obscure this hair
It is bright.According to some features described in one embodiment or element can with according to feature described in other embodiment or element knot
It closes.For the sake of clarity, it may not repeat that same or similar feature or element are discussed.
Although embodiments of the present invention are not limited thereto, such as " processing ", " calculating (computing) ", " meter are used
The discussion of the term of calculation (calculating) ", " determination ", " foundation ", " analysis ", " verification " etc. can refer to the operation of computer
And/or process, computing platform, computing system or other electronic computing devices, manipulate the register in computer and/or storage
Be expressed as in device physics (for example, electronics) amount data and/or transform it into computer register and/or memory or
Person, which can store, similar in other information non-transitory storage medium of the instruction to execute operation and/or process is expressed as physical quantity
Other data.Although embodiments of the present invention are not limited thereto, term " multiple (plurality) " used herein and
" multiple (a plurality) " may include such as " multiple (multiple) " or " two or more ".Throughout the specification
Term " multiple (plurality) " or " multiple (a plurality) " can be used to come to two or more components, equipment, member
Part, unit, parameter etc. are described.In addition, some in described embodiment of the method or its element can be at same time point
Or occurs or be performed simultaneously simultaneously.
The embodiment of the present invention can relate to the device and method for monitoring food preparation.Such as in dining room or food chain kitchen
The food prepared in room can be checked automatically, to find out whether food prepares according to the order provided by client.For example, can be certainly
It is dynamic to check the pizza come out from oven, to check it is whether uniformly and appropriate whether dough is baked to correct degree, cheese
Ground is spread and whether dispensing matches (for example, 1/2 peperoni, 1/2 onion) with the order of client.Show again another
In example, device according to some embodiments of the present invention can check hamburger food automatically, to verify the correct (example of hamburger size
Such as, 300 grams), reach correctly ripe degree, be added to correct sauce and provide correct garnishes with it.
In some embodiments, food (for example, pizza, hamburger, sushi etc.) can be placed in a device, to examine
It looks into food and prepares quality.Except the regular meaning for preparing quality unless a term, within the scope of the application, " preparing quality " can refer to
The amount of product, the freshness of product, the placement order of product, the color of product, nutritive value and temperature.The device may include into
As device, it is configured to shoot at least one image of prepared food.In some embodiments, which may also include all
Such as the additional sensor of thermometer, spectrometer and/or graduation apparatus.Equipment may also include controller, can be configured as from temperature
Meter, spectrometer and/or graduation apparatus receive at least one image, measurement result are optionally can receive, to determine the quality of food.
A referring now to fig. 1 is the signal of the device for monitoring food preparation according to some embodiments of the present invention
Figure.Device 100 may include at least one imager 105, controller 110, database 120 and user interface 130.Device 100 is also
It may include communication unit 140, thermometer 107 and/or spectrometer 109.Device 100 can be via communication unit 140 and user equipment
10 are communicated.In some embodiments, imager 105 can be the imager of user equipment 10.User equipment 10 can be
Smart phone, tablet computer, laptop computer etc..
In some embodiments, imager 105 can be integrated into the special imager of device 100.105 (quilt of imager
Including in apparatus 10 or in device 100) capture images can be configured as and send the image to appointing for controller 110
What optical device, camera etc..
Thermometer 107 can be configured as any temperature meter of the temperature of instrument, for example, thermometer may include heat
Galvanic couple.The temperature measurement result of food can be sent to controller 110 by thermometer 107.
Spectrometer 109 may include to be configured as measuring food according to from the spectrum (for example, in IR frequency spectrums) that food receives
Any equipment of the attribute of product.Attribute may include the food that may cause that nutritive value of food is identified temperature and
Chemical composition/combination.Spectrometer 109 can will be sent to the relevant data of results of spectral measurements (for example, frequency spectrum and/or attribute)
Controller 110.
Controller 110 (for example, server) can be or may include that processor 112, the processor can be for example central
Processing unit (CPU), chip, calculating based on cloud service or any suitable computing device or calculating operation application apparatus, behaviour
Make system 114 and memory 116.Processor 112 can be configured as being stored in depositing for such as memory 116 for example, by executing
Instruction in reservoir executes method according to an embodiment of the invention.Processor 112 can be configured as executing according to the present invention
Some embodiments monitoring food prepare method.
Operating system 114 can be or may include any code segment, be designed and/or be configured to execute to be related to controller
110 following task:Coordination, scheduling, arbitration, supervision, control or the management of other modes operate, for example, the scheduling of program.Behaviour
It can be commercial operating systems to make system 114.Memory 116 can be or may include memory for example based on cloud, deposit at random
Access to memory (RAM), read-only memory (ROM), dynamic ram (DRAM), synchronous dram (SD-RAM), double data rate (DDR)
Memory chip, flash memory, volatile memory, nonvolatile memory, cache memory, buffer, short-term storage
Unit, long term memory unit or other suitable memory cells or storage element.Memory 116 can be or may include
Multiple memory cells, they can be identical or different.
Memory 116 can store any executable code, for example, application program, program, process, task or script.It can hold
Line code may include for monitor food preparation code or for executing any of method according to an embodiment of the invention
Other codes or instruction.Executable code can be executed by the processor 112 that may be controlled by operating system 114.
Database 120 can be or may include that for example hard drive, disk drive, CD (CD) driving, CD are recordable
(CD-R) driving, universal serial bus (USB) equipment or other suitable removable and/or fixed storage elements.In addition or
Alternatively, database 120 may include any store-service based on cloud.Content can be stored in database 120, and can
To be loaded into the memory 116 that can be handled it by processor 112 from database 120.For example, reality according to the present invention
Apply example, database 120 may include image, temperature measurement result, spectrum and the product data for the preparation extracted of food with
And the corresponding relevant data of order and prepare quality level.
User interface 130 can be or may include screen, touch screen or palm PC, mouse, keyboard etc..User interface
130 may include audio frequency apparatus, such as one or more loud speakers, earphone, printer and/or any other suitable equipment.
Communication unit 140 can be configured as in the other assemblies of controller 110 and device 100 (for example, imager 105, temperature
Degree meter 107, spectrometer 109 etc.) between communicated, and communicated with user equipment 10.Communication unit 140 may include having
Line or wireless network interface card (NIC), modem etc..In addition, any applicable input/output (I/O) equipment can be straight
It is connected to controller 110 in succession, or via communication unit 140 or for example hard via universal serial bus (USB) equipment or outside
Driving etc. is connected to controller.
B referring now to fig. 1 is the example of the device for monitoring food preparation according to some embodiments of the present invention
Diagram.Device 100 may include for holding meanss 100 at least some components (for example, imager 105, thermometer 107 and/
Or spectrometer 109) shell 102.Shell 102 is also configured to receive the food 20 (for example, pizza) for inspection, and
And it may include the surface for receiving food 20 or pallet.In some embodiments, device 100 may also include tested for illuminating
The light source 104 for the food 20 looked into.Shell 102 can also keep light source 104 so that the light from light source 104 is directed toward food
20.In some embodiments, shell 102 can holding meanss 100 add-on assemble, for example, communication unit 140 (not shown).Separately
Outside, shell 102 may also include the retainer (not shown) for keeping user equipment 10.Retainer is designed to keep user
Equipment 10 so that the imager of user equipment 10 can be directed toward the surface of food 20, to allow imager to capture food
20 image.In some embodiments, shell 102 may also include one or more optical lenses 103, be used to further gather
The visual field of the imager of burnt user equipment 10 is simultaneously conducted towards the examined food 20 being placed on pallet 108.
Referring now to Fig. 2, it is the flow chart of method prepared by monitoring food according to some embodiments of the present invention.Figure
2 method can automatically be executed by the processor 112 of equipment 100 or by any other processor.Operation 210 in, can for example by
Processor 112 receives the relevant data of order.The relevant data of order may include all data required by preparing food, example
Such as, the type (for example, pizza, sushi, hamburger etc.) of food, (mushroom, salmon, Italy are peppery for visible raw material on food
Sausage, double cheese etc.), at least one raw material being distributed on food, ripe degree (for example, medium, half-mature, well done etc.),
It garnishs food (for example, chips, rice etc.) etc..The relevant data of order can connect from the database of food provider (for example, restaurant)
It receives, from the computer equipment real-time reception of the employee operations by supplier, is received from user equipment (for example, working as by internet
When user orders service using online food) etc..
In operation 220, the image of food (for example, food 20) can be from imager (for example, imager 105 or user set
Standby 10 imager) it receives.The food 10 of preparation, which can be placed in shell 102, to be checked so that at least one imager
105 and/or the imager of user equipment 10 can shoot one or more images of food 20.
In operation 230, the data of the pre-stored received from database (for example, database 120) can be based on to being received
Image analyzed, to extract the product data of preparation.Image can be subjected to any image procossing as known in the art.
For example, (for example, may operate on user equipment 10) depth convolutional neural networks algorithm can be used to identify one
Or more capture image in food 20 (for example, pizza).In another example, based on each pixel to image
Analysis, full convolutional network algorithm can be applied to identification details, such as dispensing.In another example again, nervous system type pass-algorithm
(neural style transfer algorithm) can be applied to enhancing image texture and product image made to be more readily understood.
Processed image can be compared with the data of pre-stored, and the data of the pre-stored may include from previously having checked
The product data for the preparation extracted in the image of food.The identification of the relevant data of product can be generated by comparing.For example, controller can
By by the image of full convolutional network algorithm process with previously stored through handle image be compared, wherein the warp previously stored
Processing image includes small details (such as, the example associated with product data in the image completed using full convolutional network algorithm
Such as, dispensing) identification.The method that the data for collecting pre-stored are disclosed in Fig. 3.In some embodiments, compare and allow
At least one of the following is identified in the product data for the preparation extracted:It is the type of food, visible on the surface of food
The distribution of one or more of raw materials and at least one raw material on the surface of food.
In operation 240, the product data for the preparation extracted can be compared with the relevant data of order, to check food
Whether product include correct food type, if the amount of the raw material of all orders and distribution are abundant.For example, if order product is ocean
Green onion peperoni pizza then compares and may verify whether to prepare correctly to measure to the onion peperoni pizza
Onion with distribution and peperoni.In another example, if order includes tomato, romaine lettuce but not with pickle again
With 200 grams of the hamburger that mashed potatoes is garnishes, then compares and can verify that whether institute's raw material in need is included in product, and
It is mistakenly added without other raw materials (for example, pickle).
In operation 250, the accordance of food and required preparation quality level can be determined based on comparing.Herein
Used term " preparing quality " may include meeting for use in it is to be supplied/be conveyed to client food one group of preparation
Parameter.For example, preparation parameter may include temperature range residing for product to be supplied, the color/texture of various raw materials (for example,
The color of dough, the freshness of vegetables, the color of cheese, color of chips etc.), the amount of various raw materials and distribution etc..One
In a little embodiments, if the product data for the preparation extracted show that product is not prepared according to order, food can be marked
It is denoted as " not having required quality level ".However, if the product data for the preparation extracted show that food is correctly made
Standby, the product data that extracted preparation may be used carry out additional monitoring.
In some embodiments, the data of pre-stored may include processed image (product data for the preparation extracted)
Being associated with (for example, one group of preparation parameter) between required preparation quality level.Therefore, it is carried from the product image received
The product data of the preparation taken can be compared with the product data of the preparation of the extraction of pre-stored, to check whether the product has
There is required quality level.In some embodiments, it may be determined that more than two quality levels are (that is, than only enough/deficiency
It is more horizontal).
In some embodiments, it may be determined that three quality levels are insufficient, enough and almost enough.For example, if food reaches
To insufficient quality level, then product can not be provided, if food reaches enough quality level, food can be provided, and
If food reaches quality level " almost enough ", the human reviewer whether food can be can be provided that by can determine food
(for example, cook) further checks.
In some embodiments, quality level may include the quality level for the different attribute for distributing to food.For example, Piza
The quality level of cake may include the area coverage of cheese, the color of dough, the coverage area of sauce, the amount of garnishes and distribution etc..
In some embodiments, each attribute can be given with quality level, and the quality level of food can be based on the matter of each attribute
Amount level calculates.In some embodiments, each attribute can be given to distribute with different weights, and calculates and may include giving often
Weight of a attribute quality level to distribute.For example, the coverage area of cheese can be given with weight more higher than the distribution of garnishes.
In some embodiments, the temperature measurement result of food can be from temperature sensor/thermometer (for example, thermometer
107) it receives.In some embodiments, food and the accordance (in operation 250) of required quality level can also be based on temperature
Measurement result is spent to determine.For example, the temperature of pizza can be measured and with for provide/convey the required temperature of pizza into
Row compares.If temperature is too low (for example, pizza may be by cold conveying), the pizza can be reheated or abandoned.
In some embodiments, it can be received from spectrometer 109 with the relevant data of the frequency spectrum of food.For example, with frequency spectrum phase
The attribute that the data of pass may include frequency spectrum and/or be extracted from frequency spectrum, such as temperature, chemical composition, chemical bonding, nutritive value
Deng.In some embodiments, the accordance (in operation 250) of food and required quality level can also be based on being received
It is determined with the relevant data of frequency spectrum.The frequency spectrum received may indicate that the temperature of food product, therefore can for example determine hamburger
Or the ripe degree of beefsteak.In some embodiments, frequency spectrum may indicate that nutritive value of food, such as protein, fat, carbon water
Compound etc..
Referring now to Fig. 3, be according to some embodiments of the present invention in method prepared by monitoring food for receiving
Collect the flow chart of the additional step of the data of pre-stored.The step of Fig. 3, can hold by processor 102 or by any other processor
Row.In operation 310, the multiple images of food can be for example received from the imager of imager 105 or user equipment 10.It can be more
The multiple images of food are shot during the preparation of a food.For example, multiple images may include image below:Various types Piza
Cake, various types of sushis, various types of wheaten food etc..
In operation 320, can for example using identical image processing method disclosed above by the product data of preparation from
It is extracted in each image.
In operation 330, can for example it be received from user equipment or database related about the corresponding order of each image
Data.
In operation 340, the quality level about each image can be received from user equipment and/or user interface.For example,
Professional (for example, cook) can determine that the quality level of each food in present multiple images, and user can be used to set
Identified quality level is uploaded to controller 110 by standby or user interface.
It, can will be about the product data for the preparation of each image extracted and corresponding order phase in operation 350
The data and quality level of pass are stored in database (for example, database 120).Database 120 may include relevant with order
The look-up table of the product data and quality level of associated the extracted preparation of data.For example, look-up table may include using " Piza
The relevant data of order of cake "+" peperoni " and the quality level (for example, insufficient) of the pizza is given from preparation
Pizza peperoni image in the data extracted.Look-up table may include using " pizza "+" peperoni "
The relevant data of order and given additional pizza quality level (for example, enough) from pizza Italy of additional preparation
The data of the image zooming-out of peppery sausage.Therefore, the data extracted in the image of the slave pizza peperoni in operation 230
It can be compared with the data for being stored extraction in the database, whether to check prepared peperoni pizza
With enough quality level.
Although certain features of the present invention have been illustrated and described herein, those of ordinary skill in the art will expect
Many modifications, replacement, change and equivalent.It will thus be appreciated that appended claims, which are intended to covering, falls into the true of the present invention
All such modifications and changes in spirit.
Claims (19)
1. a kind of device for monitoring food preparation, including:
At least one imager;And
Controller, the controller are configured as:
Receive the relevant data of order;
The image of the food is received from least one imager;
Data based on the pre-stored received from database analyze the image received, to extract the product number of preparation
According to;
The product data for the preparation extracted are compared with the relevant data of the order;And
The comparison of product data and the relevant data of the order based on the preparation to being extracted, determines the food and is wanted
The accordance for the quality level asked.
2. device as described in claim 1, wherein the data presorted include being carried from the image of the food previously checked
The product data of the preparation taken.
3. device as described in claim 1, wherein the relevant data of order include at least one of the following:It is described
The type of food, point of visible one or more raw material and at least one raw material on the food on the food
Cloth.
4. device as described in claim 1, wherein carry out the production that analysis is included in extracted preparation to the image received
It is at least one in below being identified in product data:The type of the food, the visible one or more on the surface of the food
The distribution of kind raw material and at least one raw material on the surface of the food.
5. device as described in claim 1, wherein the controller is additionally configured to:
Receive the multiple images of food;
The product data of preparation are extracted from each image;
Receive the relevant data of corresponding order about each image;
Receive the quality level about each image;And
It will be about the product data for the preparation of each image extracted and the relevant data of corresponding order and quality
Horizontal storage is in the database.
6. device as described in claim 1, wherein determine that the accordance of the food and required quality level includes true
Whether the product data of fixed extracted preparation indicate that the food has the quality higher than scheduled quality level.
7. device as described in claim 1 further includes temperature sensor,
And wherein, the controller is additionally configured to:
The temperature measurement result of the food is received from the temperature sensor;And
Also based on the temperature measurement result received, determine whether the food has required quality.
8. device as described in claim 1 further includes spectrometer,
And wherein, the controller is additionally configured to:
The data with the spectral correlation of the food are received from the spectrometer;And
Also based on the data with the spectral correlation of the food received, it is required to determine whether the food has
Quality.
9. device as claimed in claim 8, wherein the description of the food further includes ripe degree,
And wherein, the ripe degree is indicated with the data of the spectral correlation of the food.
10. a kind of the method implemented by computer prepared by monitoring food, including:
Receive the relevant data of order;
The image of the food is received from imager;
Data based on the pre-stored received from database analyze the image received, to extract the product number of preparation
According to;
The product data for the preparation extracted are compared with the relevant data of the order;And
The comparison of product data and the relevant data of the order based on the preparation to being extracted, determines the food and is wanted
The accordance for the quality level asked.
11. the method implemented by computer as claimed in claim 9, wherein the data presorted include being checked from previously
The product data for the preparation extracted in the image of food.
12. the method implemented by computer as claimed in claim 10, wherein during the relevant data of order include following
It is at least one:The type of the food, visible one or more raw material and at least one raw material exist on the food
Distribution on the food.
13. the method implemented by computer as claimed in claim 10, wherein carry out analysis to the image received and be included in institute
It is at least one in below being identified in the product data of the preparation of extraction:The type of the food, can on the surface of the food
Distribution of the one or more of raw materials and at least one raw material seen on the surface of the food.
14. the method implemented by computer as claimed in claim 10, further includes:
Receive the multiple images of food;
The product data of preparation are extracted from each image;
Receive the relevant data of corresponding order about each image;
Receive the quality level about each image;And
It will be about the product data for the preparation of each image extracted and the relevant data of corresponding order and quality
Horizontal storage is in the database.
15. the method implemented by computer as claimed in claim 10, wherein determine the food and required quality level
Accordance include determine extracted preparation product data whether indicate the food have be higher than scheduled quality level
Quality.
16. the method implemented by computer as claimed in claim 10, further includes:
The temperature measurement result of the food is received from thermometer;And wherein
Also based on the temperature measurement result received, determine whether the food has required quality.
17. the method implemented by computer as claimed in claim 10, further includes:
The data with the spectral correlation of the food are received from spectrometer;And wherein
Also based on the data with the spectral correlation of the food received, it is required to determine whether the food has
Quality.
18. the method implemented by computer as claimed in claim 17, wherein the description of the food further includes ripe degree,
And wherein, the ripe degree is indicated with the data of the spectral correlation of the food.
19. the method implemented by computer as claimed in claim 17, wherein the description of the food further includes nutritive value,
And wherein, the nutritive value of food is indicated with the data of the spectral correlation of the food.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762478050P | 2017-03-29 | 2017-03-29 | |
US62/478,050 | 2017-03-29 | ||
US15/497,289 | 2017-04-26 | ||
US15/497,289 US10254264B2 (en) | 2017-03-29 | 2017-04-26 | Apparatus and method for monitoring preparation of a food product |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108665134A true CN108665134A (en) | 2018-10-16 |
Family
ID=62200123
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710596762.6A Pending CN108665134A (en) | 2017-03-29 | 2017-07-20 | Device and method for monitoring food preparation |
Country Status (5)
Country | Link |
---|---|
US (1) | US10254264B2 (en) |
CN (1) | CN108665134A (en) |
AU (2) | AU2017204283A1 (en) |
CA (1) | CA2974601A1 (en) |
SG (1) | SG10201705823YA (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110059603A (en) * | 2019-04-10 | 2019-07-26 | 秒针信息技术有限公司 | Food composition detector, food composition detection method, device and storage medium |
CN111126200A (en) * | 2019-12-11 | 2020-05-08 | 浙江口碑网络技术有限公司 | Method and device for tracking manufacturing progress of processed product |
CN113168167A (en) * | 2018-12-11 | 2021-07-23 | 西门子股份公司 | Method and apparatus for manufacturing a product and computer program product |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11030475B2 (en) | 2015-07-08 | 2021-06-08 | Zest Labs, Inc. | Photo analytics calibration |
ES2877175T3 (en) * | 2018-03-06 | 2021-11-16 | Vorwerk Co Interholding | Food preparation apparatus |
WO2020050973A2 (en) * | 2018-08-22 | 2020-03-12 | Florent Technologies, Llc | Neural network-based systems and computer-implemented methods for identifying and/or evaluating one or more food items present in a visual input |
ES2760848A1 (en) * | 2018-11-14 | 2020-05-14 | Beabloo S L | Quality control system and procedure for prepared dishes (Machine-translation by Google Translate, not legally binding) |
US11455714B2 (en) * | 2019-07-25 | 2022-09-27 | Verizon Patent And Licensing Inc. | Multi-access edge computing methods and systems for computer-vision-based product compliance verification |
CN110796149B (en) * | 2019-10-09 | 2023-10-27 | 陈浩能 | Image comparison method for food tracing and related device |
JP6788091B1 (en) * | 2019-11-13 | 2020-11-18 | マルハニチロ株式会社 | Inspection equipment and inspection method |
RU2758816C1 (en) * | 2020-06-29 | 2021-11-02 | Георгий Ревазович Хвистани | System and method for photofixation of orders from a catering company |
US11544925B1 (en) * | 2021-09-01 | 2023-01-03 | GOPIZZA Inc. | Kitchen system with food preparation station |
JP7227423B1 (en) | 2022-06-10 | 2023-02-21 | セーフィー株式会社 | Information processing system, information processing method and program |
WO2024148157A1 (en) * | 2023-01-06 | 2024-07-11 | General Mills, Inc. | Vision-based food product reformulation |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130302483A1 (en) * | 2012-05-09 | 2013-11-14 | Convotherm Elektrogeraete Gmbh | Optical quality control system |
US20140104385A1 (en) * | 2012-10-16 | 2014-04-17 | Sony Network Entertainment International Llc | Method and apparatus for determining information associated with a food product |
US20140119614A1 (en) * | 2012-10-30 | 2014-05-01 | Sony Corporation | Information processing apparatus and information processing method |
US20140133704A1 (en) * | 2012-11-15 | 2014-05-15 | Toshiba Tec Kabushiki Kaisha | Commodity recognition apparatus and commodity recognition method |
US20140236359A1 (en) * | 2012-04-16 | 2014-08-21 | Eugenio Minvielle | Appliances with Weight Sensors for Nutritional Substances |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012252396A (en) | 2011-05-31 | 2012-12-20 | Toshiba Tec Corp | Visual inspection device, visual inspection program and visual inspection system |
US9014434B2 (en) | 2012-11-26 | 2015-04-21 | Frito-Lay North America, Inc. | Method for scoring and controlling quality of food products in a dynamic production line |
US9659225B2 (en) | 2014-02-12 | 2017-05-23 | Microsoft Technology Licensing, Llc | Restaurant-specific food logging from images |
-
2017
- 2017-04-26 US US15/497,289 patent/US10254264B2/en active Active
- 2017-06-23 AU AU2017204283A patent/AU2017204283A1/en not_active Abandoned
- 2017-07-14 SG SG10201705823YA patent/SG10201705823YA/en unknown
- 2017-07-20 CN CN201710596762.6A patent/CN108665134A/en active Pending
- 2017-07-25 CA CA2974601A patent/CA2974601A1/en not_active Abandoned
-
2019
- 2019-03-04 AU AU2019201466A patent/AU2019201466B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140236359A1 (en) * | 2012-04-16 | 2014-08-21 | Eugenio Minvielle | Appliances with Weight Sensors for Nutritional Substances |
US20130302483A1 (en) * | 2012-05-09 | 2013-11-14 | Convotherm Elektrogeraete Gmbh | Optical quality control system |
US20140104385A1 (en) * | 2012-10-16 | 2014-04-17 | Sony Network Entertainment International Llc | Method and apparatus for determining information associated with a food product |
US20140119614A1 (en) * | 2012-10-30 | 2014-05-01 | Sony Corporation | Information processing apparatus and information processing method |
US20140133704A1 (en) * | 2012-11-15 | 2014-05-15 | Toshiba Tec Kabushiki Kaisha | Commodity recognition apparatus and commodity recognition method |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113168167A (en) * | 2018-12-11 | 2021-07-23 | 西门子股份公司 | Method and apparatus for manufacturing a product and computer program product |
US11480951B2 (en) | 2018-12-11 | 2022-10-25 | Siemens Aktiengesellschaft | Method and device for producing a product and computer program product |
CN113168167B (en) * | 2018-12-11 | 2023-09-26 | 西门子股份公司 | Method and apparatus for manufacturing product, and computer-readable storage medium |
CN110059603A (en) * | 2019-04-10 | 2019-07-26 | 秒针信息技术有限公司 | Food composition detector, food composition detection method, device and storage medium |
CN111126200A (en) * | 2019-12-11 | 2020-05-08 | 浙江口碑网络技术有限公司 | Method and device for tracking manufacturing progress of processed product |
Also Published As
Publication number | Publication date |
---|---|
AU2019201466B2 (en) | 2020-12-24 |
SG10201705823YA (en) | 2018-10-30 |
US20180284091A1 (en) | 2018-10-04 |
CA2974601A1 (en) | 2018-09-29 |
AU2017204283A1 (en) | 2018-10-18 |
NZ733184A (en) | 2018-05-25 |
US10254264B2 (en) | 2019-04-09 |
AU2019201466A1 (en) | 2019-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108665134A (en) | Device and method for monitoring food preparation | |
CN113194792B (en) | System and method for training cooking utensil, positioning food and determining cooking progress | |
JP7077506B2 (en) | Food cooking methods and systems based on food identification | |
US10408748B2 (en) | System and method for evaluating fruits and vegetables | |
US10209691B2 (en) | Instructions for conditioning nutritional substances | |
KR102236974B1 (en) | Method, device, and system ofquality classifying and selling packed meat based on image | |
Sampson et al. | A dual-view computer-vision system for volume and image texture analysis in multiple apple slices drying | |
EP2423675A2 (en) | System and method for measuring calorie content of a food sample | |
WO2015069950A1 (en) | Instructions for conditioning nutritional substances | |
JP7171970B1 (en) | Determination device, learning device, determination system, determination method, learning method, and program | |
Andresen et al. | Quality assessment of butter cookies applying multispectral imaging | |
US20160353921A1 (en) | Machine & System for Obtaining Precise Cooking Times of Irregular Shaped Food Objects | |
CN112163006A (en) | Information processing method and device, electronic equipment and storage medium | |
Matiacevich et al. | Prediction of mechanical properties of corn and tortilla chips by using computer vision | |
KR20190048922A (en) | Smart table and controlling method thereof | |
NZ733184B (en) | Apparatus and method for monitoring preparation of a food product | |
CN106442339B (en) | Cold cuts cold preservation time visible detection method and device | |
CN116452881B (en) | Food nutritive value detection method, device, equipment and storage medium | |
Jain et al. | Development of a classification system for quality evaluation of Oryza sativa L.(Rice) using computer vision | |
JP7585589B2 (en) | Fresh food current status information record/update device, fresh food current status information record/update system, fresh food current status information record/update method, and fresh food current status information record/update program | |
Matiacevich et al. | Oil content fraction in tortilla chips during frying and their prediction by image analysis using computer vision | |
KR102611452B1 (en) | Artificial Intelligence (AI)-based untact QSC inspection solution system | |
WO2024084963A1 (en) | Control method, information provision method, control system, information provision system, and program | |
CN118567277A (en) | Control method and system of air fryer of Internet of things | |
KR20220147826A (en) | Electronic apparatus and controlling method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |