CN110222720A - A kind of cooking equipment with short video acquisition function - Google Patents
A kind of cooking equipment with short video acquisition function Download PDFInfo
- Publication number
- CN110222720A CN110222720A CN201910389239.5A CN201910389239A CN110222720A CN 110222720 A CN110222720 A CN 110222720A CN 201910389239 A CN201910389239 A CN 201910389239A CN 110222720 A CN110222720 A CN 110222720A
- Authority
- CN
- China
- Prior art keywords
- cooking
- information
- image
- food material
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010411 cooking Methods 0.000 title claims abstract description 313
- 235000013305 food Nutrition 0.000 claims abstract description 273
- 239000000463 material Substances 0.000 claims abstract description 268
- 238000000034 method Methods 0.000 claims abstract description 101
- 230000008569 process Effects 0.000 claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 48
- 230000008859 change Effects 0.000 claims abstract description 33
- 238000010438 heat treatment Methods 0.000 claims abstract description 13
- 239000013598 vector Substances 0.000 claims description 32
- 238000007906 compression Methods 0.000 claims description 28
- 230000006835 compression Effects 0.000 claims description 26
- 238000004891 communication Methods 0.000 claims description 15
- 238000013139 quantization Methods 0.000 claims description 2
- 238000009825 accumulation Methods 0.000 abstract description 9
- 238000012549 training Methods 0.000 abstract description 9
- 208000001491 myopia Diseases 0.000 abstract 3
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 7
- 238000000605 extraction Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 241000287828 Gallus gallus Species 0.000 description 5
- 241000209094 Oryza Species 0.000 description 5
- 235000007164 Oryza sativa Nutrition 0.000 description 5
- 244000061458 Solanum melongena Species 0.000 description 5
- 235000002597 Solanum melongena Nutrition 0.000 description 5
- 235000002864 food coloring agent Nutrition 0.000 description 5
- 235000009566 rice Nutrition 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 239000006227 byproduct Substances 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000005315 distribution function Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000001953 sensory effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000009835 boiling Methods 0.000 description 1
- 235000013339 cereals Nutrition 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000001704 evaporation Methods 0.000 description 1
- 230000008020 evaporation Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computing Systems (AREA)
- Image Analysis (AREA)
Abstract
Present invention discloses a kind of cooking equipments with short video acquisition function, including heating unit, the cooking space that holds food materials, obtain the camera of food materials situation of change, control system in cooking process, control system includes the driving circuit for driving heating unit work, video processing unit, camera changes relevant video for shooting food materials, video processing unit is used to obtain milestone image of the food materials in locating cooking stage by camera, and changes relevant video according to milestone image selected parts food materials to generate the short-sighted frequency of cooking process.Disclosed cooking equipment, the change procedure that food materials can be shot by camera generates short-sighted frequency, corresponding cooking equipment can also compress short-sighted frequency according to the difference of short video use, share for user, or the training of accumulation and food materials identification model for video data.
Description
Technical Field
The invention belongs to the field of intelligent household appliances, and particularly relates to a cooking device with a short video acquisition function.
Background
With the increasingly mature image recognition technology, more and more household appliances start to carry cameras, and various intelligent working scenes are achieved. Typically, more and more cooking devices can shoot food material pictures and videos by means of machine vision technology, so that the requirements of users for remotely monitoring the cooking process and sharing cooking fun through an internet channel are met.
However, the current cooking equipment is not perfect in development of a vision technology, and only stays in a stage of simply shooting a cooking process, so that not only is the shooting quality of pictures and videos strong, but also a user cannot be helped to accurately judge the cooking stage. The above adverse factors not only affect user experience, but also reduce the willingness of manufacturers to configure visual technologies for home appliances, thereby hindering the trend of home appliances intellectualization.
Disclosure of Invention
The invention aims to solve the technical problems in the prior art and provides the cooking equipment with the short video acquisition function, the cooking equipment not only can intelligently judge the current cooking stage, but also can establish a milestone image for the corresponding cooking stage, the corresponding milestone image provides materials and basis for making a cooking short video, and a user can be helped to quickly and accurately master the whole cooking process. The cooking equipment disclosed by the invention can also monitor the food material change process through a visual image technology, and feed the cooking process back to a user for viewing, watching and sharing in a short video mode.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
the utility model provides a cooking equipment with short video acquires function, including heating element, hold the culinary art space of eating material, acquire the camera of eating material change situation among the culinary art process, control system includes drive circuit, the video processing unit of drive heating element work, the camera is used for shooing the video that eat material change is relevant, the video processing unit is used for acquireing the milestone image of eating material in the cooking stage of being located through the camera to according to milestone image excerpt eat material change relevant video and generate the short video of culinary art process.
Furthermore, the cooking equipment is provided with a communication unit, the control system determines a compression standard according to the standard selection information and compresses the short video, and the compressed short video is sent out through the communication unit.
Further, the standard selection information comprises the type information of the food materials and the equipment type information of the cooking equipment, the control system selects the MPEG standard as a compression standard according to the standard selection information to compress the short videos, and the compressed short videos are sent to the cloud platform through the communication unit.
Further, the standard selection information comprises duration information of the short videos and unique identification information of the cooking equipment, the control system selects the H264 standard as a compression standard according to the standard selection information to compress the short videos, and the compressed short videos are sent to the user terminal through the communication unit.
Further, the video processing unit is further configured to identify the food materials and extract feature information of the corresponding food materials.
Further, the characteristic information comprises color information and/or volume information of the respective food material.
Further, the video processing unit determines a cooking stage in the cooking process according to the characteristic information, and screens and determines a milestone image corresponding to the cooking stage in the video related to the change of the food materials.
Further, the video processing unit determines a start frame image of the cooking stage according to a first similarity between the characteristic information and the prior characteristic information, and determines a milestone image according to a second similarity between the characteristic information of the food material in the start frame image and the characteristic information of the food material in a later image, wherein the later image is the food material image in an image sequence located after the start frame image in the corresponding cooking stage.
Further, the video processing unit performs the following operations to characterize the color information: extracting color histogram information of at least one frame of image in a video related to the change of the food material; quantizing the color histogram information to obtain target color feature vectors of all regions in corresponding images; and representing the color information according to the target color feature vector.
Further, the video processing unit performs the following operations to characterize the volume information: extracting contour point sequence information of at least one frame of image in a video related to food material change; generating a food material shape characteristic vector based on the contour point sequence information; and characterizing volume information according to the food material form feature vector.
The technical scheme of the invention has the following beneficial effects:
the cooking equipment with the short video acquisition function disclosed by the invention can segment the whole cooking process, accurately determine the cooking stage and establish milestone images, and the corresponding milestone images can finally form short cooking videos, so that the requirements of users for checking, sharing and the like are met, the flow and bandwidth resources are greatly saved, and the popular trend of V-Blog (video Blog) is met. The cooking equipment can also send the short video to a cloud-end platform for accumulation of video data and training of food material recognition models.
Drawings
FIG. 1 is a schematic flow chart of one embodiment of the method of the present invention;
FIG. 2 is a schematic flow chart of an image analysis process according to an embodiment of the method of the present invention;
FIG. 3 is a flow chart illustrating short video compression according to an embodiment of the method of the present invention;
FIG. 4 is a block diagram illustrating steps of a first embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating the extraction of color information of food materials according to an embodiment of the method of the present invention;
FIG. 6 relates to one embodiment of a cooking apparatus of the present invention;
FIG. 7 is a block diagram illustrating steps of a second embodiment of the present invention;
FIG. 8 relates to a cooking apparatus in accordance with one embodiment of the method of the present invention;
FIG. 9 is a schematic diagram of a cooking apparatus according to an embodiment of the present invention;
fig. 10 is a block diagram of one embodiment of the cooking apparatus of the present invention.
Detailed Description
The technical solution provided by the present invention is described in more detail by the following figures and specific embodiments:
as shown in fig. 1-3, relating to one embodiment of the method of the present invention. This embodiment will be explained below.
FIG. 1 is a schematic flow chart of one embodiment of the method of the present invention. The cooking device in this embodiment includes, but is not limited to, an oven, a microwave oven, a rice cooker, and the like. Taking an oven as an example, in the embodiment, dynamic monitoring is performed on a baking process of the oven, image acquisition is performed in real time, and the image is uploaded to a server to perform video processing, where the video processing specifically relates to detection of food material colors, detection of food material volumes, detection of food material types, and video compression and generation.
As shown in fig. 1, after the cooking device is started, image information of a cooking process starts to be collected through a camera, the collected image information is uploaded to a cloud platform for analysis, the analysis mainly includes identifying food material types, detecting colors, volumes and the like of food materials, recording obtained information after the analysis processing is completed, and an analysis result can be used for compressing the collected image information to generate short videos related to cooking and generating a control instruction, and controlling the cooking device or adjusting the APP of a user terminal in an interactive correlation manner. In this embodiment, if the processing capability of the cooking device itself is sufficient, the task of analyzing and processing the image information may be performed by the processing module of the cooking device itself.
Fig. 2 is a schematic flow chart of image analysis processing according to an embodiment of the method of the present invention. In this embodiment, the images or videos captured by the cooking device are analyzed, for example, a series of images are subjected to feature extraction, feature comparison is performed according to the extracted feature information, a start frame image of the cooking stage and a milestone image corresponding to the cooking stage are determined according to the similarity condition, so as to provide a basis for the division of the cooking stage in the cooking process, and the corresponding milestone image is also used for the generation of the cooking short video.
Fig. 3 is a schematic flow chart related to short video compression in one embodiment of the method of the present invention. In this embodiment, after the feature comparison is completed, the image sequence reflecting the cooking process is excerpted and compressed to form a cooking short video, and the corresponding compression flow and compression standard may differ according to the different uses of the short video. For example, when the corresponding cooking short video is mainly used for the purposes of accumulation of cooking data, training of a food material recognition model and the like, the requirements on the size of a video file and the integrity of the cooking data are high; when the corresponding short cooking videos are mainly used for users to view and share, the beautifying effect of the short videos, the playing time of the short videos and other factors need to be considered. Based on the above-mentioned different demands, the cooking device in this embodiment can intelligently distinguish and execute corresponding compression flow and standard, has promoted the accuracy that food material discernment and culinary art stage were judged on the one hand, and on the other hand has also promoted quality and experience that is used for the short video of sharing.
The method and the cooking device according to the invention are described below with further examples.
The first embodiment is as follows:
as shown in fig. 4, relating to a step block diagram of a first embodiment of the present invention, the embodiment discloses a food material image acquiring method of a cooking apparatus, including:
step 4001, extracting characteristic information of food materials in at least one frame of food material image;
step 4002, determining a cooking stage in the cooking process according to the characteristic information, and screening at least one frame of food material image to determine a milestone image corresponding to the cooking stage;
step 4003, generating a cooking short video of the cooking process based on the milestone image.
In this embodiment, feature extraction is performed on the shot food material image to obtain feature information of the food material, a cooking stage corresponding to the current image can be determined according to the feature information, a milestone image can be further screened from the shot food material image, the milestone image corresponds to the cooking stage where the image is acquired, key changes of the food material in the cooking stage can be reflected, and the milestone images are arranged and processed to obtain a cooking short video related to the cooking process. The method in the embodiment can establish a relation model of the milestone image corresponding to the cooking stage, and refine the image of the complete cooking process shot by the cooking equipment to generate the cooking short video based on the relation model, so that the data pressure of model training is greatly reduced, and a user can quickly master the cooking process according to the cooking short video. When cooking a cooking process, since the change of the food material reflected on the image over a period of time is not obvious, a large amount of redundant image data is generated. After the method disclosed by the embodiment is adopted, specific cooking stages can be distinguished according to the characteristic information of the food materials, and the representative milestone image in the corresponding cooking stage is determined to be used for generating the cooking short video of the cooking process, so that manufacturers and users can obtain short video data which are really concerned by the manufacturers and users and sufficiently reflect the overall appearance of the cooking process, and redundant image data is effectively filtered.
As an embodiment of the method of the present invention, the step of determining a cooking stage in a cooking process according to the characteristic information and screening and determining a milestone image corresponding to the cooking stage in the at least one frame of food material image includes:
determining an initial frame image of the cooking stage according to a first similarity between the characteristic information and the prior characteristic information;
and determining the milestone image according to a second similarity between the characteristic information of the food material in the initial frame image and the characteristic information of the food material in a later image, wherein the later image is the food material image in the image sequence behind the initial frame image in the corresponding cooking stage.
In this embodiment, in order to distinguish a specific cooking stage in the cooking process, the start frame image and the milestone image are determined by using a feature comparison method. The extracted characteristic information is compared with the priori characteristic information which is known in advance to obtain a first similarity, and then the image with the first similarity meeting the condition is determined as the initial frame image of the corresponding cooking stage; after the initial frame image is determined, comparing the characteristic information of the food material in the initial frame image with the characteristic information of the food material in the later image to obtain a second similarity, and selecting an image with the second similarity meeting the condition as a milestone image corresponding to the cooking stage, wherein the later image is the food material image in an image sequence which is in the same cooking stage with the initial frame image but is acquired later than the initial frame image. In this embodiment, if the first similarity is higher than the first threshold, determining the corresponding food material image as a start frame image; and if the second similarity is lower than a second threshold value, determining the corresponding food material image as a milestone image. Wherein the value range of the first threshold is 60-100%, and the value range of the second threshold is 20-80%. For example, taking a microwave oven to heat a chicken wing as an example, a manufacturer already obtains feature information data of the chicken wing at each stage in the heating process through a cooking experiment and a big data means and forms a corresponding prior feature information database, so that when a user heats the chicken wing by using the microwave oven by himself, changes of the chicken wing feature information reflected by each frame of image are compared with the prior feature information, and if a first similarity between the feature information of the chicken wing in a certain frame of image and the prior feature information is 70% and exceeds a set first threshold (such as 60%), the frame of image is considered as a starting frame of image of the current cooking stage; further, if the second similarity between the subsequent image and the initial frame image is 50% and is lower than a second threshold (e.g. 80%), it is determined that the frame image has changed greatly from the initial stage of the current cooking stage, and the frame image can be used as a milestone image to reflect the key change of the food material, so as to determine the frame image as the milestone image. The milestone images for the respective cooking stages may be one or more.
In one embodiment of the method of the present invention, the characteristic information includes food material color information, and the step of extracting the characteristic information of the food material in at least one frame of food material image includes:
extracting color histogram information of food materials in the at least one frame of food material image;
quantizing the color histogram information to obtain target color characteristic vectors of all regions in the corresponding food material images;
and characterizing the food material color information according to the target color feature vector.
In this embodiment, a target color feature vector of each region in the food material image is obtained through the color histogram information, so that the food material color information is represented according to the target color feature vector. By adopting the method in the embodiment, the food color information in the food image can be quantitatively extracted, so that a processable data sample is provided for the judgment of the cooking stage and the generation of the short cooking video by compression, the judgment accuracy of the cooking stage is greatly improved, and the image data in the compression process is more clear.
As shown in fig. 5, a schematic diagram of the food material color information extraction in one embodiment of the method of the present invention is disclosed. Obtaining a target area 5001 containing food materials and shown in fig. 5 after performing foreground and background separation on a food material image, performing non-uniform blocking processing on the target area 5001 to form 9 sub-areas in total of 1-9, performing color histogram feature extraction on each sub-area respectively, and dividing gray levels according to 32, so that each sub-area generates a group of color featuresPerforming mean calculation on the group of features to generate a color mean value of each sub-regionWherein, the target color feature vector is:
in the form of a normal distribution function,disi is the distance from the center position of the ith sub-area to the center position of the first sub-area. Synchronously converting the image from RGB color space to HSV color space, and generating the color characteristic F of the HSV space according to the calculation modehsvAnd then, splicing into a feature array of 3 x 18, so that the color of the food material in the target area can be effectively represented.
In an embodiment of the method of the present invention, the characteristic information includes food material volume information, and the step of extracting the characteristic information of the food material in at least one frame of food material image includes:
extracting contour point sequence information of food materials in the at least one frame of food material image;
generating a food material shape characteristic vector based on the contour point sequence information;
and characterizing the food material volume information according to the food material shape feature vector.
In this embodiment, the cooking stage may also be determined by the change of the volume of the food material, and the volume information and the color information of the food material may be combined and mutually verified when being used for determining the cooking stage. In one embodiment of the method of the present invention, in order to fully describe the food material volume information, a relatively stable food material volume characteristic needs to be selected to mark the shape of the food material.
Specifically, the method comprises the following steps:
1. contour point sequence information { Points } of the food materials needs to be extracted, and Area information Area of a polygon formed by the contour point sequence is determined based on the contour point sequence information of the food materials;
2. deriving circularity information Fcircle of the outer contour of the target food material and geometric shape information Fshape fitted through a contour point sequence based on { Points } data and Area data;
3. quantizing and extracting a corner feature sequence { Corners } based on the contour point sequence information { Points };
4. extracting food texture features from the region surrounded by the contour point sequence, and processing the image by using Gabor transformation to ensure that the extracted food texture features are not influenced by light and shadow, thereby generating a group of Gabor feature sequences { Fgabor };
5. the five groups of characteristics are combined to generate a food material form characteristic vector to characterize the food material volume information, wherein the food material form characteristic vector Ffood { { Points }, Area, Fcircle, Fshape, Corners }, and { Fgabor } } can effectively describe the volume and the form of the food material, so that only the local form characteristics of the food material are avoided being described, and the perception of the cooking equipment on the food material form and the volume change tends to be consistent with the sensory judgment of people.
In the above embodiment, the food color information and the food volume information can be extracted quantitatively, so that the data can be obtained and accumulated by a manufacturer in advance through experiments, big data statistics and other manners, so as to form prior characteristic information for comparing the characteristic information with the prior characteristic information to determine the cooking stage corresponding to the food image.
In one embodiment of the method of the present invention, the method further comprises: and compressing the milestone image according to the food material color information to generate the cooking short video.
In this embodiment, the food material color information may be used as a basis for the cooking stage determination, and on the other hand, may be used to compress the milestone image to implement the selection of image data, generate a cooking short video, and save the data amount pressure of image processing, storage, and transmission.
In this embodiment, on one hand, a milestone image can be screened and determined in the food material image according to the second similarity between the food material color information in the initial frame image and the food material color information in the subsequent image, and on the other hand, redundant data of the food material color information in part of the milestone image can be removed to compress the milestone image to generate a cooking short video.
In an embodiment of the method of the present invention, the step of compressing the milestone image according to the food material color information to generate the cooking short video further includes:
and processing the milestone image according to the food material category information and the equipment type information of the cooking equipment and determining a corresponding compression standard, wherein the compression standard is an MPEG standard.
In this embodiment, the food material types can be further identified based on the food material images, and corresponding food material type information is acquired. In this embodiment, the short video of cooking mainly used model training data's accumulation, through collecting the short video of cooking that the user culinary art produced, can promote the accuracy of food material discernment and the accuracy that the culinary art stage was judged. The cooking short video in this embodiment is used for accumulation of model training data, and mainly concerns about diversity of food material types, differences in video images caused by product structures, light, shadows, and the like in different types of apparatuses, and the like, and it is desirable that the obtained cooking short video reflects changes of food materials in the cooking apparatus as truly as possible. For the above reasons, in this embodiment, the milestone image is processed mainly according to the food material category information and the device type information of the cooking device, and the MPEG standard is selected as the compression standard, so that the obtained cooking short video content can meet the requirement of model data accumulation, and the degradation and distortion of the image quality due to image compression are reduced.
In an embodiment of the method of the present invention, the step of compressing the milestone image according to the food material color information to generate the cooking short video further includes:
and processing the milestone image according to the duration information of the cooking short video and the equipment ID of the cooking equipment and determining a corresponding compression standard, wherein the compression standard is H264 standard.
In this embodiment, the short cooking videos are used for enjoying and sharing by the user, mainly concern about the binding relationship between the cooking device and the user (mainly the intelligent terminal of the user), and about the constraints such as the size and duration of the videos, and aim to help the user quickly grasp the key changes of the food materials in the cooking process so as to enjoy the fun brought by cooking. In this case, in this embodiment, the milestone image is processed according to the duration information of the cooking short video and the device ID of the cooking device, so that the duration of the cooking short video meets the requirements of some short video applications as much as possible (for example, the duration of the short video does not exceed 15s), the intelligent terminal to which the cooking device is bound is determined according to the device ID of the cooking device, the milestone image is matched with the intelligent terminal of the user in terms of resolution and image quality after being processed, and the milestone image is processed by filtering, beautifying and the like, so that the generated cooking short video is more suitable for the user to view and share, and the interestingness of the cooking of the user is increased. Meanwhile, the cooking short videos in the embodiment relate to storage and sharing, and the real reflecting requirements on the food material change process are not so strong, so that the data space occupied by the compressed cooking short videos should be as small as possible, and preferably, the H264 standard should be selected to compress the processed milestone images.
In one embodiment of the method of the present invention, the method further comprises: and identifying the food materials in the food material image. In one embodiment of the method of the present invention, the method further comprises: and segmenting the food materials and the containing vessels in the food material image by a background frame difference method. In this embodiment, the types of the food materials can be judged by extracting the characteristic information in the food material image, so that different prior characteristic information can be selected according to different food materials. In the cooking device, the food materials are often contained in the vessel, so that the vessel interference is avoided in order to accurately identify the food materials, and the food materials in the food material image and the containing vessel need to be separated through a foreground and background separation technology, so that the identification accuracy is improved.
Fig. 6 shows one embodiment of the cooking apparatus according to the present invention. In this embodiment, a cooking apparatus 6000 is disclosed, including:
an extracting module 6001, configured to extract characteristic information of food materials in at least one frame of food material image;
the processing module 6002 is configured to determine a cooking stage in the cooking process according to the feature information, and screen and determine a milestone image corresponding to the cooking stage from at least one frame of food material image;
a generating module 6003 for generating a cooking short video of the cooking process from the milestone image.
The cooking device in this embodiment can acquire the food material image, and accurately determine the current cooking stage according to the feature information extracted from the food material image. The cooking equipment in the embodiment can also screen milestone images capable of reflecting key changes of food materials on the basis of judging the cooking stage, and integrate the milestone images to generate cooking short videos, and the corresponding cooking short videos can be used for model training and watching or sharing by users, so that the viscosity between the cooking equipment and the users is greatly improved.
Example two:
fig. 7 is a block diagram of steps related to the second embodiment of the present invention. The embodiment discloses a cooking control method of a cooking device, which comprises the following steps:
7001, extracting characteristic information of food materials in at least one frame of food material image;
and step 7002, adjusting the cooking control program of the cooking equipment according to the characteristic information.
The cooking device in this embodiment can acquire the food material image in the cooking process, extract the characteristic information of the food material therefrom, and adjust the cooking control program of the cooking device according to the characteristic information, thereby realizing automatic cooking. The cooking equipment in the embodiment utilizes the image recognition related intelligent technology to control the cooking process in real time and adjust the cooking control program according to the requirement of the cooking process, so that the cooking effect is greatly improved.
In one embodiment of the method of the present invention, the method further comprises: and determining a cooking stage in the cooking process according to the characteristic information. In this embodiment, the specific cooking stage in the cooking process can be further determined based on the characteristic information of the food material extracted from the food material image, so that the adjustment of the cooking control program is more accurate and more targeted. For example, when the coarse cereal rice is cooked by using the intelligent rice cooker, the whole cooking process can be divided into a water absorption stage, a heating stage, a boiling stage, a stewing stage and the like based on the change of the characteristic information in the food material image, and when the intelligent rice cooker intelligently judges that the current heating stage is (the fierce fire mode needs to be started for rapid heating), the cooking control program is automatically adjusted, and the fire power is increased so as to rapidly raise the temperature in the rice cooker.
In an embodiment of the method of the present invention, the characteristic information includes food material color information and/or food material volume information. In this embodiment, the characteristic information mainly includes food material color information and/or food material volume information extracted from the food material image, and the corresponding food material color information and/or food material volume information may be used alone as a basis for the cooking stage judgment and the cooking control program adjustment, or may be combined with each other, and are mutually verified when the cooking stage judgment and the cooking control program adjustment are performed.
In one embodiment of the method of the present invention, the step of determining the cooking stage in the cooking process according to the characteristic information further includes:
determining an initial frame image of the cooking stage according to a first similarity between the characteristic information and the prior characteristic information;
and determining the milestone image according to a second similarity between the characteristic information of the food material in the initial frame image and the characteristic information of the food material in a later image, wherein the later image is the food material image in the image sequence behind the initial frame image in the corresponding cooking stage.
In this embodiment, in order to accurately divide the cooking stage, it is necessary to determine a start frame image of the cooking stage. Meanwhile, as the food materials are not obvious in change for a long time in the cooking process, most of the shot food material images have redundancy, and part of the food material images cannot reflect the obvious change of the food materials, so that milestone images are screened and determined in the food material images to reduce the image processing pressure, and the energy of a user for looking up the video of the cooking related images is saved. In this embodiment, the prior characteristic information may be prestored in the data storage unit of the cooking device, or may be acquired by the cooking device from the cloud platform through the network.
When the starting frame image is judged, the feature information extracted from the current frame image is compared with the prior feature information, and the similarity is calculated. For example, taking oven-baked eggplants as an example, a manufacturer divides the oven-baked eggplants into a small fire stage, a large fire stage and a uniform heating stage through experiments and knows that the oven-baked eggplants are in the three stages, and a priori characteristic information database of food material images in each stage is established, so that when a user is baking the eggplants, the food material images in the oven-baked eggplants are continuously shot, if the similarity between the extracted characteristic information in the food material image at a certain moment and the priori characteristic information in the small fire stage exceeds 80%, the image is considered as a starting frame image of the small fire stage, the food material image at the moment is used as a node divided in the cooking stage for marking and confirming, and the image which is positioned behind the starting frame image and still in the small fire stage belongs to a later image of the starting frame; when the cooking process continues to another moment, the similarity between the feature information extracted from the food material image at the moment and the prior feature information at the intense fire stage exceeds 80%, and at this moment, the image is considered as the initial frame image at the intense fire stage.
When the milestone images are screened, the feature information in the initial frame image of a certain cooking stage is compared with the feature information in the later image in the cooking stage, and if the similarity between the initial frame image and the later image is lower than 65%, the fact that the food material of the frame is greatly changed compared with the initial frame image is indicated, so that the frame image can be screened and determined as the milestone image. In this embodiment, the milestone images may be multiple, and the more posterior the milestone image is located in the same cooking stage, the lower the similarity between the initial frame image and the milestone image.
In one embodiment of the method of the present invention, the step of determining the initial frame image of the cooking stage according to the first similarity between the feature information and the prior feature information further includes:
adjusting a duration parameter and/or a fire parameter in the cooking control program according to the food material volume information acquired from the starting frame image; or,
and sending food material segmentation prompt according to the food material volume information acquired in the starting frame image.
In this embodiment, the same food material is cooked, and if the initial volumes of the food materials are different, the cooking parameters required in the cooking process are different. In the cooking process of the food material, the volume of the food material can be changed due to the influence of factors such as water evaporation and the like, so that in order to set appropriate cooking parameters for the food materials with different volumes, the volume of the food material needs to be determined at the initial cooking time, and a basis is provided for adjusting a cooking control program. Based on this, in this embodiment, the duration parameter and/or the fire parameter in the cooking control program are/is adjusted according to the food material volume information acquired in the start frame image; or, when the food material volume is too large, the cooking device can inform the user to cut the food material, so that the food material can be sufficiently and uniformly heated.
In an embodiment of the method of the present invention, the step of determining the milestone image according to a second similarity between the characteristic information of the food material in the start frame image and the characteristic information of the food material in the subsequent image further includes:
and determining the switching time of the cooking control program according to the food material color information and/or the food material volume information acquired from the milestone image.
In this embodiment, the current cooking stage can be determined according to the food color information and/or the food volume information, and thus, when each cooking stage starts, the cooking control program can be switched to match the current cooking stage with the cooking control program. By adopting the method in the embodiment, the cooking equipment can accurately master the switching time of the cooking control program, so that the cooking effect is improved, and the intelligent degree of the cooking equipment is improved.
In an embodiment of the method of the present invention, the step of extracting characteristic information of a food material in at least one frame of food material image includes:
extracting color histogram information of food materials in the at least one frame of food material image;
quantizing the color histogram information to obtain target color characteristic vectors of all regions in the corresponding food material images;
and characterizing the food material color information according to the target color feature vector.
In this embodiment, a target color feature vector of each region in the food material image is obtained through the color histogram information, so that the food material color information is represented according to the target color feature vector. By adopting the method in the embodiment, the food color information in the food image can be quantitatively extracted, so that a processable data sample is provided for the judgment of the cooking stage and the generation of the short cooking video by compression, the judgment accuracy of the cooking stage is greatly improved, and the image data in the compression process is more clear.
As shown in fig. 5, a schematic diagram of the food material color information extraction in one embodiment of the method of the present invention is disclosed. Obtaining a target area 5001 containing food materials and shown in fig. 5 after performing foreground and background separation on a food material image, performing non-uniform blocking processing on the target area 5001 to form 9 sub-areas in total of 1-9, performing color histogram feature extraction on each sub-area respectively, and dividing gray levels according to 32, so that each sub-area generates a group of color featuresPerforming mean calculation on the group of features to generate a color mean value of each sub-regionWherein, the target color feature vector is:
in the form of a normal distribution function,disi is the distance from the center position of the ith sub-area to the center position of the first sub-area. Synchronously converting the image from RGB color space to HSV color space, and generating the color characteristic F of the HSV space according to the calculation modehsvAnd then, splicing into a feature array of 3 x 18, so that the color of the food material in the target area can be effectively represented.
In an embodiment of the method of the present invention, the step of extracting characteristic information of a food material in at least one frame of food material image includes:
extracting contour point sequence information of food materials in the at least one frame of food material image;
generating a food material shape characteristic vector based on the contour point sequence information;
and characterizing the food material volume information according to the food material shape feature vector.
In this embodiment, the cooking stage may also be determined by the change of the volume of the food material, and the volume information and the color information of the food material may be combined and mutually verified when being used for determining the cooking stage. In one embodiment of the method of the present invention, in order to fully describe the food material volume information, a relatively stable food material volume characteristic needs to be selected to mark the shape of the food material.
Specifically, the method comprises the following steps:
1. contour point sequence information { Points } of the food materials needs to be extracted, and Area information Area of a polygon formed by the contour point sequence is determined based on the contour point sequence information of the food materials;
2. deriving circularity information Fcircle of the outer contour of the target food material and geometric shape information Fshape fitted through a contour point sequence based on { Points } data and Area data;
3. quantizing and extracting a corner feature sequence { Corners } based on the contour point sequence information { Points };
4. extracting food texture features from the region surrounded by the contour point sequence, and processing the image by using Gabor transformation to ensure that the extracted food texture features are not influenced by light and shadow, thereby generating a group of Gabor feature sequences { Fgabor };
5. the five groups of characteristics are combined to generate a food material form characteristic vector to characterize the food material volume information, wherein the food material form characteristic vector Ffood { { Points }, Area, Fcircle, Fshape, Corners }, and { Fgabor } } can effectively describe the volume and the form of the food material, so that only the local form characteristics of the food material are avoided being described, and the perception of the cooking equipment on the food material form and the volume change tends to be consistent with the sensory judgment of people.
In the above embodiment, the food color information and the food volume information can be extracted quantitatively, so that the data can be obtained and accumulated by a manufacturer in advance through experiments, big data statistics and other manners, so as to form prior characteristic information for comparing the characteristic information with the prior characteristic information to determine the cooking stage corresponding to the food image.
In one embodiment of the method of the present invention, the method further comprises: and compressing the milestone image according to the food material color information to generate a cooking short video of the cooking process.
In this embodiment, the food material color information may be used as a basis for the cooking stage determination, and on the other hand, may be used to compress the milestone image to implement the selection of image data, generate a cooking short video, and save the data amount pressure of image processing, storage, and transmission.
As shown in fig. 8, a cooking apparatus according to one embodiment of the method of the present invention is involved. The cooking apparatus 8000 in this embodiment includes:
an extracting module 8001, configured to extract feature information of food materials in at least one frame of food material image;
and a processing block 8002, configured to adjust a cooking control program of the cooking device according to the feature information.
The cooking device 8000 in this embodiment can acquire an image of food material and extract characteristic information of the food material, and the processing module 8002 can adjust a cooking control program of the cooking device 8000 according to the characteristic information, thereby achieving the purpose of automatic cooking. The food material image may be captured by the cooking device 8000, or forwarded to the cooking device 8000 by another device. The characteristic information of the food material includes, but is not limited to, food material color information and/or food material volume information.
Example three:
fig. 9 and 10 relate to one of the embodiments of the cooking apparatus of the present invention. Fig. 9 is a schematic structural diagram of an embodiment of a cooking apparatus according to the present invention, and fig. 10 is a block diagram of the cooking apparatus according to the present invention. The embodiment discloses a cooking device 9000 with a short video acquisition function, which comprises a heating unit 9001, a cooking space 9002 for containing food materials, a camera 9003 for acquiring the change situation of the food materials in the cooking process, and a control system 9004, wherein the control system comprises a driving circuit 9005 for driving the heating unit 9001 to work and a video processing unit 9006, the camera 9003 is used for shooting videos related to the change of the food materials, and the video processing unit 9006 is used for acquiring milestone images of the food materials in the cooking stage through the camera 9003 and selecting the videos related to the change of the food materials according to the milestone images to generate the short video of the cooking process.
The cooking device 9000 in this embodiment can capture changes of food materials, intelligently screen milestone images of the food materials in the cooking stage, and select videos related to changes of the food materials according to the milestone images to generate short videos of the cooking process. In the embodiment, the cooking process is displayed in the form of short videos, so that the cooking condition can be mastered quickly by a user, a large amount of redundant image data can be deleted, on one hand, the energy of the user is saved, and on the other hand, network transmission and data storage resources are also saved.
In one embodiment of the cooking device, the cooking device is provided with a communication unit, the control system determines a compression standard according to the standard selection information and compresses the short videos, and the compressed short videos are sent out through the communication unit.
In this embodiment, the cooking device 9000 is further provided with a communication unit 9007, and short videos shot by the cooking device 9000 can be viewed and appreciated through an intelligent terminal of the user, and can also be shared by the user through social software; in addition, the corresponding short videos can also be used for the manufacturer to collect cooking video data and train food material identification models. Cooking equipment 9000 in this embodiment configures communication unit 9007, can satisfy above-mentioned demand, sends the short video after will compressing to user's intelligent terminal through communication unit 9007, perhaps uploads to the cloud platform of firm. The control system 9004 determines different compression standards according to the received standard selection information to compress the short video according to different purposes.
In one embodiment of the cooking device of the present invention, the standard selection information includes type information of the food material and device type information of the cooking device, the control system selects an MPEG standard as a compression standard according to the standard selection information to compress the short video, and the compressed short video is sent to the cloud platform through the communication unit.
In this embodiment, the food material types can be further identified based on the food material images, and corresponding food material type information is acquired. In this embodiment, the short video of cooking mainly used model training data's accumulation, through collecting the short video of cooking that the user culinary art produced, can promote the accuracy of food material discernment and the accuracy that the culinary art stage was judged. The cooking short video in this embodiment is used for accumulation of model training data, and mainly concerns about diversity of food material types, differences in video images caused by product structures, light, shadows, and the like in different types of apparatuses, and the like, and it is desirable that the obtained cooking short video reflects changes of food materials in the cooking apparatus as truly as possible. For the above reasons, in this embodiment, the milestone image is processed mainly according to the food material category information and the device type information of the cooking device, and the MPEG standard is selected as the compression standard, so that the obtained cooking short video content can meet the requirement of model data accumulation, and the degradation and distortion of the image quality due to image compression are reduced.
In one embodiment of the cooking device of the present invention, the standard selection information includes duration information of the short video and unique identification information of the cooking device, the control system selects an H264 standard as a compression standard according to the standard selection information to compress the short video, and the compressed short video is sent to the user terminal through the communication unit.
In this embodiment, the short cooking videos are used for enjoying and sharing by the user, mainly concern about the binding relationship between the cooking device and the user (mainly the intelligent terminal of the user), and about the constraints such as the size and duration of the videos, and aim to help the user quickly grasp the key changes of the food materials in the cooking process so as to enjoy the fun brought by cooking. In this case, in this embodiment, the milestone image is processed according to the duration information of the cooking short video and the device ID of the cooking device, so that the duration of the cooking short video meets the requirements of some short video applications as much as possible (for example, the duration of the short video does not exceed 15s), the intelligent terminal to which the cooking device is bound is determined according to the device ID of the cooking device, the milestone image is matched with the intelligent terminal of the user in terms of resolution and image quality after being processed, and the milestone image is processed by filtering, beautifying and the like, so that the generated cooking short video is more suitable for the user to view and share, and the interestingness of the cooking of the user is increased. Meanwhile, the cooking short videos in the embodiment relate to storage and sharing, and the real reflecting requirements on the food material change process are not so strong, so that the data space occupied by the compressed cooking short videos should be as small as possible, and preferably, the H264 standard should be selected to compress the processed milestone images.
In one embodiment of the cooking device of the present invention, the video processing unit is further configured to identify food materials and extract feature information of the corresponding food materials. In one embodiment of the cooking apparatus of the present invention, the characteristic information includes color information and/or volume information of the corresponding food material. In this embodiment, the video processing unit 9006 is able to identify the type of food material in the acquired image and extract characteristic information of the respective food material, including but not limited to color information and/or volume information of the respective food material.
In one embodiment of the cooking device of the present invention, the video processing unit determines a cooking stage in a cooking process according to the characteristic information, and screens and determines a milestone image corresponding to the cooking stage from the videos related to the food material change. In an embodiment of the cooking apparatus of the present invention, the video processing unit determines a start frame image of the cooking stage according to a first similarity between the feature information and the prior feature information, and determines the milestone image according to a second similarity between the feature information of the food material in the start frame image and the feature information of the food material in a later image, where the later image is an image of the food material in an image sequence after the start frame image in the corresponding cooking stage.
In this embodiment, the video processing unit 9006 compares the obtained feature information with the prior feature information and determines a first similarity, thereby determining a start frame image corresponding to the cooking stage; further, the video processing unit 9006 also compares the subsequent image with the start frame image and determines a second similarity, thereby determining a milestone image corresponding to the cooking stage. Through the scheme of feature comparison and similarity threshold comparison, a basis is provided for division of cooking stages, and nodes are determined for videos related to food material selection change.
In one embodiment of the cooking apparatus of the present invention, the video processing unit performs the following operations to characterize the color information:
extracting color histogram information of at least one frame of image in the video related to the food material change;
performing quantization processing on the color histogram information to obtain target color feature vectors of each region in a corresponding image;
and characterizing the color information according to the target color feature vector.
In one embodiment of the cooking apparatus of the present invention, the video processing unit performs the following operations to characterize the volume information:
extracting contour point sequence information of at least one frame of image in the video related to the food material change;
generating a food material shape characteristic vector based on the contour point sequence information;
and representing the volume information according to the food material shape feature vector.
In this embodiment, the video processing unit 9006 represents the color information of the food material by the target color feature vector, and represents the volume information of the food material by the food material shape feature vector.
The above embodiments are merely illustrative of the design method of the present invention and are not intended to limit the scope of the present invention. The modifications and the conversion under the guidance of the technical scheme of the invention are all within the protection scope of the invention.
Claims (10)
1. The cooking equipment with the short video acquisition function comprises a heating unit, a cooking space for containing food materials, a camera for acquiring the change condition of the food materials in the cooking process and a control system, and is characterized in that the control system comprises a driving circuit for driving the heating unit to work and a video processing unit, the camera is used for shooting videos related to the change of the food materials, the video processing unit is used for acquiring milestone images of the food materials in the cooking stage through the camera, and selecting the videos related to the change of the food materials according to the milestone images to generate the short video of the cooking process.
2. The cooking apparatus having a short video acquiring function according to claim 1, wherein the cooking apparatus is provided with a communication unit, the control system determines a compression standard according to standard selection information and compresses the short video, and the compressed short video is transmitted through the communication unit.
3. The cooking device with the short video acquiring function according to claim 2, wherein the standard selection information includes type information of the food material and device type information of the cooking device, the control system selects an MPEG standard as a compression standard according to the standard selection information to compress the short video, and the compressed short video is sent to a cloud platform through the communication unit.
4. The cooking device with the short video acquiring function according to claim 2, wherein the standard selection information includes duration information of the short video and unique identification information of the cooking device, the control system selects an H264 standard as a compression standard according to the standard selection information to compress the short video, and the compressed short video is sent to the user terminal through the communication unit.
5. The cooking device with short video acquisition function according to claim 1, wherein the video processing unit is further configured to identify food materials and extract characteristic information of the corresponding food materials.
6. The cooking apparatus with short video acquisition function according to claim 5, wherein the characteristic information comprises color information and/or volume information of the respective food material.
7. The cooking device with the short video acquiring function according to claim 5 or 6, wherein the video processing unit determines a cooking stage in a cooking process according to the characteristic information, and screens videos related to the food material change to determine a milestone image corresponding to the cooking stage.
8. The cooking device with short video capture function according to claim 7, wherein the video processing unit determines a start frame image of the cooking stage according to a first similarity between the feature information and prior feature information, and determines the milestone image according to a second similarity between the feature information of the food material in the start frame image and the feature information of the food material in a later image, the later image being an image of the food material in an image sequence following the start frame image in the corresponding cooking stage.
9. The cooking apparatus with short video retrieval function of claim 6, wherein said video processing unit performs the following operations to characterize said color information:
extracting color histogram information of at least one frame of image in the video related to the food material change;
performing quantization processing on the color histogram information to obtain target color feature vectors of each region in a corresponding image;
and characterizing the color information according to the target color feature vector.
10. The cooking apparatus with short video acquisition function according to claim 6, wherein said video processing unit performs the following operations to characterize said volume information:
extracting contour point sequence information of at least one frame of image in the video related to the food material change;
generating a food material shape characteristic vector based on the contour point sequence information;
and representing the volume information according to the food material shape feature vector.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910389239.5A CN110222720A (en) | 2019-05-10 | 2019-05-10 | A kind of cooking equipment with short video acquisition function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910389239.5A CN110222720A (en) | 2019-05-10 | 2019-05-10 | A kind of cooking equipment with short video acquisition function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110222720A true CN110222720A (en) | 2019-09-10 |
Family
ID=67820641
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910389239.5A Pending CN110222720A (en) | 2019-05-10 | 2019-05-10 | A kind of cooking equipment with short video acquisition function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110222720A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929736A (en) * | 2021-01-22 | 2021-06-08 | 宁波方太厨具有限公司 | Intelligent cooking video generation method, electronic equipment and readable storage medium |
| CN113497971A (en) * | 2020-03-20 | 2021-10-12 | 珠海格力电器股份有限公司 | Method, device, storage medium and terminal for obtaining menu |
| CN113676706A (en) * | 2021-08-26 | 2021-11-19 | 广东美的厨房电器制造有限公司 | Cooking video generation method and device, server and control system |
| CN113907611A (en) * | 2021-09-27 | 2022-01-11 | 广东美的厨房电器制造有限公司 | Cooking apparatus, image processing method, image processing device, and readable storage medium |
| CN114885098A (en) * | 2022-04-27 | 2022-08-09 | 广东美的厨房电器制造有限公司 | Video shooting method, video shooting device, readable storage medium and cooking utensil |
| CN115460434A (en) * | 2022-07-22 | 2022-12-09 | 广东美的厨房电器制造有限公司 | Video generation method and system, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104361613A (en) * | 2014-11-20 | 2015-02-18 | 安徽工业大学 | Method for extracting target area in inner scene video of oven on basis of level set |
| CN106419498A (en) * | 2016-10-27 | 2017-02-22 | 广东格兰仕集团有限公司 | Cooking equipment controlling firepower and time based on image recognition and control method thereof |
| JP6416429B1 (en) * | 2018-05-17 | 2018-10-31 | クックパッド株式会社 | Information processing apparatus, information processing method, information processing program, and content distribution system |
| CN108742125A (en) * | 2018-06-27 | 2018-11-06 | 佛山市云米电器科技有限公司 | It is a kind of can carry out culinary art share scorch device and method |
| CN109271558A (en) * | 2018-10-08 | 2019-01-25 | 广东美的厨房电器制造有限公司 | A kind of control method and cooking equipment of cooking equipment |
| CN109310245A (en) * | 2016-05-03 | 2019-02-05 | 瑟瑞特公司 | The food preparation device of food is prepared by identifying and manipulating |
-
2019
- 2019-05-10 CN CN201910389239.5A patent/CN110222720A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104361613A (en) * | 2014-11-20 | 2015-02-18 | 安徽工业大学 | Method for extracting target area in inner scene video of oven on basis of level set |
| CN109310245A (en) * | 2016-05-03 | 2019-02-05 | 瑟瑞特公司 | The food preparation device of food is prepared by identifying and manipulating |
| CN106419498A (en) * | 2016-10-27 | 2017-02-22 | 广东格兰仕集团有限公司 | Cooking equipment controlling firepower and time based on image recognition and control method thereof |
| JP6416429B1 (en) * | 2018-05-17 | 2018-10-31 | クックパッド株式会社 | Information processing apparatus, information processing method, information processing program, and content distribution system |
| CN108742125A (en) * | 2018-06-27 | 2018-11-06 | 佛山市云米电器科技有限公司 | It is a kind of can carry out culinary art share scorch device and method |
| CN109271558A (en) * | 2018-10-08 | 2019-01-25 | 广东美的厨房电器制造有限公司 | A kind of control method and cooking equipment of cooking equipment |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113497971A (en) * | 2020-03-20 | 2021-10-12 | 珠海格力电器股份有限公司 | Method, device, storage medium and terminal for obtaining menu |
| CN112929736A (en) * | 2021-01-22 | 2021-06-08 | 宁波方太厨具有限公司 | Intelligent cooking video generation method, electronic equipment and readable storage medium |
| CN113676706A (en) * | 2021-08-26 | 2021-11-19 | 广东美的厨房电器制造有限公司 | Cooking video generation method and device, server and control system |
| CN113676706B (en) * | 2021-08-26 | 2023-09-12 | 广东美的厨房电器制造有限公司 | Cooking video generation method, device, server and control system |
| CN113907611A (en) * | 2021-09-27 | 2022-01-11 | 广东美的厨房电器制造有限公司 | Cooking apparatus, image processing method, image processing device, and readable storage medium |
| CN113907611B (en) * | 2021-09-27 | 2024-03-12 | 广东美的厨房电器制造有限公司 | Cooking device, image processing method, image processing apparatus, and readable storage medium |
| CN114885098A (en) * | 2022-04-27 | 2022-08-09 | 广东美的厨房电器制造有限公司 | Video shooting method, video shooting device, readable storage medium and cooking utensil |
| CN115460434A (en) * | 2022-07-22 | 2022-12-09 | 广东美的厨房电器制造有限公司 | Video generation method and system, computer equipment and storage medium |
| CN115460434B (en) * | 2022-07-22 | 2024-04-26 | 广东美的厨房电器制造有限公司 | Video generation method, system, computer equipment and storage medium thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110123149B (en) | Cooking control method of cooking equipment and cooking equipment | |
| CN110234040B (en) | Food material image acquisition method of cooking equipment and cooking equipment | |
| CN110222720A (en) | A kind of cooking equipment with short video acquisition function | |
| CN105187810B (en) | A kind of auto white balance method and electronic medium device based on face color character | |
| CN109349913A (en) | Cooking control method, cooking apparatus, Cloud Server and culinary art control system | |
| CN106899846A (en) | Board card testing method, device and system | |
| CN105791708A (en) | Photographing control method and device and intelligent terminal | |
| US8817125B2 (en) | Gesture recognition using chroma-keying | |
| CN103297675A (en) | Image capture method and relative image capture system | |
| CN106846304A (en) | Electrical equipment detection method and device based on infrared detection | |
| CN109491271A (en) | A kind of intelligent cooking platform and cooking methods | |
| CN112741508A (en) | Control method of cooking equipment and cooking equipment | |
| CN109407554A (en) | Kitchen automatic cooking control method, device, storage medium and computer equipment | |
| CN113676706B (en) | Cooking video generation method, device, server and control system | |
| CN111419096B (en) | Food processing method, controller and food processing equipment | |
| CN112019800A (en) | Image sharing method and device, range hood and storage medium | |
| CN114257730A (en) | Image data processing method and device, storage medium and computer equipment | |
| CN117462016A (en) | Control method and device of cooking equipment, storage medium and cooking equipment | |
| CN112789447A (en) | Method for preparing a culinary item, cooking appliance and cooking appliance system | |
| CN110661981B (en) | System for remotely controlling focusing system of camera module | |
| CN113723498A (en) | Food maturity identification method, device, system, electric appliance, server and medium | |
| CN110891143B (en) | System for remotely controlling focusing system of camera module | |
| CN110855888B (en) | Method for remotely controlling focusing system of camera module | |
| CN110730308B (en) | Method for remotely controlling focusing system of camera module | |
| CN118235970A (en) | Cooking appliance, system and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221024 Address after: 310018 No. 760 Yinhai Street, Xiasha Street, Hangzhou Economic and Technological Development Zone, Zhejiang Province Applicant after: HANGZHOU JIUYANG HOUSEHOLD ELECTRICAL APPLIANCES CO.,LTD. Address before: No. 999, Mei Li Road, Huaiyin District, Ji'nan, Shandong Applicant before: JOYOUNG Co.,Ltd. |
|
| TA01 | Transfer of patent application right |