CN116433919A - Method for detecting whether drink machine is deficient in material or not through visual recognition and drink machine - Google Patents

Abstract

The invention provides a method for detecting whether a drink machine is deficient or not through visual identification, which comprises the following steps: controlling the drink machine to enter a material shortage detection mode; controlling the discharge port of the beverage machine to discharge; collecting an image at a discharge port of the drink machine; and analyzing and processing the image to confirm whether the drink machine is deficient. The invention also provides a drink machine capable of detecting whether the drink is deficient or not through visual identification and a computer readable storage medium. By adopting the method provided by the invention, whether the drink machine lacks materials can be accurately detected, the types of the materials lacking can be accurately judged, the linkage alarm is realized, the timely supply of the materials is realized, the labor is saved, and the customer experience is improved.

Description

Method for detecting whether drink machine is deficient in material or not through visual recognition and drink machine

Technical Field

The present invention relates generally to the field of visual recognition technology, and more particularly, to a method for detecting whether a beverage machine is deficient or not by visual recognition, a beverage machine, and a computer readable storage medium.

Background

In recent years, visual recognition technology is widely applied in various fields, a machine visual recognition system captures a detection image by using a high-resolution industrial CCD and converts the detection image into a digital signal, and then advanced computer hardware and software technology is adopted to process the image data signal, so that various required target image characteristic values are obtained, and product part recognition or defect detection is realized.

The existing common method for detecting the shortage of the drink machine is non-contact liquid level sensor detection or manual inspection, the non-contact liquid level sensor detection can monitor the water level change in a water-proof way, but the problem of inaccurate detection and false alarm exists, which material is lack can not be accurately judged when the drink machine has a plurality of discharge holes depending on the manual inspection, and the working efficiency is affected.

The matters in the background section are only those known to the public and do not, of course, represent prior art in the field.

Disclosure of Invention

In view of at least one defect in the prior art, the present invention provides a method for detecting whether a beverage machine is deficient or not by visual recognition, comprising: controlling the drink machine to enter a material shortage detection mode; controlling the discharge port of the beverage machine to discharge; collecting an image at a discharge port of the drink machine; and analyzing and processing the image to confirm whether the drink machine is deficient.

According to one aspect of the invention, wherein the beverage machine comprises one or more cameras, the cameras being one or more of fixed focus cameras, auto focus cameras and zoom cameras, wherein the cameras are focused at the outlet, the step of capturing an image at the beverage machine outlet comprising capturing an image at the beverage machine outlet by the cameras.

According to one aspect of the present invention, the step of controlling the beverage machine to enter the material shortage detection mode includes: and selecting through a display screen and/or keys of the drink machine, and controlling the drink machine to enter a material shortage detection mode.

According to one aspect of the present invention, the step of controlling the drink machine to enter the material shortage detection mode further comprises: and controlling the drink machine to turn on the lighting system.

According to one aspect of the invention, the step of controlling the discharge of the outlet of the beverage machine comprises: and controlling one and/or a plurality of and/or all the discharge ports of the drink machine to discharge according to a preset discharge strategy, wherein the discharge duration of each discharge port is determined according to a preset threshold value.

According to one aspect of the invention, the step of collecting the image information at the outlet of the beverage machine comprises the following steps: and collecting an image at a discharge hole of the drink machine, wherein the image comprises a photo and/or a video.

According to one aspect of the present invention, the step of analyzing the image to confirm whether the beverage machine is deficient comprises: and extracting information features of the images, comparing the difference between the information features of the images and the information features of the images pre-stored at the corresponding discharge holes when the materials are sufficient, and judging that the corresponding discharge holes are deficient when the difference is larger than a preset threshold value, wherein the information features comprise one or more of color, shape, quantity and diameter.

According to one aspect of the present invention, the step of analyzing the image to confirm whether the beverage machine is deficient further comprises: and extracting information characteristics of images at different moments at the same discharge port, comparing differences between a later frame of image and a previous frame of image, and judging that the corresponding discharge port is deficient when the differences are larger than a preset threshold value.

According to one aspect of the invention, when the material shortage of the corresponding material outlet is detected, the drink machine alarms, and displays the material shortage, the lighting system is turned off, and the single detection is finished.

The invention also relates to a computer readable storage medium comprising computer executable instructions stored thereon, which when executed by a processor implement a method as described above.

The invention also relates to a drink machine capable of detecting whether the drink is deficient through visual identification, which comprises: one or more material storage containers which are communicated with the discharge port; the image acquisition unit is configured to acquire images at the discharge port; the industrial control unit is configured to control the drink machine to enter a material shortage detection mode and control the discharge port and the image acquisition unit, wherein the industrial control unit is configured to judge whether the material storage container is in shortage or not according to the image acquired by the image acquisition unit.

According to one aspect of the present invention, further comprising: a display unit configured to receive an operation instruction of a user and display a detection result; and the discharging control unit comprises one or more discharging controllers which are coupled to the industrial control unit and the discharging port and control the discharging port to discharge according to the instruction of the industrial control unit.

According to one aspect of the present invention, further comprising: and the illumination system is coupled with the industrial control unit and is configured to be lightened when the drink machine enters a material shortage detection mode.

By the method, whether the drink machine lacks materials or not can be accurately detected, the types of the materials lacking can be accurately judged, linkage alarm is realized, timely material supply is realized, labor is saved, and customer experience is improved.

Drawings

The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:

FIG. 1 shows a flow chart of a method for detecting whether a beverage machine is deficient through visual identification according to one embodiment of the invention;

FIG. 2 shows a system schematic of a beverage machine according to one embodiment of the invention;

FIG. 3 illustrates a schematic diagram of the operational mode of a beverage machine according to one embodiment of the present invention;

FIG. 4 shows a schematic diagram of controlling discharge of a discharge port according to an embodiment of the present invention; and

fig. 5 to 8 are schematic diagrams showing a drink machine according to an embodiment of the present invention, wherein the drink machine is judged whether to be deficient according to information characteristics of images.

Detailed Description

Hereinafter, only certain exemplary embodiments are briefly described. As will be recognized by those of skill in the pertinent art, the described embodiments may be modified in various different ways without departing from the spirit or scope of the present invention. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive.

In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more of the described features. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be fixedly connected, detachably connected, or integrally connected, and may be mechanically connected, electrically connected, or may communicate with each other, for example; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.

In the present invention, unless expressly stated or limited otherwise, a first feature "above" or "below" a second feature may include both the first and second features being in direct contact, as well as the first and second features not being in direct contact but being in contact with each other through additional features therebetween. Moreover, a first feature being "above," "over" and "on" a second feature includes the first feature being directly above and obliquely above the second feature, or simply indicating that the first feature is higher in level than the second feature. The first feature being "under", "below" and "beneath" the second feature includes the first feature being directly above and obliquely above the second feature, or simply indicating that the first feature is less level than the second feature.

The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. In order to simplify the present disclosure, components and arrangements of specific examples are described below. They are, of course, merely examples and are not intended to limit the invention. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples, which are for the purpose of brevity and clarity, and which do not themselves indicate the relationship between the various embodiments and/or arrangements discussed. In addition, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art will recognize the application of other processes and/or the use of other materials.

The embodiments of the present invention will be described below with reference to the accompanying drawings, and it should be understood that the embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.

Fig. 1 illustrates a method 10 for detecting a deficiency of a beverage machine by visual recognition, including steps S11-S14, in accordance with one embodiment of the present invention, and before describing the various steps of the method 10, a beverage machine 20 that may employ the method 10 is first described.

Fig. 2 shows a system schematic of drink machine 20. As shown in fig. 2, drink machine 20 includes one or more material storage containers 21, an image acquisition unit 22, an industrial control unit 23, and a display unit 24. The material storage container 21 is communicated with the discharge hole 211; the image acquisition unit 22 is configured to acquire an image at the discharge port 211; the industrial control unit 23 is configured to control the drink machine 20 to enter a material shortage detection mode, control the discharge port 211 and the image acquisition unit 22, and determine whether the material storage container 21 is deficient according to the image acquired by the image acquisition unit 22. In addition, the beverage maker 20 further includes: a display unit 24 configured to receive an operation instruction of a user and display a detection result; and a discharge control unit 231, the discharge control unit 231 including one or more discharge controllers 2311, the discharge control unit 231 being coupled to the industrial control unit 23 and the discharge port 211, and controlling the discharge of the discharge port 211 according to an instruction of the industrial control unit 23. In addition, the beverage maker 20 further includes an illumination system 232, the illumination system 232 being coupled to the industrial control unit 23 and configured to illuminate when the beverage maker 20 enters the detect starved mode. The individual steps of method 10 are described in detail below.

In step S11, the beverage machine is controlled to enter a material shortage detection mode.

Fig. 3 shows a schematic view of the operation mode of drink machine 20. As shown in FIG. 3, drink machine 20 includes various modes of operation such as a food order mode, a detect starvation mode, a standby mode, a purge mode, etc., and drink machine 20 may be selected by display unit 24 (see FIG. 2) to enter different modes of operation. Specifically, the display unit 24 includes one or more display screens, which may be any one or more of an LCD display screen, an LED display screen, an OLED display screen, and a ULED display screen, for receiving an operation instruction of a user. The invention is not limited to the particular type, number, and location of the display screens on the drink machine 20. Preferably, the display screen is an LED touch display screen, and the user can select the working mode of the drink machine 20 by directly touching the LED touch display screen, so that the operation is simple, energy-saving and economical. Optionally, the user may also select the operating mode of the beverage machine (not shown in the figures) by means of keys and/or a remote control and/or APP program software. When the user selects the "detect starved mode", the beverage machine 20 enters the detect starved mode. It is to be understood that the foregoing is illustrative only and is not to be construed as limiting the present invention.

In step S12, the discharge port of the drink machine is controlled to discharge.

Fig. 4 shows a schematic diagram of controlling the discharge of the discharge opening. As shown in fig. 4, beverage appliance 20 includes one or more material storage containers 21 and one or more discharge ports 211, each material storage container 21 being in communication with a corresponding discharge port 211. The beverage maker 20 further includes an industrial control unit 23 (refer to fig. 2), the industrial control unit 23 includes one or more discharge control units 231 (refer to fig. 2), and the discharge control unit 231 includes one or more discharge controllers 2311. The discharging control unit 231 is coupled to the industrial control unit 23 and the discharging port 211, and selects a corresponding discharging controller 2311 according to the instruction of the industrial control unit 23 to control the discharging of the corresponding discharging port 211. When drink machine 20 enters the detect starved mode, discharge port 211 may discharge according to a discharge strategy preset by the user. The discharge strategy includes allowing only a certain discharge port 211 to discharge, allowing only a certain number of discharge ports 211 to discharge, and/or allowing all discharge ports 211 to discharge.

Specifically, according to one embodiment of the present invention, referring to FIG. 4, for example, when only discharge port 211-A is allowed to discharge, discharge controller 2311-A controls discharge port 211-A, while other discharge controllers 2311-B, 2311-C, 2311-D control corresponding discharge ports 211-B, 211-C, 211-D, respectively, to not discharge.

According to one embodiment of the present invention, when only discharge ports 211-A and 211-B are allowed to discharge, discharge controller 2311-A controls discharge port 211-A to discharge, discharge controller 2311-B controls discharge port 211-B to discharge, while other discharge controllers 2311-C, 2311-D control corresponding discharge ports 211-C, 211-D, respectively, to not discharge.

According to one embodiment of the present invention, when all the discharge ports (211-A, 211-B, 211-C, 211-D) are allowed to discharge, the corresponding discharge ports (211-A, 211-B, 211-C, 211-D) are controlled to discharge by the corresponding discharge controllers (2311-A, 2311-B, 2311-C, 2311-D), respectively.

In addition, the discharging strategy further comprises the step of setting the discharging sequence and time interval of each discharging hole 211. According to one embodiment of the present invention, for example, discharge port 211-C begins to discharge and discharge port 211-B is again discharged at intervals of 2 seconds or 4 seconds.

The outfeed strategy also includes setting the duration of the outfeed of each outfeed port 211, which may be determined according to a preset threshold, such as 2 seconds, 4 seconds, 6 seconds, etc. According to one embodiment of the present invention, referring to FIG. 4, for example, the discharge controller 2311-A first controls the discharge of the discharge port 211-A, and after 2 seconds, the discharge port 211-B starts discharging.

The above illustrates the discharging strategy of the beverage machine 20, and the user may set the discharging strategy according to the actual needs at will, if the discharging strategy is not set deliberately, when the beverage machine 20 enters the material shortage detection mode, all the discharging ports 211 will be discharged simultaneously by default and last for 2 seconds. It should be understood that the above discharge strategy is merely illustrative and not limiting of the present invention.

In step S13, an image of the outlet of the beverage machine is acquired.

The beverage maker 20 further includes an image capturing unit 22 (see fig. 2), the image capturing unit 22 including one or more cameras, which may be one or more of a fixed focus camera, an autofocus camera, and a zoom camera, the invention is not limited to the type, number, and specific location of the cameras on the beverage maker 20. The camera is focused on the discharge port 211 of the drink machine 20 and collects images at the discharge port 211, wherein the images can be photos or videos. In addition, the beverage maker 20 further includes a lighting system 232, the lighting system 232 includes one or more bulbs, when the beverage maker 20 enters the material shortage detection mode, the lighting system 232 can automatically turn on the lighting discharge port, and can dynamically adjust the brightness of the bulbs according to the intensity change of ambient light, so that the image collected by the camera is clearer, and the specific power and type of the bulbs of the lighting system 232 are not limited in the invention. When the drink machine 20 is in the non-detection material shortage mode, the image acquisition unit 22 and the illumination system 232 of the drink machine 20 can be automatically closed, so that energy conservation is facilitated; or not closed for customer face payment. Of course, the image acquisition unit 22 and the illumination system 232 may also be manually controlled, preferably automatically controlled by the beverage maker 20, saving labor.

In step S14, the image is analyzed to confirm whether or not the drink machine 20 is deficient.

Before confirming whether the beverage machine 20 is out of stock, it is determined whether the beverage machine 20 has a discharging action. Specifically, the image at the discharge port collected by the image collecting unit 22 can be compared with the pre-stored image corresponding to the absence of the material at the discharge port, and when the difference between the two images is greater than a preset threshold (for example, 15%), the discharge action of the discharge port can be considered. Specifically, the industrial control unit 23 extracts the information features of the image acquired by the image acquisition unit 22 at the discharge port, compares the information features with the pre-stored information features of the image corresponding to the insufficient material at the discharge port, calculates the difference between the two features, and judges that the corresponding discharge port is deficient when the difference is greater than a preset threshold value. According to one embodiment of the present invention, when the absolute value of the difference between the two is greater than a preset threshold (e.g., 50%, or 60%, or 70%), the corresponding tap may be considered to be out of charge. Alternatively, the relative difference between the two can be calculated, e.g.

When the result is greater than a preset threshold (e.g., 30%, or 40%, or 50%), the corresponding tap is deemed to be empty. The information features include one or more of color, shape, number, diameter of the material. In addition, the information features of the images at different moments at the same discharge port can be extracted, the difference between the image of the next frame and the image of the previous frame is compared, and when the difference is greater than a preset threshold (for example, 10%, or 5%, or 1%), the corresponding discharge port is judged to be deficient. The present invention is not limited to the extraction method of the information features of the image, and various embodiments are specifically described below.

According to a preferred embodiment of the present invention, whether the beverage maker 20 is deficient or not can be determined according to the color of the material. Referring to fig. 5, for example, the material storage containers 21-a, 21-B, 21-C, 21-D store watermelon juice, orange juice, milk, and cucumber juice, respectively. All the discharge ports (211-A, 211-B, 211-C and 211-D) are discharged simultaneously for 2 seconds by default, and the image acquisition unit 22 (refer to figure 2) continuously acquires images at the discharge ports (211-A, 211-B, 211-C and 211-D) during the discharge period, and the analysis and the processing are performed by the industrial control unit 23 (refer to figure 2). The industrial control unit 23 extracts the color characteristics of the images acquired at the discharge ports (211-A, 211-B, 211-C and 211-D), compares the color characteristics with the colors of the images pre-stored corresponding to the discharge ports when the discharge ports are full of materials, calculates the absolute value of the difference value between the color characteristics and the color characteristics, and considers that the corresponding discharge ports are deficient when the calculation result is larger than a preset threshold (for example, 50%, or 60%, or 70%). Specifically, for example, when the calculated result at the discharge port 21-B is greater than 50%, the discharge port 211-B is considered to be deficient, i.e., the beverage machine 20 lacks orange juice. When the calculated result at the discharge port 211-C is 20%, the discharge port 211-C is considered to be not deficient, namely the drink machine 20 is not deficient in milk. In addition, alternatively, the relative difference between the color characteristics of the image acquired at the discharge port and the color of the image corresponding to the foot material pre-stored in advance can be calculated, and the description is omitted. It should be understood that this example is illustrative only and is not intended to limit the invention, and that this example is particularly useful for materials having relatively unique colors.

According to a preferred embodiment of the present invention, it is possible to determine whether the beverage maker 20 is deficient according to the shape of the material. Referring to fig. 6, for example, the material storage containers 21-E, 21-F store pearl milk tea and coconut milk tea, respectively. The default discharge ports 211-E and 211-F discharge simultaneously for 2 seconds, and the image acquisition unit 22 continuously acquires images at the two discharge ports (211-E and 211-F) during the discharge period, and the analysis and the processing are performed by the industrial control unit 23. Specifically, the industrial control unit 23 extracts the shape features of the images collected at the two discharge ports (211-E, 211-F), compares the shape features with the shape of the image pre-stored corresponding to the material at the discharge port, calculates the absolute value of the difference between the shape features and the shape features, and considers that the corresponding discharge port is deficient when the calculated result is greater than a preset threshold (for example, 50%, or 60%, or 70%). Specifically, if the absolute value of the difference at the outlet 21-E is calculated to be greater than 50%, the drink machine 20 is considered to lack the pearl milk tea. Alternatively, the relative difference between the shape features of the image acquired at the discharge port and the shape of the image corresponding to the foot material pre-stored in advance can be calculated, and the detailed description is omitted. It should be understood that this example is illustrative only and is not intended to limit the invention, and that this example is particularly useful for materials having relatively unique shapes.

According to a preferred embodiment of the present invention, it is also possible to determine whether the beverage maker 20 is deficient based on the amount of material. Referring to fig. 7, for example, a material storage container 21-G stores pearl milk tea. The default discharge port 211-G continuously discharges for 2 seconds, and during the discharge period, the image acquisition unit 22 continuously acquires images at the discharge port 211-G and the industrial control unit 23 performs analysis and processing. Specifically, the industrial control unit 23 extracts the number features of the images collected at the discharge port 211-G, compares the number features with the number of coconuts pre-stored in advance when the discharge port is full of material, calculates the absolute value of the difference between the two, and considers that the corresponding discharge port is deficient when the calculated result is greater than a preset threshold (for example, 50%, or 60%, or 70%). Alternatively, the relative difference between the number features of the images acquired at the discharge port and the number of the images pre-stored in advance corresponding to the foot materials can be calculated, and the detailed description is omitted. It is to be understood that this example is merely illustrative and is not to be construed as limiting the invention, which is particularly applicable to solid materials or solid-liquid mixtures.

According to a preferred embodiment of the present invention, it is also possible to determine whether the beverage maker 20 is deficient based on the diameter of the material. Referring to fig. 8, for example, the material storage container 21-H stores watermelon juice, when the beverage machine 20 enters the material shortage detection mode, the discharge port 211-H discharges for 2 seconds to form a liquid column, during this period, the image acquisition unit 22 acquires images at the discharge port 211-H, the industrial control unit 23 extracts diameters of the liquid column at different times and calculates an average value thereof, and compares the absolute value or the relative difference value of the difference value between the average value and the diameter of the discharge port 211-H when the material shortage is detected, and when the difference value is greater than a preset threshold (for example, 40% or 50% or 60%), the material shortage of the discharge port 211-H is judged, namely, the watermelon juice shortage of the beverage machine 20. In addition, the information features of the images at different moments at the same discharge port can be extracted, the difference between the image of the next frame and the image of the previous frame is compared, and when the difference is greater than a preset threshold (for example, 10%, or 5%, or 1%), the corresponding discharge port is judged to be deficient. For example, at the same discharge hole, at the time t1, the diameter of the liquid column is d2; at time t2, the liquid column diameter is d2, the variation delta d of the liquid column diameter=d2-d 1, when the variation delta d of the liquid column diameter is 20%, the variation delta d is greater than a preset threshold value of 10%, and the corresponding discharge port is judged to be deficient. This embodiment is particularly suitable for liquid materials. It is to be understood that this example is illustrative only and is not to be construed as limiting the invention.

The above list of 4 examples of information features, these 4 examples may be taken as information features alone or any two or more combinations thereof, and are within the scope of the present invention. The following describes determining whether drink machine 20 is deficient based on a plurality of information characteristics.

According to a preferred embodiment of the present invention, the industrial control unit 23 extracts the color, shape, number and diameter of the images collected at the discharge port 211, compares them with the color, shape, number and diameter of the images pre-stored corresponding to the images at the discharge port, calculates the absolute value or relative difference of the differences of the respective information features, and further compares the differences of the numbers and/or diameters to determine whether the beverage machine 20 is deficient or not and whether the beverage is deficient in the beverage product when the differences of the colors and/or shapes are not greater than a preset threshold. It is to be understood that this example is illustrative only and is not to be construed as limiting the invention.

According to a preferred embodiment of the present invention, images including, but not limited to, the above various embodiments of the beverage machine 20 when the beverage machine 20 is starved and/or is full of material may also be stored in the beverage machine 20, so that the beverage machine 20 can learn deeply, and a neural network is constructed, thereby improving the accuracy of detecting whether the beverage machine 20 is starved.

When the drink machine 20 detects the shortage of the material at the discharge port according to the method, the drink machine 20 alarms, the display unit 24 displays the shortage of the material, the illumination system 232 is turned off, the single detection is finished, and the staff timely supplies the shortage of the material. The drink machine 20 may enter the material shortage detection mode by being automatically started at regular time in addition to entering the material shortage detection mode by manually inputting instructions.

The present invention also relates to a beverage machine 20, referring to fig. 2, comprising one or more material storage containers 21, said material storage containers 21 being in communication with a discharge opening 211; an image acquisition unit 22 configured to acquire an image at the discharge port 211; the industrial control unit 23 is configured to control the drink machine 20 to enter a material shortage detection mode and control the discharge port 211 and the image acquisition unit 22, wherein the industrial control unit 23 is configured to determine whether the material storage container 21 is in a material shortage state according to the image acquired by the image acquisition unit 22. In addition, the beverage maker 20 further includes: a display unit 24 configured to receive an operation instruction of a user and display a detection result; a discharge control unit 231, wherein the discharge control unit 231 includes one or more discharge port controllers 2311 coupled to the industrial control unit 23 and the discharge port 211, and controls the discharge port 211 to discharge according to an instruction of the industrial control unit 23. In addition, the beverage maker 20 further comprises an illumination system 232, the illumination system 232 being coupled to the industrial control unit 23 and configured to illuminate when the beverage maker 20 enters a material shortage detection mode.

The invention also relates to a computer readable storage medium comprising computer executable instructions stored thereon, which when executed by a processor implement the method 10 as described above.

By adopting the method provided by the invention, whether the drink machine lacks materials can be accurately detected, the types of the materials lacking can be accurately judged, the linkage alarm is realized, the timely supply of the materials is realized, the labor is saved, and the customer experience is improved.

Finally, it should be noted that: the foregoing description is only a preferred embodiment of the present invention, and the present invention is not limited thereto, but it is to be understood that modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art, although the present invention has been described in detail with reference to the foregoing embodiments. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (13)

1. A method for detecting whether a beverage machine is deficient through visual recognition, comprising:

controlling the drink machine to enter a material shortage detection mode;

controlling the discharge port of the beverage machine to discharge;

collecting an image at a discharge port of the drink machine; and

and analyzing and processing the image to confirm whether the drink machine is deficient.

2. The method of claim 1, wherein the beverage machine comprises one or more cameras, the cameras being one or more of fixed focus cameras, auto focus cameras, and zoom cameras, wherein the cameras are focused at the outlet, the step of capturing an image at the beverage machine outlet comprising capturing an image at the beverage machine outlet by the cameras.

3. The method of claim 1, wherein the step of controlling the beverage machine to enter a detect starvation mode comprises: and selecting through a display screen and/or keys of the drink machine, and controlling the drink machine to enter a material shortage detection mode.

4. The method of any of claims 1-3, wherein the step of controlling the drink machine to enter a detect starvation mode further comprises: and controlling the drink machine to turn on the lighting system.

5. A method according to any one of claims 1-3, wherein the step of controlling the tapping of the tap of the beverage machine comprises:

and controlling one and/or a plurality of and/or all the discharge ports of the drink machine to discharge according to a preset discharge strategy, wherein the discharge duration of each discharge port is determined according to a preset threshold value.

6. The method of any one of claims 1-3, wherein the step of acquiring image information at a beverage machine outlet comprises:

and collecting an image at a discharge hole of the drink machine, wherein the image comprises a photo and/or a video.

7. A method according to any one of claims 1-3, wherein said step of analyzing the image to confirm whether the beverage machine is deficient comprises:

and extracting information features of the images, comparing the difference between the information features of the images and the information features of the images pre-stored at the corresponding discharge holes when the materials are sufficient, and judging that the corresponding discharge holes are deficient when the difference is larger than a preset threshold value, wherein the information features comprise one or more of color, shape, quantity and diameter.

8. A method according to any one of claims 1-3, wherein the step of analyzing the image to confirm whether the beverage machine is deficient further comprises:

and extracting information characteristics of images at different moments at the same discharge port, comparing differences between a later frame of image and a previous frame of image, and judging that the corresponding discharge port is deficient when the differences are larger than a preset threshold value.

9. A method according to any one of claims 1-3, wherein the beverage machine alarms when a corresponding outlet is detected as being deficient, and displays the class of deficient products, the lighting system is turned off, and the single detection is ended.

10. A computer readable storage medium comprising computer executable instructions stored thereon, which when executed by a processor, implement the method of any of claims 1-9.

11. A beverage machine that detects lack of material through visual recognition, comprising:

one or more material storage containers which are communicated with the discharge port;

the image acquisition unit is configured to acquire images at the discharge port;

the industrial control unit is configured to control the drink machine to enter a material shortage detection mode and control the discharge port and the image acquisition unit, wherein the industrial control unit is configured to judge whether the material storage container is in shortage or not according to the image acquired by the image acquisition unit.

12. The beverage machine of claim 11, further comprising:

a display unit configured to receive an operation instruction of a user and display a detection result;

and the discharging control unit comprises one or more discharging controllers which are coupled to the industrial control unit and the discharging port and control the discharging port to discharge according to the instruction of the industrial control unit.

13. The beverage machine according to claim 11 or 12, further comprising: and the illumination system is coupled with the industrial control unit and is configured to be lightened when the drink machine enters a material shortage detection mode.

Images