JP6837034B2 - Display shelves - Google Patents

Description

The present invention relates to an information processing device, a terminal device, a display shelf, an information processing system, an information processing method, and a program.

A technique for providing a video of cooking procedures (recipe) via the Internet is known. For example, in Patent Document 1, when a member inputs a cooking code number selected from a cookbook, a cooking demonstration video corresponding to the cooking code number is broadcast on the screen of the member's terminal via the Internet. The system is disclosed.

Japanese Unexamined Patent Publication No. 2003-219066

As described above, in the cooking procedure explanation video that the user browses on demand, it is generally required to carefully explain the cooking method that is difficult to convey only with letters and photographs. On the other hand, in stores such as supermarkets, it is being considered to install a terminal device at each food sales floor, play a cooking video of food related to the products in the sales floor on the terminal device, and utilize it for sales promotion. In such a case, since it is assumed that the customer who is shopping does not pay attention to the cooking video for a long time, it is required to provide the video that motivates the customer to purchase in a shorter time.

The present invention has been made in view of the above points, and is an information processing device, a terminal device, a display shelf, an information processing system, an information processing method, and an information processing device capable of providing a cooking moving image suitable for reproduction in a store. One of the purposes is to provide a program.

One aspect of the present invention is a display shelf in which a terminal device and ingredients are displayed together, and the terminal device includes an input unit that receives an instruction for playing a moving image of a recipe in which the ingredients are used, and the above. Based on the instruction, the output control unit includes an output control unit that repeatedly reproduces a moving image of a video of a series of cooking scenes including the first cooking process and the second cooking process, and the output control unit is the first cooking process. The display shelf is characterized in that the image of the above and the image of the second cooking process are reproduced at different allotted times .

Further, one aspect of the present invention is a display shelf in which a terminal device and a recipe card are displayed together, and the terminal device receives an instruction for playing a moving image of the recipe described in the recipe card. The output control unit includes a unit and an output control unit that repeatedly reproduces a moving image of a video of a series of cooking scenes including a first cooking process and a second cooking process based on the instruction. The display shelf is characterized in that the video of the first cooking process and the video of the second cooking process are reproduced at different allotted times .

Further, one aspect of the present invention is any of the above display shelves, wherein the output control unit displays an advertisement every time a moving image of a video of the cooking scenery is reproduced a predetermined number of times. It is a display shelf to be used.

Further, one aspect of the present invention is any of the above display shelves, the first cooking step is a step of frying the ingredients or a step of combining the ingredients, and the second cooking step is a step of copying the ingredients or seasoning. It is a step of adjusting the charges, and the output control unit is a display shelf characterized in that the video of the second cooking process is reproduced in a shorter allotted time than the video of the first cooking process .

Further, one aspect of the present invention is any of the above display shelves, the first cooking step is a step of frying the ingredients or a step of combining the ingredients, and the second cooking step is a step of copying the preparation or the ingredients. The output control unit is a display shelf characterized in that the video of the second cooking process is reproduced in a shorter allotted time than the video of the first cooking process .

Further, one aspect of the present invention is any of the above display shelves, the first cooking step is a step of copying ingredients or a step of combining seasonings, and the second cooking step is a step of copying the preparation. Alternatively, it is a step of cutting foodstuffs, and the output control unit is a display shelf characterized in that the video of the second cooking process is reproduced in a shorter allotted time than the video of the first cooking process .

Further, one aspect of the present invention is a procedure of classifying an image of a cooking scene into a plurality of cooking processes on a computer, a procedure of setting an importance to the cooking process, and the cooking according to the importance. It is a program for editing a video corresponding to a process and executing a procedure for generating a moving image at a predetermined time.

Further, one aspect of the present invention is an information processing method executed by a terminal device installed in a store and displaying a moving image showing a cooking procedure, based on a step of receiving a moving image reproduction instruction from a clerk and the reproduction instruction. Then, a step of repeatedly playing back a moving image of a video of a series of cooking scenes including the first cooking process and the second cooking process, at least a part of the video of the first cooking process, and the second cooking process. It is an information processing method characterized by including at least a part of video and a step of reproducing at different double speeds.

Further, one aspect of the present invention is a procedure of receiving a video playback instruction from a clerk on a computer, and a video of a series of cooking scenes including a first cooking step and a second cooking step based on the playback instruction. To execute a procedure for repeatedly playing back a moving image and a procedure for playing back at least a part of the video of the first cooking step and at least a part of the video of the second cooking step at different double speeds. It is a program.

According to one aspect of the present invention, it is possible to provide a cooking moving image suitable for reproduction in a store.

It is a system block diagram which shows the structural example of the information processing system which concerns on embodiment of this invention. It is a figure which shows the installation example of the terminal apparatus which concerns on the same embodiment. It is a figure which shows an example of the data structure of the menu data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the menu attribute data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the recipe data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the recipe attribute data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the food material data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the cooking data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the report data which concerns on this embodiment. It is a figure which shows an example of the data structure of the user data which concerns on this embodiment. It is a figure which shows an example of the data structure of the recipe moving image attribute data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the cooking process data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the importance correspondence data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the importance setting data which concerns on the same embodiment. It is a figure which shows an example of the data structure of the recipe moving image attribute data for a store which concerns on the same embodiment. It is a block diagram which shows the structural example of the recipe management apparatus which concerns on the same embodiment. It is a figure which shows the composition image of the recipe movie which concerns on the same embodiment. It is a figure which shows the composition image of the recipe video for a store which concerns on the same embodiment. It is a flowchart which shows the processing example of the recipe management apparatus which concerns on the same embodiment. It is a block diagram which shows the structural example of the terminal apparatus which concerns on this embodiment. It is a figure which shows the screen display example of the terminal apparatus which concerns on the same embodiment. It is a flowchart which shows the processing example of the terminal apparatus which concerns on this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Overview of Information Processing System 1]
First, the configuration of the information processing system 1 according to the embodiment of the present invention will be described.
FIG. 1 is a system configuration diagram showing a configuration example of the information processing system 1. The information processing system 1 includes a recipe management device 10, terminal devices 20-1, 20-2, 20-3 installed in store A, and terminal devices 20-4, 20-5, 20 installed in store B. It is configured with -6. Hereinafter, the terminal devices 20-1, 20-2, ..., 20-6 are collectively referred to as the terminal device 20. In addition, store A and store B are collectively referred to as stores. The recipe management device 10 and the terminal device 20 can be connected to a wired or wireless network NW and communicate with each other. The recipe management device 10 may be connected in the same manner as stores other than the illustrated stores A and B. The store A and the store B are not limited to the illustrated terminal devices 20-1, ..., 20-6, and other terminal devices 20 may be installed. Further, the functions of the recipe management device 10 may be distributed to a plurality of devices to form a system.

The recipe management device 10 is an information processing device, for example, a server device. The recipe management device 10 manages various information for providing cooking information such as menu data, menu attribute data, recipe data, recipe attribute data, ingredient data, cooking data, and report data, which will be described later. The recipe management device 10 has a WEB server function, and may provide cooking information in response to a request from another device (user) connected via the network NW. The recipe management device 10 manages a moving image (also referred to as a recipe moving image) in which a state of cooking (also referred to as a cooking scene) based on the recipe is photographed. The recipe video is a video that visually explains the cooking process, and is usually about 1 minute long. The cooking process represents a unit of work in cooking such as cutting ingredients, mixing ingredients, and frying ingredients.

The recipe management device 10 generates a moving image (also referred to as a recipe moving image for a store) suitable for reproduction in a food section of a store such as a supermarket based on the recipe moving image, and provides the terminal device 20 with the moving image. The recipe management device 10 classifies the recipe video into a plurality of cooking processes, sets the importance for each cooking process, edits the video corresponding to each cooking process according to the set importance, and for a predetermined time. Generate a video. The predetermined time is a time shorter than the playback time of the recipe video. Specifically, the time is within 30 seconds, preferably about 15 seconds. The predetermined time is a time calculated in consideration of the average residence time and the like at each sales floor of the customer, and can be changed depending on various conditions such as the store, the sales floor, and the recipe.

The recipe management device 10 allocates, for example, a reproduction time for a video corresponding to each cooking process according to the importance. Further, for example, the recipe management device 10 sets a double speed rate for a video corresponding to each cooking process according to the importance. Further, for example, the recipe management device 10 sets the number of cuts (the number of scene changes) for the video corresponding to each cooking process according to the importance. Further, for example, the recipe management device 10 sets a composition (camera angle, camera position, zoom rate, etc.) for an image corresponding to each cooking process according to the importance. Further, for example, the recipe management device 10 sets the composition for the image corresponding to the cooking process according to the cooking or the cooking process during cooking. Further, for example, the recipe management device 10 displays a telop showing the name and amount of the cooking ingredient together with the corresponding image. Further, for example, the recipe management device 10 sets the display position of the telop so as not to overlap with the cooking and cooking utensils.

The terminal device 20 is installed in each store such as store A and store B. Here, the store is a general retail store that sells products and the like necessary for cooking, and is, for example, a supermarket, a home center, a pharmacy, and the like. The terminal device 20 is installed at each food section of the store. In the example of FIG. 1, the terminal device 20-1 is installed in the agricultural product section (corner) that sells vegetables, etc., the terminal device 20-2 is installed in the livestock section that sells meat, etc., and the fishery section that sells fresh fish, etc. The terminal device 20-3 is installed in. Similarly, in store B, terminal devices 20-4, 20-5, and 20-6 are installed for each sales floor. The type of sales floor in each store is not limited to the above example.

Here, an installation example of the terminal device 20 will be described with reference to FIG.
FIG. 2 is a diagram showing an installation example of the terminal device 20. In this example, the terminal device 20 (20-1) is installed in the area A1 in the agricultural product section of the store A. The terminal device 20 reproduces a video of a recipe related to an ingredient sold at the sales floor among the recipe videos for stores acquired from the recipe management device 10. The video is, for example, a video of a recipe related to an ingredient being promoted. In the area of A2, the main ingredients in the recipe video for stores are displayed. In the area of A3, ingredients related to recipe videos for stores are displayed. The related ingredients are, for example, sub-ingredients of the recipe, seasonings used, and the like. Further, in the A4 area, recipe cards corresponding to recipe videos for stores are displayed. The recipe card is a card on which a recipe is described, and for example, a description of a dish associated with each cooking process may be described. The recipe card can be freely taken home by customers who are interested in the recipe by watching the recipe video for stores.

The terminal device 20 repeatedly and continuously reproduces the recipe movie for stores acquired from the recipe management device 10. Further, the terminal device 20 displays an advertisement related to the recipe video and the sales floor every time the recipe video for the store is played back a predetermined number of times. The predetermined number of times is preferably 2 to 4 times in consideration of the residence time at the customer's sales floor, the playback time of the recipe video for the store, and the like.

As described above, according to the information processing system 1 according to the present embodiment, it is possible to provide a recipe moving image (cooking moving image) suitable for reproduction at a food sales floor. In other words, it is possible to promote sales by effectively attracting the attention of customers and motivating them to purchase products in a short time at each sales floor.
Further, in the store (sales floor) of the present embodiment, the ingredients (promotional products) sold at the sales floor are displayed together with the terminal device 20 that displays the sales promotion recipe in which the sales promotion products are the main ingredients. Then, the terminal device 20 is displayed together with the recipe card, and the sales promotion product or the terminal device 20 is displayed together with the related product. Here, to be displayed together means, for example, that they are arranged in the surroundings (for example, within a radius of 1 m), the same display place (the same display shelf (including the display stand and the display case), or the vicinity thereof, etc. ), And being placed within reach while looking at the display on the terminal device 20. For example, the terminal device 20 is performed using furniture, for example, and is placed on the same display case, display shelf, or display stand as the promotional product. However, the present invention is not limited to this, and the terminal device 10 may be hung on a wall, or may be hung from a ceiling or a shelf.
That is, the display shelf of FIG. 2 is a display shelf installed in a store and displaying a terminal device, a recipe card, and a promotional product (foodstuff) together.

[Data structure]
Next, the configuration of various data processed by the recipe management device 10 or the terminal device 20 will be described.
FIG. 3 is a diagram showing an example of the data structure of the menu data. The menu data is data that describes information about the contents of the menu, and is data in which one or more constituent food information is associated with the menu ID (Identifier).

The menu ID is information for uniquely identifying the menu. The constituent dish information is information indicating the dishes that make up the menu. In the constituent dish information, the constituent dish recipe information and the constituent dish category information are described. The constituent dish recipe information is information for identifying the recipe of the dish that constitutes the menu. For example, a recipe ID is described in the constituent dish recipe information. The recipe ID is information for uniquely identifying a cooking recipe. The constituent dish category information is information indicating the position (type) of the dish in the menu. In the constituent dish category information, for example, the type of main dish, side dish, soup, dessert, etc. may be described.

By referring to such menu data, the recipe management device 10 can specify the dishes constituting the menu and their types.

FIG. 4 is a diagram showing an example of a data structure of menu attribute data. Menu attribute data includes menu name information, menu poster information, menu registration date and time information, menu image information, poster comment information, setup comment information, and menu cooking time information for the menu ID. , Menu category information, membership permission information, and menu report number information are associated with each other.

Menu name information is information indicating the name of the menu. The name of the menu includes the names of the dishes and ingredients that make up the menu. Menu poster information is information indicating the poster (creator) of the menu. For example, a user ID is described in the menu poster information. Menu registration date and time information is information indicating the date and time when the menu was posted and registered. Menu image information is information indicating a captured image of a menu. The contributor comment information is information indicating a comment (for example, outline, background) given by the contributor to the menu. The setup comment information is information indicating comments indicating precautions and the like when cooking along the menu.

Menu cooking time information is information indicating the approximate time required for menu cooking. The menu cooking time information may indicate the total cooking time of each dish constituting the menu, or may indicate a time separately calculated and set. For example, when cooking of a plurality of dishes can be carried out at the same time, the cooking time of the menu may be shorter than the total cooking time of each dish. Menu category information is information indicating the type of menu (for example, concept, calories, cost, commendation such as hall of fame and award history, purpose, use). The membership permission information is information indicating permission for information disclosure according to the membership setting. The menu report number information is information indicating the number of reports posted by the viewer for the menu.

By referring to such menu attribute data, the recipe management device 10 can specify various attributes of the menu and control the disclosure of menu information according to the member setting.

FIG. 5 is a diagram showing an example of a data structure of recipe data. The recipe data is data that describes information related to the contents of the recipe, and is data in which one or more recipe ingredient information and one or more cooking process information are associated with the recipe ID.

The recipe ingredient information is information about the ingredients used in the recipe. In the recipe ingredient information, information on the ingredients used, quantity information, and ingredient category information are described. The food ingredient information used is information for specifying the foodstuff used in the recipe. For example, a food material ID is described in the food material information used. The food material ID is information that uniquely identifies the food material. The quantity information is information indicating the quantity of ingredients used in the recipe. Ingredient category information is information indicating a group of ingredients in a recipe. For example, in the foodstuff category information, identification information of each group may be described in order to distinguish between a group of foodstuffs used in one cooking process and a group of foodstuffs used in another cooking process.

Cooking process information is information that indicates the work in cooking step by step. In the cooking process information, cooking image information, process comment information, process time information, and cooking method information are described. The cooking image information is information showing a captured image showing the state of the cooking process. The process comment information is information indicating a description of the cooking process. The process time information is information indicating the time required for the cooking process. The cooking method information is information indicating the type of cooking method in the cooking process. Cooking methods include, for example, cutting, simmering, baking, steaming, boiling, frying, and mixing.

By referring to the recipe data in this way, the recipe management device 10 can specify various information of the recipe indicating the cooking method of the dish.

FIG. 6 is a diagram showing an example of a data structure of recipe attribute data. The recipe attribute data is data that describes the attribute information of the recipe. In the recipe attribute data, for the recipe ID, the dish ID, the recipe name information, the target number of people information, the recipe poster information, the recipe registration date and time information, the dish image information, the poster comment information, and the cooking time. Information, recipe category information, membership permission information, recipe report number information, and video ID are associated with each other.

The dish ID is information that uniquely identifies a dish. The recipe name information is information indicating the name of the recipe. The name of the recipe includes the name of the dish that can be created based on the recipe and the name of the ingredient used in the recipe. The target number of people information is information indicating the amount of food indicated by the recipe. Information such as one serving, two or three servings, etc. is described in the target number of people information. The recipe contributor information is information indicating the contributor (creator) of the recipe. For example, a user ID is described in the recipe poster information. The recipe registration date and time information is information indicating the date and time when the recipe was posted and registered. The food image information is information indicating a captured image of food. The contributor comment information is information indicating a comment (for example, outline, background) given by the contributor to the recipe.

Cooking time information is information indicating an approximate time required for cooking. The cooking time information may indicate the total time required for each cooking process, or may indicate the time separately calculated and set. For example, the cooking time may include the time required for preparation, serving, etc., in addition to the time required for each cooking process. The recipe category information is information indicating the type of recipe (for example, concept, calorie, cost, award such as hall of fame or award history, purpose, use). The recipe report number information is information indicating the number of reports posted by the viewer for the recipe.

The recipe video ID is information indicating the ID of the recipe video corresponding to the recipe ID. The recipe video is a picture of cooking according to the recipe (also referred to as a cooking scene), and is usually a video having a length of about 1 minute. The recipe moving image is provided to the user from the recipe management device 10 through a communication line such as the Internet in response to a request from a user having a personal computer, a smartphone, or the like.

By referring to such recipe attribute data, the recipe management device 10 can specify various attributes of the recipe and control the disclosure of recipe information according to the member setting.

FIG. 7 is a diagram showing an example of a data structure of food material data. The foodstuff data is data that describes information about the foodstuff, and the foodstuff name information, the nutrient information, the calorie information, the belonging foodstuff information, and the same kind foodstuff information are associated with the foodstuff ID.

The food material name information is information indicating the name of the food material. Nutrient information is information indicating the nutrients contained in the food material and their amounts. The calorie information is information indicating the calories per unit amount of the food material. The affiliation food ingredient information is information indicating the affiliation foodstuff. “Affiliated foodstuff” is information indicating another food material conceptually included in one food material. For example, "fish" includes "mackerel" and "autumn sword fish". In addition, "mackerel" includes "raw mackerel" and "canned mackerel". In other words, the belonging foodstuff is a foodstuff that belongs to the subordinate concept of a certain foodstuff. In the affiliation foodstuff information, the foodstuff ID of the affiliation foodstuff may be described. The same kind of food information is information indicating the same kind of food. "Same kind of foodstuff" is information indicating another foodstuff having the same kind of relationship with one foodstuff.

By referring to such food material data, the recipe management device 10 can identify nutrients and calories contained in menus and dishes. In addition, the recipe management device 10 can specify the relationship between two or more ingredients. For example, the recipe management device 10 can specify the foodstuff to which the foodstuff of the input keyword belongs or the same kind of foodstuff. Therefore, the recipe management device 10 can extract not only menus and recipes that can be directly extracted from the ingredients indicated by the input keywords, but also menus and recipes for belonging ingredients and similar ingredients.

FIG. 8 is a diagram showing an example of a data structure of cooking data. The cooking data is data that describes information about cooking, and the cooking ID is associated with cooking name information, belonging cooking information, and similar cooking information.

The dish name information is information indicating the name of the dish. The affiliation food information is information indicating the affiliation food. "Affiliated dish" is information indicating another dish conceptually included in one dish. For example, "simmered food" includes "simmered" and "chikuzen-ni". In other words, the belonging dish is a dish that belongs to the subordinate concept of a certain dish. The dish ID of the affiliation dish may be described in the affiliation dish information. Homogeneous food information is information indicating the same kind of food. "Homogeneous food" is information indicating another food that has the same kind of relationship with one food.

By referring to such cooking data, the recipe management device 10 can specify the relationship between two or more dishes.

FIG. 9 is a diagram showing an example of the data structure of the report data. Report data is data that describes report information for menus or recipes. A report is a report in which a user who browses a menu or a recipe and cooks publishes opinions and impressions about the menu and the recipe. In the report data, the report target information, the report poster information, the report image information, the report comment information, and the corresponding comment information are associated with the report ID.

The report ID is information that uniquely identifies the report. The report target information is information indicating the target of the report. For example, a menu ID and a recipe ID are described in the report information. Report contributor information is information indicating the contributor (creator) of a report. For example, a user ID is described in the report poster information. The report image information is information showing an image showing the cooking result (menu, cooking) and the state of cooking by the poster of the report. The report comment information is information indicating a description of the report. Corresponding comment information is information indicating a menu for a report or a reaction comment from a recipe poster (creator).

By referring to such report data, the recipe management device 10 can evaluate menus and recipes. For example, menus and recipes with many reports have been used for cooking by a large number of users. Therefore, the recipe management device 10 can identify popular menus and recipes.

FIG. 10 is a diagram showing an example of a data structure of user data. The user data is data that describes information about a user who is registered as a member in the recipe sharing service provided by the information processing system 1. The user data includes name information, password information, nickname information, date of birth information, gender information, contact information, link information, favorite menu information, and favorite recipe information for the user ID. , It is the data associated with the member setting information.

The name information is information indicating the user's name. The password information is information indicating the password set for the user's account. The password is an example of authentication information. As the authentication information, in addition to the password, arbitrary information such as a fingerprint and a voiceprint may be used. Nickname information is information indicating a user's nickname (a name when it is disclosed to others). The date of birth information is information indicating the date of birth of the user. Gender information is information indicating the gender of the user. The contact information is information indicating the user's contact information such as an e-mail address, a telephone number, and an address. For example, by referring to the address, it is possible to perform processing according to the regional characteristics of the user's place of residence. The link information is information indicating a link to an account such as a user's SNS (Social Networking Service).

The favorite menu information is information indicating a menu registered as a favorite by the user. The favorite recipe information is information indicating a recipe registered as a favorite by the user. The member setting information is information indicating the member setting of the user. There are a plurality of types of member settings such as "regular member" and "special member". Regular members cannot use some of the information retrieval services. On the other hand, special members can use all of the information retrieval services. As the conditions for becoming a special member, for example, arbitrary conditions such as payment of a predetermined amount of money, use of the information retrieval service for a predetermined period, and use of the information retrieval service for a predetermined number of times may be adopted.

By referring to such user data, the recipe management device 10 can specify attributes such as the gender and age of the user. This makes it possible to present search results according to the attributes of the user. In addition, the recipe management device 10 can acquire the user's evaluation of the menu and the recipe based on the favorite menu information and the favorite recipe information. Further, the recipe management device 10 can provide an information retrieval service according to the member setting of the user based on the member setting information.

FIG. 11 is a diagram showing an example of a data structure of recipe moving image attribute data. The recipe video attribute data is data that describes the attribute information of the recipe video, and for the recipe video ID, the recipe ID, the video creator information, the video creation date and time information, the video title information, the video comment information, the thumbnail information, Playback time information, browsing number information, and recipe ID for stores are associated with each other.

The video creator information is information indicating the creator of the video. The creator of the video may be the same as the creator of the corresponding recipe, or it may be a different creator. The moving image creation date and time information is information indicating the date and time when the moving image was created. The video title information is information indicating the title of the video. The video comment information is information indicating various supplementary information about the corresponding recipe video. The thumbnail information is information indicating a representative image (thumbnail image) of the corresponding recipe moving image. The thumbnail image is displayed on the recipe video selection screen or the like. The playback time information is information indicating the playback time of the recipe video. The number of views information is information indicating the number of views of the corresponding recipe video. The recipe video ID for stores is information indicating the ID of the recipe video for stores corresponding to the recipe video.

In this way, the recipe management device 10 can specify various information related to the recipe moving image by referring to the recipe moving image attribute data. In addition, the recipe video and the recipe video for stores can be managed in association with each other.

FIG. 12 is a diagram showing an example of a data structure of cooking process data. The cooking process data is data that describes information on each cooking process in the recipe moving image, and is data in which information on one or more cooking processes included in the recipe ID is associated with the recipe moving image ID.

The information about the cooking process includes start time information, end time information and importance information of the cooking process. The importance information is information indicating the importance of the cooking process, and is set based on the importance correspondence data described later.

In this way, by referring to the cooking process data, the recipe management device 10 can specify the reproduction position of each cooking process in the recipe moving image. In addition, the importance of each cooking process can be specified, and processing can be performed according to the importance.

FIG. 13 is a diagram showing an example of a data structure of importance-corresponding data. The importance correspondence data is data showing the correspondence relationship between the importance and each cooking process. The importance may indicate that there are a plurality of importance such as importance 0, importance 1, ..., Importance 4, and the smaller the importance value, the higher the importance. For example, since the cooking process corresponding to the completed scene represents the completed image of the dish, the importance level 0 is associated with it. Further, for example, a cooking process corresponding to a scene of frying ingredients and a scene of combining ingredients is an indispensable process, and also has an effect of visually increasing the appetite, cooking motivation, purchasing motivation of ingredients, etc. of the user (customer). Is expected, so importance 1 is associated with it. Further, the cooking process corresponding to a scene that cannot be deleted but is not important due to the structure of the moving image, such as a scene in which ingredients are copied or a scene in which seasonings are combined, is associated with importance level 2. Further, the importance level 3 is set for the cooking process corresponding to a scene that is not important in the composition of the moving image and may be omitted (deleted), for example, a scene of cutting ingredients. The above association is only an example, and the importance may be associated with each cooking process based on other policies / standards. In addition, the correspondence between the importance and each cooking process can be changed as appropriate.

In this way, by referring to the importance correspondence data, the recipe management device 10 can set the importance for each process in the recipe video, and can edit the recipe video according to the importance. It can be carried out.

FIG. 14 is a diagram showing an example of a data structure of importance setting data. The importance setting data is data in which each importance is associated with the setting information of the video of the cooking process in which each importance is set. The setting information includes allocation time information, cut number information, composition information, double speed rate information, and the like. The allocated time information is information indicating the time allocated to the video of the corresponding cooking process when the recipe video for the store is generated based on the recipe video. For example, 3 seconds or more are allocated to a cooking process of importance 0 and importance 1, 2 seconds or less are allocated to a cooking process of importance 2, and 0 seconds are allocated to a cooking process of importance 3.

The cut number information is information indicating the number of cuts assigned to the video of the corresponding cooking process. The cut represents a unit of images continuously shot by the same camera, and when the camera or camera angle changes, it is determined that the next cut is performed. When the zoom ratio is changed by the same camera by zooming in / out, it may be counted as different cuts. For example, 2 to 4 cuts are assigned to a cooking process of importance 0 and importance 1, and 1 cut is assigned to a cooking process of importance 2.

The composition information is information indicating composition information in each cut. The composition is determined by the camera position, camera angle, zoom rate, etc. For example, a composition such as a true bird's-eye view, a true bird's-eye view, an oblique bird's-eye view, or an oblique bird's-eye view is included.
The double speed rate information is information indicating the double speed rate set in the image corresponding to the cooking process. In order to shorten the playback time of the moving image, a double speed rate greater than 1 is set for the video corresponding to each cooking process. In consideration of the speed at which the user can visually recognize the work, a double speed rate of 3 to 10 times speed is preferably set. However, a double speed rate of 1 or less may be set for important scenes or scenes to be emphasized.

In this way, by referring to the importance setting data, the recipe management device 10 can edit the recipe moving image according to the importance for each process in the recipe moving image.

FIG. 15 is a diagram showing an example of a data structure of recipe moving image attribute data for stores. The recipe video attribute data for stores is data that describes the attribute information of the recipe video for stores, and the playback time information, the store ID, the sales floor ID, and the advertisement ID are associated with the cooking video ID for stores. ..

The playback time information is information indicating the playback time of the recipe video for stores. The store ID is an ID for identifying the store. In addition to the store ID, a store group ID that classifies stores by chain store or region may be used. The sales floor ID is an ID for identifying the sales floor. Indicates which sales floor the recipe video for the store is suitable for playback. The advertisement ID is an ID for identifying an advertisement to be displayed together with the recipe video for the store.

In this way, by referring to the recipe video attribute data for stores, the terminal device 20 can extract the recipe video for stores corresponding to the store or the sales floor and present it to the user (clerk) as a video of a playback candidate. it can. In addition, the terminal device 20 can specify an advertisement to be displayed together with the recipe video for the store being played.
This completes the description of the configuration of various data processed by the recipe management device 10 or the terminal device 20.

[Configuration of recipe management device 10]
Next, the configuration of the recipe management device 10 will be described.
FIG. 16 is a block diagram showing a configuration example of the recipe management device 10. The recipe management device 10 includes a communication unit 11, a storage unit 12, and a control unit 13.

The communication unit 11 is an interface for communicating with the terminal device 20 and other devices via a wired or wireless communication line, and transmits / receives various data under the control of the control unit 13.

The storage unit 12 is composed of at least one HDD (Hard Disk Drive), flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), ROM (Read Only Memory), or RAM (Random Access). The storage unit 12 stores various information and programs related to the recipe management device 10. For example, the recipe management device 10 includes menu data, menu attribute data, recipe data, recipe attribute data, ingredient data, cooking data, report data, user data, recipe video attribute data, cooking process data, importance correspondence data, and importance. Stores setting data, recipe video attribute data for stores, etc. Further, the recipe management device 10 stores a recipe moving image (also referred to as recipe moving image data) and a recipe moving image for stores (also referred to as recipe moving image data for stores).

The control unit 13 controls various functions of the recipe management device 10. Some or all of the functions of the control unit 13 are realized by, for example, one or more processors such as a CPU (Central Processing Unit) included in the control unit 13 executing various programs stored in the storage unit 12. You may. The control unit 13 includes an image recognition unit 131, a classification unit 132, an importance setting unit 133, and an editing unit 134.

The image recognition unit 131 analyzes the recipe moving image data stored in the storage unit 12. For example, the image recognition unit 131 identifies a scene in which the composition or cut of an image in a moving image is switched based on the amount of change in the image or the like. Further, for example, the image recognition unit 131 identifies foodstuffs, cooking utensils, tableware, cook's hands, etc. in the image by a known image analysis technique. Further, the image recognition unit 131 may identify cooking operations such as cutting and mixing according to the movement of the cook's hand. In addition, the image recognition unit 131 may identify the amount of ingredients and seasonings (1 carrot, 2 tablespoons, etc.) in the image. The image recognition unit 131 outputs the result of analyzing the cooking moving image data to the classification unit 132, the importance setting unit 133, the editing unit 134, and the storage unit 12.

The classification unit 132 classifies the recipe moving image data stored in the storage unit 12 into a plurality of cooking processes. The classification unit 132 classifies the cooking moving image data into a plurality of cooking processes based on the analysis result of the recipe moving image data input from the image recognition unit 131. For example, the classification unit 132 "foodstuffs" based on information on scene divisions in the video input from the image recognition unit 131, information on foodstuffs in the scene, information on hand movements in the scene, and the like. It is classified into cooking processes such as "a scene where 1 is cut" and "a scene where food 1 and food 2 are mixed". Further, the classification unit 132 may classify the cooking process based on the information for identifying the cooking process such as recipe data and food material data. Alternatively, the cooking process may be classified based on the input information from the image recognition unit 131 and the information for identifying the cooking process. The classification unit 132 outputs the result of classifying the cooking moving image data into a plurality of cooking processes to the importance setting unit 133, the editing unit 134, and the storage unit 12.

The importance setting unit 133 sets the importance for each cooking process input from the classification unit 132 based on the importance correspondence data. As the importance, for example, a plurality of importance such as 0th importance, 1st importance, 2nd importance, 3rd importance, etc. are set. In the example of the importance correspondence data of FIG. 13, the importance setting unit 133 sets "importance 0" to "completed scene", "importance 1" to "scene of frying ingredients", and "scene of matching ingredients". , Set "Importance 2" for "Scene of copying ingredients" and "Scene of matching seasonings", and "Importance 3" for "Scene of preparation" and "Scene of cutting ingredients". The importance setting unit 133 outputs the result of setting the importance for each cooking process to the editorial unit 134 and the storage unit 12.

The editorial unit 134 edits the video corresponding to each cooking process based on the correspondence between each cooking process and the importance in the cooking video data input from the importance setting unit 133, and generates a video at a predetermined time. To do. The predetermined time is shorter than the cooking video before editing, and is preferably about 15 seconds. For example, the editorial unit 134 allocates the first time (for example, 3 seconds) or more as the reproduction time to the video corresponding to the cooking process in which the first importance is set. That is, the editorial unit 134 shortens the video corresponding to the cooking process for which the first importance is set to the video corresponding to the first time or more. Further, the editorial unit 134 allocates a second time (for example, 2 seconds) or less as a reproduction time to the video corresponding to the cooking process for which the second importance is set. The second time is shorter than the first time. Further, the editorial unit 134 does not allocate the reproduction time to the cooking process for which the third importance is set. That is, the image for the cooking process for which the third importance is set is deleted.

The importance may be subdivided and editing rules according to each importance may be used. For example, "importance 0" is a completed scene in the example of FIG. The completed scene is an important scene that shows how the food is completed, but in the video for stores, the video time is short and repeated playback is expected, so the completed scene at the beginning of the video is You may cut it and assign the completed scene only to the end of the video.

Further, the editorial unit 134 sets a first double speed rate (for example, 3 to 10 times) which is larger than 1 and within a predetermined range with respect to the image corresponding to the cooking process for which the first importance is set. A second double speed rate, which is larger than the first double speed rate, may be set for the image corresponding to the cooking process for which the second importance is set. The first double speed rate is a value at which it is assumed that the state of work can be visually recognized even if the speed is fast-forwarded. By setting the double speed rate in this way, it is possible to shorten the playback time of the moving image while maintaining the visibility. In addition, the visibility of high-importance scenes can be improved as compared with low-importance scenes, and the impression on the user can be strengthened. Further, the editorial unit 134 may increase the double speed rate within a predetermined range according to the length of the scene corresponding to the cooking process. For example, for a scene having a long playback time, the playback time can be significantly shortened while maintaining the user's visibility by setting the 10x speed. Further, the editorial unit 134 may perform constant speed reproduction or slow reproduction of less than 1x speed for the video of the completed scene without performing double speed reproduction. As a result, the deliciousness of the finished dish can be produced by changing and emphasizing the rhythm from the normal cooking process.

Further, the editorial unit 134 sets the number of first cuts (for example, 2 to 4 cuts) that is larger than 1 and within a predetermined range as the number of cuts for the image corresponding to the cooking process for which the first importance is set. It may be set. That is, the editorial unit 134 selects and edits as many scenes as the first number of cuts from each cooking process of the recipe video, and generates a video for the store. The composition of each cut (camera position, camera angle, zoom factor, etc.) at that time is a magnified view of the true bird's-eye view, an enlarged view of the true bird's-eye view (also called an enlarged true bird's-eye view), an enlarged oblique view, and an enlarged view of the oblique view (also referred to as an enlarged oblique bird's-eye view). Includes). Further, the editorial unit 134 may set a second number of cuts (for example, 1) for the image corresponding to the cooking process in which the second importance is set. The number of second cuts is smaller than the number of first cuts. The composition of each cut at that time includes a bird's-eye view. The true bird's-eye view refers to a composition in which the object is photographed from above (almost in the vertical direction), and the oblique bird's-eye view refers to a composition in which the object is photographed from diagonally above. In addition, the editorial unit 134 sets the cut or composition so that the size and shape of the cut food can be confirmed (visually recognized) in any scene in the moving image. Further, the editorial department 134 may select and set a scene in which the food is placed on the table and a scene in which the food is lifted with chopsticks in the completed scene. As a result, the deliciousness of the finished dish can be produced.

Further, the editorial unit 134 may select and set a composition for each cooking process according to the type of cooking being cooked and the cooking process. For example, in a cooking process in which a large amount of steam is generated, by selecting a composition from an oblique bird's-eye view instead of a true bird's-eye view, it is possible to generate an image having a composition in which the food is easily visible. The editorial unit 134 selects the composition based on the output result of the image recognition unit 131, the menu data, the menu attribute data, the recipe data, the recipe attribute data, and the like.

In addition, the editorial unit 134 displays a telop (character information) indicating the name and / or amount of the cooking ingredient together with the corresponding image. For example, in the display scene of the food material "cabbage", telops such as "cabbage" and "1/2 cabbage" are inserted into the video. Alternatively, in the display scene of "soy sauce", insert a telop such as "soy sauce" or "1 tablespoon of soy sauce" into the video. The editorial unit 134 may identify the foodstuff and the amount based on the output of the image recognition unit 131 and generate a telop. In addition, the editorial unit 134 may insert a telop based on the information of ingredients and seasonings recorded in the menu data, the menu attribute data, the recipe data, the recipe attribute data, and the like. Further, when inserting the telop into the image, the editorial unit 134 preferably sets the display position of the telop so as not to overlap with the cooking or cooking utensil. In that case, the editorial unit 134 identifies the positions of dishes and cooking utensils based on the output of the image recognition unit 131, and adjusts the display position and size of the telop so as not to overlap them. For example, the editorial unit 134 displays a telop at the bottom of the screen when the foodstuff is shown in the center of the screen.

[Example of video generation]
Next, an example of moving image generation (editing) by the recipe management device 10 will be described.
FIG. 17 is a diagram showing a configuration image of the recipe moving image. In FIG. 17, one rectangle connected in the horizontal direction shows an image (scene) corresponding to one cooking process classified by the classification unit 132. The number in the upper left of the rectangle represents the number of each scene. Further, the characters in the rectangle indicate the outline of the scene, and the numbers below it indicate the importance set by the importance setting unit 133. The horizontal direction of FIG. 17 shows a time series (time). In the example of FIG. 17, the cooking moving image data is classified into 14 scenes from 1 to 14, and the importance is set for each. Specifically, the cooking video data starts from the "completed scene (scene 1)", "scene of copying the ingredient 1 (scene 2)", "scene of cutting the ingredient 1 (scene 3)", and "after cutting". It proceeds in sequence with the "scene (scene 4) in which the foodstuff 1 of the above is copied" and ends with the "completed scene (scene 14)".

The editorial unit 134 of the recipe management device 10 performs the following processing for each scene of the moving image data of FIG. 17 based on the set importance and the importance setting data.
(Scene 1) Since the importance is 0 and it is not the end of the moving image, it is deleted.
(Scene 2) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 3) Since the importance is 3, it is deleted.
(Scene 4) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 5) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 6) Since the importance is 3, it is deleted.
(Scene 7) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 8) Since the importance is 1, the double speed rate is tripled and the image is taken for 3 seconds. In addition, the number of cuts is set to 2, and the composition is selected to include a true bird's-eye view and an enlarged oblique bird's-eye view.
(Scene 9) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 10) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 11) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 12) Since the importance is 2, the double speed rate is set to 5 times, and the image is taken for 1 second.
(Scene 13) Since the importance is 1, the double speed rate is tripled and the image is taken for 3 seconds. In addition, the number of cuts is set to 2, and the composition is selected to include a true bird's-eye view and an enlarged oblique bird's-eye view.
(Scene 14) Since the importance is 0 and it is the end of the moving image, the double speed rate is set to 1 and the image is taken for 3 seconds. In addition, the number of cuts is set to 2, and the composition is selected to include a true bird's-eye view and an enlarged oblique bird's-eye view.

FIG. 18 is a diagram showing a configuration image of a recipe video for a store after editing the recipe video data of FIG. Similarly to FIG. 17, the horizontal direction shows a time series (time), and each rectangle shows a scene corresponding to the cooking process. By the processing of the recipe management device 10 described in the example of FIG. 17, the number of scenes is reduced to 11 as a whole. In addition, the allocation time of each scene is shortened according to the importance, and in this example, it is edited as a moving image of 17 seconds in total. In this way, the recipe management device 10 edits a cooking video of about 1 minute with an emphasis on the explanation of the cooking method, and generates a short-time video suitable for customers in supermarkets and the like to view at the food sales floor. Can be done.

In addition, although the time for the entire video has been shortened, for high-importance scenes, a longer time is allocated than for less important scenes, and the double speed rate is also lower, giving customers the impression of high-importance scenes. Will remain strong. In addition, for a scene of high importance, the scene can be more impressed by including a plurality of compositions (true bird's-eye view, oblique bird's-eye view, enlarged true bird's-eye view, enlarged oblique bird's-eye view, etc.) in the scene. In the example of FIG. 18, for example, in scenes 5 and 10, by including a zoom composition of an enlarged oblique view of the scene in which the foodstuffs are mixed, the attractiveness of the foodstuffs is emphasized and the purchase motivation of the foodstuffs is enhanced.

[Processing example of recipe management device 10]
Next, an example of processing of the recipe management device 10 will be described.
FIG. 19 is a flowchart showing a processing example of the recipe management device 10.

(Step S101) The recipe management device 10 (classification unit 132) cooks a plurality of recipe videos of a landscape during cooking based on the output result of the image recognition unit 131 and / or data such as menu data and recipe data. Classify into processes. After that, the process proceeds to step S102.
(Step S102) The recipe management device 10 (importance setting unit 133) sets the importance of each cooking process based on the importance correspondence data. After that, the process proceeds to step S103.

(Step S103) The recipe management device 10 (editing unit 134) sets the playback time assigned to the video corresponding to each cooking process based on the importance setting data. After that, the process proceeds to step S104.
(Step S104) The recipe management device 10 (editing unit 134) sets the number of cuts and the composition of the video corresponding to each cooking process based on the importance setting data. After that, the process proceeds to step S105.

(Step S105) The recipe management device 10 (editing unit 134) sets the double speed rate of the video corresponding to each cooking process based on the importance setting data. After that, the process proceeds to step S106.
(Step S106) The recipe management device 10 (editing unit 134) inserts a telop representing the name and / or amount of the foodstuff into the corresponding video based on the output of the image recognition unit 131. After that, the process proceeds to step S107.

(Step S107) The recipe management device 10 (editing unit 134) combines images corresponding to each cooking process to generate a moving image at a predetermined time. This video is a recipe video for stores that shortens the recipe video before editing.
This completes the description of the processing example of the recipe management device 10.

[Configuration of terminal device 20]
Next, the configuration of the terminal device 20 will be described.
FIG. 20 is a block diagram showing a configuration example of the terminal device 20. The terminal device 20 includes a communication unit 21, a storage unit 22, an input unit 23, an output unit 24, and a control unit 25.

The communication unit 21 is an interface for communicating with the recipe management device 10 and other devices via a wired or wireless communication line, and transmits / receives various data under the control of the control unit 25.

The storage unit 22 is composed of at least one HDD, a flash memory, an EEPROM, a ROM, a RAM, or the like. The storage unit 22 stores various information and programs related to the terminal device 20. The storage unit 22 stores, for example, recipe video data for stores and recipe video attribute data for stores.

The input unit 23 is for input including, for example, a pointing device such as a mouse and a touch pad, a keyboard, a microphone, a camera, and various other sensors (for example, an acceleration sensor, a gyro sensor, a GPS (Global Positioning System) sensor, and a proximity sensor). It is a module. The input unit 23 may be integrally configured with the display as a touch panel. The input unit 23 outputs the input information received by the operation of the user (clerk) or the like to the control unit 25 (input control unit 251).

The output unit 24 is an output module such as a display panel, a speaker, and a woofer. The input unit 23 displays and reproduces a cooking video for stores, an advertisement moving image, and the like based on the control of the control unit 25 (output control unit 253).

The control unit 25 controls various functions of the terminal device 20. Some or all of the functions of the control unit 25 may be realized, for example, by executing various programs stored in the storage unit 22 by one or more processors such as a CPU included in the control unit 25. The control unit 25 includes an input control unit 251, a moving image acquisition unit 252, and an output control unit 253.

The input control unit 251 controls the input unit 23. The input control unit 251 accepts operations on the input unit 23 such as touch and swipe by the user (clerk), and performs various processes corresponding to the operations. For example, the input control unit 251 receives a video selection instruction (playback instruction) by the user on the recipe video selection screen for stores, and outputs the result to the video acquisition unit 252. Further, the input control unit 251 receives the start / end instructions of the recipe video application for the store, and outputs the result to the control unit 25.

The video acquisition unit 252 acquires a designated recipe video for a store based on the input from the input control unit 251. The video acquisition unit 252 may acquire a recipe video for a store from the recipe management device 10 via the communication unit 21. Further, the moving image acquisition unit 252 may acquire the recipe moving image for a store stored in the storage unit 22 by acquiring it from the recipe management device 10 in advance. Further, the moving image acquisition unit 252 may acquire the recipe moving image for stores generated by the recipe management device 10 via an external storage medium or the like.

The output control unit 253 controls the output unit 24. The output control unit 253 has a browser function, generates various screens such as a selection screen of a recipe movie for stores, and displays them on the output unit 24. In addition, the output control unit 253 reproduces the recipe video for stores acquired by the video acquisition unit 252. That is, the output control unit 253 classifies the video of the cooking scene into a plurality of cooking processes, sets the importance of the cooking process, and edits the video corresponding to the cooking process according to the set importance. Display / play the video of the time.

In addition, the output control unit 253 repeatedly and continuously reproduces the moving image. Further, the output control unit 253 displays an advertisement related to the video and the department (sales floor) or dish (recipe, foodstuff) selected by the user each time the video is played a predetermined number of times. The predetermined number of times is a preset number of times and is a value that can be changed. Considering the time spent at the customer's sales floor and the playback time of the recipe video for the store, it is preferable to display the advertisement every time the recipe video for the store is played 2 to 4 times. The recipe video for stores and the advertisement related to the department (sales floor) are videos or still images set in association with the video or department, and the playback time is preferably shorter than the recipe video for stores.

[Screen display example of terminal device 20]
Next, a screen display example of the terminal device 20 will be described.
FIG. 21 is a diagram showing a display example of a moving image selection screen for stores in the terminal device 20. The department name of the cooking video for stores is displayed in the area B1 on the left side of the output unit 24 (display) of the terminal device 20. The department corresponds to the sales floors of "agricultural products", "livestock products", "fisheries products" and the like. When the user (clerk) selects each department, candidates for cooking videos for stores classified into the department are displayed in the area of B2.

In the area of the center B2 of the output unit 24, the explanation of the recipe video for each store is displayed. The description of the recipe video for the store includes the recipe title, thumbnail images, and ingredients used. By scrolling the area of B2 up and down, the user can sequentially switch and display the explanation of the recipe video for the store to be displayed. When the user selects (tap) the part where the explanation of the recipe video for the store is displayed, the playback of the target recipe video starts. Various auxiliary information is displayed in the area on the right side of B2. For example, on the recipe video selection screen, the selection (operation) method may be displayed, or the recipe description may be displayed during the playback of the recipe video.

[Processing example of terminal device 20]
Next, an example of processing of the terminal device 20 will be described.
FIG. 22 is a flowchart showing a processing example of the terminal device 20.

(Step S201) When the terminal device 20 is instructed to start the recipe video playback application for the store by the operation of the user (clerk), the application is started. The terminal device 20 (output unit 24, output control unit 253) displays the top screen. After that, the process proceeds to step S202.
(Step S202) The terminal device 20 (input unit 23, input control unit 251) accepts an input for selecting a department (sales floor) by a user operation. After that, the process proceeds to step S203.

(Step S203) The terminal device 20 (output unit 24, output control unit 253) displays a description of the recipe video for the store associated with the input sales floor. After that, the terminal device 20 (input unit 23, input control unit 251) accepts the input of the selection of the recipe video for the store by the user operation. After that, the process proceeds to step S203.
(Step S204) The terminal device 20 (video acquisition unit 252) acquires the recipe video for the store selected in step S203 from the recipe management device 10 via the communication unit 21. The terminal device 20 (moving image acquisition unit 252) may acquire a recipe moving image for a store previously stored in the storage unit 22. After that, the process proceeds to step S205.

(Step S205) The terminal device 20 (output unit 24, output control unit 253) continuously and repeatedly reproduces the recipe video for stores acquired in step S204. After that, the process proceeds to step S206.
(Step S206) The terminal device 20 (control unit 25, output control unit 253) counts the number of times the recipe video for the store has been played. After that, the process proceeds to step S207.

(Step S207) The terminal device 20 (control unit 25, output control unit 253) determines whether or not the number of times of continuous reproduction of the recipe moving image for the store is equal to or more than a predetermined number of times. When the number of continuous reproductions is equal to or greater than a predetermined number (step S207 / Yes), the process proceeds to step S208. When the number of continuous reproductions is smaller than the predetermined number (step S207 / No), the terminal device 20 returns to the process of step S205 and reproduces the recipe movie for the store.
(Step S208) The terminal device 20 (output unit 24, output control unit 253) reproduces the advertisement video associated with the selected department or the recipe video after playing the recipe video for the store. After that, the process proceeds to step S209.

(Step S209) The terminal device 20 (control unit 25) determines whether or not a playback end instruction or an application end instruction by a user operation has been detected. If the end instruction is not detected (step S209 / No), the terminal device 20 (output unit 24, output control unit 253) returns to the process of step S205 and continues playing the recipe video for the store. When the end instruction is detected (step S209 / Yes), the terminal device 20 (control unit 25) ends the process. The process of step S209 may be performed in parallel with the process of steps S201 to 208.
This is the end of the description of the processing example of the terminal device 20.

[Summary of Embodiment]
As described above, the information processing system 1 according to the present embodiment includes the recipe management device 10 and the terminal device 20. The recipe management device 10 is an information processing device that generates a video showing a cooking procedure (recipe video for stores), and includes a classification unit 132 that classifies a video (recipe video) of a cooking scene into a plurality of cooking processes. An importance setting unit 133 that sets the importance of the cooking process, and an editorial unit 134 that edits the video corresponding to the cooking process according to the importance and generates a video (recipe video for stores) at a predetermined time. To be equipped.
The terminal device 20 is a terminal device installed in a food sales floor and displays a moving image showing a cooking procedure, and acquires a moving image (recipe moving image for a store) at a predetermined time from the recipe management device 10 (information processing device). It includes a moving image acquisition unit 252 (acquisition unit), an input unit 23 that receives a user's instruction, and an output control unit 253 that displays an acquired moving image for a predetermined time in response to the user's instruction.
As a result, it is possible to edit a video of a cooking scene according to the importance of the cooking process and provide a moving image suitable for reproduction in a store, particularly in a food section.

Further, the importance setting unit 133 of the recipe management device 10 sets the importance including the first importance, the second importance, and the third importance for each of the cooking processes, and the editorial unit 134 sets the first importance. The first time (3 seconds or more) is assigned as the playback time to the video corresponding to the cooking process in which the degree is set, and the playback time is assigned to the video corresponding to the cooking process in which the second importance is set. As a result, a second time (2 seconds or less) shorter than the first time is allocated, and a playback time is not allocated to the video corresponding to the cooking process in which the third importance is set.
As a result, the reproduction time allocated according to the importance of each cooking process can be changed, and the moving image can be edited at a time suitable for reproduction in a store, particularly in a food section.

Further, the importance setting unit 133 sets the importance including the first importance and the second importance for each of the cooking processes, and the editorial unit 134 corresponds to the cooking process in which the first importance is set. The first double speed rate, which is larger than 1 and within a predetermined range (3 to 10 times speed), is set for the video to be used, and the first for the video corresponding to the cooking process for which the second importance is set. Set a second double speed rate that is larger than the double speed rate of.
As a result, the double speed rate at the time of reproduction can be changed according to the importance of each cooking process, and the moving image can be edited at a time suitable for reproduction in a store, particularly in a food section.

Further, the importance setting unit 133 sets the importance including the first importance and the second importance for each of the cooking processes, and the editorial unit 134 corresponds to the cooking process in which the first importance is set. For the video corresponding to the cooking process in which the first number of cuts larger than 1 and within a predetermined range (2 to 4 cuts) is set and the second importance is set. A second cut number (1 cut) smaller than the first cut number is set.
As a result, the number of cuts to be used can be changed according to the importance of each cooking process, and the video can be edited to be suitable for reproduction in a store, particularly in a food section.

Further, the importance setting unit 133 sets the importance including the first importance and the second importance for each of the cooking processes, and the editorial unit 134 corresponds to the cooking process in which the first importance is set. For the video, set a composition that includes either a true bird's-eye view, an oblique bird's-eye view, an enlarged bird's-eye view, or an enlarged oblique bird's-eye view. To set.
As a result, the composition to be used can be changed according to the importance of each cooking process, and the video can be edited to be suitable for reproduction in a store, particularly in a food section.

In addition, the editorial department 134 composes a bird's-eye view, an oblique bird's-eye view, an enlarged bird's-eye view, and an enlarged oblique bird's-eye view according to the cooking being cooked or the cooking process with respect to the image corresponding to the cooking process for which the importance is set. Select and set.
As a result, the composition to be used can be changed according to the characteristics of the dish being cooked or the cooking process, and the video can be edited to be suitable for reproduction in a store, particularly in a food section.

Further, the recipe management device 10 includes an image recognition unit 131 that recognizes an image, and the editorial unit 134 corresponds to a cooking process with a telop indicating the name or amount of cooking ingredients based on the output of the image recognition unit 131. Display with the image.
This makes it possible to display a telop indicating the name or amount of cooking ingredients based on the image in the video and explain the recipe.

Further, the editorial unit 134 sets the display position of the telop so as not to overlap with the cooking or cooking utensil in the image corresponding to the cooking process, based on the output of the image recognition unit 131.
As a result, the display position of the telop can be appropriately changed based on the image in the video, and the visibility of the moving image can be improved.

Further, the output control unit 253 of the terminal device 20 includes an input unit (input unit 23, input control unit 251) that receives a video selection instruction from a clerk, and a first cooking process and a second cooking process based on the selection instruction. It is provided with an output control unit 253 that repeatedly reproduces a moving image of a video of a series of cooking scenes including the above. The output control unit 253 reproduces at least a part of the video of the first cooking step and at least a part of the video of the second cooking step at different double speed rates. Here, reproducing at different double speeds includes changing the double speed of the terminal device 20 and playing back a series of videos having different double speeds.
As a result, images having different double speeds can be reproduced according to each cooking process, and the moving images can be effectively shortened so as to be suitable for reproduction in a store, particularly in a food sales floor.

Further, the output control unit 253 of the terminal device 20 repeatedly reproduces the recipe video for the store, and displays an advertisement related to the foodstuff being cooked every time the recipe video for the store is reproduced a predetermined number of times.
As a result, it is possible to provide appropriate advertisements to customers who have watched the recipe videos for stores, which can lead to sales promotion of ingredients.

Further, the output control unit 253 of the terminal device 20 (provided with a touch panel) does not display the playback stop button. The input unit (input unit 23, input control unit 251) makes it possible to receive a moving image playback instruction from a clerk when the power is turned on after the power of the terminal device 20 is turned off.
As a result, when the terminal device is placed in the store, the customer may touch the touch panel of the terminal device. With the above configuration, even if the customer touches the terminal device, it is possible to prevent the playback of the moving image from being stopped or another application being started. In addition, the clerk can stop the playback of the video by turning off the power.

Further, the display shelf of FIG. 2 is a display shelf installed in a store where the terminal device 20, the recipe card, and the foodstuff (promotional product) are displayed together. The terminal device 20 includes an input unit (input unit 23, input control unit 251) that receives a selection instruction of a video of a sales promotion recipe from a clerk, and a series of cooking steps including a first cooking process and a second cooking process based on the selection instruction. It is provided with an output control unit 253 that repeatedly reproduces a moving image of a video of a cooking scene. The output control unit 253 reproduces at least a part of the image of the first cooking process and at least a part of the image of the second cooking process at different double speeds. Ingredients (promotional products) include ingredients used in promotional recipes, and recipe cards contain information about promotional recipes.
For example, the terminal device 20 may or may not display a still image of ingredients and dishes together with a moving image. Since the recipe card is arranged on the display shelf, the customer can recognize the ingredients and dishes without displaying the still image on the terminal device 20. In this case, the terminal device 20 can secure a display space for other images such as moving images.

In the above embodiment, the output control unit 253 of the terminal device 20 repeatedly reproduces a moving image of a video of a series of cooking scenes including the first cooking step and the second cooking step.
The cooking process (first cooking process, second cooking process) is completed (including serving and table scenery), preparation of ingredients (for example, a scene of copying ingredients, a scene of matching seasonings), and processing of ingredients (for example, a scene of matching seasonings). Preparation scenes, cutting ingredients), cooking (for example, heating, mixing, seasoning; frying ingredients, combining ingredients: cooking in a narrow sense). The cooking process may be a process set by the poster.
The output control unit 253 of the terminal device 20 reproduces a moving image in which any of the allocation rate, the number of cuts, the composition, and the double speed rate is different between the first cooking step and the second cooking step.

Further, for example, the output control unit 253 of the terminal device 20 may reproduce a moving image in which each process of completion and preparation of materials has a higher double speed rate than each process of processing and cooking of materials. In other words, the output control unit 253 may reproduce a moving image in which each process of processing or cooking the material has a lower double speed rate than each process of completion or preparation of the material. As a result, the terminal device 20 can display the process faster by increasing the double speed rate for the process that requires time, and can reproduce the entire moving image in a shorter time.

The allocation rate is the ratio obtained by dividing the time of the video to be played back by the time of the captured video in each process. For example, the output control unit 253 of the terminal device 20 may reproduce a moving image in which each step of completion and preparation of materials has a higher allocation rate than each step of processing or cooking of materials. In other words, the output control unit 253 may reproduce a moving image in which each process of processing or cooking the material has a lower allocation rate than each process of completion or preparation of the material. As a result, the terminal device 20 can display many steps. That is, the terminal device 20 allocates a short time (several seconds) to each process, and lowers the allocation rate for the process that requires time to display more processes.

Further, according to FIG. 13, the output control unit 253 of the terminal device 20 reproduces a moving image in which each process of completion and cooking has a larger number of cuts than each process of material preparation and material processing. In other words, the output control unit 253 reproduces a moving image in which each process of material preparation and material processing has a smaller number of cuts than each process of completion and cooking. As a result, the terminal device 20 can display a state in which cooking is nearing completion, a state in which the finished dish is completed, a state in which ingredients are mixed, or a later process from various angles. On the other hand, the terminal device 20 can display the foodstuff from a certain angle in the preparation of the material and the processing of the material, so that the customer can better recognize the foodstuff (promotional product).

In the above embodiment, the terminal device 20 displays a telop representing the foodstuff for each foodstuff in the image, and when the foodstuff is used in cooking, a moving image in which the telop representing the used foodstuff is erased is displayed. You may play it. That is, the terminal device 20 continues to display the telop representing the foodstuff that has not been used yet, while the telop representing the used foodstuff is erased. As a result, the terminal device 20 can make the customer more aware of the ingredients used in the short-time moving image. For example, when a telop representing an ingredient is displayed at the time of use, the scene in which the ingredient is used may be instantaneous (sometimes less than 1 second) in the display of a high double speed rate. In this case, the telop is displayed only for a moment. First, the terminal device 20 displays a telop representing the foodstuff for each foodstuff in the image and displays until the foodstuff is used, so that the telop representing the foodstuff can be displayed for a longer time, and the foodstuff (promotional product) can be displayed. Including) can be made more recognized by the customer.
The terminal device 20 may play a moving image in which the promotional product is used in a later order than other foodstuffs. For example, when the foodstuffs A, B, and C (C is a promotional product) are mixed, the moving image of mixing the foodstuffs A and B and then mixing the foodstuffs C may be played. In this case, the terminal device 20 displays a telop representing the foodstuffs A, B, and C when the foodstuffs A, B, and C are projected. When the foodstuff A is put in the container or the like, the telop representing the foodstuff A disappears, and when the foodstuff B is put in the container or the like, the telop representing the foodstuff B disappears. At this point, the telop representing the foodstuff C (promotional product) continues to be displayed. After that, when the foodstuff C is put in a container or the like, the telop representing the foodstuff C disappears.
As a result, the terminal device 20 can display the telop representing the sales promotion product for a longer time, and makes the customer more aware of the sales promotion product.

In the above embodiment, the terminal device 20 displays information about the poster of the menu (recipe) or report (for example, nickname), and information about posting or report (for example, comment, number of reports, ranking of number of reports). You may. Here, the report may be a report showing that a general user (corresponding to a customer) has created a recipe. As a result, the customer can know the poster, the comment of the poster, and the like. In addition, the customer can know the number of cooked foods based on the comments and recipes of general users. That is, the terminal device 20 can attract the interest of the customer not only by cooking but also by other information.

In the above embodiment, the terminal device 20 may have the clerk input the number of times (predetermined number of times) that the moving image is continuously reproduced, and the input number of times and the moving image may be continuously reproduced.
Further, the terminal device 20 may simultaneously display the moving image and the list information (information on the foodstuff list or the process list). For example, the terminal device 20 stores the display start time and display end time of the list information at the playback time (elapsed time from the start of playback of the video) of the video for each video, and the stored display start time and display end time. During the time, the list information may be displayed on a part of the display and the moving image may be displayed on a part. For example, the terminal device 20 stores the presence / absence of display of the list information in each process for each moving image, and displays the list information on a part of the display in the process of "Yes" for displaying the list information. You may display the video in. The terminal device 20 stores the type of list information to be displayed, for example, the food ingredient list or the process list, and when displaying the list information, the list information of the type to be stored may be displayed.

A program for realizing the functions of the recipe management device 10 or the terminal device 20 described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. The process as the recipe management device 10 or the terminal device 20 may be performed accordingly. Here, "loading and executing a program recorded on a recording medium into a computer system" includes installing the program in the computer system. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and a dedicated line.

Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system. As described above, the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM. The recording medium also includes an internal or external recording medium that can be accessed from the distribution server to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format that can be executed by the terminal device. That is, the format stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a form that can be executed by the terminal device. The program may be divided into a plurality of parts, downloaded at different timings, and then combined by the terminal device, or the distribution server for distributing each of the divided programs may be different. Furthermore, a "computer-readable recording medium" is a volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network, and holds the program for a certain period of time. It shall also include things. Further, the above program may be for realizing a part of the above-mentioned functions. Further, a so-called difference file (difference program) may be used, which can realize the above-mentioned functions in combination with a program already recorded in the computer system.

Further, a part or all of the recipe management device 10 or the terminal device 20 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each functional unit of the recipe management device 10 or the terminal device 20 may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of making an integrated circuit is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. Further, when an integrated circuit technology that replaces an LSI appears due to advances in semiconductor technology, an integrated circuit based on this technology may be used.

Although one embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like are made without departing from the gist of the present invention. It is possible to do. In addition, one aspect of the present invention can be variously modified within the scope of the claims, and the technical aspects of the present invention are also obtained by appropriately combining the technical means disclosed in the different embodiments. Included in the range. Further, the elements described in each of the above-described embodiments and modifications, and the configurations in which the elements having the same effect are replaced with each other are also included.

[Additional Notes]
From the above description, a plurality of aspects of the present invention can be grasped as follows, for example.

(1) An information processing device that generates a moving image showing a cooking procedure, a classification unit that classifies images of cooking scenes into a plurality of cooking processes, and an importance setting unit that sets the importance of the cooking process. An information processing device including an editing unit that edits a video corresponding to the cooking process and generates a moving image for a predetermined time according to the importance.
(2) The importance setting unit sets the importance including the first importance, the second importance, and the third importance in each of the cooking processes, and the editorial unit sets the first importance. The first time is assigned as the reproduction time to the video corresponding to the cooking process in which is set, and the reproduction time is the first time to the video corresponding to the cooking process in which the second importance is set. The information according to (1), wherein a second time shorter than the first time is allocated, and a playback time is not allocated to the video corresponding to the cooking process for which the third importance is set. Processing equipment.
(3) The importance setting unit sets the importance including the first importance and the second importance in each of the cooking processes, and the editorial unit sets the first importance. The first double speed rate, which is larger than 1 and within a predetermined range, is set for the image corresponding to the cooking process, and the second importance is set for the image corresponding to the cooking process. The information processing apparatus according to (1) or (2), wherein a second double speed rate larger than the double speed rate of 1 is set.
(4) The importance setting unit sets the importance including the first importance and the second importance in each of the cooking processes, and the editorial unit sets the first importance. The first number of cuts, which is larger than 1 and within a predetermined range, is set for the image corresponding to the cooking process, and the second importance is set for the image corresponding to the cooking process. The information processing apparatus according to any one of (1) to (3), wherein a second number of cuts smaller than the number of cuts of 1 is set.
(5) The importance setting unit sets the importance including the first importance and the second importance in each of the cooking processes, and the editorial unit sets the first importance. For the image corresponding to the cooking process, a composition including any of a bird's-eye view, an oblique bird's-eye view, an enlarged bird's-eye view, and an enlarged oblique bird's-eye view is set, and the image corresponding to the cooking process in which the second importance is set is set. On the other hand, the information processing apparatus according to any one of (1) to (4), characterized in that a composition of a bird's-eye view is set.
(6) The editorial department enlarges and enlarges a bird's-eye view, an oblique bird's-eye view, and an enlarged bird's-eye view with respect to the image corresponding to the cooking process for which the importance is set, depending on the cooking being cooked or the cooking process. The information processing apparatus according to any one of (1) to (5), wherein the composition of the oblique bird's-eye view is selected and set.
(7) An image recognition unit for recognizing an image is provided, and the editorial unit displays a telop indicating the name or amount of cooking ingredients together with an image corresponding to the cooking process based on the output of the image recognition unit. The information processing apparatus according to any one of (1) to (6).
(8) The editorial unit is characterized in that, based on the output of the image recognition unit, the display position of the telop is set so as not to overlap with the cooking or cooking utensil in the image corresponding to the cooking process. The information processing apparatus according to (7).
(9) A terminal device installed in a store that displays a video showing a cooking procedure, an input unit that receives a video playback instruction from a clerk, and a first cooking process and a second cooking process based on the playback instruction. The output control unit includes an output control unit that repeatedly reproduces a moving image of a video of a series of cooking scenes including the above, and the output control unit includes at least a part of the video of the first cooking process and the second cooking process. A terminal device characterized in that at least a part of video is played back at different double speeds.
(10) A terminal device installed in a store that displays a video showing a cooking procedure, a classification unit that classifies images of cooking scenes into a plurality of cooking processes, and the importance of setting the importance of the cooking process. Acquire the moving image of the predetermined time from an information processing device including a degree setting unit and an editing unit that edits a video corresponding to the cooking process according to the importance and generates a moving image of a predetermined time. It is characterized by including an acquisition unit, an input unit that receives a playback instruction of the video of the predetermined time from a clerk, and an output control unit that repeatedly reproduces the video of the predetermined time based on the playback instruction. Terminal device to do.
(11) The output control unit is characterized in that the moving image showing the cooking procedure is repeatedly played and an advertisement related to the cooking ingredient is displayed every time the moving image showing the cooking procedure is played a predetermined number of times. The terminal device according to (9) or (10).
(12) The output control unit does not display a playback stop button, and the input unit can receive a video playback instruction from the clerk when the power is turned on after the power of the terminal device is turned off. The terminal device according to any one of (9) to (11).
(13) A display shelf installed in a store where a terminal device, a recipe card, and ingredients are displayed together. The terminal device is an input unit that receives a playback instruction of a video of a sales promotion recipe from a clerk, and the playback. Based on the instruction, the output control unit includes an output control unit that repeatedly reproduces a moving image of a video of a series of cooking scenes including the first cooking process and the second cooking process, and the output control unit is the first cooking process. At least a part of the video and at least a part of the video of the second cooking step are reproduced at different double speeds, the foodstuff is the foodstuff used in the sales promotion recipe, and the recipe card is the sales promotion. A display shelf that contains information about recipes.
(14) An information system including an information processing device that generates a moving image showing a cooking procedure and a terminal device that is installed in a store and displays a moving image showing a cooking procedure, and the information processing device is photographed. A classification unit that classifies the video during cooking into a plurality of cooking processes, an importance setting unit that sets the importance of the cooking process, and an image corresponding to the cooking process are edited according to the importance. The terminal device includes an editorial unit that generates a moving image of a predetermined time, an acquisition unit that acquires a moving image of the predetermined time from the information processing device, an input unit that receives an instruction of a clerk, and the clerk's. An information processing system including an output unit that displays an acquired moving image of a predetermined time in response to an instruction.
(15) An information processing method executed by an information processing device that generates a moving image showing a cooking procedure, in which a classification step of classifying a video of a cooking scene into a plurality of cooking processes and an importance of the cooking process are set. An information processing method comprising: an importance setting step to be performed, and an editing step of editing a video corresponding to the cooking process and generating a moving image at a predetermined time according to the importance.
(16) On a computer, a procedure for classifying an image of a cooking scene into a plurality of cooking processes, a procedure for setting the importance of the cooking process, and an image corresponding to the cooking process according to the importance are displayed. A program to edit and generate a video for a given time, and to run it.
(17) An information processing method executed by a terminal device installed in a store and displaying a video showing a cooking procedure, which is a step of receiving a video playback instruction from a clerk and a first cooking step based on the playback instruction. A step of repeatedly playing back a moving image of a series of cooking scenes including the second cooking process, at least a part of the first cooking process, and at least a part of the second cooking process. An information processing method comprising:, and a step of reproducing at different double speeds.
(18) Based on the procedure for receiving a video playback instruction from a clerk and the playback instruction on the computer, the video of a video of a series of cooking scenes including the first cooking step and the second cooking step is repeatedly played back. A program for executing a procedure, a procedure for reproducing at least a part of the image of the first cooking process, and at least a part of the image of the second cooking process at different double speeds.

1 ... Information processing system, 10 ... Recipe management device, 11 ... Communication unit, 12 ... Storage unit, 13 ... Control unit, 131 ... Image recognition unit, 132 ... Classification unit, 133 ... Importance setting unit, 134 ... Editorial unit, 20, 20-1, 20-2, 20-3, 20-4, 20-5, 20-6 ... Terminal device, 21 ... Communication unit, 22 ... Storage unit, 23 ... Input unit, 24 ... Output unit, 25 ... control unit, 251 ... input control unit, 252 ... video acquisition unit, 253 ... output control unit

Claims (7)

It is a display shelf where terminal equipment and ingredients are displayed together.
The terminal device is
An input unit that accepts instructions for playing a video of a recipe that uses the ingredients,
Based on the above instructions, a second recipe that is a video of a series of cooking scenes including a plurality of cooking steps and is edited so that the playback time is shorter than that of the first recipe video associated with the ingredients. Equipped with an output control unit that repeatedly plays videos
The first recipe video is provided from a computer having a WEB server function for providing cooking information to the user's device in response to a request from the user's device connected to the computer via a network. Is a thing
The output control unit of the terminal device is a display shelf characterized by playing back the second recipe moving image associated with the foodstuff. The second recipe video is edited so that a double speed rate greater than 1 is set or deleted for at least one of the plurality of cooking steps included in the first recipe video, so that the playback time is The display shelf according to claim 1, which includes a shortened version as compared with the first recipe moving image. The display shelf according to claim 2, wherein the second recipe video includes one edited to perform slow playback for at least one of the plurality of cooking steps included in the first recipe video. The display shelf according to any one of claims 1 to 3, wherein the second recipe video is associated with information identifying a store in which the display shelf is installed or information identifying a sales floor of the store. The terminal device is
In the touch panel display for displaying the second recipe video , a user who is a clerk accepts a video playback instruction and receives the video playback instruction.
The operation reception unit for accepting the operation for stopping the reproduction of the second recipe moving image, which is reproduced in response to the reproduction instruction, is not displayed on the touch panel display .
The display according to any one of claims 1 to 4, which receives a playback instruction of the second recipe video from a user who is a clerk when the power is turned on after the power of the terminal device is turned off. shelf. It is a display shelf where the terminal device and the recipe card are displayed together.
The terminal device is
An input unit that accepts instructions for playing the video of the recipe described in the recipe card, and
Based on the above instructions, a second image of a series of cooking scenes including a plurality of cooking steps edited so as to shorten the playback time as compared with the first recipe video associated with the recipe card. Equipped with an output control unit that repeatedly plays recipe videos
The first recipe video is provided from a computer having a WEB server function for providing cooking information to the user's device in response to a request from the user's device connected to the computer via a network. Is a thing
The output control unit of the terminal device is a display shelf characterized by playing back the second recipe moving image associated with the recipe card. Any of claims 1 to 6, wherein the output control unit displays an advertisement related to the second recipe video or the sales floor where the display shelf is installed every time the second recipe video is played a predetermined number of times. Display shelves listed in the crab.