JP2021163500A - Augmenting reality system - Google Patents

Abstract

To provide an augmented reality system which makes users interested in advertisements.SOLUTION: A user terminal 2 of an advertisement system 1, an augmented reality system, comprises an object management unit configured to place a character in an augmented reality space, and an advertisement management unit configured to place an advertisement object for displaying an advertisement in the augmented real space. The object management unit controls the character to interact with the advertisement object. The user terminal also comprises a scene generation unit configured to generate scene information that defines motions of objects placed in the augmented reality space, where the scene generation unit sets an instruction for controlling the character to interact with the advertisement object in the scene information, and the object management unit controls placement and motions of the character and the advertisement object in accordance with the scene information.SELECTED DRAWING: Figure 1

Description

The present invention relates to an augmented reality system.

Guide information in an augmented reality form is provided (see Patent Document 1).

Japanese Patent No. 6100496

Advertisements cannot be displayed when using augmented reality guide information.

The present invention has been made in view of such a background, and an object of the present invention is to provide a technique capable of providing an advertisement in an augmented reality space.

The main invention of the present invention for solving the above problems is an augmented reality system, in which an object management unit for arranging a character in an augmented reality space and an advertisement management for arranging an advertisement object for displaying an advertisement in the augmented reality space. The object management unit comprises a unit, and is characterized in that the object management unit controls the character to interact with the advertisement object.

Other problems disclosed in the present application and solutions thereof will be clarified in the columns and drawings of the embodiments of the invention.

According to the present invention, it is possible to provide an advertisement in an augmented reality space.

It is an overall block diagram of the advertising system which concerns on this embodiment. It is a system block diagram of the advertisement system which concerns on this embodiment. It is a flowchart which shows the process which a user terminal 3 receives an advertisement. It is explanatory drawing about the display of the augmented reality content in the augmented reality system which concerns on this embodiment. It is explanatory drawing about the interaction between a virtual object and an advertisement in the augmented reality system which concerns on this embodiment. It is a figure which shows the configuration example of the augmented reality content provision system which concerns on 2nd Embodiment. It is a figure explaining the operation of the augmented reality content provision system which concerns on 2nd Embodiment.

<Outline of the invention>
The contents of the embodiments of the present invention will be described in a list. The present invention includes, for example, the following configuration.
[Item 1]
An object management unit that places characters in augmented reality space,
An advertisement management unit that arranges an advertisement object that displays an advertisement in the augmented reality space,
With
The object management unit controls the character to interact with the advertising object.
An augmented reality system featuring.
[Item 2]
The augmented reality system described in item 1
It also has a scene creation unit that creates scene information that defines the behavior of objects placed in the augmented reality space.
The scene creation unit sets an instruction in the scene information to control the character to interact with the advertisement object.
The object management unit controls the arrangement and operation of the character and the advertising object according to the scene information.
An augmented reality system featuring.
[Item 3]
The augmented reality system described in item 1
The object management unit controls the character so that the character touches the advertisement object.
An augmented reality system featuring.
[Item 4]
The augmented reality system described in item 1
The object management unit controls the character so that the character emits a line about the advertisement object.
An augmented reality system featuring.
[Item 5]
The augmented reality system described in item 1
The object management unit controls the character so that the character directs his / her eyes to the advertisement object.
An augmented reality system featuring.

A specific example of the advertising system according to the embodiment of the present invention will be described below with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims. In the following description, the same elements will be designated by the same reference numerals in the description of the drawings, and duplicate description will be omitted.

FIG. 1 is an overall configuration diagram of an advertising system according to the present embodiment. FIG. 2 is a system configuration diagram of the advertising system according to the present embodiment. The advertising system 1 includes a server 2 on the service side and a user terminal 3 that bidirectionally communicates with the server 2 via the Internet I.

The server 2 has a function of providing an advertisement to a customer, and mainly includes a server communication unit 21, a storage unit 22, and an advertisement providing unit 23.

The server communication unit 21 is a part capable of communicating with an external device such as a customer's terminal, and may be, for example, a wireless communication means.

The storage unit 22 stores a database, a program, or the like in which various information is stored. For example, the storage unit includes an advertisement DB 22a or the like in which an advertisement used for augmented reality is stored. In addition, the advertisements used for augmented reality include at least advertisements related to goods and services. Further, as the form of the advertisement, visual information including still images, moving images, and virtual objects, audio information, odor information, taste information, tactile information, and the like are included. In addition, each advertisement is associated with at least one piece of information. For example, a product advertisement includes and associates product attribute information such as type, shape, size, feature, price, and mode, and product-related information such as the sales location of the product. In addition, the service service advertisement is linked with attribute information such as the type, feature, price, and mode of the service service, and related information such as the place where the service service can be received.

The advertisement providing unit 23 has a function of extracting an advertisement from the advertisement DB 22a and transmitting the advertisement to the user terminal 3. In addition, the advertisement providing unit 23 can acquire various information from the user terminal 3 and has a function of extracting advertisements related to the acquired information.

The user terminal 3 may be an electronic terminal such as a smartphone, a tablet, or a laptop computer, and mainly includes a terminal communication unit 31, a camera 32, an input unit 33, a display unit 34, and an object management unit 35. , An advertisement management unit 36, an advertisement response unit 37, an information output unit 38, and a position identification unit 39.

The terminal communication unit 31 is a part capable of communicating with an external device, and is, for example, a wireless communication means.

The camera 32 is a part that performs a shooting operation or the like, and has an image pickup element such as a CCD or CMOS element that converts an optical image into an electric signal, and a shutter. Moreover, not only still images but also moving images can be taken.

The input unit 33 can input via a user operation, such as a touch panel or a keyboard. Further, the input unit 33 may be input not only by hand but also by voice, for example.

The display unit 34 is, for example, a liquid crystal monitor and can display various types of information. Further, the display unit 34 may be integrated with the input unit 33.

The advertisement information acquisition unit has a function of acquiring advertisement information.

The object storage unit 35a stores, for example, model information necessary for generating a virtual object with a motif such as a virtual character or daily necessities. The model information can be, for example, data in a format such as USDZ or glTF. Further, the model information includes, for example, attribute information directly related to the virtual object, advertisement attribute information, and advertisement correspondence information corresponding to the advertisement-related information. The attribute information includes, for example, information such as appearance, type, mode, and component configuration.

The object management unit 35b creates augmented reality content. Specifically, the object management unit 35b creates an augmented reality image to be superimposed and displayed on an image in the real space (an image taken by the camera 32). The object management unit 35b can create a virtual object based on the model information stored in the object storage unit 35a and arrange it in the augmented reality space. The object management unit 35b can also arrange the advertisement object created by the advertisement management unit 36, which will be described later, in the augmented reality space.

The advertisement management unit 37 has a function of outputting advertisement information. For example, the advertisement management unit applies the received advertisement information to an advertisement object suitable for the advertisement information. The advertisement object is a virtual object created by the object management unit 35b. The advertising object is an object (peripheral object) delivered together with an object specified by the user, such as a character. The advertising object may be a virtual object that originally displays content on its surface, such as a picture frame or television, or around a virtual object that is the main content such as a character, such as a wall, desk, or door. It may be a virtual object representing an article to be distributed, or it may be another virtual object such as a T-shirt or a cup that is possessed by a virtual object that is the main content such as a character. The advertisement management unit 37 can display the advertisement on the appearance of the advertisement object by, for example, pasting the advertisement information of the still image or the moving image as a texture on the surface of the advertisement object. Further, for example, when the advertisement information is voice information, the voice information can be attached to the advertisement object so that the voice information can be reproduced when the advertisement object is reproduced. For example, when the advertisement management unit 37 receives the advertisement information regarding the new clothes, the advertisement management unit 37 can have the new clothes design attached to the surface of the advertisement object having the clothes as a motif. The advertisement management unit 37 can attach the advertisement information to the advertisement object of the attribute corresponding to the attribute information of the advertisement information. For example, when the advertisement management unit 37 receives the advertisement information of a new song, since the advertisement attribute information is music, it can be attached to an advertisement object having a radio case as a motif, which includes the advertisement correspondence information corresponding to the music. .. When there are a plurality of virtual objects, the advertisement management unit can set the advertisement information as at least one texture.

The information output unit 38 has a function of outputting various information and data to the display unit 34. Further, the information output unit 38 has a function of outputting not only video but also audio information, odor information, tactile information, taste information and the like.

The position specifying unit 39 has a function of acquiring the position information of the user terminal 3 by, for example, a beacon for positioning using satellite positioning such as GPS or short-range wireless technology. In addition, the position specifying unit 39 can also transmit the acquired position information to the server 2.

FIG. 3 is a flowchart showing a process in which the user terminal 3 receives an advertisement. FIG. 4 is an explanatory diagram regarding the display of augmented reality content in the augmented reality system according to the present embodiment. FIG. 5 is an explanatory diagram regarding the interaction between the virtual object and the advertisement in the augmented reality system according to the present embodiment.

First, as step S1, the user activates the augmented reality mode on the user terminal 3. In the augmented reality mode, the camera 32 of the user terminal 3 is activated, the surrounding real space image P (information in the real space) taken by the camera 32, and the virtual character O generated by the object management unit 37. A virtual drink D (virtual object) with a drink as a motif is displayed on the display unit 34.

Next, in step S2, the user terminal 3 transmits the location information to the server 2.

Next, in step S3, the advertisement providing unit 23 of the server 2 extracts the advertisement related to the location information from the advertisement DB 22a and transmits it to the user terminal 3. In the present embodiment, an advertisement related to a drink sold at a cafe within a predetermined range is extracted from the position of the user terminal 3 based on the received position information.

Next, in step S4, the advertisement-corresponding unit 37 causes the received advertisement to be associated with the appropriate virtual drink D to generate the advertisement object C.

Next, in step S5, the object management unit 35 controls the virtual character O to react to the advertisement object C. In the present embodiment, the virtual character O raises the advertisement object C, but the present invention is not limited to this. For example, the virtual character may apply an external force to the advertising object such as touching or hitting the advertising object. Virtual characters may also refer to advertising objects. For example, when an advertisement is received or an advertisement object is generated, the virtual character may output a voice to that effect. Further, the virtual character may be used depending on its purpose. For example, if the advertising object is a drink, the virtual character can make a drinking gesture on the advertising object.

Next, in step S6, the user displays and reproduces the content of the advertisement, and the process in the present embodiment is completed.

As described above, the advertising system 1 in the present embodiment has an effect that the user can be interested in the advertisement and the virtual character reacts to the advertisement object to encourage the user to purchase. ..

Although the description of the embodiment of the present invention is completed above, the aspect of the present invention is not limited to this embodiment.

<Second embodiment>
FIG. 6 is a diagram showing a configuration example of the augmented reality content providing system according to the second embodiment. In the second embodiment, the user terminal 3 omits the advertisement receiving unit 36 and the advertisement management unit 37. Further, the storage unit 22 of the server 2 includes an object DB 22b in addition to the advertisement DB 22a.

The object DB 22b stores model information (hereinafter, also simply referred to as a virtual object) of a virtual object arranged in the augmented reality space. The model information can be, for example, data in a format such as USDZ or glTF.

In the second embodiment, the providing unit 23 provides augmented reality content. The providing unit 23 can provide augmented reality content in response to a request from the user terminal 3, for example. In the request, a virtual object (hereinafter referred to as a content object) that the user wants to view, such as a character, is specified. The providing unit 23 reads the content object specified in the request from the storage unit 22, and responds to the user terminal 3 with augmented reality content including the content object and scene information for arranging the content object in the augmented reality space. .. At this time, the providing unit 23 can respond to the user terminal 3 by including a virtual object for displaying the advertisement (hereinafter, referred to as an advertisement object) in the augmented reality content. The providing unit 23 can paste (set) an advertising image as a texture of an advertising object, for example. The providing unit provides the content object in response to the request from the user terminal, but the present invention is not limited to this. For example, when the object management unit receives a request for a content object from the user terminal, the object management unit sends the requested content object (first object) and advertisement object (second object) to the user terminal. May be provided. In addition, advertising information related to the first object may be set in the second object.

FIG. 7 is a diagram illustrating the operation of the augmented reality content providing system according to the second embodiment.

In step S2, the user terminal 3 transmits a request for augmented reality content to the server 2. The request includes the specification of a virtual object such as a character that the user wants to view.

In step S3, the server 2 creates augmented reality content in response to the request. The server 2 can create augmented reality content by reading model information corresponding to a virtual object (hereinafter referred to as a content object) such as a character specified in a request from the object DB 22b, for example. The server 2 can also generate an object such as a background set or an accessory that is not specified by the user as an advertisement object, attach the advertisement information to the texture of the advertisement object, and then include it in the augmented reality content. Further, the server 2 can include scene information in which the arrangement position and movement of the content object and the advertisement object are specified in the augmented reality content.

In step S4, the user terminal 3 receives the augmented reality content and can create an augmented reality scene based on the received augmented reality content.

As described above, according to the augmented reality content providing system according to the second embodiment, the advertisement object can be provided in association with the content object that the user intends to browse. Therefore, the advertisement can be placed in the same augmented reality space as the content object that the user is interested in.

Although the description of the embodiment of the present invention is completed above, the aspect of the present invention is not limited to this embodiment.

<Modification example>
In the above embodiment, the object storage unit 35a includes information such as appearance, type, mode, and component configuration as attribute information of the virtual object, but the present invention is not limited to this. For example, action information such as various motions and conversation phrases may be included, or scene information such as a series of motions and conversation actions in which a plurality of objects are set may be included. Further, the object management unit 35b can control the virtual object to operate based on the action information or the scene information requested by the user. Further, when the user requests an action from a virtual object or a series of actions from a plurality of objects, that fact is stored in the object storage unit 35a. Alternatively, a notification to that effect is sent to the advertisement providing section of the server.

Then, the advertisement providing unit of the server can extract the advertisement based on the behavior information or the scene information from the advertisement DB and send it to the user terminal.

Further, in the augmented reality mode in the above embodiment, the surrounding real space image P (information in the real space) captured by the camera 32 and the virtual character O (virtual object) generated by the object management unit 37 are used. Is displayed on the display unit 34, but the present invention is not limited to this. For example, an augmented reality draft service that recognizes the surrounding real space (buildings, roads, objects, etc.) taken by the camera based on the location information of the user terminal and the direction in which the user terminal is facing (for example, Google map). It may be a service (Live View).

Further, the object management unit 35 may have a function of converting all or a part of the surrounding real space (buildings, roads, objects, etc.) recognized by the augmented reality mode into a virtual object (real space object).

Further, the advertisement providing unit 23 of the server 2 may extract the advertisement related to the position information and the information about the real space object and send it to the user terminal 3.

In the above embodiment, the advertisement is displayed as a video, but the advertisement is not limited to this and may be audio information.

Further, the advertisement in the above embodiment and the environment in the real space may be odor information. For example, the information output unit 38 of the user terminal 3 contains at least one odor element, and the information output unit 38 can emit one or more odor elements. The odorant may be a single chemical substance such as furaneol (strawberry scent) or 1-hexanol (forest scent), or a combination thereof. Further, for example, regardless of the composition of the chemical substance, an odor having a scent equivalent to that of jasmine as one unit may be used. That is, for example, the information output unit 38 may output an equivalent odor by combining a plurality of chemical substances using the odor of strawberry milk as an output method, or the odor of strawberry as one unit and the odor of milk. The odor may be output in combination with the odor of one unit.

Further, the advertisement in the above embodiment and the environment in the real space may be taste information. For example, the information output unit 38 of the user terminal 3 contains at least one taste element, and the information output unit 38 can release one or more taste elements. The taste element may be, for example, a single chemical substance such as inosinic acid or glutamic acid, or a combination thereof. Further, for example, regardless of the composition of the chemical substance, a taste equivalent to the strawberry taste may be used as one unit. That is, for example, the information output unit 38 may output the same taste by combining a plurality of chemical substances by using the taste information of strawberry chocolate as an output method, or the taste with the strawberry taste as one unit and the chocolate taste. May be output in combination with a taste having a unit of.

Further, the advertisement in the above embodiment and the environment in the real space may be tactile information. (Effect of claim 14)

Further, in the present embodiment, a virtual space based on augmented reality (AR) is assumed, but the present invention is not limited to this, and is limited to a virtual reality (VR) space or a mixed reality (MR) space. Even if there is, the advertising system of this embodiment can be applied as it is.

1 Advertising system 2 Server 3 User terminal 21 Server communication unit
22 Storage unit 22a Advertising DB
23 Advertising section 31 Terminal communication section 32 Camera 33 Input section 34 Display section 35 Object management section 36 Advertising management section 37 Advertising response section 38 Information output section 39 Location identification section

Claims (5)

An object management unit that places characters in augmented reality space,
An advertisement management unit that arranges an advertisement object that displays an advertisement in the augmented reality space,
With
The object management unit controls the character to interact with the advertising object.
An augmented reality system featuring. The augmented reality system according to claim 1.
It also has a scene creation unit that creates scene information that defines the behavior of objects placed in the augmented reality space.
The scene creation unit sets an instruction in the scene information to control the character to interact with the advertisement object.
The object management unit controls the arrangement and operation of the character and the advertising object according to the scene information.
An augmented reality system featuring. The augmented reality system according to claim 1.
The object management unit controls the character so that the character touches the advertisement object.
An augmented reality system featuring. The augmented reality system according to claim 1.
The object management unit controls the character so that the character emits a line about the advertisement object.
An augmented reality system featuring. The augmented reality system according to claim 1.
The object management unit controls the character so that the character directs his / her eyes to the advertisement object.
An augmented reality system featuring.

Images