JP5512378B2 - Object display device, object display system, and object display method - Google Patents

Description

  The present invention relates to an object display device, an object display system, and an object display method.

  In recent years, services using AR (Augmented Reality) technology have been developed and provided. For example, a technique is known in which an object arranged around the location of a mobile terminal is acquired, and the object is superimposed and displayed on an image acquired by a camera provided in the mobile terminal. The object is exemplified by so-called POI (Point of Interest) information including various information and images. There is also known an apparatus that associates geographical information on a computer with each part in a landscape image of a real landscape and presents it to a user (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 10-267671

  However, in the prior art, a predetermined object such as an icon is only superimposed and displayed in association with a predetermined position in a real space video or image, and the display mode of the object is constant. For this reason, the ability to express information by displaying objects is low. In implementing various services using the AR technology, it is desired to further improve the expressive power by displaying objects.

  Therefore, the present invention has been made in view of the above problems, and in AR technology, an object display device, an object display system, and an object capable of improving the expressive power of an object to be superimposed and displayed on a real space video or image. An object is to provide a display method.

  In order to solve the above-described problems, an object display device according to the present invention is an object display device that displays an object placed in a real space so as to be superimposed on a video or image taken of the real space in a first display mode. Object information acquisition for acquiring object information including information defining a second display mode different from the first display mode and information on a control condition defining a condition for displaying an object in the second display mode A control condition determining unit that determines whether or not a control condition included in the object information acquired by the object information acquiring unit is satisfied, and a control condition determining unit that determines that the control condition is satisfied Based on the object information acquired by the object information acquisition means, the object is displayed in the second display mode. Characterized in that it comprises a display control means for performing display control on Shimesuru so.

  In order to solve the above-described problems, an object display system according to the present invention includes an object display device that superimposes and displays an object arranged in a real space on a video or image obtained by shooting the real space in a first display mode. An object display system comprising a server communicable with the object display device, wherein the object display device is different from the first display mode, and the position information transmitting means for transmitting the position information relating to the location of the object to the server. Object information acquisition means for acquiring object information including information defining the second display mode and information on control conditions defining conditions for displaying the object in the second display mode, and acquired by the object information acquisition means Determine whether the control conditions included in the object information are satisfied Display control so that the object is displayed in the second display mode based on the object information acquired by the object information acquiring unit when the control condition determining unit and the control condition determining unit determine that the control condition is satisfied. The server includes a display control means for executing the position information receiving means for receiving the position information transmitted from the object display device, the object information storage means for storing the object information, and the position indicated by the position information. Object information extracting means for extracting object information of an object located within a predetermined distance from the object information storage unit, and object information transmitting means for transmitting the object information extracted by the object information extracting means to the object display device It is characterized by comprising .

  In order to solve the above-described problem, the object display method of the present invention provides an object display that superimposes an object arranged in a real space on a video or image obtained by photographing the real space in a first display mode. An object display method in an apparatus, which includes information specifying a second display mode different from the first display mode, and object information including information related to a control condition specifying a condition for displaying an object in the second display mode Information acquisition step, a control condition determination step for determining whether or not a control condition included in the object information acquired in the object information acquisition step is satisfied, and a control condition is satisfied in the control condition determination step Is determined in the object information acquisition step. Based on the object information, and having a display control step of performing the display control to display the object in the second display mode.

  According to the object display device, the object display system, and the object display method of the present invention, the first display mode that is a normal display mode when displaying an object when a control condition defined for each object is satisfied. The display is controlled so that the object is displayed in a second display mode different from the above. Thereby, since the display mode of the object can be made different between when the control condition is satisfied and when it is not satisfied, the expressive power by displaying the object is improved.

  Further, in the object display device of the present invention, the object information acquisition means is any one of the current time, the distance between the position of the object display device and the position where the object is arranged, and the current weather condition as the control condition. One or a plurality of object information defined is acquired.

  According to this configuration, since each event described above can be defined as a control condition, an object can be displayed in the second display mode when those events occur. Therefore, the display mode of the object when the event occurs can be made different from that when the event does not occur.

  Further, in the object display device of the present invention, the object information acquisition means includes a display in a color different from the first display mode, a display with a lightness different from that in the first display mode, a blinking display, and an image of the object in the first display mode. Or a video or image different from the image, a predetermined moving image, a video or image obtained by rotating the video or image of the object in the first display mode, a display at a position different from the arrangement position of the object in the first display mode, and Object information including any one or a plurality of concealed displays that do not display an image or image of an object in the first display mode as a second display mode is obtained.

  According to this configuration, since the above display mode can be set as the second display mode of the object, the expressive power by the object display is improved by various display modes.

  In order to solve the above-described problems, an object display system according to the present invention includes an object display device that superimposes and displays an object arranged in a real space on a video or image obtained by shooting the real space in a first display mode. An object display system comprising a server communicable with the object display device, the object display device including position information transmission means for transmitting position information relating to the location of the object to the server, and object information which is information relating to the object An object information acquisition means for acquiring, and a display control means for performing display control so as to display the object in a predetermined display mode based on information relating to the display mode of the object included in the object information. Receives location information sent from the device Object information including position information receiving means, information defining a second display mode different from the first display mode, and information on control conditions defining conditions for displaying an object in the second display mode Object information storage means, and object information extraction means for extracting object information of an object located within a predetermined distance from the position indicated by the position information received by the position information receiving means from the object information storage section And an object control condition determining unit that determines whether or not the control condition of the object information extracted by the object information extracting unit is satisfied, and an object control condition determining unit that determines that the control condition is satisfied Information to display the object in the second display mode The object information is transmitted to the object display device, and the object control condition determining means includes the information indicating that the object is displayed in the first display mode when it is not determined that the control condition is satisfied. And an object information transmitting means for transmitting information to the object display device.

  In order to solve the above problems, an object display method according to the present invention includes an object display device that superimposes and displays an object placed in a real space on a video or image obtained by shooting the real space in a first display mode. An object display method in an object display system comprising a server capable of communicating with the object display device, wherein the object display device transmits position information relating to the location of the object to the server, and the server includes the object Position information receiving step for receiving position information transmitted from the display device, information for defining a second display mode different from the first display mode by the server, and conditions for displaying the object in the second display mode Objects that store object information including information on control conditions that specify An object information extracting step for extracting object information of an object located within a predetermined distance from a position indicated by the position information received in the position information receiving step from the object information storage means; An object control condition determining step for determining whether or not the control condition of the object information extracted in the step is satisfied; and a second step when the server determines that the control condition is satisfied in the object control condition determining step. If the object information including information indicating that the object is displayed in the display mode is transmitted to the object display device and it is not determined that the control condition is satisfied in the object control condition determination step, the first display mode is displayed. In the object An object information transmission step for transmitting object information including information to be displayed to the object display device; an object information acquisition step for the object display device to acquire the object information transmitted in the object information transmission step; and an object display. A display control step of performing display control so as to display the object in a predetermined display mode based on information related to the display mode of the object included in the object information acquired in the object information acquisition step. And

  According to the object display system and the object display method of the present invention, when the control condition defined for each object is satisfied, the first display mode is different from the first display mode that is a normal display mode when displaying an object. Display control is performed so that the object is displayed in the two display modes. Thereby, since the display mode of the object can be made different between when the control condition is satisfied and when it is not satisfied, the expressive power by displaying the object is improved. Further, since the server determines whether or not the control condition is satisfied, the processing load on the object display device is reduced.

  In the object display device of the present invention, the object information accumulating means is any one of the current time, the distance between the position of the object display device and the position where the object is arranged, and the current weather condition as the control condition. One or a plurality of specified object information is stored.

  According to this configuration, since each event described above can be defined as a control condition, an object can be displayed in the second display mode when those events occur. Therefore, the display mode of the object when the event occurs can be made different from that when the event does not occur.

  In the object display device of the present invention, the position information transmitting unit of the object display device transmits the identification information of the object display device together with the position information to the server, and the position information receiving unit of the object display device is the object display device. The server receives the position information and identification information transmitted from the position information transmitting means, and the object information storage means of the server is an object in which the distance between the position of the specific object display device and the position where the object is arranged is defined as a control condition. The information is stored, and the object control condition determination means of the server is configured such that the object display device identified by the identification information corresponds to a specific object display device, and the position of the object display device and the position where the object is arranged To determine whether the distance of the vehicle meets the control conditions And wherein the door.

  According to this configuration, the identification information of the object display device is transmitted from the object display device to the server together with the position information, and the server determines whether or not the specific object display device is located within a predetermined distance from the object arrangement position. When it is determined that the specific object display device is located within a predetermined distance of the object, information indicating that the object is displayed in the second display mode is transmitted to the object display device. Therefore, an object can be displayed in a display mode unique to a specific object display device.

  In the object display device of the present invention, the server includes related event acquisition means for acquiring position information of a plurality of object display devices, and the object information storage means of the server displays object information existing within a predetermined distance from the object. The object information in which the number of devices is defined as the control condition is accumulated, and the object control condition determination unit of the server satisfies the control condition based on the position information of the plurality of object display devices acquired by the related event acquisition unit. It is characterized by determining whether or not.

  According to this configuration, since the position information of the plurality of object display devices is acquired by the server, information regarding the number of object display devices located within a predetermined distance of the object is acquired by the server. Accordingly, when the number of object display devices located within a predetermined distance from the object arrangement position is defined as the control condition, the server can determine whether or not the control condition is satisfied. When it is determined that the control condition is satisfied, information indicating that the object is displayed in the second display mode is transmitted to the object display device. Therefore, when the control condition is satisfied, the object can be displayed on the plurality of object display devices in a predetermined display mode.

  Further, in the object display device of the present invention, the object information storage means displays in a color different from the first display mode, displays in brightness different from the first display mode, blinking display, and video of the object in the first display mode. Or a video or image different from the image, a predetermined moving image, a video or image obtained by rotating the video or image of the object in the first display mode, a display at a position different from the arrangement position of the object in the first display mode, and Object information including any one or more of hidden displays that do not display an object video or image in the first display mode as the second display mode is stored.

  According to this configuration, since the above display mode can be set as the second display mode of the object, the expressive power by the object display is improved by various display modes.

  In the AR technology, it is possible to improve the expressiveness of an object to be superimposed and displayed on a real space video or image.

It is a figure which shows the apparatus structure of an object display system. It is a block diagram which shows the functional structure of an object display apparatus. It is a hard block diagram of an object display device. It is a block diagram which shows the functional structure of AR server. It is a figure which shows the example of a structure of the object information storage part, and the data stored. It is a timing chart which shows the processing content of the object display method in a 1st embodiment. It is a block diagram which shows the functional structure of the object display apparatus in 2nd Embodiment. It is a block diagram which shows the functional structure of AR server in 2nd Embodiment. It is a figure which shows the structure of the object information storage part in 2nd Embodiment, and a part of stored data. It is a timing chart which shows the processing content of the object display method in a 2nd embodiment.

  Embodiments of an object display device, an object display system, and an object display method according to the present invention will be described with reference to the drawings. If possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a block diagram illustrating a device configuration of an object display system 5 according to the first embodiment. As shown in FIG. 1, the object display system 5 includes an object display device 1 and an AR server 3 (server) that can communicate with the object display device 1. The object display device 1 is, for example, a portable terminal capable of communication via a mobile communication network. Therefore, the object display device 1 communicates with the AR server 3 via the base station of the mobile communication network. The object display device 1 can communicate with the AR server 3 by means such as wireless LAN communication.

  The content server 7 is a server that manages various contents such as POI information. The AR server 3 can acquire POI information and the like from the content server 7.

  FIG. 2 is a block diagram illustrating a functional configuration of the object display device 1 according to the first embodiment. The object display device 1 of the present embodiment is a device that displays an object placed in the real space, and receives object information that is information related to an object placed around the location of the object display device 1 from the AR server 3. The acquired object is superimposed and displayed on the video or image of the real space acquired by the camera provided in the object display device 1. The object is exemplified by, for example, a character image, an icon, and text, and is associated with a place in the real space. The object can be so-called POI information including various information and images, for example.

  The object display device 1 displays an object in a predetermined first display mode during normal times. The object information includes position information related to the arrangement position of the object and information related to the first display mode. The first display mode is, for example, two-dimensional or three-dimensional video or image data that is included in the object information and represents the object, or a video or image of a predetermined icon that the object display device 1 holds in advance. It can be a reference value or ID value for the data.

  The object information includes information related to a second display mode different from the first display mode, and information related to a control condition that defines a condition for displaying the object in the second display mode. The object display device 1 displays an object in the second display mode when a control condition defined for each object is satisfied. The object information may include 2D or 3D video or image data according to the second display mode, or may include URL information indicating a storage location of such video or image data. Also good.

  As shown in FIG. 2, the object display device 1 functionally includes a position information acquisition unit 10, a position information transmission unit 11 (position information transmission unit), an object information acquisition unit 12 (object information acquisition unit), and an orientation acquisition. A visual field object information extraction unit 14, an event acquisition unit 15, a control condition determination unit 16 (control condition determination unit), an imaging unit 17, a display control unit 18 (display control unit), and a display unit 19.

  FIG. 3 is a hardware configuration diagram of the object display device 1. As shown in FIG. 3, the object display device 1 physically includes a CPU 101, a RAM 102 and a ROM 103 which are main storage devices, a communication module 104 which is a data transmission / reception device, an auxiliary storage device 105 such as a hard disk and a flash memory, an input The computer system includes an input device 106 such as a keyboard, which is a device, and an output device 107 such as a display. The functions shown in FIG. 2 are executed by reading predetermined computer software on hardware such as the CPU 101 and the RAM 102 shown in FIG. 3 and executing them, thereby controlling the communication module 104, the input device 106, This is realized by operating the output device 107 and reading and writing data in the RAM 102 and the auxiliary storage device 105. Again, with reference to FIG. 2, each function part of the object display apparatus 1 is demonstrated in detail.

  The position information acquisition unit 10 is a part that acquires position information related to the location of the object display device 1, and is configured by a GPS device, for example. The position information acquisition unit 10 may acquire position information from a base station that manages communication of the object display device 1. The position information acquisition unit 10 sends the acquired position information to the position information transmission unit 11.

  The position information transmission unit 11 is a part that transmits the position information of the object display device 1 to the AR server 3.

  The object information acquisition unit 12 is a part that acquires object information from the AR server 3. The object information defines position information indicating the arrangement position of the object, a first display mode, a second display mode different from the first display mode, and conditions for displaying the object in the second display mode. Information about the control conditions that have been made can be included.

  The second display mode is, for example, a display with a color different from the first display mode, a display with a lightness different from that of the first display mode, a blinking display, or a video or image different from the video or image of the object in the first display mode. A predetermined moving image, a video or image obtained by rotating an image or image of an object in the first display mode, a display or movement at a position different from the arrangement position of the object in the first display mode, and a first display mode Any one or a plurality of concealment displays that do not display the video or image of the object. Here, the video or image of the object includes a two-dimensional image, 3D graphics data, animation content, moving image data, and the like recorded in a predetermined format. The contents of the second display mode are examples, and are not limited to these.

  The control condition defines one or more of the current time, the distance between the position of the object display device 1 and the position where the object is arranged, the movement trajectory of the object display device 1, the current weather condition, and the like. ing. The contents of the control conditions described above are examples and are not limited to these.

  The azimuth acquisition unit 13 is a part that acquires azimuth information regarding the imaging direction of the imaging unit 17. The direction acquisition unit 13 sends the direction information to the in-view object information extraction unit 14.

  The object information extraction unit 14 in the field of view is within the field of view of the video or image in the real space acquired by the imaging unit 17 from the object information acquired by the object information acquisition unit 12 based on the position information of the object information. This is a part for extracting object information of contained objects. The in-view object information extraction unit 14 can calculate the view range in the video or image of the real space acquired by the imaging unit 17 based on the orientation information acquired by the orientation acquisition unit.

  The event acquisition unit 15 is a part that acquires various events for determining whether or not the control condition is satisfied. The event acquisition unit 15 acquires, for example, information on the current time, the distance between the position of the object display device 1 and the position where the object is arranged, the movement trajectory of the object display device 1, the current weather condition, and the like. Specifically, the event acquisition unit 15 can acquire information such as the current time and the current weather condition through communication with other devices that manage the information. In addition, the event acquisition unit 15 determines whether the position of the object display device 1 and the position where the object is arranged based on the position information acquired by the position information acquisition unit 10 and information on the arrangement position of the object included in the object information. You can get the distance. Further, the event acquisition unit 15 can acquire the movement trajectory of the object display device 1 by acquiring a plurality of pieces of position information acquired by the position information acquisition unit 10 in time series. The event acquisition unit 1 sends information about various acquired events to the control condition determination unit 16.

  The control condition determination unit 16 is a part that determines whether or not the control condition defined in the object information is satisfied based on various events acquired by the event acquisition unit 15. The control condition determination unit 16 sends the determination result to the display control unit 18.

  The imaging unit 17 is a part that captures a real space video or image, and is configured by a device such as a camera, for example.

  The display control unit 18 is a part that performs display control so that the object is displayed in the second display mode when the control condition determination unit 16 determines that the control condition is satisfied. Further, when the control condition determining unit 16 does not determine that the control condition is satisfied, the display control unit 18 performs display control so that the object is displayed in the first display mode.

  The display unit 19 is a part that displays an image in which an object is superimposed on a real space video or image based on display control by the display control unit 18. The display unit 19 is configured by, for example, a display device.

  Next, the function of the AR server 3 will be described in detail. FIG. 4 is a block diagram showing a functional configuration of the AR server 3 according to the first embodiment. The AR server 3 according to the present embodiment includes a position information receiving unit 30 (position information receiving unit), an object information storage unit 31 (object information storage unit), an object information extraction unit 32 (object information extraction unit), and an object information transmission unit 33. (Object information transmitting means), an object information collecting unit 34, and an object information adding unit 35 are provided. The AR server 3 is also a computer having a hardware configuration similar to that of the object display device 1 shown in FIG. With reference to FIG. 4, each functional unit of the AR server 3 will be described in detail.

  The position information receiving unit 30 is a part that receives position information transmitted from the object display device 1. The position information receiving unit 30 sends the received position information to the object information extracting unit 32.

  The object information storage unit 31 is a storage unit that stores object information. FIG. 5 is a diagram illustrating an example of the configuration and data of the object information stored in the object information storage unit 31. As shown in FIG. 5, the object information storage unit 31 stores object information for each object ID. The object information includes an object name, position information, unique information, an acquisition range, object data, and action information.

  “Position information” is information indicating the arrangement position of the object in the real space. The “unique information” is information regarding the location where the object is associated, and includes, for example, information such as tel (phone number), address (address), url (URL), and email (mail address). The “unique information” is not an essential component in the object information.

  The “acquisition range” defines conditions for extracting object information transmitted to the object display device 1 by distance. That is, when the distance between the arrangement position of the object and the object information device 1 is equal to or less than the distance specified in the “acquisition range”, the object information is extracted as object information to be transmitted to the object information device 1. The The object information may be extracted by extracting object information of an object arranged within a preset distance from the object display device 1 regardless of the distance defined in the “acquisition range” of the object information. .

  The “object data” is video or image data or a reference value in the first display mode when displaying the object. When video or image data or a reference value is not registered in the “object data”, the object display device 1 displays a standard icon or the like previously held as the first display mode of the object. .

  “Action information” includes control conditions, display mode, and display data, and stores information related to the second display mode of the object. In the example of object information shown in FIG. 5, action information is defined for all object information, but “action information” is not defined for object information of an object that does not require a change in display mode.

The “control condition” stores a condition for displaying the object in the second display mode. In the “control condition”, for example, the current time, the distance between the position of the object display device 1 and the position where the object is arranged, the movement trajectory of the object display device 1, the current weather condition, and the like are set. In the example shown in FIG. 5, the distance Z ₁ between the position of the object display device 1 and the position where the object is arranged is set as the control condition in the object information with ID “1”. In addition, the object information of ID "2", the current time T ₂ has been set. Also, the object information ID "3", the movement locus P ₃ of the object display device 1 is set. Further, in the object information of ID “4”, a distance Z ₄ and a time T ₄ between the position of the object display device 1 and the position where the object is arranged are set.

  The “display mode” is information that defines the display mode (second display mode) of the object when the control condition is satisfied. The “display mode” includes, for example, a display with a color different from the first display mode, a display with a lightness different from the first display mode, a blinking display, and a video or image different from the video or image of the object in the first display mode. A predetermined moving image, a video or image obtained by rotating an image or image of an object in the first display mode, a display or movement at a position different from the arrangement position of the object in the first display mode, and a first display mode Any one or a plurality of object display modes such as a hidden display that does not display the video or image of the object are defined.

  “Display data” refers to video or image data, or video or image data used when it is specified in the “display mode” that an object is displayed with a video or image different from the first display mode. Provides information on storage location. The information regarding the storage location of video or image data is, for example, a URL. The object display device 1 uses the video or image data stored in the “display data” or the video or image data acquired from the storage location indicated by the URL for displaying the object. When URL information is set in “display data”, the object display device 1 may store video or image data acquired based on the URL in a cache memory. The “display mode” and “display data” in the object information constitute information related to the second display mode in the present invention.

  The object information extraction unit 32 is a part that extracts object information of an object located within a predetermined distance set in advance from the position indicated by the position information transmitted from the object display device 1 from the object information storage unit 31. As described above, when the position of the object display device 1 is included in the “acquisition range” of the object information, the object information extraction unit 32 may extract the object information. The object information extraction unit 32 sends the extracted object information to the object information transmission unit 33.

  The object information transmission unit 33 is a part that transmits the object information extracted by the object information extraction unit 32 to the object display device 1.

  The object information collection unit 34 is a part that collects POI information and the like from the content server 7 and registers the collected POI information and the like in the object information storage unit 31 as basic information for creating object information. The POI information registered here includes information such as unique information and position information in the object information.

  The object information adding unit 35 is a part that completes the object information by adding “action information” or the like in the object information to the information collected and registered by the object information collecting unit 34. The information added by the object information adding unit 35 is input by the owner or manager of the facility related to the POI information as desired.

  Next, the operation of the object display system 5 in the object display method of the present embodiment will be described with reference to FIG. FIG. 6 is a timing chart showing the processing contents executed in the object display system 5.

  First, the object display device 1 activates the position information acquisition unit 10 (S1). Furthermore, the object display device 1 activates the imaging unit 17 and the orientation acquisition unit 13 (S2). Then, the object display device 1 determines whether or not an operation input for displaying an object has been performed (S3). When an operation input for displaying an object is performed, the processing procedure proceeds to step S4. In step S4, the position information acquisition unit 10 measures the location of the object display device 1, and transmits information about the located location to the AR server 3 as location information (S4).

  Subsequently, the position information receiving unit 30 receives the position information transmitted from the object display device 1 (S5). Next, the object information extraction unit 32 extracts object information of an object located within a predetermined distance set in advance from the position indicated by the position information transmitted from the object display device 1 from the object information storage unit 31 (S6). ). Then, the object information transmission unit 33 transmits the object information extracted by the object information extraction unit 32 to the object display device 1 (S7).

  When the object information is transmitted from the AR server 3, the object information acquisition unit 12 acquires the object information (S8, object information acquisition step). Subsequently, the orientation acquisition unit 13 acquires orientation information regarding the imaging direction of the imaging unit 17 (S9). The in-view object information extraction unit 14 then, based on the position information of the object information, from the object information acquired by the object information acquisition unit 12, the view range of the video or image of the real space acquired by the imaging unit 17. Object information of the objects included in the object is extracted (S10).

  Next, the control condition determination unit 16 determines whether there is object information in which “action information” is defined in the object information extracted in step S10 (S11). If it is determined that there is object information for which “action information” is defined, the processing procedure proceeds to step S12. On the other hand, if it is not determined that there is object information for which “action information” is defined, the processing procedure proceeds to step S14.

  In step S12, the control condition determination unit 16 determines whether there is object information that satisfies the “control condition” among the object information for which action information is defined (S12, control condition determination step). If it is determined that there is object information that satisfies the “control condition”, the processing procedure proceeds to step S13. On the other hand, if it is not determined that there is object information that satisfies the “control condition”, the processing procedure proceeds to step S14.

  In step S13, the control condition determination unit 16 sets an action flag (not shown) associated with the object information that satisfies the control condition to “ON”. The action flag means that the object is displayed in the second display mode (S13, display control step).

  In step S14, the display control unit 18 renders the object according to the object information (S14, display control step). Specifically, the display control unit 18 renders the object indicated by the object information whose action flag is set to “ON” in the second display mode. Further, the display control unit 18 renders the object indicated by the object information whose action flag is not set to “ON” in the first display mode.

  Then, the display control unit 18 superimposes the rendering screen generated in step S14 on the video or image of the real space acquired by the imaging unit 17 and causes the display unit 19 to display the rendering screen (S15, display control step). In this way, the process of this embodiment is complete | finished.

  In the object display device 1, the object display system, and the object display method of the first embodiment described above, the display control unit 18 when the control condition determination unit 16 determines that the control condition defined for each object is satisfied. Thus, the display control is performed so that the object is displayed in a second display mode different from the first display mode which is a normal display mode when displaying the object. Thereby, since the display mode of the object can be made different between when the control condition is satisfied and when it is not satisfied, the expressive power by displaying the object is improved.

(Second Embodiment)
Next, the object display system 5, the object display device 1, and the AR server 3 according to the second embodiment will be described. In the first embodiment, it is determined whether or not the control condition is satisfied in the object display device 1, and display control of the object is performed based on the determination result. On the other hand, in the second embodiment, it is determined whether or not the control condition is satisfied in the AR server 3, and object information including information regarding the display mode is transmitted from the AR server 3 to the object display device 1 to display the object display. Display control based on information related to the display mode is performed in the device 1.

  FIG. 7 is a block diagram illustrating a functional configuration of the object display device 1 according to the second embodiment. As illustrated in FIG. 7, the object display device 1 according to the second embodiment functionally includes a position information acquisition unit 10, a position information transmission unit 11 (position information transmission unit), and an object information acquisition unit 12 (object information). Acquisition means), an orientation acquisition unit 13, an in-view object information extraction unit 14, an imaging unit 17, a display control unit 18 (display control unit), and a display unit 19. The object display device 1 according to the second embodiment is different from the object display device 1 of the first embodiment in that the event acquisition unit 15 and the control condition determination unit 16 are not provided. Each function part 10-14, 17-19 of the object display apparatus 1 which concerns on 2nd Embodiment has a function similar to each function part 10-14, 17-19 in the object display apparatus 1 which concerns on 1st Embodiment. . Below, the difference with 1st Embodiment in each function part 10-14, 17-19 of the object display apparatus 1 of 2nd Embodiment is demonstrated.

  In addition to the position information of the object display device 1, the position information transmission unit 11 can transmit identification information of the object display device 1 to the AR server 3.

  The object information acquired by the object information acquisition unit 12 from the AR server 3 is different from the object information acquired by the object information acquisition unit 12 in the first embodiment. Specifically, the object information acquired by the object information acquisition unit 12 includes information that specifies the display mode of the object. The display control unit 18 performs display control so that the object is displayed in either the first display mode or the second display mode based on information specifying the display mode included in the object information.

  FIG. 8 is a block diagram showing a functional configuration of the AR server 3 according to the second embodiment. The AR server 3 of the second embodiment includes the related event acquisition unit 36 (related event acquisition unit) and the object control condition determination unit 37 (object control condition determination unit). It is different from 4). Below, it demonstrates centering on difference with 1st Embodiment about each function parts 30-37 of AR server 3 of 2nd Embodiment.

  The position information receiving unit 30 receives the position information and the identification information of the object display device 1 when the identification information of the object display device 1 is transmitted from the object display device 1 together with the position information.

  The related event acquisition unit 36 can acquire events such as the current time, the distance between the position of the object display device and the position where the object is arranged, and the current weather condition. These events are used to determine whether or not the control condition is satisfied. Moreover, the related event acquisition part 36 can acquire the positional information of several object display apparatus 1, 1A, 1B .... Specifically, the related event acquisition unit 36 can acquire information such as the current time and the current weather state by communicating with other devices that manage the information. Further, the related event acquisition unit 36 acquires the distance between the position of the object display device 1 and the position where the object is arranged based on the position information of the object display device 1 and information on the arrangement position of the object included in the object information. it can. In addition, the related event acquisition unit 36 can acquire the movement locus of the object display device 1 by acquiring a plurality of pieces of position information of the object display device 1 that can be acquired from the object display device 1 in time series.

  The object control condition determination unit 37 is a part that determines whether the control condition of the object information extracted by the object information extraction unit 32 is satisfied based on the event acquired by the related event acquisition unit 36.

  When the object control condition determination unit 37 determines that the control condition is satisfied, the object information transmission unit 33 displays object information including information indicating that the object is displayed in the second display mode. 1, when the object control condition determination unit 37 does not determine that the control condition is satisfied, the object display device 1 includes object information including information indicating that the object is displayed in the first display mode. Send to.

In the second embodiment, since it is determined whether or not the control condition is satisfied in the AR server 3, it is possible to set a control condition different from that in the first embodiment in the object information. FIG. 9 is a diagram illustrating a part of an example of object information stored in the object information storage unit 31 according to the second embodiment. As illustrated in FIG. 9, the object information storage unit 31 stores control conditions such as “object display device: X ₅ , distance: Z ₅ ”, “number of peripheral terminals: C ₆ , distance Z ₆ ”. In order for the object display device 1 to determine these control conditions, the AR server 3 side collects information related to peripheral terminals and distributes the information to the object display device 1 according to the object display device 1, object of the first embodiment. There is a need to add to display systems and object display methods.

The control condition “object display device: X ₅ , distance: Z ₅ ” indicates that when the specific object display device “X ₅ ” is located within the distance “Z ₅ ” from the object, the object is displayed in the second display mode. It is specified to be displayed in In this case, the object control condition determining unit 37 corresponds to a specific object display device X ₅ in which the object display device 1 that is identified by the received identification information is defined in the control condition by the position information receiving unit 30, and the distance between the arranged positions of the objects in the object display device 1 determines whether it is within a distance Z _5. According to this control condition, an object can be displayed in a display mode unique to the specific object display device 1.

The control condition “number of peripheral terminals: C ₆ , distance Z ₆ ” includes “C ₆ ” object display devices 1, 1 A, 1 B... Within the distance “Z ₆ ” from the object. The object is displayed in the second display mode. In this case, the object control condition determination unit 37 is based on the position information of the plurality of object display devices 1 acquired by the related event acquisition unit 36, and the object display device 1 located within the distance “Z ₆ ” from the object. It is determined whether or not the control condition is satisfied. According to this control condition, an object can be displayed on the plurality of object display devices 1 in a predetermined display mode.

  Next, the processing content of the object display method in the object display system 5 according to the second embodiment will be described with reference to FIG. FIG. 10 is a timing chart showing the processing contents executed in the object display system 5.

  The processing contents of steps S21 to S23 in FIG. 10 are the same as the processing contents of steps S1 to S3 in the first embodiment (FIG. 6), respectively. In subsequent step S24, the position information acquisition unit 10 measures the location of the object display device 1, and transmits information on the measured location to the AR server 3 as location information (S24, location information transmission step). Further, the position information acquisition unit 10 can transmit the identification information of the object display device 1 to the AR server 3 together with the position information.

  Subsequently, the position information receiving unit 30 receives the position information transmitted from the object display device 1 (S25, position information receiving step). When the identification information of the object display device 1 is transmitted in step S24, the position information receiving unit 30 also receives the identification information. Next, the object information extraction unit 32 extracts object information of an object located within a predetermined distance set in advance from the position indicated by the position information transmitted from the object display device 1 from the object information storage unit 31 (S26). , Object information extraction step).

  Next, the object control condition determination unit 37 determines whether or not there is object information in which “action information” is defined in the object information extracted in step S26 (S27, object control condition determination step). . If it is determined that there is object information for which “action information” is defined, the processing procedure proceeds to step S28. On the other hand, if it is not determined that there is object information for which “action information” is defined, the processing procedure proceeds to step S30.

  In step S28, the object control condition determining unit 37 determines whether there is object information satisfying the “control condition” among the object information in which the action information is defined (S28, object control condition determining step). ). If it is determined that there is object information that satisfies the “control condition”, the processing procedure proceeds to step S29. On the other hand, if it is not determined that there is object information that satisfies the “control condition”, the processing procedure proceeds to step S30.

  In step S29, the object control condition determination unit 37 sets an action flag (not shown) associated with the object information that satisfies the control condition to “ON” (S29, object information transmission step). The action flag means that the object is displayed in the second display mode. And the object information transmission part 33 transmits the object information containing an action flag to the object display apparatus 1 (S30, object information transmission step).

  When the object information is transmitted from the AR server 3, the object information acquisition unit 12 acquires the object information (S31, object information acquisition step). Subsequently, the orientation acquisition unit 13 acquires orientation information regarding the imaging direction of the imaging unit 17 (S32). Then, the in-view object information extraction unit 14 is based on the position information of the object information, and from the object information acquired by the object information acquisition unit 12, the view space range of the real space video or image acquired by the imaging unit 17. Object information of the objects included in the object is extracted (S33).

  Subsequently, the display control unit 18 renders the object according to the object information (S34, display control step). Specifically, the display control unit 18 renders the object indicated by the object information whose action flag is set to “ON” in the second display mode. Further, the display control unit 18 renders the object indicated by the object information whose action flag is not set to “ON” in the first display mode.

  Then, the display control unit 18 superimposes the rendering screen generated in step S34 on the video or image of the real space acquired by the imaging unit 17 and causes the display unit 19 to display the rendered screen (S35, display control step). In this way, the process of this embodiment is complete | finished.

  The object display device 1, the object display system, and the object display method according to the second embodiment described above are normal display modes for displaying an object when a control condition defined for each object is satisfied. Display control is performed so that the object is displayed in a second display mode different from the first display mode. Thereby, since the display mode of the object can be made different between when the control condition is satisfied and when it is not satisfied, the expressive power by displaying the object is improved. Further, since the AR server 3 determines whether or not the control condition is satisfied, the processing load on the object display device 1 is reduced. Furthermore, in the second embodiment, it is possible to easily modify and extend the design of action information related to an object simply by changing the configuration of the AR server 3 without changing the configuration of the object display device 1.

  The present invention has been described in detail based on the embodiments. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

  DESCRIPTION OF SYMBOLS 1,1A, 1B ... Object display apparatus, 3 ... AR server, 5 ... Object display system, 7 ... Content server, 10 ... Position information acquisition part, 11 ... Position information transmission part, 12 ... Object information acquisition part, 13 ... Direction Acquisition unit, 14 ... in-view object information extraction unit, 15 ... event acquisition unit, 16 ... control condition determination unit, 17 ... imaging unit, 18 ... display control unit, 19 ... display unit, 30 ... position information receiving unit, 31 ... Object information accumulating unit 32... Object information extracting unit 33... Object information transmitting unit 34... Object information collecting unit 35... Object information adding unit 36.

Claims (7)

An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. Because
The object display device includes:
Position information transmission means for transmitting position information related to the location of the object to the server;
Object information acquisition means for acquiring object information which is information about the object;
Display control means for performing display control so as to display the object in a predetermined display mode based on information related to the display mode of the object included in the object information;
The server
Position information receiving means for receiving the position information transmitted from the object display device;
The object information including information defining a second display mode different from the first display mode and information on a control condition defining a condition for displaying the object in the second display mode is stored. Object information storage means;
Object information extraction means for extracting object information of an object located within a predetermined distance set in advance from the position indicated by the position information received by the position information receiving means from the object information storage means;
Object control condition determination means for determining whether or not the control condition of the object information extracted by the object information extraction means is satisfied;
When the object control condition determining unit determines that the control condition is satisfied, the object information including information indicating that the object is displayed in the second display mode is transmitted to the object display device. If the object control condition determining means does not determine that the control condition is satisfied, the object display device includes the object information including information indicating that the object is displayed in the first display mode. An object information transmitting means for transmitting ,
The object information storage means defines one or more of the current time, the distance between the position of the object display device and the position where the object is arranged, and the current weather condition as the control condition. Storing the object information,
An object display system characterized by that. An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. Because
The object display device includes:
Position information transmission means for transmitting position information related to the location of the object to the server;
Object information acquisition means for acquiring object information which is information about the object;
Display control means for performing display control so as to display the object in a predetermined display mode based on information related to the display mode of the object included in the object information;
The server
Position information receiving means for receiving the position information transmitted from the object display device;
The object information including information defining a second display mode different from the first display mode and information on a control condition defining a condition for displaying the object in the second display mode is stored. Object information storage means;
Object information extraction means for extracting object information of an object located within a predetermined distance set in advance from the position indicated by the position information received by the position information receiving means from the object information storage means;
Object control condition determination means for determining whether or not the control condition of the object information extracted by the object information extraction means is satisfied;
When the object control condition determining unit determines that the control condition is satisfied, the object information including information indicating that the object is displayed in the second display mode is transmitted to the object display device. If the object control condition determining means does not determine that the control condition is satisfied, the object display device includes the object information including information indicating that the object is displayed in the first display mode. An object information transmitting means for transmitting ,
The position information transmitting means transmits identification information of the object display device together with the position information to the server,
The position information receiving means receives the position information and the identification information transmitted from the position information transmitting means,
The object information storage means stores object information in which a distance between a position of the specific object display device and a position where the object is arranged is defined as the control condition,
The object control condition determining means is configured such that the object display device identified by the identification information corresponds to the specific object display device, and the distance between the position of the object display device and the position where the object is disposed is Determine whether the control condition is met,
An object display system characterized by that. An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. Because
The object display device includes:
Position information transmission means for transmitting position information related to the location of the object to the server;
Object information acquisition means for acquiring object information which is information about the object;
Display control means for performing display control so as to display the object in a predetermined display mode based on information related to the display mode of the object included in the object information;
The server
Position information receiving means for receiving the position information transmitted from the object display device;
The object information including information defining a second display mode different from the first display mode and information on a control condition defining a condition for displaying the object in the second display mode is stored. Object information storage means;
Object information extraction means for extracting object information of an object located within a predetermined distance set in advance from the position indicated by the position information received by the position information receiving means from the object information storage means;
Object control condition determination means for determining whether or not the control condition of the object information extracted by the object information extraction means is satisfied;
When the object control condition determining unit determines that the control condition is satisfied, the object information including information indicating that the object is displayed in the second display mode is transmitted to the object display device. If the object control condition determining means does not determine that the control condition is satisfied, the object display device includes the object information including information indicating that the object is displayed in the first display mode. An object information transmitting means for transmitting ,
The server further comprises related event acquisition means for acquiring position information of a plurality of object display devices,
The object information storage means stores object information in which the number of the object display devices existing within a predetermined distance from the object is defined as the control condition;
The object control condition determining means determines whether or not the control condition is satisfied based on position information of a plurality of object display devices acquired by the related event acquiring means;
An object display system characterized by that. The object information storage means includes
Display with a color different from the first display mode, display with brightness different from the first display mode, flashing display, video or image different from the video or image of the object in the first display mode, a predetermined moving image, A video or image obtained by rotating a video or image of an object in the first display mode, display or movement at a position different from the arrangement position of the object in the first display mode, and the object in the first display mode to any one of claims 1 to 3, characterized in that accumulates the object information including any one or more of the hidden display that does not display an image or images as said second display mode The object display system described. An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. An object display method in
A position information transmitting step in which the object display device transmits position information related to a location of the object to the server;
A position information receiving step in which the server receives the position information transmitted from the object display device;
The server accumulates object information including information defining a second display mode different from the first display mode, and information relating to a control condition defining a condition for displaying the object in the second display mode. An object information extracting step for extracting object information of an object located within a predetermined distance from a position indicated by the position information received in the position information receiving step from the object information storage means
An object control condition determination step in which the server determines whether or not the control condition of the object information extracted in the object information extraction step is satisfied;
When the server determines that the control condition is satisfied in the object control condition determination step, the object information including information indicating that the object is displayed in the second display mode is displayed in the object display. The object information including information indicating that the object is displayed in the first display mode when the control condition is not determined to be satisfied in the object control condition determination step is transmitted to the apparatus. An object information transmission step for transmitting to the object display device;
An object information acquisition step in which the object display device acquires the object information transmitted in an object information transmission step;
Display control for performing display control so that the object display device displays the object in a predetermined display mode based on information on the display mode of the object included in the object information acquired in the object information acquisition step. And having steps,
The object information storage means defines one or more of the current time, the distance between the position of the object display device and the position where the object is arranged, and the current weather condition as the control condition. Storing the object information,
An object display method characterized by that. An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. An object display method in
A position information transmitting step in which the object display device transmits position information related to a location of the object to the server;
A position information receiving step in which the server receives the position information transmitted from the object display device;
The server accumulates object information including information defining a second display mode different from the first display mode, and information relating to a control condition defining a condition for displaying the object in the second display mode. An object information extracting step for extracting object information of an object located within a predetermined distance from a position indicated by the position information received in the position information receiving step from the object information storage means
An object control condition determination step in which the server determines whether or not the control condition of the object information extracted in the object information extraction step is satisfied;
When the server determines that the control condition is satisfied in the object control condition determination step, the object information including information indicating that the object is displayed in the second display mode is displayed in the object display. The object information including information indicating that the object is displayed in the first display mode when the control condition is not determined to be satisfied in the object control condition determination step is transmitted to the apparatus. An object information transmission step for transmitting to the object display device;
An object information acquisition step in which the object display device acquires the object information transmitted in an object information transmission step;
Display control for performing display control so that the object display device displays the object in a predetermined display mode based on information on the display mode of the object included in the object information acquired in the object information acquisition step. And having steps ,
In the position information transmission step, the identification information of the object display device is transmitted to the server together with the position information,
In the position information reception step, the position information and the identification information transmitted in the position information transmission step are received,
The object information storage means stores object information in which a distance between a position of the specific object display device and a position where the object is arranged is defined as the control condition,
In the object control condition determination step, the object display device identified by the identification information corresponds to the specific object display device, and the distance between the position of the object display device and the position where the object is disposed is Determine whether the control condition is met,
An object display method characterized by that. An object display system comprising: an object display device that superimposes and displays an object placed in the real space on a video or image obtained by photographing the real space in a first display mode; and a server that can communicate with the object display device. An object display method in
A position information transmitting step in which the object display device transmits position information related to a location of the object to the server;
A position information receiving step in which the server receives the position information transmitted from the object display device;
The server accumulates object information including information defining a second display mode different from the first display mode, and information relating to a control condition defining a condition for displaying the object in the second display mode. An object information extracting step for extracting object information of an object located within a predetermined distance from a position indicated by the position information received in the position information receiving step from the object information storage means
An object control condition determination step in which the server determines whether or not the control condition of the object information extracted in the object information extraction step is satisfied;
When the server determines that the control condition is satisfied in the object control condition determination step, the object information including information indicating that the object is displayed in the second display mode is displayed in the object display. The object information including information indicating that the object is displayed in the first display mode when the control condition is not determined to be satisfied in the object control condition determining step is transmitted to the device. An object information transmission step for transmitting to the object display device;
An object information acquisition step in which the object display device acquires the object information transmitted in an object information transmission step;
Display control for performing display control so that the object display device displays the object in a predetermined display mode based on information on the display mode of the object included in the object information acquired in the object information acquisition step. And having steps ,
The server further includes a related event acquisition step of acquiring position information of a plurality of object display devices,
The object information storage means stores object information in which the number of the object display devices existing within a predetermined distance from the object is defined as the control condition;
In the object control condition determination step, it is determined whether or not the control condition is satisfied based on position information of the plurality of object display devices acquired in the related event acquisition step.
An object display method characterized by that.

Images