JP4478047B2 - Information presentation apparatus, information presentation method, and program thereof - Google Patents

Description

  The present invention relates to an information presentation apparatus, an information presentation method, and a program for presenting information using a projection apparatus such as a projector.

  Conventionally, as a means for sharing information among a plurality of people, a method of projecting information on a real object has been proposed (see, for example, Patent Document 1). According to this, not only in face-to-face communication, but also when transmitting information between remote locations, such as a remote work support system, It can be projected with a projector. In this way, information can be easily and accurately transmitted by visually presenting information on the real space.

JP 2001-211132 A

However, like the above-described conventional information presentation apparatus, when information is superimposed on an object existing in real space and then projected, only the projected information is presented when an object in the real space moves. Until now, it is unclear what this information was given to.
The present invention has been made by paying attention to the above circumstances, and an object of the present invention is to provide an information presentation device capable of displaying at least traces of an object even after the object in real space has moved. And providing an information presentation method and a program thereof.

  In order to achieve the above object, an information presentation device, an information presentation method, and a program therefor according to the present invention project additional information related to an object existing in the space in the space where the imaging device and the projection device are arranged. It is an information presentation device presented in the space by the device, and obtains first image information obtained by photographing the object by the photographing device. And means for receiving the input of the additional information and means for generating the second image information by combining the acquired first image information and the received additional information. The image information is associated with the position where the object is present and projected onto the space by the projection device.

  By configuring in this way, it is possible to clearly represent the relationship between the information related to the object and the object even after the object in the real space has moved. For this reason, even if the target object has moved, only the additional information is not presented as it is, and it is possible to clearly grasp what is the additional information.

The present invention is also characterized by having the following various configurations.
The first configuration is based on means for accepting input of information specifying a specific range including an object in the first image information, and the first image based on the information specifying the received specific range. Means for extracting third image information by extracting an image corresponding to the specific range from the information, and the means for generating the second image information includes the generated third image information and the above-described third image information. The received additional information is combined to create second image information.
Thereby, since a projection image is displayed only in the specific range of a target object, the relevance of a target object and additional information can be grasped | ascertained easily.

In the second configuration, the means for accepting input of information specifying the specific range accepts input of information representing the contour of the object in the first image information.
In this way, since the projection image is displayed only in the region of the target object, the relevance between the target object and the additional information can be grasped more reliably.

According to a third configuration, the means for creating the second image information includes display control means for controlling whether or not the third image information is displayed, and when the display control means sets display to be present. The second image information is created by combining the generated third image information and the received additional information, and when the display control means sets no display, only the received additional information is displayed. The second image information consisting of is created.
If comprised in this way, when a target object exists in real space, it can avoid projecting the image of a target object. Thereby, the image of the object is not superimposed on the object in the real space, and the visibility is not impaired.

  According to a fourth configuration, the display control means includes a target detection means for determining whether or not the target is present in the specific range in the space, and the target detection means, so that the target is detected by the target detection means. If it is determined that the object does not exist in the specific range, the third image information is set to display. If the object is determined to exist in the specific range, the third image information is not displayed. Set to.

As a result, it is possible to detect whether or not the target object is present and autonomously switch between display and non-display of the target object image, so that information on the target object can be more reliably transmitted together with the target object. Become.
In the fifth configuration, the object detection means calculates a difference value between the fourth image information obtained by photographing with the photographing device and the third image information, and the calculated difference value is a predetermined value. When the threshold value is exceeded, it is determined that the object does not exist, and when the calculated difference value does not exceed a predetermined threshold value, it is determined that the object exists.
By configuring in this way, it can be realized without requiring another new device. For example, the presence of an object can be easily detected using a commercially available image processing algorithm.

The sixth configuration includes means for obtaining first image information obtained by photographing an object existing in a space with a photographing device, and after obtaining the first image information, the object is in the space. It is detected whether or not it exists in the existing position. When it is determined by this detection that the object does not exist at the existence position, the first image information is associated with the existence position of the object and projected onto the space by the projection device. .
In this way, even when the additional information is not presented, when the object in the real space moves, the trace of the object existing in the real space can be clearly indicated.

  In short, according to the present invention, it is possible to provide an information presentation device, an information presentation method, and a program thereof that can display at least traces of the target object even after the target object in real space has moved.

(First embodiment)
FIG. 1 is a schematic configuration diagram showing an information presentation system including an information presentation apparatus according to the first embodiment of the present invention.
This information presentation system includes an information presentation device 1, a camera 2, and a projector 3. The camera 2 and the projector 3 are connected to the information presentation device 1 respectively. The information presentation apparatus 1 is connected with an input device 18 such as a keyboard and a mouse and a display device 19 such as a liquid crystal display (LCD).

  The camera 2 and the projector 3 are fixed so that the shooting range of the camera 2 and the video projection range of the projector 3 coincide as shown in FIG. For example, the optical axis and the angle of view of the camera 2 and the projector 3 are made to coincide with each other by using a half mirror, a mirror, and a focus / zoom function of the camera 2 and the projector 3. In this state, when an image captured by the camera 2 is output to the projector 3 as it is, the image captured by the object 5 is projected onto the object 5 that is the subject. The projection additional information 51 is information related to the object 5 input by the user from the information presentation device 1 and is represented by an image, video, text data, or the like projected by the projector 3.

FIG. 2 is a block diagram showing a functional configuration of the information presentation apparatus 1 according to the first embodiment of the present invention.
The information presentation apparatus 1 includes a central processing unit (CPU) 11 as a main control unit. A data memory 13 and a program memory 14 are connected to the CPU 11 via a bus 12, and further a camera input interface (camera input I / F) 15, a projector output interface (projector output I / F) 16, and an input / output interface. (Input / output I / F) 17 is connected. The input / output I / F 17 is connected to the above-described input device 18 such as a keyboard and a display device 19 such as an LCD.

  The camera input I / F 15 is a connection interface with the camera 2 and has a function of inputting a photographed image of the camera 2. The projector output I / F 16 is a connection interface with the projector 3 and outputs a projection image to the projector 3 under the control of the CPU 11.

  The data memory 13 is composed of, for example, a RAM or a hard disk, and stores an area information storage area 13a and a projection image storage area 13b. The area information storage area 13 a stores area information for creating a projection image projected by the projector 3. FIG. 3 shows the configuration of the area information storage area 13a.

  Each area information stored in the area information storage area 13a includes an ID for identifying area information, an area image, additional information, area coordinates, and a display flag. The area image is an image obtained by extracting an area including the object 5 from the image captured by the camera 2. The additional information is additional information related to the object 5 made up of images, text data, and the like. The area coordinates are coordinate values that represent the area of the object 5 in the captured image of the camera 2. The display flag is set to “ON” or “OFF” whether or not to display the area image.

  In the projection image storage area 13b, a projection image of the projector 3 created by the projection control program 14b described later is stored based on the area information storage area 13a. Further, the projection image stored in the projection image storage area 13b is output to the projector 3 via the projector output I / F 16 by the projection control program 14b.

  The program memory 14 stores an area information receiving program 14a and a projection control program 14b as control programs for realizing the present invention. The area information receiving program 14a has a function of receiving input data for configuring the area information and storing it in the area information storage area 13a. As described above, the projection image storage area 13b is provided with a display flag indicating whether or not to display an area image. The area information reception program 14a sets the display flag to "ON" or "OFF". Process to update to.

  The projection control program 14b reads the region information stored in the region information storage area 13a, creates a projection image of the projector 3 based on the read region information, and stores the created projection image in the projection image storage. The information is stored in the area 13b and output from the projector output I / F 16 to the projector 3.

Next, the operation of the information presentation apparatus 1 configured as described above will be described. FIG. 4 is a flowchart showing the procedure and contents of the area information receiving process of the information presentation apparatus 1.
First, in step S4a, the information presenting apparatus 1 captures a captured image of the object 5 by the camera 2 from the camera input I / F 15 and outputs it to the display device 19 through the input / output I / F 17. Next, the CPU 11 of the information presentation apparatus 1 executes the area information reception program 14a, and inputs and outputs area information (here, additional information, area coordinates, and display flag) input from the input device 18 such as a keyboard and a mouse. Capture via I / F 17. The additional information is display information related to the object 5, and is image data or text data input from an input device such as a keyboard. For example, the region coordinates are obtained by moving a region including the target object 5 with the input device 18 such as a mouse on the screen of the display device 19 on which the captured image of the target object 5 is displayed. The coordinate value of the trajectory up to.

  Next, in step S4c, an area image is extracted from the image captured by the camera 2 in accordance with the received area coordinates. In step S4d, the region image, the region coordinates, the additional information, and the display flag are stored in the region information storage area 13a in association with the ID that is uniquely issued to each region information.

Next, the information presentation operation of the information presentation device 1 will be described according to the stored area information. FIG. 5 is a flowchart showing the procedure and contents of the area information presentation process of the information presentation apparatus 1.
The CPU 11 of the information presentation apparatus 1 executes the projection control program 14b, first initializes the projection image stored in the projection image storage area 13b, and then in step S5a to S5f, the projection image to be projected on the projector 3 is displayed. Perform the creation process. In step S5b, the area information is read from the area information storage area 13a.

  In step S5c, it is determined whether the display flag is set to “ON”. If it is determined that the display flag is “ON”, the process proceeds to step S5d, and the area image is written in the projection image according to the area coordinates. Subsequently, in step S5e, additional information is written into the projection image. On the other hand, if it is determined in step S5c that the display flag is “OFF”, the writing process in step S5d is skipped, the process proceeds to step S5e, and only the additional information is written in the projection image. The processes of steps S5b to S5f are performed for all the area information stored in the area information storage area 13a.

  Then, after creating a projection image as described above, in step S5g, the CPU 11 of the information presenting apparatus 1 stores the created projection image in the projection image storage area 13b and the projection image I. Output to the projector 3 by / F16. Thus, the projector 3 projects the area image (image of the target object 5) superimposed on the target object 5 in the real space and the projection additional information 51 related to the target object 5.

  As described above, in the first embodiment, the CPU 11 of the information presentation device 1 executes the area information reception program 14 a and displays the captured image of the camera 2 input from the camera input I / F 15 on the display device 19. Then, the area information input from the input device 18 is received and stored in the area information storage area 13a. In addition, the CPU 11 of the information presentation device 1 executes the projection control program 14b, reads each area information stored in the area information storage area 13a, creates a projection image, and creates the projection image as a projection image. In addition to being stored in the storage area 13b, this projection image is output from the projector output I / F 16 to the projector 3.

  Therefore, according to the first embodiment, as shown in FIG. 10B, not only the projection additional information 51 related to the object 5 but also the image 52 of the object is combined with the actual object 5 by the projector 3. Projected in a superimposed manner. Conventionally, since only the projection additional information 51 is projected as shown in FIG. 10A, what information the projected projection additional information 51 is for when the actual object 5 no longer exists. It was unknown. In this invention, since the image 52 of the target object is displayed together with the projection additional information 51, it is possible to reliably grasp what the additional information is related to.

  Further, it is possible to control whether or not to display a region image by setting a display flag. If comprised in this way, when the target object 5 exists in real space, as shown to Fig.10 (a), it can avoid projecting the image 52 of a target object. Thereby, the fall of visibility by the image 52 of a target object being superimposed on the target object 5 of real space can be avoided.

  In the first embodiment, the region coordinates are configured to be the coordinate values of the movement trajectory of the input device 18 such as a mouse, but in addition, by selecting the object 5 from the input device 18. Alternatively, the contour of the object 5 may be extracted by a commercially available image recognition algorithm, and coordinate values representing the extracted contour may be used as region coordinates.

(Second Embodiment)
FIG. 6 is a block diagram showing a functional configuration of an information presentation apparatus 1A according to the second embodiment of the present invention. This figure shows another configuration example of the information presentation apparatus 1 in the first embodiment. In the figure, the same parts as those in FIG. .
The information presentation apparatus 1A includes a CPU 11, a data memory 131 and a program memory 141 are connected to the CPU 11 via a bus 12, and further, a camera input I / F 15, a projector output I / F 16, an input / output I / F 17, and the like. Is connected. As in the first embodiment, an input device 18 and a display device 19 are connected to the input / output I / F 17.

  The data memory 131 stores an area information storage area 131a, a projection image storage area 13b, and a camera image storage area 13c. Each area information stored in the area information storage area 131a includes an ID for identifying the area information, an area image, additional information, and area coordinates. That is, the display flag is deleted from the area information storage area 13a of the first embodiment. In the camera image storage area 13c, a photographed image of the camera 2 input from the camera input I / F 15 is stored.

  The program memory 141 stores a difference calculation program 14c in addition to the area information reception program 14a and the projection control program 141b. The difference calculation program 14c has a function of calculating the difference between the camera image stored in the camera image storage area 13c and each area image stored in the area information storage area 131a. Details will be described later.

  The operation of the information presentation device 1A configured as described above will be described. FIG. 7 is a flowchart showing the procedure and contents of the area information presentation process of the information presentation apparatus 1A. Prior to this, it is assumed that the area information reception process shown in FIG. 4 is performed in the same manner as in the first embodiment.

  The CPU 11 of the information presenting apparatus 1A executes the projection control program 14b, first initializes the projection image stored in the projection image storage area 13b, and then in step S7a to S7g, the projection image to be projected on the projector 3 is displayed. Perform the creation process. In step S7b, region information (region image, region coordinates, additional information) is read from the region information storage area 131a. Next, in step S7c, based on the read area information, the sum of the difference values for each pixel in the area coordinates between the area image and the camera image stored in the camera image storage area 13c is calculated.

  Then, in step S7d, a comparison is made between the calculated sum of the difference values and a predetermined threshold value. If the sum of the difference values is larger than the threshold value, the process proceeds to step S7e, and the region image is converted into region coordinates. Write to the projected image according to Following this, additional information is written into the projection image in step S7f. On the other hand, if it is determined in step S7d that the sum of the difference values is smaller than the threshold value, the area image writing process in step S7d is skipped, and the process proceeds to step S7f to write only the additional information in the projection image. The processes in steps S7b to S7f are performed for all the area information stored in the area information storage area 131a.

  Then, after creating a projection image as described above, in step S7h, the CPU 11 of the information presenting apparatus 1A stores the created projection image in the projection image storage area 13b, and also outputs this projection image to the projector output I. Output to the projector 3 by / F16. Thus, the projector 3 projects the area image (image of the target object 5) superimposed on the target object 5 in the real space and the projection additional information 51 related to the target object 5.

  In the second embodiment, the sum of the difference values for each pixel between the captured image of the target object 5 and the region image input from the camera 2 is calculated, and when the calculated value is larger than a predetermined threshold value, The area image is projected by the projector 3, and if the area image is smaller than the threshold value, the area image is not projected. That is, when the target object 5 in the real space moves, a region image (image of the target object 5) is projected, and when the target object 5 exists on the real space at the position when registering the region information, The area image (image of the object 5) is not superimposed on the object 5.

  Since it is such a configuration, it is detected whether or not the object 5 exists in the real space, and the display / non-display of the area image of the object 5 is autonomously switched. It becomes possible to transmit the information 51 together with the object 5 more reliably. This also makes it possible to clearly show the trace of the object 5 in real space even when the projection additional information 51 does not exist.

In addition, the detection process for determining whether or not the object 5 exists in the real space calculates a difference value between the captured image of the camera 2 and the region image, and when the calculated difference value exceeds a predetermined threshold value. Determines that the object does not exist, and determines that the object 5 exists in the real space if the calculated difference value does not exceed a predetermined threshold.
By configuring in this way, it can be realized without requiring another new device. For example, the presence of an object can be easily detected using a commercially available image processing algorithm. Moreover, since the threshold value for determining whether or not the target object 5 exists in the real space has a certain width, for example, the target object 5 can be recognized even if the illumination condition slightly changes. Stable operation is possible even with a certain degree of environmental change.

  Furthermore, in the above determination, the value of (calculated difference value) / (number of pixels used for difference calculation) is obtained using the number of pixels used for difference calculation, that is, the number of pixels included in the region coordinates, and this value The presence / absence of the object 5 may be determined based on whether or not exceeds a preset threshold value. Thus, by using the value normalized by the number of pixels included in the region coordinates rather than the integration of the difference values described above, the presence / absence of the object 5 is determined by a more appropriate index regardless of the size of the region image. can do.

  In the second embodiment, the image captured by the camera 2 and the area image are compared by image processing to determine the presence or absence of the object 5 in the real space. For example, other detectors such as an infrared sensor and an ultrasonic sensor may be used.

(Third embodiment)
FIG. 8 is a schematic configuration diagram of a remote work support system including an information presentation device according to the third embodiment. In the figure, the same parts as those in FIG. 1 in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.
In this remote work support system, the information presentation apparatus 1B arranged at the work site and the instruction apparatus 6 arranged in the support center where the remote instructor is located can be connected via the communication network NW. The communication network NW may be either a wired transmission path or a wireless transmission path. For example, the communication network NW may be configured to pass through a LAN (Local Area Network) or a WAN (Wide Area Network) including the Internet. Similarly to the first embodiment, a camera 2 and a projector 3 are connected to the information presentation device 1B. Further, a display device such as a liquid crystal display (LCD) and an input device such as a keyboard and a mouse are connected to the instruction device 6.

FIG. 9 is a block diagram showing a functional configuration of the information presentation device 1B shown in FIG. This figure shows another configuration example of the information presentation apparatus 1 in the first embodiment. In the figure, the same parts as those in FIG. .
The information presentation device 1 </ b> B includes a communication interface (communication I / F) 20 instead of the input / output I / F 17, the input device 18, and the display device 19 in the information presentation device 1. The communication I / F 20 performs communication with the instruction device 6 installed in the support center via the communication network NW. The program memory 142 connected to the CPU 11 stores an area information reception program 142a and a projection control program 14b.

  The area information reception program 142a receives the area information input from the instruction device 6 through the communication I / F 20, and stores it in the area information storage area 13a. As described in the first embodiment, the projection image storage area 13b is provided with a display flag indicating whether or not to display a region image, and the region information reception program 142a is transmitted from the instruction device 6. The display flag is updated to “ON” or “OFF” based on the display flag.

  The instruction device 6 is configured by, for example, a personal computer, and includes a display device, an input device, and a communication I / F. The communication I / F communicates with the information presentation apparatus 1B installed at the work site via the communication network NW. The display device is configured by a liquid crystal display (LCD) or the like, and displays a photographed image of the camera 2 sent from the information presentation device 1B. As the input device, for example, a keyboard and a mouse are used, and a remote instructor inputs region information. The input area information is transmitted from the communication I / F of the work apparatus to the information presentation apparatus 1B via the communication network NW.

  The operation of the remote work support system configured as described above will be described. The CPU 11 of the information presenting apparatus 1B executes the area information receiving program 142a to photograph the state of the work site with the camera 2, and the photographed image is directed to the instruction apparatus 6 via the communication network NW by the communication I / F 20. Send. The instruction device 6 receives the captured image of the camera 2 transmitted from the information presentation device 1B and outputs it to the display device.

  The remote instructor of the support center grasps the state of the work site from the photographed image of the camera 2 displayed on the display device, selects the area of the object 5 with a mouse or the like, and the area information of the object 5 (here Then, additional information, area coordinates, and display flags) are transmitted to the information presentation apparatus 1B via the communication network NW. Then, the information presentation device 1B receives the transmitted area information via the communication I / F 20. Thereafter, according to the region information input from the pointing device 6, the processing in steps S4c to S4d in FIG. 4 is performed as in the first embodiment, and the region information is stored in the region information storage area 13a. Based on the area information stored in this way, the projection additional information 51 is projected by the projector 3 together with the image of the object 5 by the projection control program 14b as in the first embodiment.

  As described above, in the third embodiment, the information presentation device 1B includes the communication I / F 20, and can be connected to the instruction device 6 via the communication network NW by the communication I / F 20. The CPU 11 of the information presentation device 1B executes the area information reception program 142a and transmits the captured image of the camera 2 to the instruction device 6 through the communication I / F 20. On the other hand, the instruction device 6 outputs the transmitted captured image of the camera 2 to a display device. And the instruction | indication apparatus 6 transmits the area | region information input with the input device from the remote instructor to the information presentation apparatus 1B via the communication network NW. The information presenting apparatus 1B receives the area information transmitted from the instruction apparatus 6 through the communication I / F 20 and stores it in the area information storage area 13a.

  Thus, the remote instructor can grasp the state of the work site while staying at the support center, and can present the projection additional information 51 related to the object 5 to the work site. Further, it is possible to remotely confirm whether or not the object 5 at the work site exists and control whether or not to display the region image (image of the object 5).

  In the third embodiment, the area coordinates and the additional information are transmitted as the area information from the pointing device 6 to the information presentation apparatus 1B. However, the area is determined from the captured image of the camera 2 output to the display apparatus. An area image may be extracted based on the coordinates, and the extracted area image, area coordinates, and additional information may be transmitted.

  The present invention is not limited to the above embodiments. For example, the information presentation apparatus 1 can be applied to various uses such as a telemedicine system and an education support system other than the remote work support system shown in the third embodiment. In addition, the configuration of the information presentation device 1, items stored in the data memory 13, and processing procedures and processing contents of each program stored in the program memory 14 are variously modified without departing from the gist of the present invention. Can be implemented.

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, you may combine the component covering different embodiment suitably.

BRIEF DESCRIPTION OF THE DRAWINGS Schematic which shows an information presentation system provided with the information presentation apparatus concerning 1st Embodiment of this invention. The block diagram which shows the function structure of the information presentation apparatus shown in FIG. The figure which shows the structure of the area | region information storage area of the information presentation apparatus shown in FIG. The flowchart which shows the procedure of the area | region information reception process of the information presentation apparatus shown in FIG. 1, and its content. The flowchart which shows the procedure of the area | region information presentation process of the information presentation apparatus shown in FIG. 1, and its content. Schematic which shows an information presentation system provided with the information presentation apparatus concerning 2nd Embodiment of this invention. The flowchart which shows the procedure of the area | region information presentation process of the information presentation apparatus shown in FIG. 6, and its content. Schematic which shows the remote work assistance system provided with the information presentation apparatus concerning the 3rd Embodiment of this invention. The block diagram which shows the function structure of the information presentation apparatus shown in FIG. The figure which shows the image projected by a projector.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1,1A, 1B ... Information presentation apparatus, 2 ... Camera 2 ... Projector, 5 ... Object, 51 ... Additional information, 11 ... CPU, 12 ... Bus, 13, 131 ... Data memory, 13a, 131a ... Area information storage area , 13b ... projected image storage area, 13c ... camera image storage area, 14, 141, 142 ... program memory, 14a, 142a ... area information reception program, 14b ... projection control program, 14c ... difference calculation program, 15 ... camera input I / F, 16 ... Projector output I / F, 17 ... Input / output I / F, 18 ... Input device, 19 ... Display device, NW ... Communication network, 6 ... Indicator, 51 ... Projection additional information, 52 ... Object image.

Claims (4)

An information presentation device for presenting additional information related to an object existing in the space to the space by the projection device in a space where the imaging device and the projection device are arranged,
Means for obtaining first image information obtained by photographing the object by the photographing device;
Means for receiving input of the additional information;
Means for accepting input of information for designating a specific range including the object in the first image information;
Means for extracting third image information by extracting an image corresponding to the specific range from the first image information based on the information specifying the received specific range;
Object detection means for determining whether or not the object is present in the specific range in the space;
When it is determined by the object detection means that the object does not exist in the specific range, the third image information is set to display, and it is determined that the object exists in the specific range. Display control means for setting the third image information to no display in the case ,
When the display control means sets display, the second image information is created by combining the created third image information and the received additional information, and no display is made by the display control means. The second image information including only the received additional information ;
An information presentation device comprising: means for causing the projection device to project the created second image information to the space in association with the position where the object exists. The object detection unit calculates a difference value between the fourth image information obtained by photographing with the photographing device and the third image information, and the calculated difference value exceeds a predetermined threshold value. The information presenting apparatus according to claim 1 , wherein: determines that the object does not exist, and determines that the object exists if the calculated difference value does not exceed a predetermined threshold . In a space where an imaging device and a projection device are arranged, an information presentation method for presenting additional information related to an object existing in the space to the space by the projection device,
Acquiring first image information obtained by photographing the object with the photographing device;
Receiving the input of the additional information;
Receiving an input of information specifying a specific range including an object in the first image information;
A step of extracting third image information by extracting an image corresponding to the specific range from the first image information based on the information specifying the received specific range;
An object detection process for determining whether the object exists in the specific range in the space;
When it is determined by the object detection means that the object does not exist in the specific range, the third image information is set to display, and it is determined that the object exists in the specific range. A display control process for setting the third image information to no display in the case ;
If display is set in the display control process, second image information is created by combining the created third image information and the received additional information, and no display is made in the display control process. Is set, the process of creating the second image information consisting only of the received additional information,
Associating the created second image information with the position where the object exists and projecting the second image information onto the space by the projection device;
An information presentation method characterized by comprising: In a space where an imaging device and a projection device are arranged, a program used in an information presentation device including a computer that presents additional information related to an object existing in the space to the space by the projection device,
Processing for obtaining first image information obtained by photographing the object by the photographing device;
A process of receiving input of the additional information;
A process of accepting input of information specifying a specific range including an object in the first image information;
A process of extracting third image information by extracting an image corresponding to the specific range from the first image information based on the information specifying the received specific range;
An object detection process for determining whether or not the object exists in the specific range in the space;
When it is determined by the object detection means that the object does not exist in the specific range, the third image information is set to display, and it is determined that the object exists in the specific range. A display control process for setting the third image information to no display in the case ;
When the display control process is set to display, the generated third image information and the received additional information are combined to create second image information, and no display is performed in the display control process. Is set, the process of creating the second image information consisting only of the received additional information,
A process of associating the created second image information with an existing position of the object and projecting the second image information onto the space by the projection device;
Is executed by the computer.

Images