JP2014010362A - Image producing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image producing device which can take in various contents so as to perform interesting image production.SOLUTION: An image producing device includes: a projector and distance sensor camera which are arranged at a viewpoint-side prescribed position in a region where an object as a target for image projection can appear; and a controller generating an image projected on a surface of the object on the basis of distance information on the surface of the object, which is obtained by the distance sensor camera, so as to output an image signal to the projector.

Description

  The present invention relates to a video effect device.

  A video presentation such as presenting a video in conjunction with the movement of a moving object such as a player is desired, but no sufficient video has been proposed.

  Patent Document 1 discloses a mechanism that detects a user's instruction and line of sight from an image of a user's appearance and reflects it in information presentation such as an advertisement, but is not intended for video production. Not enough.

JP 2006-215863 A

  As described above, there has conventionally been no interesting thing as a video production, and the appearance of a novel structure has been awaited.

  The present invention has been proposed in view of the above-described conventional problems, and an object of the present invention is to provide an interesting video effect capable of capturing various contents.

  In order to solve the above-described problems, in the present invention, the projector and the distance sensor camera arranged at a predetermined position on the viewpoint side of the possible appearance area of the object to be image projected, and the distance sensor camera are obtained. And a control device that generates an image projected on the surface of the object based on distance information of the surface of the object and outputs a video signal to the projector.

  In the video presentation apparatus of the present invention, various contents can be captured, and an interesting video presentation can be performed.

It is a figure which shows the structural example of the video presentation apparatus concerning one Embodiment of this invention. It is a figure which shows the structural example of a control apparatus. It is a figure which shows the structural example of a video correction | amendment part. It is FIG. (1) which shows the example of a video production. It is a figure (the 2) which shows the example of a video production. It is FIG. (The 3) which shows the example of a video production.

  Hereinafter, preferred embodiments of the present invention will be described.

  FIG. 1 is a diagram showing a configuration example of a video effect device according to an embodiment of the present invention.

  In FIG. 1, a large LCD (Liquid Crystal Display) panel 1 is installed on a wall or the like where the player P can approach, and a projector 2 and a distance sensor camera 3 are installed on the ceiling or the like above. It is assumed that the visual field of the distance sensor camera 3 covers an area where an object such as the player P to be detected can appear.

  The LCD panel 1 receives a video signal and displays a video. The projector 2 inputs a video signal and projects the video on the surface of an object such as a hand or a body of the player P. The distance sensor camera 3 irradiates a fine pattern of infrared light in the direction to be imaged, images an image including the pattern, and analyzes the distance information indicating the distance from the distance sensor camera 3 for each pixel ( A distance video signal having depth information) is output. In addition, as distance information, it is good also as what gives an offset to the distance from the distance sensor camera 3, and shows the distance from another position.

  The LCD panel 1, the projector 2, and the distance sensor camera 3 are connected to a control device 4 such as a PC (Personal Computer). An audio amplifier 5 for driving the speaker 6 is also connected to the control device 4.

  In the configuration of FIG. 1, the display is performed in two systems, that is, the display of the image by the LCD panel 1 and the display (projection) of the image by the projector 2, but the LCD panel 1 is omitted and only the projector 2 is used. You can also.

  The projector 2 and the distance sensor camera 3 are provided above, and this is determined by the relationship between the viewpoint (eye position) of the player P and the target object (here, the hand and body of the player P) to be projected. is there. For example, if an image is projected on the inside of an open umbrella held by the player P, the projector 2 and the distance sensor camera 3 are arranged facing downward.

  FIG. 2 is a diagram illustrating a configuration example of the control device 4.

  In FIG. 2, the control device 4 includes a noise removal unit 41, an object extraction unit 42, a video / audio production unit 43, a video correction unit 44, a video output unit 45, and an audio output unit 46.

  The noise removing unit 41 has a function of removing noise from the distance video signal output from the distance sensor camera 3.

  The object extraction unit 42 has a function of extracting contour coordinates of an object such as the head, hand, and body of the player P and distance information of each pixel in the contour from the distance video signal after noise removal by the noise removal unit 41. doing.

  The video / audio production unit 43 has a function of generating video and audio for a predetermined video production according to the state of the object (position, shape, movement, etc. in the three-dimensional space) extracted by the object extraction unit 42. Have.

  For example, when the hand of the player P (a part of the body that may be a hand) moves to a position where the player touches the LCD panel 1, the display object displayed on the LCD panel 1 is transferred to the hand or body of the player P. Generate video to be moved. When the player P's hand moves to a position away from the LCD panel 1, an image for moving the display object that has moved to the player P's hand or body to the LCD panel 1 is generated. Further, when the player P is in a position where one hand touches the LCD panel 1 and the other hand moves to a position where the other hand touches the LCD panel 1, the display object that has moved to the hand or body of the player P is displayed. Moves to the LCD panel 1 through the other hand, and generates an image that circulates these.

  The video correction unit 44 extracts the head object of the player P from the output of the object extraction unit 42 to specify the viewpoint, and also generates the video generated by the video / audio production unit 43 (video to be output to the projector 2. For the output video, correction is not necessary.) The distance information of the surface of the object on which the video is projected is acquired from the output of the object extraction unit 42, and the video viewed from the viewpoint is obtained in a desired shape (for example, by projection mapping). If the image represents a sphere, it has a function of correcting the image so that it becomes a sphere when viewed from the viewpoint.

  In other words, there is no particular problem if the projected image does not require the reproduction of subtle shapes, etc., but the image projected on the object surface is distorted due to the inclination, curvature or unevenness of the object surface, and the image is accurate. In other words, there is a problem that the effect of the video production is reduced. Therefore, the video correcting unit 44 corrects the projected video based on the distance information of the surface of the object to be projected. Furthermore, the image correction unit 44 follows the object surface even if the object surface changes dynamically by acquiring distance information on the object surface at predetermined time intervals (for example, every 1/30 second). The video can be corrected.

  The video output unit 45 has a function of outputting the video corrected by the video correction unit 44 (the video on the LCD panel 1 is not corrected) to the LCD panel 1 and the projector 2.

  The audio output unit 46 has a function of outputting the audio generated by the video / audio production unit 43 to the audio amplifier 5.

  FIG. 3 is a diagram illustrating a configuration example of the video correction unit 44.

  In FIG. 3, the video correction unit 44 includes a head object extraction unit 441, a viewpoint determination unit 442, a video projection region extraction unit 443, a surface distance information extraction unit 444, and a video projection region video correction unit 445.

  The head object extracting unit 441 has a function of extracting contour coordinates of the head object of the player P (an object estimated from the shape as an object corresponding to the head) and distance information of each pixel in the contour from the output of the object extracting unit 42. have.

  The viewpoint determination unit 442 has a function of determining the three-dimensional coordinates of the viewpoint from the output of the head object extraction unit 441 based on a general model of the head shape and the three-dimensional relative position of the eyes.

  The video projection area extraction unit 443 has a function of extracting area coordinates where the main projection video exists (for example, area coordinates of the video projected onto the hand of the player P) from the video output from the video / audio production unit 43. . When the video / audio production unit 43 outputs the region coordinates where the main projection video exists separately, the video projection region extraction unit 443 is omitted and the video / audio production unit 43 replaces the output of the video projection region extraction unit 443. Region coordinate output can be used.

  The surface distance information extraction unit 444 is based on the region coordinates where the main projection image extracted by the image projection region extraction unit 443 exists, the contour coordinates of each object of the object extraction unit 42, and the distance information of each pixel in the contour. It has a function of extracting distance information of the surface of the object of the projection part.

  The video projection area video correction unit 445 converts the video in the contour coordinates extracted by the surface distance information extraction unit 444 from the original video of the video / audio production unit 43 according to the distance information of each pixel in the contour. It has a function of performing a matrix calculation or the like so that the video viewed from the viewpoint determined by the viewpoint determination unit 442 becomes a normal image, and outputs the corrected video signal to the video output unit 45. Yes.

  4 to 6 are diagrams showing examples of video effects.

  As shown in FIG. 4A, in a state where the player P is not touching the LCD panel 1, a spherical display object that looks like a mysterious creature or a hand-shaped display object for guiding touching with a hand is displayed. Displayed on the LCD panel 1.

  Accordingly, when the player P touches the LCD panel 1 as shown in FIG. 4B, a spherical display object on the LCD panel 1 is placed around the player P's hand as shown in FIG. The projector 2 projects and displays the video that gathers and moves through the hand on the hand of the player P. In this case, since the image projected on the hand of the player P is corrected to be viewed from the viewpoint of the player P, it is possible to realize that the spherical display object comes in real.

  FIG. 5B shows a state where spherical display objects are gathered on the player P's chest.

  FIG. 6 shows that when the player P touches the LCD panel 1 with the other hand and touches with both hands, the spherical display object moves from one hand of the player P to the other hand through the chest. Returning to the LCD panel 1, it is shown cyclically repeating it.

  Further, when the player P releases his / her hand from the LCD panel 1, the spherical display object displayed on the player's P hand or chest moves to the LCD panel 1 vigorously (returns).

  Various aspects other than the above-described video effects can be considered. For example, it is possible to project clothing images on the human body or project commercial messages on the hood of a car. The image is distorted by the inclination, curvature, or unevenness of the surface of the object to be projected. It can be displayed without.

  In the above-described embodiment, the viewpoint determining unit 442 determines a viewpoint serving as a reference for correcting the projected video. However, this viewpoint may be arbitrarily set according to the configuration of the device. For example, the viewpoint may be set at a fixed position in advance with respect to the floor or the LCD panel 1, or the viewpoint may be set at infinity on the normal line of each surface of the projection target object.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments, various modifications and changes may be made to the embodiments without departing from the broad spirit and scope of the invention as defined in the claims. Obviously you can. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

DESCRIPTION OF SYMBOLS 1 LCD panel 2 Projector 3 Distance sensor camera 4 Control apparatus 41 Noise removal part 42 Object extraction part 43 Image | video audio production part 44 Video correction part 441 Head object extraction part 442 View point determination part 443 Image | video projection area extraction part 444 Surface distance information extraction part 445 video projection area video correction unit 45 video output unit 46 audio output unit 5 audio amplifier 6 speaker P player

Claims (4)

A projector and a distance sensor camera arranged at a predetermined position on the viewpoint side of an appearable region of an object to be projected;
An image comprising: a control device that generates an image projected on the surface of the object based on distance information of the surface of the object obtained by the distance sensor camera, and outputs an image signal to the projector Production device. The video effect device according to claim 1,
The control device includes image correction means for correcting an image projected on the surface of the object by the projector based on distance information at each point on the surface of the object obtained by the distance sensor camera. A video production device. Obtaining distance information of the surface of the object from a distance sensor camera arranged at a predetermined position on the viewpoint side of the possible appearance area of the object to be image projected;
Based on the distance information of the surface of the object obtained by the distance sensor camera, an image to be projected on the surface of the object is generated and placed at a predetermined position on the viewpoint side of the appearable area of the object to be image projected. And a step of outputting a video signal to the projector. Computer
Means for acquiring distance information of the surface of the object from a distance sensor camera arranged at a predetermined position on the viewpoint side of an appearable area of the object to be projected;
Based on the distance information of the surface of the object obtained by the distance sensor camera, an image to be projected on the surface of the object is generated and placed at a predetermined position on the viewpoint side of the appearable area of the object to be image projected. A video production program for causing a projector to function as a means for outputting a video signal.

Images