JP2017169160A - Projector, method for controlling projector, and projection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system for pointing out the attention place of information for presentation with an easy operation, without requiring complex setting and operation.SOLUTION: A projector 3 is a projector 3 for projecting a projection image PI onto a first projection surface (drawing board BD) and a second projection surface (screen SC), images the first projection surface, detects the relative position of the first projection surface with respect to the projector 3 from the imaged information, extracts the positional information of an indication body PN operated with respect to the first projection surface from the imaged information, to generate a drawn image DI on the basis of the positional information of the indication body PN, and overlaps an equipment image OI received from external equipment 10 with the drawn image DI, to generate the projection image PI and project the projection image PI onto the first projection surface and the second projection surface.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a projector, a control method, and a projection system.

  Conventionally, as described in Patent Document 1, a projection system that projects an image provided from a mobile terminal from a projector has been known. In this projection system, an image drawn by operating a touch panel of a mobile terminal is superimposed on an image to be provided and synthesized, and the synthesized image is projected onto a projector. With such a projection system, it has been said that an operation for easily pointing out a point of interest of an image to be provided can be realized using a portable terminal.

JP-A-2015-90561

However, the projection system using a portable terminal according to Patent Document 1 is not a user-friendly system for the presenter, and various inconvenient situations have occurred by using the portable terminal. Specifically, in Patent Document 1, it is a great advantage that the user can bring and use his / her familiar portable terminal. In such a case, installation of software for generating a composite image, portable terminal and projector It was necessary to set up the connection with. Users had to spend valuable preparation time before the presentation on such tasks.
In addition, there is a method that allows the user to use the mobile terminal provided in the projection system. However, since the user is different from the mobile terminal that the user is used to, the user may be unfamiliar with the operation of the mobile terminal of the projection system. There was a risk that the progress of the presentation would be hindered.
In particular, in an event where a plurality of presenters make a presentation using a common projection system, it is necessary to minimize the risk that the progress of the presentation is hindered due to operational troubles. Accordingly, there has been a demand for providing a system that can point out a point of interest of information to be presented with an easy operation without requiring complicated settings and operations.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 A projector according to this application example is a projector that projects a projection image on a first projection surface and a second projection surface, and an imaging unit that images the first projection surface and outputs imaging information; A detection unit that detects a relative position of the first projection surface with respect to the projector from the imaging information; an extraction unit that extracts position information of a pointer operated on the first projection surface from the imaging information; and the instruction A drawing image generation unit that generates a drawing image based on the position information of the body; a reception unit that receives a device image from an external device; and a projection image that generates the projection image by superimposing the device image and the drawing image A generation unit, a first projection unit that projects the projection image onto the first projection surface, and a second projection unit that projects the projection image onto the second projection surface are provided.

According to the projector of this application example, the projector includes two projection units, a first projection unit and a second projection unit that project the same projection image. The imaging information of the first projection surface imaged by the imaging unit includes position information of the indicator that operates on the first projection surface. The drawing image generated based on the position information of the indicator is superimposed on the device image and output as a projection image to the first projection unit and the second projection unit. In this way, the drawn image drawn based on the position information of the indicator operated on the first projection surface is superimposed on the device image and projected onto the first projection surface and the second projection surface. For example, when the presenter operates (points out) a point of interest of the projection image projected on the first projection surface with the indicator, the point of interest indicated by the indicator is drawn on the second projection surface visually recognized by the viewer It is possible to project the (explicit) projected image.
Therefore, the presenter can point out the attention point of the information to be presented by an easy operation.
Moreover, the information regarding operation of a pointer can be acquired in the imaging part which images the 1st projection surface projected by the 1st projection part with which the projector was equipped. Since it is not a system that forces a presenter to use a mobile terminal as in the past, it does not require complicated settings and operations using the mobile terminal, software installation, and the like.
Therefore, it is possible to provide a projector that can point out a point of interest of information to be presented by an easy operation without requiring complicated settings and operations.

  Application Example 2 The drawing image generation unit described in the application example generates the drawing image corresponding to a locus of the position of the indicator.

  According to this application example, the point of interest can be clearly indicated by the indicator. For example, when an operation is performed in which the attention location is surrounded by the indicator, the indicator leaves a locus surrounding the attention location, and the drawn image is generated as a line surrounding the attention location.

  Application Example 3 The detection unit described in the application example described above is characterized in that a projection direction projected by the first projection unit is determined based on the detected relative position.

  According to this application example, the detection unit can direct the projection direction of the first projection unit toward the first projection surface. For example, when the first projection surface moves, the projection direction of the first projection unit can follow the first projection surface.

  Application Example 4 The imaging unit according to the application example captures a pattern indicating a projection area of the first projection surface, outputs the captured image as the imaging information, and the detection unit is included in the imaging information. The relative position is detected based on the pattern to be detected.

  According to this application example, the detection unit can accurately detect the relative position of the first projection surface and the projection area of the first projection surface using the pattern imaged by the imaging unit as a mark.

  Application Example 5 The first projection surface described in the application example includes a first surface on which the projection image is projected and a second surface that is a back surface of the first surface, and is projected from the first surface side. A filter that displays the projected image on the second surface and transmits the position information of the indicator operated on the second surface.

  According to this application example, the projection image is displayed on the second surface of the first projection surface, and the point of interest of the projection image displayed on the second surface can be pointed out with the indicator.

  Application Example 6 The imaging unit according to the application example captures the position information of the indicator operated on the second surface.

  According to this application example, since the indicator can be operated on the second surface, the projection from the first projection unit to the first projection surface is not hindered by the indicator.

  Application Example 7 In the application example, the first projection surface includes a reflection surface that reflects the projection image on a projection surface on which the projection image is projected, and the imaging unit is provided on the first projection surface. The position information of the indicator to be operated is imaged.

  According to this application example, the projection image is displayed on the projection surface, and the point of interest of the projection image displayed on the projection surface can be pointed out with the indicator.

  Application Example 8 A projector control method according to this application example is a projector control method that projects a projection image on a first projection surface and a second projection surface, and images the first projection surface and captures imaging information. An imaging step of outputting, a detection step of detecting a relative position of the first projection plane with respect to the projector from the imaging information, and position information of an indicator operated on the first projection plane are extracted from the imaging information. An extraction step, a drawing image generation step for generating a drawing image based on the position information of the indicator, a receiving step for receiving a device image from an external device, and the projection by superimposing the device image and the drawing image A projection image generation step of generating an image; a first projection step of projecting the projection image onto the first projection surface; and a second projection step of projecting the projection image onto the second projection surface. It is characterized in.

According to the projector control method according to this application example, the same projection image is projected onto the first projection surface and the second projection surface. The imaging information of the first projection surface imaged by the imaging process includes position information of the indicator that operates on the first projection surface. The drawing image generated based on the position information of the indicator is superimposed on the device image and output as a projection image to the first projection step and the second projection step. In this way, the drawn image drawn based on the position information of the indicator operated on the first projection surface is superimposed on the device image and projected onto the first projection surface and the second projection surface. For example, when the presenter operates (points out) a point of interest of the projection image projected on the first projection surface with the indicator, the point of interest indicated by the indicator is drawn on the second projection surface visually recognized by the viewer It is possible to project the (explicit) projected image.
Therefore, the presenter can point out the attention point of the information to be presented by an easy operation.
Moreover, the information regarding operation of a pointer can be acquired in the imaging process which images the 1st projection surface projected by the 1st projection process. Since it is not a system that forces a presenter to use a mobile terminal as in the past, it does not require complicated settings and operations using the mobile terminal, software installation, and the like.
Therefore, it is possible to provide a projector control method that can point out a point of interest of information to be presented by an easy operation without requiring complicated settings and operations.

  Application Example 9 A projection system according to this application example is a projection system including a projector that projects a projection image on a first projection surface and a second projection surface, and the first projection surface, and the projector includes: An imaging unit for imaging the first projection plane and outputting imaging information; a detection unit for detecting a relative position of the first projection plane with respect to the projector from the imaging information; and operating the first projection plane. An extraction unit that extracts position information of a pointer from the imaging information; a drawing image generation unit that generates a drawing image based on the position information of the pointer; a reception unit that receives a device image from an external device; A projection image generation unit that generates a projection image by superimposing a device image and the drawing image, a first projection unit that projects the projection image onto the first projection surface, and the projection A second projection unit that projects an image onto the second projection surface, and the first projection surface includes a first surface on which the projection image is projected and a second surface that is a back surface of the first surface. Including a filter that displays the projected image projected from the first surface side on the second surface and transmits the position information of the indicator operated on the second surface. And

According to the projector of this application example, the projector includes two projection units, a first projection unit and a second projection unit that project the same projection image. The imaging information of the first projection surface imaged by the imaging unit includes position information of the indicator that operates on the first projection surface. The drawing image generated based on the position information of the indicator is superimposed on the device image and output as a projection image to the first projection unit and the second projection unit. In this way, the drawn image drawn based on the position information of the indicator operated on the first projection surface is superimposed on the device image and projected onto the first projection surface and the second projection surface. For example, when the presenter operates (points out) a point of interest of the projection image projected on the first projection surface with the indicator, the point of interest indicated by the indicator is drawn on the second projection surface visually recognized by the viewer It is possible to project the (explicit) projected image.
Therefore, the presenter can point out the attention point of the information to be presented by an easy operation.
In addition, the projection image is displayed on the second surface of the first projection surface, and the point of interest of the projection image displayed on the second surface can be pointed out with the indicator. Since the indicator can be operated on the second surface, the projection from the first projection unit to the first projection surface is not hindered by the indicator.

  Application Example 10 A projection system according to this application example is a projection system that includes a projector that projects a projection image on a first projection surface and a second projection surface, and the first projection surface. An imaging unit for imaging the first projection plane and outputting imaging information; a detection unit for detecting a relative position of the first projection plane with respect to the projector from the imaging information; and operating the first projection plane. An extraction unit that extracts position information of a pointer from the imaging information; a drawing image generation unit that generates a drawing image based on the position information of the pointer; a reception unit that receives a device image from an external device; A projection image generation unit configured to superimpose the device image and the drawing image to generate the projection image; a first projection unit configured to project the projection image onto the first projection plane; A second projection unit that projects an image onto the second projection surface, and the first projection surface includes a reflection surface that reflects the projection image on a first surface on which the projection image is projected. Features.

According to the projector of this application example, the projector includes two projection units, a first projection unit and a second projection unit that project the same projection image. The imaging information of the first projection surface imaged by the imaging unit includes position information of the indicator that operates on the first projection surface. The drawing image generated based on the position information of the indicator is superimposed on the device image and output as a projection image to the first projection unit and the second projection unit. In this way, the drawn image drawn based on the position information of the indicator operated on the first projection surface is superimposed on the device image and projected onto the first projection surface and the second projection surface. For example, when the presenter operates (points out) a point of interest of the projection image projected on the first projection surface with the indicator, the point of interest indicated by the indicator is drawn on the second projection surface visually recognized by the viewer It is possible to project the (explicit) projected image.
Therefore, the presenter can point out the attention point of the information to be presented by an easy operation.
In addition, a projected image is displayed on the projection surface, and a point of interest of the projected image displayed on the projection surface can be pointed out with an indicator.

The figure explaining the outline | summary of a projection system. The block diagram showing the schematic function of a projection system. The figure explaining the structure of a projection part. The flowchart figure showing a projection process. FIG. 5 is a diagram for explaining an outline of a projection system according to a second embodiment. FIG. 9 is a diagram for explaining an outline of a projection system according to a third embodiment. The figure explaining the structure of the projection part in a modification.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following drawings, the scale of each part and each screen is different from the actual scale so that each part and each screen can be recognized.

(Embodiment 1)
(Outline of projection system)
FIG. 1 is a diagram for explaining the outline of the projection system.
The projection system 1 includes a projector 3, an external device 10, a drawing board BD, a screen SC, and the like.

  The external device 10 is an information device such as a general PC (Personal Computer) or a server, and includes a display device, a storage device, a connector for supplying a video signal, and the like. The storage device stores in advance an image file to be displayed at the time of presentation. The external device 10 reads the image file, displays the device image OI on the display device, and simultaneously outputs the video signal of the device image OI to the connector side. In the external device 10 shown in FIG. 1, a device image OI is displayed as a display example. A part of the device image OI illustrates an image representing a character string “AB”. The video signal of the device image OI output from the external device 10 is supplied to the projector 3 via the communication 4.

  The projector 3 includes a first projection device 30 and a second projection unit 40. The first projection device 30 includes an imaging unit 31, a first projection unit 32, and the like. In the projector 3, an image for projection (projection image PI) is generated from the device image OI input from the external device 10, and is output to the first projection unit 32 and the second projection unit 40.

  The second projection unit 40 projects the projection image PI onto the screen SC (projection PR2). The screen SC is a large screen (for example, a size of 200 inches or more) and is a main screen that many viewers visually recognize.

The first projection unit 32 and the imaging unit 31 are provided on the housing surface of the projector 3 that is different from the second projection unit 40 (on the opposite surface in the example illustrated in FIG. 1).
The first projection unit 32 projects the projection image PI on the drawing board BD side (projection PR1). The drawing board BD is a small (for example, A4 size) translucent or transparent board visually recognized by the presenter. An image projected from the projection surface through a known specific wavelength reflection filter attached to the board surface is displayed on the projection surface. Display on the opposite surface. Hereinafter, the surface projected from the projector 3 onto the drawing board BD is referred to as “the back surface of the drawing board BD”, and the opposite surface of the back surface is referred to as “the front surface of the drawing board BD”. In addition, marks 6 indicating the projection areas of the projection image PI are provided at the four corners near the apex on the back surface of the drawing board BD. Details of the mark 6 will be described later.
The back surface and front surface of the drawing board BD onto which the projection image PI is projected by the first projection unit 32 correspond to the first projection surface, and the projection surface of the screen SC on which the projection image PI is projected by the second projection unit 40. Corresponds to the second projection surface.

The presenter holds the indicator PN and performs an operation of pointing out a point of interest of the projection image PI displayed on the surface of the drawing board BD. In the example illustrated in FIG. 1, the locus PNL surrounding the portion “A” is operated. The trajectory PNL is imaged by the imaging unit 31 of the projector 3, and the drawing image DI is generated by the imaging unit 31. The projector 3 superimposes the generated drawing image DI on the device image OI and projects the composite image onto the screen SC and the drawing board BD as a new projection image PI. Since the operation of the indicator PN on the drawing board BD and the projection process on the screen SC and the drawing board BD are repeated, each time the indicator PN is moved on the drawing board BD side, drawing is performed so that the position is traced. The locus PNL is displayed on the board BD and the screen SC.
With the configuration described above, when the presenter operates the indicator PN on the projection image PI displayed on the drawing board BD at hand, the locus PNL of the indicator PN is reflected in the projection image PI on the screen SC. . A portable terminal or the like is not required, and it is possible to point out a point of interest of information to be presented with an easy operation without requiring complicated settings and operations.
Hereinafter, the projection system 1 having such an effect will be described in detail.

(Projection system)
FIG. 2 is a block diagram showing a schematic function of the projection system.
The projection system 1 includes a projector 3, an external device 10, a drawing board BD, an indicator PN, a screen SC, and the like.

  The external device 10 is an information device such as a general PC or server as described above. The external device 10 is not limited to a single PC, and may be a plurality of information devices connected via a network. An image or video file displayed at the time of presentation may be stored in a network cloud environment or a specific server.

As described above, the drawing board BD is a translucent or transparent board, and displays an image projected from the surface 5A, which is the back surface of the drawing board BD, on the surface 5B, which is the surface of the drawing board BD, through a specific wavelength reflection filter. To do. The drawing board BD is provided with a mark 6 indicating that the enclosed area is a projection area of the drawing board BD at an outer peripheral portion (for example, four corners) of the surface 5A (see FIG. 1). These marks 6 can be recognized separately from the indicator PN in the imaging unit 31 of the projector 3, and are used when calculating (measuring) the relative position between the projector 3 and the drawing board BD. Note that the mark 6 may be made of a material such as a fluorescent material that reacts (emits light) to the black light when the imaging unit 31 has an irradiation function such as black light. In such a configuration, even in a relatively dark venue, the mark 6 can be detected without making the viewer or presenter aware. Further, the mark 6 is not limited to the surface 5A of the drawing board BD, and may be provided on the surface 5B. In that case, the mark 6 may be transmitted through the translucent or transparent drawing board BD and can be imaged on the imaging unit 31 side.
The surface 5A of the drawing board BD corresponds to the first surface, and the surface 5B corresponds to the second surface. The mark 6 corresponds to a pattern indicating the projection area of the first projection surface.

The indicator PN is a pen-shaped indicator bar having a length of about 10 to 15 cm, and has a light emitting element such as an LED (Light Emitting Diode) at the tip. The LED emits light when the tip of the indicator PN is in contact with the surface of the drawing board BD. The light emission of the LED passes through a transparent or translucent drawing board and can be detected by the imaging unit 31 of the projector 3.
Note that the tip of the indicator PN is not limited to the LED, but may be detected by the imaging unit 31 of the projector 3. For example, a fluorescent material or a phosphorescent material may be applied or attached. Further, the material at the tip of the indicator PN may be a material that reacts to black light in the case where a black light irradiation mechanism is provided on the imaging unit 31 side as in the case of the mark 6.

  The screen SC is a large screen as described above, and projects the projection image PI projected from the second projection unit 40 onto the surface 9A which is a projection surface. The projected image PI projected on the surface 9A is visually recognized by the viewer. The screen SC may be any wall or other object as long as the projected image PI projected is visible.

(projector)
The projector 3 includes an operation unit 21, a timing unit 23, a storage unit 25, a communication unit 27, a first projection device 30, a second projection unit 40, a control unit 50, a video processing unit 60, and the like.

  The operation unit 21 includes a plurality of buttons for operating the projector 3. Various functions are realized by the control unit 50 controlling each unit in accordance with the operated button. For example, when an operation of switching the input signal of the projector 3 to the external device 10 is performed, an image signal of the device image OI is input from the external device 10 by the control unit 50, and the device image OI is the second projection unit 40 and the first device. Projected to the projection device 30. Adjustment of the image projected on the screen SC and the drawing board BD, setting of various functions of the projector 3, and the like are performed. When the projector 3 includes a remote controller (not shown) for realizing various operations, the operation unit 21 includes buttons on the remote controller, a display unit displayed on the remote controller, a touch panel covering the display unit, and the like.

  The clock unit 23 is a real-time clock, clock generation to the control unit 50, clock synchronization of the first projection device 30, the second projection unit 40, the communication unit 27, etc., timer functions, calendar functions, clock functions, etc. have. Time data such as the date and time that the time measuring unit 23 is measuring is read by the control unit 50. In the imaging unit 31 of the first projection device 30, the sampling period of the imaging device is generated based on the clock oscillated from the time measuring unit 23, and the projection image PI of the first projection device 30, the second projection unit 40, and the communication unit 27 is generated. The timing from the input to the projection is synchronized based on the clock oscillated from the time measuring unit 23.

The storage unit 25 includes a storage device such as a ROM (Read Only Memory), a flash ROM, a RAM (Random Access Memory), a VideoRAM, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like. In the storage unit 25, the device image OI input from the external device 10, the captured image captured by the imaging unit 31, the rendered image DI in which the locus PNL of the indicator PN is rendered, and the device image OI and the rendered image DI are combined for image synthesis. A work area to be used, a projection image PI that is a composite image thereof, and the like are stored.
In addition to these, a program for realizing the functional unit of the control unit 50, data of a temporarily stored variable, and the like are stored.

  The communication unit 27 includes a plurality of connectors to which video signals are supplied such as a Video terminal, an S terminal, a 3RCA terminal, a D-Sub terminal, and an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal. The video signal supplied from the external device to the connector via the communication 4 is output to the video processing unit 60 as device image data of the device image OI. The communication unit 27 includes a wireless communication adapter such as a wireless local area network (LAN) and Bluetooth (registered trademark), and a wired communication adapter such as a USB (Universal Serial Bus) and a wired LAN. The communication unit 27 includes a communication protocol such as IP (Internet Protocol) or USB used by these adapters, selects a communication protocol common to an external device such as the external device 10, and various signals via the communication 4. Various types of data including image data are transmitted and received. The communication unit 27 corresponds to a receiving unit.

The first projection device 30 includes an imaging unit 31, a first projection unit 32, and the like.
The imaging unit 31 includes an imaging element (such as a CMOS or CCD) that receives light emitted or reflected from the drawing board BD side, an optical system member that forms an image on the imaging element, and a diaphragm that controls light incident on the imaging element. And a circuit for generating captured image data in RGB matrix format from the received information. The imaging unit 31 is adjusted and installed so as to capture the same direction as the projection direction in conjunction with the first projection unit 32 (described later). That is, in a state where the projection image PI is projected from the first projection unit 32, the imaging unit 31 is adjusted so that the projection image PI projected from the first projection unit 32 is placed in the center of the captured image. .
The imaging unit 31 includes an automatic zoom mechanism, and can adjust the imaging size of the projection image PI stored in the center of the captured image.
The imaging unit 31 acquires a captured image in which the projection image PI is accommodated at the maximum size inside the mark 6 indicating the projection area of the drawing board BD. Moreover, the captured image which can extract the position 7B which is the front-end | tip position of the indicator PN is acquired.
The imaging unit 31 outputs imaging information including captured image data in the captured range to an imaging information analysis unit 52 described later. The imaging unit 31 acquires imaging information for each sampling period, and outputs it to the imaging information analysis unit 52. The sampling period is set to, for example, a 16.7 msec period (sampling frequency 60 Hz). In this case, imaging information is output 60 times per second.
The imaging unit 31 includes an irradiation unit (not shown) that irradiates laser light such as black light, and the imaging element receives reflected light reflected by the mark 6 and the position 7B of the indicator. It may be.

Next, the 1st projection part 32 is demonstrated using the example shown in FIG.
FIG. 3 is a diagram illustrating the configuration of the projection unit.
The first projection unit 32 shown in FIG. 3 includes a total reflection mirror 33, a position adjustment unit 35, a first projection lens 37, and the like. The image of the projection image PI enters the first projection unit 32 from the direction L5. The video of the projection image PI is generated by the video processing unit 60 and is incident on the first projection unit 32 via the second projection unit 40.

The total reflection mirror 33 is a total reflection type that reflects the video of the projection image PI incident from the direction L5 in the direction of the first projection lens 37 (direction L7), and is a known mirror having high heat resistance and high reflectance.
The first projection lens 37 is a lens unit composed of a plurality of optical systems, and magnifies and outputs video light incident from the direction L7.

  The position adjustment unit 35 is a mechanism that moves the installation angles of the total reflection mirror 33 and the projection lens 37. Specifically, the total reflection mirror 33 and the projection lens 37 are installed such that the angle can be changed around the center position. The position adjustment unit 35 has a drive mechanism that changes the angles of the total reflection mirror 33 and the first projection lens 37 by a minute angle. The position adjustment unit 35 drives the drive mechanism and changes the angles of the total reflection mirror 33 and the first projection lens 37 based on the control (adjustment control command) of the control unit 50. By adjusting the angles of the total reflection mirror 33 and the first projection lens 37, the direction of the direction L7 that is the direction of emitting the image of the projection image PI is changed, and the keystone correction and distortion of the image projected on the drawing board BD are performed. Realize corrections.

Next, the second projection unit 40 will be described.
The second projection unit 40 illustrated in FIG. 3 includes an RGB liquid crystal unit 42, a half mirror 48, a second projection lens 49, and the like.

The RGB liquid crystal unit 42 receives the video signal projected from the video processing unit 60 and projects the video in the direction of the second projection lens 49 (direction L1).
The RGB liquid crystal unit 42 includes a drive circuit unit 43, LED light sources 44R, 44G, and 44B, liquid crystal panels 45R, 45G, and 45B, a cross dichroic prism 47, and the like.

  The drive circuit unit 43 acquires the video signal supplied from the video processing unit 60. The video signal supplied to the drive circuit unit 43 includes gradation data representing the gradation of the red component, gradation data representing the gradation of the green component, and blue (Blue) in the projected image. ) Component gradation data representing the gradation of the component. The drive circuit unit 43 extracts gradation data of each color of red (R), green (G), and blue (B), and based on the extracted gradation data of each color, the LED light sources 44R, 44G, and 44B and the liquid crystal panel. 45R, 45G, and 45B are driven.

The LED light sources 44R, 44G, and 44B are LED light source units including LED lamps that emit red light, green light, and blue light, respectively.
The liquid crystal panels 45R, 45G, and 45B are transmissive liquid crystal panels, and include pixels arranged in a matrix with a plurality of rows and a plurality of columns. In the liquid crystal panels 45R, 45G, and 45B, the transmittance of each pixel is changed by the drive circuit unit 43. By controlling the transmittance of the pixels, the light of each color transmitted through the liquid crystal panels 45R, 45G, and 45B is emitted to the cross dichroic prism 47. An image corresponding to each color gradation data is obtained.

  The cross dichroic prism 47 has an incident surface for each color light of red light, green light, and blue light, and the incident surfaces are disposed to face the LED light sources 44R, 44G, and 44B, respectively. In the cross dichroic prism 47, four right angle prisms are bonded, and a dielectric multilayer film that reflects red light and a dielectric multilayer film that reflects blue light are formed in a cross shape on the inner surface thereof. The three color lights are synthesized by these dielectric multilayer films, and the light representing the color image is synthesized. The combined light is emitted in the direction L1 as an image (light) of the projection image PI.

The image (light) of the projection image PI is incident on the half mirror 48 and is emitted from the half mirror 48 in the directions L3 and L5.
The half mirror 48 is a known transmission type mirror that linearly transmits incident video (light) and changes (reflects) a 90-degree optical path. The transmittance and reflectance of the image (light) are both about 50%, for example. By using the half mirror 48, the incident image can be separated in two directions. The amount of light emitted from the LED light sources 44R, 44G, and 44B is adjusted so that the amount of light loss of the image (light) in the direction L5 and the direction L3 in the half mirror 48 is minimized.

The image (light) traveling in the direction L5 enters the first projection unit 32.
The image (light) traveling in the direction L3 enters the second projection lens 49.
The second projection lens 49 is a projection optical system, and displays an enlarged image on the screen SC. The image projected from the second projection lens 49 is projected onto the surface 9A on the screen SC.

(Control part)
Returning to FIG. 2, the controller 50 will be described.
The control unit 50 is configured to include a processor such as a CPU (Central Processing Unit), and the operation unit 21 that configures the projector 3 according to various programs (not shown) including the programs stored in the storage unit 25, the time measurement The unit 23, the storage unit 25, the communication unit 27, the first projection device 30 (the imaging unit 31, the first projection unit 32), the second projection unit 40, and the video processing unit 60 are controlled.

  The control unit 50 includes an imaging information analysis unit 52, a drawing processing unit 57, and the like as functional units. The imaging information analysis unit 52 includes functional units such as a projection position detection unit 53 and a pointer extraction unit 55. However, these functional units are merely described as an example, and all the functional units and configurations are not necessarily required. Moreover, it is good also considering a function part other than these as an essential structure.

  The imaging information analysis unit 52 acquires the captured image data output from the imaging unit 31, and analyzes the position of the drawing board BD and the position of the indicator PN. As described above, the projection image PI is recorded in the central portion of the image (captured image) captured by the imaging unit 31 by the interlocking mechanism of the imaging unit 31 with the first projection unit 32 and the automatic zoom mechanism. Yes.

The projection position detection unit 53 analyzes the captured image and detects whether or not the projection image PI projected by the first projection unit 32 is projected on the drawing board BD. When not projected, the projection direction of the 1st projection part 32 is adjusted so that it may project on drawing board BD.
Specifically, the projection position detection unit 53 detects whether or not the mark 6 is included in the captured image data acquired from the imaging unit 31, and includes all the marks 6 (for example, four locations at the apex portion of the drawing board BD). If not, an adjustment control command for changing the angles of the total reflection mirror 33 and the first projection lens 37 is transmitted to the position adjustment unit 35. The position adjustment unit 35 drives the drive mechanism to adjust the angles of the total reflection mirror 33 and the first projection lens 37 based on the adjustment control command. When the projection direction of the first projection unit 32 is changed, the imaging direction of the imaging unit 31 is also changed in conjunction with it.
When the projection position detection unit 53 detects that all the marks 6 are included in the captured image (the outer peripheral portion of the drawing board BD is arranged at the position of the outer peripheral portion in the captured image), all the marks 6 are detected. An adjustment control command is transmitted to the automatic zoom mechanism of the first projection device 30 (imaging unit 31) so that the projected image PI is contained inside the image. When it is detected that the projection image PI having a size that fits inside all the marks 6 has been received, information on the adjustment angles of the total reflection mirror 33 and the first projection lens 37 from the first projection device 30 (position adjustment unit 35). And information including the zoom value information of the automatic zoom mechanism of the first projection device 30 (imaging unit 31) is acquired and stored. In addition, fitting position information (information indicating the positional relationship between the mark 6 and the projection image PI) with the projection image PI fitted inside the mark 6 is also stored. Information acquired from these first projection devices 30 is information relating to the relative position between the projector 3 and the drawing board BD.
When the position of the drawing board BD is moved, the position adjustment unit 35 again adjusts the projection image PI so that it is inside all the marks 6.

Further, the projection position detection unit 53 may be configured to control the operation unit 21 to notify the presenter to align the position of the drawing board BD. For example, a message such as “Please display the projected image on the drawing board” is displayed on the display unit of the remote control unit. Thereafter, the projection position detection unit 53 side acquires the captured image from the imaging unit 31, It is detected whether or not the mark 6 is included.
Note that the projection position detection unit 53 corresponds to a detection unit.

The indicator extraction unit 55 extracts the position 7B of the tip of the indicator PN. Specifically, the projection image PI is referred to by referring to the position 7B and the position of the mark 6 of the indicator PN included in the captured image data acquired from the imaging unit 31, and the fit position information of the projected image PI being projected. The position 7B is extracted. The position 7B is extracted as coordinates corresponding to each pixel included in the image data of the projection image PI.
The indicator extraction unit 55 corresponds to an extraction unit.

The drawing processing unit 57 draws a line or the like at a position corresponding to the position 7B at the tip of the indicator PN. Specifically, the drawing processing unit 57 stores the drawn state in the storage unit 25 as drawing image data. The drawing image data has the same size (number of pixels) as that of the projection image PI. The drawing processing unit 57 acquires and holds the attribute of the object to be drawn at the position designated by the indicator PN via the operation unit 21. For example, the drawn image DI shown in FIG. 1 has an object attribute such as a black line having a thickness of 5 pixels at the position designated by the indicator PN.
When the drawing processing unit 57 obtains the tip position 7B of the indicator PN, the drawing processing unit 57 updates the drawing image data by overwriting the object. By repeatedly updating the drawing image data, the locus of the indicator PN is formed in the drawing image DI. Each time the drawing image data is updated, the drawing image DI is output to the video processing unit 60.
The drawing processing unit 57 corresponds to a drawing image generation unit.

The video processing unit 60 generates a video signal from the image data supplied from the control unit 50 (drawing processing unit 57) and the communication unit 27 and outputs the video signal to the second projection unit 40. In the video processing unit 60, when the drawing image DI is supplied from the drawing processing unit 57, projection image data (projection image PI) synthesized by superimposing the drawing image DI on the device image OI supplied from the communication unit 27. Is generated. The projection image PI is converted into a video signal and output to the second projection unit 40.
The video processing unit 60 corresponds to a projection image generation unit.

  With the above configuration, in the projection position detection unit 53, the position of the drawing board BD on which the projection image PI is projected onto the surface 5 </ b> A of the drawing board BD from the captured image acquired from the imaging unit 31 (relative to the drawing board BD with respect to the projector 3). Position). Then, the pointer extraction unit 55 extracts position information on the projection image PI corresponding to the position 7B (7A) of the pointer PN on the drawing board BD. The drawing processing unit 57 generates a drawing image DI based on the position information on the projection image PI. The video processing unit 60 outputs the projection image PI obtained by superimposing the synthesized image DI on the device image OI input from the external device 10 to the second projection unit 40 and the first projection device 30. In this way, the projector 3 has two systems of projection units, the first projection device 30 and the second projection unit 40, and draws a drawing image drawn by the indicator PN operated on the drawing board BD to the outside. The projection image PI superimposed and synthesized on the device image OI supplied from the device 10 is projected onto the first projection device 30 and the second projection unit 40. As a result, by operating the indicator PN on the drawing board BD, it is possible to point out the point of interest in the device image OI.

(Projection processing method)
Next, the projection processing method will be described with reference to FIG.
FIG. 4 is a flowchart showing the projection process. In this flow, based on a program (not shown) stored in the storage unit 25, the control unit 50 includes the communication unit 27, the first projection device 30, the second projection unit 40, and the video processing unit 60. This process is executed by controlling each unit. This flow corresponds to a projector control method.

  In step S100, preparation is performed. Specifically, each unit such as the communication unit 27, the first projection device 30 including the imaging unit 31, and the second projection unit 40 is activated. When the communication unit 27 is activated, a signal (for example, a video signal input from the external device 10) input to the connector of the communication unit 27 can be detected. When the imaging unit 31 is activated, imaging in the projection direction projected by the first projection unit 32 is started.

  Step S110 is an event processing loop. Specifically, various events occur when each unit is activated in step S100, and event processing registered in advance is executed for each event that occurs. The plurality of event processes are executed in parallel by a multitask process, a pseudo multitask process, or a multithread process.

  In subsequent steps, when an input of a captured image captured by the imaging unit 31 is detected (steps S120 to S160), and when an input of the device image OI is detected from the communication unit 27 (steps S200 to S210). The event processing to be executed will be described. In addition, the process which images by the imaging part 31 and outputs a captured image is corresponded to an imaging process.

  In step S120, a captured image is acquired. Captured image data captured by the imaging unit 31 is input.

In step S130, the drawing board BD is detected. Specifically, the captured image is analyzed and it is detected whether or not the mark 6 of the drawing board BD is included in the captured image. When all the marks 6 on the drawing board BD are detected, the process proceeds to the next step.
Until all the marks 6 on the drawing board BD are detected, an adjustment control command is transmitted to the first projection device 30 to finely adjust the projection direction of the first projection unit 32.
This step corresponds to a detection process.

  In step S140, the position of the drawing board BD is detected. Specifically, information related to the projection direction of the first projection unit 32 is acquired from the first projection device 30 and stored in the storage unit 25. Moreover, the fitting position information of the state arrange | positioned so that the projection image PI projected from the 1st projection part 32 may fit the inside of all the marks 6 to the maximum is acquired. The information acquired from the first projection device 30 and the fit position information are information related to the relative position between the projector 3 and the drawing board BD.

  In step S150, the position of the indicator PN is detected. Specifically, the position 7B of the tip of the indicator PN is acquired from the captured image. The coordinate value of the position 7B on the projection image PI is calculated with reference to the position information of the mark 6 and the fit position information acquired in step S140. This step corresponds to an extraction process.

  In step S160, a drawing image DI is generated. Specifically, the coordinate value of the indicator PN calculated in step S150 is written in the drawing image data in the storage unit 25. By repeating step S150 and this step, a drawing image DI in which the locus of the position 7B of the tip of the indicator PN is drawn is generated. This step corresponds to a drawing image generation process.

  In step S200, the input of the device image OI is detected. It is detected whether a video signal is input from the external device 10 from the communication unit 27.

  In step S210, the device image OI is acquired. Specifically, the received video signal is received from the external device 10 via the communication unit 27, and the received video signal is stored in the storage unit 25 as device image data of the device image OI. This step corresponds to a reception process.

  In step S250, the drawing image DI is superimposed on the device image OI to generate the projection image PI. Specifically, the image data of the device image OI stored in step S200 and the image data of the drawing image DI generated in step S160 are superimposed to generate image data of the projection image PI. This step corresponds to a projection image generation process.

  In step S260, the projection image PI is projected onto the screen SC and the drawing board BD. The projection image PI generated in step S250 is output to the second projection unit 40 (projected on the screen SC). The output projection image PI is output (projected onto the drawing board BD) to the first projection unit 32 via the second projection unit 40. This step corresponds to a first projection process and a second projection process.

  In step S270, it is determined whether or not the projection has ended. If it is not the end of projection, the process proceeds to the event processing loop shown in step S110. If it is the end of projection, this flow is terminated.

  With the above flow, the locus of the indicator PN operated on the drawing board BD is superimposed on the device image PI and projected onto the second projection unit 40 and the first projection unit 32.

As described above, according to the projection system 1, the projector 3, and the control method thereof according to the present embodiment, the following effects can be obtained.
The projector 3 includes two projection units, a first projection device 30 (including the first projection unit 32) and a second projection unit 40 that project the same projection image PI. The first projection device 30 includes an imaging unit 31 that images the direction of the surface 5 </ b> A of the first projection surface in conjunction with the first projection unit 32. The imaging information analysis unit 52 acquires a captured image from the imaging unit 31, adjusts the surface 5A to be projected onto the drawing board BD, and is operated on the drawing board BD (the surface 5A or the surface 5B). The position information (trajectory) of the indicator PN is extracted. The drawing processing unit 57 generates a drawing image DI based on the locus of the indicator PN. The video processing unit 60 superimposes and synthesizes the drawing image DI and the device image OI to generate a projection image PI. The generated projection image PI is projected to the first projection unit 32 and the second projection unit 40. By repeating such a series of processing, attention is given to information to be presented by an easy operation such as designating part of the surfaces 5A and 5B on which the projection image PI is projected on the drawing board BD by the indicator PN. The location can be pointed out easily.
Further, since the operation by the indicator PN can be acquired by the surfaces 5A and 5B projected by the first projection unit 32 provided in the projector 3 and the imaging unit 31, complicated settings and operations as in the conventional method are possible. It is not necessary to have a portable terminal that requires the software, and it is not necessary to install software on the portable terminal.
Therefore, it is possible to provide the projection system 1 that can point out a noticed point of information to be presented by an easy operation without requiring complicated settings and operations.

(Embodiment 2)
FIG. 5 is a diagram for explaining the outline of the projection system according to the second embodiment.
A projection system 100 according to this embodiment will be described with reference to FIG. In addition, about the component same as Embodiment 1, the same number is used and the overlapping description is abbreviate | omitted.

  The projection system 100 includes a projector 103, a table TBL having a first projection surface, a screen SC having a second projection surface, and the like. The projector 103 is installed on the table TBL.

  The external device 10 supplies the device image OI to the projector 103 via the communication 4. The projector 103 includes a first projection device 130 and projects a projection image PI (projection PR101) on the table TBL. The upper surface of the table TBL is a reflecting surface, and is white as a suitable example. A white paper or a white board may be placed on the table TBL. The projection area of the projection image PI projected PR101 with respect to the table TBL corresponds to the first projection surface. The presenter operates the indicator PN on the first projection surface on which the projection image PI is projected, and points out a point of interest of the projection image PI.

The 1st projection apparatus 130 is provided with the imaging part 31 (FIG. 2), and the imaging part 31 images the front-end | tip part of the indicator PN100 with respect to a 1st projection surface and a 1st projection surface, and produces | generates a captured image. In the control unit 50 (FIG. 2) of the projector 103, an image area in which the first projection surface included in the captured image is captured, and position information of the tip of the indicator PN100 pointed to the image area. To extract. Based on the extracted position information, a drawing image DI is generated, and a projection image PI superimposed on the device image OI is projected onto the second projection unit 40 and the first projection device 130. The second projection unit 40 projects the projection image PI onto the screen SC (projection PR102).
The first projection device 130 and the second projection unit 40 project the same projection image PI, but the vertical and horizontal directions of the projected projection image PI can be changed according to the direction operated by the presenter. it can.

  As described above, in the projection system 100 according to the present embodiment, the first projection device 130 can perform projection PR101 on various areas such as the table TBL and white paper, so the projector 103 is placed on a desk or the like. It is suitable for the case. In addition, the indicator PN100 can be operated on the first projection surface (reflection surface) projected by the projection PR101, and can be operated on a desk.

(Embodiment 3)
FIG. 6 is a diagram for explaining the outline of the projection system according to the third embodiment.
A projection system 200 according to this embodiment will be described with reference to FIG. In addition, about the component same as the above-mentioned embodiment, the same number is used and the overlapping description is abbreviate | omitted.

  The projection system 200 includes a projector 203, a table TBL having a first projection surface, a screen SC having a second projection surface, and the like. The projector 203 is installed on the ceiling TP.

  The external device 10 supplies the device image OI to the projector 203 via the communication 4. The projector 203 includes a first projection device 230 and projects a projection image PI (projection PR201) onto a table TBL installed below. The upper surface of the table TBL is a reflecting surface, and is white as a suitable example. A white paper or a white board may be placed on the table TBL. The projection area of the projection image PI projected PR201 on the table TBL corresponds to the first projection surface. The presenter operates the indicator PN200 on the first projection surface on which the projection image PI is projected, and points out a point of interest of the projection image PI.

The 1st projection apparatus 230 is provided with the imaging part 31 (FIG. 2), and the imaging part 31 images the front-end | tip part of the indicator PN200 with respect to a 1st projection surface and a 1st projection surface, and produces | generates a captured image. In the control unit 50 (FIG. 2) of the projector 203, the image area where the first projection surface included in the captured image is imaged, and the positional information of the tip of the indicator PN200 pointed to the image area. To extract. Based on the extracted position information, a drawing image DI is generated, and a projection image PI superimposed on the device image OI is projected onto the second projection unit 40 and the first projection device 230. The second projection unit 40 projects the projection image PI onto the screen SC (projection PR202).
The first projection device 230 and the second projection unit 40 project the same projection image PI, but the vertical and horizontal directions of the projected projection image PI can be changed according to the direction operated by the presenter. it can.

  As described above, in the projection system 200 according to the present embodiment, since the first projection device 230 can project the projection PR201 onto various areas such as the table TBL or blank sheet below from the projector 203, This is suitable when the projector 203 is installed on a ceiling TP or the like. In addition, the indicator PN200 can be operated on the first projection surface (reflection surface) projected by the projection PR201, and can be operated on a desk.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and improvements can be added to the above-described embodiment. A modification will be described below.

(Modification 1)
In the above-described embodiment, the first projection devices 30, 130, and 230 may further include a mechanism that adjusts the focus of the first projection lens 37. Specifically, the imaging unit 31 outputs the captured projection image PI to the control unit 50. The control unit 50 analyzes the contrast of the captured projection image PI and determines whether or not the image is in focus. If it is not in focus, the focus of the first projection lens 37 is adjusted. With such a configuration, even if there is a change in the position of the first projection surface in the first projection devices 30, 130, and 230, it is possible to automatically focus.

(Modification 2)
In the above-described embodiment and the modification, the projector 3 (103, 203) controls the control direction of the control unit 50 (adjustment control command) based on the projection direction projected from the first projection unit 32 of the first projection device 30 (130, 230). However, the present invention is not limited to such a configuration. The projection direction projected from the first projection unit 32 may be configured to provide an automatic tracking function in the first projection device 30 (130, 230) and determine the projection direction without using the control unit 50.

  For example, in the case of the first projection device 30, a detection circuit (including a CPU and a program) that detects the drawing board BD is provided in the imaging unit 31, and the position adjustment unit 35 of the first projection unit 32 is further controlled. In the detection circuit, it is detected whether or not the projection image PI is placed inside all the marks 6 indicating the projection area of the drawing board BD (for example, four corners). If it is detected that it does not fit, the position adjustment unit 35 is controlled to change the projection direction. In the detection circuit, it is possible to automatically detect an optimal projection direction in which the projection image PI is accommodated on the drawing board BD by repeating the detection and control of the position adjustment unit 35.

For example, in the case of the first projection devices 130 and 230, the imaging unit 31 is provided with a detection circuit (including a CPU and a program) that detects whether the projection state of the first projection surface (reflection state of the projection image PI) is good or bad. Further, the position adjustment unit 35 of the first projection unit 32 is controlled. The detection circuit performs pattern matching between the projection image PI captured by the imaging unit 31 and the projection image PI projected from the first projection unit 32, and detects a projection direction in which the difference between the two images is reduced. In the detection circuit, it is possible to automatically detect an optimal projection direction such that the projection state of the projection image PI is good on the first projection surface by repeating the detection and control of the position adjustment unit 35.
Note that the detection circuit in this modification corresponds to a detection unit.

  In the configuration of the present modification, the projection direction of the first projection unit 32 can be determined in the first projection device 30 (130, 230) without using the control unit 50, so the processing load on the control unit 50 is reduced. High-speed projection direction can be automatically adjusted.

(Modification 3)
In the above-described embodiment and modification, the projector 3 (103, 203) is configured to only input the device image OI from the external device 10, but may be configured to output information on the external device 10 side. Good. Specifically, the position information of the indicator PN is output from the projector 3 (103, 203) to the external device 10. On the external device 10 side, the input positional information of the indicator PN can be drawn and displayed on the device image OI displayed on the display device of the external device 10. Alternatively, the drawing image DI may be output from the projector 3 (103, 203) to the external device 10, and an image obtained by superimposing the drawing image DI and the device image OI may be displayed on the display device on the external device 10 side. Alternatively, the projection image PI may be output from the projector 3 (103, 203) to the external device 10, and the projection image PI may be displayed on the display device on the external device 10 side.
By adopting such a configuration, a screen similar to the projection image PI projected on the screen SC can be viewed on the display device of the external device 10.

(Modification 4)
In the embodiment and the modification described above, the configuration of the projection unit (FIG. 3), the video of the projection image PI incident from the video processing unit 60 is incident on the first projection unit 32 via the second projection unit 40. However, the present invention is not limited to such a configuration. A configuration in which the image of the projection image PI is directly incident from the image processing unit 60 to both projection units may be employed.

FIG. 7 is a diagram illustrating the configuration of the projection unit in the modification. The projection unit shown in FIG. 7 includes a video processing unit 560, a first projection unit 532, a second projection unit 540, and the like.
The video processing unit 560 outputs the video signal of the projection image PI to the first projection unit 532 and the second projection unit 540 at the same timing.

The first projection unit 532 includes an RGB liquid crystal unit 542, a position adjustment unit 535, a first projection lens 537, and the like.
The RGB liquid crystal unit 542 receives the video signal of the projection image PI and emits video (light) in the direction of the first projection lens 537 (direction L13).
The position adjustment unit 535 adjusts the projection direction, focal length, zoom function, and the like of the first projection lens 537 based on control from the control unit 50 or the imaging unit 31.
The projection image PI is projected from the first projection lens 537 onto the surfaces 5A and 5B of the drawing board BD.

  The second projection unit 540 includes an RGB liquid crystal unit 42, a second projection lens 549, and the like. The RGB liquid crystal unit 42 receives the video signal of the projection image PI, and emits video (light) in the direction of the second projection lens 549 (direction L11). The projected image PI is projected from the second projection lens 549 onto the surface 9A of the screen SC.

  With such a configuration, the first projection unit 532 includes the RGB liquid crystal unit 542, and thus can project a clear image with the light amount adjusted to the drawing board BD.

  DESCRIPTION OF SYMBOLS 1 ... Projection system 3 ... Projector 4 ... Communication 5A, 5B ... Drawing board BD surface, 6 ... Mark, 7A, 7B ... Position of indicator PN, 9A ... Projection surface on screen SC, 10 ... External device , 21 ... operation section, 23 ... timing section, 25 ... storage section, 27 ... communication section, 30 ... first projection device, 31 ... imaging section, 32 ... first projection section, 33 ... total reflection mirror, 35 ... position adjustment , 37 ... first projection lens, 40 ... second projection unit, 42 ... RGB liquid crystal unit, 43 ... drive circuit unit, 44R, 44G, 44B ... LED light source, 45R, 45G, 45B ... liquid crystal panel, 47 ... cross dichroic Prism, 48 ... half mirror, 49 ... second projection lens, 50 ... control unit, 52 ... imaging information analysis unit, 53 ... projection position detection unit, 55 ... indicator extraction unit, 57 ... drawing processing unit, 60 ... projection Processing unit 100 ... Projection system 103 ... Projector 130 ... First projection device 200 ... Projection system 203 ... Projector 230 ... First projection device 560 ... Video processing unit 532 ... First projection unit 540 ... Second projection unit 542 RGB liquid crystal unit 535 Position adjustment unit 537 First projection lens 549 Second projection lens

Claims (10)

A projector that projects a projection image on a first projection surface and a second projection surface,
An imaging unit that images the first projection surface and outputs imaging information;
A detection unit that detects a relative position of the first projection surface with respect to the projector from the imaging information;
An extraction unit that extracts position information of an indicator operated on the first projection surface from the imaging information;
A drawing image generation unit that generates a drawing image based on the position information of the indicator;
A receiver for receiving device images from an external device;
A projection image generation unit that generates the projection image by superimposing the device image and the drawing image;
A first projection unit that projects the projection image onto the first projection surface;
A second projection unit that projects the projection image onto the second projection surface;
A projector comprising:   The projector according to claim 1, wherein the drawing image generation unit generates the drawing image according to a locus of the position of the indicator.   The projector according to claim 1, wherein the detection unit determines a projection direction in which the first projection unit projects based on the detected relative position. The imaging unit captures a pattern indicating a projection area of the first projection surface, outputs the captured image as the imaging information,
The detection unit detects the relative position based on the pattern included in the imaging information;
The projector according to claim 1, wherein the projector is a projector.   The first projection surface includes a first surface on which the projection image is projected and a second surface which is a back surface of the first surface, and the projection image projected from the first surface side is the second surface. The projector according to claim 4, further comprising a filter that transmits the position information of the indicator operated on the second surface and displayed on the second surface.   The projector according to claim 5, wherein the imaging unit images the position information of the indicator operated on the second surface. The first projection surface includes a reflection surface that reflects the projection image on a projection surface on which the projection image is projected,
The projector according to any one of claims 1 to 3, wherein the imaging unit images the position information of the indicator operated on the first projection surface. A control method for a projector that projects a projection image on a first projection surface and a second projection surface,
An imaging step of imaging the first projection surface and outputting imaging information;
A detection step of detecting a relative position of the first projection surface with respect to the projector from the imaging information;
An extraction step of extracting from the imaging information position information of an indicator operated on the first projection surface;
A drawing image generation step of generating a drawing image based on the position information of the indicator;
A receiving process for receiving a device image from an external device;
A projection image generation step of generating the projection image by superimposing the device image and the drawing image;
A first projection step of projecting the projection image onto the first projection surface;
A second projection step of projecting the projection image onto the second projection surface;
A projector control method comprising: A projection system comprising: a projector that projects a projection image on a first projection surface and a second projection surface; and the first projection surface,
The projector is
An imaging unit that images the first projection surface and outputs imaging information;
A detection unit that detects a relative position of the first projection surface with respect to the projector from the imaging information;
An extraction unit that extracts position information of an indicator operated on the first projection surface from the imaging information;
A drawing image generation unit that generates a drawing image based on position information of the indicator;
A receiver for receiving device images from an external device;
A projection image generation unit that generates the projection image by superimposing the device image and the drawing image;
A first projection unit that projects the projection image onto the first projection surface;
A second projection unit that projects the projection image onto the second projection surface;
With
The first projection surface is
Including the first surface on which the projection image is projected and the second surface which is the back surface of the first surface, the projection image projected from the first surface side is displayed on the second surface, and Comprising a filter that transmits the position information of the indicator operated on the second surface;
Projection system characterized by A projection system comprising: a projector that projects a projection image on a first projection surface and a second projection surface; and the first projection surface,
The projector is
An imaging unit that images the first projection surface and outputs imaging information;
A detection unit that detects a relative position of the first projection surface with respect to the projector from the imaging information;
An extraction unit that extracts position information of an indicator operated on the first projection surface from the imaging information;
A drawing image generation unit that generates a drawing image based on the position information of the indicator;
A receiver for receiving device images from an external device;
A projection image generation unit that generates the projection image by superimposing the device image and the drawing image;
A first projection unit that projects the projection image onto the first projection surface;
A second projection unit that projects the projection image onto the second projection surface;
With
The first projection surface is
Providing a reflective surface for reflecting the projection image on the first surface on which the projection image is projected;
Projection system characterized by

Images