WO2018135141A1

WO2018135141A1 - Information processing device, information processing method, and projection system

Info

Publication number: WO2018135141A1
Application number: PCT/JP2017/042835
Authority: WO
Inventors: 高尾　宜之
Original assignee: ソニー株式会社
Priority date: 2017-01-17
Filing date: 2017-11-29
Publication date: 2018-07-26

Abstract

[Problem] To provide an information processing device, an information processing method, and a projection system. [Solution] An information processing device provided with a control unit that, on the basis of a simulation image including a projection region of a projector in a design made in advance, and a captured image including a projection region of the projector, controls the projector.

Description

Information processing apparatus, information processing method, and projection system

The present disclosure relates to an information processing apparatus, an information processing method, and a projection system.

When a projector that projects an image is used, various adjustments relating to the projection are performed manually (operations by the user, etc.) in order to perform projection according to the user's expectations. For example, when the projection area of the projector is different from the projection area expected by the user, the projection area is adjusted using the lens adjustment function of the projector.

Further, instead of performing the adjustment as described above, an image input to the projector is corrected by image processing. For example, Non-Patent Document 1 describes that an image subjected to geometric correction processing is input to a projector based on projection destination information obtained by photographing with a camera.

As described above, when the adjustment is performed manually, the human burden is large. In particular, when a plurality of projectors are used, the adjustment is performed for each projector, and thus the human burden may be enormous. On the other hand, when the image input to the projector is corrected by image processing, the human burden is reduced, but the image quality of the image seen by the user may be reduced.

Therefore, the present disclosure proposes a new and improved information processing apparatus, information processing method, and projection system capable of reducing the human burden while suppressing deterioration in image quality.

According to the present disclosure, there is provided an information processing apparatus including a simulation image including a projection area of a projector in a pre-design and a control unit that controls the projector based on a captured image including the projection area of the projector.

Further, according to the present disclosure, there is provided an information processing method including a processor controlling the projector based on a simulation image including a projection area of the projector in a pre-design and a captured image including the projection area of the projector. Is done.

In addition, according to the present disclosure, a projector that projects a projection image, an imaging device that acquires a captured image including the projection area of the projector, a simulation image including the projection area of the projector in advance design, and the captured image An information processing apparatus having a control unit for controlling the projector is provided.

As described above, according to the present disclosure, it is possible to reduce the human burden while suppressing deterioration in image quality.

Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

It is explanatory drawing for demonstrating schematic structure of the projection system 1 which concerns on one Embodiment of this indication. It is a block diagram showing an example of composition of information processor 30 concerning the embodiment. 4 is an explanatory diagram for explaining an example of projector control by a projector control unit 318 according to the embodiment. FIG. 10 is an explanatory diagram for explaining another example of projector control by the projector control unit 318 according to the embodiment. FIG. It is a flowchart which shows the operation example of the embodiment. It is explanatory drawing which shows the example of the screen displayed on a display part not shown in prior design. It is a flowchart figure which shows the more detailed process of step S13. It is a flowchart figure which shows the more detailed process of step S15. It is explanatory drawing which shows the hardware structural example.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

In the present specification and drawings, a plurality of constituent elements having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

The description will be made in the following order.
<< 1. Overview >>
<1-1. Schematic configuration>
<1-2. Background>
<< 2. Configuration >>
<< 3. Operation >>
<< 4. Modification >>
<4-1. Modification 1>
<4-2. Modification 2>
<4-3. Modification 3>
<< 5. Hardware configuration example >>
<< 6. Conclusion >>

<< 1. Overview >>
<1-1. Schematic configuration>
First, a schematic configuration of a projection system according to an embodiment of the present disclosure will be described with reference to FIG. FIG. 1 is an explanatory diagram for explaining a schematic configuration of a projection system 1 according to the present embodiment. As shown in FIG. 1, the projection system 1 includes one or more projectors 10 (projection devices), a camera 20 (imaging device), an information processing device 30, and the like that project an image (still image or moving image) onto a screen 50. And a communication network 80.

The projector 10 projects an image on the screen 50. As shown in FIG. 1, the projector 10 may include a plurality of projectors 10A to 10D. The number of projectors included in projector 10 is not limited to the example shown in FIG.

The camera 20 is an imaging device that captures an image projected by the projector 10 and acquires a captured image. For example, the camera 20 may be arranged at a viewpoint overlooking the projections by the projectors 10A to 10D, and the camera 20 acquires captured images including actual projection areas of the projectors 10A to 10D.

The information processing apparatus 30 performs information processing related to the projection system 1. As shown in FIG. 1, the information processing apparatus 30 is connected to a communication network 80, and projects images to the projectors 10A to 10D, for example, via the communication network 80 (hereinafter sometimes referred to as projection images). May be input (provided). Further, the information processing apparatus 30 may receive a captured image acquired by the camera 20 from the camera 20 via the communication network 80. Details of the information processing apparatus 30 will be described later with reference to FIGS.

The screen 50 is a projection destination by the projector 10. The screen 50 may have a dome shape, for example. In FIG. 1, the cross section which cut | disconnected the dome-shaped screen 50 horizontally is shown. The shape of the screen 50 is not limited to a dome shape, and may be a curved surface or a flat surface.

The communication network 80 is a wired or wireless transmission path for information transmitted from a device connected to the communication network 80. For example, the communication network 80 may include a public line network such as the Internet, a telephone line network, and a satellite communication network, various LANs including the Ethernet (registered trademark), a wide area network (WAN), and the like. . Further, the communication network 80 may include a dedicated network such as an IP-VPN (Internet Protocol-Virtual Private Network).

<1-2. Background>
The overall configuration of the projection system 1 according to an embodiment of the present disclosure has been described above. Next, the background that led to the creation of the projection system 1 according to the present embodiment will be described.

When projecting an image with a projector, the projection area expected by the user may be different from the projection area of the projector. The projection area expected by the user may be a projection area assumed when, for example, the screen (projection destination) and the arrangement (position and orientation) of the projector are designed in advance.

For example, when the image is projected at a position different (shifted) from the position expected by the user, it is desirable to adjust the position of the projection area. If the projection area does not match the screen size, it is desirable to adjust the size of the projection area.

Further, when the shape of the projection destination is not a plane as in the screen 50 shown in FIG. 1, it is desirable to adjust the projection area according to the shape of the projection destination, and more detailed than the case of projecting onto the plane. Adjustment may be required. Also, as shown in FIG. 1, when an image can be projected onto a nearby area by a plurality of projectors, detailed adjustment in consideration of the projection areas of other projectors is required. When a plurality of projectors are used, it is desirable not only to adjust the projection area, but also to make adjustments so that colors, brightness, and the like are consistent among the plurality of projectors.

For such adjustment, adjustment by human (for example, user operation) has been conventionally performed. For example, the projector has a lens shift function that adjusts the position of the projection area by moving the lens up, down, left, or right, for example, and a zoom that adjusts the size of the projection area by moving the lens back and forth A function, a color adjusting function, a brightness adjusting function, and the like can be mounted. For example, it is conceivable to perform the above adjustment by a user operation via a button or a remote controller provided in the projector. However, in this method, since the user performs adjustment while visually recognizing that the image is actually projected by the projector, the human burden is large. In particular, when a plurality of projectors are used, the labor for adjustment increases according to the number of projectors, which may increase the human burden.

On the other hand, in order to project an image on a region desired by the user, for example, a method of correcting a projection image input to the projector by image processing is also conceivable. For example, in the projection system shown in FIG. 1, it is conceivable that a projection image subjected to reduction processing by the information processing device 30 is input to the projector 10 based on a captured image acquired by the camera 20. With such a configuration, it is possible to realize a projection in which an image is visually recognized only in an area desired by the user among the projection areas of the projector 10. Further, by inputting a projection image subjected to color correction processing and brightness correction processing to the projector 10 based on the captured image acquired by the camera 20, the colors and brightness are similar between the plurality of projectors. It is possible to project.

When a projection image that has been subjected to image processing (reduction processing, color correction processing, brightness correction processing, etc.) as described above is input to the projector, the human burden is reduced, but there is a risk that, for example, degradation in image quality may occur. is there. For example, when the reduction process is performed, the number of pixels used is reduced, so that the image quality (for example, resolution) can be greatly reduced as compared with the case where the reduction process is not performed. In addition, when color correction processing or brightness correction processing is performed, for example, it is difficult to perform appropriate correction on a pixel having a pixel value near the maximum value or the minimum value, and image quality deteriorates when such a pixel exists. It's easy to do.

<< 2. Configuration >>
Accordingly, the projection system 1 according to an embodiment of the present disclosure has been created with the above circumstances as a focus. In the projection system 1 according to the present embodiment, the information processing apparatus 30 controls the projector 10 and automatically adjusts the projection based on the captured image acquired by the camera 20, thereby suppressing deterioration in image quality. It is possible to reduce the human burden.

Control of the projector 10 by the information processing apparatus 30 may be performed, for example, by transmitting a projector control signal similar to the user operation via the above-described button or remote controller from the information processing apparatus 30 to the projector 10. That is, according to this embodiment, the same adjustment as the adjustment by the user operation using the function of the projector 10 described above is automatically performed, and it is possible to reduce the human burden.

If the adjustment using the function of the projector 10 is performed, it is possible to suppress a decrease in image quality as compared with the case where the above-described image processing is performed. For example, when the projection area is adjusted by controlling the projector 10, only the projection area is different, and the number of pixels used for projection is not changed. In addition, since control of changing the maximum output value and the minimum output value of the projector 10 is possible, it is possible to adjust the color and brightness while suppressing the above-described deterioration in image quality. is there.

Hereinafter, the configuration of the present embodiment having such an effect will be described in more detail. FIG. 2 is a block diagram illustrating a configuration example of the information processing apparatus 30 illustrated in FIG. As illustrated in FIG. 2, the information processing apparatus 30 according to the present embodiment includes a control unit 310, a communication unit 320, and a storage unit 350.

The control unit 310 controls each component of the information processing apparatus 30. Further, as shown in FIG. 2, the control unit 310 also functions as a communication control unit 312, an imaging control unit 314, a simulation image generation unit 316, and a projector control unit 318.

The communication control unit 312 controls communication by the communication unit 320. For example, the communication control unit 312 controls the communication unit 320 to transmit a projection image and a projector control signal for controlling the projector 10 to the projector 10 (projection apparatus) described with reference to FIG. Further, the communication control unit 312 controls the communication unit 320 to transmit an imaging control signal for controlling imaging by the camera 20 to the camera 20 (imaging device) described with reference to FIG. Further, the communication control unit 312 controls the communication unit 320 to receive a captured image from the camera 20 (imaging device) described with reference to FIG. The projector control signal and the imaging control signal will be described later.

The imaging control unit 314 controls imaging by the camera 20 in accordance with projector control by the projector control unit 318. For example, the imaging control unit 314 outputs an imaging control signal that causes the camera 20 to perform imaging when the projector control unit 318 controls to turn on one of the projectors 10A to 10D (for example, the projector 10A). Generated and provided to the communication control unit 312.

The simulation image generation unit 316 is an image to be acquired by the camera 20 when projection by the projector 10 is performed according to the pre-design based on the parameters in the pre-design stored in the storage unit 350 and the parameters related to the camera 20. A simulation image is generated. Here, the simulation image is an image including a projection region expected by the user in the pre-design, that is, a projection region of the projector 10 in the pre-design.

The parameters in the pre-design may include, for example, information on the three-dimensional shape, three-dimensional position, and three-dimensional posture of the screen 50. The parameters in the pre-design may further include a three-dimensional position, a three-dimensional attitude, and lens parameters (lens position, focal length, etc.) of the projector 10 set by the pre-design. In addition to or instead of the lens parameters of the projector 10, information indicating the relationship between the projection distance of the projector 10 and the projection area may be included in the parameters in the prior design. The parameters relating to the camera 20 may include, for example, a three-dimensional position, a three-dimensional posture, and a lens parameter of the camera 20. The parameters in the pre-design are values based on the specifications and performance of the projector 10 and the camera 20 that are actually used.

The simulation image generation unit 316 generates a simulation image based on the parameters in the advance design as described above and the parameters related to the camera 20. With this configuration, a simulation image that corresponds to the captured image and can be compared with the captured image can be generated.

The projector control unit 318 controls the projector 10. For example, the projector control unit 318 can control the projector 10 by generating a projector control signal for controlling the projector 10 and providing it to the communication control unit 312. In the following description, for example, “controlling the projector 10” means “generating a projector control signal for controlling the projector 10”.

The projector control signal generated by the projector control unit 318 may be, for example, a control signal for turning on the projector 10 (projecting an image on the projector 10).

Further, the projector control signal generated by the projector control unit 318 may be a control signal for performing control related to the lens of the projector 10. The control related to the lens is, for example, at least one of control (lens shift control) for moving the lens position of the projector 10 up and down, left and right, and control (zoom control) for changing the zoom magnification of the projector 10 (that is, changing the focal length of the lens). Either one may be included.

The movement of the lens position may be, for example, movement in any one direction of up, down, left, or right, and the control for moving the lens position is performed in one step in the designated direction by the projector control signal. It may include moving the lens position of the projector 10 one by one. Further, the control for changing the zoom magnification may include, for example, increasing or decreasing the zoom magnification of the projector 10 step by step by a projector control signal.

Further, the projector control signal generated by the projector control unit 318 may be a control signal for performing control related to the output parameter of the projector 10. The output parameters of the projector 10 may include, for example, parameters of the brightness, hue, saturation, and hue (for example, R, G, and B colors) of the projector 10. Further, the control related to the output parameter of the projector 10 may include changing at least one of the brightness, hue, saturation, and color of the projector 10 step by step.

Further, the projector control unit 318 controls the projector 10 based on the simulation image generated by the simulation image generation unit 316 and the captured image provided from the camera 20. As described above, the simulation image is an image including the projection area of the projector 10 in the pre-design, and the captured image is an image including the actual projection area of the projector 10 at the time of imaging.

For example, the projector control unit 318 may control the projector 10 so that the difference between the simulation image and the captured image becomes small.

FIG. 3 is an explanatory diagram for explaining an example of projector control by the projector control unit 318. As shown in FIG. 3, the projector control unit 318 may control the projector 10 so that the difference between the simulation image D10 and the captured image F10 is small. For example, the difference may be reduced by changing the projection area by controlling the projector 10 so as to move the lens position in any direction or change (increase or decrease) the zoom magnification. Good.

Further, the projector control unit 318 may repeatedly control the projector 10 until it is determined that the difference between the simulation image and the captured image is sufficiently small (for example, the difference is smaller than a predetermined threshold).

In addition, the projector control unit 318 determines that the difference between the simulation image calculated immediately after performing the first control on the projector 10 and the captured image is larger (increased) than the previously calculated difference. The second control different from the control may be performed. For example, when the difference increases due to the control of moving the lens position, the projector control unit 318 may perform control to change the zoom magnification or control to move the lens position in different directions. Further, when the difference increases due to the control to increase (or decrease) the zoom magnification, the projector control unit 318 may perform control to decrease (or increase) the zoom magnification or move the lens position. Control may be performed.

In addition, the projector control unit 318 performs the first control when the difference between the simulation image and the captured image is larger (increased) than the previously calculated difference immediately after performing the first control on the projector 10. The reverse control may be performed. For example, when the difference increases due to the control of moving the lens position, the projector control unit 318 may perform the control of moving the lens position by reversing the moving direction of the lens position. Further, when the difference increases due to the control for increasing (or decreasing) the zoom magnification, control for decreasing (or increasing) the zoom magnification of the projector control unit 318 may be performed.

When the projector control unit 318 controls the projector 10 as described above, the projection area of the projector 10 is automatically set so that the difference between the actual projection area by the projector 10 and the projection area in the pre-design is sufficiently small. Adjusted to

Note that the difference between the simulation image and the captured image is, for example, the difference in area between the projection area included in the simulation image (projection area in advance design) and the projection area included in the captured image (actual projection area). Also good. The difference between the simulation image and the captured image may be a difference between the vertex position of the projection area included in the simulation image and the vertex position of the projection area included in the captured image. Further, the difference between the simulation image and the captured image may be a value obtained by summing up the pixel values of the pixels of the simulation image and the captured image. The difference between the simulation image and the captured image is not limited to the above example, and may be calculated by various methods.

Further, the projector control unit 318 may control the projector 10 based on the captured image including the projection area of each projector acquired for each projector, and a plurality of projectors included in the projector 10 based on the plurality of captured images. May be controlled. Note that in obtaining such a plurality of captured images, the projection images used for projection may all be the same.

FIG. 4 is an explanatory diagram for explaining an example of projector control by the projector control unit 318. As shown in FIG. 4, even if the projection images are the same, the brightness, hue, saturation, hue, etc. perceived by the user from the projection areas P11 to P14 by the plurality of projectors included in the projector 10 are as follows. Can be different. Therefore, the projector control unit 318 may control the projector 10 based on a plurality of captured images so as to reduce the variation among the plurality of projectors. Note that, in this specification, the variation among a plurality of projectors means a variation relating to appearance such as brightness, hue, saturation, or hue perceived by the user.

For example, the projector control unit 318 may control the projector 10 so that variation among a plurality of projectors is reduced with respect to at least one of brightness, hue, saturation, and color. In the following, the control of the projector 10 relating to the parameters of brightness, hue, saturation, or tint will be collectively described as output parameter control. However, the projector control unit 318 includes brightness, hue, saturation, Alternatively, the color parameters can be controlled independently.

The projector control unit 318 calculates the output parameters of each projector from, for example, a plurality of captured images, and controls the projector 10 so that the variation of the output parameters among the plurality of projectors becomes small. For example, the projector control unit 318 may specify a reference value based on the output parameters of a plurality of projectors, and control the output parameter of each projector to approach the reference value. For example, the projector control unit 318 may control the projector 10 having an output parameter larger (smaller) than the reference value so that the output parameter is smaller (larger). The reference value may be, for example, an average value of output parameters of a plurality of projectors included in the projector 10, or may be a median value, a minimum value, or a maximum value.

The projector control unit 318 may repeatedly control the projector 10 until it is determined that the variation in the output parameter among the plurality of projectors is sufficiently small (for example, the variation is smaller than a predetermined threshold).

Further, the projector control unit 318 determines that the output parameter variation among the plurality of projectors calculated immediately after the output parameter control of the projector 10 is larger (increased) than the previously calculated variation. Control opposite to the output parameter control may be performed. For example, when the variation increases due to the control to increase (decrease) the output parameter, the projector control unit 318 may control the projector 10 to decrease (increase) the output parameter.

When the projector control unit 318 controls the projector 10 as described above, the output parameter of the projector 10 is automatically adjusted so that the variation of the output parameter among the plurality of projectors included in the projector 10 becomes sufficiently small. The

Note that the variation in output parameters among the plurality of projectors may be, for example, dispersion of output parameters of the plurality of projectors or standard deviation. Further, the variation in the output parameter among the plurality of projectors may be a difference between the maximum value and the minimum value of the output parameters of the plurality of projectors. Further, the variation of the output parameter among the plurality of projectors may be a total value of the difference between the above-described reference value and the output parameter of each projector. Variations in output parameters among a plurality of projectors are not limited to the above example, and may be calculated by various methods.

The communication unit 320 is a communication interface that mediates communication with other devices. The communication unit 320 supports an arbitrary wireless communication protocol or wired communication protocol, and for example, a communication connection with other devices (for example, the projector 10 and the camera 20) via the communication network 80 described with reference to FIG. Establish. Further, the communication unit 320 receives information from other devices or transmits information to other devices according to the control of the communication control unit 312.

The storage unit 350 stores programs and parameters for the functions of the information processing apparatus 30 to function. In addition, the storage unit 350 stores parameters in advance design and parameters related to the camera 20.

The configuration example of this embodiment has been described above. The configuration of the information processing apparatus 30 illustrated in FIG. 2 is an example, and the present embodiment is not limited to this. For example, each function of the control unit 310 according to the present embodiment may be provided in another information processing apparatus connected via the communication unit 320. For example, when the simulation image generation unit 316 is provided in another information processing apparatus, a simulation image generated by the other information processing apparatus may be provided to the information processing apparatus 30 via the communication unit 320.

<< 3. Operation >>
Subsequently, an operation example of the present embodiment will be described. First, an overall operation example will be described with reference to FIGS. 5 and 6, and then projector control for adjusting the projection area of each projector will be described with reference to FIG. Projector control for adjusting the variation between projectors will be described.

(Overall operation)
FIG. 5 is a flowchart showing an operation example of this embodiment. First, the user performs advance design regarding the arrangement of the screen 50 and the projector 10 (S11). The pre-design may be performed using the information processing apparatus 30 or may be performed using another apparatus (not illustrated) connected to the communication network 80, and parameters in the prior design are provided to the information processing apparatus 30. May be.

FIG. 6 is an explanatory diagram showing an example of a screen displayed on a display unit (not shown) in the prior design in step S11. For example, in the pre-design, the user uses a screen G50 (for example, corresponding to the screen 50 shown in FIG. 1) by the projectors G11 to G14 (for example, corresponding to the projectors 10A to 10D shown in FIG. 1) displayed on the screen G1. The positions and orientations of the projectors G11 to G14 may be adjusted while confirming the projection area. In FIG. 6, the screen G1 is displayed in a plane, but the screen G1 may be displayed three-dimensionally, and the user may be able to change the viewpoint position.

Referring back to FIG. Subsequently, the user installs the screen 50 and the projector 10 according to a pre-design (S12). At this time, the camera 20 and the information processing apparatus 30 are also installed.

Subsequently, projector control for adjusting the projection area of each projector is performed by the information processing apparatus 30 (S13). Details of step S13 will be described later with reference to FIG.

Among the projectors included in the projector 10, when there is a projector for which the projection area adjustment of step S13 has not been completed (NO in S14), the process of step S13 is repeated for the projector for which the projection area adjustment has not been completed.

On the other hand, when the projection area adjustment in step S13 is completed for all projectors included in projector 10 (YES in S14), control for adjusting the variation among the plurality of projectors included in projector 10 is performed by information processing device 30. Performed (S15). Details of step S15 will be described later with reference to FIG.

(Control to adjust the projection area of each projector)
FIG. 7 is a flowchart showing more detailed processing of step S13 shown in FIG. First, the projector control unit 318 selects one of the projectors 10 for which the process of step S13 has not been completed, and sets it as a target projector to be processed (S131).

Subsequently, the simulation image generation unit 316 generates a simulation image (an image including the projection area of the target projector in advance design) when the target projector is turned on (S132). Subsequently, the projector control unit 318 turns on the target projector (S133).

Subsequently, under the control of the imaging control unit 314, the camera 20 acquires a captured image including the projection area of the projector of interest and provides it to the information processing apparatus 30 (S134). Subsequently, the projector control unit 318 calculates a difference between the simulation image and the captured image acquired in step S134, and controls the projector of interest so that the difference becomes small (S135). When the process of step S135 is first performed on the target projector, the projector control unit 318 calculates the difference and then moves the lens in any direction or changes the zoom magnification (large or Any one of the projector controls to be (smaller) may be performed at random. Then, each time the process of step S135 is performed, the projector control unit 318 calculates the difference again. If the difference calculated this time is larger than the difference calculated last time, the previous control is as described above. Different control and reverse control may be performed. On the other hand, when the difference is smaller than the previous time, the projector control unit 318 may perform the same control as the previous time. As described above, the projector control unit 318 can control the projector of interest so that the difference becomes small.

If the difference between the simulation image calculated by the projector control unit 318 and the captured image in step S135 is sufficiently small, the projector control unit 318 does not have to control the projector of interest in step S135. If the difference between the simulation image and the captured image is sufficiently small (YES in S136), the process in step S13 for the projector of interest ends. On the other hand, if the difference between the simulation image and the captured image is not sufficiently small, the projector of interest is controlled in step S135 as described above. Further, until it is determined that the difference between the simulation image and the captured image is sufficiently small, acquisition of the captured image (S134) and control of the projector 10 (S135) are repeatedly performed.

The projector control for adjusting the projection area of each projector in step S13 has been described above. Note that the flowchart shown in FIG. 7 is an example, and the operation according to the present embodiment is not limited to the example. For example, the generation of the simulation image in step S132 may be performed for all projectors in advance before the target projector is set, and simulation images corresponding to all the projectors may be stored in the storage unit 350.

(Control to adjust dispersion between multiple projectors)
FIG. 8 is a flowchart showing more detailed processing of step S15 shown in FIG. First, the projector control unit 318 selects one of the projectors 10 for which the processing in steps S152 to S153 has not been completed, and sets it as the target projector to be processed (S151).

Subsequently, the projector control unit 318 turns on the target projector (S152).
Further, according to the control of the imaging control unit 314, the camera 20 acquires a captured image including the projection area of the projector of interest, and provides it to the information processing apparatus 30 (S153). The processes in steps S151 to S153 are repeatedly performed until captured images at the time of lighting are acquired for all projectors included in the projector 10. In other words, if there is a projector for which a captured image at the time of lighting is not acquired among the projectors included in projector 10 (NO in S154), the process returns to step S151.

On the other hand, when the captured images at the time of lighting are acquired for all the projectors included in projector 10 (YES in S154), projector control unit 318 outputs output parameters between the plurality of projectors based on the acquired plurality of captured images. It is determined whether or not the variation in the number is sufficiently small (S155). If it is determined that the variation in output parameters among the plurality of projectors is sufficiently small (YES in S155), the process in step S15 ends.

On the other hand, when it is determined that the variation in output parameter among the plurality of projectors is not sufficiently small (NO in S155), projector control unit 318 controls each projector included in projector 10 so that the variation is small. (S156). Further, the process returns to step S151, and after acquiring the captured images for all the projectors controlled in step S156 (S151 to S154), it is determined again whether or not the variation is sufficiently small based on the captured images. (S155).

<< 4. Modification >>
The embodiment of the present disclosure has been described above. Below, some modifications of this embodiment are explained. Each modified example described below may be applied to the present embodiment alone, or may be applied to the present embodiment in combination. Each modification may be applied instead of the configuration described in the present embodiment, or may be additionally applied to the configuration described in the present embodiment.

<4-1. Modification 1>
In the above-described embodiment, the example in which the output parameter is acquired based on the captured image has been described, but the present technology is not limited to the example. For example, the projection system 1 may include a sensor other than the camera 20, and the output parameter may be acquired based on sensing data acquired by the sensor. For example, when the projection system 1 includes an illuminance sensor, a brightness parameter (an example of an output parameter) may be acquired based on sensing data acquired by the illuminance sensor. According to such a configuration, the output parameter can be acquired with higher accuracy.

<4-2. Modification 2>
In the above-described embodiment, the example in which the imaging control unit 314 controls the imaging of the camera 20 and the captured image is acquired every time each projector is turned on is described. However, the present technology is not limited to such an example. For example, the control unit 310 may not have a function as the imaging control unit 314. In such a case, for example, the captured image is continuously provided from the camera 20 to the information processing device 30 (for example, constantly) The processing device 30 may select a captured image used for projector control by referring to the captured time of the captured image.

<4-3. Modification 3>
Although FIG. 1 illustrates an example in which the camera 20 is a single camera, the present technology is not limited to such an example. For example, the camera 20 may include a plurality of cameras. When the camera 20 includes a plurality of cameras, the imaging control unit 314 generates an imaging control signal for controlling imaging by the camera corresponding to the projector that is lit among the cameras included in the camera 20. Also good. Here, the camera corresponding to the projector is a camera capable of acquiring a captured image including a projection area by the projector, for example.

Further, when the camera 20 includes a plurality of cameras, calibration such as brightness, hue, saturation, and hue is performed between the cameras, and output parameters are calculated from the captured image based on the calibration result. Is desirable.

<< 5. Hardware configuration example >>
The embodiment of the present disclosure has been described above. Finally, the hardware configuration of the information processing apparatus according to the present embodiment will be described with reference to FIG. FIG. 9 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present embodiment. Note that the information processing apparatus 900 illustrated in FIG. 9 can realize the information processing apparatus 30 illustrated in FIGS. 1 and 2, for example. Information processing by the information processing apparatus 30 according to the present embodiment is realized by cooperation between software and hardware described below.

As shown in FIG. 9, the information processing apparatus 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, and a host bus 904a. The information processing apparatus 900 includes a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a drive 909, a connection port 911, a communication device 913, and a sensor 915. The information processing apparatus 900 may include a processing circuit such as a DSP or an ASIC in place of or in addition to the CPU 901.

The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 900 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. For example, the CPU 901 can form the control unit 310.

The CPU 901, ROM 902, and RAM 903 are connected to each other by a host bus 904a including a CPU bus. The host bus 904 a is connected to an external bus 904 b such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 904. Note that the host bus 904a, the bridge 904, and the external bus 904b do not necessarily have to be configured separately, and these functions may be mounted on one bus.

The input device 906 is realized by a device in which information is input by the user, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever. The input device 906 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or a PDA that supports the operation of the information processing device 900. . Furthermore, the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by the user using the above-described input means and outputs the input signal to the CPU 901. A user of the information processing apparatus 900 can input various data and instruct a processing operation to the information processing apparatus 900 by operating the input device 906.

The output device 907 is formed of a device that can notify the user of the acquired information visually or audibly. Examples of such devices include CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, display devices such as lamps, audio output devices such as speakers and headphones, printer devices, and the like. For example, the output device 907 outputs results obtained by various processes performed by the information processing device 900. Specifically, the display device visually displays results obtained by various processes performed by the information processing device 900 in various formats such as text, images, tables, and graphs. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally.

The storage device 908 is a data storage device formed as an example of a storage unit of the information processing device 900. The storage apparatus 908 is realized by, for example, a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. The storage device 908 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 908 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like. The storage apparatus 908 can form the storage unit 350, for example.

The drive 909 is a storage medium reader / writer, and is built in or externally attached to the information processing apparatus 900. The drive 909 reads information recorded on a removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. The drive 909 can also write information to a removable storage medium.

The connection port 911 is an interface connected to an external device, and is a connection port with an external device capable of transmitting data by USB (Universal Serial Bus), for example.

The communication device 913 is a communication interface formed by a communication device or the like for connecting to the network 920, for example. The communication device 913 is, for example, a communication card for wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 913 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communication, or the like. The communication device 913 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet and other communication devices.

The sensor 915 is various sensors such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, a sound sensor, a distance measuring sensor, and a force sensor. The sensor 915 acquires information on the state of the information processing apparatus 900 itself, such as the posture and movement speed of the information processing apparatus 900, and information on the surrounding environment of the information processing apparatus 900, such as brightness and noise around the information processing apparatus 900. . Sensor 915 may also include a GPS sensor that receives GPS signals and measures the latitude, longitude, and altitude of the device.

Note that the network 920 is a wired or wireless transmission path for information transmitted from a device connected to the network 920. For example, the network 920 may include a public line network such as the Internet, a telephone line network, and a satellite communication network, various LANs including the Ethernet (registered trademark), a wide area network (WAN), and the like. Further, the network 920 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

Heretofore, an example of the hardware configuration capable of realizing the functions of the information processing apparatus 900 according to the present embodiment has been shown. Each of the above components may be realized using a general-purpose member, or may be realized by hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out this embodiment.

It should be noted that a computer program for realizing each function of the information processing apparatus 900 according to the present embodiment as described above can be produced and mounted on a PC or the like. In addition, a computer-readable recording medium storing such a computer program can be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.

<< 6. Conclusion >>
As described above, according to the embodiment of the present disclosure, it is possible to reduce the human burden while suppressing deterioration in image quality.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
An information processing apparatus comprising: a simulation image including a projection area of a projector in advance design; and a control unit that controls the projector based on a captured image including the projection area of the projector.
(2)
The information processing apparatus according to (1), wherein the simulation image is generated based on a parameter in the preliminary design and a parameter related to an imaging apparatus that acquires the captured image.
(3)
The information processing apparatus according to (1) or (2), wherein the control unit controls the projector so that a difference between the simulation image and the captured image becomes small.
(4)
The information processing apparatus according to (3), wherein the control unit performs control related to a lens of the projector.
(5)
The information processing apparatus according to (4), wherein the control related to the lens includes lens shift control of the projector.
(6)
The information processing apparatus according to (4) or (5), wherein the control related to the lens includes zoom control of the projector.
(7)
The information processing apparatus according to any one of (3) to (6), wherein the control unit repeatedly controls the projector until the difference is determined to be sufficiently small.
(8)
The control unit performs a second control different from the first control when the difference calculated after performing the first control is larger than the previously calculated difference, (7 ).
(9)
The control unit performs control opposite to the first control when the difference calculated after performing the first control is larger than the difference calculated last time, (8) The information processing apparatus described in 1.
(10)
The information processing apparatus according to any one of (1) to (9), wherein the control unit controls a plurality of projectors based on a plurality of captured images.
(11)
The information processing apparatus according to (10), wherein the control unit performs control related to output parameters of the plurality of projectors so that variations in output parameters among the plurality of projectors are reduced.
(12)
The information processing according to (11), wherein the control unit controls an output parameter of each projector included in the plurality of projectors so as to approach a reference value specified based on the output parameters of the plurality of projectors. apparatus.
(13)
The information processing apparatus according to (11) or (12), wherein the control unit repeatedly controls the projector until it is determined that the variation is sufficiently small.
(14)
The control unit reverses the control related to the output parameters of the plurality of projectors when the variation calculated after the control related to the output parameters of the plurality of projectors is larger than the variation calculated last time. The information processing apparatus according to (13), wherein control is performed.
(15)
The information processing apparatus according to any one of (11) to (14), wherein the output parameter includes at least one parameter of brightness, hue, saturation, and color.
(16)
An information processing method including: a processor controlling a projector based on a simulation image including a projection area of a projector in a pre-design and a captured image including a projection area of the projector.
(17)
A projector that projects a projected image;
An imaging device for acquiring a captured image including a projection area of the projector;
An information processing apparatus including a simulation image including a projection area of the projector in advance design, and a control unit that controls the projector based on the captured image;
A projection system comprising:

DESCRIPTION OF SYMBOLS 1 Projection system 10 Projector 20 Camera 30 Information processing apparatus 50 Screen 80 Communication network 310 Control part 312 Communication control part 314 Imaging control part 316 Simulation image generation part 318 Projector control part 320 Communication part 350 Storage part

Claims

An information processing apparatus comprising: a simulation image including a projection area of a projector in advance design; and a control unit that controls the projector based on a captured image including the projection area of the projector.
The information processing apparatus according to claim 1, wherein the simulation image is generated based on a parameter in the preliminary design and a parameter relating to an imaging apparatus that acquires the captured image.
The information processing apparatus according to claim 1, wherein the control unit controls the projector so that a difference between the simulation image and the captured image becomes small.
The information processing apparatus according to claim 3, wherein the control unit performs control related to a lens of the projector.
5. The information processing apparatus according to claim 4, wherein the control related to the lens includes lens shift control of the projector.
The information processing apparatus according to claim 4, wherein the control related to the lens includes zoom control of the projector.
The information processing apparatus according to claim 3, wherein the control unit repeatedly controls the projector until it is determined that the difference is sufficiently small.
The said control part performs 2nd control different from said 1st control, when the said difference calculated after performing 1st control is larger than the said difference calculated last time. The information processing apparatus described in 1.
9. The control unit according to claim 8, wherein when the difference calculated after performing the first control is larger than the difference calculated last time, the control unit performs control opposite to the first control. The information processing apparatus described.
The information processing apparatus according to claim 1, wherein the control unit controls a plurality of projectors based on a plurality of captured images.
The information processing apparatus according to claim 10, wherein the control unit performs control related to output parameters of the plurality of projectors so that variations in output parameters among the plurality of projectors are reduced.
The information processing apparatus according to claim 11, wherein the control unit controls an output parameter of each projector included in the plurality of projectors to approach a reference value specified based on the output parameters of the plurality of projectors. .
The information processing apparatus according to claim 11, wherein the control unit repeatedly controls the projector until it is determined that the variation is sufficiently small.
The control unit reverses the control related to the output parameters of the plurality of projectors when the variation calculated after the control related to the output parameters of the plurality of projectors is larger than the variation calculated last time. The information processing apparatus according to claim 13, wherein control is performed.
The information processing apparatus according to claim 11, wherein the output parameter includes at least one parameter of brightness, hue, saturation, or color.
An information processing method including: a processor controlling the projector based on a simulation image including a projection area of the projector in a pre-design and a captured image including the projection area of the projector.
A projector that projects a projected image;
An imaging device for acquiring a captured image including a projection area of the projector;
An information processing apparatus including a simulation image including a projection area of the projector in advance design, and a control unit that controls the projector based on the captured image;
A projection system comprising: