JP4965894B2 - Video display system - Google Patents

Description

  The present invention relates to a video display system suitable for viewing videos displayed on a video display surface at a plurality of viewpoint positions.

  In a video display system in which a video can be viewed at a plurality of viewpoint positions, the appearance of the video generally differs depending on the position at which the video is viewed. The change in appearance is significant when the directivity of the video display surface is high, and even when high-quality video can be viewed from one viewpoint position, only low-quality video can be viewed from another viewpoint position. The phenomenon that is not possible occurs.

  Such a phenomenon is a kind of video display system in which videos projected from a plurality of projectors are optically synthesized on a screen and presented to the audience as a single video (hereinafter referred to as “multi-projection video display system”). Is a particularly important issue.

  In a multi-projection video display system, generally, images are projected so that adjacent images on the screen overlap each other, and processing called edge blending is performed on the overlapped projection portion optically or by image processing technology. As a result, smooth connection of multiple images is realized. Here, the edge blending process is a process of processing each video so that a plurality of videos projected in an overlapping manner are mixed at an appropriate ratio. This is implemented by converting the pixel value of the input image based on a given conversion parameter and then projecting from the projector.

  When the directivity of the screen is high, even if it is adjusted so that it is mixed in an appropriate ratio with respect to one viewpoint position, it results in not being mixed in an appropriate ratio with respect to another viewpoint position. . For this reason, in a multi-projection video display system using a highly directional screen, video joints are conspicuous at many viewpoint positions except the viewpoint position at the time of adjustment.

As a technique for improving such a problem, Patent Document 1 is known. This document discloses a technique for improving a problem that occurs when an image is viewed at a second viewpoint position different from the first viewpoint position used for adjustment of the image display system. In this technique, characteristics relating to the directivity of the screen at the first viewpoint position and the second viewpoint position are measured in advance, and a camera installed at the first viewpoint position is used when adjusting the video display system. When performing conversion parameter estimation processing using a conventional adjustment technique using, as preprocessing, correction processing that takes into account the difference in characteristics related to the directivity of the screen between the first viewpoint position and the second viewpoint position Is to add. Specifically, this correction processing corrects the difference between the appearance at the first viewpoint position and the appearance at the second viewpoint position for the image data taken by the camera for adjustment. It is processing to do.
JP 2004-80160 A

  In the technique described in Patent Document 1, it is necessary to measure characteristics relating to the directivity of the screen for each viewpoint position assumed in advance. That is, the measurement cost increases when the positions where the video can be viewed are in a wide range. In addition, it is necessary to deal with an unexpected viewpoint position by selecting one of the conversion parameters corresponding to the assumed viewpoint position, or it is necessary to remeasure the characteristics related to the directivity of the screen.

  In the above technique, (1) first, the viewpoint position of the spectator is determined, (2) next, correction regarding the directivity of the screen is performed, and (3) conversion that is actually used from the corrected image data. A processing flow of calculating parameters is required. For this reason, the calculation cost from when the viewpoint position of the audience is determined until the conversion parameter is generated increases.

  The present invention has been made in view of these problems, and provides an image display system capable of easily correcting deterioration in image quality that occurs when a displayed image is viewed from a viewpoint position different from the adjustment position. Is.

  In order to solve the above problems, the present invention employs the following means.

A video generator that outputs video for presentation to the user;
A correction unit that corrects and outputs the video output from the video generation unit based on a pixel value conversion parameter stored in a parameter storage unit;
A display unit having a light beam controller for displaying an image output from the correction unit;
A first storage unit for storing a first pixel value conversion parameter for obtaining a good correction result at the first adjustment position;
A second storage unit for storing a second pixel value conversion parameter for obtaining a good correction result at the second adjustment position;
A parameter combining unit that calculates a third pixel value conversion parameter using the first and second pixel value conversion parameters and stores the third pixel value conversion parameter in the parameter storage unit;
A command input unit for inputting a selection command for selecting an adjustment position and a correction command for correcting the first or second pixel value conversion parameter;
A command control unit that controls the video display system according to the command input from the command input unit,
The command control unit
When the first adjustment position is selected by the selection command, a video obtained by correcting the first image with the first pixel value conversion parameter is output from the correction unit,
When the second adjustment position is selected by the selection command, a video obtained by correcting the second image with the second pixel value conversion parameter is output from the correction unit,
When the correction command is input, after the correction input from the command input unit to the pixel value conversion parameter corresponding to the adjustment position selected by the selection command, The parameter combining unit calculates the third pixel value conversion parameter using the first and second pixel value conversion parameters, and stores the third pixel value conversion parameter in the parameter storage unit.

  Since the present invention has the above-described configuration, it is possible to easily correct deterioration in video quality that occurs when a displayed video is viewed from a viewpoint position different from the adjustment position.

  The first embodiment will be described below. The present embodiment is an example suitable for application to a video display system that presents video to a linearly distributed audience, such as a video display system installed in a communication passage of a station.

  FIG. 1 is a diagram illustrating a video display system according to the present embodiment. In the figure, a screen 110 is a rear projection type screen. On the screen 110, a projector 220 (220-1 to 220-4) (not shown) projects an image from the back side, that is, from the opposite side of the passage with the screen 110 in between. The projectors 220-1 to 220-4 are arranged so that adjacent images overlap each other as indicated by the horizontal projection range 130 (130-1 to 130-4).

  A video output from a video generation device 200 (not shown) is subjected to geometric correction processing and pixel value conversion processing using a video correction device 210 (not shown) and projected from the projector 220, whereby a plurality of videos are displayed on the screen 110 as a whole. Displayed as one smoothly connected video.

  In the present embodiment, a rear projection type plane-shaped screen is used as the screen 110, but is not limited thereto. For example, a front projection type screen may be used, or a curved screen may be used. When a curved screen is used, it is desirable to increase the number of adjustment positions described later.

  The audience 140 (140-1 to 140-3) is, for example, a pedestrian who watches an image displayed on the screen 110 on the wall surface while walking along a communication path of a station. In this embodiment, the spatial distribution of the audience 140 is detected by the audience distribution detection unit 120, and the detected distribution is reflected in the pixel value conversion parameter used in the pixel value conversion process.

  The audience distribution detection unit 120 (120-1 to 120-3) uses a monitoring camera and detects a moving object using an existing technique such as background difference. However, the audience distribution detection unit 120 may be anything that can detect the spatial distribution of the audience, and is not limited to this embodiment. For example, a sensor using an existing technique can be used as appropriate according to the application, such as a stereo vision sensor, an infrared sensor, or a pressure sensor.

  In this embodiment, the spatial distribution of the audience is illustrated as a one-dimensional distribution along the passage, but may be considered as a two-dimensional distribution when the width of the passage is wide. In addition, when an image is displayed on a screen installed in an atrium of a high building, a three-dimensional distribution may be considered.

  In order to obtain one image smoothly connected on the screen 110 using the image correction device 210, a geometric correction parameter and a pixel value conversion parameter used in the geometric correction process and the pixel value conversion process are generated in advance. It is necessary to keep. In order to obtain parameters that look beautiful at the adjustment position, these can be generated by existing techniques. The pixel value conversion parameter is a different parameter depending on the adjusted position. In particular, when a rear projection type screen is used as in this embodiment, the optical characteristics of the screen are high in directivity and highly dependent on the adjustment position.

  In the present embodiment, a pixel value conversion parameter is generated for each of the adjustment positions 100-1 to 100-3 (three locations) so that the pixel value conversion parameter looks beautiful (in this case, for example, the adjustment position 100-1). When the image is viewed from the adjustment position 100-3 using the pixel value conversion parameter adjusted in step 3, the quality deterioration such as the joints of a plurality of images appearing dark and sinking is seen). Use mixed according to the audience distribution. Details of this will be described with reference to FIGS.

  The arrangement of the adjustment positions 100 (100-1 to 100-3) is preferably near both ends and the center of the range in which the audience can be distributed. As a result, when mixing a plurality of pixel value conversion parameters, only interpolation processing can be essentially performed, and adverse effects due to errors can be reduced. The number of adjustment positions may be two or more, and is not limited to three. The adjustment positions may be set as necessary within the range in which the audience can be distributed in addition to the both ends of the range in which the audience can be distributed. In addition, when the video quality at both ends of the range in which the audience can be distributed is not important, it is not necessary to arrange the adjustment positions 100 at both ends of the range in which the audience can be distributed. In this case, when a plurality of pixel value conversion parameters are mixed, portions that can be mixed by interpolation processing are mixed by interpolation processing, and other portions may be mixed by extrapolation processing.

  FIG. 2 is a diagram for explaining the details of the video display system. 2 that are the same as those shown in FIG. 1 are given the same reference numerals, and descriptions thereof are omitted.

  The video display system of this embodiment includes a video generation device 200, a video correction device 210, a projector 220, and a screen 110. In this system, the video generated by the video generation device 200 is corrected by the video correction device 210, and the corrected video data is projected on the screen 110 from the projector 220, thereby providing the video to the audience.

  The video generation device 200 supplies video for four channels equal to the number of projectors 220 to the image correction unit 215. As a specific configuration, a matrix switcher may be used to copy and output one video for the required number of channels, or a scan converter may be used to assign each channel from one video. It is good also as a structure which cuts out and outputs this area | region, and is good also as a structure which uses them together. Further, it may be configured such that a video that is divided in advance for each channel's assigned area and stored in a storage medium such as a magnetic disk device or an optical disk is reproduced while being synchronized with a plurality of devices. In addition, a video generation apparatus using existing technology can be used alone or in combination as appropriate according to the application.

  As the projector 220, a device using existing technology can be used as appropriate according to the application, such as a liquid crystal projector. Note that when using a device having a function of automatically adjusting the contrast or the like according to the input video, it is necessary to turn off the automatic adjustment function.

  The video correction device 210 includes an audience distribution detection unit 120, an arithmetic processing device 211, a main storage device 213, an external storage device 214, and an image correction unit 215.

  The arithmetic processing device 211 performs various processes including updating of a pixel value conversion parameter stored in the image correction unit 215 while reading a program and data from the external storage device 214 to the main storage device 213 as necessary.

  The main storage device 213 temporarily stores audience distribution data 231 in addition to programs and data read from the external storage device 214 by the arithmetic processing unit 211. The audience distribution data 231 includes the number of audiences and position information of each audience, and is sequentially updated by the audience distribution detection unit 120 described with reference to FIG. In this embodiment, the audience distribution data 231 is stored in the main storage device 213, but may be stored in the external storage device 214 and read into the main storage device 213 as necessary.

  The external storage device 214 stores a parameter initialization program 241, a parameter update program 242, design data 243, adjusted geometric correction parameter data 244, and adjusted pixel value conversion parameter data 245. As the external storage device 214, a magnetic disk device, an optical disk, or the like can be used. Further, as a configuration including a data communication device instead of the external storage device 214, the program and data stored in the external storage device 214 may be acquired from outside the system via a network or the like.

  The image correction unit 215 performs geometric correction and correction related to color and brightness on the video supplied from the video generation device 200 and supplies the corrected video to the projector 220. In the present embodiment, the input channel and the output channel are made to correspond one-to-one, and four image correction apparatuses 300 described later (FIG. 3) are used. In this specification, the description will be made with a configuration in which the number of input channels and the number of output channels are consistently the same, but this is not essential, and for example, a plurality of input videos are connected and stored. By adopting a configuration including a frame buffer having such a size that it is possible, the present invention can be applied even when the number of input / output channels is different.

  The parameter initialization program 241 is started when the arithmetic processing unit 211 starts the system and is executed only once. Specifically, initialization processing such as setting of the input / output video signal format is performed on the image correction unit 215, and adjusted geometric correction parameter data 244 (described later) is set in the image correction unit 215. Among the adjusted pixel value conversion parameter data 245 (described later), pixel value conversion parameters corresponding to the projectors 220-1 to 220-4 stored in association with the adjustment position 100-2 are stored in the image correction unit 215. Perform the setting process.

  As for the pixel value conversion parameters, those stored in relation to the adjustment position 100-1 and the adjustment position 100-3 instead of the adjustment position 100-2 may be set. The pixel value conversion parameter generated by the processing may be stored in the external storage device 214 and set. Further, when the parameter storage unit 316 of the image correction apparatus 300 (FIG. 3) is configured by a non-volatile memory or the like, the geometric correction parameter 322 and the pixel value conversion parameter 323 can be retained even after the system is terminated. In the second and subsequent activations of the system, the process of setting the geometric correction parameter and the pixel value conversion parameter in the image correction apparatus 300 by the parameter initialization program 241 may be omitted.

  The parameter update program 242 is started when the parameter initialization program 241 ends, and is repeatedly executed while the system is operating. Details of the parameter update program 242 will be described later (FIG. 5).

  When executing the parameter update program 242, the arithmetic processing unit 211 performs processing based on a reference coordinate system unique to the entire video display system. The design data 243 includes coordinate values of the respective adjustment positions 100-1 to 100-3 in the reference coordinate system, parameters for converting the coordinate system unique to the screen 110 to the reference coordinate system, and unique to the audience distribution detector 120. Parameters for converting the coordinate system of the projector 110-1 to the reference coordinate system, parameters for converting the coordinate system unique to each of the projectors 220-1 to 220-4 to the coordinate system unique to the screen 110, and the image generation device 200 This is data for coordinate conversion including parameters for converting a coordinate system unique to the supplied video of each channel into a coordinate system unique to the corresponding projector 220-1 to 220-4. As the design data 243, design values determined in advance at the time of designing the video display system are used. The arithmetic processing unit 211 converts data expressed in a coordinate system unique to each device into a representation in a reference coordinate system using a known method based on the design data 243 as necessary.

  The adjusted geometric correction parameter data 244 is a set of adjusted geometric correction parameters corresponding to each of the projectors 220-1 to 220-4, that is, a geometric correction in which an image is geometrically smoothly connected on the screen 110. A set of parameters. Such geometric correction parameters are generated in advance using existing techniques. Specifically, it may be generated simply based on a design value, or may be generated by a method described in JP-A-2002-72359, for example, as a configuration including an adjustment imaging device. Similarly, the image pickup apparatus for adjustment is also provided with a coordinate system unique to each channel image supplied by the image generation device 200 and a predetermined condition (designed value) as a predetermined condition (designed value). The correspondence with the coordinate system on the captured image data obtained by capturing the entire image on the screen 110 with the image capturing device for adjustment (at a preliminarily given posture and angle of view) for each channel supplied by the image generating device 200. Generated by an existing method such as a spatial encoding method (Seiji Iguchi, Kosuke Sato, 3D image measurement, Shosodo, Tokyo, 1990, pp. 80-91), and the generated coordinate system correspondence data; “How should the video of each channel supplied by the video generation device 200 be captured in the coordinate system on the captured image data” calculated from the design value? Based on over data, it may be generated. A specific embodiment of the geometric correction parameter will be described later (FIG. 3).

  The adjusted pixel value conversion parameter data 245 is a set of pixel value conversion parameters corresponding to the projectors 220-1 to 220-4 adjusted at the respective adjustment positions 100-1 to 100-3. Yes, and stored in association with each of the adjustment positions 100-1 to 100-3. Such a pixel value conversion parameter, that is, a pixel value conversion parameter suitable for viewing an image at a predetermined adjustment position is known in the art, for example, Japanese Patent Application No. 2006-24627 or Japanese Patent Application Laid-Open No. 2002-72359. It is generated in advance using the technique described in. A specific embodiment of the pixel value conversion parameter will be described later (FIG. 4).

  FIG. 3 is a diagram for explaining the details of the image correction apparatus 300. The image correction apparatus 300 includes a video input unit 310, a frame memory 311, a geometric correction unit 312, a pixel value conversion unit 313, a video output unit 314, a parameter setting unit 315, and a parameter storage unit 316. The parameter storage unit 316 stores a geometric correction parameter 322 and a pixel value conversion parameter 323.

  The video input unit 310 reads the video for one channel supplied from the video generation device 200 and writes it into the frame memory 311 as digital image data. When the video is supplied as an analog signal, a configuration including an A / D converter may be used.

  The frame memory 311 is configured to have a memory having a size enough to store input video for one channel for two frames, and one frame for writing from the video input unit, and the remaining one frame for geometric correction unit For reading from a frame, it is used by alternately changing the roles of odd frames and even frames.

  The geometric correction unit 312 outputs, to the pixel value conversion unit 313, image data obtained as a result of performing geometric correction on the image data on the frame memory 311 based on the geometric correction parameter 322 stored in the parameter storage unit 316. . Here, the geometric correction parameter 322 defines how the pixel value of each pixel of the image data output from the geometric correction unit 312 is determined with reference to which pixel on the frame memory 311. Parameter. For example, a set of a real value X and a real value Y is stored for each pixel, and is associated with a coordinate value (X, Y) on the frame memory for each reference color (for example, R, G, B). In addition, the pixel value may be determined by bilinear interpolation of four neighboring pixels. If there is no corresponding coordinate value on the frame memory, a predetermined exceptional value is entered at the position of the geometric correction parameter 322, and the geometric correction unit 312 always displays “black” for such a pixel. That is, (R, G, B) = (0, 0, 0) is output.

  The pixel value conversion unit 313 converts the pixel value for each pixel in the image input from the geometric correction unit 312 based on the pixel value conversion parameter 323 stored in the parameter storage unit 316 and outputs a video output unit. This is output to 314, and is a part that performs processing corresponding to correction of the color and brightness of the video. The resolution of the image that is the input and output of the pixel value conversion unit 313 is equal to the resolution of the video that is the output of the image correction apparatus 300. Details of the pixel value conversion parameter 323 will be described later (FIG. 4).

  The video output unit 314 converts the image data output from the pixel value conversion unit 313 into a video signal and outputs the video signal to the projector 220. When the projector 220 is configured to project an analog video signal, the projector 220 may be configured to include a D / A converter.

  The parameter setting unit 315 stores the geometric correction parameter input to the image correction device 300 in accordance with an instruction from the arithmetic processing device 211 in the parameter storage unit 316 as the geometric correction parameter 322, and the image correction device in accordance with an instruction from the arithmetic processing device 211. The pixel value conversion parameter input to 300 is stored in the parameter storage unit 316 as the pixel value conversion parameter 323.

  The frame memory 311 and the parameter storage unit 316 use a RAM, the geometric correction unit 312 and the pixel value conversion unit 313 use an FPGA or ASIC, and the parameter setting unit 315 uses an input interface such as a USB or PCI bus, A set of FPGA, ASIC, etc. for processing the input data can be used. However, it is not limited to using these.

  The configuration of the image correction apparatus 300 is not limited to the configuration of FIG. For example, it is not necessary to perform geometric correction in the image correction apparatus 300 when a video having been subjected to necessary geometric correction is supplied from the video generation apparatus 200 or when the screen 110 and the projector 220 are installed strictly correctly. In this case, the geometric correction unit 312 may be omitted. In this case, it is not necessary to store the geometric correction parameter 322 in the parameter storage unit 316.

  Further, for example, when a maximum value of the assumed geometric correction amount (in this case, the maximum value of the change amount in the vertical direction) is given in advance, the frame can be controlled by controlling the read / write timing for each line. The memory 311 may be implemented in place of the line buffers having the number of lines determined depending on the maximum value of the geometric correction amount.

  FIG. 4 is a diagram for explaining a method of expressing the pixel value conversion parameter 323. The pixel value conversion parameter 323 includes a characteristic function 400 such that an output pixel value is uniquely determined with respect to an input pixel value independently for each pixel and each reference color (for example, R, G, B). In the example of the figure, the characteristic function 400 is a piecewise linear function and is defined by associating the output pixel values L0, L1, L2, L3, and L4 with the input pixel values 0, 64, 128, 192, and 255, respectively. Is done. Note that the expression method of the characteristic function 400 is not limited to this, but the change of the number of pieces of the piecewise linear function, the expression by the lookup table, the model expression (for example, “the normalized output pixel value is the input pixel value Use a variety of expressions, such as `` equal to the γ-th power of the normalized one '' and keep the parameters necessary for normalization such as the offset value for each pixel and each color and the value of γ) Can do.

  FIG. 5 is a diagram for explaining processing of the parameter update program 242 of this embodiment. This process is started when the parameter initialization program 241 ends, and is repeatedly executed while the system is operating.

  The arithmetic processing unit 211 reads the parameter update program 242 from the external storage device 214 to the main storage device 213 and executes it. When the execution is started, first, the latest audience distribution data 231 updated asynchronously by the audience distribution detection unit 120 is read (S501).

  Next, parameter composition processing is performed (S502). The parameter synthesis process generates and generates pixel value conversion parameters that are expected to be optimal for the current audience distribution based on the audience distribution data 231, the design data 243, and the adjusted pixel value conversion parameter data 245. In this process, the pixel value conversion parameter in the image correction apparatus 300 is updated with the pixel value conversion parameter. This process can be performed independently for each pixel value conversion parameter corresponding to each projector 220-1 to 220-4.

  In this embodiment, first, pixel value conversion parameters expected to be optimal for the audience (hereinafter referred to as “provisional pixel value conversion parameters”) are calculated independently for each audience, Based on the provisional pixel value conversion parameter (equal to the number of spectators detected in the audience distribution data 231), the pixel value conversion parameter (hereinafter referred to as “the pixel value conversion parameter” for actually updating the pixel value conversion parameter in the image correction apparatus 300). The updated pixel value conversion parameter ”is calculated.

The provisional pixel value conversion parameter corresponding to the audience a is calculated according to the equation (1).

  Here, Ta (X) is a parameter value at the pixel position X of the provisional pixel value conversion parameter (in this embodiment, a vector value represented by (L0, L1, L2, L3, L4) in FIG. 4). We (Yp, Ya) is a weight value determined by the coordinate Yp on the reference coordinate system of the adjustment position p and the coordinate Ya on the reference coordinate system of the spectator a, so that the sum relating to the adjustment position p is 1. It has been normalized. Tp (X) is a value at the pixel position X of the adjusted pixel value conversion parameter corresponding to the adjustment position p, and is a vector value similar to Ta (X).

We (Yp, Ya) can be calculated, for example, by normalizing the value calculated using equation (2).

  Here, ε is a given constant, and when the position Ya of the audience a coincides with a certain adjustment position Yp, the provisional pixel value conversion parameter is substantially the same as the adjusted pixel value conversion parameter corresponding to the adjustment position p. Set a value that matches. For example, when the Euclidean distance between the two closest adjustment positions is d, a value of d / 10000 may be set. D (Yp, Ya) is the Euclidean distance between Yp and Ya.

The updated pixel value conversion parameter is calculated according to the equation (3) using the plurality of provisional pixel value conversion parameters calculated as described above.

  Here, T (X) is the parameter value (vector value) at the pixel position X of the updated pixel value conversion parameter, and Wx (Yx, Ya) is the coordinate Yx on the reference coordinate system of the pixel position X and the audience a It is a weight value determined by the coordinate Ya on the reference coordinate system, and is normalized so that the sum relating to the audience a becomes 1. Ta (X) is the parameter value (vector value) at the pixel position X of the provisional pixel value conversion parameter.

Wx (Yx, Ya) can be calculated, for example, by normalizing the value calculated using the equation (4).

  Here, D (Yx, Ya) is the Euclidean distance between Yx and Ya.

  After the parameter synthesis process (S502) ends, the arithmetic processing unit 211 performs a parameter registration process (S503). The parameter registration process is a process of registering the updated pixel value conversion parameter generated in the parameter synthesis process (S502) as the pixel value conversion parameter 323 of the corresponding image correction apparatus 300. It is desirable that this processing is configured to simultaneously perform the update corresponding to each projector 220-1 to 220-4.

  After the parameter registration process (S503) ends, the arithmetic processing unit 211 ends the execution of the parameter update program 242.

  In this embodiment, the parameter synthesis process (S502) is performed in two stages: (a) provisional pixel value conversion parameter generation and (b) update pixel value conversion parameter generation. Then, it may be carried out by a single calculation. In this case, what is necessary is just to implement by using the formula which substituted the formula (1) into the formula (3) and arranged beforehand.

  In the present embodiment, the parameter synthesis process (S502) is a process of taking a weighted average of a plurality of adjusted pixel value conversion parameters, but the present invention is not limited to this. For example, in the generation of the provisional pixel value conversion parameter, the section in which the audience a exists is determined, and the provisional pixel value conversion parameter is generated by interpolation processing from the adjusted pixel value conversion parameters at the adjustment positions at both ends of the section. Also good. Or, more simply, the adjusted pixel value conversion parameter at the closest adjustment position may be used as it is as the temporary pixel value conversion parameter.

  In this embodiment, the weight value is calculated using the Euclidean distance. However, the present invention is not limited to this. For example, as illustrated in FIG. 1, conversion is performed in which an assumed route that connects the adjustment positions 100-1 to 100-3 is set, and the coordinate value of the reference coordinate system is converted into a one-dimensional coordinate value on the assumed route You may calculate using the one-dimensional coordinate value, after converting using a function. The conversion function may be, for example, a function that converts a coordinate value of a reference coordinate system into a coordinate value on an assumed route that is closest to the conversion function. It is also possible to divide into small areas, create in advance a conversion table that defines the coordinate values on the assumed path for each of the small areas, and perform conversion using the conversion table. Needless to say, the assumed route may be set in consideration of the average height of the assumed audience.

  In this way, by adopting an embodiment in which the calculation of the weight value is performed based on the one-dimensional coordinate value, when the assumed route is a curve, the “distance” can be treated as a route. A pixel value conversion parameter that can be expected to be suitable can be obtained.

  Further, even when it is difficult for the spectator distribution detection unit to accurately detect the viewpoint position of the spectator a, the adverse effect of the component in the height direction that is expected to have a large variance and a large error in detection, A pixel value conversion parameter that can be expected to be suitable can be obtained. Note that the existence range of the viewpoint in the height direction is determined depending on the individual difference of the audience, and is generally narrower than the existence area of the viewpoint determined depending on the amount of movement of the audience, so even if it is completely ignored The impact is minor.

  As described above, according to the present embodiment, the current audience distribution is detected, and adjusted pixel value conversion parameters that have been adjusted in advance at several measurement positions that do not depend on the viewpoint position of the audience are represented by the audience distribution. The pixel value conversion parameter expected to be optimal in the detected audience distribution can be generated by mixing based on the above. For this reason, pixel value conversion parameters can be generated individually by a simple method without requiring global optimization, and the image quality perceived by the audience can be improved at a lower cost than the conventional technology. .

  In this embodiment, the coordinate values of the respective adjustment positions 100-1 to 100-3 in the reference coordinate system are given as design values. However, when the adjusted pixel value conversion parameter is generated, each projector 220 is generated. When generating the correspondence data between the coordinates defining the correspondence between the coordinate system unique to -1 to 220-4 and the coordinate system unique to the imaging apparatus used for adjustment, the coordinate correspondence data and design A value estimated from the data 243 using an existing method may be used.

  In this embodiment, the adjusted pixel value conversion parameter data 245 is a set of pixel value conversion parameters, but this “pixel value conversion parameter” refers to a pixel value conversion parameter stored in the image correction apparatus 300. Any information may be provided as long as it has information equivalent to or more than H.323, and the specific expression method may be different.

  In the present embodiment, the spatial distribution of all the audiences is detected using the audience distribution detection unit 120, but the present invention is not limited to this. For example, when displaying an image directed to passengers of a glass-walled elevator installed in the center of the atrium on a screen installed vertically so as to straddle the floor in the atrium of the department store, on each floor of the department store The existing audience is ignored, and the pixel value conversion parameter may be generated as if there is only one audience at the elevator position, that is, as a function of the elevator height.

  In the present embodiment, by repeatedly executing the parameter update program 242, the pixel value conversion parameters set in the image correction unit 215 are sequentially updated, and suitable for the audience distribution detected by the audience distribution detection unit 120 each time. Although video can be presented, it is not limited to this. For example, when displaying an image without interaction with the audience on a screen installed around a roller coaster in an amusement park, by calculating the position of the audience at each time starting from the departure time in advance, An appropriate pixel value conversion parameter is generated in advance for each time, and an image that has been corrected in advance equivalent to the correction performed by the image correction unit 215 based on the pixel value conversion parameter is generated in advance. The already generated video may be directly output from the video generation device 200 to the projector 220 without passing through the video correction device 210.

  In the present embodiment, for example, the pixel value conversion parameter adjusted at the adjustment position 100-2 is stored in the image correction unit to perform image correction. However, the adjustment is performed by directly installing the photographing apparatus at the adjustment position 100-2. If the pixel value conversion parameter adjusted at the adjustment position 100-1 and the pixel value conversion parameter adjusted at the adjustment position 100-3 are combined, the pixel value conversion parameter at the adjustment position 100-2 is obtained. It is also possible to apply to uses such as generating.

  Next, a second embodiment will be described. This embodiment is a suitable example when applied to a video display system in which a temporal change in audience distribution can be easily predicted by fixed point observation, such as a video display system installed beside a moving sidewalk or an escalator.

  FIG. 6 is a diagram for explaining the video display system of the present embodiment. In the figure, the same parts as those shown in FIG.

  An image is projected on the screen 110 as in the example of FIG. However, in this embodiment, a video correction device 710 (FIG. 7) is used as the video correction device instead of the video correction device in FIG.

  The audience 640 (640-1 to 640-3) is, for example, a pedestrian who views a video displayed on the screen 110 on the wall surface on a moving sidewalk 630. In this embodiment, the time when the spectators 640-1 to 640-3 get on the moving sidewalk 630 is detected by the attendee detection unit 620, and the spectator is based on the detection time and the current time and the moving speed 631 of the moving sidewalk 630. After estimating the spatial distribution of 640, it is reflected in the pixel value conversion parameter used in the pixel value conversion process.

  The visitor detection unit 620 is a distance sensor using a laser, is installed at the entrance of the moving sidewalk 630, and detects that the spectator has got on the moving sidewalk 630 using a change in the distance detected by the sensor. The visitor detection unit 620 sequentially updates the visitor data 732 (FIG. 7) based on the detected information. The attendee detection unit 620 may be anything that can detect a human flow at a fixed point, and the embodiment is not limited to this embodiment. For example, a sensor using an existing technique can be used as appropriate according to the application, such as a stereo vision sensor, an infrared sensor, or a pressure sensor.

  FIG. 7 is a diagram for explaining the details of the video display system. In the figure, the same parts as those shown in FIG.

  The video display system of the present embodiment includes a video generation device 200, a video correction device 710, a projector 220, and a screen 110. The video generated by the video generation device 200 is corrected by the video correction device 710 and corrected video data. Is projected from the projector 220 onto the screen 110, thereby providing an image to the audience.

  The video correction device 710 includes a visitor detection unit 620, an arithmetic processing device 211, a main storage device 213, an external storage device 214, and an image correction unit 215.

  The main storage device 213 temporarily stores visitor data 732 in addition to programs and data read from the external storage device 214 by the arithmetic processing unit 211. The visitor data 732 is data that is sequentially updated by the visitor detection unit 620 described with reference to FIG. 6, and details thereof will be described later (FIG. 8).

  The external storage device 214 stores a parameter initialization program 241, a parameter update program 742, design data 743, adjusted geometric correction parameter data 244, and adjusted pixel value conversion parameter data 245.

  The parameter update program 742 is started when the parameter initialization program 241 ends, and is repeatedly executed every unit time Δt while the system is operating. Details of the parameter update program 742 will be described later (FIG. 9).

  The design data 743 is data including a weight value used in the parameter update program 742. This embodiment is an example in which the moving sidewalk advances by 1/8 of the overall length during the unit time Δt. The moving sidewalk 630 is equally divided into eight sections, and the spectators estimated to exist in each section The process is simplified by approximating the position with a position representative of the predetermined section. The weight value We (Yp, Ys) and the weight value Wx (Yx, Ys) may be calculated in the same manner as in the first embodiment using the coordinate value Ys of the center position of each section. Since Ys can be obtained as a design value, these weight values can be calculated in advance. Note that a normalized value is used for We (Yp, Ys), but normalization is not necessary for Wx (Yx, Ys).

  It should be noted that it is presumed that it is important for an application such as the present embodiment that the image of the portion located obliquely in front of the audience looks beautiful. In addition, it is expected that the importance of the video where the audience has already passed is low. For this reason, when calculating the value of Wx (Yx, Ys), it may be calculated in consideration of these factors. For example, the moving speed 631 of the moving sidewalk 630 may be normalized to a predetermined size and added to Ys, and the value of Wx (Yx, Ys) may be calculated based on the position, or the moving sidewalk 630 may be calculated. The inner product of the moving speed 631 and the vector from Ys to Yx normalized to size 1 may be reflected in the value of Wx (Yx, Ys).

  FIG. 8 is a diagram for explaining the data structure of the visitor data 732. In this embodiment, since the moving sidewalk 630 is divided into eight sections and handled, eight areas for storing the number of persons considered to be present in each section are prepared. In the case of this embodiment, since it is considered that the spectator has exited the sidewalk where the spectator moves after a certain time has elapsed, the counting data becomes unnecessary after the lapse of a certain time. Therefore, in this embodiment, the visitor data 732 is held as a ring buffer.

  When the visitor detection unit 620 detects a visitor, it increases the data in the area 810 indicated by the current time pointer 800 by “1”. The arithmetic processing unit 211 moves the current time pointer 800 to the right by every unit time Δt, and initializes the data in the moved area to “0”. When the current time pointer 800 points to the rightmost area 812, the current time pointer 800 is moved to the leftmost area 813.

  In the state of FIG. 8, the number of spectators who are estimated to exist in the section (s = 1) closest to the entrance of the moving walk where the number of people stored in the area 810 is represented, and gradually toward the area 813 This represents the number of spectators who have moved to the nearest section and are estimated to be in the section (s = 8) closest to the exit of the moving walk where the number of people stored in the area 811 moves.

  As a specific example of the ring buffer, an area for storing the number of people may be secured as an array, and the current time pointer 800 may be held as an index of the array.

  FIG. 9 is a diagram for explaining the processing of the parameter update program 742. This process is started when the parameter initialization program 241 ends, and is repeatedly executed while the system is operating.

  The arithmetic processing unit 211 reads the parameter update program 742 from the external storage device 214 to the main storage device 213 and executes it, thereby first reading the latest visitor data 732 updated asynchronously by the visitor detection unit 620. (S901).

  Next, audience distribution estimation processing is performed (S902). The audience distribution estimation process is a process of estimating the number of spectators and the position information of each spectator from the visitor data. In the present embodiment, since the visitor data 732 includes essentially equivalent information, no specific processing is required, but more precise calculation can be performed based on data such as the length and speed of the moving sidewalk. If necessary, the audience distribution is estimated in the audience distribution estimation process (S902), the estimated audience distribution is stored as the audience distribution data 731 in the main memory 213, and then the audience distribution is obtained in the parameter synthesis process (S903). Processing similar to that of the first embodiment may be performed using the data 731.

After the audience distribution estimation process (S902) ends, the arithmetic processing unit 211 performs a parameter synthesis process (S903). The parameter synthesis process (S903) is executed in the same manner as the parameter synthesis process (S502) in the first embodiment using the equations (5) and (6).

  In the present embodiment, values stored in the design data 743 are used as the weight values We (Yp, Ys) and Wx (Yx, Ys). Here, ρ (s) is the number of people estimated to exist in the section s, and can be obtained from the visitor data 732.

  After the parameter synthesis process (S903) ends, the arithmetic processing unit 211 performs a parameter registration process (S904), and ends the execution of the parameter update program 742. The parameter registration process (S904) may be performed in the same manner as the parameter registration process (S503) (FIG. 5) in the first embodiment.

  As described above, according to the present embodiment, by estimating the current audience distribution by fixed point observation and appropriate modeling, the audience distribution can be obtained in a simpler method than in the first embodiment, The estimated audience distribution is discretized into a plurality of sections, and weight values related to each section are stored as design values in advance, so that parameter synthesis processing is performed in a simpler method than in the first embodiment. can do. That is, according to the present embodiment, it is possible to improve the quality of the image felt by the audience at a lower cost than in the first embodiment.

  In this embodiment, the number of visitors was counted only at the entrance of the moving sidewalk.However, by counting the number of spectators passing through the position at several points on the moving sidewalk, the distribution of the spectators closer to reality can be obtained. It may be estimated and reflected in the pixel value conversion parameter.

  In addition, since the essence of the present embodiment is to generate a pixel value conversion parameter that is expected to be optimal by estimating the spectator distribution from data by fixed point measurement, for example, when it is a bidirectional moving walkway, Even when there are spectators walking on a moving sidewalk, by creating models corresponding to each and estimating the spectator distribution according to the model, it is expected to be optimal for the spectator distribution in the same way as in the illustrated form. The pixel value conversion parameter can be generated.

  In the present embodiment, the parameter synthesis process is performed as a weighted average for ρ (s), but the present invention is not limited to this. For example, the parameter synthesis process may be performed based on only the section s in which ρ (s) is maximum, that is, regarding other sections, ρ (s) is regarded as 0.

  Next, a third embodiment will be described. In the present embodiment, instead of the image correction apparatus 300 used in the second embodiment, an image correction apparatus 1000 described with reference to FIG. 10 is used, so that processing costs are considered in consideration of data transfer costs during system operation. This is intended to reduce this. In the present embodiment, in order to simplify the description, the description will be made assuming that Wx (Yx, Ys) = 1, but the present invention is not limited to this. Since Wx (Yx, Ys) is a fixed value that can be calculated in advance, when this value has a different value for each pixel, the parameter storage unit 316 (FIG. 10) described later corresponds to each section. An area for storing data of Wx (Yx, Ys) to be performed may be provided, and the processing of the pixel value synthesis unit 1011 may be changed to take a weighted average taking Wx (Yx, Ys) into consideration.

  FIG. 10 is a diagram illustrating the image correction apparatus according to the present embodiment. In the figure, the same parts as those shown in FIG. 3 are denoted by the same reference numerals and description thereof is omitted.

  The image correction apparatus 1000 includes a video input unit 310, a frame memory 311, a geometric correction unit 312, a pixel value conversion unit 1010, a pixel value synthesis unit 1011, a video output unit 314, a parameter setting unit 315, and a parameter storage unit 316. The parameter storage unit 316 stores a geometric correction parameter 322, a pixel value conversion parameter 1020, a mixing ratio parameter 1021, and a mixing weight parameter 1022.

  The pixel value conversion parameter 1020 is an adjusted pixel value conversion parameter, and includes a number of parameters equal to the number of adjustment positions (“3” of 100-1 to 100-3 in this embodiment). The pixel value conversion parameter 1020 is a parameter that is set in the image correction apparatus 1000 in advance by the arithmetic processing unit 211 when the system is activated.

  The mixing ratio parameter 1021 is a mixing ratio (vector value common to all pixels) of each pixel value conversion parameter in each section, corresponds to We (Yp, Ys), and the number of sections (in the present embodiment, “8”). ) Contains the same number of parameters. The mixing ratio parameter 1021 is a parameter that is set in the image correction apparatus 1000 in advance by the arithmetic processing unit 211 when the system is activated.

  The mixing weight parameter 1022 is the number of people estimated to exist in each section, and is a parameter corresponding to the visitor data 732. For this reason, as with the visitor data 732, it may be held in a ring buffer. In this case, the latest passing number determined by the arithmetic processing unit 211 per unit time Δt is transmitted to the image correction apparatus 1000, The parameter setting unit 315 that has received the transmitted information updates the current time pointer, and then writes the received information in the updated position. In addition, you may make it simply transmit every time the number of persons estimated that the arithmetic processing apparatus exists in each area.

  The pixel value conversion unit 1010 calculates a pixel value for each pixel in the image input from the geometric correction unit 312 based on the pixel value conversion parameter 1020 and the mixture ratio parameter 1021 stored in the parameter storage unit 316. This is converted and output to the pixel value synthesis unit. Here, pixel value conversion is performed independently for each section, and a number of images equal to the number of sections (hereinafter referred to as “provisional images”) are output to the pixel value synthesis unit. The provisional image is an image that is expected to obtain an optimal appearance in a section corresponding to the image when the image is output as it is as a correction result of the image correction apparatus 1000.

  The pixel value synthesizing unit 1011 synthesizes the provisional images as many as the number of sections input from the pixel value converting unit 1010 based on the mixing weight parameter 1022 stored in the parameter storage unit 316, and outputs a video output unit 314 is output. Specifically, for each pixel, the pixel value of the provisional image corresponding to each section is multiplied by the number of people in each section, and the multiplication result of all sections is added, and the addition result is divided by the total number of people in all sections. To do.

  As described above, according to the present embodiment, processing similar to that of the second embodiment can be realized by only transmitting the mixture weight parameter 1022 (or a part thereof) to the image correction unit. For this reason, when the data transfer cost is also taken into consideration, that is, when the data transfer via the parameter setting unit 315 is slower than the data transfer in the image correction apparatus, the audience can be reduced at a lower cost than the second embodiment. Can improve video quality.

  Next, a fourth embodiment will be described. The present embodiment is suitable for application to a video display system such as a movie theater or a conference room where the audience distribution has a two-dimensional spread. Also, it is particularly suitable when constructing a video display system in which the importance level of the audience has superiority or inferiority according to the price of the seat, etc., and each of the audiences is provided with a video having a quality commensurate with the importance level. .

  FIG. 11 is a diagram for explaining the video display system of the present embodiment. In the present embodiment, pixel value conversion parameters that can be clearly seen at each of the adjustment positions 1100-1 to 1100-4 are generated in advance, and these four pixel value conversion parameters are mixed according to the audience distribution. To use. When the audience distribution is assumed to have a two-dimensional spread, as shown in the figure, the distribution of the adjustment position 1100 is also two-dimensionally distributed so as to substantially cover the assumed audience distribution. It is desirable.

  The hatched seat 1120 is a special seat, and the other seats 1121 are general seats. Special appreciation tickets are usually sold at a higher price than regular seat appreciation tickets, and therefore image quality corresponding to them is required. In the present embodiment, a high-quality image is provided to the special seat audience as compared to the general seat audience.

  FIG. 12 is a diagram for explaining the details of the video display system. In the figure, the same parts as those shown in FIG.

  The video display system of the present embodiment includes a video generation device 200, a video correction device 1210, a projector 220, and a screen 110. The video generated by the video generation device 200 is corrected by the video correction device 1210, and the corrected video data Is projected from the projector 220 onto the screen 110, thereby providing an image to the audience.

  The video correction device 1210 includes an arithmetic processing device 211, a main storage device 213, an external storage device 214, an image correction unit 215, and a data communication device 1260.

  The main storage device 213 temporarily stores audience distribution data 1231 in addition to programs and data read from the external storage device 214 by the arithmetic processing unit 211. Audience distribution data 1231 is composed of the number of spectators and seat information of each spectator. When executing the parameter update program 1242, a database managed by an (external) appreciation ticket issuing system or the like not shown in the drawing. To update by reading from the data communication device 1260.

  The external storage device 214 stores a parameter initialization program 241, a parameter update program 1242, design data 1243, adjusted geometric correction parameter data 244, and adjusted pixel value conversion parameter data 245.

  The design data 1243 is data including coordinates of each adjustment position, coordinates of each seat, and importance of each seat. The importance of each seat is stored in advance by the system administrator according to the system management policy (how much the price difference of appreciation tickets is reflected in the importance).

  The parameter update program 1242 is repeatedly executed for each screening, and has the same processing flow as the parameter update program 242 (FIG. 5) in the first embodiment.

  For example, the audience distribution data reading process (S501) is performed by reading the sales status data of each seat from a database managed by an external appreciation ticket issuing system or the like using the data communication device 1260 via the network.

  The parameter synthesizing process (S502) is performed based on the expressions (5) and (6). At this time, the section s is read as the seat s, ρ (s) is read as the importance of the seat s, and further, “Wx (Yx, Ys) = 1” is executed. However, when the appreciation ticket for seat s has not been issued, the importance of seat s is treated as zero. Note that “Wx (Yx, Ys) = 1” is set because the audience in each seat is viewing the entire video in the application as in the present embodiment, and the weight value depends on the pixel position. This is because it is considered that it is not appropriate to change the value, and the value of Wx (Yx, Ys) can be set to an individual value for each pixel and for each seat, as in the other embodiments, as necessary.

  As described above, according to the present embodiment, even when the audience distribution has a two-dimensional spread and there is a difference in importance for each audience, the audience feels at a low cost while reflecting the importance. Video quality can be improved.

  The parameter update program 1242 may be executed depending on a change in the ticketing situation. As for the calculation method of We (Yp, Ys), for example, a two-dimensional space is divided into Delaunay triangles using the adjustment positions 1100-1 to 1100-4 as a generating point, and a vertex of a triangle including the seat for each seat For example, the calculation may be performed by other methods such as calculating by linear interpolation using only the adjustment position.

  In the present embodiment, the parameter composition processing is performed on the seats whose position and importance are fixed in advance based on the sales status data of each seat. However, the present invention is not limited to this. For example, in the case of a video display system installed at an event venue, an individual is identified by reading a wireless tag attached to a name tag given to each spectator, and the position and importance of each spectator are detected. In addition, the parameter synthesis process may be performed based on the detected position and importance.

  Next, a fifth embodiment will be described. The present embodiment is suitable for application to adjustment of a light reproduction type video display system. Here, the image display system of the light beam reproduction system is a known technique that is widely used in applications such as autostereoscopic viewing.

  In the present embodiment, an apparatus using an integral photography technique, which is one method of light beam reproduction, is used as an image display apparatus. In the integral photography technology, a lens array is used as a light controller. First, the outline of the apparatus will be described with reference to FIGS. 13 and 14, and then the present embodiment will be described with reference to FIGS.

  13 and 14 are a side view and a plan view, respectively, for explaining the video display method of the video display device of the present embodiment.

  In FIG. 13, the spectator views the video displayed on the video display surface 1310 through the lens array 1320. At this time, the image is viewed as follows.

  In FIG. 14, each rectangle represents a pixel on the video display surface 1310, and each circle represents a lens on the lens array 1320. For each lens, a region in charge on the video display surface 1310 is determined, and the audience can see one of the regions in charge of the lens at the position of each lens. For each lens, which position in the assigned area is visible is optically determined depending on the viewing position of the audience. For example, the area in charge of the lens 1421 is a rectangular area 1411 composed of 4 vertical pixels × 4 horizontal pixels, and from a certain viewing position, it appears that there is a hatched pixel 1412 at the position of the lens 1421. Note that it is possible to calculate from the design value which position in the assigned region of the lens is visible at each lens position with respect to each viewing position. At that time, as indicated by the hatched lines in FIG. 14, it is not always possible to see the same position in each assigned region, and therefore it is necessary to perform calculation for each lens.

  FIG. 15 is a diagram illustrating a video display system and an adjustment system thereof according to the present embodiment. In the figure, the same parts as those shown in FIG.

  The video display system according to this embodiment includes a video generation device 1500, an image correction device 1510, and a video display device 1520. The video generated by the video generation device 1500 is corrected based on the pixel value conversion parameter 1511 by the image correction device 1510. Then, the corrected video data is displayed on the video display device 1520 to provide video to the audience.

  Further, the adjustment system of the present embodiment includes a parameter generation device 1550, a photographing device 1560, and a photographing condition control device 1570, and is displayed on the video display device 1520 while changing the pixel value conversion parameter 1511 in the image correction device 1510. A pixel value conversion parameter 1511 suitable for displaying a good video on the video display system is generated based on the captured image data obtained by shooting the video.

  The video generation device 1500 generates video for one channel suitable for display using the video display device 1520 and supplies the video to the image correction device 1510. For example, a predetermined video recorded on a DVD medium may be supplied using a DVD player, or an interactive content video may be supplied using a PC. However, the present invention is not limited to these examples. is not.

  The image correction device 1510 is obtained by removing the frame memory 311 and the geometric correction unit 312 from the image correction device 300 (FIG. 3). That is, since the geometric correction function is not provided, it is not necessary to store the geometric correction parameter 322 in the parameter storage unit 316. Needless to say, the image correction apparatus 300 may be used in place of the image correction apparatus 1510 in the video display system of the present embodiment.

  The video display device 1520 is a light reproduction type video display device, and in this embodiment, includes a video display surface 1310 for displaying image data transmitted from the image correction device 1510 and a lens array 1320. The present invention is not limited to application to a system including a lens array, and can be applied to other light reproduction type image display systems such as an image display system including a lenticular lens.

  The parameter generation device 1550 includes an arithmetic processing device 211, a main storage device 213, an external storage device 214, an image correction control unit 1551, a shooting control unit 1552, and a shooting condition control unit 1553. The main storage device 213 temporarily stores programs and data read from the external storage device 214 by the arithmetic processing unit 211.

  The external storage device 214 includes a parameter generation program 1541, a parameter adjustment program 1542, a pattern display program 1543, an imaging condition control program 1544, design data 1545, adjustment pattern data 1546, coordinate correspondence data 1547, and adjusted pixel value conversion parameters. Data 1548 is stored.

  The parameter generation program 1541 is a program that is started when the adjustment system is started, generates a pixel value conversion parameter suitable for use in the video display system, and sets it in the image correction apparatus 1510. Details of the program will be described later (FIG. 16).

  The parameter adjustment program 1542 is a program that is called during the execution of the parameter generation program 1541, and generates adjusted pixel value conversion parameter data 1548. Details of the program will be described later (FIG. 17).

  The pattern display program 1543, when given pattern image data is input as the program, the adjusted pixel value that the image correction apparatus 1510 is currently subject to processing to the pattern image data without depending on the input video. This is a program that generates a pixel value conversion parameter that outputs a result of applying the conversion parameter, and sets it in the image correction apparatus 1510. Specifically, a pixel for which a conversion result based on the adjusted pixel value conversion parameter currently being processed is calculated independently for each pixel, and the conversion result is an output pixel value for all input pixel values. Generate and set value conversion parameters.

  The shooting condition control program 1544 is a program used by the arithmetic processing unit 211 to control the shooting condition control device 1570 via the shooting condition control unit 1553. From the six parameters for defining the position and orientation, A control command for controlling the photographing condition control device 1570 is generated.

  The design data 1545 stores data determined in advance as design values. In the present embodiment, the number of adjustment points (= the position where the image is taken), the direction vector representing the direction of the light ray assigned to each pixel corresponding to each pixel on the image display surface 1310 (regular so that the magnitude is 1). Similarly, the identifier of the lens that is in charge of the pixel corresponding to each pixel and the direction vector (normalized so that the size is 1) indicating the direction of each adjustment point corresponding to each lens And information for controlling the position and orientation of the photographing apparatus 1560 corresponding to each adjustment point.

  The adjustment pattern data 1546 stores a plurality of adjustment pattern image data used in the parameter adjustment program. Specifically, it is configured to include image data used in the coordinate correspondence data generation process (S1703) and feedback adjustment process (S1704) in the parameter adjustment process of FIG. 17, such as a gray code pattern.

  The coordinate correspondence data 1547 is data representing the correspondence between the coordinate values on the video display surface 1310 and the coordinate values on the photographed image data photographed by the photographing device 1560, and is generated and stored when the parameter adjustment program 1542 is executed. Is done.

  The adjusted pixel value conversion parameter data 1548 is an aggregate of a plurality of adjusted pixel value conversion parameters, and each adjusted pixel value conversion parameter corresponds to one of the plurality of adjustment points and is viewed at the adjustment point. In this case, the pixel value conversion parameter allows a good video to be seen. The adjusted pixel value conversion parameter data 1548 is generated and stored when the parameter adjustment program 1542 is executed. In this embodiment, the initial value of each adjusted pixel value conversion parameter is the identity conversion parameter. However, in the second and subsequent adjustments, the previous adjustment result may be used as it is.

  The image correction control unit 1551 performs processing for storing the pixel value conversion parameter 1511 in the image correction device 1510 in accordance with an instruction from the arithmetic processing device 211. As an interface for data transmission / reception with the image correction apparatus 1510, an interface suitable for the image correction apparatus 1510 is used. Further, when the video display system is configured to always include the adjustment system, the image correction device 1510 is directly connected to the data bus of the parameter generation device 1550 without using the configuration including the image correction control unit 1551. It is good also as a simple structure.

  The imaging control unit 1552 controls the imaging device 1560 by transmitting a control command to the imaging device 1560 in accordance with an instruction from the arithmetic processing device 211. In addition, the captured image data transmitted from the imaging device 1560 is received and stored in the main storage device 213 or the external storage device 214 in accordance with an instruction from the arithmetic processing device 211. As an interface for transmitting / receiving control commands and captured image data to / from the image capturing apparatus 1560, an interface suitable for an interface on the image capturing apparatus 1560 side, such as a USB interface or an IEEE1394 interface, is used.

  The shooting condition control unit 1553 controls the shooting condition control device 1570 by transmitting a control command to the shooting condition control device 1570 in accordance with an instruction from the arithmetic processing device 211. As an interface for transmitting and receiving control commands to and from the imaging condition control device 1570, an interface suitable for an interface on the imaging condition control device 1570 side, such as an RS-232C interface, is used.

  The photographing apparatus 1560 is, for example, a digital camera, and has functions of setting exposure, photographing a subject, and transmitting photographed image data according to a control command transmitted from the photographing control unit 1552. An existing interface such as a USB interface or an IEEE 1394 interface can be used as an interface for exchanging control commands and captured image data with the imaging control unit 1552.

  The imaging condition control device 1570 is, for example, a robot hand, holds the imaging device 1560, and controls the position and orientation of the imaging device 1560 by a control command transmitted from the imaging condition control unit 1553. An existing interface such as an RS-232C interface can be used as an interface for transmitting and receiving control commands to and from the imaging condition control unit 1553.

  FIG. 16 is a diagram for explaining the processing of the parameter generation program 1541 of this embodiment.

  In the parameter generation process, first, the parameter adjustment process is performed to generate adjusted pixel value conversion parameter data 1548 (S1601). Next, in the parameter synthesis process (S1602), the parameter adjustment process (S1602) is performed for each pixel. In this process, a pixel value conversion parameter is generated based on the adjusted pixel value conversion parameter data 1548 generated in step S1601), and the generated pixel value conversion parameter is set as the pixel value conversion parameter 1511 in the image correction device 1510. Details of the parameter adjustment process (S1601) will be described later (FIG. 17).

  In the parameter composition process (S1602), for each pixel, each adjustment is determined based on the direction in which the pixel is assigned and the direction in which each adjustment point is with respect to the lens in charge of the pixel. A weight value corresponding to the point is determined, and based on the weight value, a weighted average of the parameter values (vector values) corresponding to the pixels of each adjusted pixel value conversion parameter is taken, and the pixel value conversion parameter of the pixel And As a method for determining the weight value, for example, a value of an inner product between the direction vectors expressing the assigned direction and the direction of the adjustment point may be used. The generated pixel value conversion parameter is stored in the image correction apparatus 1510 as the pixel value conversion parameter 1511. Even when the actual position of the photographing apparatus 1560 does not exactly match the position of each adjustment point, the direction of each adjustment point with respect to each lens may be approximated using the design value as it is. The correct position may be estimated from the correspondence data 1547 and the design value and used.

  FIG. 17 is a diagram for explaining processing of the parameter adjustment program 1542 of the present embodiment.

  When parameter adjustment processing is started, first, N, which is the serial number of the adjustment point, is initialized to 0 (S1701), and then shooting condition control processing is performed for the Nth adjustment point (S1702). . The imaging condition control process (S1702) controls the position and orientation of the imaging device 1560 so as to match the position and orientation corresponding to the Nth adjustment point based on the design values defined in the design data 1545. It is processing to do. The processing (S1702) is performed by the arithmetic processing unit 211 controlling the photographing condition control device 1570 via the photographing condition control unit 1533 using the photographing condition control program 1544. Note that the control may be performed based on design values, and the relative positional relationship between the video display device 1520 and the imaging device 1560 after the control is strictly ideal even when there is an installation error of each device. It is not necessary to meet the specific conditions.

  Next, coordinate corresponding data generation processing (S1703) is performed. In this process, the correspondence between the coordinate value on the video display surface 1310 seen from the photographing position and the coordinate value on the photographed image data photographed by the photographing device 1560 is obtained. For example, a pattern display program 1543 is a group of a plurality of pattern image data called gray code (alternating binary code) (a set of image data of a plurality of vertical stripes and horizontal stripes having different stripe widths). Are repeatedly displayed on the video display device 1520, and they can be obtained based on the captured image data sequentially captured by the photographing device 1560. This method is a method called “spatial coding method”, which is a known technique described in “Seiji Iguchi, Kosuke Sato, 3D image measurement, Shosodo, Tokyo, 1990, pp. 80-91”. is there. Note that the pattern image data used in the coordinate correspondence data generation process (S1703) is stored in the adjustment pattern data 1546.

  Next, feedback adjustment processing is performed (S1704). In the feedback adjustment process (S1704), feedback adjustment is performed by equating a plurality of pixels handled by the same lens. In other words, although only one pixel is actually photographed among a plurality of pixels in charge of the same lens, pixel values corresponding to a plurality of pixels in charge of the same lens in order to reduce the influence of errors. The conversion parameter is configured to always change in the same manner during the execution of the feedback adjustment process (S1704). For a specific feedback adjustment method, for example, the method described in Japanese Patent Application No. 2006-24627 can be used.

  Next, parameter complement processing is performed (S1705). In the parameter complementing process (S1705), for the pixel value conversion parameter generated as a result of the feedback adjustment process (S1704), the correspondence relationship of the coordinate values with the captured image data is obtained by the coordinate corresponding data generation process (S1703). Based on the pixel value conversion parameter corresponding to the pixel, the pixel value conversion parameter of the other pixel is reconfigured, and the reconfigured pixel value conversion parameter is used as the Nth adjustment point of the adjusted pixel value conversion parameter data 1548. Is stored as an adjusted pixel value conversion parameter corresponding to. The reconstruction processing may be performed by existing interpolation processing and extrapolation processing.

  After completion of the parameter complementing process (S1705), it is determined whether or not adjustment has been completed for all adjustment points that need to be adjusted (S1706). If there is an adjustment point for which adjustment has not yet been completed, N, which is the serial number of the adjustment point, is incremented by “1” (S1707), and the process returns to the shooting condition control process (S1702) to continue the process. If the adjustment has been completed for all the adjustment points, the parameter adjustment process is terminated.

  As described above, according to the present embodiment, when a light reproduction type image display system is used, an image that can be satisfactorily viewed at many viewpoint positions is provided by adjustment at several adjustment points. Can do.

  In this embodiment, the position and orientation of the image capturing device 1560 are adjusted based on data captured while being controlled by the image capturing condition control device 1570. However, this control portion is replaced with a plurality of image capturing devices. It is also possible. That is, it is only necessary to provide the same number of imaging devices as the number of adjustment points that need to be adjusted, fix the position and orientation based on the design values, and then start the adjustment of the video display system. At that time, it is desirable to have the characteristics of the plurality of imaging devices as uniform as possible. However, in this embodiment, the pixel value conversion parameter is generated as a weighted average of the plurality of adjusted pixel value conversion parameters. Even if there is some variation in the characteristics of the device, adjustment is possible without failure.

  In the present embodiment, in the feedback adjustment process (S1704) in FIG. 17, the adjustment is performed by feedback adjustment on the pixels that are visible from the adjustment point. However, at each adjustment point, each lens is regarded as one pixel. Since the image can be handled as an image, it can be adjusted using another adjustment method, for example, the method disclosed in Japanese Patent Laid-Open No. 2002-72359.

  Next, a sixth embodiment will be described. In this embodiment, the image display system is transported by a robot arm in the adjustment phase in the manufacturing process of a small-sized light reproduction type image display system, and is simply adjusted one after another using a fixed camera. This is suitable when applied to simple adjustment of a display system.

  FIG. 18 is a diagram for explaining the video display system and the adjustment system of the present embodiment. In the figure, the same parts as those shown in FIG. 15 are denoted by the same reference numerals and description thereof is omitted.

  The adjustment system of this embodiment includes a parameter generation device 1850, a photographing device 1560, and an attitude control device 1870. The parameter generation device 1850 includes an arithmetic processing device 211, a main storage device 213, an external storage device 214, an image correction control unit 1551, an imaging control unit 1552, and an attitude control unit 1853. The external storage device 214 stores a parameter generation program 1841, a parameter adjustment program 1842, a pattern display program 1543, an attitude control program 1844, design data 1845, adjustment pattern data 1846, and adjusted pixel value conversion parameter data 1847. Is done.

  The parameter generation program 1841 performs parameter adjustment processing using the parameter adjustment program 1842 instead of the parameter adjustment processing performed using the parameter adjustment program 1542 in the parameter generation program 1541 (FIG. 15). It is. Details of the process of the parameter adjustment program 1842 will be described later (FIG. 19).

  The attitude control program 1844 is a program used by the arithmetic processing unit 211 to control the attitude control apparatus 1870 via the attitude control unit 1853. From the three angle parameters for defining the attitude, the attitude control apparatus 1870 is used. Generate control commands to control

  The design data 1845 stores data determined as design values in advance. In the present embodiment, the number of adjustment points that need to be adjusted (a plurality of shooting positions used for adjustment), the tolerance of misalignment corresponding to each adjustment point, and the attitude of the video display device corresponding to each adjustment point are controlled. Information, the range and interval of the attitude control parameter used in attitude fine adjustment, the threshold used in the determination of necessity of adjustment shown in FIG. 19 (S1904), and information on the partial area on the captured image data Is configured to include.

  The adjustment pattern data 1846 is a set of a plurality of pieces of image data to be input to the pattern display program 1543, and is generated in advance based on the design value independently for each adjustment point. Specific pattern features will be described later (FIG. 19).

  The adjusted pixel value conversion parameter data 1847 is an aggregate of a plurality of adjusted pixel value conversion parameters, and each adjusted pixel value conversion parameter corresponds to one of the plurality of adjustment points, and corresponds to the corresponding adjustment point. This is a pixel value conversion parameter that allows a good image to be seen when viewed. The adjusted pixel value conversion parameter data 1847 is generated and stored when the parameter adjustment program 1842 is executed. In this embodiment, it is assumed that the initial value of each adjusted pixel value conversion parameter is an identity conversion parameter, but in the second and subsequent adjustments, the previous adjustment result may be used as it is. Since the present embodiment is an example that focuses on simple adjustment of the video display system, each processing is performed by approximating that the characteristics of each pixel are linear. In other words, each adjusted parameter is treated as a one-dimensional vector (a three-dimensional vector in the case of handling with three colors of R, G, and B), and only the maximum value of the input pixel value is adjusted based on photographing. .

  The posture control unit 1853 controls the operation of the posture control device 1870 based on an instruction from the arithmetic processing device 211. As an interface used for transmission / reception of a control command to / from the attitude control device 1870, for example, an RS232C interface or the like adapted to the attitude control device 1870 side is used.

  The posture control device 1870 is, for example, a robot arm, holds the video display device 1520, and controls the posture of the video display device 1520 according to a control command sent from the posture control unit 1853. An existing interface such as an RS-232C interface can be used as an interface used to transmit and receive control commands to and from the attitude control unit 1853.

  FIG. 19 is a diagram illustrating the processing of the parameter adjustment program 1842 of this embodiment. When the parameter adjustment process is started, first, N, which is the serial number of the adjustment point, is initialized to 0 (S1901).

  Next, an Nth adjustment pattern display process is performed (S1902). This process is a process of displaying the adjustment pattern for the Nth adjustment point with the current adjusted pixel value conversion parameter corresponding to the Nth adjustment point. Here, the adjustment pattern for the Nth adjustment point is such that “white” is seen when viewed from the Nth adjustment point, and “black” is seen when viewed from other points. A pattern in which a white point is drawn on a black background (a pixel in which “white” is drawn at this time is hereinafter referred to as a “control point corresponding to the Nth adjustment point”).

  Specifically, in the adjustment pattern display process (S1902), the adjustment pattern for the Nth adjustment point is stored in the image correction device 1510 that stores the current adjusted pixel value conversion parameter corresponding to the Nth adjustment point. The output result of the image correction device 1510 when the input is input is calculated using the pattern display program 1543, and a pixel value conversion parameter for outputting the calculation result for any input is stored in the image correction device 1510. It is processing. For example, when the expression method described in FIG. 4 is used as the pixel value conversion parameter, by setting L0 to L4 to be equal to the pixel value to be output for each pixel, A pixel value conversion parameter can be generated. As for the size of the white point, a value determined in accordance with the tolerance of misalignment corresponding to the Nth adjustment point stored in the design data 1845 may be used.

  Next, posture control processing is performed (S1903). The attitude control process (S1903) controls the attitude of the video display device 1520 by controlling the attitude control device 1870 so that the photographing device 1560 is positioned at the Nth adjustment point relative to the video display device 1520. It is processing to do. Specifically, the attitude of the video display device 1520 is controlled so that the entire image appears brightest based on data obtained by the video shooting device 1560 shooting the video display surface 1310 through the lens array 1320.

  This embodiment is an example in the case where the positions of the photographing device 1560 and the posture control device 1870 are fixed. After the posture is controlled based on the design data 1845, the influence of various errors such as installation errors is affected. In order to absorb, the best one is selected by exhaustively searching for the attitude control parameters around the design value. The attitude control parameter fluctuation range and attitude control parameter fluctuation interval in this search are determined according to the specifications of the attitude control device 1870 and the assumed error range, and values stored in the design data 1845 in advance are used. use.

  Next, it is determined whether or not adjustment is necessary for the Nth adjustment point (S1904). In the adjustment necessity determination process (S1904), the average value of the brightness is calculated for each of the plurality of partial areas in the video display area in the data obtained by the imaging apparatus 1560 shooting the video display surface 1310 through the lens array 1320. If the variance of the average value is equal to or less than a predetermined threshold value (stored in the design data 1845), it is determined that adjustment is unnecessary, and otherwise, it is determined that adjustment is necessary. Here, since it is only necessary to obtain a representative value of each partial region, a median value may be used instead of the average value. Further, when the characteristic function for converting the pixel value of the photographed image data into brightness is not given as the design data, the calculation may be performed using the pixel value of the photographed image data directly. The partial area is calculated in advance for each adjustment point based on the design value and stored in the design data 1845. A pattern for detecting the video display area is displayed on the video display device. Alternatively, it may be dynamically created based on the data obtained by photographing it.

  It is not necessary for the union of the partial areas to cover the entire video display area on the photographed image data, and it is large enough to mitigate the effects of errors during photographing, depending on the required accuracy. The number of partial regions may be extracted. For example, the video display area on the photographed image data is divided into 3 × 3 partial areas having approximately the same size, and a partial area having a size of about 5% of the entire video display area from the center of each partial area. May be extracted and used for determination.

  If it is determined in the adjustment necessity determination process (S1904) that adjustment is necessary, a parameter update process (S1905) is performed, and the process returns to the adjustment pattern display process (S1902) to continue the process.

  The parameter update process (S1905) is based on the data obtained by photographing the video display surface 1310 through the lens array 1320 by the photographing apparatus 1560 and the current adjusted pixel value conversion parameter corresponding to the Nth adjustment point. This is a process of updating the adjusted pixel value conversion parameter corresponding to the adjustment point. In this process, first, for the set of control points corresponding to the Nth adjustment point, the parameters for each control point are corrected so that the control point being brightly photographed matches the control point being photographed darkly. Then, the parameter value corresponding to each pixel is determined by determining the value of the corrected parameter for each of the control points by an existing interpolation method or extrapolation method such as bilinear interpolation. If the adjustment is insufficient, the processing of S1902 to S1905 is repeatedly performed, so that the parameter correction for the control point in the parameter update processing (S1905) does not need to be performed strictly.

  If it is determined in the adjustment necessity determination process (S1904) that adjustment is not necessary, it is determined whether adjustment has been completed for all adjustment points that require adjustment (S1906). If there is an adjustment point for which adjustment has not yet been completed, N, which is the serial number of the adjustment point, is increased by “1” in S1907, and the process returns to S1902 and continues. If the adjustment has been completed for all the adjustment points, the parameter adjustment process is terminated.

  As described above, according to the present embodiment, at the time of adjustment of the light reproduction type image display system, the image adjustment is performed after controlling the attitude of the image display device so that the positional relationship with the imaging device substantially matches the design data. By doing so, it is possible to provide an adjustment system capable of adjusting a light reproduction type video display system while suppressing the total movement amount of devices in the entire adjustment processing including photographing processing at a plurality of positions.

  Next, a seventh embodiment will be described. This embodiment is a suitable example when it is desirable for the user to be able to easily adjust the video quality visually, such as when applying a light reproduction type video display system as a display for a mobile phone.

  FIG. 20 is a diagram illustrating the video display system and the adjustment system according to the present embodiment. In the figure, the same parts as those shown in FIG. 18 are denoted by the same reference numerals and description thereof is omitted.

  In the present embodiment, the imaging control unit 1552 and the posture control unit 1853 are removed from the parameter generation device 1850 (FIG. 18), and a pixel value conversion parameter is generated using the parameter generation device 2050 that newly includes the command input unit 2052. To do.

  In addition, the photographing device 1560 and the posture control device 1870 used in the sixth embodiment (FIG. 18) are unnecessary in this embodiment, and therefore the posture control program 1844 stored in the external storage device 214 is also used. It is unnecessary. In this embodiment, the parameter generation program 2041 is replaced with the parameter generation program 1841, the parameter adjustment program 2042 is replaced with the parameter adjustment program 1842, and the design data 2045 is replaced with the design data 1845, respectively. Store and use.

  The command input unit 2052 inputs a “parameter adjustment start” command, commands “brighten” and “darken” for each of the four corners of the screen, and a command “complete adjustment at the current viewpoint position”. It has a function. Specifically, a key input interface may be used. In the present embodiment, the parameter generation program 2041 is executed by the arithmetic processing unit 211 in response to a “parameter adjustment start” command from the command input unit 2052.

  When the parameter generation program 2041 is executed, first, parameter adjustment processing is performed using the parameter adjustment program 2042, and then parameter synthesis processing is performed as in the sixth embodiment. Details of the processing of the parameter adjustment program 2042 will be described later (FIG. 21).

  The design data 2045 stores data determined as design values in advance. In the present embodiment, data that defines what correction each adjustment command applies to each control point, the number of adjustment points (= a plurality of viewpoint positions used for adjustment) that need adjustment, and each adjustment point The position deviation tolerance in FIG. 5 and the position of the control point corresponding to each adjustment point are included.

  FIG. 21 is a diagram for explaining processing of the parameter adjustment program 2042 of this embodiment.

  When the parameter adjustment process is started, first, N, which is the serial number of the adjustment point, is initialized to 0 (S2101), and then the Nth adjustment pattern display process is performed by the same method as S1902 in FIG. Perform (S2102).

  Next, user command input processing is performed (S2103). In the user command input process (S2103), the arithmetic processing unit 211 continues to wait for a command input without proceeding to the next process until any command is input from the user. When any command is input from the user, first, in S2104, it is determined whether or not the input command is an adjustment command. If the result of the determination is an adjustment command, the process proceeds to parameter update processing (S2105). Based on the definition of the input adjustment command and the current adjusted pixel value conversion parameter corresponding to the Nth adjustment point. After updating the adjusted pixel value conversion parameter corresponding to the Nth adjustment point, the process returns to the adjustment pattern display process (S2102) and the process is repeated. Here, the process of the parameter update process (S2105) does not depend on which position on the video display surface 1310 is actually seen, and the adjustment is performed on the set of control points corresponding to the Nth adjustment point. After performing the correction based on the command, the parameter value corresponding to each pixel is determined by the existing interpolation or extrapolation method such as bilinear interpolation from the corrected parameter value for each of the control points. To implement.

  If the determination result is not an adjustment command, it is determined in step S2106 whether the input command is an adjustment completion command. If the determination result is not an adjustment completion command, the process returns to the user command input process (S2103). Repeat the process.

  If the result of the determination is an adjustment completion command, it is determined whether or not adjustment has been completed for all adjustment points that require adjustment (S2107), and if there is an adjustment point that has not yet been adjusted. N, which is the serial number of the adjustment point, is incremented by “1” (S2108), the process returns to the adjustment pattern display process (S2102) and the process is repeated. If the adjustment has been completed for all the adjustment points, the parameter adjustment process is terminated.

  As described above, according to the present embodiment, when the image display system of the light reproduction system is adjusted, an image that allows the user to visually recognize the adjustment point is displayed. An adjustment system that can be adjusted can be provided.

  Note that the essence in this paper is that the pixel value conversion parameters that are actually used are generated by combining from a set of pixel value conversion parameters that allow a video to be satisfactorily viewed at each of a plurality of adjustment positions. It goes without saying that the features described in each embodiment may be used in appropriate combination according to the application.

  As described above, according to the present embodiment, in the video display system that converts and displays the pixel value of the input image based on a given conversion parameter, at each of a plurality of representative viewpoint positions during system adjustment. Conversion parameters for appreciating good images are generated independently, and when the system is operated, conversion parameters synthesized by changing the mixing ratio of these conversion parameters according to the audience distribution and display position etc. Used to convert and display the pixel value of the input image. That is, instead of trying to obtain a theoretically correct conversion parameter at a specific viewpoint position by treating the directivity characteristics independently, as in the past, the conversion parameters corresponding to each representative viewpoint position Assuming that the characteristics related to directivity have already been factored in, it is possible to generate and use a plausible conversion parameter by a simpler method in accordance with the distribution of the viewpoint position for viewing the video.

  For this reason, in a video display system in which video can be viewed at a plurality of viewpoint positions, when the appearance of the video varies greatly depending on the video viewing position, the quality of the video felt by the viewer is improved at a lower cost. be able to.

The figure explaining the video display system in a 1st embodiment. The figure explaining the detail of the video display system in 1st Embodiment. The figure explaining the detail of the image correction apparatus 300 in 1st Embodiment. FIG. 6 is a diagram illustrating a method for expressing a pixel value conversion parameter 323 according to the first embodiment. The figure explaining the process of the parameter update program 242 in 1st Embodiment. The figure explaining the video display system in 2nd Embodiment. The figure explaining the detail of the video display system in 2nd Embodiment. The figure explaining the data structure of the visitor data 732 in 2nd Embodiment. The figure explaining the process of the parameter update program 742 in 2nd Embodiment. The figure explaining the image correction apparatus in 3rd Embodiment. The figure explaining the video display system in 4th Embodiment. The figure explaining the detail of the video display system in 4th Embodiment. The side view for demonstrating the video display method of the video display apparatus in 5th Embodiment. The top view for demonstrating the video display method of the video display apparatus in 5th Embodiment. The figure explaining the video display system in 5th Embodiment, and its adjustment system. The figure explaining the process of the parameter generation program 1541 in 5th Embodiment. The figure explaining the process of the parameter adjustment program 1542 in 5th Embodiment. The figure explaining the video display system and its adjustment system in 6th Embodiment. The figure explaining the process of the parameter adjustment program 1842 in 6th Embodiment. The figure explaining the video display system in 7th Embodiment, and its adjustment system. The figure explaining the process of the parameter adjustment program 2042 in 7th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Adjustment position 110 Screen 120 Audience distribution detection part 130 Horizontal projection range of one projector 140 Audience 1310 Video display surface 1320 Lens array 1411 Rectangular area 1412 Pixel 1421 Lens

Claims (4)

A video generator that outputs video for presentation to the user;
A correction unit that corrects and outputs the video output from the video generation unit based on a pixel value conversion parameter stored in a parameter storage unit;
A display unit having a light beam controller for displaying an image output from the correction unit;
A first storage unit for storing a first pixel value conversion parameter for obtaining a good correction result at the first adjustment position;
A second storage unit for storing a second pixel value conversion parameter for obtaining a good correction result at the second adjustment position;
A parameter combining unit that calculates a third pixel value conversion parameter using the first and second pixel value conversion parameters and stores the third pixel value conversion parameter in the parameter storage unit;
A command input unit for inputting a selection command for selecting an adjustment position and a correction command for correcting the first or second pixel value conversion parameter;
A command control unit that controls the video display system according to the command input from the command input unit,
The command control unit
When the first adjustment position is selected by the selection command, a video obtained by correcting the first image with the first pixel value conversion parameter is output from the correction unit,
When the second adjustment position is selected by the selection command, a video obtained by correcting the second image with the second pixel value conversion parameter is output from the correction unit,
When the correction command is input, after the correction input from the command input unit to the pixel value conversion parameter corresponding to the adjustment position selected by the selection command, Calculating the third pixel value conversion parameter in the parameter combining unit using the first and second pixel value conversion parameters, and storing the third pixel value conversion parameter in the parameter storage unit;
Video display system. The first image appears bright when observed at the first adjustment position and appears dark when observed at other positions;
2. The video display system according to claim 1, wherein the second image looks bright when observed at the second adjustment position and dark when photographed at another position. A video generator that outputs video for presentation to the user;
A correction unit that corrects and outputs the video output from the video generation unit based on a pixel value conversion parameter stored in a parameter storage unit;
A display unit having a light beam controller for displaying an image output from the correction unit;
In an adjustment system for adjusting brightness and / or hue of an image displayed by an image display system comprising:
A parameter generation unit for generating a first pixel value conversion parameter for obtaining a good correction result at the first adjustment position and a second pixel value conversion parameter for obtaining a good correction result at the second adjustment position;
A parameter combining unit that calculates a third pixel value conversion parameter using the first and second pixel value conversion parameters and stores the third pixel value conversion parameter in the parameter storage unit;
With
The parameter generation unit is configured to include an imaging unit whose position and orientation are fixed, and an orientation control unit that controls the position and orientation of the display unit with respect to the imaging unit,
The posture control unit outputs a video for specifying each of the adjustment positions from the correction unit, and the position and posture of the display unit with respect to the photographing unit so that a desired image is photographed by the photographing unit. To control,
An adjustment system characterized by. A video generator that outputs video for presentation to the user;
A correction unit that corrects and outputs the video output from the video generation unit based on a pixel value conversion parameter stored in a parameter storage unit;
A display unit having a light beam controller for displaying an image output from the correction unit;
The adjustment system of an image displayed on the video display system, adjust the brightness or shade, or both comprise,
A parameter generation unit for generating a first pixel value conversion parameter for obtaining a good correction result at the first adjustment position and a second pixel value conversion parameter for obtaining a good correction result at the second adjustment position;
A parameter combining unit that calculates a third pixel value conversion parameter using the first and second pixel value conversion parameters and stores the third pixel value conversion parameter in the parameter storage unit;
With
The parameter generation unit includes an imaging unit, and an attitude control unit that controls a position and an attitude of the imaging unit with respect to the display unit,
The posture control unit outputs a video for specifying each of the adjustment positions from the correction unit, and the position and posture of the photographing unit with respect to the display unit so that a desired image is photographed by the photographing unit. To control,
An adjustment system characterized by.

Images