JP2004004357A - Image pick up apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image pick up apparatus which can obtain a wide range picture from pictures photographed by a plurality of cameras, correct picture differences between the cameras in a relatively short period of time, and acquire a high quality image. <P>SOLUTION: The image pick up apparatus comprises the plurality of cameras 1. The cameras 1 are arranged so that imaging areas of the adjacent cameras 1 are contiguous with or overlap each other. Each camera 1 has an identical reference material 11 within the imaging area. The whole of a picture photographed by each camera 1 is corrected using a picture in which the reference material 11 is photographed by each camera 1. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an imaging device capable of capturing a wide range such as all directions and all circumferences.
[0002]
[Prior art]
As is well known, various cameras have been developed in which a large number of video cameras are housed in a single housing and images are taken in all directions or all around at the same time.
[0003]
As one of the methods, there has been proposed a method of eliminating parallax (parallax) occurring between a plurality of cameras by virtually matching imaging viewpoints using, for example, mirrors arranged in a polygonal pyramid shape. (See US Pat. No. 6,115,176).
[0004]
FIG. 12 shows a schematic configuration diagram of an example of an imaging apparatus having a configuration using mirrors arranged in a polygonal pyramid shape as described above.
This imaging apparatus includes eight plane mirrors 54 arranged in a polygonal pyramid shape, in this case, an octagonal pyramid shape, and cameras 51 arranged one by one so as to face each plane mirror 54. FIG. 12 shows two plane mirrors 54 and two cameras 51 on the vertical plane passing through the center line of the imaging device.
Each camera 51 is provided with a lens 52 and an image sensor 53, and the camera 52 is configured by attaching the lens 52 to a camera body (not shown) in which the image sensor 53 and other components are stored.
[0005]
In this image pickup apparatus, an angle-of-view end ray 56A at the top of the angle of view, an angle-of-view end ray 56B at the bottom of the angle of view, and a ray passing on the lens optical axis 57 are reflected by the mirror 54 and enter the lens 52, An image is formed on the image sensor 53.
[0006]
Then, in the plurality of cameras 51, the parallax can be suppressed by substantially matching the virtual viewpoint center 55 by the plane mirror 54. As a result, images from a plurality of cameras 51 are pasted together to obtain an image in a wide range such as all directions or all around.
[0007]
Further, since the incident angle of the light beam passing through the lens optical axis 57 to the plane mirror 54 is 45 degrees, the light beam passing through the lens optical axis 57 is horizontally incident on the plane mirror 54 and is reflected by the plane mirror 54. The light enters the lens 52 in the vertical direction.
[0008]
[Problems to be solved by the invention]
Conventionally, in the case where a wide angle of view is photographed with a plurality of cameras 51 and the photographed images are connected to form a continuous single image, there is a difference in brightness and color tone between the cameras 51, so that the At the seams of the joints.
[0009]
It is possible to correct such a difference in the image at the seam of the images so that there is no unnaturalness if sufficient time is taken.
[0010]
However, for example, when a moving image such as a video is captured, the time required for the correction becomes enormous, so that it is difficult to obtain a high-quality image in which the joints of the images are corrected in a short time, for example, in a time almost near real time. Met.
[0011]
In order to solve the above-described problem, in the present invention, it is possible to obtain a wide range of images from images captured by a plurality of cameras, and to correct a difference between images of each camera in a relatively short time. An object of the present invention is to provide an imaging device capable of obtaining a high-quality image.
[0012]
[Means for Solving the Problems]
The imaging apparatus of the present invention includes a plurality of cameras, and a plurality of cameras are arranged so that imaging regions of adjacent cameras are adjacent to or overlap with each other, and each camera is provided with the same reference material in the imaging region. The correction of the entire image captured by each camera is performed using the image captured by each camera of the reference material.
[0013]
According to the configuration of the imaging device of the present invention described above, by providing the same reference material in the imaging region of each camera, an image of the reference material is reflected in the image of each camera. Then, by correcting the entire image photographed by each camera using the image photographed by each camera using the reference material, the images photographed by all the cameras are stuck together at the joints without any discomfort.
[0014]
The imaging apparatus of the present invention includes a plurality of cameras, and a plurality of cameras are arranged so that the imaging regions of the adjacent cameras overlap each other. Each of the cameras has at least a portion where the imaging region overlaps with the adjacent camera. The same reference material is provided, and correction is performed on the entire image captured by each of the adjacent cameras using the image captured by each camera, and further, the entire image captured by all the cameras is captured. Correction is performed.
[0015]
According to the above-described configuration of the imaging device of the present invention, each camera is provided with the same reference material at least in a portion where the imaging region overlaps with the adjacent camera, so that the image of each camera can be captured. An image of the reference material is reflected in a portion where the regions overlap and the images overlap. Then, correction is performed on the entire image captured by the adjacent camera using the image captured by each camera with the reference material, so that the overlapping portion of the image captured by the adjacent camera is referenced. Is corrected, and the images captured by the adjacent cameras can be stuck together at the joint without any discomfort. At this time, since these images have the same ray state, although they overlap each other, the correction can be performed easily and relatively easily.
Further, the correction of the entire image captured by all cameras is performed, so that the images captured by all cameras are stuck together at the seams.
[0016]
BEST MODE FOR CARRYING OUT THE INVENTION
The present invention is configured by providing a plurality of cameras, a plurality of cameras are arranged so that the imaging regions of adjacent cameras are adjacent to or overlap each other, each camera is provided with the same reference material in the imaging region, This is an imaging device in which the entire image captured by each camera is corrected using the image captured by the camera of the reference material.
[0017]
Further, according to the present invention, in the above-described imaging apparatus, a mirror is provided to face each camera.
[0018]
Further, according to the present invention, in the above-described imaging apparatus, the reference material is configured by a reference plate provided on a surface of a mirror.
[0019]
The present invention includes a plurality of cameras, and a plurality of cameras are arranged so that the imaging regions of adjacent cameras overlap with each other. Each of the cameras has at least the same portion at which the imaging region overlaps with the adjacent camera. A reference material is provided, and correction is performed on the entire image captured by each of the adjacent cameras using an image obtained by capturing the reference material by each camera, and further, the entire image captured by all cameras is corrected. This is an imaging device.
[0020]
Further, according to the present invention, in the above-described imaging apparatus, a mirror is provided to face each camera.
[0021]
Further, according to the present invention, in the above-described imaging apparatus, the reference material is configured by a reference plate provided on a surface of a mirror.
[0022]
FIG. 1 is a schematic configuration diagram of an imaging apparatus according to an embodiment of the present invention. FIG. 1 is a cross-sectional view in a vertical plane passing through the center line of the imaging device.
[0023]
This imaging apparatus includes eight plane mirrors 4 arranged in a polygonal pyramid shape, in this case, an octagonal pyramid, and a camera 1 arranged one by one so as to face each plane mirror 4. FIG. 1 shows two plane mirrors 4 and two cameras 1 on a vertical plane passing through the center line of the imaging device.
Each camera 1 is provided with a lens 2 and an image sensor 3, and the camera 1 is configured by attaching the lens 2 to a camera body (not shown) that houses the image sensor 3 and the like.
[0024]
The incident light beam is reflected by the mirror 4 and enters the lens 2 to form an image on the image sensor 3.
[0025]
Then, in the plurality of cameras 1, parallax can be suppressed by substantially matching the virtual viewpoint center (not shown) by the plane mirror 4. As a result, images from a plurality of cameras 1 are pasted together to obtain an image in a wide range such as omnidirectional or entire circumference.
[0026]
In the imaging device of the present embodiment, a chart (reference plate) 11 is provided on a surface below the mirror 4.
Thus, the chart 11 is photographed at the lower angle β in the vertical angle of view θ of the camera 1, and the image reflected by the mirror 4 is photographed at the other angle α.
[0027]
FIG. 2 is a plan view of each mirror 4 of the imaging device shown in FIG.
As shown in FIG. 2, one mirror 4 is formed in a trapezoidal shape, and a chart (reference plate) 11 is provided in a portion 4A below the broken line on the surface.
[0028]
The chart (reference plate) 11 is used as a reference material for performing correction so as to eliminate discomfort at a joint when all (eight in the present embodiment) images of the camera 1 are connected to form a wide-range image. It is provided.
Therefore, the chart (reference plate) 11 provided on each mirror 4 is the same so that the three elements of color (lightness, saturation, hue) are equal.
For example, each chart 11 may be formed by dividing a plate on which colors and surface conditions are uniformly formed.
[0029]
3A to 3D show specific forms of the chart 11 in the imaging device shown in FIG.
[0030]
FIG. 3A shows a chart 11 by providing charts (reference plates) 11A and 11B on the outer side of the portion 4A of the mirror 4 shown in FIG. Since the chart 11 (11A, 11B) is provided outside the portion 4A, the chart 11 (11A, 11B) is provided in a portion where an imaging area overlaps with an adjacent camera, that is, in a portion where an image overlaps (hereinafter, referred to as an image overlap portion). Become.
Note that each of the charts 11A and 11B does not necessarily have to have a dimensional shape consistent with the range of the image overlapping portion as long as the chart includes at least the image overlapping portion.
[0031]
FIG. 3B divides each of the charts 11A and 11B shown in FIG. 3A into a chart (reference plate) of three colors of red R, green G and blue B, respectively. This makes it possible to perform more detailed correction as compared with the case where the charts 11A and 11B are of a single color.
[0032]
FIG. 3C shows a chart (reference plate) 11 (11C) provided inside the portion 4A of the mirror 4 shown in FIG. That is, the chart 11 is provided mainly in a portion other than the image overlapping portion.
Thus, even if the chart 11 is provided in a portion other than the image overlapping portion, the image of each camera 1 can be corrected.
[0033]
FIG. 3D shows an overall chart obtained by combining the charts 11A and 11B of FIG. 3A and the chart 11C of FIG. 3C. This enables various correction methods.
The inner chart 11C may be the same color as the outer charts 11A and 11B, or may be a different color. Further, the inner chart 11C or the outer charts 11A and 11B may be divided into different colors like R, G and B in FIG. 3B.
[0034]
FIG. 4 is a diagram showing one form of a more specific chart.
The inner chart 11C is divided into two left and right charts 11D and 11E having different colors.
The outer charts 11A and 11B are, for example, white.
In the inner chart 11C, the right chart 11D is, for example, black, and the left chart 11E is, for example, gray.
[0035]
In this embodiment, since the charts 11A, 11B, 11C, and 11D having different lightness such as white, gray, and black are provided, for example, it is possible to optimize the correction corresponding to a very bright image and a dark image, respectively. become.
It is also effective for more strict color matching including gamma characteristic correction.
[0036]
As the chart (reference plate) 11, a light diffusion chart (reference plate) is preferably used.
If the chart 11 is not light-diffusing, the chart 11 may illuminate and the image taken of the chart 11 may change, which complicates the calculation of the correction of the image taken by the plurality of cameras 1. Can be considered.
By using the light-diffusing chart 11, it is possible to prevent the chart 11 from illuminating and changing the color of the image, and to easily correct images captured by the plurality of cameras 1 with relatively simple calculations. Can have the advantages.
[0037]
The use of a matte chart makes it easy to construct a light-diffusing chart.
For example, a matte white chart can be used.
[0038]
Next, a method of correcting an image captured by the camera 1 using the chart 11 as a reference will be described.
Here, a method of correcting using the chart 11 provided in the image overlapping portion will be described.
[0039]
FIG. 5A is a diagram illustrating a state in which images captured by each camera 1 of the imaging apparatus according to the present embodiment are connected. FIG. 5B is a diagram in which images of the adjacent cameras 1 are vertically arranged for explanation. In FIG. 5B, images C1, C3, C5, and C7 (images of odd-numbered cameras 1) arranged below images C2, C4, C6, and C8 (images of even-numbered cameras 1) arranged as indicated by thick arrows. 5A).
5A and 5B, the image overlapping portions 13 of the images C1 to C8 of the respective cameras 1 are indicated by oblique lines.
In the images C1 to C8 of the cameras 1 shown in FIGS. 5A and 5B, an image above the horizontal line corresponds to the portion of the angle α in FIG. 2, and a portion below the horizontal line (region 14) corresponds to the angle β in FIG. This is an image corresponding to the portion, that is, an image showing the chart 11.
[0040]
First, by displacing each camera 1 by an appropriate amount in a direction indicated by an arrow 12 in FIG. 1 (a direction substantially coinciding with the vertical direction V) from a position (omitted in the drawing) where the center of the lens viewpoint completely coincides, an image overlapping portion is obtained. 13 can be generated.
At this time, the amount by which each camera 1 is shifted is set within a range in which parallax of an image captured by each camera 1 can be suppressed to a level that causes no problem.
[0041]
Here, in FIG. 5B, the correction of the image C1 of the first camera and the image C2 of the second camera will be considered.
In the image overlapping portions 13 of the images C1 and C2 of the adjacent cameras, the regions 15 and 16 in which the chart 11 is photographed are emitted from the subject by using the chart 11 having the light diffusing property. It can be considered that almost the same ray of light is captured.
[0042]
Therefore, as shown in FIG. 6, the entirety of the images C1 and C2 of the adjacent cameras is set so that the pixels at the positions P1 and P2 having the same coordinates in the region 15 and the region 16 have the same pixel value (RGB value). By converting the pixel data of (1), an image in which the joint between the images C1 and C2 is not noticeable can be obtained.
[0043]
The above conversion of the pixel data can be performed, for example, as follows.
If the pixel value of the position P1 of the image C1 of the first camera is RGB (175, 156, 171), and the pixel value of the position P2 of the image C2 of the second camera is RGB (173, 173, 156). Then, first, the R value of each pixel of the image C2 of the second camera is multiplied by a coefficient of 175/173, the G value is multiplied by 156/173, and the B value is multiplied by 171/156.
Subsequently, the second camera (image C2) and the third camera (image C3), the third camera and the fourth camera (image C4), the fourth camera and the fifth camera (image C5), The same processing is sequentially performed for the fifth camera and the sixth camera (image C6), the sixth camera and the seventh camera (image C7), and the seventh camera and the eighth camera (image C8).
When a series of processing is completed and the pixel value of the image overlapping portion 13 of the image C8 of the eighth camera and the image C1 of the first camera is significantly different, the error is distributed to the image overlapping portions 13 of all the cameras 1. Perform processing. Specifically, for example, the eighth root (1 / 8th power) of the ratio of the pixel value of the image overlapping unit 13 between the image C1 of the first camera and the image C8 of the eighth camera is calculated by the first camera. For example, a process of sequentially multiplying from the image C1 is considered.
In this way, it is possible to alleviate the variation among the cameras 1 and suppress occurrence of a sense of incongruity at a joint between images.
[0044]
The specific processing method for converting image data is not limited to the above-described method, and a conventionally known arithmetic processing method can be used.
Furthermore, as for the algorithm of the luminance adjustment and the hue adjustment based on the video signal information of the chart 11, various conventionally known methods can be adopted.
[0045]
Further, the video signal information of the chart 11 may be temporarily recorded (stored) in a computer or the like, and then color correction may be performed.
Further, the correction value calculated in real time based on the video signal information of the chart 11 can be used by reflecting it on the R gain, G gain, B gain, and the like of the camera 21.
[0046]
On the other hand, when correcting the image of each camera 1 based on a chart (11C in FIG. 3C) provided in a portion other than the image overlapping portion 13, a method of sequentially converting the images by the adjacent cameras described above may be used. Although it is possible, a method of performing batch conversion so that the images C1 to C8 of all the cameras 1 are matched is also possible.
When the conversion is performed collectively in this way, for example, the pixel value of the portion where the chart of the image of any one camera is captured is matched with the pixel value of the portion where the chart of the image of another camera is captured, for example, a specific value. A conversion method is conceivable in which a pixel value of a portion where a chart of an image of all cameras is captured is matched with a pixel value.
[0047]
According to the above-described embodiment, since the same chart (reference plate) 11 is provided below each mirror 4, an image obtained by photographing the chart 11 appears in the images C <b> 1 to C <b> 8 of each camera 1. .
Then, video signal information obtained by photographing the same chart 11 is compared between the images C1 to C8 of the cameras 1, and based on the result of the comparison, the entire image data of the images C1 to C8 of each camera 1 is converted. be able to. For example, by comparing the images of the adjacent cameras 1, the image data of the entire image of the adjacent camera can be converted based on the result of the comparison.
By converting the image data and adjusting the brightness and the color tone of the images C1 to C8 of the respective cameras 1, the image data can be easily converted by a relatively simple calculation to correct the image. As a result, it is possible to obtain a smooth wide-angle image with no discomfort at the joint between the images C1 to C8.
[0048]
In particular, when the chart 11 is provided at least in a portion corresponding to the image overlapping portion 13 of the images C1 to C8 of the cameras 1, the video signal information obtained by photographing the chart 11 of the image overlapping portion 13 of the images of the adjacent cameras. The comparison can be performed, and the image overlapping portions 13 of the images of the adjacent cameras almost coincide with each other in the ray state, so that the image can be corrected more accurately and the calculation for converting the image data is performed more efficiently. It has the advantage that it can be simplified.
[0049]
Further, according to the present embodiment, since the correction is performed based on the same chart 11, the correction can be performed by a simpler calculation than when the correction is performed from the images of the subjects actually used. Is possible.
This makes it possible to perform the correction in a relatively short time. Further, the image can be corrected with a relatively simple device configuration.
Therefore, the image can be corrected in real time, and high-quality omnidirectional live broadcasting can be performed.
[0050]
Next, as another embodiment of the present invention, a schematic configuration diagram of an imaging apparatus is shown in FIG. FIG. 7 is a cross-sectional view in a vertical plane passing through the center line of the imaging device.
This imaging device includes a plurality of cameras 21 arranged radially. FIG. 7 shows two cameras 21 in a vertical plane passing through the center line of the imaging device.
Each camera 21 is provided with a lens 20 and an image sensor (not shown) having the same configuration, and the angle of view of each camera 21 is also substantially the same.
[0051]
The incident light beam enters the lens 20 of the camera 21 and forms an image on the image sensor.
Then, images taken by the plurality of cameras 21 are pasted together to obtain an image in a wide range such as an entire circumference.
[0052]
In the imaging apparatus according to the present embodiment, a reference member 22 that is a reference for correcting an image captured by each camera 21 is provided in an optical path ahead of the lens 20 of the camera 21.
This reference material 22 may be arranged in the image overlapping portion or may be arranged in a portion other than the image overlapping portion. Of course, they may be arranged over both.
[0053]
In the configuration of the present embodiment, since there is no mirror between the camera 21 and the subject, if the angle of view of the camera 21 is widened, the image overlapping portion can be obtained even if the camera 21 is not shifted from the position where the center of the lens viewpoint substantially coincides. Can be formed. For example, when shooting 360 ° with four cameras 21, the angle of view of each camera may be wider than 90 °.
[0054]
FIGS. 8 and 9 show the arrangement of the reference material 22 in a configuration in which the four cameras 21 radially cover the entire imaging range (360 °).
FIG. 8 shows a case where the reference material 22 is arranged in the image overlapping portion, and FIG. 9 shows a case where the reference material 22 is arranged in a portion other than the image overlapping portion.
In FIG. 8, two reference materials 22 are provided for each camera 21 in order to cover each image overlapping portion with the adjacent cameras 21.
In FIG. 9, one reference material 22 is provided for each camera 21.
[0055]
In the imaging device according to the present embodiment, for example, the form shown in FIGS. 10A and 10B can be used as reference material 22.
In FIG. 10A, one horizontally long reference material 22 is provided. The reference material 22 is divided into three colors of R, G, and B as in FIG. 3B.
In FIG. 10B, two vertically long reference members 22 are provided corresponding to the image overlapping portion with the adjacent camera 21. Each reference material 22 is divided into three colors of R, G, and B as in FIG. 3B.
Note that the reference material 22 may be divided into colors other than the three colors in these modes, or may be a single-color reference material 22.
[0056]
FIG. 11 shows a modified configuration of the imaging apparatus according to the embodiment shown in FIG. In the configuration shown in FIG. 11, a reference member 23 is attached to the front of the camera 21.
With this configuration, since the reference member 23 is attached to the camera 21, there is an advantage that the imaging device can be made smaller than when the reference member 22 is disposed in front of the camera 21 as shown in FIG. 7. .
[0057]
As described above, in the imaging apparatus having a configuration that does not use a mirror, a reference filter using a light transmission type filter can be used as the reference materials 22 and 23 instead of a chart (reference plate).
When the reference filter is used, it is more preferable to arrange in the image overlapping portion as shown in FIG. 8 than to arrange in the portion other than the image overlapping portion as in FIG. This is because, by arranging in the image overlapping portion, the light transmitted through the reference filter of each image overlapping portion in the adjacent cameras becomes substantially the same, so that the correction becomes easier.
[0058]
According to the above-described embodiment, by providing the same reference material 22 in front of each camera 21 or attaching the same reference material 23 to the front surface thereof, the image of each camera 21 can be obtained. An image of the reference material 22 or 23 is reflected.
Then, the video signal information obtained by photographing the same reference material 22 or 23 is compared with the image of each camera 21, and based on the result, the pixel data of the entire image of each camera 21 is converted, and the luminance of the image is converted. And color tone can be adjusted.
As a result, as in the previous embodiment, it is possible to easily perform image data conversion with a relatively simple operation to correct the image, and to realize a smooth wide-angle image without a sense of incongruity at the seam of the images. Is obtained.
[0059]
Further, according to the present embodiment, since the correction is performed based on the same reference materials 22 and 23, the correction is performed from the images obtained by actually photographing the subjects, as in the previous embodiment. The correction can be performed by a simpler calculation than in the case.
This makes it possible to perform the correction in a relatively short time. Further, the image can be corrected with a relatively simple device configuration.
Therefore, the image can be corrected in real time, and high-quality omnidirectional live broadcasting can be performed.
[0060]
It should be noted that even in an image pickup apparatus using a mirror, a reference filter can be used when a reference material is provided other than on the surface of the mirror (on the subject side of the mirror, between the mirror and the camera, and in front of the camera). is there.
[0061]
In each of the above-described embodiments, the images of the cameras 1 and 21 each have an image overlapping portion, that is, the imaging regions of the adjacent cameras overlap each other. If a configuration in which the chart (reference plate) 11 and the same reference material 22 are provided is adopted, correction is similarly performed using an image of the chart 11 or the reference material 22 even when the imaging regions of adjacent cameras are adjacent to each other. be able to. For example, in a case where four cameras are radially arranged, the angle of view of each camera is 90 °, and the imaging area of each camera is adjacent to each other, and 360 ° of the entire circumference is photographed, the same correction is performed according to the present invention. Can be.
[0062]
Further, in each of the above-described embodiments, the present invention is applied to a case where a plane mirror is provided or a case where no mirror is provided. However, the present invention can be widely applied to other configurations.
[0063]
For example, the present invention can be applied to a case where a curved mirror having a curved surface such as a paraboloid or a hyperboloid is arranged in place of a plane mirror to constitute an imaging device.
In this case, a plurality of cameras are arranged to face each other on the mirror surface of the curved mirror so that the imaging areas of adjacent cameras are adjacent or overlap.
[0064]
Also, in each of the above-described embodiments, the case where the optical axis in the object space of the imaging region of each camera is on the same plane, for example, all the cameras are slightly upward or downward from the horizontal. In the case where the optical axis is in the object space of the imaging region of each camera (for example, the optical axis is on the side surface of the cone in this case), the present invention can be similarly applied.
[0065]
Furthermore, in each of the above-described embodiments, the optical axis in the object space of the imaging area of each camera is horizontal and the central axis of the entire imaging apparatus is vertical V. The central axis of the whole may be a horizontal direction or another direction. Also in that case, the imaging areas of the adjacent cameras are configured to be adjacent or overlap.
[0066]
Furthermore, in each of the above-described embodiments, a configuration in which a plurality of cameras capture an image of 360 °, that is, the entire circumference of a band-shaped area, is described. However, in the present invention, a plurality of cameras partially capture the entire circumference. (For example, 120 °, 180 °, 240 °, etc.).
[0067]
The present invention is not limited to the above-described embodiment, and may take various other configurations without departing from the gist of the present invention.
[0068]
【The invention's effect】
According to the present invention described above, it is possible to correct the image of each camera as a whole based on an image obtained by photographing the same reference material, and adjust the brightness and color tone of the image of each camera.
As a result, the image can be easily corrected by a relatively simple calculation, and a video having a smooth wide angle of view without a sense of incongruity at the joint of the images can be obtained.
Therefore, according to the present invention, a high-quality image can be obtained in a wide range without discomfort at the joint of images.
[0069]
Further, according to the present invention, it is possible to perform the correction with a simpler calculation than in the case where the correction is performed from the images obtained by actually photographing the subjects, so that the correction can be performed in a relatively short time. Will be possible. Further, the image can be corrected with a relatively simple device configuration.
Therefore, the image can be corrected in real time, and high-quality omnidirectional live broadcasting can be performed.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of an imaging device according to an embodiment of the present invention.
FIG. 2 is a plan view of each mirror of the imaging device in FIG. 1;
3A to 3D are diagrams showing forms of the chart of FIG. 1;
FIG. 4 is a diagram showing another form of the chart of FIG. 1;
FIG. 5 is a diagram illustrating a method of correcting images of cameras A and B.
FIG. 6 is a diagram illustrating a method of correcting an image of each camera.
FIG. 7 is a schematic configuration diagram of an imaging apparatus according to another embodiment of the present invention.
FIG. 8 is a plan view in the case where a reference material is provided in an image overlapping portion of each camera in the imaging device of FIG. 7;
9 is a plan view in a case where a reference material is provided in a portion other than an image overlapping portion of each camera in the imaging device in FIG. 7;
10A and 10B are diagrams showing a form of a reference material in the imaging device of FIG. 7;
FIG. 11 is a diagram illustrating a modified configuration of the imaging device of FIG. 7;
FIG. 12 is a schematic configuration diagram of an example of an imaging device having a configuration using mirrors arranged in a polygonal pyramid shape.
[Explanation of symbols]
1, 21 camera, 2, 20 lens, 3 image pickup device, 4 mirror, 11 chart (reference plate), 13 image overlapping part, 22, 23 reference material

Claims (6)

It consists of multiple cameras,
A plurality of the cameras are arranged so that the imaging regions of the adjacent cameras are adjacent to or overlap each other,
Each of the above cameras is provided with the same reference material in the imaging area,
An image pickup apparatus, wherein an entire image captured by each camera is corrected using an image captured by each camera of the reference material. The imaging apparatus according to claim 1, wherein a mirror is provided to face each of the cameras. The imaging device according to claim 2, wherein the reference material includes a reference plate provided on a surface of the mirror. It consists of multiple cameras,
A plurality of the cameras are arranged so that the imaging regions of the adjacent cameras overlap each other,
Each of the above cameras is provided with the same reference material at least in a portion where an imaging region overlaps with an adjacent camera,
Correction is performed on the entire image captured by each of the adjacent cameras using the image captured by each of the cameras, and correction is performed on the entire image captured by all the cameras. An imaging device characterized by the above-mentioned. The imaging device according to claim 4, wherein a mirror is provided to face each of the cameras. The imaging device according to claim 5, wherein the reference material is configured by a reference plate provided on a surface of the mirror.

Images