JP2001238229A - Stereoscopic image photographing device and stereoscopic image display device, and stereoscopic image photographing and display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic image photographing device that can photograph and display objects with different depths without causing out of focus. SOLUTION: A focal distance of a variable focus lens 16a is set so that a real image 17a of an object 11a is formed in the vicinity of a lens group 13. The real image 17a of the object 11a in the vicinity of the lens group 13 is photographed with a high resolution. Since a real image 17b' of the object 11b is formed at a position apart from the lens group 13, the object 11b is photographed with a blue. When the focal distance of the lens 16b is set so that the real image 17b of the object 11b is formed in the vicinity of the lens group 13, the real image of the object 11b in the vicinity of the lens group 13 is photographed with a high resolution and the real image of the object 11a apart from the lens group 13 is photographed with a blur. As a result, the two objects 11a, 11b are photographed with a high resolution. Since the distance between the lens group and the objects is not far different from a conventional IP image pickup device, no blur is caused.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image photographing apparatus, a three-dimensional image display apparatus, and a three-dimensional image photographing display system, and more particularly to integral photography (hereinafter referred to as IP) for photographing and displaying a three-dimensional image using a lens group. The present invention relates to a three-dimensional image photographing device, a three-dimensional image display device, and a three-dimensional image photographing and displaying system using the same.

[0002]

2. Description of the Related Art A state in which a stereoscopic image is photographed and displayed by a conventional IP photographing device and a conventional IP display device will be described with reference to FIGS.

FIG. 20 shows a conventional IP photographing apparatus, in which a lens group 9 composed of a plurality of single focus lenses arranged on a plane.
3 and an image sensor 94 arranged on the opposite side of the subject 91 from the lens group 93. Normally, lens group 93
Is configured by arranging hundreds to thousands of small lenses vertically and horizontally, respectively, but for simplification of the drawing, it is illustrated as being constituted by five lenses.

[0004] The inventors of the present invention have invented that there is no reversal of the depth of a stereoscopic image by using a refractive index distribution lens as each single focus lens constituting the lens group 93 in the conventional IP photographing apparatus. (Japanese Unexamined Patent Application Publication No. 10-150
No. 675). The description will be given on the assumption that the lens group 93 in FIG. 20 is also configured using a gradient index lens.

In the conventional IP photographing apparatus, the number of images 95 of the subject equal to the number of lenses constituting the lens group 93 is photographed by the image pickup device 94. The lens group is composed of a gradient index lens, and the light of the subject meanders in the gradient index lens. If the length of the lens is appropriately selected, an erect image 95 of the subject is formed on the image sensor 94. Details of how to select the length of the lens are described in JP-A-10-150675. The position and size of each erect image 95 on the image sensor 94 include information on how the light of the subject 91 travels 92.

FIG. 19 shows a conventional three-dimensional image display device (hereinafter, referred to as a “stereo image display device”).
(Referred to as a conventional IP display device), and includes a lens group 83 composed of a plurality of single focus lenses arranged on a plane, and image display means 84 arranged on the side opposite to the observer 80 when viewed from the lens group 83. . Each single focus lens constituting the lens group 83 is a general convex lens, and the image display means 84
The focal length and the position (distance) with respect to the image display means 84 are adjusted so that the light emitted in step (1) is emitted as parallel light. Usually, the lens group 83 is configured by arranging hundreds to thousands of small lenses vertically and horizontally, but only five lenses are shown to simplify the drawing.

When an image photographed by the image pickup device 94 of the conventional IP photographing apparatus is displayed on the image display means 84 as it is, light having the same traveling direction 82 as the traveling direction 92 of the photographed subject 91 is reproduced. The observer 80 has a subject 91
Since the same light as that emitted from is viewed, a three-dimensional spatial image 81 is viewed at the position where the subject 91 was present without special glasses.

Although the above description is for a single subject, a general image including a plurality of subjects can be taken and displayed.

[0009]

In the conventional IP photographing apparatus described above, the resolution deteriorates as the subject 91 moves away from the lens group 93. Because the lens group 9
If the distance between the lens group 3 and the subject 91 is long, the lens group 94
The size of each erect image 95 taken through the camera becomes smaller, and the image sensor 94 is required to have a higher resolution. However, since the resolution of the image sensor 94 is finite, the erect image is consequently blurred.

As a simple solution, as shown in FIG. 18, a large convex lens 76 is arranged between the subject 71 and the lens group 73 so that a real image of the subject 71 can be set at the position of the lens group 73. Can be In this case, the subject 7
It can be interpreted that the light of the real image 77 is photographed instead of the light of 1. Since the real image 77 is located at the position of the lens group 73, the real image 77 is not photographed small on the image sensor 74, and the resolution does not deteriorate. This is sufficient when photographing one subject.

However, inconvenience arises when photographing a plurality of subjects. Because the focal length of the general convex lens 76 does not change with time, when a real image of one subject is formed on the lens group, a real image of another subject is not formed on the lens group. Because it will blur.

Similarly, in the conventional IP display device described above, the resolution deteriorates as the position at which the aerial image 81 is reproduced moves away from the lens group 83. Because, when the distance between the lens group 83 and the aerial image 81 is long, the size of each erect image 85 displayed through the lens group 83 becomes small, and the image display means 84 is required to have higher resolution. Will be. However, since the resolution of the image display means 84 is limited, the aerial image 81 is consequently blurred and reproduced.

The present invention has been made in view of the above problems, and has as its object to provide a stereoscopic image photographing apparatus capable of photographing a plurality of objects having different depths at a high resolution. It is in. Also, for other purposes,
It is an object of the present invention to provide a three-dimensional image display device that can reproduce any of a plurality of aerial images having different depth positions, that is, even if the position for reproducing the aerial image is far from the lens group, with high resolution. . Another object of the present invention is to provide a stereoscopic image photographing and displaying system which can solve the above-mentioned problems and can reproduce an excellent image even when a plurality of subjects are displayed in an overlapping manner.

[0014]

According to a first aspect of the present invention, there is provided a stereoscopic image photographing apparatus comprising: a lens group including a plurality of single focus lenses arranged on a plane; and an image sensor for photographing light from a subject through the lens group. A varifocal lens disposed between the subject and the lens group, the focal length of which can be changed over time; and the focal length of the varifocal lens is changed over time, through the varifocal lens. And a focal length adjusting means for forming the light from the plurality of subjects into an image in the vicinity of the lens group in a time-division manner.

According to a second aspect of the present invention, there is provided a three-dimensional image display device, comprising: an image display means; a variable focus lens capable of changing a focal length over time; and an arrangement on a plane between the image display means and the variable focus lens. A lens group comprising a plurality of single focus lenses, each of which has a focal length and a distance between the image display means adjusted so that light from the image display means is emitted as parallel light, In response to the display of the image on the image display means, the focal length of the varifocal lens is temporally changed, and a plurality of spatial images based on light from the image display means formed near the lens group. And a focal length adjusting means for reproducing in a time-division manner at different depths.

[0016] The stereoscopic image photographing and displaying system according to claim 3 is
3. The stereoscopic image photographing apparatus according to claim 1, the stereoscopic image display apparatus according to claim 2, and the focal length adjusting means of the stereoscopic image photographing apparatus and the focal length adjusting means of the stereoscopic image displaying apparatus, wherein the stereoscopic image photographing apparatus is controlled. Interlocking means for interlocking the operation of the varifocal lens of the three-dimensional image display device with the operation of the varifocal lens of the three-dimensional image display device, wherein the image display means displays a plurality of images taken by the image sensor in a time-division manner. When the varifocal lens of the three-dimensional image photographing device forms an image of a nearer subject among the plurality of subjects in the vicinity of the lens group, the interlocking means may operate the lens group of the three-dimensional image display device. The operation of the varifocal lens of the three-dimensional image display device is linked so that a spatial image formed in the vicinity is reproduced at a position farther from the lens group.

According to a fourth aspect of the present invention, there is provided a stereoscopic image photographing and displaying system,
In claim 3, from the image captured by the image sensor,
The image processing apparatus further includes an unfocused portion removing unit that extracts only a portion where the subject formed in the vicinity of the lens group of the stereoscopic image capturing device is reflected and supplies the extracted portion to the image display unit.

According to a fifth aspect of the present invention, there is provided a three-dimensional image capturing and displaying system,
5. The image display device according to claim 3, wherein when displaying a plurality of images on the image display means in a time-division manner, a spatial image is reproduced at a position farther from the image display means within a display range of each of the display images. In the case where at least a part of another image overlaps, a hidden surface portion removing means for making the overlapping portion non-light-emitting at the time of displaying the display image is further provided.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A stereoscopic image photographing apparatus according to a first embodiment of the present invention will be described with reference to FIGS. The apparatus shown in FIGS. 1 and 2 includes a lens group 13 composed of a plurality of single focus lenses arranged on a plane, an imaging element 14 arranged on the opposite side of the subjects 11a and 11b from the lens group 13, and a lens. A varifocal lens 16a or 16b disposed on the subject side as viewed from the group 13;
Variable focus lenses 16a, 16b in conjunction with the imaging cycle of
And a focal length adjusting means 18 for adjusting the focal length. The lens group 13 is assumed to be composed of a refractive index distribution lens, similarly to the conventional IP photographing apparatus (FIG. 20). Usually, the lens group 13 is configured by arranging hundreds to thousands of small lenses vertically and horizontally, but only five lenses are shown to simplify the drawing. 1 and 2, the variable focus lenses 16a and 16b are the same, but are denoted by different reference numerals to indicate that they are set to have different focal lengths. As the image pickup device 14, an image pickup tube or a CCD used in a television can be used.

In FIG. 1, the focal length of the varifocal lens 16a is such that the real image 17a of the subject 11a is
Is set so as to form an image in the vicinity of. Lens group 13
Is photographed at high resolution. On the other hand, since the real image 17b 'of the subject 11b can be located at a position away from the lens group 13 by the variable focus lens 16a, the subject 11b is photographed while being blurred.

In FIG. 2, the focal length of the varifocal lens 16b is such that the real image 17b of the subject 11b is
Is set so as to form an image in the vicinity of. Lens group 13
The real image 17b of the subject 11b in the vicinity of the object 11b is photographed at a high resolution, and the
The real image 17a ′ of “a” is photographed with blurring.

When the configuration of FIG. 1 and the configuration of FIG.
The two subjects 11a and 11b are photographed at high resolution by one of the two configurations. Since the distance between the lens group and the subject is not long as in the conventional IP photographing apparatus, no blur occurs.

Hereinafter, specific examples of the varifocal lens and the focal length adjusting means used in this embodiment and each embodiment described later will be described.

As the variable focus lens, for example, a liquid crystal lens utilizing a change in the refractive index of a liquid crystal (IEICE Technical Report, E
D79-30, 1979, 55-61, "Variable focal length nematic liquid crystal lens cell") and the optical surface having a thin structure is mechanically deformed by using an electrostatic force or a small actuator to provide a focal length adjusting function. (OPTRO
NICS, 1999, No. 7, 161-167, “variable focus mirror, variable focus lens”). FIG. 16 shows an example of the former variable focus lens and its focus adjusting means, and FIG. 17 shows an example of the latter variable focus lens and its focus adjusting means.

As shown in FIG. 16, reference numeral 1 denotes a voltage source, 2 denotes a plano-concave lens, 3 denotes a liquid crystal lens, 4 denotes a flat glass, and 5 denotes a spacer. By changing the alignment state of the liquid crystal molecules, the optical properties (such as the focal length) of the liquid crystal are changed.

As shown in FIG. 17, reference numeral 6 denotes an actuator, 7 denotes an output shaft, 8 denotes silicone oil, 9 denotes a glass diaphragm, which constitutes a lens by the silicon oil 8 and the glass diaphragm 9, and comprises a glass diaphragm. By changing the pressure of the silicone oil 8 by applying a force to one side of the lens 9 with the actuator 6, the optical surface of the lens can be mechanically deformed and the focal length can be adjusted. The variable focus lens as shown in FIGS. 16 and 17 can change its focal length at high speed. Therefore, shooting is not limited to still image shooting, and moving image shooting can be performed. That is, as described above, the focal length of the varifocal lens 11 is controlled at high speed in synchronization with the imaging timing of the imaging plate 5 based on the focal length information of the varifocal lens 11 at each photographing, so that each time , A clear real image of each subject can be taken.

Next, a stereoscopic image display apparatus according to a second embodiment of the present invention will be described with reference to FIGS. The apparatus shown in FIGS. 3, 4, and 5 includes a lens group 23 composed of a plurality of single focus lenses arranged on a plane, and an image display element 24 arranged on the side opposite to the observer 20 when viewed from the lens group. A variable focus lens 26a or 26b disposed on the observer 20 side as viewed from the lens group, and a variable focus lens 26a linked with the display cycle of the image display element 24.
focal length adjusting means 28 for adjusting the focal lengths of a and 26b
Consists of Each single focus lens constituting the lens group 23 is a general convex lens, as in the conventional IP display device (FIG. 19), so that light emitted from the image display element 24 is emitted as parallel light. Its focal length and position have been adjusted.

Normally, the lens group 23 is constituted by arranging hundreds to thousands of small lenses vertically and horizontally, but only five lenses are shown to simplify the drawing. Figures 3 and 4
, The variable focus lenses 26a and 26b are the same, but are denoted by different reference numerals to indicate that they are set to have different focal lengths. Image display element 24
For example, a CRT or a plasma display for displaying television images can be used.

In FIG. 3, on the image display element 24,
An image such that the aerial image 27a is reproduced at the position of the lens group 23 is displayed. This image is obtained by forming a real image 77 of the subject 71 at the position of the lens group 73 by the convex lens 76 and photographing the real image 77 by the image sensor 74 through the lens group 73 as shown in FIG. Further, an equivalent image may be generated by computer graphics. The real image 21a of the aerial image 27a reproduced on the lens group 23 by the varifocal lens 26a is shown in FIG.
And the observer 20 looks at the reproduced real image 21a. As described in the section of the problem to be solved by the invention, the spatial image 2 formed near the lens group 23
Since 7a has a high resolution, the real image 21a is also reproduced at a high resolution.

In FIG. 4, on the image display element 24,
An image is displayed such that the aerial image 27b is reproduced at the position of the lens group 23. The method of generating the image is the same as the method of generating the image in FIG. 3, and in the apparatus of FIG.
The photographing should be performed according to 4. The real image 21b of the spatial image 27b reproduced on the lens group 23 by the varifocal lens 26b is reproduced at the position shown in FIG.
Looks at the reproduced real image 21b. Since the spatial image 27b formed near the lens group 23 has a high resolution, the real image 21b is also reproduced at a high resolution.

Here, when the state shown in FIG. 3 and the state shown in FIG. 4 are switched at a cycle shorter than the afterimage time of the human eye, two real images 21a and 21b are displayed to the observer 20 as shown in FIG. Looks like The two spatial images 21a and 21b at different depths are both reproduced at high resolution.

In the apparatus of this embodiment, the aerial images 21a, 21a
When the observer 20 and the observer 20 are arranged in a straight line, the spatial image 21b in front of the observer 20 and the distant spatial image 21a appear to be mixed, so that the position of the subject does not overlap with the spatial images as seen from the observer. Must be considered. This problem has been solved in an apparatus according to a fifth embodiment described later.

Next, a stereoscopic image photographing and displaying system according to a third embodiment of the present invention will be described with reference to FIGS. 6, 7, and 8. FIG. The system of FIGS. 6, 7, and 8 includes a stereoscopic image photographing apparatus according to a first embodiment of the present invention and a second embodiment of the present invention.
And a variable focus lens 16a (16b) and 26a in each of the two devices.
A focal length interlocking device 38 for interlocking the operation of (26b) is provided. Portions common to the stereoscopic image photographing device of the first embodiment and the stereoscopic image display device of the second embodiment are denoted by the same reference numerals as those in FIGS. The focal length interlocking device 38 includes the focal length adjusting means 18 or 28 as described above.

FIG. 6 shows that the varifocal lens 16a is
The state where the real image 17a of 1a is controlled to form an image in the vicinity of the lens group 13 is shown. At this time, the focal length interlocking device 38 controls the focal length of the varifocal lens 26a so that the lens group 23 and the reproduced image 31a have an image forming relationship. In this state, the image 39a captured by the image sensor 14
Is exactly the same as what the device of FIG. 1 captures. That is, the real image 17a of the subject 11a is photographed with high resolution, and the real image 17b 'of the subject 11b is photographed with blurring. The photographed image 39a is directly input to the image display device 24 and displayed. As a result, the spatial image 27a corresponding to the subject 11a is reproduced at the position of the lens group 23 with high resolution, and the real image 31a can be brought to the position shown in FIG. 6 by the variable focus lens 26a. on the other hand,
The spatial image 27b 'corresponding to the subject 11b is
The image is reproduced with a more blur on the observer 30 side, and the real image is formed at the position 31b 'by the variable focus lens 26a. The observer 30 looks at two real images 31a and 31b 'from the variable focus lens 26a. In FIG. 6, the real image 31b '
The thin drawing indicates that the image is blurred.

Next, the focal length of the varifocal lens 16a is changed, and the varifocal lens 16b after the change is
Is formed near the lens group 13 (FIG. 7). At this time, the varifocal lens 2 is
6a is also changed, and the varifocal lens 2 after the change is changed.
By 6b, the lens group 23 and the reproduced image 31b are controlled so as to form an imaging relationship. In this state, the image 39b captured by the image sensor 14 is exactly the same as that captured by the apparatus in FIG. That is, the real image 17b of the subject 11b is photographed with high resolution, and the real image 17a 'of the subject 11a is photographed with blurring. The photographed image 39b
Is input to the image display device 24 as it is and displayed. As a result, the spatial image 27b corresponding to the subject 11b
Is reproduced at the position of the lens group 23 with high resolution, and the real image can be formed at the position of 31b by the varifocal lens 26b. On the other hand, the spatial image 27a 'corresponding to the subject 11a is reproduced with a blur on the side opposite to the observer 30 when viewed from the lens group 23, and the real image 31a' can be set at the position shown in FIG. . Observer 30
Are two real images 31b and 3 by the varifocal lens 26b.
Look at 1a '. In FIG. 7, the thin drawing of the real image 31a 'indicates that the image is blurred.

Here, when the state shown in FIG. 6 and the state shown in FIG. 7 are switched at a cycle shorter than the afterimage time of the human eye, the observer 30 looks as shown in FIG. The finally reproduced aerial image of the subject 11a is a superimposed aerial image 31a 'with a blurred aerial image 31a'. Similarly, the finally reproduced aerial image of the subject 11b is a superimposed aerial image 31b 'with a blurred aerial image 31b'. When the depths of the subjects 11a and 11b are significantly different, the amount of blur of the aerial image reproduced with blur increases, so that the blurred aerial images 11a 'and 11b' cannot be seen by the observer 30. As a result, the observer 30 sees only the high-resolution aerial images 11a and 11b. As described above, the system according to the present embodiment is effective as a method for reproducing a spatial image that is not blurred when the depths of the subjects are largely different.

Next, a stereoscopic image photographing and displaying system according to a fourth embodiment of the present invention will be described with reference to FIGS. 9, 10 and 11. The stereoscopic image capturing and displaying system according to the present embodiment is a modification of the stereoscopic image capturing and displaying system according to the third embodiment. The image captured by the image sensor 14 is not displayed on the image display element 24 as it is, After performing image processing by the defocusing device 48, the image display element 24
This is displayed as. Other configurations are the same as those of the stereoscopic image capturing and displaying system of the third embodiment.
Portions common to the stereoscopic image capturing and displaying system of the third embodiment are denoted by the same reference numerals as in FIGS.

FIG. 9 shows that the variable focus lens 16a is
The state where the real image 17a of 1a is controlled to form an image in the vicinity of the lens group 13 is shown. At this time, the focal length interlocking device 38 controls the focal length of the varifocal lens 26a so that the lens group 23 and the reproduced image 41a are in an imaging relationship. In this state, the image 39a captured by the image sensor 14
Is exactly the same as what the device of FIG. 1 captures. That is, the real image 17a of the subject 11a is photographed with high resolution, and the real image 17b 'of the subject 11b is photographed with blurring.

The photographed image 39a is subjected to image processing by the unfocused portion removing device 48, and the image 49a after the image processing is displayed on the image display element 24. The out-of-focus portion removing device 48 keeps the portion of the real image 17 a formed near the lens group 13 in the input image 39 a as it is, and the real image 17 not formed near the lens group 13.
b is removed (the image display device 24 to be connected later)
This is an apparatus that performs image processing such as not emitting light. Image 49a after passing through out-of-focus portion removing device 48 (real image 17)
(only a is shown) is input to the image display device 24 and displayed. As a result, the spatial image 27a corresponding to the subject 11a is reproduced with high resolution at the position of the lens group 23, and the real image 41a can be formed at the position shown in FIG. 9 by the varifocal lens 26a. On the other hand, since the aerial image corresponding to the subject 11b has been removed by the out-of-focus portion removing device 48, it is not reproduced. The observer 40 looks at the real image 41a from the variable focus lens 26a.

Next, the focal length of the varifocal lens 16a is changed, and the varifocal lens 16b after the change is
Is formed near the lens group 13 (FIG. 10). At this time, the focal length of the variable focal length lens 26a is also changed by the focal length interlocking device 38, and the lens group 23 and the reproduced image 41b are controlled by the changed variable focal length lens 26b so as to form an imaging relationship. In this state, the image sensor 14
Image 39b is exactly the same as the image captured by the apparatus of FIG. That is, the real image 17b of the subject 11b
Is photographed with high resolution, and the real image 17a 'of the subject 11a is photographed with blurring.

The photographed image 39b is the image 3
Similarly to 9a, image processing is performed by the out-of-focus part removing device 48. Image 4 after passing through unfocused portion removing device 48
9b (only the real image 17b is shown) is input to the image display device 24 and displayed. As a result, the subject 11
The aerial image 27b corresponding to b is reproduced at the position of the lens group 23 with high resolution, and the real image 41b can be brought to the position shown in FIG. On the other hand, since the spatial image 27a 'corresponding to the subject 11a has been removed by the out-of-focus part removing device 48, it is not reproduced. The observer 40 looks at the real image 41b by the variable focus lens 26b.

Here, when the state shown in FIG. 9 and the state shown in FIG. 10 are switched in a cycle shorter than the afterimage time of the human eye, the observer 40 looks as shown in FIG. Finally, the subject 11a is reproduced as a high-resolution spatial image 41a, and the subject 11b is reproduced as a high-resolution spatial image 41b. In the system according to the present embodiment, similarly to the apparatus according to the second embodiment, when the spatial images 41a and 41b and the observer 40 are arranged in a straight line, the spatial image 4
Since 1b and the distant spatial image 41a appear to be mixed, the position of the subject must be considered so that a plurality of spatial images do not overlap as viewed from the observer. This problem is discussed in the fifth section below.
This is solved in the device of the embodiment.

Next, a stereoscopic image photographing and displaying system according to a fifth embodiment of the present invention will be described with reference to FIGS. The stereoscopic image capturing and displaying system according to the present embodiment is obtained by modifying the stereoscopic image displaying unit of the stereoscopic image capturing and displaying system according to the fourth embodiment. The image processing is performed by a hidden surface part removing device described later. Other configurations are the same as those of the stereoscopic image capturing and displaying system of the fourth embodiment. Portions common to the stereoscopic image photographing and displaying system of the fourth embodiment are denoted by the same reference numerals as in FIGS.

FIG. 12 shows a state in which the varifocal lens 16a is controlled to form a real image 17a of the subject 11a near the lens group 13. Since the configuration of this system is the same as the configuration of the system in FIG. 9 until the out-of-focus portion removing device 48 generates the image 49a, the detailed description is omitted. As a result, only the image of the subject 11a appears in the image 49a.

FIG. 13 shows the varifocal lens 16a in the system of FIG. 12 in which the focal length of the varifocal lens 16a has been changed.
b is controlled to form an image near the lens group 13.
In the configuration of this system, the out-of-focus portion removing device 48 is used.
Is the same as the configuration of the system in FIG. 10 until the image 49b is generated, and a detailed description thereof will be omitted. As a result, only the image of the subject 11b appears in the image 49b.

12 and 13, the images 49a and 49b output from the out-of-focus portion removing device 48 are input to the hidden surface portion removing device 58. Hidden surface removal device 58
Are the varifocal lenses 16a, 1
Information 52 is received as to which focal length is set for 6b and 26a, 26b. Based on the information 52, the image 49a input in the configuration of FIG. 12 is an image reproduced at a position farther from the observer than the image 49b input in the configuration of FIG. The determination can be made in the removing device 58. Based on this determination, the hidden surface part removing device 58 performs the following image processing. Image 49b
Is the observer 5 among the input images 49a and 49b.
Since it is reproduced at a position close to 0, it is output as an image 59b without any processing. Image 59b
In the portion where the subject is shown (in this embodiment, the subject 1
1b) is stored. The image reproduced next to the observer 50 after the image 49b is the image 49a. The hidden surface portion removing device 58 removes a portion where the subject is reflected in the above-described image 59b from the input image 49a (the image display device 24 to be connected later).
The image processing is performed as shown in FIG. (Similarly, the portion where the subject appears in the image 59a is stored, and the portion where the subject appears in the images 59b and 59a is removed from the image reproduced next to the position closest to the observer. In the present embodiment, since the number of states of the varifocal lens is 2, the image processing by the hidden surface part removing device 58 ends when the image 59a is output.)

As a result of the image processing by the hidden surface part removing device 58, in the configuration of FIG. 12, the image of the subject 11a shown in the image 49a is changed from the image of the subject 11b shown in the image 49b.
The image 59a obtained by removing the portion overlapping with the image of FIG. 4 is input to the image display device 24, and the image 59a forms the aerial image 57a at the position of the lens group 23.
The real image 51a is reproduced by 6a, and the observer 50 looks at the reproduced real image 51a. The shape of the real image 51a is different from the shape of the original subject 11a. This is because a portion overlapping the subject 11b has been removed by the hidden surface portion removing device 58.

On the other hand, in the configuration of FIG. 13, the image 49b is input as it is to the image display device 24 as the image 59b.
The image 59b forms an aerial image at the position of the lens group 24. The real image 51b is reproduced by the varifocal lens 26b, and the observer 50 looks at the reproduced real image 51b.

Here, as in the other embodiments, when the state shown in FIG. 12 and the state shown in FIG. 13 are switched at a cycle shorter than the afterimage time of the human eye, the observer 50 can see FIG.
Looks like. Finally, the subject 11a is a high-resolution spatial image 51a, and the subject 11b is a high-resolution spatial image 5a.
1b. Since the portion of the space image 51a covered by the space image 51b has been removed by the hidden surface portion removal device, the two objects 51a, 5a
1b does not appear mixed.

In the description of each of the above embodiments, the focal lengths of the variable focal length lenses 16a, 16b and 26a, 26b are assumed to be in two states by the focal length adjusting means 18 or 28 as described above. The number of states is not limited to two and may be any number greater than two.

In the description of the first, third, fourth and fifth embodiments, the variable focus lens 16a is set so that the real image of the subject 11a can be located at the position of the lens group 13. Similarly, the varifocal lens 16b is connected to the subject 11b.
Is set so that a real image of the lens group can be formed at the position of the lens group 13. In practice, it is not necessary to strictly adjust the parameters of the varifocal lens so that a real image of a specific subject (in this case, the subjects 11a and 11b) can be formed at the position of the lens group 13. The reason will be described with reference to FIG. The apparatus shown in FIG. 15 shows a stereoscopic image photographing device in the stereoscopic image photographing apparatus of the first embodiment or the stereoscopic image photographing display systems of the third, fourth and fifth embodiments. When the varifocal lens 16a is used, an object within the range 61a is photographed without blurring. When the variable focal length lens 16b in which the focal length of the variable focal length lens 16a is changed is used,
The subject within the range 61b is photographed without blurring. Further, if the number of states of the focal length setting of the varifocal lens is set to be sufficiently large, even if there is a subject other than the above, it is possible to take a picture without blurring at any one of the focal length settings. For example, by determining the number of states of the focal length setting so that the range from 2 to ∞m measured from the variable focus lens can be photographed without blurring at any of the focal length settings,
In practice, it can be said that all subjects can be photographed without blurring.

[0052]

As described above, according to the stereoscopic image photographing apparatus of the present invention, a stereoscopic image without blur can be photographed for all of a plurality of subjects having different depths. Further, according to the stereoscopic image display device of the present invention, a plurality of spatial images having different depths can be reproduced without blurring. Furthermore, according to the stereoscopic image photographing and displaying system of the present invention, it is possible to photograph a stereoscopic image without blur for all of a plurality of subjects having different depths and reproduce a spatial image of those subjects without blurring.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a stereoscopic image photographing apparatus according to a first embodiment of the present invention.

FIG. 2 is another diagram illustrating the stereoscopic image photographing apparatus according to the first embodiment of the present invention.

FIG. 3 is a diagram illustrating a stereoscopic image display device according to a second embodiment of the present invention.

FIG. 4 is another diagram illustrating a stereoscopic image display device according to a second embodiment of the present invention.

FIG. 5 is still another diagram illustrating the stereoscopic image display device according to the second embodiment of the present invention.

FIG. 6 is a diagram illustrating a stereoscopic image capturing and displaying system according to a third embodiment of the present invention.

FIG. 7 is another diagram illustrating a stereoscopic image capturing and displaying system according to a third embodiment of the present invention.

FIG. 8 is still another diagram for explaining the stereoscopic image photographing and displaying system according to the third embodiment of the present invention.

FIG. 9 is a diagram illustrating a stereoscopic image photographing and displaying system according to a fourth embodiment of the present invention.

FIG. 10 is another diagram illustrating a stereoscopic image capturing and displaying system according to a fourth embodiment of the present invention.

FIG. 11 is still another diagram illustrating the stereoscopic image capturing and displaying system according to the fourth embodiment of the present invention.

FIG. 12 is a diagram illustrating a stereoscopic image photographing and displaying system according to a fifth embodiment of the present invention.

FIG. 13 is another diagram illustrating a stereoscopic image photographing and displaying system according to a fifth embodiment of the present invention.

FIG. 14 is still another diagram illustrating the stereoscopic image capturing and displaying system according to the fifth embodiment of the present invention.

FIG. 15 is a diagram illustrating a state of setting a focal length of a variable focus lens.

FIG. 16 is a diagram illustrating an example of a variable focus lens and a focus adjustment device.

FIG. 17 is a diagram illustrating another example of the variable focus lens and the focus adjustment device.

FIG. 18 is a diagram illustrating an example of an IP imaging apparatus.

FIG. 19 is a diagram illustrating a conventional IP display device.

FIG. 20 is a diagram illustrating a conventional IP photographing apparatus.

[Explanation of symbols]

 11a, 11b Subject 13 Lens group 14 Image sensor 16a Variable focus lens 17a, 17a 'Real image

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Mitsui Yamada 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Corporation Research Institute (72) Inventor Fumio Okano 1-1-10 Kinuta, Setagaya-ku, Tokyo No. 11 Japan Broadcasting Corporation F-Term (in reference) 5C061 AA07 AB03 AB12

Claims (5)

[Claims] 1. A lens group including a plurality of single focus lenses arranged on a plane, an image sensor for photographing light from a subject through the lens group, and a lens group disposed between the subject and the lens group. A varifocal lens capable of changing the focal length over time, and changing the focal length of the varifocal lens over time,
A stereoscopic image photographing apparatus comprising: a focal length adjusting unit configured to form light from a plurality of subjects obtained through the variable focus lens in the vicinity of the lens group in a time-division manner. 2. An image display means, a varifocal lens capable of changing the focal length over time, and arranged on a plane between the image display means and the varifocal lens. A lens group consisting of a plurality of single focus lenses whose focal length and the distance between the image display means are adjusted so that light from the means is emitted as parallel light, and an image on the image display means. In response to the display, the focal length of the varifocal lens is temporally changed, and a plurality of aerial images based on light from the image display means formed in the vicinity of the lens group are respectively time-divided into different depths. A stereoscopic image display device comprising: a focal length adjusting unit for reproducing. 3. The stereoscopic image photographing apparatus according to claim 1, controlling the focal length adjusting means of the stereoscopic image photographing apparatus and the focal length adjusting means of the stereoscopic image displaying apparatus. Interlocking means for interlocking the operation of the varifocal lens of the stereoscopic image photographing device with the operation of the varifocal lens of the stereoscopic image display device, wherein the image display means comprises a plurality of images photographed by the image sensor. Is displayed in a time-division manner. The interlocking means is configured to display the stereoscopic image when the varifocal lens of the stereoscopic image photographing device forms an image of a front object among a plurality of objects in the vicinity of a lens group. A stereoscopic image characterized by interlocking the operation of a varifocal lens of the stereoscopic image display device so that an aerial image formed near the lens group of the device is reproduced at a position farther from the lens group. Shadow display system. 4. The image processing device according to claim 3, wherein only a portion where a subject formed near a lens group of the three-dimensional image photographing device is shown is taken out of the image photographed by the image pickup device and supplied to the image display means. A stereoscopic image photographing and displaying system, further comprising an out-of-focus portion removing unit. 5. The image display device according to claim 3, wherein when displaying a plurality of images on the image display means in a time-division manner, the plurality of images are located within a display range of each of the display images, at a position farther from the image display means. In the case where at least a part of another image in which the aerial image is reproduced overlaps, a hidden surface portion removing unit that makes the overlapping portion non-emission when displaying the display image is further provided. Image shooting and display system.