US20160077315A1 - Compact panoramic camera: optical system, apparatus, image forming method - Google Patents
Compact panoramic camera: optical system, apparatus, image forming method Download PDFInfo
- Publication number
- US20160077315A1 US20160077315A1 US14/854,687 US201514854687A US2016077315A1 US 20160077315 A1 US20160077315 A1 US 20160077315A1 US 201514854687 A US201514854687 A US 201514854687A US 2016077315 A1 US2016077315 A1 US 2016077315A1
- Authority
- US
- United States
- Prior art keywords
- image
- decompression
- lens element
- lens
- optical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 148
- 238000000034 method Methods 0.000 title claims abstract description 28
- 230000006837 decompression Effects 0.000 claims abstract description 83
- 238000007906 compression Methods 0.000 claims abstract description 45
- 230000006835 compression Effects 0.000 claims abstract description 44
- 230000004075 alteration Effects 0.000 claims description 17
- 239000000463 material Substances 0.000 claims description 16
- NIXOWILDQLNWCW-UHFFFAOYSA-N acrylic acid group Chemical group C(C=C)(=O)O NIXOWILDQLNWCW-UHFFFAOYSA-N 0.000 claims description 13
- 239000004033 plastic Substances 0.000 claims description 10
- 229920003023 plastic Polymers 0.000 claims description 10
- 239000006185 dispersion Substances 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 5
- 238000001914 filtration Methods 0.000 claims description 4
- 238000012546 transfer Methods 0.000 claims description 4
- 239000010409 thin film Substances 0.000 claims description 3
- 239000004793 Polystyrene Substances 0.000 claims description 2
- 229920003229 poly(methyl methacrylate) Polymers 0.000 claims description 2
- 239000004417 polycarbonate Substances 0.000 claims description 2
- 229920000515 polycarbonate Polymers 0.000 claims description 2
- 239000004926 polymethyl methacrylate Substances 0.000 claims description 2
- 229920002223 polystyrene Polymers 0.000 claims description 2
- 238000009501 film coating Methods 0.000 claims 1
- 230000005855 radiation Effects 0.000 claims 1
- 238000012986 modification Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 11
- 230000008901 benefit Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000003384 imaging method Methods 0.000 description 9
- 238000012937 correction Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 230000004313 glare Effects 0.000 description 4
- 239000011248 coating agent Substances 0.000 description 3
- 238000000576 coating method Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 241000251468 Actinopterygii Species 0.000 description 2
- 201000009310 astigmatism Diseases 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000006059 cover glass Substances 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000010137 moulding (plastic) Methods 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 206010010071 Coma Diseases 0.000 description 1
- 206010073261 Ovarian theca cell tumour Diseases 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000001839 endoscopy Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000005499 meniscus Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 208000001644 thecoma Diseases 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/06—Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/18—Optical objectives specially designed for the purposes specified below with lenses having one or more non-spherical faces, e.g. for reducing geometrical aberration
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B17/00—Systems with reflecting surfaces, with or without refracting elements
- G02B17/08—Catadioptric systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/08—Mirrors
- G02B5/09—Multifaceted or polygonal mirrors, e.g. polygonal scanning mirrors; Fresnel mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/208—Filters for use with infrared or ultraviolet radiation, e.g. for separating visible light from infrared and/or ultraviolet radiation
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B9/00—Optical objectives characterised both by the number of the components and their arrangements according to their sign, i.e. + or -
- G02B9/12—Optical objectives characterised both by the number of the components and their arrangements according to their sign, i.e. + or - having three components only
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/06—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe involving anamorphosis
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19626—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses
- G08B13/19628—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H04N5/23238—
Definitions
- the decompression lens is positioned to receive the virtual curved and compressed image filtered by the hardware aperture.
- the decompression lens is configured to decompress the virtual curved and compressed image into a real image with a high optical resolution and a desirable image decompression, and project the real image onto an image sensor.
- the image sensor is positioned to receive the real image projected by the decompression lens of the 360-degree panoramic scene.
- FIG. 5 is a convex hyperbolic mirror with an ideal lens of the ideal catadioptric optics.
- FIG. 13 is shows an image spot diagram for twelve vertical view points for the arrangement of FIG. 1 , according to an example embodiment.
- FIG. 27 is a graph of polychromatic diffraction MTF for twelve vertical view points for the arrangement of FIG. 26 , according to an eleventh example embodiment.
- FIG. 33 is a graph of diffraction ensquared energy for the arrangement of FIG. 31 , according to a twelfth example embodiment.
- FIG. 34 shows an image of spot diagram for twelve vertical view points for the arrangement of FIG. 31 , according to a twelfth example embodiment.
- FIG. 39 is a depiction of field curvature and distortion graphs for the arrangement of FIG. 31 with a flat image sensor, according to a thirteenth example embodiment.
- the compact panoramic camera optics includes two main optical components.
- the first optical component is a catadioptric optical element (COE).
- COE catadioptric optical element
- the COE includes a convex reflector incorporated into a refractive lens between a first and a second refractive surface.
- the COE as a result, has three optical surfaces: two refractive (dioptric) surfaces and one reflective (catoptric) surface.
- the second optical component is a decompression lens.
- the decompression lens is made of at least one lens element (e.g., one lens element, three single lens elements (singlets), etc.), each having aspheric optical surfaces.
- the decompression lens 23 includes three lens elements: a first lens element, shown as first negative lens element 24 , a second lens element, shown as positive lens element 26 , and a third lens element, shown as second negative lens element 28 .
- the decompression lens 23 includes at least one lens element (e.g., one, two, etc.).
- the first negative lens element 24 has at least one high order aspheric surface.
- the high order aspheric surface(s) of the first negative lens element 24 may be structured to have a negative optical power, expand bundles of rays, and partially correct field aberrations.
- the focal length of the first negative lens element 24 is minus 5.6 mm.
- a virtual curved and compressed image 19 with a specific compression is created.
- the virtual curved and compressed image 19 of the object space points of the scene is created behind the convex reflector 18 (e.g., due to the negative focal length as mentioned above, etc.).
- the virtual curved and compressed image 19 takes on the aspheric compression (e.g., hyperbolic compression, etc.) of the high order convex aspheric surface of the convex reflector 18 (e.g., hyperbolic mirror, etc.).
- FIG. 4 a graph of the panoramic field curvature 400 and a graph of the f-theta distortion/image compression 402 with the convex reflector 18 structured as a parabolic mirror, an ideal telecentric lens 27 , and an ideal camera lens 29 for the system of FIG. 3 are shown.
- the field curvature becomes a significant issue (see, e.g., FIG. 6 ) that needs to be corrected to achieve the flat field shown in the graph of the panoramic field curvature 400 .
- the system has the benefit of 20.7% decompression from the center to the edge of the mirror.
- the parabolic mirror systems are capable of providing even higher decompression ranging from 23% up to 25%. This may be desirable as the edge of the mirror covers the most pixels and hence results in higher digital resolution of the resultant image.
- FIG. 11 a graph of polychromatic Huygens MTF for twelve vertical viewpoints of the compact panoramic camera system 10 is shown according to an example embodiment.
- the range of the image contrast here is slightly higher than the MTF data in FIG. 8 , which may be calculated with some approximation by using the fast Fourier transform.
- FIG. 17 shows an alternative optical system layout according to a second example embodiment.
- the second embodiment is a modification of the first embodiment in that the convex reflector 18 is mounted using a cylindrical window 39 . Interior to the cylindrical window 39 is the convex reflector 18 , a spike 35 , and a baffle 36 .
- the convex reflector 18 may be of hyperbolic structure with a diameter of 20.1 mm and the image sensor 32 may have a diameter of 4.6 mm. Thus the convex reflector to image sensor ratio may be 4.4:1.
- the spike 35 may be disposed along the vertical optical axis 12 and extend at least partially into the interior of the baffle 36 . The spike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera.
- the baffle 36 is a mechanical system, whose function is to shield the light coming from sources outside the field of view (FOV) of the compact panoramic camera.
- FOV field of view
- the acrylic cone window 40 acts as a refractive surface as the light travels through it, as well as adds support to the mounting of the convex reflector 18 .
- the housing 41 is used to contain the light trap diaphragm 42 .
- the light trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through the hardware aperture 22 .
- FIG. 21 shows an alternative compact panoramic camera according to a sixth example embodiment.
- the sixth embodiment is a modification of the first embodiment in that the embodiment includes an optical system with EVFOV of 80 degrees: 30 degrees up and 50 degrees down from the horizon.
- the convex reflector 18 has a diameter of 24.2 mm and the image sensor 32 has a diameter of 4.6 mm.
- the convex reflector to image sensor ratio is 5.3:1.
- the overall length of the optical system of FIG. 21 is 51.2 mm. In other embodiments, the overall length of the optical system of FIG. 21 is greater or lesser than 51.2 mm.
- the two refractive surfaces may be a variety of shapes (e.g., linear, parabolic, hyperbolic, aspheric, etc.).
- the spike 35 may be disposed along the vertical optical axis 12 and extend at least partially into the interior of the housing 41 .
- the spike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera.
- the housing 41 is used to contain the light trap diaphragm 42 .
- the light trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through the hardware aperture 22 .
- the convex reflector 18 has a diameter of 27.8 mm and the image sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 6.2:1.
- FIG. 25 shows an alternative compact panoramic camera according to a tenth example embodiment.
- the tenth embodiment is a modification of the first embodiment in that this embodiment includes an optical system with EVFOV of 80 degrees: 40 degrees up and 40 degrees down from the horizon, a spike 35 , an acrylic cone window 40 , a housing 41 , and a light trap diaphragm 42 .
- the spike 35 may be disposed along the vertical optical axis 12 and extend at least partially into the interior of the housing 41 .
- the spike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera.
- the acrylic cone window 40 acts as a refractive surface as the light travels through it, as well as adds support to the mounting of the convex reflector 18 .
- the first surface 46 and the second surface 47 of the decompression lens 23 of FIG. 31 have different aspheric shapes.
- the first surface 46 may include a diffractive optical structure on a top of its aspheric surface.
- the first surface 46 and the second surface 47 are capable of effectively correcting chromatic aberrations and all field aberrations except field curvature, as well as decompress the virtual image compression created by the convex reflector 18 .
- the first surface 46 of the single lens element of the decompression lens 23 may be coated by a thin film IR cut-off filter, which blocks the light wavelengths starting approximately from 680 nm and up.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Lenses (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
An optical system, apparatus, and method for sensing 360-degree horizontal and wide vertical field of view are shown. Powerful optics creates high resolution decompressed images on an image sensor. The compact panoramic camera includes two major optical components: (i) an axially symmetric convex aspheric reflector incorporated into a catadioptric optical element capable of providing a virtual curved image of a 360-degree panoramic scene with a specific image compression and (ii) a decompression lens with hardware aperture. The decompression lens is comprised of three single lens elements and accepts the virtual curved and compressed image and projects it onto the image sensor with high optical resolution and desirable image decompression to achieve a high digital resolution at the same time. Another version of decompression lens is comprised only of a single lens element and projects high resolution decompressed images onto an image sensor.
Description
- This application claims the benefit of and priority to U.S. Provisional Patent Application No. 62/050,725, filed Sep. 15, 2014, which is incorporated herein by reference in its entirety.
- There are many panoramic imaging cameras and optical systems that use a variety of refractive and reflective optical components. The space of wide angle persistent visual imaging may be broadly segmented into single camera systems (e.g., fisheye and catadioptric systems) and multiple camera systems. Single camera systems are able to see a wider than usual field of view by introducing distortions in visual field in the form of a field compression function. One method uses wide field of view refractive-only optics (e.g., fish-eye lenses) to acquire a wide swath of the visual field around a camera. Refractive-only optics present a unique challenge when it comes to maintaining uniform (or minimum) quality at all points in the field of view. This is because the field-compression methods provided by refraction only are quite limited. At the same time, the field compression function of fish eye lenses is computationally complex and not fully reversible. Field compression by lenses alone also comes with a huge toll in terms of weight. The need for high-refractive dense meniscus lenses may alone drive the weight of the system up by an order of magnitude as compared with catadioptric systems.
- Catadioptric optical systems may include one or more concave and/or convex mirrors and one or more refractive lens elements, usually placed behind the mirrors. These optical systems have been developed to achieve a super-wide-angle field of view and a wide range of field compression functions are possible with this method.
- One embodiment relates to a compact panoramic camera for sensing 360-degree field of view having a rotational axis of symmetry. The compact panoramic camera includes a convex reflector, a hardware aperture, and a decompression lens. The convex reflector has an axially symmetric aspheric surface. The convex reflector is configured to provide a virtual curved and compressed image of a 360-degree panoramic scene with a specific image compression. The hardware aperture is configured to filter out light rays other than those reflected directly from the convex reflector to provide a desirable compact object space viewpoint for prospective mapping of sensing images. The hardware aperture is positioned a distance from the convex reflector at or in a vicinity of a geometrical focus of the convex reflector. The decompression lens is positioned to receive the virtual curved and compressed image filtered by the hardware aperture. The decompression lens is configured to decompress the virtual curved and compressed image into a real image with a high optical resolution and a desirable image decompression, and project the real image onto an image sensor. The image sensor is positioned to receive the real image projected by the decompression lens of the 360-degree panoramic scene.
- Another embodiment relates to a system for a compact panoramic camera having an image sensor. The system includes a convex reflector and a decompression lens. The convex reflector has an axially symmetric aspheric surface that provides a virtual curved and compressed image of a panoramic scene with a non-parabolic image compression. The decompression lens is positioned to receive the virtual curved and compressed image. The decompression lens is configured to decompress the virtual curved and compressed image into a real image with a high optical resolution and a parabolic image decompression, and project the real image onto the image sensor.
- Still another embodiment relates to a method for compressing and decompressing an image with high resolution. The method includes receiving, by a catadioptric optical element, light ray bundles from a scene; compressing, by the catadioptric optical element, the light ray bundles into a virtual curved and compressed image with a non-parabolic compression; reflecting, by the catadioptric optical element, the virtual curved and compressed image onto a hardware aperture; filtering out, by the hardware aperture, light rays other than those reflected by the catadioptric optical element; receiving, by a decompression lens, the virtual curved and compressed image from the hardware aperture; decompressing, by the decompression lens, the virtual curved and compressed image into a real image; and projecting, by the decompression lens, the real image onto an image sensor.
- Yet another embodiment relates to a decompression lens for use with a non-parabolic mirror and an image sensor in a catadioptric optical system. The decompression lens includes at least one lens element positioned to receive a virtual curved and compressed image in a non-parabolic compression format from the non-parabolic mirror. The at least one lens element is configured to decompress the virtual curved and compressed image into a real image with a high optical resolution and a parabolic type of decompression, and project the real image onto the image sensor.
- Advantages and features of the embodiments of this disclosure will become more apparent from the following detailed descriptions of example embodiments when viewed in conjunction with the accompanying drawings.
-
FIG. 1 is an optical system layout of a compact panoramic camera, according to an example embodiment. -
FIGS. 2A and 2B show a schematic and flow chart of a method of image compression and decompression, according to an example embodiment. -
FIG. 3 is an ideal convex parabolic mirror based catadioptric optic. -
FIG. 4 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 3 . -
FIG. 5 is a convex hyperbolic mirror with an ideal lens of the ideal catadioptric optics. -
FIG. 6 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 5 . -
FIG. 7 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 8 is a graph of polychromatic diffraction MTF for twelve vertical view points for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 9 is a graph of polychromatic diffraction MTF for horizon points for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 10 is a graph of diffraction ensquared energy for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 11 is a graph of polychromatic Huygens MTF for twelve vertical view points for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 12 is a graph of the relative illumination across the vertical field of view for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 13 is shows an image spot diagram for twelve vertical view points for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 14 is shows a lateral color graphs for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 15 is shows an instantaneous field of view (IVOF) graphs for the arrangement ofFIG. 1 , according to an example embodiment. -
FIG. 16 shows a system block diagram of a panoramic camera, according to an example embodiment. -
FIG. 17 is an alternative mirror mount by using a cylindrical window, according to another example embodiment. -
FIG. 18 is an alternative mirror mount by using a central strut and an acrylic plate, according to a third example embodiment. -
FIG. 19 is an alternative mirror mount by using a central strut and an acrylic plate protected by an acrylic truncated cone window, according to a fourth example embodiment. -
FIG. 20 is an alternative optical system layout with a housing, a hood, a spike and a diaphragm, according to a fifth example embodiment. -
FIG. 21 is a compact panoramic camera with EVFOV 80 degrees: 30 degrees up and 50 degrees down from horizon, according to a sixth example embodiment. -
FIG. 22 is a compact panoramic camera with EVFOV 80 degrees: 40 degrees up and 40 degrees down from horizon, according to a seventh example embodiment. -
FIG. 23 is a compact panoramic camera with EVFOV 85 degrees: 45 degrees up and 40 degrees down from horizon, according to an eighth example embodiment. -
FIG. 24 is a compact panoramic camera with EVFOV 80 degrees: 40 degrees up and 40 degrees down from horizon and a COE with an alternative shape, according to a ninth example embodiment. -
FIG. 25 is a compact panoramic camera with EVFOV 80 degrees: 40 degrees up and 40 degrees down from horizon with a central spike, housing, a protective cone window, and a light trap diaphragms, according to a tenth example embodiment. -
FIG. 26 is a compact panoramic camera with EVFOV 80 degrees: 15 degrees up and 65 degrees down from horizon, according to an eleventh example embodiment. -
FIG. 27 is a graph of polychromatic diffraction MTF for twelve vertical view points for the arrangement ofFIG. 26 , according to an eleventh example embodiment. -
FIG. 28 is a graph of diffraction ensquared energy for the arrangement ofFIG. 26 , according to an eleventh example embodiment. -
FIG. 29 shows an image of spot diagram for twelve vertical view points for the arrangement ofFIG. 26 , according to an eleventh example embodiment. -
FIG. 30 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 26 , according to an eleventh example embodiment. -
FIG. 31 is a compact panoramic camera with EVFOV 80 degrees: 15 degrees up and 65 degrees down from horizon, according to a twelfth example embodiment. -
FIG. 32 is a graph of polychromatic diffraction MTF for twelve vertical view points for the arrangement ofFIG. 31 , according to a twelfth example embodiment. -
FIG. 33 is a graph of diffraction ensquared energy for the arrangement ofFIG. 31 , according to a twelfth example embodiment. -
FIG. 34 shows an image of spot diagram for twelve vertical view points for the arrangement ofFIG. 31 , according to a twelfth example embodiment. -
FIG. 35 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 31 , according to a twelfth example embodiment. -
FIG. 36 is a graph of polychromatic diffraction MTF for twelve vertical view points for the arrangement ofFIG. 31 with a flat image sensor, according to a thirteenth example embodiment. -
FIG. 37 is a graph of diffraction ensquared energy for the arrangement ofFIG. 31 with a flat image sensor, according to a thirteenth example embodiment. -
FIG. 38 shows an image of spot diagram for twelve vertical view points for the arrangement ofFIG. 31 with a flat image sensor, according to a thirteenth example embodiment. -
FIG. 39 is a depiction of field curvature and distortion graphs for the arrangement ofFIG. 31 with a flat image sensor, according to a thirteenth example embodiment. - Referring to figures generally, a compact panoramic camera with an optical system, apparatus, and image forming methods are shown. The system presented in the following disclosure may be used to provide a compact (i.e., miniaturized) panoramic camera with powerful optics and high resolution imaging. Compact may mean the total volume of the camera is three cubic inches or less. Powerful optics may mean that the camera has an optic aperture of f/2.8 or higher. High resolution imaging may mean that the camera has a polychromatic diffraction modulation transfer function (MTF) 30% or more for 150 cy/mm. Other qualities, dimensions, power levels, and resolution levels may be provided according to varying embodiments. The claims are not limited to any particular size, power, or resolution unless so expressly limited in the claims. The techniques are suitable for applications in teleconferencing, robotics vision, unmanned vehicles, medical endoscopy, or any other similar applications where it may be important to acquire live video imaging, not along, but perpendicular to the optical axis.
- The compact panoramic camera optics includes two main optical components. The first optical component is a catadioptric optical element (COE). According to an example embodiment, the COE includes a convex reflector incorporated into a refractive lens between a first and a second refractive surface. The COE, as a result, has three optical surfaces: two refractive (dioptric) surfaces and one reflective (catoptric) surface. The second optical component is a decompression lens. According to an example embodiment, the decompression lens is made of at least one lens element (e.g., one lens element, three single lens elements (singlets), etc.), each having aspheric optical surfaces. With this design, a compact aspheric primary mirror structure, flat image surface field due to field curvature correction, and conversion of an aspheric image compression to a parabolic decompression may be achieved altogether. All of which may result in a compact panoramic camera with a powerful optical system comprising at most four optical elements, which may be made from a total of two plastic materials and provide high resolution images. The mirror design may also allow the reduction of its diameter by one-third or more of previously designed mirrors, and also decrease the camera volume to one-tenth of alternate systems.
- Referring now to
FIG. 1 , an optical system layout of a compact panoramic camera is shown, according to an example embodiment. According to the example embodiment shown inFIG. 1 , anoptical system 10 includes two main optical components: a catadioptric optical element (COE) 14 and adecompression lens 23. Theoptical system 10 may further include ahardware aperture 22, acover glass 30, and animage sensor 32. All of the optical elements of theoptical system 10 are shown as centered relative to a verticaloptical axis 12, which is the axis of symmetry. According to the example embodiment shown inFIG. 1 , theCOE 14 includes three optical surfaces: a first optical surface, shown as firstrefractive surface 16, a second optical surface, shown asconvex reflector 18, and a third optical surface, shown as secondrefractive surface 20. In one embodiment, the firstrefractive surface 16 is structured as an ellipsoidal refractive surface (i.e., an ellipsoidal lens). The advantage of the ellipsoidal surface over a spherical surface may be a flattenbarrel edge 15, which may allow theCOE 14 to be removed from a mold form relatively easier if the method of fabrication used to construct theCOE 14 is plastic molding. In other embodiments, the firstrefractive surface 16 is another shape (e.g., spherical, hyperbolic, parabolic, or high order aspheric). In one embodiment, theconvex reflector 18 has a convex hyperbolic surface. In other embodiments, theconvex reflector 18 has another shape (e.g., high order aspheric shape, spherical, parabolic, etc.). In one embodiment, the secondrefractive surface 20 is a spherical refractive surface (i.e., a spherical lens). In other embodiments, the secondrefractive surface 20 is another shape (e.g., aspheric, hyperbolic, parabolic, etc.). - According to an example embodiment, the
COE 14 has a maximum diameter of 32.4 millimeters (mm) and a focal length of minus 5.0 mm. Thus, theoptical system 10 may create a virtual curved andcompressed image 19 of object space points positioned behind the convex reflector 18 (i.e., indicated by the negative focal length). In other embodiments, the diameter and focal length of theCOE 14 are another size and length (e.g., a 30 mm diameter and a minus 3.5 mm focal length, etc.). The other surfaces ofCOE 14, such as the flattenbarrel edge 15, are mechanical surfaces which may be used to facilitate mounting theCOE 14 within a camera housing (not shown) and/or to thedecompression lens 23. - According to the example embodiment shown in
FIG. 1 , thedecompression lens 23 includes three lens elements: a first lens element, shown as firstnegative lens element 24, a second lens element, shown aspositive lens element 26, and a third lens element, shown as secondnegative lens element 28. In other embodiments, thedecompression lens 23 includes at least one lens element (e.g., one, two, etc.). According to an example embodiment, the firstnegative lens element 24 has at least one high order aspheric surface. The high order aspheric surface(s) of the firstnegative lens element 24 may be structured to have a negative optical power, expand bundles of rays, and partially correct field aberrations. In one embodiment, the focal length of the firstnegative lens element 24 is minus 5.6 mm. In other embodiments, the focal length of the firstnegative lens element 24 is at least one of greater, lesser, and positive. According to an example embodiment, thepositive lens element 26 has high order aspheric surfaces with a relatively strong positive optical power. The high order aspheric surfaces of thepositive lens element 26 may be structured to converge bundles of rays and partially correct field aberrations. In one embodiment, the focal length of thepositive lens element 26 is positive 3.9 mm. In other embodiments, the focal length of thepositive lens element 26 is at least one of greater, lesser, and negative. According to an example embodiment, the secondnegative lens element 28 has high order aspheric surfaces. Due to the secondnegative lens element 28 being in such close proximity to theimage sensor 32, the aspheric surfaces of the secondnegative lens element 28 may effectively correct image compression, field curvature, and residual field aberrations through cooperation with the aspheric surfaces of the firstnegative lens element 24 and thepositive lens element 26. In one embodiment, the secondnegative lens element 28 is structured to have a negative optical power with a focal length of minus 3.2 mm. In other embodiments, the focal length is at least one of greater, lesser, and positive. - The lens element(s) of the
decompression lens 23 may be made cost effectively from plastic materials using plastic molding technology. The firstnegative lens elements 24 and the secondnegative lens element 28 may be made from high dispersion plastic materials such as at least one of Polystyrene, Polycarbonate, and Rexolite. According to an example embodiment, the Abbe number for the high dispersion plastic materials is approximately 30. In other embodiments, the Abbe number of the high dispersion plastic materials varies (e.g., greater than or less than 30, etc.) based on the application of theoptical system 10. Thepositive lens element 26 and theCOE 14 may be made from low dispersion optical plastic materials such as at least one of Acrylic, PMMA and Zeone. According to an example embodiment, the Abbe number of the low dispersion plastic materials is slightly less than 60. In other embodiments, the Abbe number varies (e.g., greater than or less than 60, etc.) based on the application of theoptical system 10. Chromatic aberrations (longitudinal and lateral color) may be corrected using these types of optical materials in a wavelength range from blue line 455 nm up to red line 644 nm. It is important to eliminate lateral color in wide-angle optics, which may be done with this specific embodiment (see, e.g.,FIG. 14 ). To further improve color correction, the first surface of the firstnegative lens element 24 may be coated by a thin film infrared (IR) cut-off filter, which blocks the light starting from wavelength 680 nanometers (nm) approximately and up. Another advantage of the IR filter coating is reducing the number of optical elements needed in thesystem 10. Without the IR coating, theoptical system 10 may otherwise require an additional filter placed in a front of theimage sensor 32. In other embodiments, one or more of the lens elements of thedecompression lens 23 and/or one or more of the optical surfaces of theCOE 14 are made from materials other than plastic materials (e.g., glass, etc.). - According to an example embodiment, the effective focal length of the
decompression lens 23 is 6.2 mm. In other embodiments, the focal length is different (i.e., differently structured to receive the virtual curved and compressed image projected by differing catadioptric optical elements) (e.g., longer, shorter, based on the structure of theCOE 14, etc.). In other embodiments, thedecompression lens 23 is comprised of one or more lens elements having a total of one or more aspheric surfaces (e.g., one lens, two lenses, four lenses, etc.). - As shown in
FIG. 1 , thehardware aperture 22 is positioned behind theCOE 14 and in a front of the decompression lens 23 (i.e., between theCOE 14 and the decompression lens 23). In one embodiment, thehardware aperture 22 is positioned at a distance from theCOE 14 such that thehardware aperture 22 is located at or in the vicinity of the geometrical focus of theconvex reflector 18. According to an example embodiment, thehardware aperture 22 is configured to aid in optical image formation; specifying entrance and exit pupils for theoptical system 10 and filtering ray bundles 34 from object points (e.g., filtering out light rays other than those reflected by theconvex reflector 18, etc.). According to an example embodiment, thecover glass 30 is configured to protect the surface of theimage sensor 32 where a real optical image (e.g., a high resolution decompressed image, etc.) is formed. In one embodiment, theimage sensor 32 is a flat (i.e., two-dimensional (2D)) sensing surface. In other embodiments, theimage sensor 32 is curved (i.e., three-dimensional (3D)) (see, e.g.,FIG. 31 ). The process in which a high resolution decompressed image is formed onto theimage sensor 32 is described more fully herein. - According to an example embodiment, the total length of the
optical system 10 is 60 mm. In other embodiments, the total length of theoptical system 10 increases or decreases based on the selection of the structure and dimensional qualities (e.g., focal length, diameter, etc.) of theCOE 14 and/or thedecompression lens 23. The effective vertical field of view (EVFOV) of theoptical system 10, according to an example embodiment, is 70 degrees: 15 degrees up from the horizon and 55 degrees down from the horizon. In other embodiments, the EVFOV ranges between 70 and 90 degrees with a variety of possibilities for degrees up from the horizon and degrees down from the horizon (e.g., EVFOV of 80: 30 degrees up and 50 degrees down from the horizon, EVFOV of 80: 40 degrees up and 40 degrees down from the horizon, EVFOV of 85: 45 degrees up and 40 degrees down from the horizon, etc.). In still other embodiments, the EVFOV of theoptical system 10 is less than 70 degrees. The horizontal field of view of theoptical system 10 may be up to 360 degrees as a result of the axial symmetry of theoptical system 10 about the verticaloptical axis 12. - Referring now to
FIGS. 2A and 2B , amethod 200 to compress and decompress an image with high resolution is shown according to an example embodiment. In one example embodiment,method 200 may be implemented with theoptical system 10 ofFIG. 1 . Accordingly,method 200 may be described in regard toFIG. 1 . - At
process 202, a scene of interest is chosen. For example, a compact panoramic camera with theoptical system 10 may be directed towards attendees and/or a board of a meeting in a conference room for videoconferencing purposes, used as the eye of a robotic apparatus in a robotics competition to aid in the navigation of a course, or any other implementation which may require and/or benefit from a compact panoramic camera with powerful optics and high resolution imaging. Atprocess 204, a primary image collector, such as convex reflector 18 (i.e., a high order convex aspheric mirror) accepts (i.e., receives) light rays from the scene. For example, the ray bundles 34 from object points of the scene mentioned above enter theCOE 14 through the firstrefractive surface 16. The ray bundles 34 refract as they pass through the firstrefractive surface 16 towards theconvex reflector 18. The ray bundles 34 reflect off of the high order aspheric mirrored surface (e.g., a hyperbolic mirrored surface, etc.) of theconvex reflector 18 and leave theCOE 14 through the secondrefractive surface 20. - At
process 206, a virtual curved andcompressed image 19 with a specific compression is created. For example, as the ray bundles 34 reflect off of theconvex reflector 18, the virtual curved andcompressed image 19 of the object space points of the scene is created behind the convex reflector 18 (e.g., due to the negative focal length as mentioned above, etc.). The virtual curved andcompressed image 19 takes on the aspheric compression (e.g., hyperbolic compression, etc.) of the high order convex aspheric surface of the convex reflector 18 (e.g., hyperbolic mirror, etc.). According to an example embodiment, theconvex reflector 18 has a hyperbolic structure, and therefore the virtual curved andcompressed image 19 is of a hyperbolic compression specific to the hyperbolic structure of the mirror surface of theconvex reflector 18. The virtual curved andcompressed image 19 is formed along a curved surface (e.g., hyperbolic, parabolic, etc.). Field curvature correction or elimination to generate an image on a flat surface is a substantially important task in getting high resolution sharp optical images on theimage sensor 32. In other embodiments, the compression of the virtual curved andcompressed image 19 is different depending on the shape of the surface of the convex reflector 18 (e.g., spherical, parabolic, high order aspheric, etc.). For example, if theconvex reflector 18 surface is parabolic in structure, the virtual curved andcompressed image 19 may have parabolic compression and its surface curvature may be two times more than the surface curvature of theconvex reflector 18. - At process 208, the
decompression lens 23 receives the ray bundles 34 which left theCOE 14 through the secondrefractive surface 20, as mentioned above. The virtual curved andcompressed image 19 is projected throughhardware aperture 22 where it is filtered and relayed to thedecompression lens 23. The virtual curved andcompressed image 19 plays the role of the object (i.e., the scene) for thedecompression lens 23. The specifically structuredaspheric lens elements image sensor 32 with high optical resolution and desired decompression (process 210). According to the example embodiment, thedecompression lens 23 receives the virtual curved andcompressed image 19 with hyperbolic compression and projects the image with high resolution and parabolic decompression onto theimage sensor 32. In other embodiments, thedecompression lens 23 receive a differently shaped aspheric compressed image (e.g., parabolic, etc.) and projects an image with high resolution and desired decompression (e.g., parabolic, hyperbolic, etc.) onto theimage sensor 32. According to an example embodiment, the method for compressing and decompressing the light ray bundles is done by optic means with theoptical system 10 without digital image processing (i.e., mechanically, etc.). In alternative embodiments, digital image processing may be used. - Referring to
FIG. 3 , a prior art optics of an idealcatadioptric optics system 100 is shown with theconvex reflector 18 structured as a convex parabolic mirror. The idealcatadioptric optics system 100 also includes an ideal telecentric lens 27, acamera lens 29, and acurved image sensor 33. The telecentric lens 27 is needed when using a pure parabolic mirror. Working together, the telecentric lens 27 and thecamera lens 29 create a real curved image of the ray bundles 34 from the object space points. The telecentric lens 27 and thecamera lens 29 achieve this by projecting the virtual curved and compressed image 19 (not shown inFIG. 3 ) created by the parabolicconvex reflector 18 with some magnification onto thecurved image sensor 33. The magnification is equal to some relationship of the focal length of telecentric lens 27 and thecamera lens 29. The virtual image diameter is equal to diameter of the parabolicconvex reflector 18. In one embodiment, the magnification is less than 1.0 because the focal length of the telecentric lens 27 is more than the focal length of thecamera lens 29. The smaller the magnification, the smaller the diameter of the image on thecurved image sensor 33 relative to the virtual image diameter. Lower magnification oncamera lens 29 enables simpler lens design for field flattening. This results in a higher number for the ratio of the diameter ofconvex reflector 18 to the diameter of thecurved image sensor 33. If the magnification is less than 4.5, it is very difficult, if not impossible, to get a high resolution sharp flat image surface. - When appropriately designed, catadioptric systems (e.g., mirror and lens based systems), like that of
FIG. 3 , offer the best method of single-sensor wide angle persistent imaging. A wide range of field compression functions are possible with this method. The field compression introduced in capture may be fully reversed computationally in the resulting image. The use of mirrors as the primary field compression agents in these systems causes the subsequent refractive elements to have dramatically smaller sizes (i.e., by orders of magnitude in some cases). It is also true for the idealcatadioptric optics system 100 only if the telecentric lens 27 be replaced by a mirror. In this case, thesingle mirror optics 100 may be converted in dual-mirror optics. This may be a distinct advantage when at least one of weight and material cost may be considerations. - Referring to
FIG. 4 , a graph of thepanoramic field curvature 400 and a graph of the f-theta distortion/image compression 402 with theconvex reflector 18 structured as a parabolic mirror, an ideal telecentric lens 27, and anideal camera lens 29 for the system ofFIG. 3 are shown. When used with a flat image sensor, such as theimage sensor 32, as opposed to the idealcurved image sensor 33, the field curvature becomes a significant issue (see, e.g.,FIG. 6 ) that needs to be corrected to achieve the flat field shown in the graph of thepanoramic field curvature 400. The system has the benefit of 20.7% decompression from the center to the edge of the mirror. In other embodiments, the parabolic mirror systems are capable of providing even higher decompression ranging from 23% up to 25%. This may be desirable as the edge of the mirror covers the most pixels and hence results in higher digital resolution of the resultant image. - Implementing systems with field curvature correction using primary parabolic mirrors and obtaining the desirable field compression properties have been done for years. However, challenges remain in delivering systems that are both very high in resolution and simultaneously small and compact. Market demands call for systems incorporating this dichotomy of small size and high resolution. Systems may be implemented which employ sophisticated methods to eliminate third and higher order aberrations including astigmatism, field curvature and milder versions of coma. This may be achieved by using techniques such as building confocal systems to eliminate astigmatism and spherical aberration in pupils, and using the second and higher order aspheric optical surfaces of the mirrors and lens elements to suppress the coma and higher order field aberrations. However, as the overall linear size of the system approaches the sensor linear size, higher order aberrations begin to play a greater role and below certain scale ratios, these aberrations remain uncorrected and detectable by sensor pixels, rendering images unusable, and placing lower limits on the ratio between system and sensor sizes. The use of hyperbolic and other primary mirror shapes may be used to address the above challenges. This idea is discussed more fully herein and an example of the field compression using a hyperbolic primary mirror may be seen in
FIGS. 5-6 . - Referring to
FIG. 5 , a hyperbolicconvex reflector 18 with anideal camera lens 29 of the idealcatadioptric optics system 100 is shown. Theideal camera lens 29 creates a real curved and decompressed image of the ray bundles 34 of the object space points by projecting the virtual curved and compressed image 19 (not shown inFIG. 5 ) created by the hyperbolic structuredconvex reflector 18 with some demagnification onto thecurved image sensor 33. It is the same type of optical system as shown inFIG. 1 with replacement of thedecompression lens 23 with theideal camera lens 29. This example embodiment is shown for comparison of image decompression capabilities between thedecompression lens 23 and theideal camera lens 29. - Referring now to
FIG. 6 , a graph of thepanoramic field curvature 600 and a graph of the f-theta distortion/image compression 602 with theconvex reflector 18 structured as a hyperbolic mirror together with the ideal camera lens 29 (layout shown inFIG. 5 ) are shown. The field compression advantage over a fish eye lens does not meet desired performance characteristics when using this mirror profile together with theideal lens 29. Therefore, to achieve the high performance characteristics of the parabolic mirror based optics system with a hyperbolic mirror based optics system (shown inFIGS. 1 and 5 ), the ideal lens 29 (inFIGS. 3 and 5 ) is replaced with theinventive decompression lens 23 ofFIG. 1 , which is described more fully herein. - Referring now to
FIG. 7 , a graph of the panoramic field curvature 700 and a graph of the f-theta distortion/image compression 702 for theoptical system 10 ofFIG. 1 are shown. To achieve the promise of a compact high resolution wide angle catadioptric optical system, the following features are desirable: a compact aspheric primary mirror, flat field (i.e., low field curvature), and parabolic field compression. Theoptical system 10 uses the same compact, aspheric, non-parabolic primary mirror ofFIG. 5 used to generate the results inFIG. 6 (i.e., a hyperbolic structured convex reflector 18). However, theideal lens 29 and the idealcurved image sensor 33 ofFIG. 5 are replaced with thedecompression lens 23 and theflat image senor 32 ofFIG. 1 . Thenovel decompression lens 23 modifies the field compression function to achieve near parabolic field compression in the resultant image (without using a parabolic mirror). - The field compression characteristic of 20.5% decompression from the center to the edge of the mirror is relatively close to the field compression characteristic of the ideal parabolic mirror based system (20.7% decompression) shown in
FIG. 4 . This results in a high resolution system that mimics the behavior of the parabolic mirror based systems without foregoing the small and compact size consideration. To achieve this objective, the shape of the virtual curved andcompressed image 19 generated by the primary aspheric mirror, theconvex reflector 18, may be analyzed and a field curvature corrector and decompression profile may be generated to design thedecompression lens 23 as shown inFIG. 1 . The lens includes geometries configured to provide field curvature correction, aspheric to parabolic compression conversion, low optic F-stop, and a compact form factor. The combination of the specific optical parameters of theCOE 14 and thelens elements optical system 10 to achieve high optical resolution on theflat image sensor 32 for the visible spectrum of light with F-stop 2.6 in image space. In other embodiments, the above characteristics may vary, resulting in different F-stop numbers (e.g., 2.7, 2.8, 2.9, etc.). In various embodiments, the ratio of the convex reflector diameter to the image diameter may range from approximately 6.5:1 to 2.3:1. - Referring to
FIG. 8 , a graph of the polychromatic diffraction modulation transfer functions (MTF) for twelve vertical view points of the compact panoramic cameraoptical system 10 as compared with a diffraction limited MTF (black curve) are shown according to an example embodiment. As can be seen from the graph, the panoramic imaging system provides resolution of 150 line pairs per millimeter with image contrast (MTF) in a range from 45.9% up to 61.0% across vertical field of view from 35 degrees up to 105 degrees counting up from the verticaloptical axis 12. - Referring to
FIG. 9 , the tangential and sagittal graphs of the modulation transfer function (MTF) for horizon points of the compact panoramic cameraoptical system 10 as compared with a diffraction limited MTF (black curve) for polychromatic light are shown according to an example embodiment. As can be seen from the graphs, the panoramic imaging system provides resolution of 150 line pairs per millimeter with contrast (MTF) about 61.0%. The real limited resolution for the horizon is much higher, specifically 300 cy/mm if the minimum image contrast of 30% is accepted. - Referring to
FIG. 10 , a graph of diffraction ensquared energy (DEE) concentration for twelve vertical view points of the compactpanoramic camera system 10 as compared with a diffraction limited DEE (top curve) are shown according to an example embodiment. The DEE graph illustrates the relative amount of the total light energy collected by a square area 2a by 2a on an image plane from a single object point across the field view, where “a” is a distance in microns from the square center as its marked along the horizontal axis of the graph. The vertical axis indicates a fraction of the ensquared energy. The light energy distribution on an image plane from an object point is described by its point spread function (PSF). The DEE concentration is a PSF integration across the square area 2a×2a when the square center point coincides with the maximum PSF point (centroid point). It is desirable to have two-thirds or about 70% DEE concentration in a pixel area to match the optical and digital resolutions. - Referring to
FIG. 11 , a graph of polychromatic Huygens MTF for twelve vertical viewpoints of the compactpanoramic camera system 10 is shown according to an example embodiment. The range of the image contrast here is slightly higher than the MTF data inFIG. 8 , which may be calculated with some approximation by using the fast Fourier transform. - Referring to
FIG. 12 , a graph of the relative illumination across the vertical field of view of the compact panoramic cameraoptical system 10 is shown according to an example embodiment. This graph demonstrates uniformity of the light distribution on theimage sensor 32 across the vertical field of view of the compact panoramic camera. The illumination variation is less than 18% across the entire view. - Referring now to
FIG. 13 , image spot diagrams for twelve vertical view points for the arrangement ofFIG. 1 are shown according to an example embodiment. As is shown, there is very minimal distortion on theimage sensor 32 as the vertical angle increases through the 105 degrees. -
FIG. 14 shows the lateral color graphs for wavelength range from 0.455 microns up to 0.644 microns and their deviations across entire vertical view from the main color wavelength 0.546 microns. The deviations as it may be seen are less than 2 microns and no more than Airy limits. - Referring to
FIG. 15 , the graphs of the instantaneous field of view in vertical (1550) and horizontal (1500) direction in milli-radians per pixel. They characterize the digital resolution of the compact panoramic camera across entire field of view in both directions in suggestion of using digital sensor with pixel pitch 1.5 microns. For example, the vertical resolution varies from 1.4 mrad/pixel down to 0.8 mrad/pixel if the vertical angle from optical axis varies from 35 degrees up to 105 degrees. The smaller number means the higher resolution. - Referring now to
FIG. 16 , a system block diagram of apanoramic camera 110 is shown according to an example embodiment. Thepanoramic camera 110 includes multiple subassemblies. A first subassembly is the optical system 10 (shown inFIG. 1 ). A second subassembly includes adigital image sensor 122, mounted with respect to theoptical system 10 in such a way that asensor plane 122 b of thedigital image sensor 122 coincides with theimage sensor 32 of theoptical system 10. Theoptical system 10 produces animage 125 on thedigital image sensor 122. In some embodiments, the image is circular. For example, in some embodiments, an annularcircular image 125 can be formed between an imageinner circle 125 a and an imageouter circle 125 b, as determined by theoptical system 10. - A third subsystem includes a
controller 105 configured to receive an electronic representation of the image captured by thedigital image sensor 122. In some embodiments, image processing software 106 is provided for processing the captured image. A digital representation of the focused image is rendered and displayed to an end user. For example, the rendered focused image can be displayed onto avideo display 107 at auser interface 108. Theuser interface 108 can include user controls allowing a user to manipulate the image processing software 106 for at least one of functions to automatically focus theimage 125 and functions to manually focus theimage 125. In a preferred embodiment, none of the compression and decompression of the virtual curved andcompressed image 19 is performed with digital image processing. -
FIG. 17 shows an alternative optical system layout according to a second example embodiment. The second embodiment is a modification of the first embodiment in that theconvex reflector 18 is mounted using acylindrical window 39. Interior to thecylindrical window 39 is theconvex reflector 18, aspike 35, and abaffle 36. Theconvex reflector 18 may be of hyperbolic structure with a diameter of 20.1 mm and theimage sensor 32 may have a diameter of 4.6 mm. Thus the convex reflector to image sensor ratio may be 4.4:1. Thespike 35 may be disposed along the verticaloptical axis 12 and extend at least partially into the interior of thebaffle 36. Thespike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera. Thebaffle 36 is a mechanical system, whose function is to shield the light coming from sources outside the field of view (FOV) of the compact panoramic camera. -
FIG. 18 shows an alternative optical system layout according to a third example embodiment. The third embodiment is a modification of the first embodiment in that theconvex reflector 18 is mounted by using acentral strut 37, anacrylic plate 38, and ahousing 41. Theconvex reflector 18 has a diameter of 21.2 mm and theimage sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 4.7:1. Thecentral strut 37 acts as a support for theconvex reflector 18. Theacrylic plate 38 supports thecentral strut 37, as well as provides a clear passage for light to pass through into thehousing 41. -
FIG. 19 shows an alternative optical system layout according to a fourth example embodiment. The fourth embodiment is a modification of the first embodiment in that theconvex reflector 18 is mounted by using acentral strut 37, anacrylic plate 38, anacrylic cone window 40, ahousing 41, and alight trap diaphragm 42. Theconvex reflector 18 has a diameter of 21.2 mm and theimage sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 4.7:1. Thecentral strut 37 acts as a support for theconvex reflector 18. Theacrylic plate 38 supports thecentral strut 37 as well as provides a clear passage for light to pass through into thehousing 41. Theacrylic cone window 40 acts as a refractive surface as the light travels through it, as well as adds support to the mounting of theconvex reflector 18. Thehousing 41 is used to contain thelight trap diaphragm 42. Thelight trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through thehardware aperture 22. -
FIG. 20 shows an alternative optical system layout according to a fifth example embodiment. The fifth embodiment is a modification of the first embodiment in that the optical system layout includes aspike 35, ahousing 41, alight trap diaphragm 42, and ahood 43. Theconvex reflector 18 has a diameter of 24.2 mm and theimage sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 5.4:1. Thespike 35 may be disposed along the verticaloptical axis 12 and extend at least partially into the interior of thehousing 41. Thespike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera. Thehousing 41 is used to contain thelight trap diaphragm 42. Thelight trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through thehardware aperture 22. Thehood 43 serves the purpose of reducing lens flare as well as protecting the optical system from damage. -
FIG. 21 shows an alternative compact panoramic camera according to a sixth example embodiment. The sixth embodiment is a modification of the first embodiment in that the embodiment includes an optical system with EVFOV of 80 degrees: 30 degrees up and 50 degrees down from the horizon. Theconvex reflector 18 has a diameter of 24.2 mm and theimage sensor 32 has a diameter of 4.6 mm. Thus the convex reflector to image sensor ratio is 5.3:1. According to an example embodiment, the overall length of the optical system ofFIG. 21 is 51.2 mm. In other embodiments, the overall length of the optical system ofFIG. 21 is greater or lesser than 51.2 mm. -
FIG. 22 shows an alternative compact panoramic camera according to a seventh example embodiment. The seventh embodiment is a modification of the first embodiment in that this embodiment includes an optical system with EVFOV of 80 degrees: 40 degrees up and 40 degrees down from the horizon. Theconvex reflector 18 has a diameter of 26.4 mm and theimage sensor 32 has a diameter of 4.6 mm. Thus the convex reflector to image sensor ratio is 5.7:1. According to an example embodiment, the overall length of the optical system ofFIG. 22 is 49.1 mm. In other embodiments, the overall length of the optical system ofFIG. 22 is greater or lesser than 49.1 mm. -
FIG. 23 shows an alternative compact panoramic camera according to an eighth example embodiment. The eighth embodiment is a modification of the first embodiment in that this embodiment includes an optical system with EVFOV of 85 degrees: 45 degrees up and 40 degrees down from the horizon. Theconvex reflector 18 has a diameter of 25.3 mm and theimage sensor 32 has a diameter of 4.6 mm. Thus the convex reflector to image sensor ratio is 5.5:1. According to an example embodiment, the overall length of the optical system ofFIG. 23 is 47.2 mm. In other embodiments, the overall length of the optical system ofFIG. 23 is greater or lesser than 47.2 mm. -
FIG. 24 shows an alternative compact panoramic camera according to a ninth example embodiment. The ninth embodiment is a modification of the first embodiment in that this embodiment includes an optical system with EVFOV of 80 degrees: 40 degrees up and 40 degrees down from the horizon, aCOE 14 with an alternative shape, aspike 35, ahousing 41, and alight trap diaphragm 42. TheCOE 14 with an alternative shape includes three optical surfaces: theconvex reflector 18 which may be any aspheric shape (e.g., hyperbolic, parabolic, etc.), and two spherical refractive surfaces may be connected to theconvex reflector 18. In other embodiments, the two refractive surfaces may be a variety of shapes (e.g., linear, parabolic, hyperbolic, aspheric, etc.). Thespike 35 may be disposed along the verticaloptical axis 12 and extend at least partially into the interior of thehousing 41. Thespike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera. Thehousing 41 is used to contain thelight trap diaphragm 42. Thelight trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through thehardware aperture 22. Theconvex reflector 18 has a diameter of 27.8 mm and theimage sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 6.2:1. -
FIG. 25 shows an alternative compact panoramic camera according to a tenth example embodiment. The tenth embodiment is a modification of the first embodiment in that this embodiment includes an optical system with EVFOV of 80 degrees: 40 degrees up and 40 degrees down from the horizon, aspike 35, anacrylic cone window 40, ahousing 41, and alight trap diaphragm 42. Thespike 35 may be disposed along the verticaloptical axis 12 and extend at least partially into the interior of thehousing 41. Thespike 35 provides improved stability of the overall optic and reduces unwanted glare in images reflected to the camera. Theacrylic cone window 40 acts as a refractive surface as the light travels through it, as well as adds support to the mounting of theconvex reflector 18. Thehousing 41 is used to contain thelight trap diaphragm 42. Thelight trap diaphragm 42 is a tapered annular diaphragm (i.e., contains a conical cutout) which stops the passage of light, except for the light passing through thehardware aperture 22. Theconvex reflector 18 has a diameter of 27.0 mm and theimage sensor 32 has a diameter of 4.5 mm. Thus the convex reflector to image sensor ratio is 6:1. - Referring now to
FIG. 26 , an optical system layout of the compact panoramic camera is shown, according to an eleventh example embodiment. Theoptical system 10 with axis of symmetry, verticaloptical axis 12, as itself includes two main optical components: a convex reflector 18 (e.g., a hyperbolic mirror) and adecompression lens 23, which is comprised of a single lens element. Theoptical system 10 further includes ahardware aperture 22 and a curved image sensor 33 (i.e., 3D). In other embodiments, the image sensor may be a flat image senor, such as theimage sensor 32. The diameter of the hyperbolicconvex reflector 18 is 25.6 mm, the conic constant is negative 1.4, and radius of curvature at the vertex is 9.346 mm, the same as for the first embodiment (FIG. 1 ). The single lens element of thedecompression lens 23 includes afirst surface 46 and asecond surface 47, each having different aspheric shapes. Working together, thefirst surface 46 and thesecond surface 47 are capable of effectively correcting all field aberrations except field curvature, as well as decompress the virtual image compression created by hyperbolic mirror,convex reflector 18. As a result, theoptical system 10 has a diffraction limited image quality by using aperture F/4, which is confirmed by diffraction MTF (FIG. 27 ), diffraction ensquared energy concentration (FIG. 28 ), and spot diagram (FIG. 29 ). The decompression ability of the single lens element of thedecompression lens 23 is confirmed by F-theta distortion graph 3002 (FIG. 30 ), which indicates 30.8% decompression for field ofview edge 105 degrees (15 degree up from the horizon). Thefirst surface 46 of thedecompression lens 23 may have a positive optical power and a focal length of 8.8 mm. For this reason, it is not possible to correct its own field curvature plus compensate the positive field curvature introduced by theconvex reflector 18. Thesecond surface 47 has a negative optical power and corrects the field curvature of theoptical system 10. Thesecond surface 47 may also correct chromatic aberrations if its optical material has higher dispersion than thefirst surface 46 of the lens element. The optical system 10 (FIG. 26 ) may be monochromatic and have a working wavelength of 546 nanometers. - Nevertheless, it is possible to correct chromatic aberrations having only a single lens element acting as a decompression lens, such as the
decompression lens 23 inFIG. 31 , by making one of its optical surface a diffractive one. This is realized in the twelfth example embodiment (FIG. 31 ) by making the first surface 46 a diffractive surface. Theoptical system 10 has a high optical resolution for aperture F/4, which is confirmed by polychromatic diffraction MTF (FIG. 32 ), diffraction ensquared energy concentration (FIG. 33 ), and spot diagram (FIG. 34 ). The parabolic type of image compression is confirmed by F-theta distortion graph 3502 (FIG. 35 ) with 26.9% decompression for the FOV edge. The optical system 10 (FIG. 31 ) has an effective vertical field ofview 80 degrees: 15 degrees up and 65 degrees down from the horizon. The convex hyperbolic mirror, theconvex reflector 18, has a high order aspheric surface, its diameter is 24.5 mm, and the conic constant and radius of curvature at the vertex are the same as for the eleventh example embodiment (FIG. 26 ). - The
first surface 46 and thesecond surface 47 of thedecompression lens 23 ofFIG. 31 have different aspheric shapes. Thefirst surface 46 may include a diffractive optical structure on a top of its aspheric surface. Working together, thefirst surface 46 and thesecond surface 47 are capable of effectively correcting chromatic aberrations and all field aberrations except field curvature, as well as decompress the virtual image compression created by theconvex reflector 18. To improve the color correction even further, thefirst surface 46 of the single lens element of thedecompression lens 23 may be coated by a thin film IR cut-off filter, which blocks the light wavelengths starting approximately from 680 nm and up. Another advantage of the IR filter coating is optical element reduction: otherwise an additional flat filter element may need to be placed in a front of thecurved image sensor 33. The sharpest image is located on the concave surface ofcurved image sensor 33. It is still possible to get a sharp image on a flat sensing surface, such asimage sensor 32, if relying on depth of focus and using pinhole aperture with F-stop - By reducing the diameter of the
aperture 22 inFIG. 31 from 2.20 mm down to 0.55 mm, the F-stop of theoptical system 10, becomes 16 instead of 4.FIGS. 36-39 characterize the image quality on a flat surface, such as theimage sensor 32, after refocusing. The maximum optical resolution is 50 cy/mm for contrast 0.3-0.4 (FIG. 36 ), and 70% light energy concentrates on thearea 16×16 microns on average (FIG. 37 ). As a result, the image quality reduction on a flat sensing surface is about four times less as compared with the 3D sensing surface, such as thecurved image sensor 33. - The present disclosure may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the disclosure is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
- It is to be understood that the inventions disclosed herein are not limited to the details of construction and the arrangement of the components set forth in the description or illustrated in the drawings. The inventions are capable of other embodiments or being practiced or carried out in various ways. It is also to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
- It is also important to note that although only a few embodiments of the fitting have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications are possible (e.g., variations in size, dimensions, structures, shapes and portions of the various elements, values of parameters, mounting arrangements, materials, colors, orientations, etc.) without materially departing from the novel teachings and advantages of the subject matter recited in the disclosed embodiments. Accordingly, all such modifications are intended to be included within the scope of the present disclosure as defined in the disclosed embodiments.
Claims (20)
1. A system for a compact panoramic camera having an image sensor, comprising:
a convex reflector having an axially symmetric aspheric surface that provides a virtual curved and compressed image of a panoramic scene with a non-parabolic image compression; and
a decompression lens positioned to receive the virtual curved and compressed image, the decompression lens configured to:
decompress the virtual curved and compressed image into a real image with a high optical resolution and a parabolic image decompression; and
project the real image onto the image sensor.
2. The system of claim 1 , wherein the axially symmetric aspheric surface of the convex reflector is of a hyperbolic structure.
3. The system of claim 1 , wherein the non-parabolic image compression of the virtual curved and compressed image is in the same format as the structure of the axially symmetric aspheric surface.
4. The system of claim 1 , wherein the high optical resolution includes the system having a polychromatic diffraction modulation transfer function of 30% or more for 150 cy/mm.
5. The system of claim 1 , further comprising a catadioptric optical element configured to create the virtual curved and compressed image, wherein the catadioptric optical element includes the convex reflector.
6. The system of claim 5 , wherein the catadioptric optical element further includes a first refractive surface positioned to receive light rays from the panoramic scene and a second refractive surface positioned to receive light rays reflected by the convex reflector.
7. The system of claim 1 , wherein the decompression lens is comprised of one or more lens elements having a total of one or more aspheric surfaces.
8. The system of claim 7 , wherein at least one of the one or more aspheric surfaces has a diffractive optical structure disposed along the at least one of the one or more aspheric surfaces.
9. The system of claim 7 , wherein the decompression lens includes a first negative lens element having a negative optical power, a second negative lens element having a negative optical power, and a positive lens element having a positive optical power and positioned between the first negative lens element and the second negative lens element.
10. The system of claim 9 , wherein a first surface of the first negative lens element is coated with a thin film coating capable of cutting off infrared radiation starting from approximately 680 nanometers and up.
11. The system of claim 9 , wherein at least one of the first negative lens element, the second negative lens element, and the positive lens element have one or more aspheric surfaces.
12. The system of claim 1 , further comprising a hardware aperture configured to filter out light rays other than those reflected directly from the convex reflector, wherein the hardware aperture is positioned a distance from the convex reflector at or in a vicinity of a geometrical focus of the convex reflector, and wherein the decompression lens is positioned to receive the virtual curved and compressed image filtered by the hardware aperture.
13. A method for compressing and decompressing an image with high resolution, comprising:
receiving, by a catadioptric optical element, light ray bundles from a scene;
compressing, by the catadioptric optical element, the light ray bundles into a virtual curved and compressed image with a non-parabolic compression;
reflecting, by the catadioptric optical element, the virtual curved and compressed image onto a hardware aperture;
filtering out, by the hardware aperture, light rays other than those reflected by the catadioptric optical element;
receiving, by a decompression lens, the virtual curved and compressed image from the hardware aperture;
decompressing, by the decompression lens, the virtual curved and compressed image into a real image; and
projecting, by the decompression lens, the real image onto an image sensor.
14. The method of claim 13 , wherein the non-parabolic compression of the virtual curved and compressed image is of a hyperbolic structure, and wherein the real image is in a parabolic decompression format with a high optical resolution.
15. The method of claim 13 , wherein the method for compressing and decompressing the light ray bundles is done by optic means without digital image processing.
16. A decompression lens for use with a non-parabolic mirror and an image sensor in a catadioptric optical system, comprising:
at least one lens element positioned to receive a virtual curved and compressed image in a non-parabolic compression format from the non-parabolic mirror;
wherein the at least one lens element is configured to decompress the virtual curved and compressed image into a real image with a high optical resolution and a parabolic type of decompression, and project the real image onto the image sensor.
17. The decompression lens of claim 16 , wherein the at least one lens element includes a first negative lens element that has at least one aspheric surface, the first negative lens element structured to at least one of have a negative optical power, expand bundles of light rays, and partially correct field aberrations using the at least one aspheric surface.
18. The decompression lens of claim 17 , wherein the at least one lens element includes a second negative lens element that has aspheric surfaces and is positioned in close proximity to the image sensor, the second negative lens element is structured to at least one of have a negative optical power, correct image compression, correct field curvature, and correct residual field aberrations using the aspheric surfaces.
19. The decompression lens of claim 18 , wherein the at least one lens element includes a positive lens element that has aspheric surfaces, wherein the positive lens element is structured to at least one of have a positive optical power, converge bundles of light rays, and partially correct field aberrations by using the aspheric surfaces, and wherein the positive lens element positioned between the first negative lens element and the second negative lens element.
20. The decompression lens of claim 19 , wherein the first negative lens element and the second negative lens element are made from high dispersion plastic materials including at least one of Polystyrene, Polycarbonate, and Rexolite, and wherein the positive lens element is made from low dispersion optical plastic materials including at least one of Acrylic, PMMA, and Zeonex.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/854,687 US20160077315A1 (en) | 2014-09-15 | 2015-09-15 | Compact panoramic camera: optical system, apparatus, image forming method |
US16/116,597 US11061208B2 (en) | 2014-09-15 | 2018-08-29 | Compact panoramic camera: optical system, apparatus, image forming method |
US17/371,983 US20210341714A1 (en) | 2014-09-15 | 2021-07-09 | Compact panoramic camera: optical system, apparatus, image forming method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462050725P | 2014-09-15 | 2014-09-15 | |
US14/854,687 US20160077315A1 (en) | 2014-09-15 | 2015-09-15 | Compact panoramic camera: optical system, apparatus, image forming method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/116,597 Continuation US11061208B2 (en) | 2014-09-15 | 2018-08-29 | Compact panoramic camera: optical system, apparatus, image forming method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160077315A1 true US20160077315A1 (en) | 2016-03-17 |
Family
ID=55454598
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/854,687 Abandoned US20160077315A1 (en) | 2014-09-15 | 2015-09-15 | Compact panoramic camera: optical system, apparatus, image forming method |
US16/116,597 Active 2036-05-16 US11061208B2 (en) | 2014-09-15 | 2018-08-29 | Compact panoramic camera: optical system, apparatus, image forming method |
US17/371,983 Abandoned US20210341714A1 (en) | 2014-09-15 | 2021-07-09 | Compact panoramic camera: optical system, apparatus, image forming method |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/116,597 Active 2036-05-16 US11061208B2 (en) | 2014-09-15 | 2018-08-29 | Compact panoramic camera: optical system, apparatus, image forming method |
US17/371,983 Abandoned US20210341714A1 (en) | 2014-09-15 | 2021-07-09 | Compact panoramic camera: optical system, apparatus, image forming method |
Country Status (7)
Country | Link |
---|---|
US (3) | US20160077315A1 (en) |
EP (1) | EP3195040B1 (en) |
JP (1) | JP6598314B2 (en) |
KR (2) | KR102489794B1 (en) |
CN (2) | CN111999861A (en) |
IL (1) | IL250963B (en) |
WO (1) | WO2016044264A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018006938A1 (en) * | 2016-07-05 | 2018-01-11 | Zero Parallax Technologies Ab | Spherical camera lens system, camera system and lens assembly |
US20180115689A1 (en) * | 2016-10-26 | 2018-04-26 | Lite-On Electronics (Guangzhou) Limited | Camera module and assembly method thereof |
CN107995388A (en) * | 2016-10-26 | 2018-05-04 | 光宝科技股份有限公司 | Camera module and assembling method thereof |
CN112313947A (en) * | 2018-06-20 | 2021-02-02 | 三星电子株式会社 | Method and apparatus for processing 360 degree image |
EP3940444A1 (en) * | 2020-07-14 | 2022-01-19 | Opto Engineering S.R.L. | Borescope probe |
CN114486939A (en) * | 2022-04-08 | 2022-05-13 | 欧普康视科技股份有限公司 | Lens scratch detection system and method |
US11588992B2 (en) * | 2019-06-04 | 2023-02-21 | Jabil Optics Germany GmbH | Surround-view imaging system |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3779553A4 (en) * | 2018-04-09 | 2021-05-19 | Sony Corporation | Optical system and projector |
CN108734681A (en) * | 2018-05-31 | 2018-11-02 | 天津煋鸟科技有限公司 | One kind being based on Embedded on piece radial distortion bearing calibration |
US20220276125A1 (en) * | 2019-08-07 | 2022-09-01 | Agilent Technologies, Inc. | Optical imaging performance test system and method |
CN111751964A (en) * | 2020-06-30 | 2020-10-09 | 浙江大学 | Double-view-field panoramic annular belt imaging device based on aspherical mirror |
CN112363308B (en) * | 2020-12-15 | 2022-07-19 | 长春理工大学 | Compact two-channel catadioptric panoramic imaging optical system |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2244235A (en) * | 1938-09-03 | 1941-06-03 | Ibm | Cycloramic optical system |
US5710661A (en) * | 1996-06-27 | 1998-01-20 | Hughes Electronics | Integrated panoramic and high resolution sensor optics |
US5956178A (en) * | 1996-09-02 | 1999-09-21 | Nikon Corporation | Keplerian variable magnification viewfinder |
US6175454B1 (en) * | 1999-01-13 | 2001-01-16 | Behere Corporation | Panoramic imaging arrangement |
US6373642B1 (en) * | 1996-06-24 | 2002-04-16 | Be Here Corporation | Panoramic imaging arrangement |
US6426774B1 (en) * | 1996-06-24 | 2002-07-30 | Be Here Corporation | Panoramic camera |
US6464362B1 (en) * | 1998-10-29 | 2002-10-15 | Canon Kabushiki Kaisha | Illuminating apparatus |
US20040264013A1 (en) * | 2001-11-13 | 2004-12-30 | Daizaburo Matsuki | Wide-angle imaging optical system and wide-angle imaging apparatus surveillance imaging apparatus vehicle-mounted imaging apparatus and projection apparatus using the wide-angle imaging optical system |
US7362517B2 (en) * | 2005-04-25 | 2008-04-22 | Olympus Corporation | Rotationally asymmetric optical system |
US20100322059A1 (en) * | 2009-06-18 | 2010-12-23 | Sony Corporation | Objective lens, optical pickup, and optical disc apparatus |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3229576A (en) * | 1962-11-21 | 1966-01-18 | Donald W Rees | Hyperbolic ellipsoidal real time display panoramic viewing installation for vehicles |
DE68909553T2 (en) * | 1988-10-21 | 1994-01-27 | Thomson Csf | Optical collimation system for a helmet view indicator. |
US6449103B1 (en) * | 1997-04-16 | 2002-09-10 | Jeffrey R. Charles | Solid catadioptric omnidirectional optical system having central coverage means which is associated with a camera, projector, medical instrument, or similar article |
US5982549A (en) * | 1998-05-15 | 1999-11-09 | University Technology Corporation | Ultra-wide field viewing system |
CA2358220A1 (en) * | 1999-01-04 | 2000-07-13 | Cyclovision Technologies, Inc. | Panoramic imaging apparatus |
JP3804916B2 (en) * | 2001-02-09 | 2006-08-02 | シャープ株式会社 | Imaging system, program used for controlling image data thereof, method for correcting distortion of captured image in imaging system, and storage medium storing procedure thereof |
US6744569B2 (en) * | 2001-06-19 | 2004-06-01 | Genex Technologies, Inc | Method and apparatus for omnidirectional three dimensional imaging |
US7336299B2 (en) * | 2003-07-03 | 2008-02-26 | Physical Optics Corporation | Panoramic video system with real-time distortion-free imaging |
US8124929B2 (en) * | 2004-08-25 | 2012-02-28 | Protarius Filo Ag, L.L.C. | Imager module optical focus and assembly method |
US7609381B2 (en) * | 2008-03-20 | 2009-10-27 | The Aerospace Corporation | Compact, high-throughput spectrometer apparatus for hyperspectral remote sensing |
US8451318B2 (en) * | 2008-08-14 | 2013-05-28 | Remotereality Corporation | Three-mirror panoramic camera |
CN102495460B (en) * | 2011-12-13 | 2014-01-22 | 复旦大学 | Panoramic imaging lens |
KR20140121431A (en) | 2012-01-09 | 2014-10-15 | 아이시360, 인코포레이티드 | Panoramic optical systems |
-
2015
- 2015-09-15 KR KR1020177009688A patent/KR102489794B1/en active IP Right Grant
- 2015-09-15 WO PCT/US2015/050169 patent/WO2016044264A1/en active Application Filing
- 2015-09-15 EP EP15841497.9A patent/EP3195040B1/en active Active
- 2015-09-15 JP JP2017533738A patent/JP6598314B2/en active Active
- 2015-09-15 KR KR1020237001380A patent/KR20230014854A/en not_active Application Discontinuation
- 2015-09-15 US US14/854,687 patent/US20160077315A1/en not_active Abandoned
- 2015-09-15 CN CN202010928373.0A patent/CN111999861A/en active Pending
- 2015-09-15 CN CN201580059029.XA patent/CN107111113A/en active Pending
-
2017
- 2017-03-06 IL IL250963A patent/IL250963B/en unknown
-
2018
- 2018-08-29 US US16/116,597 patent/US11061208B2/en active Active
-
2021
- 2021-07-09 US US17/371,983 patent/US20210341714A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2244235A (en) * | 1938-09-03 | 1941-06-03 | Ibm | Cycloramic optical system |
US6373642B1 (en) * | 1996-06-24 | 2002-04-16 | Be Here Corporation | Panoramic imaging arrangement |
US6426774B1 (en) * | 1996-06-24 | 2002-07-30 | Be Here Corporation | Panoramic camera |
US5710661A (en) * | 1996-06-27 | 1998-01-20 | Hughes Electronics | Integrated panoramic and high resolution sensor optics |
US5956178A (en) * | 1996-09-02 | 1999-09-21 | Nikon Corporation | Keplerian variable magnification viewfinder |
US6464362B1 (en) * | 1998-10-29 | 2002-10-15 | Canon Kabushiki Kaisha | Illuminating apparatus |
US6175454B1 (en) * | 1999-01-13 | 2001-01-16 | Behere Corporation | Panoramic imaging arrangement |
US20040264013A1 (en) * | 2001-11-13 | 2004-12-30 | Daizaburo Matsuki | Wide-angle imaging optical system and wide-angle imaging apparatus surveillance imaging apparatus vehicle-mounted imaging apparatus and projection apparatus using the wide-angle imaging optical system |
US7362517B2 (en) * | 2005-04-25 | 2008-04-22 | Olympus Corporation | Rotationally asymmetric optical system |
US20100322059A1 (en) * | 2009-06-18 | 2010-12-23 | Sony Corporation | Objective lens, optical pickup, and optical disc apparatus |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018006938A1 (en) * | 2016-07-05 | 2018-01-11 | Zero Parallax Technologies Ab | Spherical camera lens system, camera system and lens assembly |
CN109478006A (en) * | 2016-07-05 | 2019-03-15 | 零视差技术有限公司 | Spherical camera lens system, camera system and lens subassembly |
EP3482256A1 (en) * | 2016-07-05 | 2019-05-15 | Zero Parallax Technologies Ab | Spherical camera lens system, camera system and lens assembly |
US20190235214A1 (en) * | 2016-07-05 | 2019-08-01 | Zero Parallax Technologies Ab | Spherical camera lens system, camera system and lens assembly |
US20180115689A1 (en) * | 2016-10-26 | 2018-04-26 | Lite-On Electronics (Guangzhou) Limited | Camera module and assembly method thereof |
CN107995388A (en) * | 2016-10-26 | 2018-05-04 | 光宝科技股份有限公司 | Camera module and assembling method thereof |
CN112313947A (en) * | 2018-06-20 | 2021-02-02 | 三星电子株式会社 | Method and apparatus for processing 360 degree image |
US11989849B2 (en) | 2018-06-20 | 2024-05-21 | Samsung Electronics Co., Ltd. | Method and device for processing 360-degree image |
US11588992B2 (en) * | 2019-06-04 | 2023-02-21 | Jabil Optics Germany GmbH | Surround-view imaging system |
US11838663B2 (en) | 2019-06-04 | 2023-12-05 | Jabil Optics Germany GmbH | Surround-view imaging system |
EP3940444A1 (en) * | 2020-07-14 | 2022-01-19 | Opto Engineering S.R.L. | Borescope probe |
US11474340B2 (en) | 2020-07-14 | 2022-10-18 | Opto Engineering S.P.A. | Borescope probe |
CN114486939A (en) * | 2022-04-08 | 2022-05-13 | 欧普康视科技股份有限公司 | Lens scratch detection system and method |
Also Published As
Publication number | Publication date |
---|---|
US20190011678A1 (en) | 2019-01-10 |
US11061208B2 (en) | 2021-07-13 |
CN107111113A (en) | 2017-08-29 |
KR20170067767A (en) | 2017-06-16 |
EP3195040A1 (en) | 2017-07-26 |
KR102489794B1 (en) | 2023-01-18 |
CN111999861A (en) | 2020-11-27 |
WO2016044264A1 (en) | 2016-03-24 |
EP3195040B1 (en) | 2023-05-24 |
KR20230014854A (en) | 2023-01-30 |
EP3195040A4 (en) | 2018-02-28 |
IL250963B (en) | 2022-04-01 |
JP6598314B2 (en) | 2019-10-30 |
IL250963A0 (en) | 2017-04-30 |
US20210341714A1 (en) | 2021-11-04 |
JP2017532612A (en) | 2017-11-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210341714A1 (en) | Compact panoramic camera: optical system, apparatus, image forming method | |
CN109669258B (en) | Imaging optical lens, image capturing device and electronic device | |
CN110119020B (en) | Image capturing optical lens assembly, image capturing device and electronic device | |
CN108267833B (en) | Image capturing system, image capturing device and electronic device | |
EP1141760B1 (en) | Panoramic imaging apparatus | |
CN108089279B (en) | Image pickup lens system, image pickup apparatus, and projector | |
US8451318B2 (en) | Three-mirror panoramic camera | |
TW201937226A (en) | Optical imaging lens assembly, image capturing unit and electronic device | |
CN112394477A (en) | Camera lens | |
CN113703136A (en) | Photographic lens group | |
CN116560052A (en) | Optical lens group for image capturing | |
CN110716284B (en) | Imaging optical lens assembly, image capturing device and electronic device | |
CN110888221B (en) | Electronic device | |
CN113238340A (en) | Image capturing lens assembly and image capturing device | |
JP6664853B2 (en) | Imaging lens | |
KR20150146058A (en) | Zoom lens system | |
CN110471165B (en) | Small-sized high-resolution fisheye lens optical system capable of eliminating distortion | |
JP5850191B1 (en) | Optical system and imaging system | |
CN115032759B (en) | Optical image lens system set, image capturing device and electronic device | |
JP2007155976A (en) | Fisheye lens and imaging apparatus | |
JP7225047B2 (en) | Imaging lens and imaging device | |
CN118519258A (en) | Image system lens assembly, image capturing device and electronic device | |
JPH0682699A (en) | Lens system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: REMOTEREALITY CORPORATION, CONNECTICUT Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TRUBKO, SERGEY;MENON, RAGHU;ZHU, YANGIU (JULIA);AND OTHERS;SIGNING DATES FROM 20160617 TO 20160805;REEL/FRAME:039405/0537 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |