KR101689534B1 - Multiscale Imaging System - Google Patents

Abstract

The present invention provides a camera device and an imaging method. The imaging system includes a first lens that converts an object of an object plane into an entire image of a first image plane; A second lens disposed at a distance from the first central axis of the first lens and having a second central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix, Main 2-Degree-of-Freedom Mirror; A second two-degree-of-freedom mirror disposed at a second central axis of the second lens and providing a divided image reflected by the main two-degree-of-freedom mirror as a center thereof to the second lens; And an image sensor array for picking up an enlarged divided image generated by enlarging the split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto a second image plane of the second lens.

Description

[0001] Multiscale Imaging System [

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a structure of a camera optical system, and more particularly, to an optical method for generating a high resolution image using a low resolution image sensor array.

Gigapixel image refers to an early resolution of the digital page consisting of ^nine 10 pixels. The production method is to synthesize hundreds to thousands of elementary photographs from a megapixel image sensor into a single photograph.

Specifically, the neighboring element photographs photographed from the megapixel image sensor are superimposed on each other and the superimposed regions are connected to each other, so that a large-scale pixel photograph as a whole is completed. The process of converting hundreds or thousands of megapixel-quality element photos into a single gigabyte-class picture is achieved by digital synthesis techniques called image stitching, It can be understood as a process that produces

The team of Duke University proposed a multi-scale imaging system through US patent publication US2013-2242060. The main features of this camera are a ball-shaped 6 cm air-core objective lens and a set of 98 micro-scopic cameras. This camera does not need to focus on one part when taking a picture, but shoots the whole scene. Then, a specific portion is zoomed-in and enlarged later. Unlike ordinary photographs, the enlarged portion of the zoom-in has an extremely high resolution so that the pixels are not broken and the sharp image quality is maintained. Therefore, you can take the whole image with one shot and then zoom in freely to select the desired photo area.

The Duke technology divides the field of view (FOV) using a common lens called an air-core lens to obtain gigapixel images. The segmented viewing angles are shared by 20 to 30 percent of the adjacent microscopic cameras, creating an individual elemental image. As a result, the elemental images obtained from the megapixel-level micro-scopic camera are synthesized with each other and re-created as one gigantic pixel image.

The Duke technology used the world's first objective lens of eccentricity and 98 microscopic camera lenses to construct a gigapixel lens system, from which 1.2 gigapixel images were acquired. Duke technology can be characterized as pure optical system using only a lens. However, since this technique requires the use of 98 micro-scopic cameras, there is a disadvantage in that the volume of the entire camera system is inevitably large. As a result, the volume of the entire camera system is close to 45 kg, which is a very small refrigerator size and very heavy in weight.

Therefore, in order to acquire images of several gigabytes of pixels in this way, the volume is also several times smaller than that of a miniature refrigerator, as hundreds of microscopic cameras are required, far more than 98. The Duke University technology will have great significance in the symbolic aspect of being the first in the world, but it has many limitations in terms of practicality and economics.

Therefore, there is a need for a gigapixel imaging device that is economical and capable of providing a small volume.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an imaging device and a multi-scale imaging system capable of miniaturization and gigapixel imaging.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a gigapixel lens system by combining a pair of lenses and two biaxial actuators without constructing a gigapixel lens system only in a purely optical manner. As a result, not only gigapixel image but also miniaturization is possible.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an image sensor array which does not constitute a gigapixel lens system only in a purely optical manner but has a pair of lenses, two two-axis drive actuators and a plurality of image sensor arrays To realize a high-speed gigapixel lens system.

An imaging system according to an embodiment of the present invention includes a first lens that converts an object of an object plane into an entire image of a first image plane; A second lens disposed at a distance from the first central axis of the first lens and having a second central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix, Main 2-Degree-of-Freedom Mirror; A second two-degree-of-freedom mirror disposed at a second central axis of the second lens and providing a divided image reflected by the main two-degree-of-freedom mirror as a center thereof to the second lens; And an image sensor array for picking up an enlarged divided image generated by enlarging the split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto a second image plane of the second lens.

In one embodiment of the present invention, the image sensor array is arranged in a second image plane of the second lens, and the number of divided images is an integer multiple of the number of the image sensor arrays , Each of the image sensor arrays is disposed spaced apart, and as the scanning of the divided images, the enlarged divided images can be sequentially captured in the image sensor array.

In one embodiment of the present invention, the main two-degree-of-freedom mirror can independently rotate about two axes perpendicular to each other in the arrangement plane of the main two-degree-of-freedom mirror.

In one embodiment of the present invention, the auxiliary two-degree of freedom mirror can be independently rotated about two axes perpendicular to each other in the arrangement plane of the auxiliary two-degree of freedom mirror.

In an embodiment of the present invention, the first central axis and the second central axis may be parallel to each other.

In one embodiment of the present invention, the auxiliary 2-DOF mirror may further include a linear motion portion for moving the auxiliary 2-DOF mirror in the second center axis direction.

In one embodiment of the present invention, the apparatus further includes a diaphragm disposed between the auxiliary two-degree-of-freedom mirror and the second lens, and neighboring divided images may have areas overlapping with each other.

An imaging system according to an embodiment of the present invention includes a first lens that converts an object of an object plane into an entire image of a first image plane; A plurality of second lenses spaced apart from a first central axis of the first lens and each having a central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix, Main 2-Degree-of-Freedom Mirror; A second two-degree-of-freedom mirror disposed at a center axis of the second lens and serving as a center of the divided image reflected by the main two-degree-of-freedom mirror and providing the split image to the second lens; And a plurality of image sensor arrays for picking up an enlarged divided image generated by magnifying the split image reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror on a second image curved surface. The second lens and the image sensor array are configured to pair with each other.

In one embodiment of the present invention, the image sensor array is less than or equal to the number of divided images, and the second lens is disposed on a curved surface having a predetermined constant first radius of curvature, and each of the image sensor arrays has a first radius of curvature Wherein the enlarged divided image is sequentially imaged onto the image sensor array as the divided image is scanned.

In one embodiment of the present invention, the main two-degree-of-freedom mirror can independently rotate about two axes perpendicular to each other in the arrangement plane of the main two-degree-of-freedom mirror.

In one embodiment of the present invention, the auxiliary two-degree of freedom mirror can be independently rotated about two axes perpendicular to each other in the arrangement plane of the auxiliary two-degree of freedom mirror.

An imaging method according to an embodiment of the present invention includes the steps of converting an object of an object plane into an entire image of a first image plane using a first lens; Dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix using a main two-degree-of-freedom mirror disposed in the first image plane at a first central axis of the first lens, Selecting and reflecting one of them; Providing a split image reflected by the main 2-DOF mirror at the center thereof to the second lens using an auxiliary 2-DOF mirror disposed on a second central axis of the second lens; Degree mirror and the auxiliary two-degree-of-freedom mirror using a second lens disposed at a vertical distance from the first central axis of the first lens and having a second central axis, Enlarging the second image plane of the second lens to produce an enlarged divided image; And capturing the enlarged divided image. As the divided images are scanned, the enlarged divided images are successively captured in a plurality of image sensor arrays.

An imaging method according to an embodiment of the present invention includes the steps of converting an object of an object plane into an entire image of a first image plane using a first lens; Dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix using a main two-degree-of-freedom mirror disposed in the first image plane at a first central axis of the first lens, Selecting and reflecting one of them; Providing a divided image reflected by the main 2-DOF mirror at the center thereof to the second lens using an auxiliary 2-DOF mirror disposed on the central axis of the plurality of second lenses; Enlarging a split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto a second image surface using the second lens to produce an enlarged split image; And capturing the enlarged divided image. As the divided images are scanned, the enlarged divided images are successively captured in a plurality of image sensor arrays.

A camera device or a multi-scale imaging system according to an embodiment of the present invention can acquire a high-resolution image with a simple structure using a plurality of low-resolution image sensors.

1 is a conceptual diagram illustrating a divided image according to an embodiment of the present invention.
2 is a diagram for explaining conversion of a divided image into an enlarged divided image according to an embodiment of the present invention.
3A is a diagram for explaining conversion of a divided image into an enlarged divided image according to an embodiment of the present invention.
FIG. 3B is an enlarged view of the main 2-DOF mirror of FIG. 3A.
4 is a conceptual diagram illustrating a camera device according to an embodiment of the present invention.
5 is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.
6 is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.
7A is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.
FIG. 7B is a conceptual diagram illustrating the imaging system of FIG. 7A.
Fig. 7C is a view for explaining the divided image scanning of the imaging system of Fig. 7A. Fig.
8 is a view for explaining a divided image scanning of an imaging system according to another embodiment of the present invention.
9A is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.
FIG. 9B is a conceptual diagram showing the operation state of FIG. 9A.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. Rather, the embodiments disclosed herein are being provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. In the drawings, the components have been exaggerated for clarity. Like numbers refer to like elements throughout the specification.

1 is a conceptual diagram illustrating a divided image according to an embodiment of the present invention.

Referring to FIG. 1, the first lens 110 is an objective lens of a camera. The first lens 110 may be composed of one or more lenses. The first lens 110 has a first central axis. The object plane is a plane on which an object to be imaged exists. The principal ray is a ray passing through the center of the first lens. The first image plane is a plane on which the image of the first lens 110 is formed. The distance from the center of the first lens 110 to the first image plane may be larger or smaller than the focal length of the first lens 110. The principal rays may be displayed in a matrix form in the image plane.

In order to obtain a high resolution image, when a high resolution image sensor array is disposed in the image plane, a high resolution image can be realized. However, implementing a high resolution image sensor array is physically limited. Also, there is a limit to increasing the overall size of the image sensor array. To overcome this limitation, in order to realize a high-resolution image, the entire image on the image plane can be divided into a predetermined size based on the principal ray points arranged in a matrix form to form a divided image. The divided images are shown as a 5x5 matrix, but the present invention is not limited thereto and can be modified into various structures. When each of the divided images is imaged by a mega-pixel class image sensor, the entire image may be composed of approximately 30x30 matrix divided images so as to form a gigapixel image.

According to an embodiment of the present invention, each divided image is enlarged through the second lens 140 to generate an enlarged divided image. The enlarged divided image can be picked up through a typical megapixel image sensor array. A pair of two-degree-of-freedom mirrors 120 and 130 are used to transmit the divided image as a virtual object to the second lens 140.

2 is a diagram for explaining conversion of a divided image into an enlarged divided image according to an embodiment of the present invention.

Referring to FIG. 2, the first to third principal rays (a, b, c) passing through the center of the first lens 110 form principal ray points in the image plane, respectively. The entire image can be divided into divided images of the same size based on the principal ray point. The main 2-DOF mirror 120 is disposed in the first image plane at the first central axis of the first lens 110. The main two-degree-of-freedom mirror 120 is arranged obliquely with respect to the first central axis, and a pair of coordinate axes (x 'axis and y' axis) perpendicular to the arrangement plane (x'y 'plane) To provide a tilt. Accordingly, the selected one divided image 2b is transmitted to the center of the auxiliary two-degree of freedom mirror 130 by the main two-degree of freedom mirror 120. [

The unselected divided images a and c are not transmitted to the center of the auxiliary two-degree-of-freedom mirror 130. Therefore, the enlarged divided image can not be formed by the second lens 140.

The auxiliary 2-DOF mirror 130 may be aligned with the main 2-DOF mirror 120 in the x-axis direction. The auxiliary two-degree-of-freedom mirror 130 may be disposed on the second central axis of the second lens 140. The auxiliary two-degree-of-freedom mirror 130 is arranged on the second center axis of the second lens 140 to transmit the transferred divided image 2b to the second lens 140, 2b '. To this end, the secondary two-degree of freedom mirror 130 rotates about a pair of coordinate axes (x "and y" axes) perpendicular to its plane of placement (x "y" . The virtual divided image 2b 'is disposed in a virtual object plane of the second lens 140 and can function as an image pickup object of the second lens 140. [

In the case of the principal ray b passing through the first central axis of the first lens 110, the divided image 2b based on the principal ray b is divided into the virtual division image 2b '. The virtual divided image 2b 'is transmitted to the enlarged divided image 3b by the second lens 140. [

The distance from the center of the main 2-DOF mirror 120 to the center of the auxiliary 2-DOF mirror 130 is MD. Also, the distance from the virtual divided image 2b 'to the center of the auxiliary 2-DOF mirror 130 is also MD.

3A is a diagram for explaining conversion of a divided image into an enlarged divided image according to an embodiment of the present invention.

FIG. 3B is an enlarged view of the main 2-DOF mirror of FIG. 3A.

3A and 3B, in the case of the principal ray c passing through the first central axis of the first lens 110, the divided image 2c based on the principal ray c is incident on the auxiliary 2- 130 to the virtual partition image 2c '. The virtual divided image 2c 'is transmitted to the enlarged divided image 3c by the second lens 140. [ In this case, the center of the auxiliary two-degree of freedom mirror 130 is disposed at the position S '. In this case, the distance between the images is changed when compared with the previous enlarged divided image 3b in Fig. 2, so that the two-dimensional image sensor array also needs to change its position to pick up the enlarged divided image 3c clearly.

Therefore, there is a need for a method that can obtain the enlarged divided image without changing the position of the two-dimensional image sensor array. When the center of the auxiliary two-degree of freedom mirror 130 is moved from the point S 'to the point Q, the auxiliary two-degree-of-freedom mirror 130 is moved from the point P' The distance PQ to the center Q of the mirror 130 is given by MD in Fig. In this case, the conventional virtual divided image 2c 'moves to the new virtual divided image 2c' '. Further, the conventional enlarged divided image 3c moves to the new enlarged divided image 4c. Accordingly, the conventional object distance OD is changed to the new object distance OD ', and the conventional image distance ID is changed to the new image distance ID'. Thus, the two-dimensional image sensor array can capture the enlarged divided image 4c without changing its position.

4 is a conceptual diagram illustrating an imaging system according to an embodiment of the present invention.

Referring to Figures 1-4, an imaging system 100 includes a first lens 110 for converting an object of an object plane into an entire image of a first image plane; A second lens 140 disposed at a distance from the first central axis of the first lens 110 and having a second central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in a matrix form, A main two-degree-of-freedom mirror 120 for reflecting the light beam; And a second lens (140) disposed on a second central axis of the second lens (140) and provided to the center of the divided image reflected by the main 2-degree of freedom mirror (120) And a degree-of-freedom mirror 130. The second lens 140 enlarges the split image reflected by the main 2-DOF mirror 120 and the auxiliary 2-DOF mirror 130 onto the second image plane of the second lens 140 Thereby generating an enlarged divided image.

The first lens 110 may be a single lens or a plurality of lenses. The first lens 110 may include a convex lens. The first lens 110 has a first central axis passing through the center thereof. The first lens 110 is an image-forming lens and can define a field of view (FOV). The viewing angle determines the size of the object to be photographed. The viewing angle is defined by the angle between the circle surrounding the film and the lens. A principal ray passing through the center of the first lens 110 forms a principal ray spot in the form of a matrix in the first image plane of the first lens. The set of principal ray points within the range of viewing angles form the entire image.

When imaging the entire image with a megapixel level image sensor, the image resolution is low. Therefore, in order to obtain a high-resolution image with a megapixel level image sensor, it is necessary to enlarge each divided image and sequentially capture images on a megapixel level image sensor. In order to enlarge and deliver each divided image to the second image plane of the new second lens 140, a light transmission structure is required. To this end, a pair of 2-DOF mirrors may be used.

The second lens 140 can treat the divided image 2b of the first lens 110 as a virtual object image to generate the enlarged divided image 3b. Here, the virtual object image is a virtual divided image 2b '. The first central axis of the first lens 110 and the second central axis of the second lens 140 may be parallel to each other. In this case, each of the main 2-DOF mirror 120 and the auxiliary 2-DOF mirror 130 may be disposed at an angle of substantially 45 degrees with respect to the first central axis. Accordingly, the principal ray (b) incident parallel to the first central axis of the first lens 110 can travel parallel to the second central axis of the second lens.

The main 2-DOF mirror 120 can independently rotate about two axes perpendicular to each other in the arrangement plane of the main 2-DOF mirror. The main 2-DOF mirror 120 transmits each divided image to the center of the auxiliary 2-DOF mirror 130. Thus, the main 2-DOF mirror 120 can rotate based on two perpendicular axes (x ', y') in its placement plane. Thus, the main 2-DOF mirror 120 can transmit the selected split image to the center of the auxiliary 2-DOF mirror 130. [ The main 2-DOF mirror 120 may include a main 2-DOF mirror driver 122 that provides a tilt.

The auxiliary two-degree-of-freedom mirror 130 can be independently rotated about two axes perpendicular to each other in the arrangement plane of the auxiliary two-degree-of-freedom mirror 10. The split image transmitted to the center of the auxiliary 2-DOF mirror must be transmitted to the second image plane of the second lens 140. For this purpose, the auxiliary two-degree-of-freedom mirror 130 may rotate about two vertical axes (x ", y ") in its arrangement plane. The auxiliary 2-DOF mirror 130 may include an auxiliary 2-DOF mirror driver 132 capable of adjusting the tilt.

When the auxiliary two-degree-of-freedom mirror 130 adjusts the slice of the divided image to transfer the divided image (or virtual split image) to the second image plane, the second lens 140 and the virtual split image (2b ') may be different for each divided image. For all the divided images, the auxiliary two-degree of freedom mirror 130 can linearly move in the second central axis direction of the second lens so as to secure the same object distance.

The linear motion unit 134 can move the auxiliary two-degree of freedom mirror 130 in the second central axis direction. The linear motion unit 134 may move the distance calculated by the geometric structure for each divided image. For fast scanning, the linear motion unit 134 can perform a high-speed operation using a high-speed voice-coil motor or the like.

A diaphragm 142 is disposed between the auxiliary two-degree of freedom mirror 130 and the second lens 140, and neighboring divided images may have areas overlapping with each other by the diaphragm 142. The diaphragm 142 can adjust the size of the opening.

The image sensor array 150 is disposed in the second image plane of the second lens 140 to capture the enlarged divided image 3b. The image sensor array 150 may be a megapixel-level two-dimensional image sensor.

Each divided image captured by a megapixel image sensor is reconstructed into a single image by image synthesis technique called image stitching, resulting in a gigapixel image. However, in order for the individual divided images to be stitched to each other, the adjacent divided images usually have an overlapping area of 10 to 30 percent.

The processing unit 160 may control the main 2-DOF mirror and the auxiliary 2-DOF mirror. In addition, the processing unit 160 may combine the divided images into one image by an image synthesis technique called image stitching.

According to a modified embodiment of the present invention, instead of moving the auxiliary two-degree of freedom mirror 130 in the second central axis direction, the image sensor array 150 can move in the second central axis direction.

According to a modified embodiment of the present invention, in many cases of the divided image, specifically about 10 X 10, the auxiliary two-degree of freedom mirror 130 can be moved in the second central axis direction Can be provided.

5 is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.

Referring to FIG. 5, the imaging system 100a includes a first lens 110 for converting an object of an object plane into an entire image of a first image plane; A second lens 140 disposed at a distance from the first central axis of the first lens 110 and having a second central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in a matrix form, A main two-degree-of-freedom mirror 120 for reflecting the light beam; And a second lens (140) disposed on a second central axis of the second lens (140) and provided to the center of the divided image reflected by the main 2-degree of freedom mirror (120) And a degree-of-freedom mirror 130. The second lens 140 enlarges the split image reflected by the main 2-DOF mirror 120 and the auxiliary 2-DOF mirror 130 onto the second image plane of the second lens 140 Thereby generating an enlarged divided image.

 A method of obtaining the enlarged divided image without changing the position of the two-dimensional image sensor array 150 is required. For this purpose, the linear motion part 144 may move the second lens 140 in the second central axis direction. The linear motion unit 144 can move the distance calculated by the geometric structure for each divided image. For fast scanning, the linear motion unit 144 can perform a high-speed operation using a high-speed voice coil motor or the like.

6 is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.

Referring to FIG. 6, the imaging system 100b includes a first lens 110 that converts an object of an object plane into an entire image of a first image plane; A second lens 140 disposed at a distance from the first central axis of the first lens 110 and having a second central axis; A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in a matrix form, A main two-degree-of-freedom mirror 120 for reflecting the light beam; And a second lens (140) disposed on a second central axis of the second lens (140) and provided to the center of the divided image reflected by the main 2-degree of freedom mirror (120) And a degree-of-freedom mirror 130. The second lens 140 enlarges the split image reflected by the main 2-DOF mirror 120 and the auxiliary 2-DOF mirror 130 onto the second image plane of the second lens 140 Thereby generating an enlarged divided image.

 In order to change the position of the two-dimensional image sensor array 150, the sensor linear motion unit 155 may move the two-dimensional image sensor array 150 in the second central axis direction.

The sensor linear motion unit 155 can move the distance calculated by the geometric structure for each divided image. For fast scanning, the sensor linear motion unit 155 can perform a high-speed operation using a high-speed voice coil motor or the like.

7A is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.

FIG. 7B is a conceptual diagram illustrating the imaging system of FIG. 7A.

Fig. 7C is a view for explaining the divided image scanning of the imaging system of Fig. 7A. Fig.

7A through 7C, the imaging system 200 includes a first lens 110, a second lens 140, a main 2-degree of freedom mirror 120, an auxiliary 2-degree of freedom mirror 130, And an image sensor array 150.

The first lens 110 converts the object of the object plane into an entire image of the first image plane. The second lens 140 is disposed apart from the first central axis of the first lens and has a second central axis. The main two-degree-of-freedom mirror (120) is disposed in the first image plane at a first central axis of the first lens, and divides the entire image of the first image plane into a plurality of divided images in the form of a matrix , And one of the divided images is selected and reflected. The auxiliary two-degree-of-freedom mirror 130 is disposed at the second central axis of the second lens 140 and serves as a center of the divided image reflected by the main two- ). The image sensor array 150 picks up an enlarged divided image generated by enlarging the split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto the second image plane of the second lens.

The image sensor array 150 may be a plurality of image sensors, and the image sensor array may be disposed in a second image plane of the second lens 140. The number of the divided images may be an integral multiple of the number of the image sensor arrays 150. Each of the image sensor arrays 150a to 150i may be spaced apart from each other. As the divided images are scanned, the enlarged divided images can be sequentially picked up by the image sensor arrays 150a to 150i.

The first through third principal rays (a, b, c) passing through the center of the first lens 110 form respective principal ray points in the first image plane. The entire image can be divided into divided images of the same size based on the principal ray point. The main 2-DOF mirror 120 is disposed in the first image plane at the first central axis of the first lens 110. The main two-degree-of-freedom mirror 120 is arranged obliquely with respect to the first central axis, and a pair of coordinate axes (x 'axis and y' axis) perpendicular to the arrangement plane (x'y 'plane) To provide a tilt. Accordingly, the selected one divided image 20e is transmitted to the center of the auxiliary two-degree of freedom mirror 130 by the main two-degree of freedom mirror 120. [

The unselected divided images 20a to 20d and 20f to 20i can not be transmitted to the center of the auxiliary two-degree of freedom mirror 130. [ Therefore, the enlarged divided image can not be formed by the second lens 140.

The auxiliary 2-DOF mirror 130 may be aligned with the main 2-DOF mirror 120 in the x-axis direction. The auxiliary two-degree-of-freedom mirror 130 may be disposed on the second central axis of the second lens 140. The auxiliary two-degree of freedom mirror 130 is arranged on the second center axis of the second lens 140 to transmit the transferred division image 20e to the second lens 140, 0.0 > 20e '. ≪ / RTI > To this end, the secondary two-degree of freedom mirror 130 rotates about a pair of coordinate axes (x "and y" axes) perpendicular to its plane of placement (x "y" . The virtual divided image 20e 'is disposed in a virtual object plane of the second lens 140 and can function as an image pickup object of the second lens 140. [

In the case of the principal ray b passing through the first central axis of the first lens 110, the divided image 20e based on the principal ray b is divided into the virtual division image 20e '. The virtual divided image 20e 'is transmitted to the enlarged divided image 30e by the second lens 140. [

The distance from the center of the main 2-DOF mirror 120 to the center of the auxiliary 2-DOF mirror 130 is MD. Also, the distance from the virtual divided image 20e 'to the center of the auxiliary two-degree of freedom mirror 130 is also MD.

Referring to FIG. 7B, in the case of the principal ray c passing through the first central axis of the first lens 110, the divided image 20b based on the principal ray c is reflected by the auxiliary two-degree of freedom mirror 130 To the virtual partition image 20b '. The virtual divided image 20b 'is transmitted to the enlarged divided image 30b by the second lens 140. [

In this case, the center of the auxiliary two-degree of freedom mirror 130 is disposed at the position S '. In this case, the distance between the object images is changed when compared with the previous enlarged divided image 30e, so that the two-dimensional image sensor array also needs to change its position so that the enlarged divided image 30e can be captured clearly.

Therefore, there is a need for a method that can obtain the enlarged divided image without changing the position of the two-dimensional image sensor array. To this end, the auxiliary 2-DOF mirror 130 can move in the direction of the center axis.

The first lens 110 may be a single lens or a plurality of lenses. The first lens 110 may include a convex lens. The first lens 110 has a first central axis passing through the center thereof. The first lens 110 is an image-forming lens and can define a field of view (FOV). The viewing angle determines the size of the object to be photographed. The viewing angle is defined by the angle between the circle surrounding the film and the lens. A principal ray passing through the center of the first lens 110 forms a principal ray spot in the form of a matrix in the first image plane of the first lens. The set of principal ray points within the range of viewing angles form the entire image.

When imaging the entire image with a megapixel level image sensor, the image resolution is low. Therefore, in order to obtain a high-resolution image with a megapixel level image sensor, it is necessary to enlarge each divided image and sequentially capture images on a megapixel level image sensor. In order to enlarge and deliver each divided image to the second image plane of the new second lens 140, a light transmission structure is required. To this end, a pair of 2-DOF mirrors may be used.

The second lens 140 can treat the split image of the first lens 110 as a virtual object image to generate an enlarged divided image. Here, the virtual object image is a virtual divided image. The first central axis of the first lens 110 and the second central axis of the second lens 140 may be parallel to each other. In this case, each of the main 2-DOF mirror 120 and the auxiliary 2-DOF mirror 130 may be disposed at an angle of substantially 45 degrees with respect to the first central axis. Accordingly, the principal ray (b) incident parallel to the first central axis of the first lens 110 can travel parallel to the second central axis of the second lens.

The main 2-DOF mirror 120 can independently rotate about two axes perpendicular to each other in the arrangement plane of the main 2-DOF mirror. The main 2-DOF mirror 120 transmits each divided image to the center of the auxiliary 2-DOF mirror 130. Thus, the main 2-DOF mirror 120 can rotate based on two perpendicular axes (x ', y') in its placement plane. Thus, the main 2-DOF mirror 120 can transmit the selected split image to the center of the auxiliary 2-DOF mirror 130. [ The main 2-DOF mirror 120 may include a main 2-DOF mirror driver that provides a tilt.

The auxiliary two-degree-of-freedom mirror 130 can be independently rotated about two axes perpendicular to each other in the arrangement plane of the auxiliary two-degree-of-freedom mirror 10. The split image transmitted to the center of the auxiliary 2-DOF mirror must be transmitted to the second image plane of the second lens 140. For this purpose, the auxiliary two-degree-of-freedom mirror 130 may rotate about two vertical axes (x ", y ") in its arrangement plane. The auxiliary 2-DOF mirror 130 may include an auxiliary 2-DOF mirror driver capable of adjusting the tilt.

When the auxiliary two-degree-of-freedom mirror 130 adjusts the slice of the divided image to transfer the divided image (or virtual split image) to the second image plane, the second lens 140 and the virtual split image The object distance may be different for each divided image. For all the divided images, the auxiliary two-degree of freedom mirror 130 can linearly move in the second central axis direction of the second lens so as to secure the same object distance.

And the linear motion part can move the auxiliary two-degree-of-freedom mirror 130 in the second central axis direction. The linear motion unit 134 may move the distance calculated by the geometric structure for each divided image. For fast scanning, the linear motion unit can perform a high-speed operation using a high-speed voice coil motor or the like.

A diaphragm 142 is disposed between the auxiliary two-degree of freedom mirror 130 and the second lens 140, and neighboring divided images may have areas overlapping with each other by the diaphragm 142. The diaphragm 142 can adjust the size of the opening.

The image sensor array 150 is disposed in the second image plane of the second lens 140 to capture the enlarged divided image 3b. The image sensor array 150 may be a megapixel-level two-dimensional image sensor.

The image sensor array may be a CCD device or a CIS device. The image sensor array typically has a frame rate and has 30 to 60 fps (frame per second).

If the number of divided images is 100, and the frame rate is 50 fps, 2 seconds are consumed to capture the entire image. Thus, in order to increase the imaging speed, a plurality of image sensor arrays 150 can be arranged. Each image sensor array 150a-150i operates with a fixed frame rate, but since there are a plurality of image sensor arrays, the total imaging time is reduced by the number of image sensor arrays. For example, in the above example, if there are 10 image sensor arrays, the total imaging time is reduced to 0.2 seconds. Thus, high-speed imaging is possible using an image sensor array having a low frame rate.

The plurality of image sensor arrays 150 may be arranged in a matrix form on the second image plane of the second lens. The image sensor arrays can be sequentially picked up in accordance with the scanning order. If there are nine segment images and nine image sensor arrays, during one period of scanning the segment images, the image sensor array may capture one enlarged segment image.

According to a modified embodiment of the present invention, the image sensor array can be configured to be set to a value obtained by dividing the number of fixed divided images by an integer.

According to a modified embodiment of the present invention, in order to obtain a clearer image for each divided image, the second lens may include a second rent tilde portion 245 to perform a 2-degree freedom tilt function. Accordingly, the virtual divided image and the enlarged divided image can be disposed on the central axis of the second lens.

Each divided image captured by a megapixel image sensor is reconstructed into a single image by image synthesis technique called image stitching, resulting in a gigapixel image. However, in order for the individual divided images to be stitched to each other, the adjacent divided images usually have an overlapping area of 10 to 30 percent.

The processing unit 160 may control the main 2-DOF mirror and the auxiliary 2-DOF mirror. In addition, the processing unit 160 may receive enlarged divided images from the plurality of image sensor arrays 150, and may combine the divided images into one image by an image synthesis technique called image stitching.

8 is a view for explaining a divided image scanning of an imaging system according to another embodiment of the present invention.

8, when the number of divided images is nine, and the image sensor arrays 150a, 150b, and 150c are three, when the image sensor array 150a is scanned by a raster scanning method, The three divided images 30a, 30d and 30g can be picked up under the scanning operation condition of one period. Further, the second image sensor array 150b can capture three divided images 30b, 30e, and 30h in a scanning operation condition of one cycle. Further, the third image sensor array 150c can capture three divided images 30c, 30f, and 30i under scanning operation conditions of one period.

9A is a conceptual diagram illustrating an imaging system according to another embodiment of the present invention.

FIG. 9B is a conceptual diagram showing the operation state of FIG. 9A.

9A and 9B, the imaging system 300 includes a first lens 110, a plurality of second lenses 140, a main 2-degree of freedom mirror 120, an auxiliary 2-degree of freedom mirror 130, , And a plurality of image sensor arrays (150). The first lens 110 converts the object of the object plane into an entire image of the first image plane. The plurality of second lenses 140 are disposed apart from the first central axis of the first lens and have respective central axes. The main two-degree-of-freedom mirror (120) is disposed in the first image plane at a first central axis of the first lens, and divides the entire image of the first image plane into a plurality of divided images in the form of a matrix , And one of the divided images is selected and reflected. The auxiliary two-degree-of-freedom mirror 130 is disposed at the center axis of the second lens and provides a divided image reflected by the main two-degree-of-freedom mirror as a center thereof to the second lens. The plurality of image sensor arrays pick up an enlarged divided image generated by enlarging the split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto the second image surface. The second lens and the image sensor array are configured to pair with each other.

Wherein the image sensor array (150) is less than or equal to the number of divided images and the second lens is disposed on a curved surface having a predetermined first radius of curvature, each of the image sensor arrays having a second radius of curvature And the enlarged divided image is sequentially picked up by the image sensor array as the divided image is scanned. The center of the first radius of curvature may be the center of the auxiliary 2-DOF mirror 130. Also, the center of the second radius of curvature may be the center of the auxiliary 2-DOF mirror 130.

The first through third principal rays (a, b, c) passing through the center of the first lens 110 form respective principal ray points in the first image plane. The entire image can be divided into divided images of the same size based on the principal ray point. The main 2-DOF mirror 120 is disposed in the first image plane at the first central axis of the first lens 110. The main two-degree-of-freedom mirror 120 is arranged obliquely with respect to the first central axis, and a pair of coordinate axes (x 'axis and y' axis) perpendicular to the arrangement plane (x'y 'plane) To provide a tilt. Accordingly, the selected one divided image 20e is transmitted to the center of the auxiliary two-degree of freedom mirror 130 by the main two-degree of freedom mirror 120. [

The unselected divided images 20a to 20d and 20f to 20i can not be transmitted to the center of the auxiliary two-degree of freedom mirror 130. [ Therefore, the enlarged divided image can not be formed by the second lens 140.

The auxiliary 2-DOF mirror 130 may be aligned with the main 2-DOF mirror 120 in the x-axis direction. The auxiliary two-degree-of-freedom mirror 130 may be disposed on the second central axis of the second lens 140. The auxiliary two-degree of freedom mirror 130 is arranged on the second center axis of the second lens 140 to transmit the transferred division image 20e to the second lens 140, 0.0 > 20e '. ≪ / RTI > To this end, the secondary two-degree of freedom mirror 130 rotates about a pair of coordinate axes (x "and y" axes) perpendicular to its plane of placement (x "y" . The virtual divided image 20e 'is disposed in a virtual object plane of the second lens 140 and can function as an image pickup object of the second lens 140. [

In the case of the principal ray b passing through the first central axis of the first lens 110, the divided image 20e based on the principal ray b is divided into the virtual division image 20e '. The virtual divided image 20e 'is transmitted to the enlarged divided image 30e by the second lens 140. [

The distance from the center of the main 2-DOF mirror 120 to the center of the auxiliary 2-DOF mirror 130 is MD. Also, the distance from the virtual divided image 20e 'to the center of the auxiliary two-degree of freedom mirror 130 is also MD.

Referring again to FIG. 9B, in the case of the principal ray c passing through the first central axis of the first lens 110, the divided image 20b based on the principal ray c is incident on the auxiliary two-degree of freedom mirror 130 To the virtual partition image 20b '. The virtual divided image 20b 'is transmitted to the enlarged divided image 30b by the second lens 140. [

In this case, the center of the auxiliary two-degree of freedom mirror 130 is disposed at the position S '. In this case, the distance between the object images is changed when compared with the previous enlarged divided image 30e, so that the two-dimensional image sensor array also needs to change its position so that the enlarged divided image 30e can be captured clearly.

Therefore, there is a need for a method that can obtain the enlarged divided image without changing the position of the two-dimensional image sensor array. To this end, the auxiliary 2-DOF mirror 130 can move in the direction of the center axis.

The first lens 110 may be a single lens or a plurality of lenses. The first lens 110 may include a convex lens. The first lens 110 has a first central axis passing through the center thereof. The first lens 110 is an image-forming lens and can define a field of view (FOV). The viewing angle determines the size of the object to be photographed. The viewing angle is defined by the angle between the circle surrounding the film and the lens. A principal ray passing through the center of the first lens 110 forms a principal ray spot in the form of a matrix in the first image plane of the first lens. The set of principal ray points within the range of viewing angles form the entire image.

When imaging the entire image with a megapixel level image sensor, the image resolution is low. Therefore, in order to obtain a high-resolution image with a megapixel level image sensor, it is necessary to enlarge each divided image and sequentially capture images on a megapixel level image sensor. In order to enlarge and deliver each divided image to the second image plane of the new second lens 140, a light transmission structure is required. To this end, a pair of 2-DOF mirrors may be used.

The second lens 140 may be a plurality of lenses. The second lens 140 may be disposed at regular intervals on a curved surface having a certain radius of curvature with respect to the center of the auxiliary two-degree-of-freedom mirror. The second lens 140 can treat the split image of the first lens 110 as a virtual object image to generate an enlarged divided image. Here, the virtual object image is a virtual divided image.

The main 2-DOF mirror 120 can independently rotate about two axes perpendicular to each other in the arrangement plane of the main 2-DOF mirror. The main 2-DOF mirror 120 transmits each divided image to the center of the auxiliary 2-DOF mirror 130. Thus, the main 2-DOF mirror 120 can rotate based on two perpendicular axes (x ', y') in its placement plane. Thus, the main 2-DOF mirror 120 can transmit the selected split image to the center of the auxiliary 2-DOF mirror 130. [ The main 2-DOF mirror 120 may include a main 2-DOF mirror driver that provides a tilt.

The auxiliary two-degree-of-freedom mirror 130 can be independently rotated about two axes perpendicular to each other in the arrangement plane of the auxiliary two-degree-of-freedom mirror 10. The split image transmitted to the center of the auxiliary 2-DOF mirror must be transmitted to the second image plane of the second lens 140. For this purpose, the auxiliary two-degree-of-freedom mirror 130 may rotate about two vertical axes (x ", y ") in its arrangement plane. The auxiliary 2-DOF mirror 130 may include an auxiliary 2-DOF mirror driver capable of adjusting the tilt.

When the auxiliary two-degree-of-freedom mirror 130 adjusts the slice of the divided image to transfer the divided image (or virtual split image) to the second image plane, the second lens 140 and the virtual split image The object distance may be different for each divided image. For all the divided images, the auxiliary two-degree of freedom mirror 130 can linearly move in the second central axis direction of the second lens so as to secure the same object distance.

And the linear motion part can move the auxiliary two-degree-of-freedom mirror 130 in the second central axis direction. The linear motion unit 134 may move the distance calculated by the geometric structure for each divided image. For fast scanning, the linear motion unit can perform a high-speed operation using a high-speed voice coil motor or the like.

The image sensor array 150 is disposed in the second image plane of the second lens 140 to capture the enlarged divided image. The image sensor array 150 may be a megapixel-level two-dimensional image sensor. The image sensor array may be arranged at regular intervals on an image curved surface having a certain radius of curvature with respect to the center of the auxiliary two-degree-of-freedom mirror. The image sensor array 150a and the second lens 140a may form a pair, and the paired image sensor array may be disposed on the center axis of the paired second lens.

The image sensor array may be a CCD device or a CIS device. The image sensor array typically has a frame rate and has 30 to 60 fps (frame per second).

If the number of divided images is 100, and the frame rate is 50 fps, 2 seconds are consumed to capture the entire image. Thus, in order to increase the imaging speed, a plurality of image sensor arrays can be arranged. Each image sensor array operates with a fixed frame rate, but since there are a plurality of image sensor arrays, the total imaging time is reduced by the number of image sensor arrays. For example, in the above example, if there are 10 image sensor arrays, the total imaging time is reduced to 0.2 seconds. Thus, high-speed imaging is possible using an image sensor array having a low frame rate.

The plurality of image sensor arrays 150a, 150b, and 150c may be arranged in a matrix form on the image surface. The image sensor arrays can be sequentially picked up in accordance with the scanning order. During one period of scanning the divided images, each of the image sensor arrays (150a, 150b, 150), when there are nine divided images and three image sensor arrays (150a, 150b, 150) Can be picked up.

According to a modified embodiment of the present invention, the image sensor array can be configured to be set to a value obtained by dividing the number of fixed divided images by an integer.

Each divided image captured by a megapixel image sensor is reconstructed into a single image by image synthesis technique called image stitching, resulting in a gigapixel image. However, in order for the individual divided images to be stitched to each other, the adjacent divided images usually have an overlapping area of 10 to 30 percent.

The processing unit 160 may control the main 2-DOF mirror and the auxiliary 2-DOF mirror. In addition, the processing unit 160 may receive enlarged divided images from the plurality of image sensor arrays 150, and may combine the divided images into one image by an image synthesis technique called image stitching.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, And all of the various forms of embodiments that can be practiced without departing from the technical spirit.

110: first lens
120: Main 2-DOF mirror
130: auxiliary two-degree-of-freedom mirror
140: Second lens
150: Image sensor array

Claims (13)

A first lens that converts the object of the object plane into an entire image of the first image plane;
A second lens disposed at a distance from the first central axis of the first lens and having a second central axis;
A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix, Main 2-Degree-of-Freedom Mirror;
A second two-degree-of-freedom mirror disposed at a second central axis of the second lens and providing a divided image reflected by the main two-degree-of-freedom mirror as a center thereof to the second lens; And
And an image sensor array for picking up an enlarged divided image generated by enlarging the split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto a second image plane of the second lens,
The first lens is an imaging lens,
The auxiliary two-degree of freedom mirror forms a virtual split image on a virtual object plane on a second central axis of the second lens to transfer the provided split image to a second lens,
The virtual divided image is arranged in a virtual object plane of the second lens, and functions as an image pickup target of the second lens,
Wherein the second lens treats the division image of the first lens as a virtual division image to generate an enlarged division image. The method according to claim 1,
The image sensor array includes a plurality of image sensors,
Wherein the image sensor array is disposed in a second image plane of the second lens,
Wherein the number of divided images is an integral multiple of the number of the image sensor arrays,
Each of the image sensor arrays being disposed spaced apart,
And wherein, by scanning the segmented image, the enlarged segmented image is sequentially imaged onto the image sensor array. The method according to claim 1,
Wherein the main 2-DOF mirror independently rotates about two axes perpendicular to each other in a plane of arrangement of the main 2-DOF mirror. The method according to claim 1,
Wherein the auxiliary two-degree of freedom mirror rotates independently about two axes perpendicular to each other in an arrangement plane of the auxiliary two-degree of freedom mirror. The method according to claim 1,
Wherein the first central axis and the second central axis are parallel to each other. The method according to claim 1,
Further comprising a linear motion portion for moving the auxiliary two-degree of freedom mirror in the second central axis direction. The method according to claim 1,
Further comprising a diaphragm disposed between the auxiliary 2-DOF mirror and the second lens,
Wherein the neighboring divided images have areas overlapping each other. A first lens that converts the object of the object plane into an entire image of the first image plane;
A plurality of second lenses spaced apart from a first central axis of the first lens and each having a central axis;
A first lens disposed on the first image plane at a first central axis of the first lens and dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix, Main 2-Degree-of-Freedom Mirror;
A second two-degree-of-freedom mirror disposed at a center axis of the second lens and serving as a center of the divided image reflected by the main two-degree-of-freedom mirror and providing the split image to the second lens; And
And a plurality of image sensor arrays for picking up an enlarged divided image generated by enlarging the split image reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror on a second image curved surface,
The first lens is an imaging lens,
The auxiliary two-degree of freedom mirror forms a virtual split image on a virtual object plane on a second central axis of the second lens to transfer the provided split image to a second lens,
The virtual divided image is arranged in a virtual object plane of the second lens, and functions as an image pickup target of the second lens,
Wherein the second lens treats the division image of the first lens as a virtual division image to generate an enlarged division image,
Wherein the second lens and the image sensor array are configured to pair with each other. 9. The method of claim 8,
Wherein the image sensor array is less than or equal to the number of the divided images,
Wherein the second lens is disposed on a curved surface having a predetermined first radius of curvature,
Each of the image sensor arrays being disposed on a curved surface of a second radius of curvature larger than the first radius of curvature,
And wherein, by scanning the segmented image, the enlarged segmented image is sequentially imaged onto the image sensor array. 9. The method of claim 8,
Wherein the main 2-DOF mirror independently rotates about two axes perpendicular to each other in a plane of arrangement of the main 2-DOF mirror. 9. The method of claim 8,
Wherein the auxiliary two-degree of freedom mirror rotates independently about two axes perpendicular to each other in an arrangement plane of the auxiliary two-degree of freedom mirror. Converting an object of the object plane into an entire image of the first image plane using the first lens;
Dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix using a main two-degree-of-freedom mirror disposed in the first image plane at a first central axis of the first lens, Selecting and reflecting one of them;
Providing a split image reflected by the main 2-DOF mirror at the center thereof to the second lens using an auxiliary 2-DOF mirror disposed on a second central axis of the second lens;
Degree mirror and the auxiliary two-degree-of-freedom mirror using a second lens disposed at a vertical distance from the first central axis of the first lens and having a second central axis, Enlarging the second image plane of the second lens to produce an enlarged divided image; And
And capturing the enlarged divided image,
The first lens is an imaging lens,
The auxiliary two-degree of freedom mirror forms a virtual split image on a virtual object plane on a second central axis of the second lens to transfer the provided split image to a second lens,
The virtual divided image is arranged in a virtual object plane of the second lens, and functions as an image pickup target of the second lens,
Wherein the second lens treats the division image of the first lens as a virtual division image to generate an enlarged division image,
Wherein the enlarged divided images are sequentially picked up by a plurality of image sensor arrays as the divided images are scanned. Converting an object of the object plane into an entire image of the first image plane using the first lens;
Dividing the entire image of the first image plane into a plurality of divided images in the form of a matrix using a main two-degree-of-freedom mirror disposed in the first image plane at a first central axis of the first lens, Selecting and reflecting one of them;
Providing a divided image reflected by the main 2-DOF mirror at the center thereof to the second lens using an auxiliary 2-DOF mirror disposed on the central axis of the plurality of second lenses;
Enlarging a split image, which is reflected by the main 2-DOF mirror and the auxiliary 2-DOF mirror, onto a second image surface using the second lens to produce an enlarged split image; And
And capturing the enlarged divided image,
The first lens is an imaging lens,
The auxiliary two-degree of freedom mirror forms a virtual split image on a virtual object plane on a second central axis of the second lens to transfer the provided split image to a second lens,
The virtual divided image is arranged in a virtual object plane of the second lens, and functions as an image pickup target of the second lens,
Wherein the second lens treats the division image of the first lens as a virtual division image to generate an enlarged division image,
Wherein the enlarged divided images are sequentially picked up by a plurality of image sensor arrays as the divided images are scanned.

Images