JP2002314870A - Imaging device, method, program, and computer-readable record medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To cope with a variety of image standard easily without changing the angle of view in photographing. SOLUTION: An image sensor 110 having a random access function comprises a light reception section 111 conforming to an HD format, an HSR 112, a VSR 113, an H decoder 114, and a V decoder 115, thus inserting a start pulse at an arbitrary location in several bit units, and hence starting scanning from an arbitrary location in a sensor region. Then, for example, when reading only a region in an SD angle of view from the image sensor region of the HD angle of view, a variable magnification lens 102 at a lens block 100 is moved to a wide-angle side for switching so that it becomes the same as the original HD angle of view.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging apparatus, a method,
The present invention relates to a program and a computer-readable storage medium, and more particularly to a program using an imaging unit having a random access function.

[0002]

2. Description of the Related Art An image sensor composed of a solid-state image sensor having a color filter is used in various video equipment such as a video camera for photographing moving images and an electronic still camera for photographing still images.

[0003] Recent advances in semiconductor technology have led to the development of image sensors with millions of pixels, which have enabled the capture of delicate still images. Such an image sensor is required not only in electronic still cameras and the like that require high resolution, but also in digital video that originally did not require such high resolution exceeding several million pixels, and when shooting moving images, In addition, a method has been adopted in which the reading frequency of the signal of the image sensor is made higher than that in the case of a still image, or the signal from the image sensor is thinned out to substantially reduce the number of pixels for reading.

In such a high pixel sensor, X-Y
Among image sensors of the address system, an imaging device proposed in Japanese Patent Application No. 2984437 has been known because of its feature of random access. There, the imaging device is HDTV (1920 × 1080 pixels), SXG
A (1280 x 1024 pixels), SVGA (1204 x
768 pixels), the HDTV is set to the all-pixel read mode, and in other modes, the block read mode is performed by random access.
Partial reading is performed so as to conform to the standard.

[0005]

However, in the above-described image pickup apparatus corresponding to the video standard, a phenomenon occurs in which the image pickup angle of view changes in each mode because block reading is simply performed (see FIG. 5). . The image recording format (GIF, VGA, XG
A), a similar phenomenon occurs.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has as its object to easily correspond to various video standards without changing the angle of view.

[0007]

According to the present invention, there is provided an image pickup apparatus comprising: a pixel selecting means for arbitrarily selecting a pixel included in an image pickup area of the image pickup means; and a lens for changing the magnification of a subject image by optical displacement of an image pickup lens. And a view angle control means for controlling the system.

Another feature of the image pickup apparatus of the present invention resides in that control means for interlocking the angle-of-view control means and the image pickup means is provided.

Another feature of the image pickup apparatus of the present invention is that it can be displayed on a monitor of a different format without changing the angle of view.

Another feature of the image pickup apparatus of the present invention is that the image pickup means is an image sensor capable of progressive reading.

Another feature of the image pickup apparatus of the present invention resides in that a conversion means for performing interlace-progressive conversion is provided.

Another feature of the image pickup apparatus of the present invention is that images having different numbers of pixels can be recorded without changing the angle of view.

Another feature of the image pickup apparatus of the present invention resides in that the control means interlocks the electronic zoom.

According to the imaging method of the present invention, there is provided a pixel selection process for arbitrarily selecting a pixel included in an imaging area of an imaging means, and an angle of view for controlling a lens system for performing magnification of a subject image by optical displacement of an imaging lens. It is characterized by having control processing.

The program according to the present invention comprises a pixel selection process for arbitrarily selecting a pixel included in an image pickup area of an image pickup means, and an angle of view control for controlling a lens system for changing the magnification of a subject image by optical displacement of an image pickup lens. It is characterized in that processing is performed.

A computer-readable storage medium according to the present invention includes a lens system for arbitrarily selecting a pixel included in an imaging region of an imaging unit and a lens system for performing magnification of a subject image by optical displacement of an imaging lens. The feature is that a program for executing the control of the angle of view control processing is stored.

[0017]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing the configuration of an image pickup apparatus, a method, a program, and a computer-readable storage medium according to the present invention.

FIG. 1 is an overall block diagram of an imaging apparatus according to the present embodiment. In the figure, incident light enters a lens block 100. The lens block 100 shown in FIG.
As shown in the figure, the first fixed lens 101 and the variable power lens 10
2, a stop 103, a second fixed lens 104, and a focus lens 105.

For the movable lenses other than the fixed lenses 101 and 104, the lens system control unit 2
20. Variable magnification lens 1 which is a movable lens
02, the amount of displacement due to the movement of the aperture 103 and the focus lens 105 is controlled by feeding back the pulse amount of a position encoder or a stepping motor to the lens system control unit 220.

The incident light passing through the lens block 100 forms an image on the sensor surface of an image sensor 110 which is an amplification type solid-state image sensor, and is photoelectrically converted in the solid-state image sensor. The TG 210 gives a drive timing to the image sensor 110.

The converted analog electric quantity is AGC1
At 20, a desired gain is given, and converted into a digital value by the ADC 130.

Thereafter, a series of signal processing for the camera, such as color interpolation, color separation, and luminance component enhancement, is performed by the camera DSP 150, and the output / display standard to the electronic viewfinder (EVF) 160, the monitor 170, and the recording medium 180 is performed. Is attached and controlled to correspond to.

When the electronic zoom is ON, the zoom processing unit 190 performs an electronic zoom, such as spline interpolation, for inflating pixels on the image data processed by the camera DSP 150.

In order to correspond to these electronic zoom and output / display standards, a memory for one frame or more is provided in the DRAM 140, and mutual exchange is performed between the camera DSP 150 and the electronic zoom processing unit 190.

The details of the DRAM 14 will be described later.
The combination of “0” and the camera DSP 150 is also used to adjust the aspect ratio of the screen when switching the video format.

A system control unit 200 is provided to control each unit that handles these image data. The system control unit 200 controls the entire system via a lens system control unit 220 that controls the lens block 100, a TG 210 that gives drive timing to the image sensor 100, an AGC 120, and an electronic zoom processing unit 190.

FIG. 3 shows an example of the image sensor 110 having a random access function. Here, a description will be given of an example of a sensor in which the number of pixels is adjusted to the largest one of the existing monitor standards. As shown in the figure, the light receiving unit 111 of 1920 pixels × 1080 pixels conforming to the HD format is used.
A horizontal shift register (HSR) 112 that enables the X address of the light receiving unit 111 and scans each pixel in the horizontal direction by a start pulse;
Similarly, a vertical shift register (VSR) 113 capable of validating a Y address in the vertical direction and scanning each pixel by a start pulse, and an H decoder 11
4. It is composed of a V decoder 115.

As a result, all bits cannot be read out in a random access manner, but a start pulse can be applied to an arbitrary place in units of several bits, and scanning can be started from an arbitrary place in the sensor area. When the shift register moves to that position, the HSR 112 is forcibly supplied with a start pulse from the H decoder 114 to return the HSR 112 to the initial state.
Move 3 forward one line and move to the next line. Alternatively, the end position is also determined by the H decoder 114 and the V decoder 1 by other methods.
15 and forcedly terminated when it reaches this position.

With the above structure, as shown in FIG.
It is possible to read out an arbitrary area in 20 × 1080 pixels as a block. For example, using this sensor 110, it is possible to scan only an area corresponding to the SD format (720 × 480 pixels). .

FIG. 5 is a diagram for explaining an example of linked use of lenses. As described above, when only the area of the SD angle of view is read from the image sensor area of the HD angle of view, FIG.
The angle of view changes as shown in FIG. Therefore, the variable power lens 102 in the lens block 100 is moved to the wide angle side, and as shown in FIG. 5B, switching is performed so as to be the same as the original HD angle of view.

In this case, it is possible to switch between two modes, an up-down priority mode and a left-right priority mode. FIG. 6 is a diagram for explaining each mode. FIG. 6 (A)
FIG. 4 is a diagram for explaining an up / down priority mode. When the variable power lens 102 is moved to change from the HD angle of view to the SD angle of view, the zooming lens 102 is moved so that the angle of view vertically and the angle of view coincide with each other. As a result, the subject images at the right end and the left end are cut off, and the start and end positions in the sensor are set to the start position A and the end position A as shown in FIG.

FIG. 6B is a diagram for explaining the left-right priority mode. Zoom lens 1 to change to SD angle of view
When moving 02, the camera moves so that the angle of view matches the HD angle of view with the left and right. As a result, the upper and lower portions having no image data are moved to the monitor.
In P150, it is fixed to black and output on the monitor. The start and end positions in the sensor are set at a start position B and an end position B as shown in FIG.

Although there are two modes as described above, since there is a slight difference in the angle of view between these modes, it is necessary to move the variable power lens 102 in accordance with these.

Next, FIG. 7 is a diagram for explaining a reading method of the progressive reading type sensor 110 which can be randomly accessed. The alphabet shown in the figure indicates one pixel, and indicates the way of output when each is read.

In the case of 1-channel output, A, B, and
Are output as C, D, E. In the case of 2ch output, 1ch is output as A, B, C, D, I, J, K, L for every other row, and E, F, G, H, M, N, O, P for the other ch. . Thereby, 1ch can always output the ODD field, and 2ch can output the EVEN field. In the case of 4-channel output, four pixels A, B, E, and F are output corresponding to channels 1 to 4 respectively.

With reference to FIGS. 8 to 10, progressive / interlace conversion (P / I conversion) corresponding to each reading method will be described. FIG. 8 is a diagram for explaining the case where the output from the progressive scan type sensor is a 1-channel output.
30 and input to the camera DSP 150. Thereafter, the image data input in 1ch is transferred to the camera DS
A series of processes are performed by the camera signal processing unit 151 in the P150, and are buffered in the external DRAM 140.

In the DRAM 140, two field memories 141 are formed, and the ODD is switched by a switch for each horizontal line of image data.
Field and the EVEN field. A switch is provided for switching the field of each of the DRAMs 140 for each field, and reading is performed. When outputting as a video, the video format conversion unit 153 and the recording format conversion unit 154 perform output after making them correspond to the respective standards.

FIG. 9 is a diagram for explaining a case where the output from the sensor is a 2cb output. At this time, since 1ch and 2ch correspond to each horizontal line as shown in FIG. 7, the selection can be performed for each field after the processing is performed by the camera signal processing unit 151 in the camera DSP 150. Output is selected by switch. After that, the video format converter 153 and the recording format converter 1
At 54, output is performed after making it correspond to each standard.

FIG. 10 is a diagram for explaining the case of 4ch output from the sensor. At this time, 2 × 2 pixels are simultaneously input to the camera DSP 150 in one clock, and
The pixels are simultaneously processed by the camera signal processing unit 151. Two selection switches that can be switched for each field are provided, and switching is performed so that only necessary fields are output. Finally, the video format conversion unit 153 and the recording format conversion unit 154 correspond to the respective standards, and then 2 channels are set. Output at the same time. Also, the DRAM 14
It is also possible to store one frame of image data in 0 and output only the necessary field data at the time of reading.

Next, simply, from a sensor having a pixel size conforming to the HD format, an XGA (1024 × 7
An example in which only the (68 pixels) region is read out in a block manner will be described. As described with reference to FIG. 4, at this time, the in-sensor scanning start position and the in-sensor scanning end position are adjusted, and the in-sensor scanning range is limited to the XGA (1024 × 768 pixels) area. In addition, the lens block 100
The variable magnification lens 102 is moved to the wide angle side so that the angle of view of the image is not cut off as shown in FIG. 5A, and then an image is recorded according to the standard conforming to the recording medium 180.

Similarly, other recording formats such as SXGA (1280 × 1024 pixels) and SVGA (80
Similarly, for the VGA (640 × 480 pixels) and the VGA (640 × 480 pixels), the scanning range in the sensor is limited, and the variable-magnification lens 102 is moved to match the angle of view. Thereafter, an image is recorded on the recording medium 180 in the same manner.

Since this sensor is a progressive scan type sensor, it has a feature that recording and reproduction can be performed as it is.

Since the sensor 110 is an image sensor capable of random access as described with reference to FIG. 3, a start pulse for starting scanning can be input to an arbitrary position in the sensor by the address decoder of the H decoder 114 and the V decoder 115. . Thereby, as shown in FIG. 11, in a smaller area in the sensor, the arbitrary area and the start position can be changed at the same time. A shown in the figure is 1/16 of the original angle of view. B is 1/9 of the original angle of view, and C is 1/4 of the original angle of view. These are determined by how much the HSR 114 and the VSR 113 have been moved as described above. Further, since the start position can be moved by the H decoder 114 and the V decoder 115, it is possible to change the start position from A to B to C for each frame, for example.

In FIG. 11, for example, when only the position B at the center of the angle of view is used at 1/9 of the HD angle of view, if it is desired to enlarge the area, it has been used so far to have the same angle of view. By moving the variable power lens 102 to the enlargement side, optical enlargement can be performed. In addition, electronic zoom can be performed by inflating processing in the zoom processing unit 190. Thus, when the moving amount of the variable power lens 102 reaches the maximum value due to the optical zoom, the processing is automatically switched to the electronic zoom processing, and further enlargement is performed.

Here, not only the region B in FIG.
The same can be performed in the area C. FIG.
Indicates that a VAP (Variable Angle P
rism: variable apex prism) 106, displacement is detected by the angular velocity detector 107 and the apex angle detector 108, and these are controlled by the system control unit 200.
Is moved by the driving means 109. In addition, VA
P106 is an optical element in which a liquid having a high refractive index is sealed between two parallel glass plates, and the speed of light incident on the camera lens can be freely controlled by controlling the top and bottom apex angles and the left and right apex angles. It can be refracted.

As a result, even if an arbitrary area is read from an arbitrary position in a block manner, optical zoom can be performed, and electronic zoom can be performed from the limit of optical zoom. As a result, it is possible to magnify and reproduce the image that the user wants to focus on without moving the camera itself.

In order to operate various devices for realizing the functions of the above-described embodiments, an apparatus connected to the various devices or a computer in a system is required to realize the functions of the above-described embodiments. The present invention also includes a case in which the present invention is implemented by supplying a program code of software and operating the various devices according to a program stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the software program code itself implements the functions of the above-described embodiment, and the program code itself constitutes the present invention. Means for supplying the program code to the computer, for example, a recording medium storing the program code constitutes the present invention. As a recording medium for storing such a program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk,
A magneto-optical disk, CD-ROM, magnetic tape, nonvolatile memory card, ROM, or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the OS (operating system) or other operating system in which the program code runs on the computer. It goes without saying that such program codes are also included in the embodiments of the present invention when the functions of the above-described embodiments are realized in cooperation with the application software or the like.

Further, after the supplied program code is stored in the memory provided on the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or the function expansion unit is stored based on the instruction of the program code. It is needless to say that the present invention also includes a case where the CPU or the like provided for performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

It should be noted that the shapes and structures of the respective parts shown in the above-described embodiments are merely examples of the embodiment for carrying out the present invention, and the technical scope of the present invention is thereby reduced. It should not be interpreted restrictively. That is, the present invention can be implemented in various forms without departing from the spirit or main features thereof.

[0052]

As described above, according to the present invention, it is possible to easily cope with various video standards without changing the shooting angle of view.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of an imaging device.

FIG. 2 is a diagram showing a configuration of a lens block.

FIG. 3 is a diagram illustrating an example of an image sensor that can be randomly accessed.

FIG. 4 is a diagram illustrating an example of use of random access.

FIG. 5 is a diagram for explaining a case where the angle of view is not adjusted by a lens and a case where the angle of view is adjusted;

FIG. 6 is a diagram for explaining a vertical priority mode and a horizontal priority mode.

FIG. 7 is a diagram for explaining an output method in sensor reading.

FIG. 8 is a diagram for explaining interlace conversion in a sensor 1-line output.

FIG. 9 is a diagram for explaining interlace conversion in a sensor 2-line output.

FIG. 10 is a diagram for explaining interlace conversion in a sensor 4-line output.

FIG. 11 is a diagram for explaining an example in which an arbitrary area and a start position are simultaneously changed by random access in a sensor.

FIG. 12 is a diagram showing a configuration of a lens block incorporating a VAP.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 Lens block 110 Image sensor 120 AGC 130 ADC 140 DRAM 150 Camera DSP 160 EVF 170 Monitor 180 Recording medium 190 Zoom processing unit 200 System control unit 102 Zoom lens 112 HSR 113 VSR 114 H decoder 115 V decoder

Continued on front page F term (reference) 2H054 AA01 2H101 DD00 5C022 AB36 AB62 AB66 AC42 AC54 5C024 CY07 CY19 EX42 EX47 GY36 GY37 JX08 JX12

Claims (10)

[Claims] 1. An image pickup apparatus comprising: a pixel selection unit for arbitrarily selecting a pixel included in an imaging region of an imaging unit; and an angle-of-view control unit for controlling a lens system for changing a magnification of a subject image by optical displacement of an imaging lens. An imaging device characterized in that: 2. The imaging apparatus according to claim 1, further comprising control means for interlocking said angle-of-view control means and said imaging means. 3. The display according to claim 1, wherein the display can be performed on a monitor of a different format without changing a photographing angle of view.
An imaging device according to claim 1. 4. The apparatus according to claim 1, wherein said image pickup means is an image sensor capable of progressive reading.
An imaging device according to claim 1. 5. The imaging apparatus according to claim 4, further comprising a conversion unit that performs interlace-progressive conversion. 6. The image pickup apparatus according to claim 1, wherein images having different numbers of pixels can be recorded without changing a photographing angle of view. 7. The image pickup apparatus according to claim 2, wherein the control unit operates an electronic zoom in conjunction with the electronic zoom. 8. A pixel selection process for arbitrarily selecting a pixel included in an imaging region of an imaging unit, and an angle-of-view control process for controlling a lens system that performs magnification of a subject image by optical displacement of an imaging lens. An imaging method characterized in that: 9. A pixel selection process for arbitrarily selecting a pixel included in an imaging region of an imaging unit and an angle-of-view control process for controlling a lens system that performs magnification of a subject image by optical displacement of an imaging lens. A program characterized by causing 10. A pixel selection process for arbitrarily selecting a pixel included in an imaging area of an imaging unit, and an angle-of-view control process for controlling a lens system that performs magnification of a subject image by optical displacement of an imaging lens. A computer-readable storage medium storing a program for causing a computer to execute the program.