CN101312537A - Drive method for solid-state imaging device, solid-state imaging device, and imaging apparatus - Google Patents

Abstract

A drive method for a solid-state imaging device having an oblique pixel pattern includes the steps of: adding, separately for an odd-numbered row and an even-numbered row, x pixels in the horizontal direction and y pixels in the vertical direction, the x pixels and the y pixels having the same color, in an area having adjacent n pixels in the horizontal direction and adjacent n pixels in the vertical direction, where n is an odd number of three or greater and n>=x>=y; and repeatedly adding the x pixels and the y pixels while shifting the nxn area by m pixels in the vertical or horizontal direction, where m is an odd number of three or greater. The nxn area of odd-numbered rows is displaced from that of even-numbered rows by m pixels in the oblique direction in the oblique pixel pattern.

Description

Solid-state imaging device driving method, solid state image pickup device and imaging device

The application is to be December 27, application number in 2005 the dividing an application for the application for a patent for invention of " solid-state imaging device driving method, solid state image pickup device and imaging device " that be 200510135801.X, denomination of invention the applying date.

Cross reference to related application

The present invention comprises the theme relevant with following application: the Japanese patent application JP 2004-375405 that submitted in Japan Patent office on December 27th, 2004, on April 4th, 2005 are herein incorporated its full content by reference at the Japanese patent application JP 2005-107034 of Japan Patent office submission and the Japanese patent application JP 2005-107037 that submitted in Japan Patent office on April 4th, 2005.

Technical field

The present invention relates to driving method, solid state image pickup device and the imaging device of solid state image pickup device.More specifically, the present invention relates to be used for the driving method of X-Y addressing solid state image pickup device (its exemplary is complementary metal oxide semiconductors (CMOS) (CMOS) installation drawing image-position sensor), the solid state image pickup device of realizing top driving method and the imaging device that uses this solid state image pickup device.

Also relevant solid-state imaging apparatus of the present invention and vision facilities, and more specifically, be arranged in the lip-deep solid-state imaging apparatus of pixel about the colour filter that wherein will have the primary color component (primary color component) that is used to generate brightness (Y) component and other color component, and, also relevant with the imaging device of solid-state imaging apparatus as imaging device.

Background technology

As announcing in Japanese unexamined patent application publication for example 2004-266369 number, in order to improve the frame rate of solid state image pickup device, usually, by information phase Calais minimizing Pixel Information amount with relevant a plurality of pixels.

The example of above-mentioned technology is as follows.In the color-code (color coding) of Bayer pattern shown in Figure 1 (Bayer pattern), from 3 * 3 pixel regions, extract the pixel of the same color in also addition two row and two row, simultaneously, by do not change that the color space repeat patterns does not change vertically yet, pixel pitch on level and the incline direction keeps original pattern of pixels under than the situation of (pitch ratio), and 3 * 3 pixel regions moved three pixels.

To be arranged in capable red (R) pixel 311,313,331 of odd-numbered and 333 additions, then, with the addition R signal framing of gained at the centre of form (centroid) A.Similarly, by moving horizontally three pixels from R pixel 311,313,331 and 333, with green (G) pixel 314,316,334 and 336 additions, then, with the addition G signal framing of gained at centre of form B.By further moving horizontally three pixels from G pixel 314,316,334 and 336, with R signal 317,319,337 and 339 additions, then, with the addition R signal framing of gained at centre of form C.

Then,, will be arranged in capable G pixel of even-numbered 341,343,361 and 363 additions by from R pixel 311,313,331 and three pixels of 333 vertical moving, then, with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 341,343,361 and 363, with indigo plant (B) pixel 344,346,364 and 366 additions, then, with the addition B signal framing of gained at centre of form E.By this way, by on whole pixel region as mentioned above with the color pixel addition, can be with the pixel addition of same color, keep original colour image (colorpattern) simultaneously, and do not change that the color space repeat patterns does not change vertically yet, the pixel pitch ratio on level and the incline direction.

In the imaging device such as digital still life camera and video camera, the pixel count that is used as the solid-state imaging apparatus of imaging device increases, and the solid-state imaging apparatus with millions of pixels is widely used gradually.The use of many pixels imaging device is intended to obtain high-definition picture.Yet, still exist showing the needs of more high-resolution solid-state imaging apparatus.

In the single sided board digital camera, the colour image of the colour filter that uses in the solid-state imaging apparatus is extremely important to obtaining high-resolution.The exemplary of this colour image is well-known and widely used Bayer pattern.

Bayer pattern

Bayer pattern is a colour image as shown in Figure 2, and (also in vertical direction) arranged alternate alternately has the GR line of G pixel and R pixel and alternately has the G pixel and the GB line of B pixel wherein in the horizontal direction.This Bayer pattern is characterised in that: the pixel separation d (pixel pitch) with rule on vertical and horizontal direction is arranged in the cage (square lattice) with pixel; And the G of the GRB color in this hound's-tooth: R: the B ratio is 2: 1: 1.

(that is) characteristic, R and B color is described the spatial frequency characteristic of the RGB color in the Bayer pattern for G color by being considered as the primary colours that are used to generate brightness (Y) component respectively and other color now.

Usually, generate brightness signal Y according to equation (1).

Y＝0.6G+0.3R+0.1B (1)

Equation (1) is responsive and to the R and the more insensitive fact of B color to the G color based on the mankind's eyes.In other words, if brightness (Y) component needs high-resolution, the resolution that then increases the G color component is extremely important, and other R and B color component need not include too high resolution.

Fig. 3 A and 3B illustrate wherein the G pattern that G pixel is only extracted out from Bayer pattern.Consider spatial frequency characteristic in conjunction with Fig. 3 A and 3B now.If (sampling rate) is set to pixel pitch d with the pixel sampling rate, then the sampling rate of G pixel equals pixel pitch d on vertical and horizontal direction, and, according to sampling theorem, can collection frequency the highest (1/2) fs (fs (=1/d): signal component sampling frequency).In other words, might collect by the row of the halftoning shown in Fig. 3 A (half-tonecolumn) and empty row (voided column) indicated signal component according to theoretical threshold value, and can not collect the signal component that has above the higher frequency of this threshold frequency.

As for 45 ° of incline directions, because the sampling rate of G pixel is

So can collect the highest according to sampling theorem Signal component.

Similarly, consider the spatial frequency characteristic of R and B pixel below.In this case, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Fig. 3 C and 3D show wherein the R pattern that R pixel is only extracted out from Bayer pattern.For the spatial frequency characteristic of R pixel because the sampling rate of R pixel on vertical and horizontal direction is 2d, so according to sampling theorem can collection frequency the signal component of the highest 1/4fs.In an inclined direction, the sampling rate of R pixel is

Like this, can collection frequency the highest according to sampling theorem

Signal component.

In Fig. 3 A to Fig. 3 D, indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

The spatial frequency characteristic of G, R and B pixel has been shown among Fig. 4.Fig. 4 illustrates, when sampling rate is set to pixel pitch d (=1/fs) time, the spatial frequency characteristic of G pixel is illustrated on vertical and the horizontal direction resolution of the highest 1/2fs and the highest on the direction of 45 ° of inclinations

Resolution, and the spatial frequency characteristic of R pixel is illustrated on vertical and the horizontal direction resolution of the highest 1/4fs and the highest on the direction of 45 ° of inclinations

Resolution, that is, can collect the signal component of high above-mentioned threshold frequency.

The Baeyer pixel moves pattern

Except that above-mentioned Bayer pattern, as what announced in the public announcement of a patent application of Japanese unexamined 10-262260 number, proposed the Bayer pattern from shown in Fig. 3 A to 3D the pattern shown in Fig. 6 A to 6D and moved pattern after 45 °, promptly wherein pixel is arranged in the finishing Bayer pattern that is moved the half-pixel pitch on vertical and the horizontal direction.

Hereinafter call " the Baeyer pixel moves pattern (Bayer pixel shifted pattern) " by Bayer pattern being moved 45 ° of colour images that produce.Move in the pattern in this Baeyer pixel, because the sampling rate result is

It is the sampling rate of Bayer pattern

Doubly, so can obtain the resolution higher than the resolution of Bayer pattern.

From another viewpoint, need identical resolution in the pattern if move in Bayer pattern and Baeyer pixel, the sampling rate that then the Baeyer pixel can be moved pattern increases the sampling rate of Bayer pattern Doubly.In other words, move pattern, can obtain identical resolution with the pixel count littler than the pixel count in the Bayer pattern by using the Baeyer pixel.As a result, can increase pixel aperture (pixel aperture), the feasible photo sensitivity that can improve pixel, thus acquisition has the signal of high noise (S/N) ratio.

Yet the Baeyer pixel moves pattern only can show high-resolution to the object (subject) of achromaticity (achromatic).Such reason is as follows.

Fig. 5 diagram Baeyer pixel moves the color-code of pattern.

Fig. 6 A and 6B only show wherein, and the G pixel is moved the G pattern of extracting out the pattern from the Baeyer pixel.Because the sampling rate of G pixel on vertical and horizontal direction is It is bigger than the sampling rate d of the G pixel in the Bayer pattern on vertical and horizontal direction, so the resolution that the Baeyer pixel moves in the pattern is lower than the resolution in the Bayer pattern.On the other hand, since the sampling rate d of G pixel on 45 ° of incline directions than Bayer pattern in sampling rate on 45 ° of incline directions Little, so this resolution is than the resolution height in the Bayer pattern.

Similarly, consider the resolution of R pixel and B pixel.Because the R pixel is identical with the pixel pitch of B pixel, so the following resolution of only describing the R pixel.

Fig. 6 C and 6D only show wherein, and the R pixel is moved the R pattern of extracting out the pattern from the Baeyer pixel.The sampling rate of R pixel on vertical and horizontal direction is

And R pixel sampling rate in an inclined direction is 2d.

In Fig. 6 A to 6D, can indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

The spatial frequency characteristic of G shown in Figure 7, R and B pixel.When comparison diagram 7 and Fig. 4, to move the spatial frequency characteristic of pattern identical with the spatial frequency characteristic that spatial frequency characteristic from Bayer pattern moves after 45 ° for the Baeyer pixel as can be seen.

Summary of the invention

For the effective integrality (effective integrity) that improves the pixel that comprises photoelectric transformer, some solid state image pickup devices use ensuing what is called " oblique pixel pattern ".In this oblique pixel pattern, from the matrix pixel pattern, with the row pixel of even-numbered on column direction with respect to 1/2 of the about pixel pitch of row pixel shift of odd-numbered, and, with the capable pixel of even-numbered on line direction with respect to 1/2 of the about pixel pitch of capable pixel shift of odd-numbered.When colour filter being arranged on the solid state image pickup device with this oblique pixel pattern, as shown in Figure 8, the color-code of Bayer pattern is moved 45 °.

In having the cmos image sensor of oblique pixel pattern, when line sequentially during the read pixel signal, therein in the pixel region 101 that pixel 100 is in tilted layout, as shown in Figure 9, drive each drive wire wherein all is connected to pixel 100 with two zigzag lines horizontal pixel drive wire group 105 by vertical selection circuit 106, and, the signal storage of the pixel 100 of the zigzag line that will select via horizontal pixel drive wire group 105 is in column processing circuit 103, each column processing circuit 103 is that row are arranged via vertical signal line group 102, and each vertical signal line is that a pixel column is arranged.Then, the signal sequence that will be stored in the pixel 100 in the column processing circuit 103 via horizontal selector switch group 107 reads into horizontal signal lines 108, wherein selects this switch of circuit 104 selective sequentials by level.

In this read method, owing to can read many picture element signals,, but on the other hand, be necessary to read simultaneously two picture element signals in the adjacent lines so reading speed is fast by a read operation, its flexibility is littler.Therefore, when in by the color-code that Bayer pattern is moved 45 ° of oblique pixel pattern shown in Figure 8 that generated, carrying out pixel addition, different with the pixel addition in the color-code of Bayer pattern, the gained colour image of sum signal becomes different in the original color pattern, identical pitch ratio on color space repeat patterns of finding simultaneously to be difficult to keep identical and vertical, level and the incline direction.

In another read method in having the cmos image sensor of oblique pixel pattern, as shown in figure 10, arranged obliquely therein in the pixel region 201 of pixel 200, driving wherein by vertical selection circuit 206, each pixel drive line is the horizontal pixel drive wire group 205 that a pixel column is arranged, and, the signal storage of the pixel 200 of the row that will select via horizontal pixel drive wire group 205 is in column processing circuit 203, each column processing circuit 203 is two row layouts in a zigzag via vertical signal line group 202, and each holding wire is connected to pixel 200 with two identical zigzag row.Then, the signal sequence that will be stored in the pixel 200 in the column processing circuit 203 via transversal switch group 207 reads into horizontal signal lines 208, wherein selects this switch of circuit 204 selective sequentials by level.

In this read method, owing to only can read picture element signal by line, so be difficult to realize read operation fast.In addition, the picture element signal during the capable and even-numbered of adjacent odd-numbered is capable is to read via the same vertical holding wire in the vertical signal line group 202, and handles in identical column circuits 203.Therefore, when by the color-code that moves the pattern of pixels as shown in Figure 8 after 45 ° from Bayer pattern, carrying out pixel addition, the gained colour image of sum signal becomes different with the original color pattern, the same pitch ratio on color space repeat patterns of finding simultaneously to be difficult to keep identical and vertical, level and the incline direction.

Baeyer pixel as the exemplary of known colour image is described below moves difference between pattern and the Bayer pattern.

Move in the pattern in the Baeyer pixel, because sampling rate is the sampling rate of Bayer pattern Doubly, so, as long as use the Baeyer pixel to move pattern, just can obtain Pixel Information into the Pixel Information twice of Bayer pattern at achromatic object.In other words, move in the pattern in the Baeyer pixel and can obtain higher resolution.In other words, the Baeyer pixel moves the use of pattern and has showed and the identical resolution of resolution of the Baeyer pixel with less number of pixels that this makes might increase the aperture of pixel, thereby increases the photo sensitivity of pixel, i.e. S/N ratio.

Only with the viewpoint of the G pixel of the fundamental component (primary component) that is used to generate brightness (Y) component, the Baeyer pixel moves the sampling rate of the sampling rate of pattern on vertical and horizontal direction greater than Bayer pattern.This means that the resolution of G pixel on vertical and horizontal direction in the Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern.In other words, as long as pay close attention to the resolution of G pixel on vertical and horizontal direction, then the Baeyer pixel moves pattern and just is inferior to Bayer pattern.

In order to overcome this point, when to achromatic object imaging, in the camera signal treatment system, adjust the RGB balance, that is, and applying gain makes the RGB level in a disguised form with.Then, suppose that R and B level equal the G level, generate brightness (Y) component, and, the sampling rate of Y component is treated to

Thereby on all vertical, levels and incline direction, realize the resolution higher than Bayer pattern.

Yet, above-mentioned processing only to achromatic to as if effectively, and if the object of colored (chromatic) is carried out identical processing, be difficult to obtain high-resolution.In addition, when departing from balance of power level,, then be difficult in the camera signal treatment system, carry out correct interpolation and handle the generation of the color that leads to errors if supposition R and B level equal the G level and carry out processing.

In view of above-mentioned background, be necessary to provide a kind of driving method that is used for solid state image pickup device, solid state image pickup device and imaging device, wherein, after with the pixel addition in the oblique pixel pattern, can keep original colour image, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.

Be necessary also to provide that a kind of the two all realizes high-resolution solid-state imaging apparatus and imaging device to achromatic object and colored object under the situation that does not cause wrong color.

According to embodiments of the invention, provide a kind of driving method that is used to have the solid state image pickup device of the oblique pixel pattern that pixel is in tilted layout.This driving method may further comprise the steps: on having horizontal direction on an adjacent n pixel and the vertical direction in the zone of an adjacent n pixel, respectively at the row of odd-numbered and the row of even-numbered, with y pixel addition on pixel of the x on the horizontal direction and the vertical direction, this x pixel has identical color with y pixel, and wherein n is three or bigger odd number and n 〉=x 〉=y; And with y pixel repeated addition on pixel of the x on the horizontal direction and the vertical direction, simultaneously will have on the horizontal direction a regional mobile m pixel of an adjacent n pixel on the adjacent n pixel and vertical direction on the horizontal or vertical direction, wherein m is three or bigger odd number.Odd-numbered is capable has on the horizontal direction the capable spatial relation between the zone of an adjacent n pixel on the adjacent n pixel and vertical direction of having on the horizontal direction in the zone of an adjacent n pixel and even-numbered on the adjacent n pixel and vertical direction and makes them in the incline direction of oblique pixel pattern m the pixel that be shifted each other.

With pixel addition, can keep original colour image as described above, and the pitch ratio on should not variable color color space repeat patterns or vertical, level and the incline direction.

According to still another embodiment of the invention, provide a kind of solid-state imaging apparatus, having comprised: pixel, it comprise by bidimensional be arranged in photoelectric transformer in the matrix; And colour filter, comprising primary color component and other color component as the fundamental component that is used to generate luminance component, this colour filter is disposed in the surface of pixel.Primary color component and other color component are arranged such that primary color component surrounds other color component.Can use this solid-state imaging apparatus as the imaging device in the imaging device such as digital still life camera or video camera.

The solid-state imaging apparatus that disposes above or use this solid-state imaging apparatus to have following colour image as the imaging device of imaging device, wherein the color component (for example, G color component) as the fundamental component that is used to generate luminance component has surrounded other color component (for example R and B color component).In this colour image, in all row and all row, all there is the G component.Therefore, can increase human eyes it is had the spatial frequency characteristic of more highly sensitive G component, and the processing that is used to adjust the balance of power level of RGB component becomes and there is no need.

According to embodiments of the invention, in having the solid state image pickup device of oblique pixel pattern, after with pixel addition, can keep original colour image, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space (spatially equalsampling), can obtain high-quality sum signal.Meanwhile, can export added signal with the colour image identical with the colour image that obtains by gradual (progressive) (both full-pixel) read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

In addition, can increase spatial frequency characteristic as the color component of the fundamental component that is used to generate luminance component.Like this, not only to achromatic object, and can obtain high-resolution to the object of colour.In addition, the processing that is used to adjust the balance of power level of rgb pixel becomes and there is no need, thereby prevents the appearance of wrong color.

Description of drawings

The color-code of Fig. 1 diagram Bayer pattern;

The color-code of the Bayer pattern that Fig. 2 diagram is shown in Figure 1;

The pattern of the independent color in Fig. 3 A to 3D diagram Bayer pattern and the relation between the sampling rate;

The frequency characteristic of Fig. 4 diagram Bayer pattern;

Fig. 5 diagram Baeyer pixel moves the color-code of pattern;

Fig. 6 A to 6D diagram Baeyer pixel moves the pattern of the independent color in the pattern and the relation between the sampling rate;

Fig. 7 diagram Baeyer pixel moves the frequency characteristic of pattern;

The color-code of 45 ° colour image is moved in Fig. 8 diagram from Bayer pattern;

Fig. 9 is the schematic diagram of example of the configuration of the cmos image sensor of diagram with oblique pixel pattern;

Figure 10 is the block diagram of another example of the configuration of the cmos image sensor of diagram with oblique pixel pattern;

Figure 11 diagram is by according to the driving method of the first embodiment of the invention thought with pixel addition;

Figure 12 diagram is by according to the driving method of the second embodiment of the invention thought with pixel addition;

Figure 13 diagram is by according to the driving method of the third embodiment of the invention thought with pixel addition;

Figure 14 diagram is by according to the driving method of the fourth embodiment of the invention thought with pixel addition;

Figure 15 diagram is by according to the driving method of the fifth embodiment of the invention thought with pixel addition;

Figure 16 is the diagram schematic diagram of the configuration of cmos image sensor according to an embodiment of the invention;

Figure 17 is the circuit diagram of example of the configuration of diagram odd-numbered column processing circuit;

Figure 18 is the sequential chart of the operation of diagram cmos image sensor shown in Figure 16;

Figure 19 is the diagram block diagram of the example of the configuration of imaging device according to an embodiment of the invention;

Figure 20 is the diagram block diagram of the example of the configuration of imaging device according to an embodiment of the invention;

The colour image of Figure 21 diagram colour filter according to a sixth embodiment of the invention;

Figure 22 A and 22B diagram be the G pattern extracted out from the colour image of the 6th embodiment of G pixel only wherein;

Figure 22 C and 22D diagram be the R pattern extracted out from the colour image of the 6th embodiment of R pixel only wherein;

Figure 23 diagram is according to the spatial frequency characteristic of the colour image of the 6th embodiment;

The colour image of Figure 24 diagram colour filter according to a seventh embodiment of the invention;

Figure 25 A and 25B diagram be the G pattern extracted out from the colour image of the 7th embodiment of G pixel only wherein;

Figure 25 C and 25D diagram wherein only the R pixel from the colour image of the 7th embodiment, extracted out the R pattern;

Figure 26 diagram is according to the spatial frequency characteristic of the colour image of the 7th embodiment;

Figure 27 diagram is according to the colour image of the colour filter of the eighth embodiment of the present invention;

Figure 28 A and 28B diagram be the G pattern extracted out from the colour image of the 8th embodiment of G pixel only wherein;

Figure 28 C and 28D diagram wherein only the R pixel from the colour image of the 8th embodiment, extracted out the R pattern;

Figure 29 diagram is according to the spatial frequency characteristic of the colour image of the 8th embodiment;

Figure 30 A diagram is according to the comparative result between the spatial frequency characteristic of the spatial frequency characteristic of the G pixel of the 6th to the 8th embodiment and known colour image;

Figure 30 B diagram is according to the comparative result between the spatial frequency characteristic of the spatial frequency characteristic of the R of the 6th to the 8th embodiment and B pixel and known colour image;

The characteristic of Figure 31 diagram frequency band limits low pass filter (LPF); And

The thought of handling is extracted in Figure 32 diagram.

Embodiment

Describe embodiments of the invention in detail below in conjunction with accompanying drawing.

Discuss the driving method of the pixel addition that is used for carrying out solid state image pickup device below by the explanation of first to the 5th embodiment.

The solid state image pickup device of this driving method of use that present hypothesis is discussed below has ensuing oblique pixel pattern.In this pattern of pixels, the many pixels that comprise optical-electrical converter in matrix, have been arranged, and with the row pixel of even-numbered on column direction from 1/2 of the about pixel pitch of row pixel shift of odd-numbered, and with the capable pixel of even-numbered on line direction from 1/2 of the about pixel pitch of capable pixel shift of odd-numbered.

In ensuing embodiment of the present invention, in solid-state imaging apparatus, the pixel comprise optical-electrical converter is arranged on bidimensional ground, and arranges to have as the color component of the primary color component that is used to generate brightness (Y) component and the colour filter of other color on the surface of pixel.In this solid-state imaging apparatus, the colour image of colour filter is extremely important.

Therefore, in ensuing three embodiment, the colour image of colour filter is described mainly.Have according to each the solid-state imaging apparatus of colour filter among three embodiment and can shift solid-state imaging apparatus for: electric charge, its exemplary is charge coupled device (CCD) solid-state imaging apparatus; Perhaps X-Y addressing solid-state imaging apparatus, its exemplary is the MOS solid-state imaging apparatus.

In ensuing description, suppose: in colour filter, are G components as the color component of the primary colours that are used to generate brightness (Y) component, and other color component is R and B component.

Yet in the present invention, these color components only are examples, for example can be used to generate the primary colours of Y component with white, cyan and yellow color component conduct, and, for example can be with purple, cyan and yellow color component as other color component.

In above-mentioned solid state image pickup device with oblique pixel pattern, do not change keeping original colour image in the pitch ratio on color space repeat patterns or vertical, level and the incline direction, can the carries out image addition.

First embodiment

Figure 11 diagram is by according to the driving method of the first embodiment of the present invention thought with pixel addition.Move 45 ° the color-code of pattern of pixels according to oblique pixel pattern and from Bayer pattern, from 3 * 3 pixel regions, extracting and be added in mutually the pixel of the same color in two row and two row out, simultaneously this 3 * 3 pixel region is moved three pixels, is the unit with three pixels promptly.Following mask body is discussed the process of such pixel addition.

In Figure 11, will be arranged in the R pixel 111,113,151 and 153 additions of the row of odd-numbered, then, with the addition R signal framing of gained at centre of form A.Similarly, by moving horizontally three pixels from R pixel 111,113,151 and 153, with B pixel 114,116,154 and 156 additions, then, with the addition B signal framing of gained at centre of form B.By further moving horizontally three pixels from B pixel 114,116,154 and 156, with R signal 117,119,157 and 159, addition then, with the addition R signal framing of gained at centre of form C.

By tilt moving three pixels from R signal 117,119,157 and 159, will be arranged in the G pixel 142,144,182 and 184 additions of the row of even-numbered, and, with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 142,144,182 and 184, with G pixel 145,147,185 and 187 additions, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as described above with the color pixel addition, the pixel addition of same color can be kept original colour image simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.In this oblique pixel pattern, be not both corresponding to the column number of the capable pixel of odd-numbered and column number and be necessary corresponding to the capable pixel of even-numbered.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export added signal with the colour image identical with the colour image that obtains by gradual (both full-pixel) read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

Second embodiment

The driving method of Figure 12 diagram by according to a second embodiment of the present invention is with the thought of pixel addition.Move 45 ° the color-code of pattern of pixels according to oblique pixel pattern and from Bayer pattern, from 5 * 5 pixel regions, extract and be added in mutually the pixel of the same color in three row and the triplex row out, simultaneously this 5 * 5 pixel region is moved three pixels.Following mask body is discussed the process of such pixel addition.

In Figure 12, will be arranged in capable R pixel of odd-numbered 211,213,215,251,253,255,291,293 and 295 additions, then, with the addition R signal framing of gained at centre of form A.By moving horizontally three pixels from R pixel 211,213,215,251,253,255,291,293 and 295, with B pixel 214,216,218,254,256,258,294,296 and 298 additions, then, with the addition B signal framing of gained at centre of form B.By further moving horizontally three pixels from B pixel 214,216,218,254,256,258,294,296 and 298, with R pixel 217,219,21b, 257,259,25b, 297,299 and the 29b addition, then, with the addition R signal framing of gained at centre of form C.

By tilting to move three pixels, will be arranged in the capable G pixel of even-numbered 242,244,246,282,284,286,2c2,2c4 and 2c6 addition, and with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 242,244,246,282,284,286,2c2,2c4 and 2c6, with G pixel 245,247,249,285,287,289,2c5,2c7 and 2c9 addition, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as mentioned above with the color pixel addition, the pixel addition of same color can be kept original colour image simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export added signal with the colour image identical with the colour image that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 3rd embodiment

The driving method of Figure 13 diagram by a third embodiment in accordance with the invention is with the thought of pixel addition.There not being the oblique pixel pattern of colour filter, from 3 * 3 pixel regions, extract and be added in mutually the neighbor in two row and two row out, simultaneously this 3 * 3 pixel region is moved three pixels.Following mask body is discussed the process of such pixel addition.

In Figure 13, will be arranged in the pixel 311,312,331 and 332 additions of the row of odd-numbered, then, the sum signal of gained is positioned at centre of form A.By moving horizontally three pixels,, then, the sum signal of gained is positioned at centre of form B with pixel 314,315,334 and 335 additions from pixel 311,312,331 and 332.By being moved further three pixels from 314,315,334 and 335,, then, the sum signal of gained is positioned at centre of form C with pixel 317,318,337 and 338 additions.

Then,, will be arranged in the pixel 342,343,362 and 363 additions of the row of even-numbered, then, the sum signal of gained will be positioned at centre of form D by tilting to move three pixels.By moving horizontally three pixels,, and the sum signal of gained is positioned at centre of form E with pixel 345,346,365 and 366 additions from pixel 342,343,362 and 363.

By this way, by on whole pixel region as mentioned above with pixel addition, these pixel addition can be kept master pattern simultaneously, and not change the pitch ratio on vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export sum signal with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 4th embodiment

The driving method of Figure 14 diagram by a fourth embodiment in accordance with the invention is with the thought of pixel addition.In not having the oblique pixel pattern of colour filter, from 3 * 3 pixel regions, extract and be added in mutually the neighbor in three row and the triplex row out, simultaneously this 3 * 3 pixel region is moved three pixels.Following mask body is discussed the process of such pixel addition.

In Figure 14, will be arranged in the pixel 411,412,413,431,432,433,451,452 and 453 additions of the row of odd-numbered, then, the sum signal of gained is positioned at centre of form A.By moving horizontally three pixels from pixel 411,412,413,431,432,433,451,452 and 453, with pixel 414,415,416,434,435,436,454,455 and 456 additions, then, the sum signal with gained is positioned at centre of form B.By being moved further three pixels from pixel 414,415,416,434,435,436,454,455 and 456, with pixel 417,418,419,437,438,439,457,458 and 459 additions, and the sum signal of gained is positioned at centre of form C.

Then, by tilting to move three pixels, addition is arranged in the capable pixel of even-numbered 442,443,444,462,463,464,482,483 and 484, then, the sum signal of gained is positioned at centre of form D.By moving horizontally three pixels from pixel 442,443,444,462,463,464,482,483 and 484, with pixel 445,446,447,465,466,467,485,486 and 487 additions, and the sum signal of gained is positioned at centre of form E.

By this way, by on whole pixel region as mentioned above with pixel addition, these pixel addition can be kept original pattern simultaneously, and not change the pitch ratio on vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Simultaneously, can export added signal with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

The 5th embodiment

The driving method of Figure 15 diagram by according to a fifth embodiment of the invention is with the thought of pixel addition.In special-purpose color-code as special-purpose color-code example, from 5 * 5 pixel regions, extract and be added in mutually the pixel of the same color in two row and two row out, simultaneously this 5 * 5 pixel region is moved three pixels.Following mask body is discussed the process of such pixel addition.

In Figure 15, will be arranged in the R pixel 511,513,551 and 553 additions of the row of odd-numbered, then, with the addition R signal framing of gained at centre of form A.Similarly, by moving horizontally three pixels from R pixel 511,513,551 and 553, with G pixel 514,516,554 and 556 additions, then, with the addition G signal framing of gained at centre of form B.By further moving horizontally three pixels from G pixel 514,516,554 and 556, with R image signal 517,519,557 and 559 additions, then, with the addition R signal framing of gained at centre of form C.

By tilting to move three pixels, will be arranged in the G pixel 542,544,582 and 584 additions of the row of even-numbered, and with the addition G signal framing of gained at centre of form D.By moving horizontally three pixels from G pixel 542,544,582 and 584, with G pixel 545,547,585 and 587 additions, then, with the addition G signal framing of gained at centre of form E.

By this way, by on whole pixel region as mentioned above with the color pixel addition, the pixel addition of same color can be kept the original color pattern simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export sum signal with the colour image identical with the colour image that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

Citation form

By first to the 5th embodiment, discussed and be used for by using the driving method of various patterns with pixel addition.General type with pixel addition is described below.

In comprising pixel region (pel array) solid state image pickup device, at the n of adjacent n * n pixel with oblique pixel pattern ²In the zone (n be three or bigger odd number), extract out and be added in mutually x row and y (pixel of the same color in the row of n 〉=x 〉=y), simultaneously in horizontal or vertical direction with the regional mobile m pixel of n * n (m be three or bigger odd number).In this situation, capable and even-numbered is about to pixel addition at odd-numbered respectively.In this case, the spatial relation between the neighbor in adjacent n * n the pixel that neighbor in adjacent n * n the pixel that odd-numbered is capable and even-numbered are capable is like this: their m pixels that in an inclined direction be shifted each other.

According to the driving method that is used to carry out above-mentioned pixel addition, pixel addition can be kept the original color pattern simultaneously, and not change the pitch ratio on color space repeat patterns or vertical, level and the incline direction.

As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export added signal with the pattern identical with the pattern that obtains by the gradual read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.In addition, as described below, because n 〉=x 〉=y keeps capacitor so there is no need to increase the sampling that is used for pixel addition.

Solid state image pickup device

Provide now realizing the description of being used for the example of the configuration of the solid state image pickup device of the driving method of pixel addition according to first to the 5th embodiment.

Figure 16 schematic illustrations is the configuration of X-Y addressing solid state image pickup device (for example, cmos image sensor) according to an embodiment of the invention.

Cmos image sensor shown in Figure 16 comprises: pixel 10, pel array 11, colour filter 12, odd-numbered row drive wire group 13, even-numbered row drive wire group 14, odd-numbered column signal line (vertical signal line) group 15, even-numbered column signal line (vertical signal line) group 16, the capable circuit 17 of vertically selecting of odd-numbered, the capable circuit 18 of vertically selecting of even-numbered, odd-numbered ranks treatment circuit 19, even-numbered ranks treatment circuit 20, the capable transversal switch 21 of odd-numbered, the capable horizontal signal lines 22 of odd-numbered, the capable level of odd-numbered is selected circuit 23, output amplifier 24 and 28, the capable transversal switch 25 of even-numbered, the capable horizontal signal lines 26 of even-numbered, the capable level of even-numbered is selected circuit 27, and timing generative circuit 29.

In Figure 16, have by pixel 10 and form pel arrays (pixel region) 11 with the optical-electrical converter of matrix arrangements.In pel array 11, even numbered columns pixel 10 is gone up from 1/2 of the about pixel pitch of odd numbered columns pixel 10 displacements at column direction (vertical direction among Figure 16), and the capable pixel 10 of even-numbered is gone up from 1/2 of the about pixel pitch of capable pixel 10 displacements of odd-numbered at line direction (horizontal direction among Figure 16).In other words, pel array 11 has formed oblique pixel pattern.

In pel array 11, will have the colour filter 12 that moves 45 ° color-code (see figure 8) from Bayer pattern and be arranged on the pixel 10 with oblique pixel pattern.Provide the odd-numbered row drive wire of odd-numbered row drive wire group 13 to each odd number code line of pixel 10, and, each even numbered row of pixel 10 is provided the even-numbered row drive wire of even-numbered row drive wire group 14.The odd-numbered column signal line of odd numbered columns signal line group 15 is connected to each odd numbered columns pixel 10, and, the even-numbered column signal line of even numbered columns signal line group 16 is connected to each even numbered columns pixel 10.

One end of each odd-numbered row drive wire of odd-numbered row drive wire group 13 is connected to the capable corresponding output of vertically selecting circuit 17 of odd-numbered.One end of each even-numbered row drive wire of even-numbered row drive wire group 14 is connected to the capable corresponding output of vertically selecting circuit 18 of even-numbered.Odd-numbered is capable vertically selects the capable vertical row selector of selecting circuit 18 to form to be used for being chosen in via odd-numbered row drive wire group 13 and even-numbered row drive wire group 14 respectively pel array 11 pixels 10 not adjacent to each other, that odd-numbered is capable and even-numbered is capable of circuit 17 and even-numbered.

One end of each odd-numbered column signal line of odd numbered columns signal line group 15 is connected to the input of the corresponding odd-numbered ranks treatment circuit 19 of a side (downside among Figure 16 in this embodiment) that is disposed in pel array 11.Picture element signal during odd-numbered ranks treatment circuit 19 storage odd-numbereds are capable, and the picture element signal addition in other row with each.

One end of each even-numbered column signal line of even numbered columns signal line group 16 is connected to the input of the corresponding even-numbered ranks treatment circuit 20 of the opposite side (upside among Figure 16 in this embodiment) that is disposed in pel array 11.Picture element signal in the row of even-numbered ranks treatment circuit 20 storage even-numbereds, and the picture element signal addition in other row with all.

The physical circuit configuration of odd-numbered ranks treatment circuit 19 and even-numbered ranks treatment circuit 20 is described below.Be attached to odd-numbered ranks treatment circuit 19 among Figure 16 and symbol A, B on the even-numbered ranks treatment circuit 20 and C and be used to distinguish the switch shown in Figure 17.

Via the capable transversal switch 21 of odd-numbered of correspondence the output of odd-numbered ranks treatment circuit 19 is connected to odd-numbered horizontal signal lines 22.Select the capable transversal switch 21 of circuit 23 selective sequential odd-numbereds by the capable level of odd-numbered, so that will in odd-numbered ranks treatment circuit 19, added signal read into the capable horizontal signal lines 22 of odd-numbered.In output amplifier 24, amplify the signal that is read out the capable horizontal signal lines 22 of odd-numbered, and then with its output.

Via the capable transversal switch 25 of even-numbered of correspondence the output of even-numbered ranks treatment circuit 20 is connected to the capable horizontal signal lines 26 of even-numbered.Select the capable transversal switch 25 of circuit 27 selective sequential even-numbereds by the capable level of even-numbered, so that will in even-numbered ranks treatment circuit 20, added signal read into the capable horizontal signal lines 26 of even-numbered.In output amplifier 28, amplify the signal that is read out the capable horizontal signal lines 26 of even-numbered, and then with its output.

The capable level of odd-numbered selects circuit 23 and the capable level of even-numbered to select circuit 27 to be formed for selecting the column selector that is listed as, and makes that column number and even-numbered the column number capable in of odd-numbered in capable is inconsistent.Select circuit 23 and the capable level of even-numbered to select the drive controlling of circuit 27 based on carry out capable circuit 17, capable circuit 18, odd-numbered ranks treatment circuit 19, even-numbered ranks treatment circuit 20, the capable level of odd-numbered vertically selected of even-numbered vertically selected of odd-numbered from the various timing signals of timing generative circuit 29 outputs.

Figure 17 is the circuit diagram of example of the configuration of diagram odd-numbered ranks treatment circuit 19, supposes the pixel of the same color of move 45 ° color-code (see figure 8) from Bayer pattern addition two row and two in capable.Even-numbered ranks treatment circuit 20 has identical configuration basically.

In Figure 17, clamper (clamp) impulse line 31, clamp voltage line 32, record controls line 33, addition control line 34, A switching line 35, B switching line 36, C switching line 37 and clamp voltage line 38 are connected to odd-numbered column processing circuit 19A, the 19B of a unit of formation and each among the 19C (corresponding to column processing circuit A, B and C shown in Figure 16).

Column processing circuit 19A, 19B, 19C have identical circuit arrangement basically.Column processing circuit 19A comprises: clamp capacitor 41A; First, second and the 3rd switch 42A, 43A and 44A; And sampling keeps capacitor 45A.Column processing circuit 19B comprises: clamp capacitor 41B; First, second and the 3rd switch 42B, 43B and 44B; And sampling keeps capacitor 45B.Column processing circuit 19C comprises: clamp capacitor 41C; First, second and the 3rd switch 42C, 43C and 44C; And sampling keeps capacitor 45C.Can be with the N-channel MOS transistor as first, second and the 3rd switch.

Below by being the more specifically configuration that example is discussed column processing circuit 19 with column processing circuit 19A.The end of clamp capacitor 41A is connected to an end of the corresponding odd-numbered column signal line (vertical signal line) of odd numbered columns signal line group 15.Between the other end of clamp capacitor 41A and clamp voltage line 32, connect the first switch 42A, and the grid of the first switch 42A is connected to clamp pulse line 31.The main electrode of second switch 43A is connected to the other end of clamp capacitor 41A, and its gate electrode is connected to record controls line 33.

The main electrode of the 3rd switch 44A is connected to another main electrode of second switch 43A, and its gate electrode is connected to A switching line 35.In column processing circuit 19B, the gate electrode of the 3rd switch 44B is connected to B switching line 36.In column processing circuit 19C, the gate electrode of the 3rd switch 44C is connected to C switching line 37.An end that keeps capacitor 45A with sampling is connected to another main electrode of the 3rd switch 44A, and its other end is connected to clamp voltage line 38.

In the above among Pei Zhi column processing circuit 19A, 19B and the 19C, in this embodiment, with the picture element signal addition among column processing circuit 19A and the 19C.In addition, between column processing circuit 19A and 19C, more specifically, between the 3rd switch 44A in column processing circuit 19A and 19C and the main electrode of 44C, connect addition switch 46.Can be with the N-channel MOS transistor as addition switch 46.The grid of addition switch 46 is connected to addition control line 34.

The operation that comprises the cmos image sensor with oblique pixel pattern of the column processing circuit 19A, the 19B that dispose above and 19C according to this embodiment is described below with reference to the sequential chart of Figure 18.

Figure 18 illustrates the timing relationship between the following pulse: reset pulse is used for the electromotive force in the floating diffusion region of reset of pixels 10; Electric charge shifts pulse, is used for and will be transferred to floating diffusion region by the signal charge of light-to-current inversion at photoelectric transformer; Clamp pulse is provided to clamp pulse line 31; The record controls pulse is provided to record controls line 33; The addition control impuls is provided to addition control line 34; The A switching pulse is provided to A switching line 35; The B switching pulse is provided to B switching line 36; And the C switching pulse, be provided to C switching line 37.

When operation has the cmos image sensor of oblique pixel pattern of this embodiment in the addition read mode, the addition control impuls is changed to the H level, so that addition switch 46 is in " leading to " (ON) state.If do not carry out the phase add operation, the addition control impuls is changed to the L level, so that addition switch 46 is in " breaking " (OFF) state.In this situation, preferably dummy switch (dummyswitch) is arranged in column processing circuit 19 and 20, makes the variation of load capacitance of the addition switch 46 be connected to vertical signal line in the odd-numbered row signal line group 15 and the vertical signal line in the even-numbered row signal line group 16 become not obvious.

In Figure 16, select first row by the capable circuit 17 of vertically selecting of odd-numbered by vertical scanning, select fourth line by the capable circuit 18 vertically selected of even-numbered by vertical scanning.By selecting row by this way, it is capable and even-numbered is capable to read odd-numbered not adjacent to each other simultaneously, and this is the feature of embodiments of the invention.For easy to understand, below and first embodiment (Figure 11) come together to describe this point.

At first reset pulse is provided to the pixel (first and fourth line) in selected two row, then, reflects that the resetting voltage of the reset level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.In this situation, clamp pulse is changed to the H level, so that the first switch 42A, 42B and 42C among Figure 17 connect " leading to ", then, the resetting voltage with the holding wire in vertical signal line group 15 and 16 is stored in (first resetting voltage reads period) among clamp capacitor 41A, 41B and the 41C.Then, clamp pulse is changed to the L level, to close " breaking " first switch 42A, 42B and 42C.

Subsequently, electric charge is shifted pulse be provided to selected two row (first and fourth line), then, the signal voltage of the optical signalling level of reflection pixel 10 appears in the respective signal line of vertical signal line group 15 and 16.In this situation, owing to generated signal voltage and be stored in poor between the resetting voltage among clamp capacitor 41A, 41B and the 41C, so eliminated fixed pattern noise (first signal voltage reads period) from pixel 10.

Then, the record controls pulse is changed to the H level, and, the A switching pulse is changed to the H level, feasible wherein the 3rd switch 44A (hereinafter, be called " A switch 44A " for short) be connected to the signal in signal plus in the row of A switching line 35 is connected to C switching line 37 to the 3rd switch 44C (being called hereinafter, " C switch 44C " for short) wherein the row.

As a result, will be connected to the signal in the row of A switch 44A via addition switch 46 and be connected to signal plus in the row of C switch 44C, and the sampling that added signal is stored in column processing circuit 19A keeps among the capacitor 45A.More specifically, in Figure 11, in the row of odd-numbered, with the signal of R pixel 111 and the signal plus of R pixel 113, with the signal of G pixel 114 and the signal plus of G pixel 116, or the like.In the row of even-numbered, with the signal of G pixel 142 and the signal plus of G signal 144, with the signal of B signal 145 and the signal plus of B signal 147, or the like.

Then, record controls pulse and A switching pulse are all changed to the L level.After this, reset selected two the row unsteady diffusions (FD).Be to comprise that first resetting voltage reads period and first signal voltage and reads first of period and read period the period of these operations up till now.

Subsequently, in Figure 16, select fifth line by vertical scanning by the capable circuit 17 vertically selected of odd-numbered, and, the 8th row selected by the capable circuit 18 of vertically selecting of even-numbered by vertical scanning.It is capable and even-numbered is capable to read odd-numbered not adjacent to each other simultaneously.

At first reset pulse is provided to the pixel in selected two row (fifth line and the 8th row), then, reflects that the resetting voltage of the reset level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.Then, clamp pulse is changed to the H level, so that meet " leading to " first switch 42A, 42B and 42C, and the resetting voltage of the holding wire in vertical signal line group 15 and 16 is stored in (second resetting voltage reads period) among clamp capacitor 41A, 41B and the 41C.Then, clamp pulse is changed to the L level, to close " breaking " first switch 42A, 42B and 42C.

Subsequently, electric charge is shifted pulse be provided to selected two row (the 5th and the 8th row), and, reflect that the signal voltage of the optical signalling level of this pixel appears in the respective signal line of vertical signal line group 15 and 16.Owing to generated signal voltage and be stored in poor between the resetting voltage among clamp capacitor 41A, 41B and the 41C, so can eliminate fixed pattern noises (secondary signal voltage reads period) from pixel 10.

Then, the record controls pulse is changed to the H level, and, the C switching pulse is changed to the H level, make signal in the row be connected to A switch 44A be added to the signal in the row that are connected to C switch 44C, and the sampling that added signal is stored in column processing circuit 19C is kept among the capacitor 45C.

As a result, will be connected to the signal in the row of A switch 44A via addition switch 46 and be connected to signal plus in the row of C switch 44C, and, added signal is stored among the sample-and-hold circuit 45C of column processing circuit 19C.More specifically, in Figure 11, in the row of odd-numbered, with the signal of R pixel 151 and the signal plus of R pixel 153, with the signal of B pixel 154 and the signal plus of B pixel 156, or the like.In the row of even-numbered, with the signal of G pixel 182 and the signal plus of G pixel 184, with the signal of G pixel 185 and the signal plus of G pixel 187, or the like.

Subsequently, record controls pulse and C switching pulse are changed to the L level, and, the floating diffusion region of the pixel of selected two row that reset.Then, A switching pulse and C switching pulse are changed to the H level, so that connect A switch 44A and C switch 44C.As a result, the sampling maintenance capacitor 45A of column processing circuit 19A and 19C and the horizontal summation signal addition vertically (vertical summation period) among the 45C will be stored in.

More specifically, in the row of odd-numbered, with the horizontal summation signal (signal of the signal of R pixel 111 and R pixel 113, B pixel 114 and B pixel 116 that is stored among the sampling maintenance capacitor 45A, or the like) and the horizontal summation signal (signal of the signal of R pixel 151 and R pixel 153, B pixel 154 and B pixel 156, or the like) addition vertically.

In the row of even-numbered, with the horizontal summation signal (signal of the signal of G pixel 142 and G pixel 144, G pixel 145 and G pixel 147 that is stored among the sampling maintenance capacitor 45A, or the like) and the horizontal summation signal (signal of the signal of G pixel 182 and G pixel 183, G pixel 185 and G pixel 187, or the like) addition vertically.

According to above-mentioned phase add operation, move 45 ° the color-code of first embodiment from Bayer pattern,, extract out and the pixel of the same color of addition two row and two in capable from 3 * 3 pixel regions.Can keep reading the signal that obtains by with these pixel addition capacitor 45A or the 45C from sampling.Be to comprise that second resetting voltage reads second of the period of reading in period, secondary signal voltage and vertical summation period and reads period the period of operation up till now.

In the read method of mentioning in front, with the added signal of a horizontal x pixel (in this embodiment, x=2) be stored in unitary sampling and keep in the capacitor 45 (45A, 45B or 45C), and, the vertical y row of similar number (y=2) are repeated this operation in this embodiment.Under this situation, if x 〉=y, then to keep capacitor 45 be enough in the sampling that provides for the row of the original pixels pattern of similar number.Like this, the phase add operation does not just need extra sampling to keep capacitor

First reads and forms horizontal blanking interval (blanking period) in period and second period of reading.Interim a horizontal blanking, the row of odd-numbered not adjacent to each other and the row of even-numbered are read repeatedly (in this embodiment, because with two vertical pixels (two row) addition, institute thinks twice), this is the feature of this embodiment of the present invention.After this horizontal blanking interval, level begins the period of reading.

If interim sampling from column processing circuit 19A keeps reading added signal the capacitor 45A when vertical summation, then can select to select in the circuit 23 first row, the 4th row, the 7th row or the like according to the capable level of odd-numbered that is configured in shown in Figure 16.Then, can extract added signal in the row of odd-numbered out.Similarly, can select circuit 27 to select secondary series, the 5th row, the 8th row or the like, then, can extract the added signal in the row of this even-numbered out by the capable level of even-numbered.

In this situation, select to make them be shifted each other corresponding to the capable row of odd-numbered with corresponding to the capable row of even-numbered.In other words, select the capable corresponding column number of circuit 23 selected odd-numbereds and select the capable corresponding column number of circuit 27 selected even-numbereds inconsistent with the capable level of odd-numbered with the capable level of even-numbered.The pattern of sum signal needs the master pattern of matched pixel signal.

As mentioned above, the solid state image pickup device with oblique pixel pattern comprises: vertically select circuit 17 and 18, be used for repeatedly selecting odd-numbered not adjacent to each other capable and even-numbered is capable respectively simultaneously in that horizontal blanking is interim; Column processing circuit 19 (19A, 19B and 19C) and 20 (20A, 20B and 20C) have capable transversal switch 21 of odd-numbered and the capable transversal switch 25 of even-numbered respectively; And level selection circuit 23 and 27, be respectively applied for selector switch 21 and 25.Utilize this configuration, make with the capable corresponding row of selected odd-numbered with the corresponding row of the row of even-numbered to be shifted each other.Therefore, after with pixel addition, can keep original color coding, and not change the pixel pitch ratio on color space repeat patterns or vertical, level and the incline direction.As a result, by the impartial sampling in space, can obtain high-quality sum signal.Meanwhile, can export sum signal with the colour image identical with the colour image that obtains by the progressive read method that is used for independent read pixel signal, thus convenient signal processing in subsequent stage.

Example application

Above-mentioned X-Y addressing solid state image pickup device (its exemplary is a cmos image sensor) with oblique pixel pattern is suitably used the imaging device that acts on the imaging device (camera module) such as digital still life camera or video camera.

Figure 19 is the diagram block diagram of the example of the configuration of imaging device according to an embodiment of the invention.Imaging device shown in Figure 19 comprises lens 51, imaging device 52, signal processing circuit 52, mode setting unit 54 and device drive circuit 55.

Lens 51 are gone up at the imaging surface (imaging plane) of imaging device 52 and are formed the corresponding image of light that is reflected with object.Under the control of device drive circuit 55, it is the signal of telecommunication of unit that imaging device 52 forms scioptics 51 on imaging surface optical imagery is converted into the pixel, and the picture signal of output gained.With according to the X-Y addressing solid state image pickup device (its exemplary is a cmos image sensor) that comprises oblique pixel pattern of the foregoing description as imaging device 52.Can will install drive circuit 55 by technology in the chip is installed on the imaging device 52.

53 pairs of picture signals from imaging device 52 outputs of signal processing circuit are carried out various signal processing operations.In response to user's indication, the addition read mode that mode setting unit 54 optionally is provided for reading the gradual read mode of all picture element signals or is used to carry out pixel addition is as the operator scheme of imaging device 52.

Device drive circuit 55 is formed by timing generative circuit 29 for example shown in Figure 16, and the driving that the mode signal that provides from mode setting unit 54 is controlled timing device 52 is provided.

More specifically, when in imaging device shown in Figure 16 (cmos image sensor), having specified progressive read mode, device drive circuit 55 is carried out control, the level that makes selects circuit 17 and 18 to select odd-numbered capable and even-numbered is capable respectively, and, select circuit 23 and 27 signal that from the pixel of selected row, reads of selective sequential respectively by level.

When having specified the addition read mode, device drive circuit 55 is carried out control, make by vertical selection circuit 17 and 18 at the interim row of odd-numbered not adjacent to each other and a row of even-numbered repeatedly selected simultaneously respectively of horizontal blanking, and, respectively with the signal level ground addition of the pixel of selected row, and select circuit 23 and 27 to call over added signal by the column processing circuit 19 with transversal switch 21 and 25 (19A, 19B and 19C) and 20 (20A, 20B and 20C) by level.

As discussed above, will be carried in the imaging device such as digital still life camera or video camera according to the X-Y addressing solid state image pickup device (its exemplary is a cmos image sensor) with oblique pixel pattern of one of the foregoing description.Therefore, this imaging device can tackle gradual read mode and addition read mode the two.In addition, this imaging device can be exported the signal that gradual read mode acquisition is passed through in the sum signal conduct with identical colour image.As a result, by the impartial sampling in space, can obtain high-quality added signal, and can be convenient to the signal processing in the signal processing circuit 53.

The 6th embodiment

The colour image of Figure 21 diagram colour filter according to a sixth embodiment of the invention.In the solid state image pickup device that comprises according to the colour image of the 6th embodiment, as shown in figure 21, the pixel (not shown) that will have photoelectric transformer on vertical direction (column direction) and horizontal direction (line direction) is arranged in the cage with equal intervals (pixel pitch) d.

In this cage pattern of pixels, in first row, is that the unit repeats to arrange in the horizontal direction with RGRB with four pixels, in second row, only arranging the G pixel, in the third line, is that the unit repeats to arrange in the horizontal direction with BGRG with four pixels, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out, be arranged such that G component encirclement R and B component as color component (being the G component in this embodiment) and other component (being R and B component in this example) of the primary color component that is used to generate brightness (Y) component from Figure 21.In addition, in this colour image, on vertical and horizontal direction, arrange R and B pixel with rule interval 4d.

In the colour image of above-mentioned configuration, if the pixel sampling rate on vertical and the horizontal direction is set to pixel pitch d, then the sampling rate to the G pixel is d, and the sampling rate of R and B pixel is 2d.In other words, every row (in this embodiment, the row of odd-numbered) and interlacing (in this embodiment, the row of odd-numbered) arrange R pixel or B pixel, make on vertical and horizontal direction sampling rate to R and B pixel become to 1/2 of the sampling rate of G pixel.Therefore, the resolution of R and B pixel be the G pixel resolution 1/2.On 45 ° of incline directions, be to the sampling rate of G pixel

And to the sampling rate of R and B pixel be

Figure 22 A and 22B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 21.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 22 A and 22B.On vertical and horizontal direction, because the sampling rate of G pixel is d, shown in Figure 22 A, so can collection frequency the highest (1/2) fs (fs: signal component sampling frequency) according to sampling theorem.On 45 ° of incline directions, owing to be to the sampling rate of G pixel

Shown in Figure 22 B, so can collection frequency the highest according to sampling theorem

Signal component.

Similarly, consider the spatial frequency characteristic of R and B pixel below.Under this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 22 C and 22D illustrate wherein the R pattern that R pixel is only extracted out from colour image shown in Figure 21.In Figure 22 A to 22D, indicate the threshold frequency component that on vertical, level and incline direction, can collect with empty row and halftoning row.

On vertical and horizontal direction, owing to the sampling rate of R pixel is 2d, shown in Figure 22 C, thus according to sampling theorem can collection frequency the signal component of the highest 1/4fs.On the direction of 45 ° of inclinations, owing to be to the sampling rate of R pixel

Shown in Figure 22 D, so can collection frequency the highest according to sampling theorem

Signal component.

According to above-mentioned some, Figure 23 indicates the spatial frequency characteristic of the colour image of the 6th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/2) fs, and in an inclined direction is can collection frequency the highest Signal component.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/4) fs, and in an inclined direction is can collection frequency the highest

Signal component.

The 7th embodiment

The colour image of Figure 24 diagram colour filter according to a seventh embodiment of the invention.As use the solid-state imaging apparatus of colour image of the 6th embodiment shown in Figure 21, use the solid-state imaging apparatus of the colour filter of this embodiment to have the pattern of pixels of cage.

In the colour image of this embodiment, in first row, is that the unit repeats to arrange in the horizontal direction with RGGG with four pixels, in second row, only arranging the G pixel, in the third line, is that the unit repeats to arrange in the horizontal direction with GGBG with four pixels, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out from Figure 24, wherein color component (being the G component in this embodiment) and other component (being R and B component in this example) as the primary color component that is used to generate brightness (Y) component is arranged such that G component encirclement R and B component.In addition, in this colour image, as the colour image among the 6th embodiment, on vertical and horizontal direction, arrange R and B pixel with rule interval 4d.

In the colour image of above-mentioned configuration, if the pixel sampling rate on vertical and the horizontal direction is set to pixel pitch d, then the sampling rate to the G pixel is d, and is 4d for the sampling rate of R and B pixel.In other words, arrange R pixel or B pixel, make the sampling rate of R and B pixel is being become 1/4 of the sampling rate of G pixel vertically and on the horizontal direction every row (in this embodiment, odd-numbered is capable) and interlacing (in this embodiment, odd numbered columns).Therefore, the resolution of R and B pixel be the G pixel resolution 1/4.On the direction of 45 ° of inclinations, be to the sampling rate of G pixel Sampling rate to R and B pixel is

Figure 25 A and 25B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 24.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 25 A and 25B.On vertical and horizontal direction, because the sampling rate of G pixel is d, shown in Figure 25 A, so can collection frequency the highest (1/2) fs (fs: signal component sampling frequency) according to sampling theorem.On the direction of 45 ° of inclinations, owing to be to the sampling rate of G pixel

Shown in Figure 25 B, so can collection frequency the highest according to sampling theorem Signal component.

Similarly, consider the spatial frequency characteristic of R and B pixel below.In this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 25 C and 25D illustrate wherein the R pattern that R pixel is only extracted out from pattern of pixels shown in Figure 24.In Figure 25 A to 25D, indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

On vertical and horizontal direction, owing to the sampling rate to the R pixel is 4d, shown in Figure 25 C, thus according to sampling theorem can collection frequency the signal component of the highest 1/8fs.On the direction of 45 ° of inclinations, owing to be to the sampling rate of R pixel

Shown in Figure 25 D, so can collection frequency the highest according to sampling theorem

Signal component.

According to above-mentioned some, Figure 26 indicates the spatial frequency characteristic of the colour image of the 7th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/2) fs, and in an inclined direction is can collection frequency the highest

Signal component.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, signal component that can collection frequency the highest (1/8) fs, and in an inclined direction is can collection frequency the highest

Signal component.

The 8th embodiment

Figure 27 diagram is according to the colour image of the colour filter of the eighth embodiment of the present invention.As shown in figure 27, use the solid-state imaging apparatus according to the colour image of this embodiment to have oblique pixel pattern, the pixel pitch on wherein vertical and the horizontal direction is set to different with the pixel pitch d of cage pattern of pixels shown in Figure 21

And, the even numbered columns pixel is expert at and the about pixel pitch of column direction superior displacement from the odd numbered columns pixel 1/2.In other words, each the row, in the horizontal direction with

The pitch laying out pixel, and at each row, vertical direction with

The pitch laying out pixel.

In having the colour image of this oblique pixel pattern, in first row, arranged alternate G and R pixel in second row, are only arranged the G pixel, in the third line, and arranged alternate B and G pixel, and in fourth line, only arrange the G pixel.After this, repeat to arrange this four lines.

In the colour image of this embodiment, as finding out from Figure 27, wherein color component (being the G component in this embodiment) and other component (being R and B component in this example) as the primary color component that is used to generate brightness (Y) component is arranged such that G component encirclement R and B component.In this colour image, on vertical and horizontal direction with the rule interval Arrange R and B pixel.This colour image equals colour image from the cage pattern of pixels of the 6th embodiment shown in Figure 21 and moves pattern after 45 °.

In the colour image of above-mentioned configuration, on vertical and horizontal direction, be to the sampling rate of G pixel

And for the sampling rate of R and B pixel be

In other words, every row (in this embodiment, the row of odd-numbered) and interlacing (in this embodiment, the row of odd-numbered) arrange R pixel or B pixel, make on vertical and horizontal direction sampling rate to R and B pixel become to 1/4 of the sampling rate of G pixel.Therefore, the resolution of R and B pixel be the G pixel resolution 1/4.On 45 ° of incline directions, be d to the sampling rate of G pixel, and be 2d the sampling rate of R and B pixel.

Figure 28 A and 28B illustrate wherein the G pattern that G pixel is only extracted out from colour image shown in Figure 27.Consider the spatial frequency characteristic of G pixel in conjunction with Figure 28 A and 28B.On vertical and horizontal direction, because the sampling rate of G pixel is Shown in Figure 28 A, so can collection frequency the highest according to sampling theorem (fs: signal component sampling frequency).On 45 ° of incline directions owing to be d to the sampling rate of G pixel, shown in Figure 28 B, thus according to sampling theorem can collection frequency the highest (1/4) fs signal component.

Similarly, consider the spatial frequency characteristic of R and B pixel below.In this situation, because R is identical with the pixel pitch of B pixel, so the following spatial frequency characteristic of only describing the R pixel.

Figure 28 C and 28D illustrate wherein the R pattern that R pixel is only extracted out from pattern of pixels shown in Figure 27.In Figure 28 A to 28D, indicate the threshold frequency component that on vertical, level and incline direction, can collect by sky row and halftoning row.

On vertical and horizontal direction, owing to be to the sampling rate of R pixel Shown in Figure 28 C, so can collection frequency the highest according to sampling theorem

Signal component.On 45 ° of incline directions because the sampling rate of R pixel is 2d, shown in Figure 28 D, thus according to sampling theorem can collection frequency the highest (1/2) fs signal component.

According to above-mentioned some, Figure 29 indicates the spatial frequency characteristic of the colour image of the 8th embodiment.About the spatial frequency characteristic of G pixel, on vertical and horizontal direction, can collection frequency the highest

Signal component, and in an inclined direction, signal component that can collection frequency the highest (1/4) fs.About the spatial frequency characteristic of R and B pixel, on vertical and horizontal direction, can collection frequency the highest

Signal component, and in an inclined direction, signal component that can collection frequency the highest (1/2) fs.

In the above-described embodiments, the spatial frequency characteristic of the G pixel shown in Figure 23,26 and 29 is theoretic frequency characteristic, supposes that camera signal treatment system (the camera signal treatment circuit 1014 shown in Figure 20) execution of discussing below is used for the interpolation processing of interpolation G pixel on R and B locus.

Figure 30 A illustrates according to the comparative result between the spatial frequency characteristic of the G pixel of the spatial frequency characteristic (spatial resolution) of the G pixel of the colour image of the 6th to the 8th embodiment and known colour image (Bayer pattern and Baeyer pixel move pattern).Figure 30 B illustrates according to the comparative result between the spatial frequency characteristic of the R of the spatial frequency characteristic (spatial resolution) of the R of the colour image of the 6th to the 8th embodiment and B pixel and known colour image (Bayer pattern and Baeyer pixel move pattern) and B pixel.

Figure 30 A illustrates: the 6th is identical with the corresponding space frequency characteristic that the Baeyer pixel moves pattern with the spatial frequency characteristic of G pixel on 45 ° of incline directions of the colour image of the 7th embodiment, and wherein the Baeyer pixel moves the corresponding space frequency characteristic height of the corresponding space frequency characteristic of pattern than Bayer pattern; And the 6th with the spatial frequency characteristic of G pixel on vertical and horizontal direction of the colour image of the 7th embodiment corresponding space frequency characteristic height than Bayer pattern, wherein the corresponding space frequency characteristic of Bayer pattern moves the corresponding space frequency characteristic height of pattern than Baeyer pixel.

Figure 30 A also illustrates: the G pixel of the colour image of the 8th embodiment vertically with horizontal direction on spatial frequency characteristic identical with the corresponding space frequency characteristic of Bayer pattern, wherein the corresponding space frequency characteristic of Bayer pattern moves the corresponding space frequency characteristic height of pattern than Baeyer pixel; And the spatial frequency characteristic of the G pixel of the 8th embodiment on 45 ° of incline directions moves the corresponding space frequency characteristic height of pattern than Baeyer pixel, and wherein the Baeyer pixel moves the corresponding space frequency characteristic height of the corresponding space frequency characteristic of pattern than Bayer pattern.

Figure 30 B illustrates: the R of the colour image of the 6th embodiment and the B pixel spatial frequency characteristic on vertical and horizontal direction is identical with the corresponding space frequency characteristic of Bayer pattern, and wherein the corresponding space frequency characteristic of Bayer pattern is lower than the corresponding space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 6th embodiment and the B pixel spatial frequency characteristic on 45 ° of incline directions is lower than the corresponding space frequency characteristic that Baeyer pixel moves pattern, and wherein the Baeyer pixel moves the corresponding space frequency characteristic height of the corresponding space frequency characteristic of pattern than Bayer pattern.

Figure 30 B also illustrates: the R of the colour image of the 7th embodiment is lower than the corresponding space frequency characteristic of Bayer pattern with the spatial frequency characteristic of B pixel on vertical and horizontal direction, and wherein the corresponding space frequency characteristic of Bayer pattern is lower than the corresponding space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 7th embodiment is identical with the corresponding space frequency characteristic of the 6th embodiment with the spatial frequency characteristic of B pixel on 45 ° of incline directions.

Figure 30 B also illustrates: the R of the colour image of the 8th embodiment is lower than the corresponding space frequency characteristic of Bayer pattern with the spatial frequency characteristic of B pixel on vertical and horizontal direction, and wherein the corresponding space frequency characteristic of Bayer pattern is lower than the corresponding space frequency characteristic that Baeyer pixel moves pattern; And the R of the colour image of the 8th embodiment and the B pixel spatial frequency characteristic on 45 ° of incline directions is lower than the corresponding space frequency characteristic that Baeyer pixel moves pattern.

These comparative results show: the 6th with the G pixel of the colour image of the 7th embodiment on vertical and horizontal direction and the G pixel of the colour image of the 8th embodiment on 45 ° of incline directions, represented the higher spatial frequency characteristic of spatial frequency characteristic than known colour image (Bayer pattern and Baeyer pixel move pattern).Because the G pixel is the basic pixel that is used to generate brightness (Y) component, so the higher spatial frequency characteristic of G pixel helps to improve resolution very much.

On the contrary, the spatial frequency characteristic of R and B pixel is lower than the spatial frequency characteristic of known colour image (Bayer pattern and Baeyer pixel move pattern).Yet as mentioned above, human eyes are more insensitive to R and B color, and like this, the low characteristic of R and B color can not have a strong impact on the raising of resolution.

As discussed above, the pixel that comprises photoelectric transformer therein by bidimensional be arranged in the matrix and comprise that the colour filter as the G component of the fundamental component that is used for generating brightness (Y) component and other R and B component is disposed in the lip-deep solid-state imaging apparatus of pixel, arrange colour filter, make the G pixel surround R and B pixel.Therefore, the G pixel arrangement in all row and all row of colour filter, had the spatial frequency characteristic (spatial resolution) of the G component of higher sensitivity thereby increase human eyes to it.

More specifically, the resolution of G pixel on vertical and horizontal direction is greater than or equal to the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is greater than or equal to the corresponding resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.As a result, not only to achromatic object, and, can represent higher resolution to the object of colour.

In addition, to move pattern different with known Baeyer pixel, there is no need to adjust the RGB balance in the camera signal treatment system that will be described below, overcome the low resolution of G pixel, thereby prevented the generation that departs from caused wrong color in the balance of power level.

Particularly, in the colour image of the 6th embodiment, interlacing and arrange R and B pixel every row, make R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/2.Therefore, the resolution of G pixel on vertical and horizontal direction is higher than the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is comparable to the resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.

In the colour image of the 7th embodiment, interlacing and arrange R and B pixel every row, make R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/4.Therefore, as the colour image of the 6th embodiment, the resolution of G pixel on vertical and horizontal direction is higher than the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on 45 ° of incline directions is comparable to the corresponding resolution that the Baeyer pixel moves pattern, and wherein the Baeyer pixel corresponding resolution that moves pattern is higher than the corresponding resolution of Bayer pattern.

In the colour image of the 8th embodiment, therein the pixel of even-numbered is expert at and column direction on from the oblique pixel pattern of pixel shift 1/2 pixel pitch of odd-numbered, interlacing and arrange R and B pixel every row ground, make R and the B pixel sampling rate on vertical and horizontal direction become the G pixel sampling rate 1/4.Therefore, as the colour image of the 8th embodiment, the resolution of G pixel on vertical and horizontal direction is comparable to the corresponding resolution of Bayer pattern, and wherein the corresponding resolution of Bayer pattern is higher than the corresponding resolution that the Baeyer pixel moves pattern; And the resolution of G pixel on the 45 ° of directions that tilt doubles the corresponding resolution of Bayer pattern.

Particularly, in the colour image of the 8th embodiment with oblique pixel pattern, sampling rate is the sampling rate of Bayer pattern

Doubly.Therefore, can obtain the many Pixel Information of twice of cage pattern of pixels, that is, compare with the cage pattern of pixels and can obtain higher resolution.If desired with the identical resolution of cage pattern of pixels resolution, then can be on wideer pitch laying out pixel.As a result, can increase pixel aperture (pixel aperture), making to increase the photo sensitivity of pixel, thereby obtains to have the signal of high S/N ratio.

In the colour image of the 6th embodiment, Figure 23 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/2, and, on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/4.In the colour image of the 7th embodiment, Figure 26 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/4, and on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/4.In the colour image of the 8th embodiment, Figure 29 illustrates: on vertical and horizontal direction, the spatial frequency characteristic of R and B pixel be the G pixel spatial frequency characteristic 1/4, and on 45 ° of incline directions, its be the G pixel spatial frequency characteristic 1/2.

Yet the human human eyes of observability characteristic proof are easy to be familiar with the resolution of high brightness and are difficult to be familiar with high color-resolution.Therefore, the above-mentioned R and the spatial frequency characteristic of B pixel are enough.

For example, in common television format signal, the frequency band (band) of colourity (C) signal be brightness (Y) signal frequency band 1/4, this is enough for color-resolution.The colour image of the 6th to the 8th embodiment has utilized this characteristic best.

In other words, colour image according to the 6th to the 8th embodiment, the color space frequency characteristic is reduced to the minimum level that can not allow human eyes produce factitious sensation, as an alternative, increase the brightness space frequency characteristic considerably with respect to known colour image.

In addition, in the colour image of the 6th to the 8th embodiment, in all row and all row, arrange the G pixel.This helps to be used for increasing the interpolation precision when the interpolation of R and B locus interpolation G pixel is handled when carrying out in the camera signal treatment system very much, and this point will be discussed below.

The solid-state imaging apparatus that comprises the colour filter of the colour image with the 6th to the 8th embodiment is suitable for being particularly suitable for as the imaging device in the video camera as the imaging device such as digital still life camera and video camera.

Imaging device

Figure 20 is the diagram block diagram of the example of the configuration of imaging device according to an embodiment of the invention.In Figure 20, the corresponding image of light that the formation of the optical system such as lens 1011 on the imaging surface of imaging device 1012 and object (not shown) are reflected.As imaging device 1012, used comprising the pixel of photoelectric transformer and arranged by bidimensional ground and have a lip-deep solid-state imaging apparatus that is disposed in this pixel as the colour filter of the color component of the fundamental component that is used to generate luminance component and other color component.In this case, use the colour filter that has according to the colour image of the 6th, the 7th or the 8th embodiment.

Imaging device shown in Figure 20 comprises lens 1011, imaging device (solid state image pickup device) 1012, analog digital (A/D) transducer 1013 and camera signal treatment circuit 1014.Camera signal treatment circuit 1014 comprises optical system correcting circuit 1021, interpolation circuit 1022, brightness (Y) signal processing circuit 1023, colored (C) signal processing circuit 1024, frequency band limits low pass filter (LPF) 1025, and extracts treatment circuit 1026.

In the light on being incident on imaging device 1012, only corresponding with the color component of colour filter light component has passed through colour filter, and is incident on the pixel.Then, the light that will incide on the pixel by the photoelectric transformer such as photodiode is converted into the signal of telecommunication, and it is read as analog signal.Then, this analog signal conversion is become digital signal, and this digital signal is input to camera signal treatment circuit 1014 by A/D converter 1013.

Optical system correcting circuit 1021 is carried out the correction to transducer or optical system, comes the correcting digital clamper or is used at the defect correction of defect correction imaging device 1012 and is used for coming the blackspot (shading) of correcting lens 1011 to proofread and correct at edge light dark and gloomy (eclipse) such as being used for adjustment at black level.

Interpolation circuit 1022 generates three planed signals from the rgb signal of space out-phase each other, the rgb signal that has same spatial location with generation, and this rgb signal is supplied to Y-signal treatment circuit 1023 and C signal processing circuit 1024.Y-signal treatment circuit 1023 generates brightness (Y) signal according to above-mentioned formula (1).C signal processing circuit 1024 generates color difference signal Cr (R-Y) and Cb (B-Y) according to equation (2).

Cr＝(R-Y)＝R-(0.3R+0.6G+0.1B)

Cb＝(B-Y)＝B-(0.3R+0.6G+0.1B) (2)

Frequency band limits LPF 1025 is that cut-off frequency equals 1/8 the filter of sampling frequency fs as shown in figure 31, and it is Cr and the Cb color difference signal of (1/2) fs to (1/8) fs that this filter weakens (drop) frequency range.Cr and Cb color difference signal according to television format signal output band restriction LPF 1025.If output Cr and Cb color difference signal then are that 1/8fs or higher signal are output as rub-out signal with frequency under the situation of not carrying out frequency band limits.Shown in figure 32, extract treatment circuit 1026 and extract Cr and Cb color difference signal.

The reason that is used to extract Cr and Cb color difference signal is 1/4 of Cr and the Cb color difference signal frequency band that only needs brightness (Y) signal.This is determined by television format signal, and this also is difficult to recognize high-frequency colourity (C) signal because human eyes are easy to recognize high-frequency brightness (Y) signal.

When with Y: Cr: Cb=4: 4: 4 (output band of Y and C signal is identical) and Y: Cr: Cb=4: when the difference between 1: 1 is observed as output signal, except the special object of the object that for example uses red or Bluepoint light source, be difficult to the difference in the output image of identifying object.In other words, if the C signal have Y-signal frequency band 1/4, then can obtain the resolution of enough level, this is determined by television format signal.

This means the color filter pattern that can be used as colour filter according to the colour image of the 6th, the 7th or the 8th embodiment, wherein this colour filter serves as the imaging device 1012 of solid-state imaging apparatus.

More specifically, the spatial frequency of R and B color component---with the different color component of G component as the primary color component that is used to generate luminance component---is as described below.In the colour image of the 6th embodiment, as shown in figure 23, the spatial frequency of R and B color component is 1/2 and be 1/4 on 45 ° of directions on vertical and horizontal direction.In the colour image of the 7th embodiment, as shown in figure 26, the spatial frequency of R and B color component is 1/4 and be 1/4 on 45 ° of directions on vertical and horizontal direction.In the colour image of the 8th embodiment, as shown in figure 29, the spatial frequency of R and B color component is 1/4 and be 1/2 on 45 ° of directions on vertical and horizontal direction.Therefore, any one color pixel all satisfies Y: Cr: Cb=4: 1: 1 condition.

As mentioned above, by be used for the imaging device 1012 of the imaging device such as digital still life camera or video camera (particularly video camera) with the colour image conduct of the 6th, the 7th or the 8th embodiment, can increase human eyes it is had the spatial frequency characteristic (spatial resolution) of highly sensitive G component.As a result, not only can obtain high brightness resolution to the achromaticity object but also to colored object.

In addition, to move pattern different with known Baeyer pixel, need not adjust the balance of power level of rgb pixel in camera signal treatment circuit 1014, overcome the lower resolution of G pixel.In addition, circuit operation is simplified, and can be prevented by the generation that departs from caused wrong color in the balance of power level.

In in the colour image of the 6th, the 7th and the 8th embodiment any, the G pixel is surrounded R and B pixel.Therefore since with the G pixel arrangement in all row and all row, so improved greatly when in the interpolation circuit 1022 at camera signal treatment circuit 1014 with the G pixel interpolating interpolation precision on R and B locus the time.

It should be appreciated by those skilled in the art, various changes, combination, sub-portfolio and change to be arranged, as long as they are within the scope of claims or its equivalent according to design needs and other factors.

Claims (10)

1, a kind of solid-state imaging apparatus comprises:

Pixel, comprise by bidimensional be arranged in photoelectric transformer in the matrix; And

Colour filter comprises primary color component and other color component as the fundamental component that is used to generate luminance component, and this colour filter is disposed on the surface of pixel,

Wherein primary color component and other color component are arranged such that primary color component surrounds other color component.

2, according to the solid-state imaging apparatus of claim 1, wherein other color component is arranged by interlacing with every row, make the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/2.

3, according to the solid-state imaging apparatus of claim 2, wherein other color component has two kinds of colors, and the row of going and comprising primary color component and other color component that only comprises primary color component is by arranged alternate.

4, according to the solid-state imaging apparatus of claim 1, wherein other color component is arranged by interlacing with every row, make the sampling rate of other color component on vertical and horizontal direction become primary color component sampling rate 1/4.

5, according to the solid-state imaging apparatus of claim 4, wherein, other color component has two kinds of colors; And

The row that only comprises primary color component arranged by interlacing, and the row of other color component of going and comprising primary color component and another kind of color of other color component that comprises primary color component and a kind of color is by arranged alternate.

6, according to the solid-state imaging apparatus of claim 4, wherein, every capable pixel is by from adjacent lines pixel shift 1/2 pixel pitch, and every row pixel is by from adjacent column pixel shift 1/2 pixel pitch.

7, according to the solid-state imaging apparatus of claim 6, wherein, other color component has two kinds of colors; And

The row that only comprises primary color component arranged by interlacing, and the row of other color component of going and comprising primary color component and another kind of color of other color component that comprises primary color component and a kind of color is by arranged alternate.

8, a kind of imaging device comprises:

Solid-state imaging apparatus, it comprises having as the primary color component of the fundamental component that is used to generate luminance component and the colour filter of other color component, this primary color component and other color component are arranged such that primary color component surrounds other color component;

Optical system, be configured on the imaging surface of solid-state imaging apparatus to form corresponding to from the image of light of object; And

Signal processing circuit is configured to handle the output signal of solid-state imaging apparatus.

9, a kind of solid state image pickup device comprises:

Pel array, has the oblique pixel pattern that pixel is wherein arranged with being tilted, the capable vertical signal line of odd-numbered in the capable vertical signal line group of odd-numbered is connected to each row of the capable pixel of odd-numbered, and the capable vertical signal line of even-numbered in the capable vertical signal line group of even-numbered is connected to each row of the capable pixel of even-numbered;

Row selector is configured to select respectively the odd-numbered of oblique pixel pattern capable and even-numbered is capable;

Odd-numbered ranks treatment circuit group, it comprises column processing circuit and is connected to the capable vertical signal line group of odd-numbered, is used for the signal plus with the capable pixel of odd-numbered between a plurality of row;

Even-numbered ranks treatment circuit group, it comprises column processing circuit and is connected to the capable vertical signal line group of even-numbered, is used for the signal plus with the capable pixel of even-numbered of pixel column; And

Column selector is configured to select the column processing circuit of odd-numbered ranks treatment circuit group and the column processing circuit of even-numbered ranks treatment circuit group.

10, a kind of imaging device comprises:

Solid state image pickup device, has the oblique pixel pattern that pixel is wherein arranged with being tilted, on having horizontal direction on an adjacent n pixel and the vertical direction in the zone of an adjacent n pixel, capable and even-numbered is capable and with y pixel repeated addition on pixel of the x on the horizontal direction and the vertical direction at the odd-numbered of oblique pixel pattern respectively, simultaneously will have on the horizontal direction a regional mobile m pixel of an adjacent n pixel on the adjacent n pixel and vertical direction on the horizontal or vertical direction, this x pixel has identical color with y pixel, wherein, n is three or bigger odd number, m is three or bigger odd number, and n 〉=x 〉=y, odd-numbered is capable has on the horizontal direction the capable spatial relation between the zone of an adjacent n pixel that has on the horizontal direction on the adjacent n pixel and vertical direction in the zone of an adjacent n pixel and even-numbered on the adjacent n pixel and vertical direction make their m pixels that be shifted each other on the incline direction of oblique pixel pattern;

Mode setting unit, be configured to optionally to be provided for independently to read all pixels in the oblique pixel pattern signal gradual read mode and be used for pixel addition read mode with the pixel addition of oblique pixel pattern; And

Driver element is configured to drive solid state image pickup device according to gradual read mode or pixel addition read mode by the mode setting unit setting.

Images