CN105430359B - Imaging method, imaging sensor, imaging device and electronic device - Google Patents
Imaging method, imaging sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105430359B CN105430359B CN201510963592.1A CN201510963592A CN105430359B CN 105430359 B CN105430359 B CN 105430359B CN 201510963592 A CN201510963592 A CN 201510963592A CN 105430359 B CN105430359 B CN 105430359B
- Authority
- CN
- China
- Prior art keywords
- pixel
- image
- merging
- infrared
- photosensitive pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 114
- 238000001914 filtration Methods 0.000 claims abstract description 97
- 230000003287 optical effect Effects 0.000 claims abstract description 65
- 238000012545 processing Methods 0.000 claims description 51
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000000465 moulding Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 22
- 230000006870 function Effects 0.000 description 10
- 238000000034 method Methods 0.000 description 9
- 238000005286 illumination Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000003750 conditioning effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 238000004382 potting Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a kind of imaging methods, first, imaging sensor is provided, imaging sensor includes photosensitive pixel array and the optical filter being arranged on photosensitive pixel array, optical filter includes filter unit array, and each filter unit includes white filter area, colorized optical filtering area and infrared filtering area.Colorized optical filtering area covers a photosensitive pixel, and white filter area and infrared filtering area are covered each by least one photosensitive pixel.The photosensitive pixel of same filter unit covering, which is formed, merges pixel.Then, the output of photosensitive pixel array is read, and is calculated according to the output of the same photosensitive pixel for merging pixel and merges the pixel value of pixel to generate merging image.Obtained merging image includes complete color information, and signal-to-noise ratio is high.The invention also discloses a kind of imaging sensors, imaging device and the electronic device using imaging device that can be used for realizing this imaging method.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging method, imaging sensor, imaging device and electronics dress
It puts.
Background technology
The optical filtering pel array of conventional images sensor include R, G, B optical filtering pixel, some imaging sensors with W, IR come
Original R, G, B optical filtering pixel in part is replaced, though the preferable image of clarity can be obtained under low-light (level), color can be not allowed
Really.Wherein, R, G, B, W, IR represent red, green, blue, white and infrared respectively.
Invention content
The present invention is directed at least solve one of technical problem in the prior art.For this purpose, the present invention needs offer one
Kind imaging method, imaging sensor, imaging device and electronic device.
The imaging method of embodiment of the present invention includes the following steps：
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set to the photosensitive pixel array
On optical filter, the optical filter includes filter unit array, the filter unit include white filter area, colorized optical filtering area and
Infrared filtering area, the colorized optical filtering area cover a photosensitive pixel, and the infrared filtering area is used to only make preset wavelength
Infrared light pass through, it is described white filter area and the infrared filtering area be covered each by least one photosensitive pixel, together
The photosensitive pixel of the one filter unit covering, which is formed, merges pixel；And
The output of the photosensitive pixel array is read, and according to the output of the same photosensitive pixel for merging pixel
The pixel value for merging pixel is calculated to generate merging image.
The colorized optical filtering area of filter unit in the imaging method of embodiment of the present invention merges the color of pixel for obtaining
Multimedia message, white filter area and infrared filtering area merge the luminance information and this luminance information of pixel for being obtained under low-light (level)
Noise is less.In this way, the pixel value of generation image had not only included color information but also the luminance information for including low noise degree, image is generated
Color is complete, and brightness and clarity are preferable, and noise is few, solves the problems, such as certain in existing imaging method.
In some embodiments, each described 2*2 photosensitive pixels of filter unit covering；The colorized optical filtering
Area, the white filter area and the infrared filtering area are covered each by one, two, a photosensitive pixel.
In some embodiments, each described 2*2 photosensitive pixels of filter unit covering；The colorized optical filtering
Area, the white filter area and the infrared filtering area are covered each by one, one, two photosensitive pixels.
In some embodiments, the read step further comprises：
It acquires the output of the photosensitive pixel of+1 row of row k and kth and is stored in register, wherein k=2n-1, n are certainly
So number, k+1 are less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of+1 row of the row k and kth is extracted from the register to obtain the conjunction
And the pixel value of pixel.
In some embodiments, the pixel value for merging pixel include respectively with the colorized optical filtering area, described white
The corresponding color pixel values of color filter area and the infrared filtering area, white pixel value and infrared image element value；
The read step further comprises：
Coloured image, ash are generated according to the color pixel values, the white pixel value and the infrared image element value respectively
Spend image and infrared image；And
Merge image according to the coloured image, gray level image and IR image enhancement.
In some embodiments,
The read step further comprises：
By the same the output phase of the corresponding at least one photosensitive pixel of the white filter area for merging pixel
Add as the white pixel value for merging pixel or the same infrared filtering area for merging pixel is corresponding described
The output of at least one photosensitive pixel is added as the infrared image element value for merging pixel.
In some embodiments, the read step further comprises：
The coloured image is converted to the colored subgraph of yuv format；And
By the brightness value of the colored subgraph replace with according to the colored subgraph and/or the gray level image and/
Or the obtained brightness value of the infrared image is to generate the merging image.
In some embodiments, the replacement step further comprises：
It senses and judges ambient brightness：And
When the ambient brightness is more than the first predetermined threshold, the brightness value of the colored subgraph is subtracted described infrared
The brightness value of image is so as to obtain the merging image.
In some embodiments, the replacement step further comprises：
It senses and judges ambient brightness：And
When the ambient brightness is less than the second predetermined threshold, by the brightness value of the colored subgraph plus described infrared
The brightness value of image is so as to obtain the merging image.
In some embodiments, the replacement step further comprises：
It senses and judges ambient brightness：And
When the ambient brightness is less than third predetermined threshold, by the brightness value of the colored subgraph plus described infrared
The brightness value of image simultaneously adds the brightness value of the gray level image to obtain the merging image.
In some embodiments, each photosensitive pixel is connect respectively with an analog-digital converter；
The imaging method further comprises：
The analog signal output that the photosensitive pixel generates is converted into digital signal output；And
The same digital signal for merging the corresponding photosensitive pixel of white filter area described in pixel is defeated
Go out to be added to obtain the white pixel value for merging pixel or correspond to infrared filtering area described in the same merging pixel
The photosensitive pixel the digital signal the output phase obtained it is described merge pixel infrared image element value.
The present invention also provides a kind of imaging sensor, including：
Photosensitive pixel array；And
The optical filter being set on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes white filter area, colorized optical filtering area
And infrared filtering area；The colorized optical filtering area covers a photosensitive pixel, and the infrared filtering area is used to only make default wave
Long infrared light passes through, and the white filter area and the infrared filtering area are covered each by least one photosensitive pixel；
The photosensitive pixel of the same filter unit covering, which is formed, merges pixel.
In some embodiments, the colorized optical filtering area forms Bayer array.
In some embodiments, each filter unit includes the 2*2 photosensitive pixels；The colorized optical filtering
Area, the white filter area and the infrared filtering area are covered each by one, two, a photosensitive pixel.
In some embodiments, each filter unit includes the 2*2 photosensitive pixels；The colorized optical filtering
Area, the white filter area and the infrared filtering area are covered each by one, one, two photosensitive pixels.
In some embodiments, described image sensor includes control module, and the control module is described for controlling
Photosensitive pixel array exposes line by line.
In some embodiments, described image sensor further includes register, and the control module is used to acquire successively
The output of the photosensitive pixel for+1 row of row k and kth that current exposure is completed simultaneously is stored in the register, wherein k=2n-1,
N is natural number, and k+1 is less than or equal to total line number of the photosensitive pixel array.
In some embodiments, described image sensor includes analog-digital converter array, each analog-digital converter
It is connect with a photosensitive pixel.
In some embodiments, described image sensor includes micro mirror array, each micro mirror and a sense
Light pixel corresponds to.
The present invention also provides a kind of imaging device, including the imaging sensor in the above embodiment；
The imaging device further includes the image processing module being connect with described image sensor；
Described image processing module is used to read and handle the output of the photosensitive pixel array to obtain the merging picture
The pixel value of element is so as to form merging image；
The pixel value for merging pixel include respectively with the colorized optical filtering area, the white filter area and described infrared
The corresponding color pixel values of filter area, white pixel value and infrared image element value；
The color pixel values, the white pixel value and the infrared image element value are respectively used to form coloured image, ash
Spend image and infrared image；
Described image processing module is used for according to the coloured image, the gray level image and IR image enhancement institute
State merging image.
In some embodiments, described image processing module is used to filter the same white for merging pixel
The output of the corresponding at least one photosensitive pixel in area is added as the white pixel value of the merging pixel or for will be same
The output of the one corresponding at least one photosensitive pixel in the infrared filtering area for merging pixel, which is added, is used as the conjunction
And the infrared image element value of pixel.
In some embodiments, described image processing module is additionally operable to the coloured image being converted to yuv format
Colored subgraph.
Described image processing module is additionally operable to replace with the brightness value of the colored subgraph according to the colored subgraph
As and/or the obtained brightness value of the gray level image and/or the infrared image to generate the merging image.
In some embodiments, described image processing module is used to judge environment according to the pixel value of the photosensitive pixel
Brightness and for when the ambient brightness is more than the first predetermined threshold, the brightness value of the colored subgraph being subtracted described
The brightness value of infrared image is so as to obtain the merging image.
In some embodiments, described image processing module is used to judge environment according to the pixel value of the photosensitive pixel
Brightness and for when the ambient brightness is less than the second predetermined threshold, by the brightness value of the colored subgraph plus described
The brightness value of infrared image is so as to obtain the merging image.
In some embodiments, described image processing module is used to judge environment according to the pixel value of the photosensitive pixel
Brightness and for when the ambient brightness is less than third predetermined threshold, by the brightness value of the colored subgraph plus described
The brightness value of infrared image simultaneously adds the brightness value of the gray level image to obtain the merging image.
The present invention also provides a kind of electronic device, including the imaging device in the above embodiment.
In some embodiments, the electronic device includes mobile phone.
In some embodiments, the imaging device includes the Front camera of the mobile phone.
In some embodiments, the electronic device includes the central processing unit and external memory that are connect with the imaging device
Reservoir, the central processing unit are used to that the external memory to be controlled to store the merging image.
In some embodiments, the electronic device further includes the central processing unit being connect with the imaging device and shows
Showing device, the central processing unit are used to that the display device to be controlled to show the merging image.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description
It obtains significantly or is recognized by the practice of the present invention.
Description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention is from combining in description of the accompanying drawings below to embodiment by change
It obtains significantly and is readily appreciated that, wherein：
Fig. 1 is the flow diagram of the imaging method of embodiment of the present invention.
Fig. 2 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 3 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 4 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 5 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 6 is the flow diagram of the replacement step of embodiment of the present invention imaging method.
Fig. 7 is the flow diagram of the replacement step of embodiment of the present invention imaging method.
Fig. 8 is the flow diagram of the replacement step of embodiment of the present invention imaging method.
Fig. 9 is the flow diagram of the read step of embodiment of the present invention imaging method.
Figure 10 is the schematic side view of the imaging sensor of embodiment of the present invention.
Figure 11 is the filter unit schematic diagram of the imaging sensor of embodiment of the present invention.
Figure 12 is the filter unit array schematic diagram of Bayer structure.
Figure 13 is the filter unit array schematic diagram of the imaging sensor of embodiment of the present invention.
Figure 14 is the dimensional structure diagram of the imaging sensor of embodiment of the present invention.
Figure 15 is the filter unit array schematic diagram of the imaging sensor of embodiment of the present invention.
Figure 16 is the dimensional structure diagram of the imaging sensor of embodiment of the present invention.
Figure 17 is the high-level schematic functional block diagram of the imaging sensor of embodiment of the present invention.
Figure 18 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imaging sensor.
Figure 19 is the high-level schematic functional block diagram of the imaging sensor of embodiment of the present invention.
Figure 20 is the dimensional structure diagram of the imaging sensor of embodiment of the present invention.
Figure 21 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 22 is the high-level schematic functional block diagram of the electronic device of embodiment of the present invention.
Figure 23 is the high-level schematic functional block diagram of the electronic device of embodiment of the present invention.
Specific embodiment
The embodiment of embodiments of the present invention is described below in detail, the example of the embodiment is shown in the accompanying drawings
Go out, wherein same or similar label represents same or similar element or the member with same or like function from beginning to end
Part.It is exemplary below with reference to the embodiment of attached drawing description, is only used for explaining embodiments of the present invention, and cannot
It is interpreted as the limitation to embodiments of the present invention.
The imaging method of embodiments of the present invention, imaging sensor, imaging device and electronics are filled below in conjunction with attached drawing
It puts and is described further.
Referring to Fig. 1, the imaging method of embodiment of the present invention includes the following steps：
S1, provides imaging sensor, and imaging sensor includes photosensitive pixel array and is set on photosensitive pixel array
Optical filter, optical filter include filter unit array, and filter unit includes white filter area, colorized optical filtering area and infrared filtering area,
Colorized optical filtering area covers a photosensitive pixel, and for only passing through the infrared light of preset wavelength, white filters in infrared filtering area
Area and infrared filtering area are covered each by least one photosensitive pixel, and the photosensitive pixel of same filter unit covering, which is formed, merges picture
Element.
S2 reads the output of photosensitive pixel array, and is calculated and merged according to the output of the same photosensitive pixel for merging pixel
The pixel value of pixel is to generate merging image.
The colorized optical filtering area of filter unit in the imaging method of embodiment of the present invention merges the color of pixel for obtaining
Multimedia message, white filter area and infrared filtering area merge the luminance information and this luminance information of pixel for being obtained under low-light (level)
Noise is less.In this way, the pixel value of composograph had not only included color information but also the luminance information for including low noise degree, composograph
Color is complete, and brightness and clarity are preferable, and noise is few.
It please join Figure 14, in some embodiments, each filter unit covers 2*2 photosensitive pixel；It is colorized optical filtering area, white
Color filter area and infrared filtering area are covered each by one, two, a photosensitive pixel.
It please join Figure 16, in some embodiments, each filter unit covers 2*2 photosensitive pixel；It is colorized optical filtering area, white
Color filter area and infrared filtering area are covered each by one, one, two photosensitive pixels.
It please join Fig. 2, in imaging method in the present embodiment, step S2 further comprises：
S21：It acquires the output of the photosensitive pixel of+1 row of row k and kth and is stored in register, wherein k=2n-1, n are certainly
So number, k+1 are less than or equal to total line number of photosensitive pixel array.
S23：The output of the photosensitive pixel of+1 row of row k and kth is extracted from register to obtain the pixel for merging pixel
Value.
In this way, register can be made full use of to realize output reading, caching and the process merged of photosensitive unit, hardware
Easy to implement and processing speed is very fast.
In some embodiments, merge pixel pixel value include respectively with colorized optical filtering area, white filter area and red
The corresponding color pixel values of outer filter area, white pixel value and infrared image element value.
It please join Fig. 3, step S2 further comprises：
S25：Respectively according to color pixel values, white pixel value and infrared image element value generate coloured image, gray level image and
Infrared image.
S26：Image is merged according to coloured image, gray level image and IR image enhancement.
In this way, the complete coloured image of color information is worth to according to the colour element for merging pixel, according to merging pixel
White pixel be worth to brightness and the gray level image that clarity is preferable, noise is less under low-light (level).
It please join Fig. 4, in some embodiments, step S2 further comprises：
The output of the same corresponding at least one photosensitive pixel of white filter area for merging pixel is added as conjunction by S24
And the white pixel value of pixel or by it is same merge pixel the corresponding at least one photosensitive pixel in infrared filtering area the output phase
Add as the infrared image element value for merging pixel.
In this way, using the method for potting gum, merge sum of the output of pixel for pixel output each before merging, and merge
The noise of pixel is less than merge before each pixel noise sum, therefore the gray level image that generates later of merging or infrared image are made an uproar
Point is less, and signal-to-noise ratio is high.
It please join Fig. 5, in some embodiments, step S2 further comprises：
Coloured image is converted to the colored subgraph of yuv format by S27；And
S29 replaces with the brightness value of colored subgraph according to colored subgraph and/or gray level image and/or infrared figure
As obtained brightness value to generate merging image.
The image of yuv format includes brightness attribute, and common green, red, blue color filter are almost without hindrance to infrared ray
Every, therefore infrared ray passes through optical filter that can lead to the image fault generated, especially under high illumination.Under low-light (level), compared with
Colorized optical filtering area, white filter area are smaller to the barrier effect of ambient, therefore in same merging pixel, white pixel value pair
The gray level image brightness value answered is higher, noise is also less.Due to have the object of heat can infrared radiation, and IR wavelength
It is longer and propagate farther out, can realize preferable imaging effect by sensing infrared ray under low-light (level).Therefore, it is colored under low-light (level)
Subgraph can compensate processing according to gray level image or infrared image, to generate clarity and the higher merging figure of signal-to-noise ratio
Picture.
It please join Fig. 6, in some embodiments, replacement step further comprises：
S291：It senses and judges ambient brightness：
When ambient brightness is more than the first predetermined threshold, the brightness value of colored subgraph is subtracted to the brightness value of infrared image
So as to obtain merging image.
It please join Fig. 7, in some embodiments, replacement step further comprises：
S293：It senses and judges ambient brightness：
When ambient brightness is less than the second predetermined threshold, the brightness value of colored subgraph is added to the brightness value of infrared image
So as to obtain merging image.
It please join Fig. 8, in some embodiments, replacement step further comprises：
S295：It senses and judges ambient brightness：
When ambient brightness is less than third predetermined threshold, the brightness value of colored subgraph is added to the brightness value of infrared image
And the brightness value of gray level image is added to obtain merging image.
It can be using the pixel value of photosensitive pixel as the foundation for judging ambient brightness, for example, whites all on optical filter are filtered
The pixel value of the corresponding photosensitive pixel in light area, which is averaged, is used as ambient brightness value.By sensing and judging ambient brightness, come
Appropriate processing is carried out to colored subgraph.Such as the infrared ray that external scene radiates during daytime can influence image quality, can allow
The brightness value of colored subgraph cuts its infrared ray luminance components.When night brightness is relatively low, using white filter or infrared
The brightness value of the photosensitive pixel imaging of optical filter compensates to promote brightness of image and signal-to-noise ratio.
In the relatively low environment of brightness, both the brightness value of colored subgraph can directly be replaced with gray level image or infrared figure
The brightness value of colored subgraph can also be added gray-scale map by the sum of the brightness value of picture or the brightness value that replaces with the two images
The brightness value or the brightness value of superposition gray level image and infrared image of picture or infrared image are as the brightness value for merging image.
It please join Fig. 9, in some embodiments, each photosensitive pixel is connect respectively with an analog-digital converter；
Step S2 further comprises：
The analog signal output that photosensitive pixel generates is converted to digital signal output by S31；
S33 is obtained the digital signal the output phase of the corresponding photosensitive pixel of filter area white in same merging pixel
Merge the white pixel value of pixel or export the digital signal of the corresponding photosensitive pixel in infrared filtering area in same merging pixel
It is added the infrared image element value to obtain merging pixel.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly handle the output of imaging sensor, two, relative to it is certain by circuit directly to imaging sensor
Analog signal format the scheme that is handled of output for, the information of image is preferably remained, for example, for 16M pictures
For the imaging sensor of element, the imaging method of embodiment of the present invention can retain the letter of 16M pixels (image before merging)
Breath obtains the merging image of 4M pixels or the image of other resolution ratio by processing on this basis.
The imaging method of embodiment of the present invention can be realized by the imaging sensor of embodiment of the present invention.
0 and Figure 11 is please referred to Fig.1, the imaging sensor 10 of embodiment of the present invention includes photosensitive pixel array 11 and setting
In the optical filter 13 on photosensitive pixel array 11.Optical filter 13 includes filter unit array 131, and each filter unit 1311 includes
White filter area 1313, colorized optical filtering area 1315 and infrared filtering area 1316.Colorized optical filtering area 1315 covers a photosensitive pixel
111, infrared filtering area 1316 is for only passing through the infrared light of preset wavelength, white filter area 1313 and infrared filtering area
1316 are covered each by least one photosensitive pixel 111.The photosensitive pixel of same filter unit covering, which is formed, merges pixel.Exterior light
Line is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to generate electric signal by optical filter 13, i.e., photosensitive pixel 111 is defeated
Go out.
The colorized optical filtering area 1316 of filter unit 1311 in the imaging method of embodiment of the present invention merges for obtaining
The color information of pixel, white filter area 1313 and infrared filtering area 1316 merge the brightness of pixel for being obtained under low-light (level)
Information and this luminance information noise is less.In this way, the pixel value of composograph is not only bright comprising color information but also comprising low noise degree
Information is spent, the color of composograph is complete, and brightness and clarity are preferable, and noise is few.
2 are please referred to Fig.1, in some embodiments, colorized optical filtering area forms Bayer array (Bayer pattern).
Bayer array includes filtering structure 1317, and each filtering structure 1317 includes 2*2 filter unit 1311, respectively
It is green, red, blue, green filter unit 1311.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware
Big adjustment is done in structure.
In traditional filter unit array structure, each filter unit corresponds to multiple photosensitive pixels and image pixel.It please join
Figure 11 is read, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure 1317, each knot that filters
Structure 1317 includes green, red, blue, green filter unit 1311, and unlike, each filter unit 1311 corresponds to multiple
Photosensitive pixel 111.Colored filter 1315 in each filter unit 1311 corresponds to a photosensitive pixel 111, white filtration piece
1313 and infrared fileter 1316 respectively correspond to a photosensitive pixel 111.
4 and Figure 13 is please referred to Fig.1, in certain embodiment, each filter unit 1311 covers 2*2 photosensitive pixel
111 to form merging pixel.Colorized optical filtering area 1315, white filter area 1313 and infrared filtering area 1316 be covered each by one,
Two, a photosensitive pixel 111.
6 and Figure 15 is please referred to Fig.1, in another embodiment, each filter unit 1311 covers 2*2 photosensitive pixel
111 to form merging pixel.Colorized optical filtering area 1315, white filter area 1313 and infrared filtering area 1316 be covered each by one,
One, two photosensitive pixels 111.
Difference lies in the quantity of the corresponding photosensitive pixel of white filter area and infrared filtering area for above two embodiment.
If white filter area corresponds to two photosensitive pixels, convenient for the high gray level image of generation signal-to-noise ratio and clarity.If infrared filtering area
Corresponding two photosensitive pixels, convenient for the high infrared image of generation signal-to-noise ratio and clarity.
Other than 2*2 structures, also structures such as 3*3,4*4, even arbitrary n*m (n, m are natural number), it will be understood that
The number of sequencable photosensitive pixel 111 is limited on photosensitive pixel array 11, each light-sensitive image for merging pixel and being included
If element 111 is excessive, the resolution sizes of image can be restricted, and e.g., if the pixel value of photosensitive pixel array 11 is 16M, be adopted
Can obtain the merging image that resolution ratio is 4M with the merging dot structure of 2*2, and use 4*4 structures just can only obtain resolution ratio for
The merging image of 1M.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, in the premise for sacrificing resolution ratio less as possible
Lower promotion brightness of image and clarity.Meanwhile the reading and conjunction that realization exports photosensitive pixel on hardware are facilitated using 2*2 structures
And it handles.
7 are please referred to Fig.1, in some embodiments, imaging sensor further includes control module 17, and control module 17 is used for
Control photosensitive pixel array 11 exposes line by line.Control module 17 is connected with row selection logic unit 171 and column selection logic unit
173, the output of photosensitive pixel 111 is handled line by line with control.
The mode for exposing and exporting line by line is easier to realize on hardware.
Also referring to Figure 17, in the present embodiment, imaging sensor 10 further includes register 19, and control module 17 is used
In the output of the photosensitive pixel 111 of+1 row of row k and kth that acquisition current exposure is completed successively and it is stored in register 19, wherein k
=2n-1, n are natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Specifically, please referring to Fig.1 7 and Figure 18, imaging sensor 10 includes patrolling with row selection logic unit 171 and column selection
Collect the control module 17 that unit 173 connects.Row selection logic unit 171 and column selection logic unit 173 and multiple photosensitive pixels
111 corresponding switching tubes 1115 connect, and control module 17 selects logic unit 171 and column selection logic unit for controlling to go
173 to gate the switching tube 1115 of the photosensitive pixel 111 of specific position.
Control module 17 acquires the output of the photosensitive pixel of the first row and the second row and is stored in register 19 first.Follow-up electricity
Road handles the output for four photosensitive pixels 111 that position coordinates are 1-1,1-2,2-1,2-2 to obtain merging pixel
Pixel value.The wherein left side digitized representation row of position coordinates, digits right represent row.
The output for four photosensitive pixels that coordinate is 1-3,1-4,2-3,2-4 is handled again, obtains accordingly merging pixel
Pixel value.
And so on, until having handled last four photosensitive pixel of group of the first row and the second row.
More than processing mode is pressed, the output of the photosensitive pixel of the third line and fourth line, fifth line and the 6th row etc. is carried out
Processing, until the output of whole photosensitive pixels handles completion.
It please join Figure 19 and Figure 18, in some embodiments, imaging sensor 10 includes 21 array of analog-digital converter, each
Photosensitive pixel 111 is connect respectively with an analog-digital converter 17.Analog-digital converter 17 is used for the analog signal of photosensitive pixel 111
Output is converted to digital signal output.
Photosensitive pixel 111 in present embodiment includes photodiode 1113.Photodiode 1113 is used for illumination
It is converted into charge, and the charge relationship proportional to intensity of illumination generated.Switching tube 1115 is used to select logic unit according to row
171 and the control signal of column selection logic unit 173 come the conducting and disconnection of control circuit, when circuit turn-on, source electrode follows
Charge signal of the device 1117 (source follower) for photodiode 1113 to be generated through illumination is converted into voltage letter
Number.Analog-digital converter 211 (Analog-to-digital converter) for voltage signal to be converted to digital signal, with
It is transmitted to subsequent conditioning circuit processing.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, in following digital circuit or in chip
It is middle to be handled with software.Therefore the output information of each photosensitive pixel can be retained, for example, the image for 16M pixels
For sensor, the imaging method of embodiment of the present invention can retain the information of 16M pixels (image before merging), in this base
On plinth the merging image of 4M pixels or the image of other resolution ratio are obtained by processing.It ultimately generates image and the probability of bad point occurs
It is relatively low.In addition, the noise of this output processing mode is smaller, noise is higher.
Figure 20 is please referred to, in some embodiments, imaging sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Row 23, each micro mirror 231 are corresponding with a photosensitive pixel 111.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 111, corresponded to including size, position.In certain implementations
In mode, each filter unit 1311 corresponds to 2*2 photosensitive pixel 111 and 2*2 micro mirror 191.It is terrible as technology develops
To the higher image of resolution ratio, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also less and less, and light is affected, and 1111 area of photosensitive part of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered to photosensitive part 1111, so as to promote the light reception intensity of photosensitive pixel 111 to improve image quality.
To sum up, each filter unit of imaging sensor in embodiment of the present invention includes white filter area, colorized optical filtering
Area and infrared filtering area make the pixel value of merging pixel not only include color information but also the luminance information for including low noise degree, with convenient
The subsequent conditioning circuit generation merging image that color is complete and signal-to-noise ratio is high.
It please join Figure 21, the present invention also provides a kind of imaging device 100, the imaging sensor including embodiment of the present invention
Except 10, the image processing module 50 being connect with imaging sensor 10 is further included.Image processing module 50 is used to read and handle
The output of photosensitive pixel array 11 with obtain merge pixel pixel value so as to form merging image.
Merge pixel pixel value include respectively with colorized optical filtering area 1315, white filter area 1313 and infrared filtering area
1316 corresponding color pixel values, white pixel value and infrared image element value.Color pixel values, white pixel value and infrared image element value
It is respectively used to form coloured image, gray level image and infrared image.Image processing module 50 is used for according to coloured image, gray-scale map
Picture and IR image enhancement merge image.
Specifically, the imaging sensor of embodiment of the present invention may include control module 17, row selection logic unit 171,
Column selection logic unit 173, analog-digital converter array 21, register 19 etc., the output of photosensitive pixel array 11 is through analog-to-digital conversion
Device array 21 is converted to digital signal, is stored in register 19 line by line and is sent to image processing module 50 and handles, until all
The output of photosensitive pixel is handled to generate merging image.
In this way, image processing module 50 is complete according to color pixel values corresponding with colorized optical filtering area generation color information
Coloured image and higher, the less gray level image of noise according to the corresponding white pixel value generation brightness of white filter area, according to
Clarity is high under the corresponding infrared image element value generation low-light (level) in infrared filtering area, the high infrared image of signal-to-noise ratio.
In the present embodiment, image processing module 50 is used for the same white filter area for merging pixel is corresponding at least
The output of one photosensitive pixel is added as the white pixel value for merging pixel or for by the infrared filtering of same merging pixel
The output of the corresponding at least one photosensitive pixel in area is added as the infrared image element value for merging pixel.
In this way, the output of more photosensitive pixels is added, the merging pixel signal-to-noise ratio higher of formation.It is for example it is assumed that original every
The output of a photosensitive pixel is S, noise N, merges pixel and includes m photosensitive pixel, then the pixel value for merging pixel is m*S,
And the noise for merging pixel isM is the natural number more than or equal to 1.It is appreciated that in m>In the case of 1, merge picture
The noise of element is less than before merging each the sum of noise of photosensitive pixel output.And the output for merging pixel is each light-sensitive image before merging
The sum of element output, therefore the gray level image or infrared image generated after merging, compared with what is generated in traditional approach with single pixel
Gray level image or infrared image, noise decline signal-to-noise ratio and improve, and clarity is promoted.
In some embodiments, image processing module is additionally operable to the colored subgraph that coloured image is converted to yuv format.
Image processing module be additionally operable to replace with the brightness value of colored subgraph according to colored subgraph and/or gray level image and/or
The brightness value that infrared image obtains is to generate merging image.
YUV is the picture format that color is described according to the principle of brightness and aberration, and yuv format includes many specific lattice
Formula, such as YUV422, YUV420 etc..In some embodiments, the colored pixel that merges includes green, red, blue combined pixels,
Image processing module is first worth to the coloured image of rgb format to get to each image slices according to the colored pixel for merging pixel
The red luma value of element, Green brightness value, blue intensity values are represented, then its corresponding yuv format image with R, G, B respectively
The brightness value Y=0.299*R+0.587*G+0.114*B of pixel.
In this way, it can obtain the colored subgraph of yuv format.
In some embodiments, image processing module is used to judge ambient brightness according to the pixel value of photosensitive pixel.
When ambient brightness is more than the first predetermined threshold, image processing module subtracts the brightness value of colored subgraph infrared
The brightness value of image is so as to obtain merging image.Or when ambient brightness is less than the second predetermined threshold, by colored subgraph
Brightness value is plus the brightness value of infrared image so as to obtain merging image.Or when ambient brightness is less than third predetermined threshold,
The brightness value of colored subgraph is added into the brightness value of infrared image and adds the brightness value of gray level image to obtain merging image.
It can be using the pixel value of photosensitive pixel as the foundation for judging ambient brightness, for example, whites all on optical filter are filtered
The pixel value of the corresponding photosensitive pixel in light area, which is averaged, is used as ambient brightness value.
By sensing and judging ambient brightness, appropriate processing is carried out to colored subgraph.It is more than the in ambient brightness
During one predetermined threshold, it can be considered that ambient brightness is higher, the infrared ray of external scene radiation can pass through colored filter so as to influence
Image quality, therefore the brightness value of colored subgraph can be allowed to cut its infrared ray luminance components to improve image quality.
When ambient brightness is less than the second predetermined threshold or less than third predetermined threshold, it can be considered that ambient brightness is relatively low, it can profit
The brightness value being imaged with the photosensitive pixel of white filter or infrared fileter compensates to promote brightness of image and signal-to-noise ratio.
In the relatively low environment of brightness, both the brightness value of colored subgraph can directly be replaced with gray level image or infrared figure
The brightness value of colored subgraph can also be added gray-scale map by the sum of the brightness value of picture or the brightness value that replaces with the two images
The brightness value or the brightness value of superposition gray level image and infrared image of picture or infrared image are as the brightness value for merging image.Specifically
The brightness replacement taken or compensation way, can be depending on ambient brightness, and be not limited to that embodiment of the present invention provides replaces
It changes or compensation way.Merge the brightness of image, some image in colored subgraph, gray level image and infrared image can be used
Brightness value or the wherein result of the brightness value operation of certain two or three image.
It to sum up, can be according to external environment illumination power according to colored subgraph, ash using the imaging device of present embodiment
Degree image and the brightness value of infrared image pixel, which integrate to obtain, merges image.Merge image on the basis of its color information is complete
Promote its brightness, signal-to-noise ratio and clarity.
The present invention also provides a kind of electronic devices using imaging device.In some embodiments, electronic device includes
Imaging device.Therefore, electronic device has camera function and can generate color under low-light (level) complete, signal-to-noise ratio height, a clarity
High merging image.
Electronic device can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Since Front camera is chiefly used in self-timer,
And self-timer generally requirement requires the clarity of image and not high to image resolution requirement, using the electronics of present embodiment
Device can meet this requirement.
Figure 22 is please referred to, in some embodiments, electronic device 200 includes the centre being connect with imaging device 100
Device 81 and external memory 83 are managed, central processing unit 81 merges image for external memory 83 to be controlled to store.
In this way, the merging image of generation can be stored, checked after convenient, use or transfer.External memory 83 includes
SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Figure 23 is please referred to, in some embodiments, electronic device 200 further includes the center being connect with imaging device 100
Processor 81 and display device 85, central processing unit 81 merge image for display device 85 to be controlled to show.In this way, electronic device
The image of 200 shootings can be shown in display device so that user checks.Display device is including light-emitting diode display etc..
To sum up, using the electronic device of embodiment of the present invention, there is camera function and color can be generated under low-light (level)
Completely, signal-to-noise ratio is high, the high merging image of clarity.Particularly, it when this electronic device is the Front camera of mobile phone, can be promoted
The brightness of self-timer image and clarity under low-light (level) reduce noise.
Part not deployed in imaging method and electronic device in embodiment of the present invention can join the figure of embodiment of above
As sensor or the corresponding part of imaging device, no longer it is developed in details herein.
In the description of this specification, reference term " embodiment ", " is schematically implemented " some embodiments "
The description of mode ", " example ", " specific example " or " some examples " etc. means the tool with reference to the embodiment or example description
Body characteristics, structure, material or feature are contained at least one embodiment or example of the present invention.In the present specification,
Schematic expression of the above terms are not necessarily referring to identical embodiment or example.Moreover, the specific features of description, knot
Structure, material or feature can in an appropriate manner combine in any one or more embodiments or example.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include
Module, segment or the portion of the code of the executable instruction of one or more the step of being used to implement specific logical function or process
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, to perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) it uses or combines these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
It puts.The more specific example (non-exhaustive list) of computer-readable medium is including following：Electricity with one or more wiring
Connecting portion (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can be for example by carrying out optical scanner to paper or other media, then into edlin, interpretation or when necessary with it
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the present invention can be realized with hardware, software, firmware or combination thereof.Above-mentioned
In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If for example, with hardware come realize in another embodiment, can be under well known in the art
Any one of row technology or their combination are realized：With for the logic gates to data-signal realization logic function
Discrete logic, have suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries
Suddenly it is that relevant hardware can be instructed to complete by program, the program can be stored in a kind of computer-readable storage medium
In matter, the program when being executed, one or a combination set of the step of including embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, it can also
That each unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and is independent product sale or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, those of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (20)
1. a kind of imaging method, which is characterized in that include the following steps：
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set on the photosensitive pixel array
Optical filter, the optical filter include filter unit array, and the filter unit includes white filter area, colorized optical filtering area and infrared
Filter area, the colorized optical filtering area cover a photosensitive pixel, the white filter area and infrared filtering area difference
At least one photosensitive pixel is covered, the photosensitive pixel of the same filter unit covering, which is formed, merges pixel, each
Described n*m photosensitive pixels of filter unit covering；And
The output of the photosensitive pixel array is read, and is calculated according to the output of the same photosensitive pixel for merging pixel
The pixel value for merging pixel is to generate merging image；
The pixel value for merging pixel include respectively with the colorized optical filtering area, the white filter area and the infrared filtering
The corresponding color pixel values in area, white pixel value and infrared image element value；
The read step further comprises：
Coloured image, gray-scale map are generated according to the color pixel values, the white pixel value and the infrared image element value respectively
Picture and infrared image；And
Merge image according to the coloured image, gray level image and IR image enhancement；
The read step further comprises：
The coloured image is converted to the colored subgraph of yuv format；And
The brightness value of the colored subgraph is replaced with according to the colored subgraph and/or the gray level image and/or institute
The brightness value that infrared image obtains is stated to generate the merging image；
The replacement step further comprises：
It senses and judges ambient brightness：
When the ambient brightness is more than the first predetermined threshold, the brightness value of the colored subgraph is subtracted into the infrared image
Brightness value so as to obtain the merging image；
When the ambient brightness is less than the second predetermined threshold, the brightness value of the colored subgraph is added into the infrared image
Brightness value so as to obtain the merging image；And
When the ambient brightness is less than third predetermined threshold, the brightness value of the colored subgraph is added into the infrared image
Brightness value and plus the gray level image brightness value to obtain the merging image.
2. imaging method as described in claim 1, which is characterized in that each filter unit covering 2*2 is described photosensitive
Pixel；The colorized optical filtering area, the white filter area and the infrared filtering area are covered each by described in one, two, one
Photosensitive pixel.
3. imaging method as described in claim 1, which is characterized in that each filter unit covering 2*2 is described photosensitive
Pixel；The colorized optical filtering area, the white filter area and the infrared filtering area are covered each by described in one, one, two
Photosensitive pixel.
4. the imaging method as described in claim 2-3 any one, which is characterized in that the read step further comprises：
It acquiring the output of the photosensitive pixel of+1 row of row k and kth and is stored in register, wherein k=2n-1, n are natural number,
K+1 is less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of+1 row of the row k and kth is extracted from the register to obtain the merging picture
The pixel value of element.
5. imaging method as described in claim 1, which is characterized in that
The read step further comprises：
The same output of the corresponding at least one photosensitive pixel of the white filter area for merging pixel is added and is made
For the white pixel value for merging pixel or by it is same it is described merge pixel the infrared filtering area it is corresponding it is described at least
The output of one photosensitive pixel is added as the infrared image element value for merging pixel.
6. imaging method as described in claim 1, which is characterized in that each photosensitive pixel respectively with an analog-to-digital conversion
Device connects；
The imaging method further comprises：
The analog signal output that the photosensitive pixel generates is converted into digital signal output；And
By the same digital signal the output phase for merging the corresponding photosensitive pixel of white filter area described in pixel
Obtained it is described merge pixel white pixel value or will it is same it is described merge pixel described in corresponding institute of infrared filtering area
The digital signal the output phase for stating photosensitive pixel is obtained the infrared image element value for merging pixel.
7. a kind of imaging device, it is characterised in that including imaging sensor, described image sensor includes：
Photosensitive pixel array；And
The optical filter being set on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes white filter area, colorized optical filtering area and red
Outer filter area；The colorized optical filtering area covers a photosensitive pixel, and the infrared filtering area is used to only make preset wavelength
Infrared light passes through, and the white filter area and the infrared filtering area are covered each by least one photosensitive pixel；
The photosensitive pixel of the same filter unit covering, which is formed, merges pixel；
The imaging device further includes the image processing module being connect with described image sensor；
Described image processing module is used to reading and handling the output of the photosensitive pixel array to obtain the merging pixel
Pixel value is so as to form merging image；
The pixel value for merging pixel include respectively with the colorized optical filtering area, the white filter area and the infrared filtering
The corresponding color pixel values in area, white pixel value and infrared image element value；
The color pixel values, the white pixel value and the infrared image element value are respectively used to form coloured image, gray-scale map
Picture and infrared image；
Described image processing module is used for the conjunction according to the coloured image, the gray level image and the IR image enhancement
And image；
Described image processing module is additionally operable to be converted to the coloured image the colored subgraph of yuv format；
Described image processing module be additionally operable to by the brightness value of the colored subgraph replace with according to the colored subgraph and/
Or the obtained brightness value of the gray level image and/or the infrared image is to generate the merging image；
Described image processing module is used to judge ambient brightness according to the pixel value of the photosensitive pixel, and in the environment
When brightness is more than the first predetermined threshold, the brightness value of the colored subgraph is subtracted into the brightness value of the infrared image so as to obtain
To the merging image；And be used for when the ambient brightness is less than the second predetermined threshold, by the brightness of the colored subgraph
Value plus the infrared image brightness value so as to obtain the merging image and for the ambient brightness be less than third it is pre-
When determining threshold value, by the brightness value of the colored subgraph plus the brightness value of the infrared image and plus the gray level image
Brightness value is to obtain the merging image.
8. imaging device as claimed in claim 7, which is characterized in that described image processing module is used for the same merging
The output of the corresponding at least one photosensitive pixel of the white filter area of pixel is added merges the white of pixel as described
Color pixel value or for by the same infrared filtering area corresponding at least one photosensitive pixel for merging pixel
Output is added as the infrared image element value for merging pixel.
9. imaging device as claimed in claim 7, which is characterized in that the colorized optical filtering area forms Bayer array.
10. imaging device as claimed in claim 7, which is characterized in that it is a described photosensitive that each filter unit includes 2*2
Pixel；The colorized optical filtering area, the white filter area and the infrared filtering area are covered each by described in one, two, one
Photosensitive pixel.
11. imaging device as claimed in claim 7, which is characterized in that it is a described photosensitive that each filter unit includes 2*2
Pixel；The colorized optical filtering area, the white filter area and the infrared filtering area are covered each by described in one, one, two
Photosensitive pixel.
12. imaging device as claimed in claim 7, which is characterized in that described image sensor includes control module, the control
Molding block is used to that the photosensitive pixel array to be controlled to expose line by line.
13. imaging device as claimed in claim 12, which is characterized in that described image sensor further includes register, described
Control module is for the output of the photosensitive pixel of+1 row of row k and kth of acquisition current exposure completion successively and is stored in institute
Register, wherein k=2n-1 are stated, n is natural number, and k+1 is less than or equal to total line number of the photosensitive pixel array.
14. imaging device as claimed in claim 7, which is characterized in that described image sensor includes analog-digital converter array,
Each analog-digital converter is connect with a photosensitive pixel.
15. imaging device as claimed in claim 7, which is characterized in that described image sensor includes micro mirror array, Mei Gesuo
It is corresponding with a photosensitive pixel to state micro mirror.
16. a kind of electronic device, which is characterized in that including the imaging device as described in claim 7-15 any one.
17. electronic device as claimed in claim 16, which is characterized in that the electronic device includes mobile phone.
18. electronic device as claimed in claim 17, which is characterized in that the imaging device includes the preposition phase of the mobile phone
Machine.
19. electronic device as claimed in claim 16, which is characterized in that the electronic device includes connecting with the imaging device
The central processing unit and external memory connect, the central processing unit are used to that the external memory to be controlled to store the merging image.
20. electronic device as claimed in claim 16, which is characterized in that the electronic device further includes and the imaging device
The central processing unit and display device of connection, the central processing unit are used to that the display device to be controlled to show the merging figure
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963592.1A CN105430359B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963592.1A CN105430359B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430359A CN105430359A (en) | 2016-03-23 |
| CN105430359B true CN105430359B (en) | 2018-07-10 |
Family
ID=55508258
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963592.1A Expired - Fee Related CN105430359B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430359B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578072A (en) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, imaging device and electronic device |
| CN105824098A (en) * | 2016-05-04 | 2016-08-03 | 广东欧珀移动通信有限公司 | Focusing control method and device, imaging control method and device, and electronic device |
| CN106341670B (en) | 2016-11-29 | 2017-09-22 | 广东欧珀移动通信有限公司 | Control method, control device and electronic installation |
| CN106454054B (en) * | 2016-11-29 | 2019-03-19 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106504218B (en) | 2016-11-29 | 2019-03-12 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN107346089B (en) * | 2017-06-30 | 2020-04-14 | Oppo广东移动通信有限公司 | Image sensor, camera module and electronic device |
| CN107144937A (en) * | 2017-06-30 | 2017-09-08 | 广东欧珀移动通信有限公司 | Camera lens module, camera module and electronic installation |
| CN107121751A (en) * | 2017-06-30 | 2017-09-01 | 广东欧珀移动通信有限公司 | Camera lens module, camera module and electronic installation |
| CN107153314B (en) * | 2017-06-30 | 2020-03-13 | Oppo广东移动通信有限公司 | Lens module, camera module and electronic device |
| CN107566753A (en) * | 2017-09-29 | 2018-01-09 | 努比亚技术有限公司 | Method, photo taking and mobile terminal |
| CN115280766B (en) * | 2020-03-06 | 2024-05-03 | Oppo广东移动通信有限公司 | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method |
| CN111756974A (en) * | 2020-05-15 | 2020-10-09 | 深圳市汇顶科技股份有限公司 | Image sensor and electronic device |
| CN111964778A (en) * | 2020-08-21 | 2020-11-20 | 深圳市汇顶科技股份有限公司 | Under-screen environment optical sensor and terminal equipment |
| CN112082644A (en) * | 2020-09-14 | 2020-12-15 | 深圳市汇顶科技股份有限公司 | Under-screen environment optical sensor and terminal equipment |
| CN114650343A (en) * | 2020-12-15 | 2022-06-21 | 超聚变数字技术有限公司 | Image sensor and imaging device |
| CN114485926B (en) * | 2021-12-27 | 2023-07-21 | 深圳市汇顶科技股份有限公司 | Ambient light sensor and electronic device |
| KR20230106119A (en) | 2021-12-27 | 2023-07-12 | 선전 구딕스 테크놀로지 컴퍼니, 리미티드 | Ambient light sensor and electronics |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101276757B1 (en) * | 2006-05-26 | 2013-06-20 | 삼성전자주식회사 | Apparatus for photographing image and operating method for the same |
| KR100818987B1 (en) * | 2006-09-19 | 2008-04-04 | 삼성전자주식회사 | Apparatus for photographing image and operating method for the same |
| EP2343904A4 (en) * | 2008-11-04 | 2012-09-05 | Konica Minolta Opto Inc | Image inputting apparatus |
| US9143704B2 (en) * | 2012-01-20 | 2015-09-22 | Htc Corporation | Image capturing device and method thereof |
| US9191635B2 (en) * | 2012-03-19 | 2015-11-17 | Semiconductor Components Industries, Llc | Imaging systems with clear filter pixels |
-
2015
- 2015-12-18 CN CN201510963592.1A patent/CN105430359B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430359A (en) | 2016-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN102892008B (en) | Dual image capture processes | |
| CN105611124B (en) | Imaging sensor, imaging method, imaging device and terminal | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN102165762B (en) | Imaging device and signal processing circuit for the imaging device | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| US20050128509A1 (en) | Image creating method and imaging device | |
| CN105578005B (en) | Imaging method, imaging device and the electronic installation of imaging sensor | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN111131798B (en) | Image processing method, image processing apparatus, and imaging apparatus | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180710 |