TWI661726B - Image sensor with enhanced image recognition and application - Google Patents

Abstract

An image sensor and application for enhancing clear image recognition mainly include: a photosensitive pixel array and its connected packaging circuit for driving and controlling the capturing of external light into a combined image output signal, wherein the photosensitive pixel array can capture Full-color visible light and infrared non-visible light for photoelectric conversion; and an image enhancement processing unit built into the package circuit to regulate the image captured by the photosensitive pixel array, including: a wide-area image signal of visible light, and at least Two non-visible light narrow-area image signals, and re-integrate and stack the one wide-area image signal and the two narrow-area image signals, so that the composition image has a three-dimensional sense of front and back layers, and a single image sensor can be used to clearly capture the daytime And night image, the composed image sensor module can be widely used in security monitoring, industrial monitoring, face recognition equipment, car reversing auxiliary image shooting and other products.

Description

Image sensor with enhanced image recognition and application

The present invention relates to the technical field of image sensors, and more particularly to an image sensor that enhances the clarity of image recognition and its application.

In order to capture daytime and nighttime images effectively, the conventional image sensors on the market generally adopt the method shown in Figure 9A, which is through a single RGB color lens A and a common MONO black and white lens. B is realized alternately, or it is realized with the current starlight night vision lens (not shown). Moreover, as shown in FIG. 9B, due to insufficient light at night, the conventional product must also add a lot of supplementary lights C around the image sensor as an auxiliary light source. The obtained waveform is shown in Figure 10. When there is sunlight during the day, the chroma is formed by capturing red (R), green (G), and blue (B) (the so-called "visible light source" RGB). Saturated images. When the visible light source is very weak at night, it can be improved by capturing through infrared rays. However, in fact, its night vision distance is shorter than about 850nm, which is quite limited in product applications because of night vision of conventional products. The short distance, poor effect, and high cost make the current application range still limited to the consumer market, and the expansion to the industrial grade market is limited.

Although the current more advanced design has a single image sensor that integrates color and infrared, the related image processing functions in its application are still not perfect, and the resulting image signal waveform is still used as shown in Figure 10. The effect is not good.

More importantly, the photographic effects of the above two conventional structures are not clear enough during the day and night, especially the limited effective distance of night vision cannot be too long, the quality of the image is not clear enough, the recognition is poor, and the image is presented. The lack of three-dimensionality of the plane, and the problem of instant overexposure due to strong light exposure are the main disadvantages.

In view of this, the main object of the present invention is to provide an image sensor and its application for enhancing clear image recognition, which mainly include: a photosensitive pixel array and its connected package circuit (chip) to drive and control the photosensitive pixel. The array captures external light and converts it into an output combined image signal. The photosensitive pixel array can capture RGB full-color visible light and IR infrared non-visible light for photoelectric conversion. And an image enhancement processing unit is built in the package circuit. The images captured by regulating the photosensitive pixel array include: a wide-color RGB visible light wide-area image signal whose wavelength of the full-color RGB visible light covers a total frequency band between 300nm and 350nm plus or minus 20nm, that is, between 280nm and 370nm, And at least two infrared IR non-visible light narrow-domain image signals, the narrow-band image signal wavelength range of each infrared IR non-visible light is 35nm to 50nm plus or minus 20nm, that is, 15nm to 70nm; and a wide-area image The signals and the two narrow-domain image signals are re-integrated and stacked to form a clear output image with a three-dimensional sense of front and back levels.

Preferably, the wide-area image signal has a spectral range between 400 nm and 700 nm, and the two narrow-area image signals have a spectral range between 850 nm and 940 nm.

As a result, the present invention can be widely applied to various products such as security monitoring, industrial monitoring, face recognition equipment, network cameras, drones, robots, and auxiliary image capturing for car reversing.

1‧‧‧Image Sensor

10‧‧‧ photosensitive pixel array

11‧‧‧ Package Circuit

12‧‧‧Image Enhancement Processing Unit

2‧‧‧Photoresistor

3‧‧‧LED light

4‧‧‧ lens

40‧‧‧base

41‧‧‧Lens

42‧‧‧ Infrared Filter

5‧‧‧Circuit Board

50‧‧‧Image Processing Circuit

51‧‧‧ Connector

6‧‧‧ Wiring

100‧‧‧Image Sensor Module

101‧‧‧Wide area image signal

102‧‧‧Narrow-domain image signal

103‧‧‧Narrow-domain image signal

104‧‧‧Narrow-domain image signal

105‧‧‧Video output signal

111‧‧‧line select drive

112‧‧‧column selection driver

113‧‧‧Control circuit

114‧‧‧Register

115‧‧‧ amplifier

116‧‧‧ Analog / Digital Converter

117‧‧‧Image Processor

A‧‧‧ color lens

B‧‧‧ black and white lens

C‧‧‧ fill light

Wd‧‧‧ Bandwidth

Wn‧‧‧ Bandwidth

FIG. 1 is a diagram of a package circuit (chip) of an image sensor of the present invention.

Fig. 2 is an equivalent circuit diagram of an image sensor package circuit (chip) of the present invention.

FIG. 3 is a spectrum diagram of a receiving range of an image sensor of the present invention.

FIG. 4 is a flowchart of a method for constructing an image sensor according to the present invention.

FIG. 5 is a spectral diagram of a receiving range of an image sensor according to another embodiment of the present invention.

Fig. 6 is a block diagram of an image sensor of the present invention.

FIG. 7 is an exploded view of the lens of the identification module of the present invention.

Figures 8A, 8B, and 8C are diagrams of application examples of the identification module of the present invention.

Figures 9A and 9B.

Fig. 10 Spectral view of the receiving range of the conventional structure.

In order to facilitate the further introduction and disclosure of the purpose, structural composition, applied functional features, and effects of the present invention, the embodiments are described in detail with the accompanying drawings as follows: As shown in Figures 1 to 4, the present invention provides An image sensor 1 for enhancing clear image recognition mainly includes: a photosensitive pixel array 10 and its connected packaging circuit 11 (chip), and driving and controlling the photosensitive pixel array 10 to capture external light and convert it into an output composite image signal. Wherein the photosensitive pixel array 10 can capture RGB full-color visible light and IR infrared non-visible light for photoelectric conversion, and; an image enhancement processing unit 12 is built in the packaging circuit 11 to regulate the captured light by the photosensitive pixel array 10 The image includes: a full-color RGB visible light wide-area image signal 101, the wavelength of the full-color RGB visible light including a total bandwidth Wd boundary between 300nm and 350nm plus or minus 20nm, and at least two infrared IR non-visible light narrow-domain images Signal 102, 103, the narrow-band image signal 102 or 103 of each infrared IR non-visible light wavelength band Wn boundary is between 35nm and 50nm plus or minus 20nm; preferably, The wide-area image signal 101 has a spectral range between 400nm and 700nm, the two narrow-area image signals 102 and 103 have a spectral interval between 850nm and 940nm, and the narrow-area image signal 102 lies at 850nm. The narrow-domain image signal 103 is located at 940nm. After obtaining the foregoing image, the wide-area image signal 101 and the two narrow-area image signals 102 and 103 are re-integrated and stacked to form a clear image output signal with a three-dimensional sense of front and back levels 105.

In a preferred implementation, as shown in FIG. 4, the specific method of the present invention includes: 1. constructing a single image sensor 1, and an image enhancement processing unit 12 is built in the single image sensor 1, Photoelectric conversion to capture day and night images. 2. Define the captured image so that the captured image includes: a wide-area image signal 101 of visible light and at least two narrow-area image signals 102 and 103 of non-visible light. 3. capture a wide-area image and select the wide-area image signal 101 spectrum The range boundary is between 400nm and 700nm. 4. Capture narrow-domain images, and select the two narrow-domain image signals 102 and 103 to be spaced between 850nm and 940nm, and each narrow-domain image signal 102 and 103 wavelength range is between 35nm and 50nm plus or minus 20nm. . 5. Stack the combined images, re-integrate the above-mentioned one wide-area image signal 101 and the two narrow-area image signals 102 and 103 to form a three-dimensional clear image.

In a preferred implementation, as shown in FIG. 2, the package circuit 11 of the present invention further includes: a row selection driver 111, a column selection driver 112, a control circuit 113, a register 114, an amplifier 115, and an analog / digital converter. 116 and an image processor 117; wherein the row selection driver 111 is electrically connected to one side of the 10th row of the photosensitive pixel array; the column selection driver 112 is electrically connected to one side of the 10th row of the photosensitive pixel array; the control circuit 113 is connected to control The row selection driver 111 and the column selection driver 112 are switched for row and column address selection. The register 114 is connected to store the photoelectric signals that are turned on by the column selection driver 112. The amplifier 115 is used to amplify the photoelectric signals from the register 114. The analog / digital converter 116 converts the amplified photoelectric analog signal into a digital signal, and the image processor 117 combines the processed digital signal into an image output signal 105.

In a preferred implementation, as shown in FIGS. 2 and 3, the image enhancement processing unit 12 is configured to connect and control the control circuit 113 and the image processor 117. Make image sensor 1With built-in image enhancement processing unit 12, it can be effectively used to capture a wide-area image signal 101 of full-color RGB visible light, and narrow-area image signals 102 and 103 of at least two infrared IR non-visible light. Communication technologies are effectively integrated and applied to each other. The wide-area image signal 101 and the two narrow-area image signals 102 and 103 are effectively re-integrated and stacked, so that when the image output signal 105 appears, it has a three-dimensional sense and clarity in front and back. degree.

In particular, because the combined image output signal 105 is transmitted through two narrow-domain image signals 102 and 103, the infrared light waves with different spectral ranges distributed between 850nm and 940nm make the effective distance of night vision significantly longer than the conventional structure. The three-dimensional sense and clarity are improved, and the practical purpose of clearly capturing day and night images with a single image sensor 1 can be achieved.

For a better implementation, as shown in FIGS. 1 and 5, the image enhancement processing unit 12 of the present invention can be implemented by software or firmware, so that it is convenient to modify and increase the number of captured narrow-field images, or to adjust the light transmittance of the image. , So that the transmittance can be bounded between 30% and 95%. For example, when capturing, one more narrow-domain image signal 104 is located at a wavelength of 1050 nm. In this way, three narrow-domain image signals 102, 103, and 104 are stacked with infrared light waves with different spectral ranges spaced between 850 nm, 940 nm, and 1050 nm. , Which makes the night vision distance significantly longer, and also enhances the three-dimensional sense and sharpness of its image.

The above is just for the convenience of illustration. The increased number of narrow-domain images is not limited to this. In fact, it can be classified into multiple specifications with different accuracy. The customization provides suggestions based on different shooting angles, distances, effects, etc. Tailor-made for customers so that the images synthesized at multiple different wavelengths can be used as a day and night dual-use technology, and are widely used in security monitoring, Industrial surveillance, face recognition equipment, network cameras, drones, robots, car reversing auxiliary image shooting and other products.

A preferred implementation, as shown in FIG. 6, is an image sensor module 100 for enhancing the clear image recognition according to an application example of the present invention. The image sensor module 100 mainly includes: a circuit board 5 provided with an image sensor 1 on the image, A photoresistor 2 is provided on the side of the sensor 1 and at least four LED lights 3 are arranged at intervals in the four corners of the image sensor 1. A lens 4 is provided on the image sensor 1. The circuit board 5 is provided with an image processing circuit 50, and at least one connector 51 is provided on one side of the circuit board 5 for external wiring 6 for image output signals. As shown in Figures 1 and 3 of the same reference, the image sensor 1 has a photosensitive pixel array 10 and a packaging circuit 11 connected to the image sensor 1 to drive and control the photosensitive pixel array 10 to capture external light and convert it into an output combination diagram. Image signal, the package circuit 11 has an image enhancement processing unit 12 built therein to regulate and capture a wide-area image signal 101 that captures a full-color RGB visible light, and a narrow-area image signal 102, 103 that has at least two infrared IR non-visible light, but the actual It is not limited to this. The wide-area image signal 101 and the two narrow-area image signals 102 and 103 are re-integrated and stacked to form an image output signal 105. The composed image has a three-dimensional sense of front and back layers, so that the image composed of the image sensor 1 is sensed. The sensor module 100 can actively receive the spectrum from 380nm to 940nm, and then debug with the software platform, that is, the single image sensor 1 can be used to clearly capture the day and night images. Of course, if auxiliary light sources of other wavelengths (810nm and 880nm) can be used together, the image superimposition effect can be better.

In a preferred implementation, as shown in FIG. 7, a base 40 is provided under the lens 4 to be disposed on the circuit board 5 (see also FIG. 6) and covered on the image sensor 1. The lens 41 of the lens 4 is provided on the upper layer. There is an infrared filter 42. This special design can further enhance the effect of capturing infrared invisible light in the present invention, increase the three-dimensional feeling and color saturation of the image, the structural design and the existing habits The lenses are different. In the conventional lenses, the filter is placed on the bottom of the lens or there is no filter, but the infrared filter 42 of the present invention is provided on the upper layer of the lens 41. This is the structure of the present invention and the conventional method. The biggest difference.

As a result, the image sensor module 100 with enhanced image recognition made by the present invention can be widely used in various monitoring systems, vehicles, face recognition equipment, network cameras, drones, robots, etc. Various products, among which the monitoring system may include, but is not limited to, indoor or outdoor monitors for security or industrial use. The vehicle may include, but is not limited to, a locomotive, a car, a boat or an aircraft. For example, FIG. 8A shows an application example in which the image sensor module 100 of the present invention is further disposed on a handheld device as a face recognition. As shown in FIG. 8B, this is an application example in which the image sensor module 100 of the present invention is further configured on an automobile as an enhanced night vision system. Alternatively, as shown in FIG. 8C, it is an application example in which the image sensor module 100 of the present invention is further configured on an outdoor monitor. The above is just for convenience of explanation, but it is not limited in practice. For example, it can also be used in car reversing auxiliary image shooting, and used on electronic devices with the Internet of Things, etc. (not shown).

Because the present invention is a combination of a wide-area image signal 101 and at least two narrow-area image signals 102 and 103, the obtained image has a clear layer and excellent depth, and can be used to accurately calculate the measured object and the surrounding distance, gesture actions, Obstacle avoidance, etc., is very important for future 3D emerging applications, which can effectively provide 3D depth image ranging applications such as VR / AR, drones, and People / Things Counting, and even accurately detect objects And the ability to measure the depth of the surrounding environment, it can also provide future applications of artificial intelligence (Artificial Intelligence), computer vision (Computer Vision) and other applications.

The present invention enhances the advantages and characteristics of an image sensor with clear image recognition:

1. Similar full color gamut from 380nm to 940nm, which can receive a wide range of spectrum. Can be applied in many different environments.

2. High-quality shooting, the effect is good, the resolution can reach 2K / 4K, and the visible distance can be used according to different lenses.

3. A single module with software can shoot multiple effects at the same time.

4. A single module can be used for 24 hours, which can basically meet the needs of day and night shooting.

5. Using only a single module can achieve the effect of two modules of the habit, which greatly reduces the use cost of the image sensor.

6. Only one module is needed, so it can be shared with existing institutions, which can further save institution costs.

In summary, the present invention can indeed achieve the aforementioned purpose, and it has indeed complied with the provisions of the Patent Law, and has filed a patent application in accordance with the law. However, the above are only the preferred embodiments of the present invention, and the scope of implementation of the present invention cannot be limited by this; therefore, any simple equivalent changes and modifications made according to the scope of patent application and the content of the patent specification of the present invention, All should fall within the scope of the invention patent.

Claims (12)

An image sensor for enhancing clear image recognition, which mainly includes a photosensitive pixel array and its connected packaging circuit to drive and control the photosensitive pixel array to capture external light and convert it into an output combined image signal. The photosensitive pixel array Capable of capturing RGB full-color visible light and IR infrared non-visible light for photoelectric conversion; and an image enhancement processing unit built into the package circuit to regulate the image captured by the photosensitive pixel array, including: a full-color RGB visible light Wide-area image signal whose wavelength of full-color RGB visible light covers a total bandwidth between 280nm and 370nm, and a narrow-domain image signal of at least two infrared IR non-visible light. The wavelength bandwidth is between 15nm and 70nm, and the wide-area image signal and the two narrow-area image signals are re-integrated and stacked to form a clear output image with a three-dimensional sense of front and back levels. The image sensor with enhanced image recognition as described in the first item of the patent application scope, wherein the wide-area image signal has a spectral range between 400nm and 700nm, and the two narrow-area image signal has a spectral interval between 850nm and 940nm. between. As described in item 2 of the scope of the patent application, the image sensor for enhanced image recognition is clear, wherein the image enhancement processing unit controls the photosensitive pixel array to further capture and add another narrow-domain image signal with a spectral range of 1050 nm and a wavelength bandwidth of 15 nm To 70nm. The image sensor with enhanced image recognition as described in item 1 of the scope of patent application, wherein the transmittance of the wide-area image signal and the narrow-area image signal is between 30% and 95%. The image sensor with enhanced image recognition as described in item 1 of the scope of patent application, wherein the package circuit further includes: a row selection driver, a row selection driver, a control circuit, a register, an amplifier, and the like. A digital converter and an image processor; the row selection driver is electrically connected to one side of the photosensitive pixel array row; the column selection driver is electrically connected to one side of the photosensitive pixel array row; the control circuit is connected Controlling the row selection driver and the column selection driver to switch on and off for row and column address selection; the register is connected and stored for the optoelectronic signal for the column selection driver to conduct; the amplifier is used to amplify the optoelectronic signal from the register The analog / digital converter converts the amplified photoelectric analog signal into a digital signal; the image processor combines the processed digital signals into an image output signal, and the image enhancement processing unit system Connected to control the control circuit and the image processor. An image sensor module for enhancing clear image recognition mainly includes: a circuit board having an image sensor thereon, a photoresistor on the side of the image sensor, and at least four LED lights spaced apart The image sensors are distributed at the four corners of the image sensor. The image sensor is provided with a lens, the circuit board is provided with an image processing circuit, and at least one connection seat is provided on one side of the circuit board for external connection of a connector. An image output signal, wherein the image sensor has a photosensitive pixel array and a connected packaging circuit for driving and controlling the photosensitive pixel array to capture external light and convert it to output a combined image signal. The packaging circuit has a built-in The image enhancement processing unit controls the capture of a wide-area image signal of a full-color RGB visible light. The full-color RGB visible light wavelength covers a narrow-band image signal with a total bandwidth between 280 nm and 370 nm, and at least two infrared IR non-visible light. The wavelength bandwidth of the narrow-domain image signal of each infrared IR non-visible light is between 15nm and 70nm, and the weight of the wide-area image signal and the two narrow-area image signals is heavy. Newly integrated stacking to form a three-dimensional image with front and back layers to clearly capture day and night images. The image sensor module with enhanced image recognition as described in item 6 of the patent application range, wherein the wide-area image signal spectral range is between 400nm and 700nm, and the two narrow-domain image signal spectral range intervals are at 850nm To 940nm. The image sensor module with enhanced image recognition as described in item 6 of the patent application scope, wherein the lens is provided with a base to be arranged on the circuit board and covered on the image sensor, and an infrared filter is provided on the upper layer of the lens of the lens Light film. The image sensor module with enhanced image recognition as described in item 7 of the scope of patent application, wherein the image sensor module is further configured on a handheld device. The image sensor module with enhanced image recognition as described in item 7 of the scope of patent application, wherein the image sensor module is further configured on an electronic device having the Internet of Things. As described in item 7 of the scope of the patent application, an image sensor module for enhancing clear image recognition is further provided, wherein the image sensor module is further configured on a vehicle, such as a locomotive, a car, a ship, an aircraft, etc. One kind. The image sensor module with enhanced image recognition as described in item 7 of the scope of patent application, wherein the image sensor module is further configured on a monitoring system, which is an indoor and outdoor monitor.