WO2005046248A1 - マルチスペクトル画像撮影装置 - Google Patents
マルチスペクトル画像撮影装置 Download PDFInfo
- Publication number
- WO2005046248A1 WO2005046248A1 PCT/JP2004/016678 JP2004016678W WO2005046248A1 WO 2005046248 A1 WO2005046248 A1 WO 2005046248A1 JP 2004016678 W JP2004016678 W JP 2004016678W WO 2005046248 A1 WO2005046248 A1 WO 2005046248A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- band
- light
- image
- spectral
- bands
- Prior art date
Links
- 238000001228 spectrum Methods 0.000 title claims description 3
- 230000003595 spectral effect Effects 0.000 claims abstract description 92
- 230000035945 sensitivity Effects 0.000 claims abstract description 47
- 238000003384 imaging method Methods 0.000 claims abstract description 45
- 238000002834 transmittance Methods 0.000 claims description 39
- 230000005540 biological transmission Effects 0.000 claims description 21
- 230000003287 optical effect Effects 0.000 claims description 11
- 238000000701 chemical imaging Methods 0.000 claims description 10
- 239000003086 colorant Substances 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 27
- 238000012986 modification Methods 0.000 description 13
- 230000004048 modification Effects 0.000 description 13
- 238000000926 separation method Methods 0.000 description 12
- 230000000694 effects Effects 0.000 description 10
- 238000005286 illumination Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 230000002542 deteriorative effect Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000000295 emission spectrum Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/30—Measuring the intensity of spectral lines directly on the spectrum itself
- G01J3/36—Investigating two or more bands of a spectrum by separate detectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/843—Demosaicing, e.g. interpolating colour pixel values
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
- G01J2003/2826—Multispectral imaging, e.g. filter imaging
Definitions
- the present invention relates to a multis vector image photographing apparatus capable of photographing images of four or more bands with different spectral characteristics.
- RGB (3-band) camera has been widely used for capturing an image of a subject.
- a filter having a transmittance characteristic narrower than the RGB wavelength band is arranged in front of the CCD image sensor, so that the spectral information of the subject can be reduced. Has been acquired.
- the present invention has been made in view of the above points, and can accurately reproduce colors even with a moving subject, and can directly reproduce images using a normal RGB monitor without requiring special changes. It is an object of the present invention to provide a multispectral image capturing device capable of confirming a close-up captured image.
- the main three bands have standard RGB spectral sensitivity characteristics
- At least one of the remaining bands excluding the main three bands out of the four or more spectral sensitivity characteristics has a spectral sensitivity characteristic narrower than the RGB.
- a multispectral imaging device is provided.
- a half mirror that splits the light of the imaging lens power into two optical paths A half mirror that splits the light of the imaging lens power into two optical paths
- Imaging means for receiving light modulated by the bandpass filter and imaging an object
- a color imaging unit that separates the other light split by the half mirror into three colors of red, blue, and green and receives the light, and captures a color image of a subject
- a dichroic mirror having a comb-shaped spectral transmittance and spectral reflectance characteristic for transmitting light in a plurality of wavelength bands and reflecting light other than the plurality of wavelength bands;
- a band-pass filter having substantially the same transmission wavelength band as the dichroic mirror A band-pass filter having a spectral transmittance characteristic transmitting a wavelength band substantially the same as the reflection wavelength band of the dichroic mirror;
- FIG. 1 is a diagram showing a configuration of a multispectral image capturing apparatus according to a first embodiment of the present invention.
- FIG. 2 is a diagram showing transmittance / reflectance characteristics of a half mirror used in the multispectral image capturing apparatus according to the first embodiment.
- FIG. 3 is a diagram showing a spectral transmittance characteristic of an infrared light power filter used in the multispectral image photographing apparatus according to the first embodiment and a spectral sensitivity characteristic of RGB3 band of a color CCD image sensor. .
- FIG. 4 is a diagram showing a pixel structure of a color CCD image sensor used in the multispectral image capturing apparatus according to the first embodiment.
- FIG. 5 is a diagram showing a spectral transmittance characteristic of a bandpass filter used in the multispectral image capturing apparatus according to the first embodiment and a spectral sensitivity characteristic of three RGB bands of a color CCD image sensor.
- FIG. 6 is a diagram showing spectral transmittance characteristics of another band-pass filter that can be used instead of the band-pass filter of FIG.
- FIG. 7 is a diagram showing six-band spectral sensitivity characteristics obtained in the multispectral image capturing apparatus according to the first embodiment.
- FIG. 8 is a diagram showing a configuration of a multispectral image capturing apparatus which is a first modification of the first embodiment.
- FIG. 9 is a diagram showing a configuration of a multispectral image photographing apparatus which is a second modification of the first embodiment.
- FIG. 10 is a diagram showing a four-resolution optical system in which a half mirror and a color separation prism are combined in the device configuration in FIG. 9.
- FIG. 11 is a diagram showing a configuration of a multispectral image capturing apparatus according to a second embodiment of the present invention.
- FIG. 12 is a diagram showing a specific configuration of a rotary filter in FIG. 11.
- FIG. 13 is a diagram showing a correspondence relationship between a state of a rotary filter and a timing of image capturing in a color CCD image sensor.
- FIG. 14 is a diagram showing a configuration of a multispectral image capturing apparatus according to a third embodiment of the present invention.
- FIG. 15 is a diagram showing a filter arrangement example of a mosaic filter (part) mounted on the color CCD image sensor in FIG.
- FIG. 16 is a diagram showing spectral transmittance characteristics of filters of R, G, B, R ′, G ′, and B ′ in FIG.
- FIG. 17 is a diagram showing another example of a filter arrangement of a mosaic filter (part) mounted on the color CCD image sensor in FIG.
- FIG. 18 is a diagram showing the spectral transmittance characteristics of the R ′, G ′, Cy, and B ′ filters in FIG.
- FIG. 19 is a diagram showing a configuration of a multispectral image capturing apparatus according to a fourth embodiment of the present invention.
- FIG. 20 is a diagram showing a spectral transmittance distribution and a spectral reflectance distribution of the dichroic mirror in FIG. 19, and a spectral characteristic of RGB separated by a color separation prism.
- FIG. 21 is a diagram showing a spectral transmittance distribution of the bandpass filter 52 in FIG. 19 and a spectral transmittance distribution by the dichroic mirror shown in FIG. 20.
- FIG. 22 is a diagram showing a spectral transmittance distribution of the bandpass filter 54 in FIG. 19 and a spectral reflectance distribution by the dichroic mirror shown in FIG.
- FIG. 23 is a diagram showing a configuration of a multispectral image capturing apparatus according to a fifth embodiment of the present invention.
- FIG. 24 is a diagram showing a spectral characteristic of a light source of a strobe illumination light-emitting unit used in a multispectral image capturing apparatus according to a fifth embodiment and a spectral sensitivity characteristic of a RGB 3 band of a color CCD image sensor.
- FIG. 25 is a timing chart showing a flow of shooting from shutter control to strobe light emission, and light reception and capture by a color CCD image sensor.
- FIG. 26 is a diagram showing a configuration of a multispectral image photographing apparatus according to a sixth embodiment of the present invention.
- the half mirror 12 is used such that the ratio between the transmittance and the reflectance is different, and each ratio is about 3: 1. That is, as shown in FIG. 2, the half mirror 12 has a transmittance 12A constant at 75% regardless of the wavelength and a reflectance 12B similarly constant at 25%.
- the light with the larger light quantity (transmission side) is passed through an infrared cut filter (IR-CF) 18 as shown in FIG. Outside light is blocked, and an image is formed on one of the color CCD image sensors 14.
- IR-CF infrared cut filter
- the light with the smaller amount of light is imaged on the other color CCD imaging device 16 through the band-pass filter 20.
- the color CCD imaging devices 14 and 16 are single-plate type color CCD imaging devices in which RGB color filters are arranged in a Bayer array in each pixel. You are using The spectral transmittance of each RGB filter has a spectral shape as shown by the broken line in FIG.
- the band-pass filter 20 has a comb-shaped spectral transmittance as shown by a solid line 20A in FIG. 5, and each band is about half of the RGB wavelength band shown by a broken line in the figure. It is like passing light through.
- the bandpass filter 20 may have a comb-shaped spectral transmittance as shown by a solid line 20B in FIG.
- a spectral transmittance characteristic indicated by the solid line 20B is an inversion of the spectral transmittance characteristic indicated by the solid line 20A in FIG. So, like this
- the bandpass filter 20 having the spectral transmittance characteristic indicated by the solid line 20B can acquire light in the near infrared region.
- the color CCD image pickup device 14 for the light on the transmission side branched by the half mirror 12 described above acquires a three-band image with the same spectral characteristics as conventional RGB.
- the color CCD image sensor 16 for the light on the reflection side acquires a three-band image having spectral characteristics narrower than the conventional RGB. Therefore, images of a total of six bands are acquired by the two color CCD image sensors 14 and 16.
- FIG. 7 shows the spectral sensitivity characteristics of a total of six bands configured as described above. As described above, since the transmission Z-reflectance ratio of the half mirror 12 differs, the peak sensitivity of the latter three bands other than RGB among the six bands in the figure is lower than the former three RGB bands! /
- the image signal obtained by the transmission side color CCD image sensor 14 is stored in the first image memory 22.
- the image signal obtained by the color CCD image sensor 16 on the reflection side is stored in the second image memory 24.
- the three-band images stored in the first image memory 22 and the second image memory 24 are synthesized as a six-band image by the image synthesizing unit 26 and stored in the storage medium and the external PC 28.
- the RGB three-band image signal is transmitted directly from the color CCD image sensor 14 on the transmission side or separately to the outside via the first image memory 22, and can be input to the RGB connection device 30. This makes it possible to connect to a general RGB monitor or the like and use it as an image view.
- the two color CCD image sensors 14 and 16 described in this embodiment need not have the same resolution.
- the color CCD image sensor 16 on the reflection side is replaced with the color CCD image sensor on the transmission side.
- a resolution lower than 14 is acceptable. Even if the resolution of the auxiliary 3-band image obtained by the color CCD image sensor 16 on the reflection side is low, the color CCD image on the transmission side Utilizing the high-frequency components in the main three-band image obtained by the element 14, it is also possible to obtain a multispectral image having substantially the same resolution as the main three-band image.
- the sensitivity of the low-resolution CCD image sensor is higher than that of the high-resolution CCD image sensor, so that the reflectance of the half mirror 12 can be further reduced and the transmittance can be increased, so that the total sensitivity can be further increased. It becomes possible.
- the bandpass filter 20 is used to narrow the band.
- the present invention is not limited to this.
- the color filter of the color CCD The band may be narrowed using other means, such as narrowing the transmission spectral characteristic by narrowing the band.
- This modification uses a three-chip color imaging unit composed of an RGB color separation prism and three CCD imaging elements instead of the single-chip color CCD imaging elements 14 and 16 in FIG. 1 described above. .
- one of the lights branched by the half mirror 12 at different intensity ratios enters the color image pickup unit 32 through the IR-CF 18, and the color image pickup unit 32 performs RGB 3-band imaging. Done.
- the light from the subject O is narrowed by the band-pass filter 20 based on the spectral transmittance as shown in FIG. Band photography is performed. As a result, a total of six bands of image signals are obtained.
- the use of the three-plate type color image pickup units 32 and 34 makes it possible to obtain a multi-resolution image with higher resolution and sensitivity compared to the case where the single-plate type color CCD image pickup devices 14 and 16 are used. Acquisition becomes possible.
- Such three-plate type color image pickup units 32 and 34 are widely used in conventional image pickup apparatuses such as HDTV cameras that shoot moving images, and are effective when shooting multispectral images of moving images.
- each of the CCD image pickup devices of the color image pickup units 32 and 34 can perform photographing in an optimal exposure state by individually determining the electronic shutter speed.
- FIG. 9 is a diagram showing a second modification of the multispectral image photographing apparatus according to the first embodiment. This modification combines the configuration of the first embodiment described above with the configuration of the first modification. Combined configuration.
- one of the lights branched by the half mirror 12 at different intensity ratios is obtained by cutting off the light in the near-infrared region by the IR-CF 18 and then, similar to the first modification described above.
- the light enters the color image pickup unit 32.
- the color image pickup unit 32 the light is separated into RGB light by a color separation prism, formed into an image on each CCD image pickup device, and three-band imaging is performed.
- the other light is narrowed by the band-pass filter 20 and the optical low-pass filter (LPF) 36, and then imaged on the color CCD image sensor 16 as in the first embodiment described above to form a three-band image.
- the optical LPF 36 is generally used to reduce false colors and color moiré. Therefore, although not particularly shown, the arrangement is similarly arranged in the configuration of the above-described first embodiment (and other embodiments described later).
- a high-resolution and high-sensitivity multi-spectral image can be acquired for the main RGB three bands by using the three-plate type color image pickup unit 32. It becomes possible.
- the auxiliary three primary colors are photographed at the expense of resolution by a single-chip color CCD image sensor 16, but as described above, the conventional three-band image is used by utilizing the high-frequency components in the main three-band image.
- Multi-spectral images can be captured with the same resolution as a band HDTV camera. As described above, a compact multi-band image capturing apparatus can be realized.
- the half mirror 12 and the color separation prism are separate elements, and the three bands on the transmission side and the reflection side are formed by separate units.
- the present invention is not limited to this.
- one element obtained by combining the half mirror 12 and the color separation prism 38, one color CCD image sensor 16 and three monochrome CCD image sensors 40R, 4OG, 40B By using, one unit can realize 6-band shooting. In this way, a 6-band image capturing device with a smaller device configuration can be realized.
- the multispectral image capturing apparatus captures one color CCD image from the subject O through the optical lens 10 and the rotary filter 42.
- An image is formed on the image element 44.
- the rotary filter 42 has the same force as the transparent glass 42A having a transmittance of almost 100% and the bandpass filter 42B based on the spectral transmittance characteristic shown in FIG. 5 described above.
- the ratio is configured to be about 3: 1.
- the light transmitted through the rotary filter 42 is blocked by the near infrared light through the IR-CF 18 and is imaged on the color CCD image sensor 44.
- the rotary filter 42 is driven by a motor 46 to rotate at a constant rotation speed, and the color CCD image sensor 44 performs two exposures while the rotary filter 42 rotates.
- FIG. 13 shows a timing chart of the state of the rotary filter 42 and the exposure timing of the color CCD image sensor 44.
- the first exposure is performed while the rotating filter 42 is in the state of the transparent glass 42A, and the acquired three-band image is stored in the first image memory 22.
- the rotation filter 42 performs the second exposure while the bandpass filter 20 is in the state, and stores the acquired three-band image in the second image memory 24.
- the three-band images stored in the first image memory 22 and the second image memory 24 are combined by the image combining unit 26 to obtain a six-band image.
- the multispectral image capturing apparatus blocks one color C An image is formed on the CD image sensor 44.
- the color CCD image sensor 44 has a mosaic filter 44A in which R, G, B and R ', G', B 'filters are periodically arranged for each pixel as shown in FIG. It is installed.
- the spectral transmittance distribution of each filter is as shown in FIG. That is, the R, G, B filters have the same spectral band as the conventional three-band camera, and R ', G', B 'have a narrower spectral band than the conventional RGB.
- I'm wearing In the mosaic filter 44A as shown in FIG. 15, filters of R, G, B are arranged at a ratio of 1 pixel to 3 pixels of R, G, B, respectively. Lined up with In.
- the light that has passed through each of the above filters is received by the color CCD image sensor 44 and input to the image interpolation processing unit 48 as six-band dot-sequential image data.
- the image interpolation processing unit 48 obtains image data corresponding to the position of a defective pixel in each band by also interpolating the neighboring image data, and generates image data with the same number of pixels.
- the RGB three band image is sent to the first image memory 22 and stored, and the R'G'B 'three band image is sent to the second image memory 24 and stored. Is done.
- the RGB connection device 30 By inputting the three-band image stored in the first image memory 22 to the RGB connection device 30, a color image of the subject O can be easily confirmed in the same manner as a conventional RGB camera. Further, by combining the three band images stored in the first image memory 22 and the second image memory 24 again in the image combining unit 26, a six-band image can be obtained.
- the auxiliary band can be handled.
- the ratio of pixels corresponding to RGB is increased for each pixel to be processed, so that multi-band images can be acquired with resolution and sensitivity almost inferior to conventional RGB 3-band cameras, and color reproduction Performance can be improved.
- the pixel of G ' is arranged twice as much as the other R' and B '. ing.
- one of the two pixels G and G may be set to Cy, and a total of 7 bands of multi-spectral imaging may be performed.
- the filter Cy has a spectral transmittance characteristic different from that of the above-described filter G ′, as shown in FIG.
- the auxiliary three bands other than the conventional RGB three bands are configured by extracting only the band within a predetermined range of the original RGB band power.
- the present invention is not limited to this, and for example, it is possible to configure a band out of the wavelength band of the original RGB, such as Cy shown in FIG.
- FIG. 19 The multispectral image capturing apparatus according to the fourth embodiment of the present invention is shown in FIG. 19 instead of the half mirror 12 used in the previous embodiments to split the light of the subject O into two.
- a dichroic mirror (DM) 50 that performs transmission Z reflection by selecting a wavelength is used.
- the spectral transmittance distribution of the DM50 is shown by a thin black line 50A in FIG. 20, and the spectral reflectance distribution is shown by a black dotted line 50B.
- the thick black line indicates the spectral characteristics of RGB separated by the color separation prism in FIG.
- each of the DMs 50 has a transmittance Z reflectance distribution based on a comb-shaped spectral shape.
- the light transmitted and reflected by the DM 50 is reflected by the color image pickup units 32 and 34 to be separated into different narrow bands of RGB 3 bands by the color separation prism and picked up. As a result, images of six bands each having a narrow band are obtained.
- filters 52 and 54 By inserting filters 52 and 54 to enhance the wavelength selectivity, it is possible to acquire six bands of images with good wavelength separation.
- wavelength selectivity cannot be expected so much, and as shown in FIG. In many cases, light leakage also exists in the band.
- band-pass filters 52 and 54 for example, a multilayer interference filter or the like
- This is a very effective means of realizing a multispectral camera.
- the loss of light due to the bandpass filter 20 can be minimized, so that a multi-band camera with high light efficiency can be realized.
- multi-spectral imaging with good wavelength separation can be realized by narrow-band six-band imaging, and a multi-band camera with a high SZN ratio can be realized.
- At least three of the bands that perform multispectral imaging have the same broadband spectral sensitivity characteristics as conventional RGB, and furthermore, By allocating the subject's light to other auxiliary narrowband bands with a smaller amount of light than the above RGB band, light loss is reduced, and color reproduction is possible even for a moving subject O.
- An accurate multispectral image capturing device can be provided. Further, it is possible to provide a multispectral image capturing apparatus capable of directly confirming captured images using a normal RGB monitor without requiring special changes. Also, by using a dichroic mirror and a band-pass filter together, it is possible to realize a narrow band of six bands with high wavelength separation, and also to realize a multispectral image capturing apparatus with reduced light loss as described above. .
- the multispectral image capturing apparatus includes a strobe illumination light-emitting unit 58 having a light source having a narrow-band three-band wavelength characteristic, and a strobe non-emission state (external light).
- a strobe illumination light-emitting unit 58 having a light source having a narrow-band three-band wavelength characteristic, and a strobe non-emission state (external light).
- the light source of the strobe illumination light emitting unit 58 includes a white LED having a wavelength characteristic of a comb-shaped spectral distribution having a sharp peak in each wavelength region of the RGB sensitivity of the color CCD image sensor 44, and a fluorescent light.
- a light source such as a lamp.
- three types of LEDs having narrow band wavelength characteristics may be used.
- An example of the light emission spectrum of the light source of the above strobe lighting light emitting section 58 is shown by a solid line in FIG. Note that, in the figure, broken lines indicate the transmittance characteristics of RGB.
- the multispectral image capturing apparatus includes an image subtracting unit 60 that subtracts the image stored in the first image memory 22 from the image stored in the second image memory 24. .
- FIG. 25 is a timing chart showing a flow of photographing when the shutter control power strobe light emission and light reception and capture by the color CCD image sensor 44 are performed. That is, according to the present embodiment, In the multi-spectral image capturing apparatus, when the shutter 62 is first pressed, the multi-spectral image capturing apparatus emits an object O as a normal RGB three-band color image with no strobe light, that is, only external light illumination. Is taken, and the obtained image is stored in the first image memory 22. The image is output to the RGB connection device 30 as a conventional RGB image, and is output to the storage medium and the external PC 28 as the main three-band image of the six bands.
- the subject O is illuminated with a strobe light emission state, that is, external light illumination + strobe illumination, and an image of the subject 0 is photographed as a three-band color image, and stored in the second image memory 24.
- a strobe light emission state that is, external light illumination + strobe illumination
- an image of the subject 0 is photographed as a three-band color image, and stored in the second image memory 24.
- the image stored in the second image memory 24 and the image in the flash non-emission state (only external light illumination) previously stored and stored in the first image memory 22 are reduced.
- the subtraction is performed by the arithmetic unit 60 to create a narrow-band three-band image using only the strobe component.
- the created image is output to the storage medium and the external PC 28 as an auxiliary three-band image. In this way, a total of six bands of images, ie, a three-band image based on the external light component and a three-band image based on the strobe component, are
- the same effect can be realized with a special optical system or an ordinary optical system that is different from a filter structure as in the above-described embodiments. Also, by inputting the three-band image stored in the first image memory 22 to the RGB connection device 30, a color image of the subject O can be easily confirmed in the same manner as a conventional RGB camera.
- a color image of the subject O is first photographed with a light source using only external light.
- the subject is first illuminated with a strobe to illuminate the subject O with the external light + strobe light.
- the color image of the subject O may be captured using only the external light source.
- the multispectral image capturing apparatus is a multispectral image capturing apparatus using a two-lens lens. Equipped with a bandpass filter with transmission characteristics on the lens and a color imaging unit for narrowband three-band imaging, a main three-band image from the conventional RGB three-band imaging color imaging unit, and a narrowband It obtains a 6-band multi-spectral image from the auxiliary 3-band image from the 3-band color imaging unit for shooting. is there.
- the image pickup unit on the upper side of FIG. 26 is a conventional color image pickup unit for RGB 3-band imaging, and includes a lens 10, an IR-CF 18, and a color CCD image pickup device 14.
- the lower imaging section is a color imaging section for three-band imaging in a narrow band, and includes a lens 64 and a narrow-band, three-band comb-shaped band-pass filter disposed in front of the lens 64 and having a comb-shaped spectral transmission characteristic. 20 and a color CCD image pickup device 16.
- the position of the narrow-band auxiliary 3-band image captured by the lower imaging unit is shifted from that of the conventional 3-band captured image (upper) due to parallax. This shift
- the correction is performed by the geometric correction unit 66 after the second image memory 24, and the positions of the three band images are matched and output.
- the same effect can be achieved with a special optical system or a normal optical system that does not use the filter structure as in the first to fourth embodiments. Further, if the three-band image stored in the first image memory 22 is input to the RGB connection device 30, the color image of the subject O can be easily confirmed in the same manner as the conventional RGB camera.
- the CCD image sensor is used as an example of the image sensor.
- an XY address type image sensor such as a CMOS image sensor is used. May be.
- CMOS image sensor When such an image sensor is used, high-speed readout and thinning-out readout become possible, and in the case of a single-chip color image sensor configuration, it becomes possible to selectively read out pixels of the same color filter. . Therefore, it is possible to increase the processing speed and reduce the cost of the multispectral image capturing apparatus.
- the main three bands have standard RGB spectral sensitivity characteristics, At least one of the remaining bands excluding the main three bands out of the four or more spectral sensitivity characteristics has a spectral sensitivity characteristic narrower than the RGB.
- a multispectral image photographing apparatus characterized by the above-mentioned.
- the first to fourth embodiments correspond to the embodiment relating to the multispectral image capturing apparatus described in (1).
- At least three of the bands that perform multispectral imaging have the same broadband spectral sensitivity characteristics as conventional RGB, and further have other auxiliary narrowbands.
- the loss of light is reduced, so that even a moving subject can reproduce color accurately.
- the sensitivity value of the main wavelength in the spectral sensitivity characteristics of the auxiliary band is less than half the sensitivity value of the main wavelength in the spectral sensitivity characteristics of the main three bands (1).
- Embodiments relating to the multispectral image capturing apparatus described in (2) correspond to the first to fourth embodiments.
- a multispectral image photographing apparatus comprising:
- the embodiment relating to the multispectral image capturing apparatus described in (3) corresponds to the first embodiment and the second modification of the first embodiment.
- one light split by the half mirror is separated into three colors of red, blue, and green, which are the same as RGB, and an image is taken.
- the light of the subject is allocated to the auxiliary narrow band with a smaller amount of light than the RGB band, thereby reducing light loss, This enables accurate color reproduction even for moving subjects.
- the embodiment relating to the multispectral image capturing apparatus described in (4) corresponds to the first embodiment and the second modification of the first embodiment.
- the band-pass filter has a plurality of transmission wavelength bands in a wavelength range of a visible region.
- a comb-shaped spectral shape having a wavelength range and a plurality of non-transmission wavelength bands
- the imaging means for receiving light passing through the band-pass filter includes a color imaging means for resolving and receiving light in a plurality of transmission wavelength bands in the band-pass filter.
- the first embodiment corresponds to the embodiment relating to the multispectral image capturing apparatus described in (5).
- the total number of pixels of the image pickup device in the image pickup device that receives the light transmitted through the band-pass filter out of the light split by the half mirror is determined by dividing the light split by the half mirror into red.
- the embodiment relating to the multispectral image capturing apparatus described in (6) corresponds to the first embodiment and the second modification of the first embodiment.
- the multi-band image having the resolution substantially equal to that of the main three-band image is used by using the high-frequency components in the main three-band image.
- a spectral image can be obtained.
- the low-resolution imaging means has higher sensitivity than the high-resolution imaging means, the reflectance of the half mirror can be further reduced and the transmittance can be increased, so that the total sensitivity can be further increased.
- Multispectral image capturing device having four or more different spectral sensitivity characteristics
- a multispectral image photographing apparatus comprising:
- the fourth embodiment corresponds to the embodiment relating to the multispectral image capturing apparatus described in (7).
- the loss of light by the band-pass filter can be minimized, so that light efficiency is improved.
- a multi-band camera can be realized.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Color Television Image Signal Generators (AREA)
- Optical Elements Other Than Lenses (AREA)
- Optical Filters (AREA)
- Cameras In General (AREA)
- Blocking Light For Cameras (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005515360A JP4118916B2 (ja) | 2003-11-11 | 2004-11-10 | マルチスペクトル画像撮影装置 |
EP04799576A EP1686810A4 (en) | 2003-11-11 | 2004-11-10 | DEVICE FOR ENTERING MULTISPECTRAL IMAGES |
US11/416,939 US7612822B2 (en) | 2003-11-11 | 2006-05-03 | Multispectral image capturing apparatus |
US12/556,437 US7868936B2 (en) | 2003-11-11 | 2009-09-09 | Multispectral image capturing apparatus |
US12/959,074 US8134618B2 (en) | 2003-11-11 | 2010-12-02 | Multispectral image capturing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003381419 | 2003-11-11 | ||
JP2003-381419 | 2003-11-11 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/416,939 Continuation US7612822B2 (en) | 2003-11-11 | 2006-05-03 | Multispectral image capturing apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005046248A1 true WO2005046248A1 (ja) | 2005-05-19 |
Family
ID=34567278
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/016678 WO2005046248A1 (ja) | 2003-11-11 | 2004-11-10 | マルチスペクトル画像撮影装置 |
Country Status (5)
Country | Link |
---|---|
US (3) | US7612822B2 (ja) |
EP (1) | EP1686810A4 (ja) |
JP (2) | JP4118916B2 (ja) |
CN (1) | CN1875638A (ja) |
WO (1) | WO2005046248A1 (ja) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2005877A2 (en) * | 2006-04-12 | 2008-12-24 | Olympus Medical Systems Corp. | Endoscope device |
JP2009158993A (ja) * | 2007-12-25 | 2009-07-16 | Toppan Printing Co Ltd | 情報取得装置、情報取得方法および情報取得プログラム |
JP2009260411A (ja) * | 2008-04-11 | 2009-11-05 | Olympus Corp | 撮像装置 |
WO2013047627A1 (ja) * | 2011-09-28 | 2013-04-04 | 株式会社 トプコン | 画像取得装置 |
JP2013072772A (ja) * | 2011-09-28 | 2013-04-22 | Topcon Corp | 画像取得装置 |
JP2013090230A (ja) * | 2011-10-20 | 2013-05-13 | Topcon Corp | 画像取得装置 |
JP2013092884A (ja) * | 2011-10-25 | 2013-05-16 | Nippon Telegr & Teleph Corp <Ntt> | 画像処理装置、方法、及びプログラム |
JP2014179857A (ja) * | 2013-03-15 | 2014-09-25 | Toppan Printing Co Ltd | 画像取得装置及び画像取得方法及び画像取得プログラム |
WO2014203639A1 (ja) * | 2013-06-21 | 2014-12-24 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
US9652827B2 (en) | 2013-06-24 | 2017-05-16 | Technology Innovation Momentum Fund (Israel) Limited Partnership | System and method for color image acquisition |
US10827152B2 (en) | 2015-07-15 | 2020-11-03 | Technology Innovation Momentum Fund (Israel) Limited Partnership | Tunable MEMS etalon |
WO2021172055A1 (ja) * | 2020-02-26 | 2021-09-02 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置、撮像方法、電子機器 |
Families Citing this family (110)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3673845B2 (ja) * | 2002-11-19 | 2005-07-20 | コニカミノルタホールディングス株式会社 | 撮像装置 |
JP2007103401A (ja) * | 2005-09-30 | 2007-04-19 | Matsushita Electric Ind Co Ltd | 撮像装置及び画像処理装置 |
WO2007056102A1 (en) * | 2005-11-04 | 2007-05-18 | The General Hospital Corporation | System for multispectral imaging |
JP5086535B2 (ja) * | 2005-11-21 | 2012-11-28 | オリンパスメディカルシステムズ株式会社 | 2板撮像装置 |
JP4899149B2 (ja) * | 2006-02-13 | 2012-03-21 | 株式会社ジェイエイアイコーポレーション | 面順次方式カラーカメラシステム |
US8242426B2 (en) * | 2006-12-12 | 2012-08-14 | Dolby Laboratories Licensing Corporation | Electronic camera having multiple sensors for capturing high dynamic range images and related methods |
US20080174691A1 (en) * | 2007-01-19 | 2008-07-24 | Quality Vision International Inc. | Strobed image acquisition guided by range sensor |
US8253824B2 (en) * | 2007-10-12 | 2012-08-28 | Microsoft Corporation | Multi-spectral imaging |
EP2057935B1 (en) * | 2007-11-09 | 2016-01-06 | FUJIFILM Corporation | Image capturing system, image capturing method, and program |
EP2263373B1 (en) * | 2008-03-28 | 2014-08-13 | The Trustees of Columbia University in the City of New York | Generalized assorted pixel camera systems and methods |
US8866920B2 (en) | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US11792538B2 (en) | 2008-05-20 | 2023-10-17 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
EP3328048B1 (en) | 2008-05-20 | 2021-04-21 | FotoNation Limited | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US7924312B2 (en) * | 2008-08-22 | 2011-04-12 | Fluke Corporation | Infrared and visible-light image registration |
US20110200237A1 (en) * | 2008-10-15 | 2011-08-18 | Nec Corporation | Pattern matching device and pattern matching method |
US8587681B2 (en) * | 2008-11-21 | 2013-11-19 | Omnivision Technologies, Inc. | Extended depth of field for image sensor |
JP5087529B2 (ja) * | 2008-12-01 | 2012-12-05 | オリンパス株式会社 | 識別処理装置、識別処理プログラム及び識別処理方法 |
WO2010089830A1 (ja) * | 2009-02-03 | 2010-08-12 | パナソニック株式会社 | 撮像装置 |
US8482652B2 (en) * | 2009-03-27 | 2013-07-09 | Radiant Imaging, Inc. | Imaging devices with components for reflecting optical data and associated methods of use and manufacture |
JP5546166B2 (ja) * | 2009-06-19 | 2014-07-09 | キヤノン株式会社 | 撮像装置、信号処理方法、及びプログラム |
JP2013509820A (ja) | 2009-10-28 | 2013-03-14 | ザ トラスティーズ オブ コロンビア ユニヴァーシティ イン ザ シティ オブ ニューヨーク | 符号化ローリングシャッタの方法およびシステム |
WO2011063347A2 (en) | 2009-11-20 | 2011-05-26 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
JP2011112452A (ja) * | 2009-11-25 | 2011-06-09 | Olympus Corp | カラーセンサ |
JP5482199B2 (ja) * | 2009-12-28 | 2014-04-23 | ソニー株式会社 | 撮像装置 |
SG185500A1 (en) | 2010-05-12 | 2012-12-28 | Pelican Imaging Corp | Architectures for imager arrays and array cameras |
US20110285895A1 (en) * | 2010-05-21 | 2011-11-24 | Chung Shan Institute Of Science And Technology | Image Sensing Device and Processing System |
LV14207B (lv) * | 2010-06-29 | 2010-11-20 | Univ Latvijas | Metode un ierīce multispektrālu attēlu iegūšanai ar digitālo RGB sensoru |
JP5675215B2 (ja) * | 2010-08-20 | 2015-02-25 | オリンパス株式会社 | デジタルカメラ |
US8878950B2 (en) | 2010-12-14 | 2014-11-04 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using super-resolution processes |
CN102148999A (zh) * | 2011-01-10 | 2011-08-10 | 南京理工大学 | 宽波段大跨度调谐滤波单通道彩色微光夜视方法及装置 |
EP3929546A1 (en) | 2011-03-03 | 2021-12-29 | Enchroma, Inc. | Multi-band color vision filters and method by lp-optimization |
JP5713816B2 (ja) * | 2011-03-16 | 2015-05-07 | 株式会社東芝 | 固体撮像装置及びカメラモジュール |
EP2708019B1 (en) | 2011-05-11 | 2019-10-16 | FotoNation Limited | Systems and methods for transmitting and receiving array camera image data |
WO2013043751A1 (en) | 2011-09-19 | 2013-03-28 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures |
US8600227B2 (en) * | 2011-09-22 | 2013-12-03 | Xerox Corporation | Multi-filter array for a multi-resolution, multi-spectral camera |
IN2014CN02708A (ja) | 2011-09-28 | 2015-08-07 | Pelican Imaging Corp | |
US9110293B2 (en) | 2011-10-17 | 2015-08-18 | Manufacturing Techniques, Inc. | Prismatic image replication for obtaining color data from a monochrome detector array |
EP2791898A4 (en) * | 2011-12-02 | 2015-10-21 | Nokia Technologies Oy | METHOD, DEVICE AND COMPUTER PROGRAM PRODUCT FOR RECORDING IMAGES |
US8836814B2 (en) * | 2012-01-18 | 2014-09-16 | Nokia Corporation | Method and apparatus for ambient light spectrum detection in digital photography |
US9258468B2 (en) * | 2012-02-15 | 2016-02-09 | Fluxdata, Inc. | Method and apparatus for separate spectral imaging and sensing |
EP2817955B1 (en) | 2012-02-21 | 2018-04-11 | FotoNation Cayman Limited | Systems and methods for the manipulation of captured light field image data |
WO2013135311A1 (en) | 2012-03-13 | 2013-09-19 | Latvijas Universitate | Method and device for imaging of spectral reflectance at several wavelength bands |
US9173570B2 (en) * | 2012-04-12 | 2015-11-03 | Thomas Nathan Millikan | Viewing and processing multispectral images |
EP2677732B1 (en) | 2012-06-22 | 2019-08-28 | Nokia Technologies Oy | Method, apparatus and computer program product for capturing video content |
JP2015534734A (ja) | 2012-06-28 | 2015-12-03 | ペリカン イメージング コーポレイション | 欠陥のあるカメラアレイ、光学アレイ、およびセンサを検出するためのシステムおよび方法 |
US20140002674A1 (en) | 2012-06-30 | 2014-01-02 | Pelican Imaging Corporation | Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors |
US9547178B2 (en) | 2012-08-15 | 2017-01-17 | Semrock. Inc. | Dichroic image splitter |
US8619082B1 (en) | 2012-08-21 | 2013-12-31 | Pelican Imaging Corporation | Systems and methods for parallax detection and correction in images captured using array cameras that contain occlusions using subsets of images to perform depth estimation |
EP2888698A4 (en) | 2012-08-23 | 2016-06-29 | Pelican Imaging Corp | PROPERTY-BASED HIGH-RESOLUTION MOTION ESTIMATION FROM LOW-RESOLUTION IMAGES RECORDED WITH AN ARRAY SOURCE |
US20140092281A1 (en) | 2012-09-28 | 2014-04-03 | Pelican Imaging Corporation | Generating Images from Light Fields Utilizing Virtual Viewpoints |
JP6017276B2 (ja) * | 2012-11-21 | 2016-10-26 | オリンパス株式会社 | 撮像装置 |
US9215433B2 (en) | 2014-02-11 | 2015-12-15 | Duelight Llc | Systems and methods for digital photography |
WO2014130849A1 (en) | 2013-02-21 | 2014-08-28 | Pelican Imaging Corporation | Generating compressed light field representation data |
WO2014133974A1 (en) | 2013-02-24 | 2014-09-04 | Pelican Imaging Corporation | Thin form computational and modular array cameras |
US9774789B2 (en) | 2013-03-08 | 2017-09-26 | Fotonation Cayman Limited | Systems and methods for high dynamic range imaging using array cameras |
US8866912B2 (en) | 2013-03-10 | 2014-10-21 | Pelican Imaging Corporation | System and methods for calibration of an array camera using a single captured image |
US9519972B2 (en) | 2013-03-13 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
WO2014164550A2 (en) | 2013-03-13 | 2014-10-09 | Pelican Imaging Corporation | System and methods for calibration of an array camera |
WO2014164909A1 (en) | 2013-03-13 | 2014-10-09 | Pelican Imaging Corporation | Array camera architecture implementing quantum film sensors |
WO2014159779A1 (en) | 2013-03-14 | 2014-10-02 | Pelican Imaging Corporation | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US9100586B2 (en) | 2013-03-14 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for photometric normalization in array cameras |
US9094567B2 (en) * | 2013-03-14 | 2015-07-28 | James Olson | Multi-channel camera system |
US10122993B2 (en) | 2013-03-15 | 2018-11-06 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
WO2014145856A1 (en) | 2013-03-15 | 2014-09-18 | Pelican Imaging Corporation | Systems and methods for stereo imaging with camera arrays |
US9445003B1 (en) | 2013-03-15 | 2016-09-13 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US9497429B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Extended color processing on pelican array cameras |
JP6086829B2 (ja) * | 2013-06-26 | 2017-03-01 | オリンパス株式会社 | 画像処理装置及び画像処理方法 |
WO2015048694A2 (en) | 2013-09-27 | 2015-04-02 | Pelican Imaging Corporation | Systems and methods for depth-assisted perspective distortion correction |
US9426343B2 (en) | 2013-11-07 | 2016-08-23 | Pelican Imaging Corporation | Array cameras incorporating independently aligned lens stacks |
US10119808B2 (en) | 2013-11-18 | 2018-11-06 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
JP6390090B2 (ja) * | 2013-11-19 | 2018-09-19 | セイコーエプソン株式会社 | 光学フィルターデバイス、光学モジュール、及び電子機器 |
EP3075140B1 (en) | 2013-11-26 | 2018-06-13 | FotoNation Cayman Limited | Array camera configurations incorporating multiple constituent array cameras |
WO2015134996A1 (en) | 2014-03-07 | 2015-09-11 | Pelican Imaging Corporation | System and methods for depth regularization and semiautomatic interactive matting using rgb-d images |
US10250871B2 (en) | 2014-09-29 | 2019-04-02 | Fotonation Limited | Systems and methods for dynamic calibration of array cameras |
EP3212057B1 (en) | 2014-10-29 | 2021-12-01 | Spectral MD, Inc. | Reflective mode multi-spectral time-resolved optical imaging methods and apparatuses for tissue classification |
US9875524B2 (en) * | 2015-01-16 | 2018-01-23 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, and computer-readable storage medium |
US9696470B2 (en) | 2015-03-04 | 2017-07-04 | Microsoft Technology Licensing, Llc | Sensing images and light sources via visible light filters |
US9942474B2 (en) | 2015-04-17 | 2018-04-10 | Fotonation Cayman Limited | Systems and methods for performing high speed video capture and depth estimation using array cameras |
EP3286914B1 (en) | 2015-04-19 | 2019-12-25 | FotoNation Limited | Multi-baseline camera array system architectures for depth augmentation in vr/ar applications |
WO2018029544A1 (en) * | 2016-08-12 | 2018-02-15 | Spectral Insights Private Limited | Spectral imaging system |
CN110573066A (zh) | 2017-03-02 | 2019-12-13 | 光谱Md公司 | 用于多光谱截肢部位分析的机器学习系统和技术 |
KR102362447B1 (ko) | 2017-05-23 | 2022-02-14 | 삼성전자 주식회사 | 듀얼 이미지 센서를 이용한 이미지 처리 방법 및 장치 |
US10482618B2 (en) | 2017-08-21 | 2019-11-19 | Fotonation Limited | Systems and methods for hybrid depth regularization |
CN112789495B (zh) * | 2018-08-01 | 2022-05-27 | 库塞尔专业公司 | 混合光谱成像仪 |
JP7211033B2 (ja) * | 2018-11-27 | 2023-01-24 | 株式会社島津製作所 | 原子吸光分光光度計 |
US10740884B2 (en) | 2018-12-14 | 2020-08-11 | Spectral Md, Inc. | System and method for high precision multi-aperture spectral imaging |
US10783632B2 (en) | 2018-12-14 | 2020-09-22 | Spectral Md, Inc. | Machine learning systems and method for assessment, healing prediction, and treatment of wounds |
EP3893733A4 (en) | 2018-12-14 | 2022-10-12 | Spectral MD, Inc. | MACHINE LEARNING SYSTEMS AND METHODS FOR WOUND ASSESSMENT, HEALING PREDICTION AND TREATMENT |
EP3899463A4 (en) | 2018-12-14 | 2022-12-21 | Spectral MD, Inc. | SYSTEM AND METHOD FOR HIGH-PRECISION MULTIAPERTURE SPECTRAL IMAGING |
CN112087559B (zh) * | 2019-06-13 | 2021-11-30 | 华为技术有限公司 | 图像传感器、图像拍摄装置和方法 |
EP3779554B1 (en) * | 2019-08-14 | 2024-01-17 | Leica Instruments (Singapore) Pte. Ltd. | Optical beam splitter assembly, camera head, and microscope assembly |
BR112022004811A2 (pt) | 2019-09-17 | 2022-06-21 | Boston Polarimetrics Inc | Sistemas e métodos para modelagem de superfície usando indicações de polarização |
JP7335969B2 (ja) * | 2019-09-27 | 2023-08-30 | 富士フイルム株式会社 | 光学素子、光学装置、撮像装置、及び光学素子の製造方法 |
CA3157197A1 (en) | 2019-10-07 | 2021-04-15 | Boston Polarimetrics, Inc. | Systems and methods for surface normals sensing with polarization |
JPWO2021085014A1 (ja) * | 2019-10-28 | 2021-05-06 | ||
CN110913101A (zh) * | 2019-11-14 | 2020-03-24 | 维沃移动通信有限公司 | 一种拍摄装置及电子设备 |
CN110868526A (zh) * | 2019-11-14 | 2020-03-06 | 维沃移动通信有限公司 | 一种拍摄模组、拍摄方法及电子设备 |
DE112020005932T5 (de) | 2019-11-30 | 2023-01-05 | Boston Polarimetrics, Inc. | Systeme und verfahren zur segmentierung von transparenten objekten mittels polarisationsmerkmalen |
WO2021131043A1 (ja) * | 2019-12-27 | 2021-07-01 | 株式会社ジェイエイアイコーポレーション | プリズム装置の提供方法及びプリズム装置 |
CN113099078B (zh) * | 2020-01-08 | 2023-06-27 | 华为技术有限公司 | 摄像头模组、成像方法和成像装置 |
US11195303B2 (en) | 2020-01-29 | 2021-12-07 | Boston Polarimetrics, Inc. | Systems and methods for characterizing object pose detection and measurement systems |
JP7542070B2 (ja) | 2020-01-30 | 2024-08-29 | イントリンジック イノベーション エルエルシー | 偏光画像を含む異なる撮像モダリティで統計モデルを訓練するためのデータを合成するためのシステムおよび方法 |
US11953700B2 (en) | 2020-05-27 | 2024-04-09 | Intrinsic Innovation Llc | Multi-aperture polarization optical systems using beam splitters |
JP7543012B2 (ja) * | 2020-07-13 | 2024-09-02 | キヤノン株式会社 | 装置、及びシステム |
US12020455B2 (en) | 2021-03-10 | 2024-06-25 | Intrinsic Innovation Llc | Systems and methods for high dynamic range image reconstruction |
US12069227B2 (en) * | 2021-03-10 | 2024-08-20 | Intrinsic Innovation Llc | Multi-modal and multi-spectral stereo camera arrays |
US11290658B1 (en) | 2021-04-15 | 2022-03-29 | Boston Polarimetrics, Inc. | Systems and methods for camera exposure control |
US11954886B2 (en) | 2021-04-15 | 2024-04-09 | Intrinsic Innovation Llc | Systems and methods for six-degree of freedom pose estimation of deformable objects |
US12067746B2 (en) | 2021-05-07 | 2024-08-20 | Intrinsic Innovation Llc | Systems and methods for using computer vision to pick up small objects |
US11689813B2 (en) | 2021-07-01 | 2023-06-27 | Intrinsic Innovation Llc | Systems and methods for high dynamic range imaging using crossed polarizers |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03174890A (ja) * | 1989-06-08 | 1991-07-30 | Fuji Photo Film Co Ltd | 固体撮像システム |
JP2001016598A (ja) * | 1999-04-30 | 2001-01-19 | Olympus Optical Co Ltd | カラー撮像素子及び撮像装置 |
JP2002034908A (ja) * | 2000-07-27 | 2002-02-05 | Olympus Optical Co Ltd | 内視鏡装置 |
JP2004172832A (ja) * | 2002-11-19 | 2004-06-17 | Minolta Co Ltd | 撮像装置 |
JP2004200357A (ja) * | 2002-12-18 | 2004-07-15 | Nikon Corp | カラー撮像素子、カラーフィルタアレイ、及びカラー撮像装置 |
JP2004228662A (ja) * | 2003-01-20 | 2004-08-12 | Minolta Co Ltd | 撮像装置 |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5821989A (ja) | 1981-07-31 | 1983-02-09 | Canon Inc | カラ−固体撮像装置 |
US6150930A (en) * | 1992-08-14 | 2000-11-21 | Texas Instruments Incorporated | Video equipment and method to assist motor vehicle operators |
JPH06202250A (ja) * | 1992-12-29 | 1994-07-22 | Konica Corp | カラー画像情報処理装置 |
JPH07203318A (ja) * | 1993-12-28 | 1995-08-04 | Nippon Telegr & Teleph Corp <Ntt> | 撮像装置 |
US5668597A (en) * | 1994-12-30 | 1997-09-16 | Eastman Kodak Company | Electronic camera with rapid automatic focus of an image upon a progressive scan image sensor |
JP3713321B2 (ja) | 1995-12-19 | 2005-11-09 | オリンパス株式会社 | カラー画像記録再生システム及び画像カラー画像記録再生方法 |
US7179222B2 (en) * | 1996-11-20 | 2007-02-20 | Olympus Corporation | Fluorescent endoscope system enabling simultaneous achievement of normal light observation based on reflected light and fluorescence observation based on light with wavelengths in infrared spectrum |
JP4076248B2 (ja) | 1997-09-09 | 2008-04-16 | オリンパス株式会社 | 色再現装置 |
US5982497A (en) * | 1998-07-09 | 1999-11-09 | Optical Insights, Llc | Multi-spectral two-dimensional imaging spectrometer |
JP3925681B2 (ja) * | 1999-05-19 | 2007-06-06 | 富士フイルム株式会社 | マルチバンド画像出力方法および装置 |
US6215597B1 (en) * | 1999-11-17 | 2001-04-10 | Duncan Technologies, Inc. | Apparatus for forming a plurality of subimages having different characteristics |
US6515275B1 (en) * | 2000-04-24 | 2003-02-04 | Hewlett-Packard Company | Method and apparatus for determining the illumination type in a scene |
EP2319390B1 (en) | 2000-07-21 | 2016-04-20 | Olympus Corporation | Endoscope apparatus |
JP2002185974A (ja) * | 2000-12-12 | 2002-06-28 | Canon Inc | 画像処理装置およびその方法 |
JP2002300589A (ja) | 2001-01-29 | 2002-10-11 | Konica Corp | 撮影装置 |
GB2373943A (en) * | 2001-03-28 | 2002-10-02 | Hewlett Packard Co | Visible and infrared imaging camera |
JP2002296493A (ja) * | 2001-03-30 | 2002-10-09 | Fuji Photo Optical Co Ltd | ピント状態検出装置 |
JP2002296114A (ja) | 2001-03-30 | 2002-10-09 | Fuji Photo Film Co Ltd | 分光反射率画像の取得方法、撮影装置および分光反射率画像取得システム |
JP2002323375A (ja) * | 2001-04-24 | 2002-11-08 | Nippon Hoso Kyokai <Nhk> | 撮像装置 |
US6924841B2 (en) * | 2001-05-02 | 2005-08-02 | Agilent Technologies, Inc. | System and method for capturing color images that extends the dynamic range of an image sensor using first and second groups of pixels |
JP2002345733A (ja) * | 2001-05-29 | 2002-12-03 | Fuji Photo Film Co Ltd | 撮像装置 |
JP2002365517A (ja) * | 2001-06-04 | 2002-12-18 | Fuji Photo Optical Co Ltd | 撮影レンズのピント状態検出装置 |
JP3862582B2 (ja) * | 2001-06-29 | 2006-12-27 | 富士フイルムホールディングス株式会社 | 蛍光画像取得方法および装置並びにプログラム |
JP3826174B2 (ja) | 2001-07-06 | 2006-09-27 | 独立行政法人情報通信研究機構 | 撮像装置 |
JP2003087806A (ja) | 2001-09-12 | 2003-03-20 | Fuji Photo Film Co Ltd | マルチバンドカメラ用フィルターとその形成方法並びにこの方法のプログラム及びこれを記録した記録媒体 |
JP2003134527A (ja) * | 2001-10-24 | 2003-05-09 | Telecommunication Advancement Organization Of Japan | カラー映像再現システム |
JP3975395B2 (ja) * | 2002-02-26 | 2007-09-12 | フジノン株式会社 | カメラシステム |
JP3950715B2 (ja) * | 2002-03-05 | 2007-08-01 | 富士フイルム株式会社 | 固体撮像素子およびこれを用いた撮像装置 |
JP4632645B2 (ja) * | 2002-12-12 | 2011-02-16 | オリンパス株式会社 | イメージング装置およびプロセッサ装置 |
US7633537B2 (en) * | 2002-12-18 | 2009-12-15 | Nikon Corporation | Color image sensor, color filter array and color imaging device |
JP2005033609A (ja) | 2003-07-08 | 2005-02-03 | Fuji Film Microdevices Co Ltd | 固体撮像装置及びデジタルカメラ |
WO2005072358A2 (en) * | 2004-01-28 | 2005-08-11 | Canesta, Inc. | Single chip red, green, blue, distance (rgb-z) sensor |
JP4717363B2 (ja) * | 2004-03-10 | 2011-07-06 | オリンパス株式会社 | マルチスペクトル画像撮影装置及びアダプタレンズ |
-
2004
- 2004-11-10 CN CNA2004800322669A patent/CN1875638A/zh active Pending
- 2004-11-10 JP JP2005515360A patent/JP4118916B2/ja not_active Expired - Fee Related
- 2004-11-10 EP EP04799576A patent/EP1686810A4/en not_active Withdrawn
- 2004-11-10 WO PCT/JP2004/016678 patent/WO2005046248A1/ja active Application Filing
-
2006
- 2006-05-03 US US11/416,939 patent/US7612822B2/en not_active Expired - Fee Related
-
2009
- 2009-09-09 US US12/556,437 patent/US7868936B2/en not_active Expired - Fee Related
-
2010
- 2010-09-29 JP JP2010219705A patent/JP5124003B2/ja not_active Expired - Fee Related
- 2010-12-02 US US12/959,074 patent/US8134618B2/en not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03174890A (ja) * | 1989-06-08 | 1991-07-30 | Fuji Photo Film Co Ltd | 固体撮像システム |
JP2001016598A (ja) * | 1999-04-30 | 2001-01-19 | Olympus Optical Co Ltd | カラー撮像素子及び撮像装置 |
JP2002034908A (ja) * | 2000-07-27 | 2002-02-05 | Olympus Optical Co Ltd | 内視鏡装置 |
JP2004172832A (ja) * | 2002-11-19 | 2004-06-17 | Minolta Co Ltd | 撮像装置 |
JP2004200357A (ja) * | 2002-12-18 | 2004-07-15 | Nikon Corp | カラー撮像素子、カラーフィルタアレイ、及びカラー撮像装置 |
JP2004228662A (ja) * | 2003-01-20 | 2004-08-12 | Minolta Co Ltd | 撮像装置 |
Non-Patent Citations (2)
Title |
---|
ISHIMARU H. ET AL.: "Fuksu no RGB camera o mochiita one shot-gata multiple spectra camera no kaihatsu", DAI 62 KAI EXTENDED ABSTRACTS; THE JAPAN SOCIETY OF APPLIED PHYSICS, vol. 3, 3 September 2000 (2000-09-03), pages 887, XP002988185 * |
See also references of EP1686810A4 * |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8979741B2 (en) | 2006-04-12 | 2015-03-17 | Olympus Medical Systems Corp. | Endoscopic apparatus |
EP2005877A4 (en) * | 2006-04-12 | 2013-03-27 | Olympus Medical Systems Corp | ENDOSCOPE DEVICE |
EP2005877A2 (en) * | 2006-04-12 | 2008-12-24 | Olympus Medical Systems Corp. | Endoscope device |
JP2009158993A (ja) * | 2007-12-25 | 2009-07-16 | Toppan Printing Co Ltd | 情報取得装置、情報取得方法および情報取得プログラム |
JP2009260411A (ja) * | 2008-04-11 | 2009-11-05 | Olympus Corp | 撮像装置 |
US9541495B2 (en) | 2011-09-28 | 2017-01-10 | Kabushiki Kaisha Topcon | Image pickup device |
JP2013072772A (ja) * | 2011-09-28 | 2013-04-22 | Topcon Corp | 画像取得装置 |
WO2013047627A1 (ja) * | 2011-09-28 | 2013-04-04 | 株式会社 トプコン | 画像取得装置 |
JP2013090230A (ja) * | 2011-10-20 | 2013-05-13 | Topcon Corp | 画像取得装置 |
JP2013092884A (ja) * | 2011-10-25 | 2013-05-16 | Nippon Telegr & Teleph Corp <Ntt> | 画像処理装置、方法、及びプログラム |
JP2014179857A (ja) * | 2013-03-15 | 2014-09-25 | Toppan Printing Co Ltd | 画像取得装置及び画像取得方法及び画像取得プログラム |
WO2014203639A1 (ja) * | 2013-06-21 | 2014-12-24 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
JP2015005921A (ja) * | 2013-06-21 | 2015-01-08 | オリンパス株式会社 | 撮像装置、画像処理装置、撮像方法及び画像処理方法 |
US9652827B2 (en) | 2013-06-24 | 2017-05-16 | Technology Innovation Momentum Fund (Israel) Limited Partnership | System and method for color image acquisition |
US10229476B2 (en) | 2013-06-24 | 2019-03-12 | Technology Innovation Momentum Fund (Israel) Limited Partnership | System and method for color image acquisition |
US10827152B2 (en) | 2015-07-15 | 2020-11-03 | Technology Innovation Momentum Fund (Israel) Limited Partnership | Tunable MEMS etalon |
WO2021172055A1 (ja) * | 2020-02-26 | 2021-09-02 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置、撮像方法、電子機器 |
JP7566869B2 (ja) | 2020-02-26 | 2024-10-15 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置、撮像方法、電子機器 |
Also Published As
Publication number | Publication date |
---|---|
US20100026876A1 (en) | 2010-02-04 |
US8134618B2 (en) | 2012-03-13 |
US7868936B2 (en) | 2011-01-11 |
JP5124003B2 (ja) | 2013-01-23 |
EP1686810A1 (en) | 2006-08-02 |
JPWO2005046248A1 (ja) | 2007-11-29 |
US20110074992A1 (en) | 2011-03-31 |
CN1875638A (zh) | 2006-12-06 |
JP4118916B2 (ja) | 2008-07-16 |
US7612822B2 (en) | 2009-11-03 |
JP2011015439A (ja) | 2011-01-20 |
EP1686810A4 (en) | 2009-06-03 |
US20060203100A1 (en) | 2006-09-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4118916B2 (ja) | マルチスペクトル画像撮影装置 | |
JP4633129B2 (ja) | マルチスペクトル画像撮影装置 | |
US8259203B2 (en) | Method and apparatus for achieving panchromatic response from a color-mosaic imager | |
US7855786B2 (en) | Single camera multi-spectral imager | |
US7948551B2 (en) | Field sequential color camera system | |
US20070153099A1 (en) | Image signal processing apparatus, imaging apparatus, image signal processing method and computer program thereof | |
KR100848763B1 (ko) | 멀티 스펙트럼 화상 촬영 장치 및 어댑터 렌즈 | |
JP2018160800A (ja) | 撮像装置及び撮像方法 | |
JP2004228662A (ja) | 撮像装置 | |
WO2021041928A1 (en) | Systems and methods for creating a full-color image in low light | |
JP4253943B2 (ja) | 固体撮像装置 | |
JP5108013B2 (ja) | カラー撮像素子及びこれを用いた撮像装置及びフィルタ | |
EP0428884A1 (en) | Colour filter arrangement for a solid-state imaging apparatus | |
KR20070011429A (ko) | 디지털 이미징 시스템을 이용하여 오브젝트로부터 광의대안적 형태의 재생 | |
JP2007315808A (ja) | マルチスペクトル撮像装置 | |
JP2010171950A (ja) | 撮像装置および撮像装置の色補正方法 | |
CN114650343A (zh) | 一种图像传感器及成像装置 | |
CN112335233B (zh) | 图像生成装置以及摄像装置 | |
RU2736780C1 (ru) | Устройство для формирования цветного изображения (варианты) | |
WO2022234753A1 (ja) | 固体撮像装置及び電子機器 | |
JP4681792B2 (ja) | デジタルカメラ | |
CN108683893A (zh) | 利用量子点技术扩展cmos摄像机中传感器色域的方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200480032266.9 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2005515360 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11416939 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2004799576 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2004799576 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 11416939 Country of ref document: US |