JP2014140117A - Camera apparatus and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce power consumption by switching illumination operation according to the movement of an object.SOLUTION: A camera apparatus 100 emits a beam of non-visible light to an object 10 to take an image of the object 10. An irradiation part 150 performs a first operation to irradiate the object 10 with a beam of non-visible light which has plural different wavelengths and a second operation with power consumption smaller than that of the first operation. A sensor unit 112 receives the light which is reflected at the object 10 and collected by an imaging optical part 111 to take an image of the object 10. When the control unit 101 detects that the object 10 is still based on taken image data of the object 10, the control unit 101 controls the irradiation part 10 to perform the second operation.

Description

  The present invention relates to a camera device and an imaging method for imaging a subject by irradiating the subject with invisible light.

  Conventionally, a night vision camera that captures and displays a color image of a subject irradiated with infrared light, which is a kind of invisible light, is known (for example, Patent Document 1). The night-vision camera of Patent Document 1 irradiates a subject with a plurality of infrared lights at different times, measures reflected light from the subject, and performs color estimation using a color table. And the night vision camera of patent document 1 displays a to-be-photographed object color based on the estimation result of color estimation.

  FIG. 1 is a diagram illustrating the irradiation timing of infrared light emitted from the night vision camera of Patent Document 1. In FIG.

  As shown in FIG. 1, the night vision camera of Patent Document 1 irradiates infrared light with a wavelength λ1 having an emission intensity S0 and a duty ratio D0, and after the irradiation with infrared light with a wavelength λ1 is completed, the emission intensity S0 and the duty ratio. Irradiate infrared light having a wavelength λ2 of D0. The night-vision camera of Patent Document 1 irradiates infrared light having a wavelength λ3 having an emission intensity S0 and a duty ratio D0 after the irradiation of infrared light having a wavelength λ2 is completed. After that, infrared light is repeatedly irradiated in this order at different wavelengths for different wavelengths.

JP 2011-50049 A

  However, in the night-vision camera of Patent Document 1, when imaging a subject, invisible light of all wavelengths λ1 to λ3 is repeatedly irradiated in order, so that the invisible light of each wavelength is emitted. Therefore, there is a problem that low power consumption cannot be achieved.

  An object of the present invention is to provide a camera device and an imaging method capable of reducing power consumption by switching an operation when irradiating a subject in accordance with the movement of the subject.

  The camera device according to the present invention is a camera device that irradiates a subject with invisible light and images the subject, and includes a first operation for irradiating the subject with invisible light having a plurality of different wavelengths, An irradiation unit that performs a second operation that consumes less power than the first operation, an imaging unit that images the subject irradiated by the irradiation unit, and image data of the subject captured by the imaging unit And a control unit that causes the irradiation unit to perform the second operation when it is detected that the subject is stationary.

  An imaging method according to the present invention is an imaging method in a camera apparatus that images a subject by irradiating the subject with invisible light, the first operation for irradiating the invisible light having a plurality of different wavelengths, Performing a second operation with lower power consumption than the first operation, imaging the irradiated subject, and stopping the subject based on the captured image data of the subject. A step of causing the second operation to be performed when it is detected.

  According to the present invention, the power consumption can be reduced by switching the operation when irradiating the subject in accordance with the movement of the subject.

The figure which shows the irradiation timing of the infrared light which the night vision camera of patent document 1 irradiates 1 is a block diagram showing a configuration of a camera device according to Embodiment 1 of the present invention. The flowchart which shows operation | movement of the camera apparatus which concerns on Embodiment 1 of this invention. The figure which shows the relationship between the light emission timing of the invisible light radiate | emitted from the radiation | emission part in Embodiment 1 of this invention, and radiation | emission intensity | strength. The figure which shows the relationship between the wavelength of the to-be-photographed object imaged with the camera apparatus which concerns on Embodiment 1 of this invention, and a reflectance. The figure which shows the luminous efficiency of the light source in the camera apparatus which concerns on Embodiment 3 of this invention. The figure which shows the relationship between the light emission timing of the invisible light radiate | emitted from the radiation | emission part in Embodiment 4 of this invention, an emitted intensity, and a duty ratio. The figure which shows the relationship between the timing of light emission of the invisible light radiate | emitted from the output part in Embodiment 5 of this invention, and emitted intensity. The figure which shows the relationship between the light emission timing of the invisible light radiate | emitted from the output part in Embodiment 6 of this invention, and an emitted intensity. Block diagram showing the configuration of a camera apparatus according to Embodiment 7 of the present invention The figure which shows the structure of the imaging optical part in Embodiment 7 of this invention. The figure which shows the relationship between the timing of light emission of the invisible light radiate | emitted from the output part in Embodiment 7 of this invention, and a duty ratio. The figure which shows the structure of the sensor part in Embodiment 8 of this invention. The figure which shows the relationship between the wavelength and quantum efficiency in Embodiment 8 of this invention. The figure which shows the structure of the wavelength filter in Embodiment 8 of this invention. The figure which shows the relationship between the wavelength in the area | region of the wavelength file which permeate | transmits the light of the wavelength range of visible light in Embodiment 8 of this invention, and the transmittance | permeability The figure which shows the relationship between the wavelength and the transmittance | permeability in the area | region of the wavelength filter which permeate | transmits the light of the wavelength range of the infrared light and ultraviolet light in Embodiment 8 of this invention. The figure which shows the relationship between the wavelength and the transmittance | permeability in the area | region of the wavelength filter which permeate | transmits the light of all the wavelength areas in Embodiment 8 of this invention. The figure which shows the structure at the time of using a wavelength filter for the camera apparatus which concerns on Embodiment 8 of this invention. The figure which shows the structure of the imaging optical part in Embodiment 9 of this invention. The figure which shows the structure of the beam separation element in Embodiment 9 of this invention. The figure which shows the structure of the wavelength filter in Embodiment 9 of this invention. The figure which shows the structure of the sensor part in Embodiment 9 of this invention. The figure which shows the structure of the beam separation element and sensor part in Embodiment 10 of this invention. The figure which shows the structure of the sensor part in Embodiment 10 of this invention. The figure which shows the structure of the beam separation element and sensor part in Embodiment 11 of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that in each drawing, the same reference numerals have the same configuration or the same action, or perform the same operation.

(Embodiment 1)
<Configuration of camera device>
The configuration of the camera device 100 according to Embodiment 1 of the present invention will be described with reference to FIG.

  The camera device 100 includes a control unit 101, a first emission unit 102, a second emission unit 103, a third emission unit 104, an illumination optical unit 105, an imaging optical unit 111, and a sensor unit 112. The data processing unit 113, the motion detection unit 114, the color estimation unit 115, and the storage unit 116 are mainly configured. The camera device 100 images the subject 10 by irradiating the subject 10 with invisible light.

  The control unit 101 controls the emission of invisible light from the first emission unit 102, the second emission unit 103, and the third emission unit 104 based on control information input from the outside. Control of each of the first emission unit 102 to the third emission unit 104 in the control unit 101 is referred to as irradiation control. A signal having irradiation control information that is output from the control unit 101 to each of the first emission unit 102 to the third emission unit 104 at that time is referred to as an irradiation control signal. Specifically, the control unit 101 performs a first operation for emitting non-visible light to all of the first emission unit 102, the second emission unit 103, and the third emission unit 104 based on the control information. Alternatively, the first emission unit 102, the second emission unit 103, and the third emission unit 104 are controlled to perform a second operation with lower power consumption than the first operation. Here, the invisible light is infrared light or ultraviolet light. The first operation and the second operation will be described later.

  Note that the control unit 101 can have control information inside in advance. In that case, it is not necessary to input control information from the outside, or the frequency of inputting control information from the outside may be low.

<Configuration of irradiation unit>
The structure of the irradiation part 150 in Embodiment 1 of this invention is demonstrated using FIG.

  The irradiation unit 150 mainly includes a control unit 101, a first emission unit 102, a second emission unit 103, a third emission unit 104, and an illumination optical unit 105. The first emission unit 102, the second emission unit 103, and the third emission unit 104 are light sources of the irradiation unit 150. The irradiation unit 150 irradiates the subject 10 with invisible light.

  The first emission unit 102, the second emission unit 103, and the third emission unit 104 emit invisible light having different wavelengths λ11, λ12, and λ13, respectively, under the control of the control unit 101. Invisible light is emitted intermittently at different wavelengths for each wavelength. The 1st output part 102, the 2nd output part 103, and the 3rd output part 104 are light emitting diodes (LED), for example. Although LEDs are used as the first emission unit 102, the second emission unit 103, and the third emission unit 104, they are not limited to LEDs, and are excited by a laser light source, laser light, LED, or the like. Any light source that emits light of a desired wavelength, such as a fluorescent material or a high-pressure mercury lamp, can be applied.

  The illumination optical unit 105 subjects the invisible light emitted from the first emitting unit 102, the invisible light emitted from the second emitting unit 103, or the invisible light emitted from the third emitting unit 104 to the subject. Irradiate toward 10. The illumination optical unit 105 has a lens for irradiating the subject 10 with invisible light. The invisible light emitted from the illumination optical unit 105 is efficiently guided toward the subject 10 by using a lens. Note that the camera device 100 according to the present embodiment can irradiate the subject 10 with invisible light emitted from the illumination optical unit 105 without a lens, and therefore the lens of the illumination optical unit 105 may be omitted.

  In the present embodiment, the diffusion elements that diffuse invisible light from the first emission unit 102 to the third emission unit 104 are the first emission unit 102 to the third emission unit 104, the subject 10, and the like. By providing in the optical path between, the light intensity of the invisible light that irradiates the subject 10 may be made uniform over a wide range. A diffusion element having a general configuration such as a diffraction type or a refractive type can be used without any limitation.

  The illumination optical unit 105 may not be common to the first emission unit 102 to the third emission unit 104, and is individually provided for each of the first emission unit 102 to the third emission unit 104. May be provided. In that case, the camera apparatus can design each illumination optical unit optimally with respect to the wavelength of the invisible light emitted from each of the first emission unit 102 to the third emission unit 104, and more Invisible light having uniform light intensity in a wide range can be irradiated.

<Configuration of imaging unit>
The configuration of the imaging unit 160 according to Embodiment 1 of the present invention will be described with reference to FIG.

  The imaging unit 160 includes an imaging optical unit 111, a sensor unit 112, a data processing unit 113, a motion detection unit 114, a color estimation unit 115, and a storage unit 116. The imaging unit 160 performs processing for capturing an image of the subject 10 irradiated with invisible light and displaying an image of the captured subject.

  The imaging optical unit 111 condenses the reflected light reflected by the subject 10 irradiated with invisible light and outputs it to the sensor unit 112. The imaging optical unit 111 has a condenser lens. The condensing lens focuses the reflected light from the subject 10 on the sensor unit 112 to form an image of the subject 10 on the sensor unit 112. Although not shown, the condenser lens is an imaging lens that is generally used in camera devices.

  The sensor unit 112 receives the reflected light from the subject 10 collected by the imaging optical unit 111, images the subject 10, and converts the received reflected light into an electrical signal. The electrical signal converted by the sensor unit 112 is output from the sensor unit 112 to the data processing unit 113 as imaging data.

  The sensor unit 112 receives sensor control from the control unit 101. A signal including sensor control information input from the control unit 101 to the sensor unit 112 at this time is referred to as a sensor control signal. For example, the sensor control signal includes information on the timing at which the subject 10 is irradiated by the first emission unit 102 to the third emission unit 104. Therefore, the sensor unit 112 can reliably know which wavelength the reflected light reflected by the subject 10 is, and therefore each of the first emission unit 102 to the third emission unit 104. It can be reliably separated into electrical signals of wavelengths.

  The data processing unit 113 performs predetermined image processing such as gain adjustment and exposure adjustment on the imaging data input from the sensor unit 112, thereby invisible light emitted from the first emission unit 102, Image data captured with the invisible light emitted from the second emitting unit 103 or the invisible light emitted from the third emitting unit 104 is acquired. The data processing unit 113 outputs the acquired image data to the motion detection unit 114 and the color estimation unit 115 and stores the acquired image data in the storage unit 116.

  The data processing unit 113 receives data processing control from the control unit 101. A signal including data processing control information input from the control unit 101 to the data processing unit 113 at that time is referred to as a data processing control signal. The data processing control signal indicates whether the imaging data output from the sensor unit 112 is imaging data corresponding to invisible light having a wavelength emitted from any of the first emission unit 102 to the third emission unit 104. It is used for confirmation and appropriate processing.

  It goes without saying that the data processing unit 113 can simultaneously receive information on the data processing control signal from the imaging data output from the sensor unit 112.

  The motion detection unit 114 detects the motion of the subject 10 by analyzing the image data input from the data processing unit 113 under the control of the control unit 101. The motion detection unit 114 outputs the detection result of the motion of the subject 10 to the control unit 101 and the color estimation unit 115.

  The color estimation unit 115 performs color estimation based on the spectrum of the image data input from the data processing unit 113 when the detection result of the movement of the subject 10 is input from the motion detection unit 114. When the detection result that the subject 10 is stationary is input from the motion detection unit 114, the color estimation unit 115 reads past image data stored in the storage unit 116, and based on the spectrum of the read image data. Color estimation. The color estimation unit 115 generates display data for displaying the subject 10 based on the color estimation result, and outputs the display data to the monitor 200.

  The color estimation unit 115 receives color estimation control from the control unit 101. A signal including color estimation process control information input from the control unit 101 to the color estimation unit 115 at that time is referred to as a color estimation control signal. Whether the color estimation control signal is the image data corresponding to the invisible light having the wavelength emitted from any of the first emission unit 102 to the third emission unit 104 of the image data output from the data processing unit 113 It is used to confirm the above and perform appropriate processing.

  Note that part or all of the processing performed by the data processing unit 113 may be performed by the color estimation unit 115. Needless to say, when all of the processing performed by the data processing unit 113 is performed by the color estimation unit 115, the data processing unit 113 may be omitted for convenience.

<Operation of camera device>
The operation of the camera apparatus 100 according to Embodiment 1 of the present invention will be described with reference to FIGS.

  First, the control unit 101 and the color estimation unit 115 determine whether or not the motion detection unit 114 has obtained a detection result indicating that the subject 10 is stationary (step ST301).

  When the detection result of the movement of the subject 10 is obtained from the motion detection unit 114 (step ST301: NO), the camera apparatus 100 performs the normal shooting mode processing in steps ST302 to ST308.

  That is, when the control unit 101 obtains the detection result of the movement of the subject 10 from the motion detection unit 114 (step ST301: NO), the control unit 101 performs the first output on the first emission unit 102 to the third emission unit 104. 1 operation is performed. Thereby, the 1st output part 102 irradiates the to-be-photographed object 10 by radiate | emitting the invisible light of wavelength (lambda) 11 (step ST302).

  Next, the data processing unit 113 acquires image data from reflected light from the subject 10 having the wavelength λ11 (step ST303).

  Next, the control unit 101 irradiates the subject 10 by emitting invisible light having a wavelength λ12 from the second emitting unit 103 as a first operation (step ST304).

  Next, the data processing unit 113 acquires image data from reflected light from the subject 10 having the wavelength λ12 (step ST305).

  Next, the control unit 101 irradiates the subject 10 by emitting invisible light having a wavelength λ13 from the third emitting unit 104 as a first operation (step ST306).

  Next, the data processing unit 113 acquires image data from reflected light from the subject 10 having the wavelength λ13 (step ST307).

  Next, the color estimation unit 115 performs color estimation processing from the image data acquired in step ST303, step ST305, and step ST307 (step ST308). The details of the operation of the camera device 100 in the normal shooting mode will be described later.

  On the other hand, when the camera apparatus 100 obtains a detection result indicating that the subject 10 is stationary from the motion detection unit 114 (step ST301: YES), the camera apparatus 100 performs processing in the still image shooting mode in steps ST309 to ST312.

  That is, the control unit 101 causes the first emission unit 102, the second emission unit 103, and the third emission unit 104 to perform a second operation that consumes less power than the first operation. To control. Thereby, the 1st output part 102 irradiates the to-be-photographed object 10 by radiate | emitting the invisible light of wavelength (lambda) 11 (step ST309). Moreover, the 2nd output part 103 and the 3rd output part 104 stop a drive, and stop the emission of invisible light (step ST310).

  Next, the data processing unit 113 acquires image data from reflected light from the subject 10 having the wavelength λ11 (step ST311).

  Next, the color estimation unit 115 performs color estimation processing from the image data acquired in step ST311 and the past image data of the wavelengths λ12 and λ13 stored in the storage unit 116 (step ST312). Details of the operation of the camera device 100 in the still image shooting mode will be described later.

  The camera apparatus 100 determines whether or not to continue imaging after the process of step ST308 or the process of step ST312 (step ST313).

  If the camera apparatus 100 determines to continue imaging (step ST313: YES), the process returns to step ST301, and if it is determined not to continue imaging (step ST313: NO), the process ends.

<Operation of Camera Device in Normal Shooting Mode>
The operation of the camera apparatus 100 in the normal shooting mode according to Embodiment 1 of the present invention will be described with reference to FIG. In FIG. 4, the first emitting unit 102 emits invisible light with a wavelength λ11, the second emitting unit 103 emits invisible light with a wavelength λ12, and the third emitting unit 104 is invisible with a wavelength λ13. It shall emit light.

  In FIG. 4, the solid line indicates the emission intensity and the duty ratio in both the normal shooting mode and the still image shooting mode, and the broken line indicates the emission intensity and the duty ratio only in the normal shooting mode.

  Here, the duty ratio is a ratio of “a period during which the phenomenon continues during a certain period” in a certain periodic phenomenon. That is, the duty ratio is a ratio of time during which light is emitted in a certain state with respect to the cycle when the light emission intensities of the first emission unit 102 to the third emission unit 104 are periodically changed. For example, when the repetition period is T and the time width in which the invisible light A is emitted in one period is a and the duty ratio is D, the duty ratio of the invisible light A is D = a / T It is. Note that changing the duty ratio means that the intensity of invisible light changes with time.

  In the present embodiment, when the wavelengths having the strongest intensity of light emitted from each of the first emission unit 102 to the third emission unit 104 are wavelengths λ11 to λ12, λ11 is a wavelength of 830 nm to 1000 nm, and λ12 is By setting the wavelengths 350 nm to 420 nm and λ13 to the wavelengths 700 nm to 830 nm, the color can be estimated with high accuracy.

  Therefore, the invisible light irradiated by the camera device 100 means light having a wavelength of 350 nm to 420 nm and 700 nm to 1000 nm.

  In this embodiment, if the relationship of λ11> λ13 is maintained, color estimation can be performed with high accuracy even when λ11 is set to 750 nm to 830 nm. Therefore, in this embodiment, the relationship of λ11> λ13 may be maintained and λ11 may be set to 750 nm to 830 nm.

  In this embodiment, λ11 = 940 nm, λ12 = 385 nm, and λ13 = 810 nm.

  The LED emits light having a relatively wide wavelength width of about 50 nm half width. Therefore, for example, the light of λ11 (λ11 = 940 nm) emitted from the first emission unit 102 is light having the above wavelength distribution. The same applies to λ12 and λ13. In the present embodiment, a filter that attenuates light having an unnecessary wavelength may be used as necessary.

  At time t0, the control unit 101 causes the first emitting unit 102 to emit invisible light having a wavelength λ11 having a duty ratio D1, based on control information input from the outside.

  At time t1, the control unit 101 causes the first emission unit 102 to stop emitting the invisible light having the wavelength λ11 based on the control information input from the outside, and to the second emission unit 103. Thus, invisible light with a wavelength λ12 having a duty ratio D2 (D1 <D2) is emitted.

  At time t2, the control unit 101 causes the second emitting unit 103 to stop emitting the invisible light having the wavelength λ12 based on the control information input from the outside, and to the third emitting unit 104. Thus, invisible light having a wavelength λ13 having a duty ratio D3 (D2> D3) is emitted.

  At time t3, the control unit 101 causes the third emitting unit 104 to stop emitting the invisible light having the wavelength λ13 based on the control information input from the outside, and the first emitting unit 102 Thus, invisible light having a wavelength λ11 with a duty ratio D1 is emitted.

  Thereafter, the control unit 101 performs the same process as the process at time t1 at time t4 and time t7. In addition, the control unit 101 performs the same process as the process at time t2 at time t5 and time t8. Further, the control unit 101 performs the same process as the process at time t3 at time t6 and time t9. In addition, the emission intensity | strength of the light radiate | emitted from the 1st output part 102-the 3rd output part 104 is the same.

  At time t1, the first emitting unit 102 stops emitting the invisible light with the wavelength λ11, and the second emitting unit 103 emits the invisible light with the wavelength λ12. Even if the emission of the invisible light is not completely stopped, the emission of the invisible light having the wavelength λ11 may be performed as long as the emission intensity has no influence on the color estimation. The same applies to times t2, t3, and the like.

  At time t1, the first emitting unit 102 stops emitting the invisible light having the wavelength λ11, and the second emitting unit 103 emits the invisible light having the wavelength λ12. Even if the emission of the invisible light is not completely stopped, the wavelength λ11 and the wavelength λ12 may be irradiated at the same time as long as they have a very short time that does not affect the color estimation. Absent. The same applies to times t2, t3, and the like.

  Reflected light from the subject 10, the electrical signal converted by the sensor unit 112, the imaging data output from the sensor unit 112, and the data processing unit 113 for the invisible light of wavelength λ11 emitted at time t0 The image data is one frame.

  In addition, the reflected light from the subject 10, the electrical signal converted by the sensor unit 112, the imaging data output from the sensor unit 112, and the output from the data processing unit 113 for the invisible light having the wavelength λ12 emitted at time t1 The image data to be processed is 2 frames.

  In addition, the reflected light from the subject 10, the electrical signal converted by the sensor unit 112, the imaging data output from the sensor unit 112, and the output from the data processing unit 113 with respect to the invisible light having the wavelength λ13 emitted at time t2 The image data to be processed is 3 frames.

  In addition, the reflected light from the subject 10, the electrical signal converted by the sensor unit 112, the imaging data output from the sensor unit 112, and the output from the data processing unit 113 with respect to the invisible light having the wavelength λ11 emitted at time t3 The image data to be processed is 4 frames.

  Thereafter, at time t4 and time t7, processing similar to the processing at time t1 is performed, reflected light from the subject 10, electrical signals converted by the sensor unit 112, imaging data output from the sensor unit 112, and data The image data output from the processing unit 113 is 5 frames and 8 frames, respectively.

  In addition, at time t5 and time t8, processing similar to that at time t2 is performed, and reflected light from the subject 10, electrical signals converted by the sensor unit 112, imaging data output from the sensor unit 112, and data processing The image data output from the unit 113 is 6 frames and 9 frames, respectively.

  In addition, at time t6 and time t9, processing similar to that at time t3 is performed, and reflected light from the subject 10, electrical signals converted by the sensor unit 112, imaging data output from the sensor unit 112, and data processing The image data output from the unit 113 is 7 frames and 10 frames, respectively.

  The color estimation unit 115 estimates the color based on the spectrum of the image data from the first frame to the third frame created within the light emission period T from the time t0 of the invisible light output from the data processing unit 113. . The color estimation unit 115 generates display data for displaying the subject 10 based on the result of estimating the color from the image data of three frames, and outputs it to the outside.

  In addition, the color estimation unit 115 estimates the color based on the spectrum of the image data from the 4th frame to the 6th frame generated within the light emission period T from the time t4 of invisible light output from the data processing unit 113. I do. The color estimation unit 115 generates display data for displaying the subject 10 based on the result of estimating the color from the image data of three frames, and outputs it to the outside.

  In addition, the color estimation unit 115 estimates the color based on the spectrum of the image data from the 7th frame to the 9th frame generated within the light emission period T from the time t7 of the invisible light output by the data processing unit 113. I do. The color estimation unit 115 generates display data for displaying the subject 10 based on the result of estimating the color from the image data of three frames, and outputs it to the outside.

  That is, display data based on the result of estimating the color every invisible light emission period T, in other words, every three frames, is output to the outside.

  In the present embodiment, display data based on the result of color estimation can be output to the outside for each frame irradiated with invisible light, not every light emission period T of invisible light. The case will be described.

  Reflected light from the subject 10, electrical signals converted by the sensor unit 112, imaging data output from the sensor unit 112, and image data output from the data processing unit 113 are created from time t0 to t9. Similarly to 1 to 10 frames. However, the processing method of the color estimation unit 115 is different.

  The color estimation unit 115 estimates the color based on the spectrum of the image data from the first frame to the third frame created within the light emission period T from the time t0 of the invisible light output from the data processing unit 113. . The color estimation unit 115 generates display data for displaying the subject 10 based on the color estimation result, and outputs the display data to the outside.

  Secondly, the color estimation unit 115 generates a color based on the spectrum of image data from 2 frames to 4 frames created within the light emission period T from the time t1 of invisible light output by the data processing unit 113. Estimate The color estimation unit 115 generates display data for displaying the subject 10 based on the color estimation result, and outputs the display data to the outside.

  Thirdly, the color estimation unit 115 generates a color based on the spectrum of the image data from 3 frames to 5 frames generated within the light emission period T from the time t2 of invisible light output from the data processing unit 113. Estimate The color estimation unit 115 generates display data for displaying the subject 10 based on the color estimation result, and outputs the display data to the outside.

  Fourth, the color estimation unit 115 performs color processing based on the spectrum of image data from 4 frames to 6 frames generated within the light emission period T from the time t3 of invisible light output from the data processing unit 113. Estimate The color estimation unit 115 generates display data for displaying the subject 10 based on the color estimation result, and outputs the display data to the outside.

  Thereafter, the camera device 100 performs the same process as the process at the time t1 at the time t4 and the time t7. In addition, the camera device 100 performs the same process as the process at the time t2 at the time t5 and the time t8. Further, the camera device 100 performs the same process as the process at the time t3 at the time t6 and the time t9.

  Thereby, display data based on the result of estimating the color for each invisible light emitting frame, in other words, for each frame is output to the outside.

<Operation of camera device in still image shooting mode>
The operation of the camera apparatus 100 in the still image shooting mode according to Embodiment 1 of the present invention will be described with reference to FIG.

  When the detection result that the subject 10 is stationary is obtained from the motion detection unit 114, the control unit 101 operates in the normal operation mode, the first emission unit 102, the second emission unit 103, the first The operation | movement of at least 1 of the 3 emission part 104 is stopped. Here, the control unit 101 stops the operations of the second emission unit 103 and the third emission unit 104 as indicated by broken lines in FIG. The first emission unit 102 operates as usual, so that at least an image of the subject 10 can be acquired.

  Here, the control unit 101 stops the operations of the second emission unit 103 and the third emission unit 104. However, if the operation of the subject can be detected with lower power consumption than in the normal operation mode, The operation of either one of the second emission unit 103 and the third emission unit 104 may be stopped.

  In addition, the control unit 101 does not need to completely stop the first emission unit 102 to the third emission unit 104, and it goes without saying that the power consumption is lower than that in the normal operation mode only by reducing the irradiation output. .

<Selection method of emitting part for emitting invisible light>
A method for selecting an emission part for emitting invisible light according to the second embodiment of the present invention will be described with reference to FIGS.

  The control unit 101 selects an emitting unit that emits invisible light based on the light reflectance of each of the wavelengths λ11, λ12, and λ13 before the processing of step ST309 and step ST310.

  Specifically, in FIG. 5, the solid line indicates the light reflectance for each wavelength of a subject that appears blue to humans (hereinafter referred to as “subject B”), and the alternate long and short dash line indicates a subject that appears green to humans. The light reflectance for each wavelength of the subject (hereinafter referred to as “subject G”) is shown, and the broken line indicates the light reflectance for each wavelength of a subject that appears red to humans (hereinafter referred to as “subject R”). , Respectively. In FIG. 5, blue, green, and red colored papers are used as subjects.

  From FIG. 5, the wavelength λ11 is the wavelength having the highest light reflectance in all of the subject B, the subject G, and the subject R. The wavelength λ12 is the wavelength having the lowest light reflectance in all of the subject B, the subject G, and the subject R. The wavelength λ13 has an intermediate reflection characteristic between the reflection characteristic of the wavelength λ11 and the reflection characteristic of the wavelength λ12, and also shows significantly different reflection characteristics for the subject B, the subject G, and the subject R.

  In consideration of the above-described characteristics, the control unit 101 emits only invisible light having the wavelength λ11 emitted from the first emission unit 102, as shown in FIG. Thereby, as shown in FIG. 4, the camera apparatus 100 emits invisible light having the wavelength λ11 at timings t0, t3, and t6. On the other hand, the camera device 100 does not emit invisible light having the wavelengths λ12 and λ13.

  In this embodiment, when the average light reflectance of the subject B, the subject G, and the subject R having the wavelength λ11 is 1, the average light reflectance of the wavelength λ12 is about 0.25 and the average of the wavelength λ13. The light reflectance is about 0.75. This is because when the emission intensity of the invisible light emitted from each of the first emission unit 102 to the third emission unit 104 is the same, the influence of noise on the video signal having the wavelength λ12 is approximately about the wavelength λ11. This indicates that the color is estimated to be four times, that is, the accuracy of estimating the color is reduced. Therefore, the control unit 101 emits only invisible light having the wavelength λ11 from the first emitting unit 102. Thereby, the influence of noise can be minimized without changing the LED mounted on each of the first emission unit 102 to the third emission unit 104 to an expensive high-power product or the like.

  In the present embodiment, the emitting unit that emits the invisible light is selected using the light reflectance of the subject B, the subject G, and the subject R. However, the present invention is not limited to this, and the first emitting unit 102 to the third emitting unit 102 Considering the wavelength spectrum emitted from each of the emission units 104, the color of the subject to be photographed, the material, the distance of the subject, or the color estimation accuracy, the first emission unit 102 to the third emission unit 104 You may select the output part which radiate | emits non-visible light. In addition, the selection method of the emission part which emits invisible light is not this limitation.

  As described above, according to the present embodiment, when the subject 10 is stationary, the driving of the second emission unit 103 and the third emission unit 104 is stopped, so that low power consumption can be achieved.

  Further, according to the present embodiment, when the subject 10 is stationary, only the first emission unit 102 is driven, so that all driving of the first emission unit 102 to the third emission unit 104 is stopped. An image closer to the actual image can be displayed as compared with the case where the image is displayed.

  Further, according to the present embodiment, an image with a sufficient signal-to-noise ratio (S / N) can be obtained, and a camera device with low power consumption can be provided. Further, when operated with a battery, it is possible to operate for a long time.

(Embodiment 2)
The camera device according to the present embodiment is not particularly limited with respect to the configuration, and for example, can be configured the same as the camera device 100 shown in the first embodiment. In the present embodiment, description will be made using the reference numerals of the camera device 100 shown in FIG. In the present embodiment, the operation of the camera apparatus 100 is the same as that in FIG.

<Selection method of emitting part for emitting invisible light>
A method for selecting an emission part that emits invisible light according to Embodiment 2 of the present invention will be described.

  The wavelength λ11 is the wavelength of invisible light emitted from the first emission unit 102 having the longest lifetime. The wavelength λ12 is the wavelength of invisible light emitted from the second emission unit 103 having the shortest lifetime. The wavelength λ13 is the wavelength of the invisible light emitted from the third emitting unit 104 having a lifetime that is intermediate between the lifetime of the first emitting unit 102 and the lifetime of the second emitting unit 103.

  The control unit 101 emits only invisible light having a wavelength λ11 emitted from the first emission unit 102 that is the light source having the longest lifetime.

  As described above, according to the present embodiment, in addition to the effect of the first embodiment, in the still image shooting mode, invisible light having the wavelength λ11 is emitted from the first emission unit 102 that is the light source having the longest lifetime. By emitting the light, the lifetime of the entire camera device 100 can be extended.

(Embodiment 3)
The camera device according to the present embodiment is not particularly limited with respect to the configuration, and for example, can be configured the same as the camera device 100 shown in the first embodiment. In the present embodiment, description will be made using the reference numerals of the camera device 100 shown in FIG. In the present embodiment, the operation of the camera apparatus 100 is the same as that in FIG.

<Selection method of emitting part for emitting invisible light>
A method for selecting an emission part for emitting invisible light according to Embodiment 3 of the present invention will be described with reference to FIG. FIG. 6 shows an example of the wavelengths and light emission efficiencies of the first emission part 102 to the third emission part 104 that are light sources.

  From FIG. 6, the wavelength λ11 has the highest luminous efficiency of the light source (electrical-light conversion efficiency of the light source). The wavelength λ11 is the wavelength of invisible light emitted from the first emission unit 102. The wavelength λ12 has the lowest luminous efficiency. The wavelength λ12 is the wavelength of invisible light emitted from the second emission unit 103. The wavelength λ13 has a light emission efficiency intermediate between the light emission efficiency of the first emission unit 102 and the light emission efficiency of the second emission unit 103. The wavelength λ13 is the wavelength of invisible light emitted from the third emitting unit 104.

  As shown in FIG. 6, the control unit 101 emits invisible light having the wavelength λ11 only from the first emission unit 102 having the highest light emission efficiency.

  Specifically, this light emission efficiency indicates that 30% of the total input power is light and the remaining 70% is heat for an LED that emits light of wavelength λ11. Indicates that 10% of the total input power is light and the remaining 90% is heat, and an LED that irradiates light of wavelength λ13 has 20% of the total input power to light and the remaining 80% heat. It shows that it becomes.

  Thereby, for example, it is not necessary to use expensive parts corresponding to high currents for the LED or electric circuit parts to be used. In addition, heat radiation countermeasure parts can be reduced, and the camera device can be easily downsized.

  In the present embodiment, the emitting unit is selected considering only the light emission efficiency of the LED to be used. However, even if the emitting unit is selected in consideration of the efficiency of the peripheral circuit of the LED or the efficiency of the power source to be used. Good.

  As described above, according to the present embodiment, in addition to the effect of the first embodiment, in the still image shooting mode, the non-visible light is emitted only from the first emission unit 102 having the highest light emission efficiency. The object 10 can be irradiated efficiently.

(Embodiment 4)
The camera device according to the present embodiment is not particularly limited with respect to the configuration, and for example, can be configured the same as the camera device 100 shown in the first embodiment. In the present embodiment, description will be made using the reference numerals of the camera device 100 shown in FIG.

<Operation of camera device>
The operation of the camera device 100 according to Embodiment 4 of the present invention will be described with reference to FIG. In FIG. 7, the broken line indicates the emission intensity and the duty ratio in the normal shooting mode, and the solid line indicates the emission intensity and the duty ratio in the still image shooting mode.

  In the present embodiment, as shown in FIG. 7, in the still image shooting mode, the control unit 101 emits invisible light of wavelength λ11 emitted from the first emitting unit 102 as compared with the normal shooting mode. While lowering the duty ratio.

  The camera device 100 according to the present embodiment is the same as that in FIG.

  As described above, according to the present embodiment, in addition to the effect of the first embodiment, the emission intensity is lowered and the duty ratio is increased in the still image shooting mode. Since the peak power flowing to the target can be lowered, the subject 10 can be sufficiently irradiated while reducing the power consumption.

(Embodiment 5)
The camera device according to the present embodiment is not particularly limited with respect to the configuration, and for example, can be configured the same as the camera device 100 shown in the first embodiment. In the present embodiment, description will be made using the reference numerals of the camera device 100 shown in FIG.

<Operation of camera device>
The operation of the camera device 100 according to Embodiment 5 of the present invention will be described with reference to FIG. In FIG. 8, the broken line indicates the emission intensity and the duty ratio in the normal shooting mode, and the solid line indicates the emission intensity and the duty ratio in the still image shooting mode.

  In the present embodiment, as shown in FIG. 8, in the still image shooting mode, the control unit 101 converts the invisible light having the wavelength λ11 emitted from the first emission unit 102 into an ultrashort pulse. Here, the ultrashort pulse means a pulse having a very short time width. For example, the pulse width of the ultrashort pulse is 3 picoseconds. The ultrashort pulse can be generated by, for example, an ultrashort pulse semiconductor laser.

  In camera device 100 according to the present embodiment, operations other than the above operations are the same as those in FIG.

  As described above, according to the present embodiment, in addition to the effect of the first embodiment, since the ultra-short pulse invisible light is emitted in the still image shooting mode, the heat generation in the irradiation unit 150 can be suppressed. it can.

(Embodiment 6)
The camera device according to the present embodiment is not particularly limited with respect to the configuration, and for example, can be configured the same as the camera device 100 shown in the first embodiment. In the present embodiment, description will be made using the reference numerals of the camera device 100 shown in FIG.

<Operation of camera device>
The operation of the camera device 100 according to Embodiment 6 of the present invention will be described with reference to FIG.

  In the present embodiment, as shown in FIG. 9, the control unit 101 performs the second operation on the first emission unit 102 to the third emission unit 104 when detecting the movement of the subject 10. Make it. That is, when detecting the movement of the subject 10, the control unit 101 reduces the emission intensity and the duty ratio of the invisible light having the wavelength λ11 emitted from the first emission unit 102 as compared with the normal imaging mode. Further, the control unit 101 stops driving the second emission unit 103 and the third emission unit 104 when detecting the movement of the subject 10.

  Note that the camera apparatus 100 according to the present embodiment has the same operations as those in FIG. In addition, the camera device 100 according to the present embodiment may perform any one of the operations in the second to fifth embodiments instead of FIG. In the present embodiment, the emission intensity and the duty ratio are reduced, but only one of the emission intensity and the duty ratio may be reduced.

  Thus, in the present embodiment, when detecting the movement of the subject, the emission intensity or duty ratio of the invisible light having the wavelength λ11 emitted from the first emission unit 102 is reduced and the second emission is performed. The driving of the unit 103 and the third emitting unit 104 is stopped. Thereby, according to the present embodiment, in addition to the effects of the first embodiment, it is possible to further reduce the power consumption as compared with the first embodiment.

(Embodiment 7)
<Configuration of camera device>
The configuration of camera apparatus 900 according to Embodiment 7 of the present invention will be described with reference to FIG.

  The camera device 900 includes a control unit 901, an irradiation unit 150, and an imaging unit 1000.

  The control unit 901 receives control information from the outside, and emits invisible light from the first emission unit 102, the second emission unit 103, and the third emission unit 104 based on the input control information. To control. Specifically, the control unit 901 varies the duty ratio of invisible light emitted from the first emission unit 102, the second emission unit 103, and the third emission unit 104 for each wavelength.

  The irradiation unit 150 irradiates the subject 10 with invisible light.

  The imaging unit 1000 images the subject 10 irradiated with invisible light.

<Configuration of irradiation unit>
The structure of the irradiation part 150 in Embodiment 7 of this invention is demonstrated using FIG. In the irradiating unit 150 in FIG. 10, the same reference numerals are given to the same components as those in FIG. 2, and the description thereof is omitted.

  The first emission unit 102, the second emission unit 103, and the third emission unit 104 emit invisible light having different wavelengths λ11, λ12, and λ13, respectively, under the control of the control unit 901. The other configurations of the first emission unit 102, the second emission unit 103, and the third emission unit 104 other than those described above are the same as those in the first embodiment, and thus description thereof is omitted.

<Configuration of imaging unit>
The configuration of the imaging unit 1000 according to Embodiment 7 of the present invention will be described with reference to FIG.

  The imaging unit 1000 illustrated in FIG. 10 includes an imaging optical unit 1005 instead of the imaging optical unit 111 and the first imaging unit instead of the sensor unit 112, as compared with the imaging unit 160 according to Embodiment 1 illustrated in FIG. Sensor unit 1002, second sensor unit 1003, and third sensor unit 1004. 10, parts having the same configuration as in FIG. 2 are denoted by the same reference numerals and description thereof is omitted.

  The imaging unit 1000 includes a data processing unit 113, a motion detection unit 114, a color estimation unit 115, a storage unit 116, a first sensor unit 1002, a second sensor unit 1003, and a third sensor unit 1004. And the imaging optical unit 1005.

  The imaging optical unit 1005 condenses the reflected light reflected by the subject 10 irradiated with invisible light. The imaging optical unit 1005 guides the collected reflected light having the wavelength λ11 to the first sensor unit 1002. The imaging optical unit 1005 guides the collected reflected light having the wavelength λ12 to the second sensor unit 1003. The imaging optical unit 1005 guides the collected reflected light having the wavelength λ13 to the third sensor unit 1004. Details of the configuration of the imaging optical unit 1005 will be described later.

  Under the control of the control unit 901, the first sensor unit 1002 receives the reflected light of the wavelength λ11 from the subject 10 collected by the imaging optical unit 1005, images the subject 10, and converts the received light into an electrical signal. Convert. The electrical signal converted by the first sensor unit 1002 is output from the first sensor unit 1002 as imaging data.

  The second sensor unit 1003 receives the reflected light of the wavelength λ12 from the subject 10 collected by the imaging optical unit 1005 under the control of the control unit 901, images the subject 10, and converts the received light into an electrical signal. Convert. The electrical signal converted by the second sensor unit 1003 is output from the second sensor unit 1003 as imaging data.

  Under the control of the control unit 901, the third sensor unit 1004 receives reflected light of the wavelength λ13 from the subject 10 collected by the imaging optical unit 1005, images the subject 10, and converts the received light into an electrical signal. Convert. The electrical signal converted by the third sensor unit 1004 is output from the third sensor unit 1004 as imaging data.

  The data processing unit 113 receives imaging data output from the first sensor unit 1002. The data processing unit 113 includes the imaging data of the wavelength λ11 output by the first sensor unit 1002, the imaging data of the wavelength λ12 output by the second sensor unit 1003, and the wavelength output by the third sensor unit 1004. Image data is acquired by combining the imaged data of λ13 and applying predetermined image processing. The data processing unit 113 outputs the acquired image data to the motion detection unit 114 and the color estimation unit 115 and stores the acquired image data in the storage unit 116.

  The data processing unit 113 receives data processing control from the control unit 901. It goes without saying that the data processing unit 113 can simultaneously receive information on the data processing control signal from the imaging data output from the first sensor unit 1002, the second sensor unit 1003, and the third sensor unit 1004. Yes.

  The motion detection unit 114 analyzes the image data input from the data processing unit 113 and detects the motion of the subject 10. The motion detection unit 114 outputs the detection result of the motion of the subject 10 to the control unit 901 and the color estimation unit 115.

<Configuration of imaging optical unit>
The configuration of the imaging optical unit 1005 in Embodiment 7 of the present invention will be described with reference to FIG.

  The imaging optical unit 1005 includes a prism 1001 and a condenser lens 1006.

  The prism 1001 separates the reflected light from the subject 10 for each wavelength. The prism 1001 guides reflected light from the subject 10 to the first sensor unit 1002 to the third sensor unit 1004. The prism 1001 has a first separator 1001a and a second separator 1001b.

  The condensing lens 1006 condenses the reflected light from the subject 10 on the first sensor unit 1002 to the third sensor unit 1004, thereby causing the image of the subject 10 to be in the first sensor unit 1002 to the third sensor unit. An image is formed at 1004. The condenser lens 1006 is an imaging lens that is generally used in camera devices.

  The imaging optical unit 1005 separates the reflected light of wavelength λ11 from the subject 10 from the reflected light of other wavelengths by the first separation unit 1001a and guides it to the first sensor unit 1002. The imaging optical unit 1001 separates the reflected light of wavelength λ12 from the subject 10 from the reflected light of other wavelengths and guides it to the second sensor unit 1003. The imaging optical unit 1005 separates the reflected light of wavelength λ13 from the subject 10 from the reflected light of other wavelengths by the second separation unit 1001b and guides it to the third sensor unit 1004.

<Operation of irradiation unit>
The operation of the irradiation unit 150 according to Embodiment 7 of the present invention will be described with reference to FIG.

  At time t0, the control unit 901 causes the second emitting unit 103 to emit invisible light having the wavelength λ12 based on the control information input from the outside, and the duty ratio to the third emitting unit 104. The invisible light having the wavelength λ13 of D4 is emitted, and the invisible light having the wavelength λ11 having the duty ratio D5 (D4> D5) is emitted to the first emitting unit 102.

  At time t1, the control unit 901 causes the first emitting unit 102 to stop emitting the invisible light having the wavelength λ11 based on the control information input from the outside.

  At time t2, the control unit 901 causes the third emitting unit 104 to stop emitting the invisible light with the wavelength λ13 based on the control information input from the outside.

  At time t3, the control unit 901 causes the third emitting unit 104 to emit invisible light having the wavelength λ13 having the duty ratio D4 and the first emitting unit 102 based on control information input from the outside. In contrast, invisible light having a wavelength λ11 having a duty ratio D5 is emitted.

  At time t4, the control unit 901 causes the first emitting unit 102 to stop emitting the invisible light with the wavelength λ11 based on the control information input from the outside.

  At time t5, the control unit 901 causes the third emitting unit 104 to stop emitting the invisible light having the wavelength λ13 based on the control information input from the outside.

  Thereafter, the control unit 901 repeats the above processing. The emission intensity of the light emitted from the first emission unit 102 to the third emission unit 104 is the same.

  Reflected light from the subject 10, the electrical signal converted by the second sensor unit 1003, the imaging data output from the second sensor unit 1003, and data processing for the invisible light of wavelength λ12 emitted at time t0 The image data output from the unit 113 is assumed to be 1-1 frames.

  Reflected light from the object 10, electrical signals converted by the third sensor unit 1004, imaging data output from the third sensor unit 1004, and data processing for invisible light of wavelength λ13 emitted at time t0 The image data output from the unit 113 is assumed to be 1-2 frames.

  Reflected light from the object 10, electrical signals converted by the first sensor unit 1002, imaging data output from the first sensor unit 1002, and data processing with respect to the invisible light of wavelength λ11 emitted at time t0 The image data output from the unit 113 is 1-3 frames.

  The invisible light emission period T is the same as one half of the time of invisible light having the wavelength λ12 irradiated for the longest time.

  Reflected light from the subject 10, the electrical signal converted by the second sensor unit 1003, the imaging data output from the second sensor unit 1003, and data processing for the invisible light of wavelength λ12 emitted at time t3 The image data output from the unit 113 is 2-1 frame.

  Reflected light from the object 10, electrical signals converted by the third sensor unit 1004, imaging data output from the third sensor unit 1004, and data processing for the invisible light of wavelength λ13 emitted at time t3 The image data output from the unit 113 is 2-2 frames.

  Reflected light from the subject 10, the electrical signal converted by the first sensor unit 1002, the imaging data output from the first sensor unit 1002, and data processing for the invisible light of wavelength λ11 emitted at time t3 The image data output from the unit 113 is 2-3 frames.

  The color estimation unit 115 outputs the color based on the spectrum of the image data from the 1-1 frame to the 1-3 frame generated within the light emission period T from the time t0 of the invisible light output by the data processing unit 113. Estimate The color estimation unit 115 generates display data for displaying the subject 10 based on the result of estimating the color from the image data of the 1-1 frame to the 1-3 frame, and outputs the display data to the monitor 200.

  Further, the color estimation unit 115 is based on the spectrum of the image data from the 2-1 frame to the 2-3 frame generated within the light emission period T from the time t3 of the invisible light output by the data processing unit 113. Color estimation. The color estimation unit 115 generates display data for displaying the subject 10 based on the result of estimating the color from the image data of the 2-1 frame to the 2-3 frame and outputs the display data to the outside.

  That is, display data is output to the monitor 200 based on the result of estimating the color for each invisible light emission period T, in other words, for each frame of invisible light having the wavelength λ 12 that has been irradiated for the longest time.

  Then, when the subject 10 is stationary, the control unit 901 drives only the first emission unit 102 and stops driving the second emission unit 103 and the third emission unit 104.

  According to the present embodiment, in addition to the effect of the first embodiment, the duty ratio of the invisible light emitted from the first emission unit 102 to the third emission unit 104 is made different for each wavelength. It is possible to provide a low power consumption camera device while obtaining an image having a sufficient signal-to-noise ratio (S / N). Further, when operated with a battery, it is possible to operate for a long time.

  Further, according to the present embodiment, in the imaging unit 900, the imaging optical unit 1005 separates invisible light for each wavelength and forms an image on each of the first sensor unit 1002 to the third sensor unit 1004. Signal processing in the imaging unit 1000 can be simplified.

  In addition, according to the present embodiment, invisible light with wavelength λ11 is emitted continuously in time, so signal processing is simpler than when invisible light with all wavelengths is emitted intermittently. Can be.

  In addition, according to the present embodiment, for invisible light of wavelength λ12 and wavelength λ13, the duty ratio is made variable according to the reflection characteristics, or the duty ratio is made variable according to the photoelectric conversion efficiency of the light source. In this case, the light emitted from the illumination optical unit 105 can have high luminance, and the far subject 10 can be irradiated and imaged.

  Further, according to the present embodiment, when the duty ratio of the invisible light having the wavelengths λ12 and λ13 is made variable according to the lifetime of the light source, the lifetime of the camera device 900 can be extended.

  In addition, according to the present embodiment, when the duty ratio of the invisible light having the wavelengths λ12 and λ13 is made variable according to the light emission efficiency of the light source, a sufficient signal-to-noise ratio (S / N) is obtained. It is possible to provide a camera device 900 with lower power consumption while obtaining an image.

  In addition, according to the present embodiment, since the invisible light of the wavelength λ12 and the wavelength λ13 is intermittently emitted, heat generation in the second emission unit 103 and the third emission unit 104 can be suppressed. The heat radiating means such as the heat radiating plate can be simplified, and a small and inexpensive camera device 900 can be provided.

(Embodiment 8)
The camera device according to the present embodiment has the same configuration as that of FIG. 2 except that a wavelength filter 1302 is added and a sensor unit 1300 is provided instead of the sensor unit 112. Therefore, descriptions other than the sensor unit 1300 and the wavelength filter 1302 will be given. Omitted. In the present embodiment, configurations other than the sensor unit 1300 and the wavelength filter 1302 will be described using reference numerals of the camera device 100 illustrated in FIG.

<Configuration of sensor unit>
A configuration of sensor unit 1300 according to the eighth embodiment of the present invention will be described with reference to FIG.

  The sensor unit 1300 includes a light receiving element 1301.

  The light receiving element 1301 includes a plurality of pixels 1301e, 1301f, 1301g, and 1301h.

  In FIG. 13, the pixel 1301e is shown as P1, the pixel 1301f as P2, the pixel 1301g as P3, and the pixel 1301h as P4.

  Each of the pixels 1301e to 1301h converts incident light into an electrical signal. The number of pixels 1301e to 1301h is normally several hundred to several tens of millions, but it is difficult to write accurately, and thus is schematically shown in FIG. The number of pixels can be arbitrarily selected according to the required image resolution.

  In the sensor unit 1300 of this embodiment, a light receiving element 1301 in which 1920 pixels are arranged horizontally and 1080 pixels is arranged vertically is used.

<Characteristics of sensor part>
The characteristics of the sensor unit 1300 according to the eighth embodiment of the present invention will be described with reference to FIG.

  FIG. 14 shows the quantum efficiency characteristics of the pixels 1301e to 1301h included in the sensor unit 1300 with respect to the wavelength. In FIG. 14, reference numeral 1301m denotes a characteristic of the pixel 1301e, reference numeral 1301n denotes a characteristic of the pixel 1301f and the pixel 1301g, and reference numeral 1301o denotes a characteristic of the pixel 1301h.

  Any of the pixels 1301e to 1301h has sensitivity in the wavelength region of infrared light.

  The pixel 1301e is configured such that the sensitivity in the wavelength region corresponding to the red color of visible light is higher than the sensitivity in the green wavelength region and the blue wavelength region of visible light.

  Further, the pixel 1301f and the pixel 1301g are configured such that the sensitivity in the wavelength region corresponding to the green color of visible light is higher than the sensitivity in the red wavelength region and the blue wavelength region of visible light.

  The pixel 1301h is configured such that the sensitivity in the wavelength region corresponding to the blue color of visible light is higher than the sensitivity in the red wavelength region and the green wavelength region of visible light.

  Specifically, a color filter having the above-described characteristics is provided above each of the pixels 1301e to 1301h. Since this configuration is the same as that generally used in image sensors that receive visible light in color, detailed description thereof is omitted.

  When the sensor unit 1300 is used in the camera device, for example, when visible light is illuminated on the subject from the outside, such as the sun during the day or a streetlight at night, it is possible to capture a color that matches the subject.

  Specifically, image data that can be regarded as constituting one pixel of color (hereinafter referred to as an equivalent pixel) can be obtained by a set of pixels 1301e to 1301h, that is, four pixels.

  When estimating the color of a subject using light that is invisible, data output from the pixel 1301h is used. Since the pixel 1301h has sufficient sensitivity to any one of the wavelengths λ11 to λ13, the color can be estimated well as in the camera device described in the first embodiment.

  The pixels 1301e to 1301g have lower sensitivity in the wavelength region of ultraviolet light than the pixel 1301h, but the sensitivity in the wavelength region of infrared light is the same as that of the pixel 1301h. Therefore, when the invisible light to be used is light in the wavelength region of infrared light, the pixels 1301e to 1301g may also be used. By using as many pixels that can detect light in the wavelength region of infrared light as much as possible, it is possible to obtain an image with a sufficient signal-to-noise ratio (S / N) even if the intensity of infrared light applied to the subject is reduced. Therefore, a camera device with low power consumption can be provided. Further, since heat generation can be suppressed by the amount of low power consumption, heat dissipation means such as a heat sink can be simplified, and a small and inexpensive camera device can be provided.

  Note that here, the pixels 1301e to 1301g have a lower sensitivity in the wavelength region of ultraviolet light than the pixel 1301h, and the sensitivity in the wavelength region of infrared light is similar to that of the pixel 1301h. In a case where ˜1301 g has good sensitivity in the wavelength region of ultraviolet light, or invisible light to be used is light in the wavelength region of ultraviolet light, the pixels 1301 e to 1301 g may be used.

  Whether or not to use a plurality of pixels within a range regarded as equivalent one pixel may be determined as follows.

  When the number of pixels to be used is k, the sum of signal outputs is Sk, and the output of one pixel that outputs the maximum signal among the pixels to be used is S1, within the range regarded as one equivalent pixel, Sk Is larger than the product of the square root of k and S1, a plurality of pixels may be used. On the other hand, when Sk is less than or equal to the product of the square root of k and S1, an image with good S / N can be obtained by using one pixel that outputs the maximum signal.

  For example, when four pixels are used in an area regarded as equivalent to 1 pixel, if Sk is larger than the product of the square root of k and S1, image information of the area regarded as equivalent to 1 pixel is generated. For this purpose, four pixels may be used.

  In addition, depending on the wavelength of light emitted from the light source, when the result regarding the criterion for determining whether Sk is larger than the product of the square root of k and S1, the wavelength of the light emitted from the light source is different. For example, four pixels are used when an image is obtained by irradiating light of wavelength λ12, and two pixels are used when an image is obtained by irradiating light of wavelength λ11 and light of wavelength λ13. In addition, the number of pixels may be switched.

  As a result, the images obtained by irradiating the light emitted from each light source are images having the best S / N, and the color can be estimated with high accuracy.

<Configuration of wavelength filter>
The configuration of the wavelength filter 1302 in the eighth embodiment of the present invention will be described with reference to FIG.

  FIG. 15 shows the configuration of a wavelength filter 1302 that limits the wavelength of light to be transmitted.

  The wavelength filter 1302 is disposed in the optical path between the subject 10 and the sensor unit 1300. The wavelength filter 1302 has a region 1302a, a region 1302b, and a region 1302c.

<Characteristics of wavelength filter>
The characteristics of the wavelength filter 1302 according to the eighth embodiment of the present invention will be described with reference to FIGS.

  FIG. 16 shows the transmittance characteristics of the wavelength filter 1302 with respect to the wavelength of the region 1302a.

  The region 1302a has a characteristic of transmitting light in the visible wavelength region and blocking light in the infrared and ultraviolet wavelength regions.

  FIG. 17 shows the transmittance characteristics with respect to the wavelength of the region 1302b. The region 1302b has a characteristic of blocking light in the visible wavelength region and transmitting light in the infrared and ultraviolet wavelength regions.

  FIG. 18 shows the transmittance characteristics with respect to the wavelength of the region 1302c. The region 1302c has a characteristic of transmitting light in all wavelength regions.

<Usage of wavelength filter>
The usage method of the wavelength filter 1302 in Embodiment 8 of this invention is demonstrated using FIG.

  FIG. 19 is a configuration diagram when the wavelength filter 1302 is used in the camera device according to the present embodiment. In FIG. 19, a light receiving element 1303 is disposed between the wavelength filter 1302 and the sensor unit 1300.

  In addition to visible light such as sunlight during the day, infrared light or ultraviolet light is irradiated on the object to be photographed, as shown in FIG. The optical path between the sensor unit 1300 and the sensor unit 1300 is arranged.

  Thereby, when visible light is irradiated on the subject 10 from the outside such as the daytime sun or night street lamp, the incident amount of light in the wavelength region of infrared light or light in the wavelength region of ultraviolet light to the sensor unit 1300. Therefore, it is possible to obtain a clear image that matches the actual color.

  When color estimation is performed by irradiating the subject 10 with infrared light or ultraviolet light in a dark space or the like, as shown in FIG. 19C, a region 1302c of the wavelength filter 1302 includes the subject 10 and the sensor. The optical path between the unit 1300 and the unit 1300 is arranged.

  Since the region 1302c transmits light in all wavelength regions, the light reflected by the subject 10 can be efficiently guided to the sensor unit 1300.

  When it is not desirable that visible light such as streetlight light or car headlight light is incident on the sensor unit 1300, the region 1302b of the wavelength filter 1302 is shown in FIG. It is arranged on the optical path between the subject 10 and the sensor unit 1300. As a result, undesirable visible light is attenuated, so that the color can be estimated with high accuracy.

  Note that although the wavelength filter 1302 described in this embodiment includes three regions 1302a to 1302c, the wavelength filter 1302 includes two regions 1302a and 1302c that do not form the region 1302b. The number and the like may be changed as necessary.

  Although omitted in FIG. 19, means for moving the wavelength filter 1302 is provided in order to selectively use the regions 1302 a to 1302 c of the wavelength filter 1302. As a means for moving the wavelength filter 1302, a generally known method such as a linear motor, a piezoelectric element, or an electromagnetic actuator can be applied.

  Further, in the wavelength filter 1302, the regions 1302a to 1302c are arranged in a row, but there is no particular limitation on the arrangement. For example, the regions 1302a to 1302c can be arbitrarily arranged, for example, by arranging the regions 1302a to 1302c on the circumference and moving the wavelength filter 1302 with a rotary motor.

<Operation 1 of Camera Device>
Operation 1 of the camera device according to Embodiment 8 of the present invention will be described.

  The pixels 1301e to 1301h have sensitivity in the wavelength region of infrared light so that infrared light at night can be received. Therefore, when a filter for attenuating the infrared wavelength region is not provided in the optical path between the subject 10 and the sensor unit 1300, light in the infrared wavelength region is also incident on the pixels 1301e to 1301h. The color image is different from the actual color.

  For example, when the subject 10 has a green color, the sensor unit 1300 also receives light in the infrared wavelength region, and outputs a signal as if the subject 10 is purple. In addition, the sensor unit 1300 outputs a signal as if it is a whitish image with low overall color contrast.

  In the camera device according to the present embodiment, invisible light is emitted even when visible light such as daytime sunlight is applied to the subject. In addition, the camera device according to the present embodiment receives the invisible light reflected by the subject 10 by the sensor unit 1300 and estimates the color. Then, the camera device according to the present embodiment provides information regarding colors that are different from the colors of the actual subject 10 such as purple and white in the signal obtained by irradiating the subject 10 with visible light, Correction is performed based on color estimation information obtained by irradiating invisible light.

  By such correction, it is possible to provide a camera device capable of acquiring a vivid color image faithful to the actual color of the subject 10 without providing a filter that attenuates light in the infrared wavelength region. it can.

  As a result, in a camera device incorporated in a mobile phone or a camera device incorporated in a door phone, both a color image illuminated with visible light during the day and an image illuminated with infrared light at night etc. Can be made available. Further, the camera device at that time does not need to be provided with a filter for attenuating light in the wavelength region of infrared light, and it is not necessary to switch the filter, so that the camera device can be made small and inexpensive.

<Operation 2 of Camera Device>
Operation 2 of the camera device according to Embodiment 8 of the present invention will be described.

  The color in the color image acquired by the camera device may differ from the actual color of the subject 10 even when light in the infrared wavelength region does not enter the light receiving element 1303.

  For example, a lighting device that emits yellow light may be installed on a road or a tunnel in order to improve visibility. A person wearing white clothes photographed under the illumination of the lighting device is photographed as if wearing yellow clothes.

  In such a case, the request to correct the color of the acquired image to the color of the actual subject and the information of the color of the subject are output while leaving the color of the acquired image as it is. There is a request to want.

  In the former case, the camera device according to the present embodiment may be corrected based on color estimation information obtained by irradiating non-visible light as described above.

  In the latter case, the camera device according to the present embodiment may output information indicating color separately from the image signal, or output the information indicating color superimposed on the image signal. Accordingly, it is possible to provide a camera device that can accurately obtain the clothes color or the car color of the person desired to be identified from the image photographed by the surveillance camera and can obtain extremely effective information for criminal investigations.

(Embodiment 9)
Since the camera device according to the present embodiment has the same configuration as that of FIG. 2 except that the imaging optical unit 2000 is provided instead of the imaging optical unit 111, the description other than the imaging optical unit 2000 is omitted. In the present embodiment, the configuration other than the imaging optical unit 2000 will be described using the reference numerals of the camera device 100 shown in FIG.

<Configuration of imaging optical unit>
The configuration of the imaging optical unit 2000 according to the ninth embodiment of the present invention will be described with reference to FIG.

  The imaging optical unit 2000 includes one light receiving element 2001, a wavelength filter 2002, and a beam separation element 2003.

  The invisible light collected by the light receiving element 2001 passes through the beam separation element 2003 and the wavelength filter 2002.

<Configuration of beam separation element>
The configuration of the beam separation element 2003 according to the ninth embodiment of the present invention will be described with reference to FIG.

  The beam separation element 2003 has four regions 2003a, 2003b, 2003c, and 2003d. The regions 2003a to 2003d have a wedge shape in which the traveling direction of the incident beam is changed to a slightly different direction and emitted.

<Configuration of wavelength filter>
The configuration of the wavelength filter 2002 according to the ninth embodiment of the present invention will be described with reference to FIG.

  The wavelength filter 2002 has three regions 2002a, 2002b, and 2002c.

  The region 2002a includes four partial regions 2002e, 2002f, 2002g, and 2002h. The region 2002b is composed of four partial regions 2002i, 2002j, 2002k, and 2002l.

  The region 2002c does not have a function of limiting the wavelength of light to be transmitted, and can transmit light in a wide wavelength range with high efficiency.

  When estimating the color of a subject to be photographed using non-visible light, the position of the wavelength filter 2002 is such that light having wavelengths λ11 to λ13 transmitted through the beam separation element 2003 enters the region 2002a of the wavelength filter 2002. Set.

  The regions 2002i to 2002l of the wavelength filter 2002 have characteristics in which the transmittance varies depending on the wavelength of visible light, that is, the color. Regions 2002i to 2002l are similar to a color filter generally used in a sensor unit that acquires a color image.

  Specifically, the region 2002i transmits light in the red wavelength region with high efficiency, and greatly attenuates light in the green wavelength region and light in the blue wavelength region. Further, the region 2002j and the partial region 2002l transmit the light in the green wavelength region with high efficiency, and greatly attenuate the light in the red wavelength region and the light in the blue wavelength region. The region 2002k transmits light in the blue wavelength region with high efficiency, and greatly attenuates light in the red wavelength region and light in the green wavelength region. Each of the regions 2002i to 2002l has a characteristic of greatly attenuating light in the infrared wavelength region.

  The light transmitted through the region 2003a of the beam separation element 2003 passes through the region 2002e of the wavelength filter 2002, and the light transmitted through the region 2002b of the beam separation device 2003 enters the region 2002f of the wavelength filter 2002 through the region 2003c of the beam separation element 2003. The transmitted light is incident on the region 2002g of the wavelength filter 2002, and the light transmitted through the region 2003d of the beam separation element 2003 is incident on the region 2002h of the wavelength filter 2002.

<Function of wavelength filter>
The function of the wavelength filter 2002 according to the ninth embodiment of the present invention will be described with reference to FIG.

  When light having wavelengths λ11 to λ13 is incident on region 2002a of wavelength filter 2002, partial regions 2002e, 2002f, 2002g, and 2002h selectively transmit light having wavelengths λ11 to λ13 with high efficiency, respectively. Or has a function of greatly attenuating.

  Specifically, the partial region 2002e transmits light having the wavelength λ11 with high efficiency, and greatly attenuates light having the wavelength λ12 and light having the wavelength λ13.

  Further, the partial region 2002f and the region 2002g transmit light having the wavelength λ12 with high efficiency, and greatly attenuate light having the wavelength λ11 and light having the wavelength λ13.

  The partial region 2002h transmits light having the wavelength λ13 with high efficiency, and greatly attenuates light having the wavelength λ11 and light having the wavelength λ12.

  The partial regions 2002e to 2002h can be formed by a widely known method such as a configuration in which a plurality of thin films are stacked or a configuration in which particles in nanometer units are dispersed, and thus detailed description thereof is omitted.

  The light transmitted through the wavelength filter 2002 is incident on the sensor unit 112.

<Operation of camera device>
The operation of the camera apparatus according to Embodiment 9 of the present invention will be described with reference to FIG.

  FIG. 23 is a schematic diagram for explaining how light transmitted through the wavelength filter 2002 enters the sensor unit 112.

  The sensor unit 112 has a light receiving region including a large number of pixels 2301e.

  By drawing two orthogonal virtual lines (virtual lines) 2301f and 2301g from the center of the sensor unit 112 composed of a plurality of pixels, the light receiving area is divided into four areas 2301m, 2301n, 2301o, and 2301p.

  The light transmitted through the partial region 2002e of the wavelength filter 2002 passes through the region 2301m of the sensor unit 112, and the light transmitted through the partial region 2002f of the wavelength filter 2002 passes through the partial region 2002g of the wavelength filter 2002 through the region 2301n of the sensor unit 112. The transmitted light is incident on the region 2301o of the sensor unit 112, and the light transmitted through the partial region 2002h of the wavelength filter 2002 is incident on the region 2301p of the sensor unit 112.

  Although the camera device according to the present embodiment uses one sensor unit 112, by using the beam separation element 2003 and the wavelength filter 2002, a subject that moves quickly as in the camera device shown in the third embodiment. However, it is possible to provide a camera device that can correctly estimate colors.

  In this case, when the subject 10 is irradiated with light in the visible wavelength range from outside such as the daytime sun and night street lamps, and a color image is to be obtained, light in the visible wavelength range from the subject 10 is used. However, after passing through the imaging optical unit 2000 and the beam separation element 2003, the position of the wavelength filter 2002 is set so as to enter the region 2002b of the wavelength filter 2002.

  As a result, the light transmitted through the region 2003a of the beam separation element 2003 is transmitted to the partial region 2002i of the wavelength filter 2002, and the light transmitted through the region 2003b of the beam separation element 2003 is transmitted to the partial region 2002j of the wavelength filter 2002. The light that has passed through the region 2003c of 2003 enters the partial region 2002k of the wavelength filter 2002, and the light that has passed through the region 2003d of the beam separation element 2003 enters the partial region 2002 of the wavelength filter 2002.

  The light transmitted through the region 2002i of the wavelength filter 2002 is transmitted to the region 2301m of the sensor unit 112, and the light transmitted through the region 2002j of the wavelength filter 2002 is transmitted to the region 2301n of the sensor unit 112 through the region 2002k of the wavelength filter 2002. The light transmitted through the region 20021 of the wavelength filter 2002 enters the region 2301o of the sensor unit 112 and enters the region 2301p of the sensor unit 112, respectively.

  From the area 2301m of the sensor unit 112, image information related to the red color of the subject 10, the image information about the green color of the subject 10 from the areas 2301n and 2301p of the sensor unit 112, and from the area 2301o of the sensor unit 112 to the subject 10 The image information about the blue color of each is obtained.

  By appropriately rearranging signals corresponding to a plurality of pixels output from the sensor unit 112 by the data processing unit 113, a color image can be obtained.

  The camera device according to the present embodiment has regions 2002a and 2002b in the wavelength filter 2002, and changes which of the regions 2002a and 2002b the light transmitted through the imaging optical unit 111 enters. Thus, according to the present embodiment, in addition to the effects of the first embodiment, when the subject 10 is irradiated with light in the visible wavelength region from the outside such as the sun during the day and the streetlight at night In addition, it is possible to obtain a color image and irradiate the subject 10 with invisible light to estimate the color of the subject with a single camera device.

  When it is desired to obtain a subject image with high sensitivity without estimating the color of the subject in a dark space or the like, the light transmitted through the imaging optical unit 2000 and the beam separation element 2003 is incident on the region 2002c of the wavelength filter 2002. Next, the position of the wavelength filter 2002 is set.

  Accordingly, the region 2002c can transmit light in a wide wavelength range with high efficiency, and thus the camera device according to the present embodiment is a camera device having high sensitivity.

  In addition, the camera device according to the present embodiment obtains a color image when the subject 10 is irradiated with light in the visible wavelength region from the outside, such as the sun during the day or a streetlight at night, Irradiating the subject 10 with invisible light to estimate the color of the subject 10, and obtaining a subject image with high sensitivity without estimating the color of the subject 10 in a dark space or the like. Can be performed with a single camera device.

  Further, in the camera device according to the present embodiment, when the beam separation element 2003 and the wavelength filter 2002 are provided in the vicinity of the imaging optical unit 2000, the size of the light transmitted through the beam separation element 2003 and the wavelength filter 2002 is increased. It is big. As a result, an allowable error amount when setting the positions of the beam separation element 2003 and the wavelength filter 2002 can be increased, and the camera device can be easily configured.

  Although the case where the wavelength filter 2002 has three regions 2002a to 2002c is shown here, the three regions are not necessarily required, and the design may be arbitrarily changed.

  For example, when the irradiation unit 150 that emits a plurality of invisible lights in a time division manner is used instead of the irradiation unit that emits a plurality of invisible lights at the same time, the region 2003a is unnecessary, and the regions 2003b and 2003c are I just need it. Furthermore, if an image that receives visible light is unnecessary, the wavelength filter 2002 may not be provided.

  Further, when the region 2002c of the wavelength filter 2002 is used, the light transmitted through the imaging optical unit 111 may not be transmitted through the beam separation element 2003, that is, may be removed from the optical path.

  With this configuration, it is possible to obtain a high-quality image with higher sensitivity and less distortion.

  Further, there is no particular limitation on the means for moving the wavelength filter 2002. The arrangement of the areas is the same.

  In addition, although not shown, a mark or a mark for easily recognizing the position is partially attached to the beam separation element 2003, the wavelength filter 2002, the component holding the beam separation element 2003, or the component holding the wavelength filter 2002. A structure may be provided. By providing the mark or structure, the relative position between the beam separation element 2003 and the wavelength filter 2002 can be easily adjusted accurately.

  In addition, a structure portion is provided that allows the position to be determined by contacting the beam separation element 2003, the wavelength filter 2002, the component that holds the beam separation element 2003, or the component that holds the wavelength filter 2002 by contact or the like. May be. By providing the structure portion, the beam separation element 2003 and the wavelength filter 2002 can be adjusted to a desired position by contacting them without recognizing the relative positions of the beam separation element 2003 and the wavelength filter 2002. The relative position with respect to the wavelength filter 2002 can be easily adjusted.

  Since the relative position between the beam separation element 2003 and the wavelength filter 2002 can be adjusted with high accuracy, crosstalk of light received by the sensor unit 112 can be reduced, and color estimation can be performed with high accuracy. A color image can be obtained.

  In the camera device according to the present embodiment, the wavelength filter 2002 and the beam separation element 2003 are separately formed. However, the wavelength filter 2002 and the beam separation element 2003 may be integrally formed.

(Embodiment 10)
The camera device according to the present embodiment has the same configuration as the camera device according to the ninth embodiment except that the beam separation element 2401 is provided instead of the beam separation element 2003 and the sensor unit 2402 is provided instead of the sensor unit 112. Therefore, description other than the beam separation element 2401 and the sensor unit 2402 is omitted. In the present embodiment, the configuration other than the beam separation element 2401 and the sensor unit 2402 will be described using the reference numerals of the camera device 100 shown in FIG.

<Configuration of beam separation element and sensor section>
Configurations of the beam separation element 2401 and the sensor unit 2402 according to Embodiment 10 of the present invention will be described with reference to FIGS.

  FIG. 25A schematically shows the pixels on the sensor unit 2402. The light transmitted through one microlens 2401a passes through the four microlenses 2401a included in the sensor unit 2402, and then enters four pixels 2402e. A group of four pixels is defined as a pixel group 2402f.

  FIG. 25B schematically shows an enlarged view of one of the pixel groups 2402f. The pixel group 2402f is composed of four pixels 2402e. In order to facilitate understanding of the present invention, the pixel group 2402f is divided into pixels 2402i, 2402j, 2402k, and 2401l.

  The invisible light emitted from the irradiation unit 150 is irradiated onto the subject 10, and the light reflected by the subject 10 is collected on the sensor unit 2402.

  A wavelength filter 2002 and a beam separation element 2401 are provided in an optical path between an imaging optical unit (not shown) and the sensor unit 2402, and the invisible light condensed by the imaging optical unit is reflected by the wavelength filter 2002 and the beam separation element. 2401 is transmitted.

  The beam separation element 2401 is disposed in the vicinity of the sensor unit 2402. The beam separation element 2401 has a kind of fly-eye lens in which a plurality of microlenses 2401a are arranged two-dimensionally. The interval between adjacent microlenses 2401a is pt1. The microlens 2401a included in the beam separation element 2401 receives and collects the light transmitted through the wavelength filter 2002.

  The sensor unit 2402 has a large number of pixels 2402e. The sensor unit 2402 enables imaging of a two-dimensional region by arranging the pixels 2402e in two dimensions.

  The sensor unit 2402 further includes a plurality of microlenses 2402a. One micro lens 2402a is arranged so as to correspond to one pixel 2402e. The interval between adjacent microlenses 2402a is pt2. Light transmitted through one microlens 2401a included in the beam separation element 2401 is incident on the four microlenses 2402a included in the sensor unit 2402.

  Further, the interval pt1 between the microlenses 2401a included in the beam separation element 2401 is set to twice the interval pt2 between the microlenses 2402a included in the sensor unit 2402.

<Operation of camera device>
The operation of the camera apparatus according to Embodiment 10 of the present invention will be described with reference to FIGS.

  The light condensed by the microlens 2401a included in the beam separation element 2401 enters the microlens 2402a included in the sensor unit 2402, and the microlens 2402a condenses the incident light on the pixel 2402e.

  Since light transmitted through one microlens 2401a included in the beam separation element 2401 is incident on the four microlenses 2402a included in the sensor unit 2402, the partial regions 2002e˜ Light transmitted through 2002h or 2002i to 2002l is received by different pixels 2402e of the sensor unit 2402.

  That is, light transmitted through the partial regions 2002e to 2002h or 2002i to 2002l of the wavelength filter 2002 can be separated and received by the pixel 2402e of the sensor unit 2402.

  Light transmitted through a partial region 2002e or 2002i or a quarter of the region 2002c located in the four quadrants of the wavelength filter 2002 is received by the pixel 2402i.

  Further, light transmitted through a partial region 2002f or 2002j located in the four quadrants of the wavelength filter 2002 or a quarter of the region 2002c is received by the pixel 2402j.

  In addition, light transmitted through a partial region 2002g or 2002k or a quarter of the region 2002c located in the four quadrants of the wavelength filter 2002 is received by the pixel 2402j.

  Further, light transmitted through a partial region 2002h or 2002l or a quarter of the region 2002c located in the four quadrants of the wavelength filter 2002 is received by the pixel 2402l.

  The light condensed on the sensor unit 2402 is received by a light receiving element (not shown) and then converted into an electric signal. The electrical signal converted by the sensor unit 2402 is input to the data processing unit 113 as image data. The data processing unit 113 receives the image data, performs desired signal processing, and outputs the result.

  In the camera device according to the present embodiment, in addition to the effects of the first embodiment, similar to the camera device shown in the ninth embodiment, visible light from the outside such as the sun during the day and street lamps during the night is the subject 10. A single camera that obtains a color image, irradiates the subject with invisible light, estimates the color of the subject, and performs monochrome photography with high sensitivity. Can be done with the device.

(Embodiment 11)
The camera device according to the present embodiment has the same configuration as the camera device according to the ninth embodiment except that the beam separation element 2601 is provided instead of the beam separation element 2003 and the sensor unit 2602 is provided instead of the sensor unit 112. Therefore, description other than the beam separation element 2601 and the sensor unit 2602 is omitted. In the present embodiment, the components other than the beam separation element 2601 and the sensor unit 2602 will be described using the reference numerals of the camera device 100 shown in FIG.

<Configuration of beam separation element and sensor section>
Configurations of the beam separation element 2601 and the sensor unit 2602 according to Embodiment 11 of the present invention will be described with reference to FIG.

  Similar to the sensor unit 2402, the sensor unit 2602 includes a plurality of pixels 2602e. However, unlike the sensor unit 2402, the sensor unit 2602 is not formed with a microlens.

  Similar to the beam separation element 2401, the beam separation element 2601 has a plurality of microlenses 2601a and a plurality of microlenses 2601b.

  The function of the micro lens 2601a is the same as that of the micro lens 2402a. The function of the micro lens 2601b is the same as that of the micro lens 2401a.

  In the camera device according to the present embodiment, in addition to the effects of the first embodiment, as in the camera device according to the tenth embodiment, visible light is emitted from the outside such as the sun during the day and street lamps at night. To obtain a color image, to irradiate the subject 10 with invisible light, to estimate the color of the subject 10, and to perform monochrome photography with high sensitivity, This can be done with one camera device.

  In the camera device according to this embodiment, the microlens 2601a and the microlens 2601b included in the beam separation element 2601 can be formed at the same time by molding resin, glass, or the like. An inexpensive camera device can be provided.

  Although not shown, a mark or a part for easily recognizing the position of the beam separation element 2601, the sensor unit 2602, a component that holds the beam separation element 2601, or a component that holds the sensor unit 2602, A structure may be provided. By providing the mark or structure, the relative position between the beam separation element 2601 and the sensor unit 2602 can be easily adjusted accurately.

  In addition, a structure portion is provided that allows the position to be determined by contacting the beam separating element 2601, the sensor portion 2602, the component that holds the beam separating element 2601, or the component that holds the sensor portion 2602, such as by contact. May be. By providing the structure portion, the beam separation element 2601 and the sensor portion 2602 can be adjusted to a desired position by being brought into contact without recognizing the relative position. The relative position with respect to the sensor unit 2602 can be easily adjusted.

  Since the relative position between the beam separation element 2601 and the sensor unit 2602 can be adjusted with high accuracy, crosstalk of light received by the sensor unit 2602 can be reduced, and color estimation can be performed with high accuracy. A color image can be obtained.

  The camera device and the imaging method according to the present invention are suitable for imaging a subject by irradiating the subject with invisible light.

DESCRIPTION OF SYMBOLS 10 Subject 100 Camera apparatus 101 Control part 102 1st light emission part 103 2nd light emission part 104 3rd light emission part 105 Illumination optical part 111 Imaging optical part 112 Sensor part 113 Data processing part 114 Motion detection part 115 Color estimation part 116 Storage unit 150 Irradiation unit 160 Imaging unit 200 Monitor

Claims (10)

A camera device that irradiates a subject with invisible light and images the subject,
An irradiation unit that performs a first operation of irradiating the subject with invisible light having a plurality of different wavelengths and a second operation that consumes less power than the first operation;
An imaging unit that images the subject irradiated by the irradiation unit;
A control unit that causes the irradiation unit to perform the second operation when it is detected that the subject is stationary based on image data of the subject imaged by the imaging unit;
A camera device.   The camera apparatus according to claim 1, further comprising: a display processing unit that displays the subject using past image data captured by the imaging unit when the control unit detects that the subject is stationary. . The controller is
As the second operation, the subject is irradiated with invisible light having a part of the plurality of different wavelengths with respect to the irradiation unit,
The camera device according to claim 1. The controller is
Irradiating the subject with invisible light of the partial wavelengths selected in order from a wavelength with a high light reflectance in the subject to the irradiation unit;
The camera device according to claim 3. The irradiation unit is
A plurality of emitting portions for emitting the plurality of different wavelengths of invisible light;
The controller is
Injecting invisible light of the part of the wavelength from the part of the emitting part selected in order from the emitting part having a long lifetime among the plurality of emitting parts,
The camera device according to claim 3. The irradiation unit is
A plurality of emitting portions for emitting the plurality of different wavelengths of invisible light;
The controller is
Emitting invisible light of the part of the wavelength from the part of the emitting part selected in order from the emitting part having a high luminous efficiency among the plurality of emitting parts,
The camera device according to claim 3. The irradiation unit is
A plurality of emitting portions for emitting the plurality of different wavelengths of invisible light;
The controller is
As the second operation, the emission intensity of the invisible light emitted to the emission unit is made smaller than the emission intensity in the first operation, and the change of the emission intensity with respect to time is emitted in the first operation. Make the intensity longer than the change over time,
The camera device according to claim 1. The irradiation unit is
A plurality of emitting portions for emitting the plurality of different wavelengths of invisible light;
The controller is
As the second operation, an ultra-short pulse of invisible light is emitted to the emission unit.
The camera device according to claim 1. The controller is
In addition to the case where it is detected that the subject is stationary, the irradiation unit is caused to perform the second operation when detecting whether or not the subject is stationary.
The camera device according to claim 1. An imaging method in a camera device that images a subject by irradiating the subject with invisible light,
Performing a first operation of irradiating invisible light having a plurality of different wavelengths and a second operation that consumes less power than the first operation;
Imaging the irradiated subject;
Performing the second operation when it is detected that the subject is stationary based on the image data of the captured subject;
An imaging method comprising:

Images