JP2010074213A - Imaging apparatus and signal processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of obtaining characteristics close to ideal spectral characteristics for which the characteristics of a desired color reproduction system are taken into consideration, and a signal processing method in the imaging apparatus. <P>SOLUTION: A coefficient computing part 63 obtains the general spectral characteristics of the entire imaging system on the basis of respective color signals outputted from a plurality of imaging elements 4R, 4G and 4B when an object for color adjustment to be a reference is imaged. The coefficient computing part 63 obtains the deviation of the spectral characteristics between the general spectral characteristics and the desired ideal characteristics of a reproduction system, and obtains a matrix coefficient for bringing the general spectral characteristics close to the ideal characteristics of the reproduction system as a color characteristic conversion coefficient on the basis of the deviation of the characteristics. The color characteristic conversion coefficient is stored in a coefficient storage part 61. In a signal processing part 62, the operation of multiplying the color characteristic conversion coefficient stored in the coefficient storage part 61 to the respective color signals outputted from the imaging elements 4R, 4G and 4B is performed and they are outputted as video signals Vout. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus that performs signal processing for multiplying a plurality of color signals output from a plurality of imaging elements by a matrix coefficient for color characteristic conversion in order to reproduce desired spectral characteristics, and a signal in the imaging apparatus It relates to the processing method.

  In general, an imaging apparatus such as a television camera or a video camera is provided with a color separation optical system. FIG. 15 shows a configuration example of a conventional color separation optical system. The color separation optical system 101 separates incident light L incident through the photographing lens 102 into three color light components of blue light LB, red light LR, and green light LG. Image pickup devices 4B, 4R, and 4G for each color light such as a CCD (Charge Coupled Device) are arranged at positions corresponding to the respective color lights separated by the color separation optical system 101. The color separation optical system 101 is called a Philips type color separation optical system, and the first prism 110, the second prism 120, and the third prism 130 are sequentially arranged from the light incident side along the optical axis Z1. The first prism 110 extracts blue light LB, the second prism 120 extracts red light LR, and the third prism 130 extracts green light LG.

  A blue light reflecting dichroic film DB1 is formed on the reflection / transmission surface 111 of the first prism 110. On the reflection / transmission surface 121 of the second prism 120, a red light reflection dichroic film DR1 is formed. In the first prism 110 and the second prism 120, the surface 111 of the first prism 110 on which the blue light reflecting dichroic film DB1 is formed and the light incident surface of the second prism 120 are separated from each other by an air gap 110AG. It arrange | positions so that it may mutually oppose. A trimming filter 151 is provided on the light exit surface of the first prism 110. A dichroic film 151 </ b> A is formed on the light exit surface of the trimming filter 151. Similarly, a trimming filter 152 formed with a dichroic film 152A is provided on the light exit surface of the second prism 120, and a trimming filter 153 formed with a dichroic film 153A is formed on the light exit surface of the third prism 130. Is provided. The trimming filters 151, 152, and 153 are provided to bring the spectral characteristics closer to the ideal characteristics, and spectral components of wavelength components that cannot be sufficiently shaped by the blue light reflecting dichroic film DB1 and the red light reflecting dichroic film DR1. Has the role of adjusting characteristics.

  FIG. 17 shows spectral characteristics that are generally ideal in a color imaging system for three colors of a red (R) component, a blue (B) component, and a green (G) component. Note that the ideal characteristics in FIG. 17 are normalized so that the maximum value of each color light component is 1, and the vertical axis indicates the transmittance intensity. This “ideal characteristic” is a characteristic that takes into account the spectral characteristics of the color reproduction system. Here, the “spectral characteristic of the color reproduction system” is a characteristic that takes into account the spectral characteristic of the desired color reproduction medium. For example, it is converted from the chromaticity coordinates of the three primary colors of the color reproduction medium, and the color matching functions x (λ), y (λ), XYZ color system (XYZ color system introduced by the International Lighting Commission in 1931), It can be obtained by a primary transformation of z (λ). Here, the “color reproduction medium” reproduces (displays) an image taken by the imaging device, and is a display device such as a liquid crystal monitor or a projector. FIG. 16 shows an example of chromaticity coordinates of the three primary colors R, G, and B for obtaining ideal characteristics. The three primary colors R, G, and B determine the color range that can be reproduced by the color reproduction medium.

  If the same characteristic as the ideal characteristic shown in FIG. 17 is obtained using the color separation optical system 101 shown in FIG. 15, ideal color reproduction can be performed. However, in practice, it is difficult to achieve the same characteristic as the ideal characteristic, and the design is such that the characteristic approximates the ideal characteristic. In the conventional color separation optical system 101, ideal characteristics are obtained by appropriately adjusting the dichroic films DB1 and DR1 formed on each prism and the dichroic films 151A, 152A, and 153A formed on the trimming filters 151, 152, and 153. It was designed to have approximate characteristics. FIG. 18 shows spectral transmission characteristics of a conventional general color separation optical system obtained by performing such a design.

  FIG. 19 shows a design example of the dichroic films DB1 and DR1 used in the conventional color separation optical system 101. As shown in FIG. 19, conventionally, as the dichroic films DB1 and DR1, the characteristic curve of the wavelength vs. transmittance shows a sharp rise or fall compared to the ideal characteristic curve shown in FIG. Something with was used. Further, unnecessary wavelength components of light emitted from the exit surface of each prism are blocked using trimming filters 151, 152, 153 provided with dichroic films 151A, 152A, 153A.

Patent Document 1 includes a photoelectric sensor having a spectral response approximate to a color matching function and a correction sensor that maximizes the spectral response near the transmission limit wavelength of the color matching function. An invention of a color measuring device is disclosed in which a reduction in accuracy of chromaticity measurement due to a deviation between the spectral response of the photoelectric sensor and the color matching function is prevented by adding an appropriate coefficient to the output value of .
JP-A-9-49765

By the way, in the ideal characteristic shown in FIG. 17, there is a region where the negative spectral sensitivity is obtained, and in particular, there are many regions (region 100 in FIG. 17) where the red spectral property is negative. This negative region is theoretically obtained, and it is impossible to directly reproduce this negative portion with an actual optical system. In the conventional color separation optical system, the negative region cannot be reproduced as shown in FIG. On the other hand, it is conceivable that negative characteristics that cannot be directly reproduced by the optical system are reproduced by calculation of signal processing on the imaging apparatus side. For example, with respect to the ideal characteristics shown in FIG. 17, a reversible conversion characteristic that eliminates the negative region is obtained, and the conversion characteristic is set as an ideal characteristic that is reproduced by the color separation optical system. The output from the color separation optical system is inversely transformed by signal processing on the imaging device side to theoretically reproduce the negative region and simulate the original ideal characteristics. Can do.
More specifically, it is possible to perform pseudo-reproduction by multiplying the signal value of each color output from the image pickup device of each color by a color characteristic conversion coefficient called a matrix coefficient to reproduce ideal characteristics. .

  If the entire color imaging system including the color separation optical system is ideally designed and manufactured, the desired ideal characteristics can be theoretically reproduced by the method described above. However, since there are actually manufacturing errors and design errors, it is difficult to manufacture the entire imaging system with ideal characteristics. In addition, the spectral characteristics at the time of actual shooting also affect the spectral characteristics of the light source. However, in the shooting scene, a light source different from the light source assumed at the time of design may be used, and the ideal characteristics cannot be reproduced depending on the shooting environment. There is a case. For this reason, in an actually manufactured imaging apparatus, it is difficult to completely reproduce ideal characteristics even if inverse conversion is performed on the signal values of each color by the above-described method. This is because the conversion coefficients (matrix coefficients) used for the inverse conversion are determined on the assumption that the imaging system is ideally designed. In order to reproduce an ideal characteristic by the above-described method in an actually manufactured imaging apparatus, it is necessary to make a conversion coefficient used for inverse conversion take into account a manufacturing error, a design error, and the like. In this case, in particular, in the color imaging system, it is the spectral characteristic of the color separation prism that greatly affects the spectral characteristic. For this reason, it is particularly important to consider manufacturing errors and design errors of the color separation prism.

  In an imaging apparatus such as a TV camera or a video camera, it is necessary to reproduce the reproduction system ideal characteristic as shown in FIG. 17 in consideration of the reproduction system characteristic as described above. When this ideal characteristic is reproduced by the above-described method, it is preferable to use a conversion coefficient corresponding to a desired reproduction system characteristic. On the other hand, in the color measuring device described in Patent Document 1, a correction sensor is provided, and the output value of the photoelectric sensor and the correction sensor is multiplied by an appropriate coefficient to add the spectral response of the photoelectric sensor and the color matching function. The deviation is minimized and ideal chromaticity measurement can be performed. That is, the technique described in Patent Document 1 is an invention for realizing the characteristic of the color matching function itself, and does not attempt to realize the characteristic in consideration of the reproduction system.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an imaging apparatus capable of obtaining characteristics close to ideal spectral characteristics in consideration of characteristics of a desired color reproduction system, and imaging thereof It is to provide a signal processing method in an apparatus.

  The image pickup apparatus of the present invention optically converts a conversion ideal characteristic obtained by performing a reversible conversion to reduce a negative spectral range with respect to a reproduction system ideal characteristic in which a spectral characteristic of a desired color reproduction system is added. An image pickup optical system including a color separation prism for reproduction, a plurality of image pickup elements provided corresponding to the plurality of color lights separated by the color separation prism and outputting color signals corresponding to the incident color lights; Based on color signals output from a plurality of image sensors when a reference color adjustment subject is imaged, a total spectral characteristic of the entire imaging system including the imaging optical system and the plurality of image sensors is obtained. The first calculation means, the second calculation means for obtaining the spectral characteristic deviation between the total spectral characteristic and the reproduction system ideal characteristic or the conversion ideal characteristic, and the spectral characteristic deviation are reduced to reproduce the total spectral characteristic. Mat that approaches the ideal characteristics of the system A third computing means for obtaining a color characteristic conversion coefficient as a color characteristic conversion coefficient, a coefficient storage unit for storing data indicating the obtained color characteristic conversion coefficient, and a plurality of color signals output from a plurality of image sensors, And a signal processing unit that performs an operation of multiplying the color characteristic conversion coefficient stored in the coefficient storage unit.

  In the imaging apparatus according to the present invention, based on the color signals output from the plurality of imaging elements when the reference color adjustment subject is imaged, the entire imaging system including the imaging optical system and the plurality of imaging elements is integrated. Spectral characteristics are required, and a shift in spectral characteristics between the total spectral characteristics and the reproduction system ideal characteristics or conversion ideal characteristics is required. A matrix coefficient that reduces the deviation of the spectral characteristic and brings the total spectral characteristic close to the reproduction system ideal characteristic is obtained as a color characteristic conversion coefficient and stored in the coefficient storage unit. The signal processing unit performs an operation of multiplying a plurality of color signals output from the plurality of image sensors by a color characteristic conversion coefficient stored in the coefficient storage unit. This corrects the design error and manufacturing error of the entire imaging system including the color separation prism, which has a large influence on the spectral characteristics, and is close to an ideal spectral characteristic that takes into account the characteristics of the desired color reproduction system as a video signal. Characteristics are obtained.

  The imaging apparatus of the present invention further includes a switching control unit that switches the operation mode between the color adjustment mode and the normal photographing mode, and when the switching control unit switches to the color adjustment mode, the first computing unit, When the switching control unit switches to the normal photographing mode, the signal processing unit includes a plurality of signal processing units. Signal processing for multiplying a plurality of color signals output from the image pickup device by the color characteristic conversion coefficient stored in the coefficient storage unit may be performed.

  In the imaging device of the present invention, the color separation prism, for example, decomposes incident light into at least three color light components of blue light, red light, and green light, and the first is sequentially from the light incident side. A first prism that extracts the first color light component reflected by the first dichroic film, and a second dichroic film that passes through the first dichroic film and passes through the second dichroic film. Use at least a second prism for extracting the second color light component reflected by the film, and a third prism for extracting the third color light component transmitted through the first and second dichroic films. Can do. In this case, it is preferable that the first and second dichroic films are designed so that the slope of the characteristic curve indicating the spectral characteristics is in accordance with the slope of the characteristic curve indicating the conversion ideal characteristics.

More specifically, for example, in the color separation prism, the first dichroic film is configured to reflect blue light as the first color light component, and the second dichroic film is used as the second color light component. In the wavelength range of 430 nm or more and 670 nm or less, the slope of the transmission characteristic curve is a film configuration that reflects red light, and shows the transmittance with respect to the wavelength of the first dichroic film. It is preferably designed to have a shape in which the average slope value changing from 20% to 80% in the range is 0.2 (% / nm) to 2.0 (% / nm). Further, the slope of the transmission characteristic curve indicating the transmittance with respect to the wavelength of the second dichroic film is changed from 80% to 20% of the range between the maximum transmittance and the minimum transmittance within the wavelength range of 430 nm to 670 nm. It is preferable that the average slope value to be changed is designed to have a shape of −2.0 (% / nm) or more and −0.2 (% / nm) or less.
By using a color separation prism that is designed to have an inclination corresponding to the inclination of the characteristic curve indicating such conversion ideal characteristics, the overall imaging system when the color separation prism is incorporated into an imaging device is used. It becomes easy to approximate the spectral characteristics to the ideal conversion characteristics. Further, by combining with the obtained color characteristic conversion coefficient, it becomes easy to obtain a characteristic close to an ideal spectral characteristic in consideration of a desired color reproduction system characteristic.

  The signal processing method of the present invention optically converts a conversion ideal characteristic obtained by performing a reversible conversion so as to reduce a negative spectral region with respect to a reproduction system ideal characteristic in which a spectral characteristic of a desired color reproduction system is added. An image pickup optical system including a color separation prism used for reproduction, and a plurality of color lights provided corresponding to a plurality of color lights separated by the color separation prism and outputting color signals corresponding to each incident color light A signal processing method in an imaging apparatus, comprising: an imaging device; and a signal processing unit that performs a calculation of multiplying a plurality of color signals output from the plurality of imaging devices by a color characteristic conversion coefficient stored in a coefficient storage unit. The overall spectral characteristics of the entire imaging system including the imaging optical system and the plurality of imaging elements based on the color signals output from the plurality of imaging elements when the reference color adjustment subject is imaged. As the first computing means The step of obtaining the spectral characteristic deviation between the total spectral characteristic and the reproduction system ideal characteristic or the conversion ideal characteristic by the second computing means, and reducing the spectral characteristic deviation, A step of obtaining a matrix coefficient that approximates the reproduction system ideal characteristic as a color characteristic conversion coefficient by the third computing means; a step of storing data indicating the obtained color characteristic conversion coefficient in the coefficient storage unit; and a plurality of imaging elements And a step of multiplying the plurality of color signals output from the color characteristic conversion coefficient stored in the coefficient storage unit.

In the signal processing method of the present invention, the entire image pickup system including the image pickup optical system and the plurality of image pickup elements is based on the color signals output from the plurality of image pickup elements when the reference color adjustment subject is picked up. A total spectral characteristic is required, and a shift in spectral characteristic between the total spectral characteristic and the reproduction system ideal characteristic or conversion ideal characteristic is required. A matrix coefficient that reduces the deviation of the spectral characteristic and brings the total spectral characteristic close to the reproduction system ideal characteristic is obtained as a color characteristic conversion coefficient and stored in the coefficient storage unit.
The color characteristic conversion coefficient determined in this way and stored in the coefficient storage unit is used in the signal processing unit on the imaging apparatus side, thereby designing the entire imaging system including the color separation prism that has a large influence on the spectral characteristics. The error and the manufacturing error are corrected, and a characteristic close to an ideal spectral characteristic including a desired color reproduction characteristic is obtained as a video signal.

  The signal processing method of the present invention further includes a step of switching the operation mode in the imaging apparatus between the color adjustment mode and the normal photographing mode by the switching control unit, and the first mode when the switching control unit switches to the color adjustment mode. The calculation means, the second calculation means, and the third calculation means may be used to obtain the color characteristic conversion coefficient and store it in the coefficient storage unit.

  Here, in the imaging apparatus and the signal processing method of the present invention, the “spectral characteristics of the color reproduction system” is a characteristic that takes into account the spectral characteristics of a desired color reproduction medium. The “color reproduction medium” reproduces (displays) an image taken by an imaging device, and is a display device such as a liquid crystal monitor or a projector. “Reproduction system ideal characteristics” are, for example, converted from the chromaticity coordinates of the three primary colors of the desired color reproduction medium, and the same color of the XYZ color system (XYZ color system introduced by the International Lighting Commission in 1931) This is a characteristic having a spectral region having a negative value, which is indicated by the linear transformation of the function.

  According to the image pickup apparatus of the present invention, the entire image pickup system including the image pickup optical system and the plurality of image pickup elements based on the color signals output from the plurality of image pickup elements when the reference color adjustment subject is picked up. Find the total spectral characteristics, and color the matrix coefficient so that the total spectral characteristics are close to the ideal reproduction characteristics based on the difference between the total spectral characteristics and the ideal characteristics of the reproduction system or conversion ideal characteristics. Since it is calculated as a characteristic conversion coefficient and stored in the coefficient storage unit, the signal processing unit multiplies the color signal by the color characteristic conversion coefficient stored in the coefficient storage unit. It is possible to correct the design error and manufacturing error of the entire imaging system including the color separation prism that has an effect, and to obtain a characteristic close to the ideal spectral characteristic with the desired color reproduction system characteristic added to the color imaging system. But Kill.

  According to the signal processing method of the present invention, the entire imaging system including the imaging optical system and the plurality of imaging elements based on the color signals output from the plurality of imaging elements when the reference color adjustment subject is imaged. The matrix coefficient is calculated so that the total spectral characteristic approaches the ideal reproduction system characteristic based on the difference between the total spectral characteristic and the ideal characteristic of the reproduction system or conversion ideal characteristic. Since it is obtained as a color characteristic conversion coefficient and stored in the coefficient storage unit, the color characteristic conversion coefficient stored in the coefficient storage unit is used in the signal processing unit on the imaging device side, which greatly affects the spectral characteristics. It is possible to correct design errors and manufacturing errors of the entire imaging system including the given color separation prism, and to obtain characteristics close to ideal spectral characteristics that take into account the characteristics of the desired color reproduction system in the color imaging system. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[First Embodiment]

  FIG. 1 shows a main configuration of an imaging apparatus including a color separation optical system 1 according to the first embodiment of the present invention. This imaging apparatus can be used for, for example, a television camera or a video camera. This image pickup apparatus is provided in an image pickup optical system, a plurality of image pickup elements 4B, 4R, 4G that output color signals corresponding to each color light incident through the image pickup optical system, and a plurality of image pickup apparatus main bodies 60. And an imaging system signal circuit that processes color signals from the imaging elements 4B, 4R, and 4G and outputs the processed signals as video signals Vout. The imaging apparatus also includes an operation unit 65 for the user to instruct an operation mode and the like. The imaging optical system includes a color separation optical system 1 and a photographing lens 2.

The imaging system signal circuit includes a coefficient storage unit 61, a signal processing unit 62, a coefficient calculation unit 63, and a control unit 64. The coefficient storage unit 61 is configured by a nonvolatile semiconductor memory or the like. The signal processing unit 62 has, for example, an MPU (microprocessor unit) for image processing. The control unit 64 has a CPU (Central Processing Unit). The control unit 64 performs operation control of each circuit such as switching control of two operation modes to be described later according to an instruction from the operation unit 65.
In the present embodiment, the control unit 64 corresponds to a specific example of a “switching control unit” in the present invention. The coefficient calculator 63 corresponds to a specific example of “first calculator”, “second calculator”, and “third calculator” in the present invention.

  The color separation optical system 1 separates the incident light L incident through the photographing lens 2 into three color light components of blue light LB, red light LR, and green light LG. Image pickup elements 4B, 4R, and 4G for each color light such as a CCD are arranged at positions corresponding to the respective color lights separated by the color separation optical system 1.

  The color separation optical system 1 is called a Philips type color separation optical system, and sequentially from the light incident side along the optical axis Z1, an IR (infrared) cut filter 3, a first prism 10, and a second prism. And a color separation prism composed of the prism 20 and the third prism 30. The color separation optical system 1 in this embodiment is a configuration example in which the first prism 10 extracts blue light LB, the second prism 20 extracts red light LR, and the third prism 30 extracts green light LG.

  The first prism 10 has a first surface 11, a second surface 12, and a third surface 13. The third surface 13 of the first prism 10 is a light exit surface. A trimming filter 51 is provided on the exit surface. The trimming filter 51 is not provided with a dichroic film for characteristic adjustment which has been conventionally used. Instead, an antireflection film 51AR for preventing ghost and flare is provided on the light emission surface of the trimming filter 51. Is formed. Note that the antireflection film 51AR may be formed directly on the third surface 13 of the first prism 10 without providing the trimming filter 51.

  A blue light reflecting dichroic film DB as a first dichroic film is formed on the second surface 12 of the first prism 10. The blue light reflecting dichroic film DB has a film configuration that reflects the blue light LB as the first color light component and transmits the red light LR and the green light LG. As will be described later, the blue light reflecting dichroic film DB is designed with film characteristics corresponding to a predetermined predetermined spectral characteristic.

  The second prism 20 has a first surface 21, a second surface 22, and a third surface 23. The second prism 20 is disposed with a predetermined air interval 10AG with respect to the first prism 10. More specifically, the first surface 21 of the second prism 20 and the second surface 12 of the first prism 10 are arranged to face each other with an air gap 10AG so as to be substantially parallel. The third surface 23 of the second prism 20 is a light exit surface. A trimming filter 52 is provided on the exit surface. Similar to the trimming filter 51 in the first prism 10, the trimming filter 52 is not provided with a dichroic film for characteristic adjustment. Instead, the trimming filter 52 has a light exit surface for preventing ghost and flare. An antireflection film 52AR is formed. Note that the antireflection film 52AR may be formed directly on the third surface 23 of the second prism 20 without providing the trimming filter 52.

  A red light reflecting dichroic film DR as a second dichroic film is formed on the second surface 22 of the second prism 20. The red light reflecting dichroic film DR has a film configuration that reflects the red light LR as the second color light component and transmits the green light LG. As will be described later, the red light reflecting dichroic film DR is designed with film characteristics corresponding to a predetermined spectral characteristic of interest.

  The third prism 30 has a first surface 31 and a second surface 32. The third prism 30 is bonded to the second prism 20 via the red light reflecting dichroic film DR. More specifically, the second surface 22 of the second prism 20 and the first surface 31 of the third prism 30 are joined via the red light reflecting dichroic film DR. The second surface 32 of the third prism 30 is a light exit surface. A trimming filter 53 is provided on the exit surface. Similar to the trimming filter 51 in the first prism 10, the trimming filter 53 is not provided with a dichroic film for characteristic adjustment. Instead, the trimming filter 53 has a light exit surface for preventing ghost and flare. An antireflection film 53AR is formed. Note that the antireflection film 53AR may be formed directly on the second surface 32 of the third prism 30 without providing the trimming filter 53.

  The IR cut filter 3 is disposed on the front side of the first prism 10. The IR cut filter 3 is preferably composed of an absorptive filter having characteristics approximating to visual sensitivity in order to easily obtain characteristics close to ideal spectral characteristics. The “absorptive filter having characteristics approximating the visibility” referred to here is called a “visibility correction filter” and is a transmission that approximates the sensitivity characteristics of the human eye and attenuates from the green to the red wavelength. This is an absorptive filter that has a low transmittance and a low transmittance even in the infrared region. Note that the IR cut filter 3 may be disposed not on the front side of the first prism 10 but on the light exit surface side of a prism (second prism 20 in FIG. 1) that extracts red light. Further, the IR cut filter 3 may be disposed on both the front side of the first prism 10 and the light exit surface side of the prism that extracts red light. Further, when infrared light cannot be sufficiently removed only by the absorption filter, a coat type infrared cut filter that cuts infrared light may be further provided. FIG. 1 shows a configuration example in which a flat absorption filter is coated with a film 3R that cuts infrared light. However, in the case where the IR cut filter 3 is arranged on the light exit surface side of the prism that extracts red light, it is preferable that the IR cut coat is not applied and only the absorption filter is used. In that case, it is more preferable that the absorption filter is provided with an antireflection film.

  Although not shown, the color separation optical system 1 may further include an absorption type or coat type ultraviolet cut filter that is disposed in front of the first prism 10 and cuts ultraviolet light.

  Here, the reproduction system ideal characteristic which is to be optically reproduced by the imaging optical system in the present embodiment will be described.

  In the present embodiment, the characteristic that is finally desired to be reproduced as the output of the imaging apparatus is a reproduction system ideal characteristic as shown in FIG. This is substantially the same as the characteristics shown in FIG. This reproduction system ideal characteristic is converted from, for example, the chromaticity coordinates of the three primary colors of the desired color reproduction medium, and is subjected to the primary conversion of the color matching functions x (λ), y (λ), z (λ) of the XYZ color system. Are expressed by the functions r (λ), g (λ), and b (λ). The functions r (λ), g (λ), and b (λ) representing the reproduction system ideal characteristics may be the color matching functions themselves of the RGB color system. The functions r (λ), g (λ), b (λ) representing the reproduction system ideal characteristics may also take into account human visual characteristics. Such a reproduction system ideal characteristic has a region having negative spectral sensitivity, but the region having negative spectral sensitivity cannot be optically directly reproduced by the imaging optical system. Therefore, in the present embodiment, a reversible conversion characteristic that eliminates the negative region is obtained in advance with respect to the reproduction system ideal characteristic shown in FIG. Conversion ideal characteristics (target predetermined spectral characteristics) that are optically reproduced by the system. Then, the signal processing unit 62 performs an inverse conversion operation on the color signals (signal values Rs, Gs, Bs) output from the image pickup devices 4B, 4R, 4G via the image pickup optical system. The negative region is reproduced, and the original ideal characteristic (reproduction system ideal characteristic) is reproduced in a pseudo manner.

FIG. 2B eliminates the negative region described above with respect to the reproduction system ideal characteristics of each color represented by the functions r (λ), g (λ), and b (λ) shown in FIG. An example of transformation ideal characteristic functions r ′ (λ), g ′ (λ), and b ′ (λ) subjected to such reversible transformation is shown. Such conversion can be performed by the calculation of primary conversion as shown in the following equation (1) of [Equation 1]. M is a matrix that minimizes negative values as much as possible in the functions r ′ (λ), g ′ (λ), and b ′ (λ) representing the conversion ideal characteristics. Here, if the imaging optical system is ideally designed and manufactured, functions r ′ (λ), g ′ (λ), b ′ ( λ) is multiplied by the inverse matrix M ⁻¹ and inversely transformed to theoretically reproduce the desired functions r (λ), g (λ), and b (λ) of the original reproduction system ideal characteristics. be able to.

  In the present embodiment, in particular, the film characteristics of the blue light reflecting dichroic film DB and the red light reflecting dichroic film DR are expressed by the functions r ′ (λ), g ′ (λ), and b ′ (λ). The design is intended to reproduce the ideal conversion characteristics, and the imaging optical system has characteristics that approximate the ideal conversion characteristics represented by the functions r ′ (λ), g ′ (λ), and b ′ (λ) as much as possible. I try to get it. Here, the conversion ideal characteristics represented by the functions r ′ (λ), g ′ (λ), and b ′ (λ) are such that the negative values are as small as possible. It can be directly reproduced optically by the imaging optical system.

  FIG. 3A shows an example of a transmission characteristic curve of the blue light reflecting dichroic film DB in the present embodiment. The blue light reflecting dichroic film DB has an ideal green spectral characteristic in which the slope of the transmission characteristic curve indicating the transmittance with respect to the wavelength is represented by the ideal green spectral characteristic (the above-described linearly converted function g ′ (λ)). ) Along the characteristic curve on the short wavelength side. Specifically, the blue light reflecting dichroic film DB has a low transmittance within a wavelength range of 430 nm or more and 670 nm or less in which the slope of the transmission characteristic curve follows the characteristic curve on the short wavelength side of the ideal green spectral characteristic. It is configured to have a shape that changes from a high rate to a high transmittance. More specifically, the average slope value at which the transmission characteristic curve changes from 20% to 80% of the range between the lowest transmittance and the highest transmittance within a wavelength range of 430 nm to 670 nm is 0.2%. It is preferable to have a shape of (% / nm) or more and 2.0 (% / nm) or less.

  FIG. 3B shows an example of a transmission characteristic curve of the red light reflecting dichroic film DR in the present embodiment. The red light reflecting dichroic film DR has an ideal green spectral characteristic in which the slope of the transmission characteristic curve indicating the transmittance with respect to the wavelength is expressed by the ideal green spectral characteristic (the above-described linearly converted function g ′ (λ)). ) Along the characteristic curve on the long wavelength side. Specifically, the red light reflecting dichroic film DR has a high transmittance within a wavelength range of 430 nm or more and 670 nm or less in which the slope of the transmission characteristic curve follows the characteristic curve on the long wavelength side of the ideal green spectral characteristic. It is configured to have a shape that changes from low to low transmittance. More specifically, the average slope value at which the transmission characteristic curve changes from 80% to 20% of the range between the highest transmittance and the lowest transmittance within a wavelength range of 430 nm to 670 nm is −2. It preferably has a shape of 0 (% / nm) or more and -0.2 (% / nm) or less.

  As described above, the blue light reflecting dichroic film DB and the red light reflecting dichroic film DR in the present embodiment are designed such that the slopes of the characteristic curves thereof are in accordance with ideal spectral characteristics.

However, even if the imaging optical system is designed to reproduce the ideal conversion characteristics represented by the functions r ′ (λ), g ′ (λ), and b ′ (λ), manufacturing errors and Due to design errors and the like, it is difficult to manufacture a completely ideal product. Therefore, in order to reproduce the reproduction system ideal characteristic by the above-described method in the actually manufactured imaging apparatus, the conversion coefficient M ⁻¹ used for the inverse transformation should be considered in consideration of a manufacturing error, a design error, and the like. is required. In this case, particularly in the color imaging system, the spectral characteristics of the color separation prism in the color separation optical system 1 have a great influence on the spectral characteristics.

  For this reason, in the present embodiment, there are a color adjustment mode and a normal shooting mode as operation modes, and when the control unit 64 switches to the color adjustment mode in response to an instruction from the operation unit 65, imaging is performed. Based on the respective color signals output from the elements 4B, 4R, 4G, the overall spectral characteristics of the entire imaging system are measured and obtained by the coefficient calculation unit 63.

Further, when the mode is switched to the color adjustment mode, the coefficient calculation unit 63 obtains a shift of the spectral characteristic between the total spectral characteristic and the ideal characteristic of the desired reproduction system, and based on the shift of the characteristic, A matrix coefficient that makes the spectral characteristics approach the ideal characteristics of the reproduction system is obtained as a color characteristic conversion coefficient. The color characteristic conversion coefficient is stored in the coefficient storage unit 61 as the color characteristic conversion coefficient corresponding to the conversion coefficient M ⁻¹ used for the inverse conversion described above.
Hereinafter, in the present embodiment, instead of the above-described theoretical conversion coefficient M ⁻¹ , the color characteristic conversion coefficient used for the actual inverse conversion operation is
Indicated as (M ⁻¹ ) ′.
When the signal processing unit 62 is switched to the normal photographing mode, the color characteristic conversion coefficient (M ⁻¹ ) stored in the coefficient storage unit 61 for each color signal output from the image pickup devices 4R, 4G, and 4B. An operation of multiplying by 'is performed and output as a video signal Vout.

Here, the overall spectral characteristics of the entire imaging system taking into account manufacturing errors, design errors, and the like are expressed by functions r ₀ ′ (λ), g ₀ ′ (λ), and b ₀ ′ (λ). Then, as shown in the following equation (3) of [Equation 3], a color characteristic conversion coefficient (M ⁻¹ ) ′ is ^added to the functions r ₀ ′ (λ), g ₀ ′ (λ), b ₀ ′ (λ). By performing inverse transformation by multiplying by, the characteristics represented by the functions r ″ (λ), g ″ (λ), b ″ (λ) are obtained. By determining a value that minimizes the deviation from the reproduction system ideal characteristic as the color characteristic conversion coefficient (M ⁻¹ ) ′, functions r ″ (λ), g ″ (λ), b ″ ( λ) can be a characteristic approximated to a desired function r (λ), g (λ), b (λ) of the original reproduction system ideal characteristic. That is, as the color characteristic conversion coefficient (M ⁻¹ ) ′, the functions r (λ), g (λ), b (λ) of the theoretical formula represented by the above formula (2) and the above formula (3) are used. What is necessary is just to obtain | require the coefficient which makes the difference with the function r '' ((lambda)), g '' ((lambda)), b '' ((lambda)) based on the actual measurement value which considered the manufacturing error etc. represented. For example, a coefficient that minimizes the square difference may be obtained by the least square method.

The coefficient calculation unit 63 is configured to have, for example, an MPU (microprocessor unit). The coefficient calculation unit 63 performs overall synthesis of the entire imaging system based on color signals output from the plurality of image pickup devices 4B, 4R, and 4G when a reference color adjustment subject is imaged in the color adjustment mode. The spectral characteristic is obtained, and the color characteristic conversion coefficient (M ⁻¹ ) ′ in the present embodiment is calculated by, for example, the above least square method.
Here, as the “reference color adjustment subject”, for example, a shot beryl filter can be used.

Data indicating the color characteristic conversion coefficient (M ⁻¹ ) ′ obtained by the coefficient calculation unit 63 is stored in the coefficient storage unit 61. The coefficient calculation unit 63 stores a default color characteristic conversion coefficient (M ⁻¹ ) ′ in advance. Then, when the user wants to change the spectral characteristics according to the shooting environment or the like, the color adjustment mode may be set to adjust to the optimum color characteristic conversion coefficient (M ⁻¹ ) ′. In addition, the coefficient calculator 63 may store a plurality of default color characteristic conversion coefficients (M ⁻¹ ) ′ in advance. Then, in response to an instruction from the operation unit 65, a user may be prepared to select an arbitrary color characteristic conversion coefficient (M ^-1) 'according to the photographing environment, and the like.

  Next, the operation of the imaging device in this embodiment will be described.

  In the imaging apparatus shown in FIG. 1, subject light from a subject (not shown) irradiated by a light source (not shown) enters the color separation optical system 1 via the photographing lens 2. In the color separation optical system 1, the incident light L is decomposed into three color light components of blue light LB, red light LR, and green light LG. More specifically, first, the blue light LB of the incident light L is reflected by the blue light reflecting dichroic film DB and extracted from the first prism 10 as the first color light component. Further, the red light LR that has passed through the blue light reflecting dichroic film DB is reflected by the red light reflecting dichroic film DR and is extracted from the second prism 20 as the second color light component. Further, the green light LG transmitted through the blue light reflecting dichroic film DB and the red light reflecting dichroic film DR is extracted from the third prism 30 as a third color light component. Each color light separated by the color separation optical system 1 enters the image pickup devices 4B, 4R, 4G provided corresponding to each color light. The imaging elements 4B, 4R, and 4G output an electrical signal corresponding to each incident color light as an imaging signal.

  Here, spectral characteristics obtained by the imaging optical system in the present embodiment will be shown by an actual design example. FIG. 4 shows the characteristics of a specific design example of the blue light reflecting dichroic film DB and the red light reflecting dichroic film DR used in the color separation optical system 1. The characteristics shown in FIG. 4 can be obtained by, for example, the film design specifically shown as numerical data in FIGS. However, the film substance, the number of layers, and the film thickness of each layer are not limited to the examples of FIGS. FIG. 7 shows the spectral transmission characteristics of the entire prism portion (the first, second, and third prisms 10, 20, and 30) on which the film design shown in FIG. 4 is applied.

  FIG. 8 shows an example of spectral characteristics of optical elements other than the prism portion in the imaging apparatus. In FIG. 8, as the characteristics of the optical elements other than the prism portion, a light source having a color temperature of 3200K, a photographing lens 2, an IR cut filter 3, and a CCD as the image sensors 4R, 4G, and 4B are shown. FIG. 9 shows the overall spectral transmission characteristics of the entire imaging system, which combines the characteristics of optical elements other than the prism section shown in FIG. 8 and the characteristics of the entire prism section shown in FIG.

In the overall spectral characteristic of the entire imaging system shown in FIG. 9, the negative spectral region cannot be reproduced with respect to the reproduction system ideal characteristic shown in FIG. 2A. The signal processing unit 62 multiplies each color signal output from the image pickup devices 4R, 4G, and 4B by the color characteristic conversion coefficient (M ⁻¹ ) ′ stored in the coefficient storage unit 61 to obtain the final result. Specifically, it is possible to reproduce a characteristic approximate to the reproduction system ideal characteristic as shown in FIG.

Next, referring to FIG. 10, FIG. 11, and FIG. 12, a process for deriving the spectral characteristics of the imaging apparatus according to the present embodiment to the final ideal state is described as a color characteristic conversion coefficient in the present embodiment. This will be described together with a method for determining (M ⁻¹ ) ′. FIG. 10 shows a mode selection operation in the imaging apparatus. FIG. 11 and FIG. 12 show the entire process from the design / manufacturing stage to finally reproducing the characteristic approximate to the reproduction system ideal characteristic.

  First, for example, the function r (λ), x (λ), y (λ), z (λ) of the XYZ color system is converted into a function, and the spectral characteristics of the desired color reproduction system are added. The reproduction system ideal characteristics represented by g (λ) and b (λ) are obtained (steps S101 and S102 in FIG. 11, FIGS. 12A and 12B). Next, with respect to the reproduction system ideal characteristics of each color represented by the functions r (λ), g (λ), and b (λ), a transformation matrix M as shown in the above equation (1) of [Equation 1] The conversion ideal characteristic represented by functions r ′ (λ), g ′ (λ), and b ′ (λ) having positive values subjected to reversible conversion to eliminate the negative region is obtained by the calculation used ( Steps S103 and S104, FIG. 12 (C)). The functions r ′ (λ), g ′ (λ), and b ′ (λ) obtained through the steps so far are theoretical values. Based on this theoretical value, an imaging optical system including a color separation prism is designed and manufactured.

  As a design stage, design values for the entire imaging system are determined (step S105, FIG. 12D). This is an overall design value of a positive value approximated to the conversion ideal characteristic represented by the functions r ′ (λ), g ′ (λ), and b ′ (λ) of positive values. The imaging system is designed and manufactured with the goal of reproducing the total design value approximated to this ideal conversion characteristic (step S106).

In the imaging device designed and manufactured in this way, it is assumed that an instruction for mode selection is given from the operation unit 65 (step S10 in FIG. 10), and the operation mode is switched to the color adjustment mode by the control unit 64. The coefficient calculation unit 63 is based on the color signals output from the plurality of image sensors 4B, 4R, and 4G when the reference color adjustment subject is imaged in the color adjustment mode (step S11 in FIG. 10). Then, the overall spectral characteristic of the entire imaging system is measured, and an actual measurement value of the characteristic is obtained (step S12 in FIG. 10, step S107 in FIG. 11, and FIG. 12E). The total spectral characteristics required here are functions r ₀ ′ (λ), g ₀ ′ (λ), b ₀ ′ () taking into account manufacturing errors and design errors of the entire imaging system including the color separation prism. λ) is a total actual measurement value of the entire imaging system, and is a positive value.

Then, the coefficient calculation unit 63, a function _{r 0 '(λ), g} 0' (λ), b 0 '(λ) overall spectral characteristic represented by a function r (λ), g (λ ) , B (λ), the deviation of the spectral characteristic from the reproduction system ideal characteristic is obtained. The coefficient calculation unit 63 obtains a matrix coefficient that reduces the deviation of the spectral characteristic and brings the total spectral characteristic closer to the reproduction system ideal characteristic as the color characteristic conversion coefficient (M ⁻¹ ) ′ (step S13 in FIG. 10, Step S108 in FIG. 11). Specifically, as described above, the functions r (λ), g (λ), b (λ) of the theoretical formula expressed by the above formula (2) and the manufacturing error expressed by the above formula (3). A coefficient that minimizes the difference from the actual value-based functions r ″ (λ), g ″ (λ), and b ″ (λ) in consideration of the above is obtained by an operation such as a least square method. The coefficient calculation unit 63 stores data indicating the obtained color characteristic conversion coefficient (M ⁻¹ ) ′ in the coefficient storage unit 61 (step S14 in FIG. 10).

Next, in the imaging apparatus, it is assumed that a mode selection instruction is given from the operation unit 65 (step S10 in FIG. 10), and the operation mode is switched to the normal shooting mode by the control unit 64. The signal processing unit 62 outputs (step S22 in FIG. 10) the plurality of image pickup devices 4R, 4G, and 4B when the subject to be normally photographed is imaged in the normal photographing mode (step S21 in FIG. 10). The calculation (approximate inverse transformation) of multiplying the plurality of color signals by the color characteristic conversion coefficient (M ⁻¹ ) ′ stored in the coefficient storage unit 61 is performed (step S23 in FIG. 10, step S109 in FIG. 11). . As a result, as a final signal output, it is possible to obtain a characteristic that approximates the reproduction system ideal characteristic in consideration of the spectral characteristic of the desired color reproduction system (step S24 in FIG. 10, step S110 in FIG. 11, and FIG. 12 (F)).

By the above process, according to the imaging apparatus of the present embodiment has a color adjustment mode, and stores data indicating the color characteristic conversion coefficients obtained in that mode (M ^-1) ', usually At the time of shooting, the signal processing unit 62 uses the color characteristic conversion coefficient (M ⁻¹ ) ′ stored in the coefficient storage unit 61 for the plurality of color signals output from the plurality of image sensors 4R, 4G, and 4B. Since multiplication is performed, it is possible to correct design errors and manufacturing errors of the entire imaging system including the color separation prism, which has a large influence on the spectral characteristics, and in addition to the characteristics of the desired color reproduction system in the color imaging system. It is possible to obtain characteristics close to the ideal spectral characteristics.

Furthermore, according to the imaging apparatus according to the present embodiment, the slope of the characteristic curve indicating the spectral characteristic (film characteristic) of the color separation prism is converted to the ideal conversion characteristic as shown in FIGS. (See FIG. 2B and FIG. 12C.) Since it is designed to have an inclination corresponding to the inclination of the characteristic curve shown in FIG. 2, the overall imaging system when the color separation prism is incorporated in the imaging apparatus. It becomes easy to approximate the spectral characteristics to the ideal conversion characteristics. Thus, by combining the color characteristic conversion coefficients obtained as described above (M ^-1) ', it becomes easier to obtain ideal spectral characteristic properties of the desired color reproduction system is taken into account.

For example, the slope of the film characteristic of the color separation prism is assumed to show a steep rise as shown in FIG. 19, and the overall spectral transmission characteristic of the entire imaging system is converted as shown in FIG. Consider the case where the ideal characteristics deviate significantly. In this case, since the shape of the overall spectral transmission characteristic is rectangular for each color, even if the calculation using the color characteristic conversion coefficient (M ⁻¹ ) ′ obtained as described above is performed. It is difficult to obtain ideal spectral characteristics. The color characteristic conversion coefficient (M ⁻¹ ) ′ performs a relatively simple calculation by primary conversion as shown in Equation (3) of the above [Equation 3]. By simply performing such a relatively simple calculation, the rectangular characteristic cannot be made sufficiently close to the ideal characteristic having a gentle curve shape as shown in FIG.
[Second Embodiment]

  Next, a second embodiment of the present invention will be described. In addition, the same code | symbol is attached | subjected to the component substantially the same as the said 1st Embodiment, and description is abbreviate | omitted suitably.

FIG. 13 and FIG. 14 show the process for deriving the spectral characteristics of the imaging apparatus according to the present embodiment to the final ideal state, and the method for determining the color characteristic conversion coefficient (M ⁻¹ ) ′ in the present embodiment. It is shown with.

The process shown in FIGS. 13 and 14 is different from the process in the first embodiment shown in FIGS. 11 and 12 in steps S208 and S209 for obtaining a color characteristic conversion coefficient (M ⁻¹ ) ′. This is a part (part (E) → (F) in FIG. 14). In the first embodiment, the coefficient calculation unit 63 expresses the color characteristic conversion coefficient (M ⁻¹ ) ′ as functions r ₀ ′ (λ), g ₀ ′ (λ), b ₀ ′ (λ). Is calculated by an operation that minimizes the deviation of the spectral characteristic between the total spectral characteristic based on the actual measurement value and the reproduction system ideal characteristic represented by the functions r (λ), g (λ), and b (λ). I did it.

On the other hand, in the present embodiment, the coefficient calculation unit 63 firstly adds a positive value function r ′ (λ), g ′ (λ), which is obtained by performing reversible transformation with the transformation matrix M on the reproduction system ideal characteristic. Comparison between ideal conversion characteristics represented by b ′ (λ) and total spectral characteristics based on actual measurement values represented by functions r ₀ ′ (λ), g ₀ ′ (λ), and b ₀ ′ (λ) Then, the first color characteristic conversion coefficient N is obtained by an operation (such as the least square method) that minimizes the deviation (step S208). Then, the coefficient calculation unit 63 calculates the total spectral characteristics (FIG. 14E) based on the actual measurement values represented by the functions r ₀ ′ (λ), g ₀ ′ (λ), and b ₀ ′ (λ). On the other hand, by multiplying the first color characteristic conversion coefficient N, the approximate conversion ideal characteristic of a positive value approximated to the positive conversion ideal characteristic (FIG. 14C) is obtained (step S209, FIG. 14 (F)). Here, it is assumed that the approximate conversion ideal characteristic of a positive value is expressed by functions r ′ (λ) ⁺ , g ′ (λ) ⁺ , and b ′ (λ) ⁺ of positive values. Next, the second color characteristic is compared with the approximate approximate ideal characteristic of the positive value represented by this positive value function r ′ (λ) ⁺ , g ′ (λ) ⁺ , b ′ (λ) ^+. By multiplying the conversion matrix M ⁻¹ as a conversion coefficient, it is possible to obtain characteristics that approximate the ideal reproduction system characteristics that take into account the spectral characteristics of the desired color reproduction system (steps S109 and S110).

Note that the transformation matrix M ⁻¹ is a coefficient that is theoretically uniquely determined as described above with reference to FIGS. 2A and 2B, and is a positive value function r ′ (λ), g ′ ( This is an inverse matrix of the transformation matrix M used when obtaining the transformation ideal characteristics (FIG. 14C) represented by λ) and b ′ (λ). In the present embodiment, the color characteristic conversion coefficient (M ⁻¹ ) ′ in the first embodiment is
(M ⁻¹ ) ′ = N · M ⁻¹
Is equivalent to being given by the product of the first color characteristic conversion coefficient N and the second color characteristic conversion coefficient M ⁻¹ . Data indicating the color characteristic conversion coefficient (M ⁻¹ ) ′ represented by N · M ⁻¹ is stored in the coefficient storage unit 61 in the imaging apparatus in the same manner as in the first embodiment. Other parts are basically the same as those in the first embodiment.
[Other embodiments]

The present invention is not limited to the above embodiments, and other modifications can be made.
For example, in each of the above embodiments, the color separation optical system 1 that separates the incident light L in the order of the blue light LB, the red light LR, and the green light LG has been described as an example. However, the order of the color separation is not limited thereto. Alternatively, color separation may be performed in another order. In each of the above-described embodiments, an example in which three prisms are provided as a color separation optical system and the light is separated into three color lights has been shown. However, the present invention is provided with four or more prisms and has four or more color lights. The present invention can also be applied to a color separation optical system that decomposes.

  In each of the above-described embodiments, the color imaging system using the color separation prism has been described. However, a single-plate color camera equipped with a color filter corresponding to each unit cell of the imaging element called a mosaic filter, or a surface The present invention can also be applied to all color cameras equipped with a color filter, such as a color camera equipped with a rotary color filter called a sequential method. In this case, the spectral characteristic of the filter may be measured in the same manner as the spectral characteristic of the color separation prism, and an optimum color characteristic conversion coefficient may be obtained based on the measurement result.

It is a block diagram which shows one structural example of the imaging device which concerns on the 1st Embodiment of this invention. It is explanatory drawing about the ideal characteristic applied with the color separation optical system which concerns on the 1st Embodiment of this invention, (A) shows the ideal characteristic before primary conversion, (B) is after primary conversion. Shows ideal characteristics. It is explanatory drawing about the characteristic (A) of the blue light reflection dichroic film | membrane DB in the color separation optical system which concerns on the 1st Embodiment of this invention, and the characteristic (B) of red light reflection dichroic film | membrane DR. FIG. 6 is a characteristic diagram showing a design example of a blue light reflecting dichroic film DB and a red light reflecting dichroic film DR in the color separation optical system according to the first embodiment of the present invention. It is a figure which shows the numerical example of the film | membrane design of the blue light reflection dichroic film | membrane DB in the color separation optical system which concerns on the 1st Embodiment of this invention. It is a figure which shows the numerical example of the film | membrane design of the red light reflection dichroic film | membrane DR in the color separation optical system which concerns on the 1st Embodiment of this invention. It is a characteristic view which shows an example of the spectral characteristic of the prism part in the imaging device which concerns on the 1st Embodiment of this invention. It is a characteristic view which shows an example of the spectral characteristic of optical elements other than the prism part in the imaging device which concerns on the 1st Embodiment of this invention. FIG. 6 is a characteristic diagram illustrating an example of a comprehensive spectral characteristic of the imaging optical system (before coefficient conversion) in the imaging apparatus according to the first embodiment of the present invention. 3 is a flowchart showing an operation mode of the imaging apparatus according to the first embodiment of the present invention. 3 is a flowchart showing a process for guiding spectral characteristics of the imaging apparatus according to the first embodiment of the present invention to a final ideal state. It is explanatory drawing which shows the process for guide | inducing the spectral characteristic of the imaging device which concerns on the 1st Embodiment of this invention to a final ideal state. It is a flowchart which shows the process for guide | inducing the spectral characteristic of the imaging device which concerns on the 2nd Embodiment of this invention to a final ideal state. It is explanatory drawing which shows the process for guide | inducing the spectral characteristic of the imaging device which concerns on the 2nd Embodiment of this invention to a final ideal state. It is sectional drawing which shows the structural example of the conventional color separation optical system. It is an xy chromaticity diagram showing chromaticity coordinates of three primary colors for obtaining ideal characteristics. It is a characteristic view which shows the normalized ideal characteristic. It is a characteristic view which shows the spectral characteristic of the conventional general color separation optical system. It is a characteristic view which shows an example of the characteristic of the dichroic film | membrane used with the conventional color separation optical system.

Explanation of symbols

  L ... incident light, LB ... blue light component, LR ... red light component, LG ... green light component, DB ... blue light reflecting dichroic film, DR ... red light reflecting dichroic film, DG ... green light reflecting dichroic film, 1 ... color Decomposing optical system, 2 ... photographing lens, 3 ... IR cut filter, 4R, 4G, 4B ... image sensor, 10 ... first prism, 20 ... second prism, 30 ... third prism, 51 ... first Trimming filter, 52 ... second trimming filter, 53 ... third trimming filter, 51AR ... first antireflection film, 52AR ... second antireflection film, 53AR ... third antireflection film, 61 ... coefficient storage Reference numeral 62: Signal processing unit 63: Coefficient calculation unit 64: Control unit 65: Operation unit Vout: Video signal

Claims (7)

A color separation prism for optically reproducing the ideal conversion characteristics by applying reversible conversion to reduce the negative spectral range with respect to the ideal characteristics of the reproduction system taking into account the spectral characteristics of the desired color reproduction system. An imaging optical system including
A plurality of imaging elements provided corresponding to a plurality of color lights separated by the color separation prism, and outputting color signals corresponding to the incident color lights;
Based on color signals output from the plurality of image sensors when a reference color adjustment subject is imaged, the overall spectral characteristics of the entire imaging system including the imaging optical system and the plurality of image sensors First computing means for obtaining
Second computing means for obtaining a shift in spectral characteristics between the total spectral characteristics and the reproduction system ideal characteristics or the conversion ideal characteristics;
Third arithmetic means for reducing a shift in the spectral characteristic and obtaining a matrix coefficient as a color characteristic conversion coefficient so that the total spectral characteristic approaches the reproduction system ideal characteristic;
A coefficient storage unit for storing data indicating the obtained color characteristic conversion coefficient;
An image pickup apparatus comprising: a signal processing unit that performs an operation of multiplying a plurality of color signals output from the plurality of image pickup elements by a color characteristic conversion coefficient stored in the coefficient storage unit. The reproduction system ideal characteristic is a characteristic having a spectral region of a negative value converted from the chromaticity coordinates of the three primary colors of the desired color reproduction medium and indicated by the primary conversion of the color matching function of the XYZ color system. The imaging apparatus according to claim 1, wherein: A switching control unit for switching the operation mode between the color adjustment mode and the normal shooting mode;
When the switching control unit switches to the color adjustment mode, the color characteristic conversion coefficient is obtained by using the first calculation means, the second calculation means, and the third calculation means, and the coefficient Perform the process of storing in the storage unit,
When the switching control unit switches to the normal shooting mode, the signal processing unit converts the color characteristic conversion stored in the coefficient storage unit with respect to a plurality of color signals output from the plurality of image sensors. The image pickup apparatus according to claim 1 or 2, wherein signal processing for multiplying by a coefficient is performed. The color separation prism separates incident light into at least three color light components of blue light, red light, and green light, and sequentially from the light incident side,
A first prism that has a first dichroic film and extracts a first color light component reflected by the first dichroic film;
A second prism that has a second dichroic film and extracts a second color light component transmitted through the first dichroic film and reflected by the second dichroic film;
And a third prism for extracting a third color light component that has passed through the first and second dichroic films,
The first and second dichroic films are designed such that the slope of the characteristic curve indicating the spectral characteristics is in accordance with the slope of the characteristic curve indicating the conversion ideal characteristic. Item 4. The imaging device according to any one of Items 1 to 3. In the color separation prism, the first dichroic film has a film configuration that reflects blue light as the first color light component, and the second dichroic film has red light as the second color light component. And a film configuration that reflects
The slope of the transmission characteristic curve showing the transmittance with respect to the wavelength of the first dichroic film changes from 20% to 80% of the range between the minimum transmittance and the maximum transmittance within the wavelength range of 430 nm to 670 nm. Having an average slope value of 0.2 (% / nm) or more and 2.0 (% / nm) or less,
The slope of the transmission characteristic curve showing the transmittance with respect to the wavelength of the second dichroic film changes from 80% to 20% of the range between the maximum transmittance and the minimum transmittance within the wavelength range of 430 nm to 670 nm. The imaging apparatus according to claim 4, wherein the imaging device has a shape having an average slope value of −2.0 (% / nm) to −0.2 (% / nm). A color used to optically reproduce the ideal conversion characteristics obtained by applying reversible conversion to reduce the negative spectral range with respect to the ideal characteristics of the reproduction system taking into account the spectral characteristics of the desired color reproduction system. An imaging optical system including a separation prism, a plurality of imaging elements provided corresponding to a plurality of color lights separated by the color separation prism, and outputting color signals corresponding to the incident color lights, A signal processing method in an imaging apparatus comprising: a signal processing unit that performs an operation of multiplying a plurality of color signals output from an imaging element by a color characteristic conversion coefficient stored in a coefficient storage unit,
Based on color signals output from the plurality of image sensors when a reference color adjustment subject is imaged, the overall spectral characteristics of the entire imaging system including the imaging optical system and the plurality of image sensors Obtaining by the first calculating means;
Obtaining a shift in spectral characteristics between the overall spectral characteristics and the reproduction system ideal characteristics or the conversion ideal characteristics by a second computing means;
A step of reducing the spectral characteristic shift and obtaining a matrix coefficient by which the total spectral characteristic approaches the reproduction system ideal characteristic as a color characteristic conversion coefficient by a third arithmetic unit;
Storing data indicating the obtained color characteristic conversion coefficient in the coefficient storage unit;
A step of multiplying a plurality of color signals output from the plurality of image sensors by a color characteristic conversion coefficient stored in the coefficient storage unit. The operation mode in the imaging device further includes a step of switching between a color adjustment mode and a normal shooting mode by a switching control unit,
When the switching control unit switches to the color adjustment mode, the color characteristic conversion coefficient is obtained by using the first calculation means, the second calculation means, and the third calculation means, and the coefficient The signal processing method according to claim 6, wherein a process of storing in the storage unit is performed.

Images