JP2020202518A - Image processing device, image processing circuit, and image processing method - Google Patents

Abstract

To provide an image processing device that improves the accuracy of an image obtained by synthesizing pieces of light detection data of wavelength bands after a binning process is executed even when the binning process is executed on each detection data obtained from a photodetector whose light receiving area of a light receiving element differs depending on the wavelength band of light to be detected.SOLUTION: An image processing device acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of a light receiving element for each photodetector. Then, the image processing device executes a binning process for each detection data by multiplying each detected value for each light receiving element included in the detection data by a weighting value according to the light receiving element that reduces variation in the area of the light receiving elements of the plurality of photodetectors that detect light in different wavelength bands.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image processing apparatus, an image processing circuit, and an image processing method.

In the image processing apparatus, a binning process may be performed in order to increase the light receiving sensitivity. A technique relating to a binning process is disclosed in Patent Document 1.

International Publication No. 2015/083683

By the way, the light receiving area of the light receiving element of the photodetector may differ depending on the wavelength band of the light to be detected. For example, in an image processing device having a certain optical system, a detector that detects each of visible light V (Visible Light), near infrared light N (Near Infrared), and short wavelength near infrared light S (Short wavelength Infrared). To be equipped. In an optical system system including a detector for detecting each of these visible light V, near infrared light N, and short wave near infrared light S, the light receiving area of the light receiving element of the photodetector of short wave near infrared light S , The light receiving area of the light receiving element of the photodetector of the near infrared light N may be different from that of other visible light V. Although this difference in the light receiving area is a problem of manufacturing technology and cost of the light receiving element, it is usually difficult to miniaturize the light receiving element of the photodetector of the short wave near infrared light S.

When the light receiving area of the light receiving element of the photodetector differs depending on the wavelength band of the light to be detected as described above, the relationship between the size of the binning range after the binning process is performed for each detection data of the light of the different wavelength band. Will be misaligned. When the detection data of the light in each wavelength band after the binning process in which such a deviation occurs is combined to generate one image, the detection position of the light to be imaged for each virtual light receiving element in each wavelength band is determined. This will result in a shift, and the accuracy of the image using the detected data after the binning process will drop.

Therefore, an object of the present invention is to provide an image processing apparatus, an image processing circuit, and an image processing method that solve the above-mentioned problems.

According to the first aspect of the present invention, the image processing apparatus is detection data of light in different wavelength bands separately detected by each photodetector having a different light receiving area of the light receiving element for each photodetector. A detection data acquisition unit that acquires the detection data indicating the detection value for each light receiving element according to the position of the imaging target in the primary direction for each of a plurality of wavelengths constituting the wavelength band, and the primary in the imaging target. The storage unit stores a weighted value for the detected value of the light receiving element for each detection data set based on the size of the area included in the binning range of the light receiving element corresponding to the position of the binning range set in the direction. The weighted value acquisition unit acquired from the above and the detected value for each light receiving element included in the detection data for each wavelength band are multiplied by the corresponding weighted value to obtain the received light corresponding to the binning range. It is characterized by including a binning processing unit that performs binning processing for each range of elements.

According to the second aspect of the present invention, the image processing circuit is detection data of light in different wavelength bands separately detected by each photodetector having a different light receiving area of the light receiving element for each photodetector. A detection data acquisition circuit that acquires the detection data indicating the detection value for each light receiving element according to the position of the imaging target in the primary direction for each of a plurality of wavelengths constituting the wavelength band, and the primary in the imaging target. The storage unit stores a weighted value for the detected value of the light receiving element for each detection data set based on the size of the area included in the binning range of the light receiving element corresponding to the position of the binning range set in the direction. The weighted value acquisition circuit acquired from the above and the detected value for each light receiving element included in the detection data for each wavelength band are multiplied by the corresponding weighted value to obtain the received light corresponding to the binning range. It is characterized by including a binning processing circuit that performs binning processing for each range of elements.

According to the third aspect of the present invention, the image processing method is detection data of light in different wavelength bands separately detected by each photodetector having a different light receiving area of the light receiving element for each photodetector. Then, the detection data indicating the detection value for each light receiving element corresponding to the position of the imaging target in the primary direction for each of a plurality of wavelengths constituting the wavelength band was acquired, and the detection data was set in the primary direction in the imaging target. The weighting value for the detection value of the light receiving element for each detection data set based on the size of the area included in the binning range of the light receiving element corresponding to the position of the binning range is acquired from the storage unit, and the weighting value is acquired from the storage unit. By multiplying each of the detected values for each light receiving element included in the detection data for each wavelength band by the corresponding weighted value, the binning process for each range of the light receiving element corresponding to the binning range is performed. It is a feature.

According to the present invention, even when the binning process is performed on each detection data obtained from the photodetector having a different light receiving area of the light receiving element according to the wavelength band of the detected light, the light in each wavelength band after the binning process is performed. It is possible to improve the accuracy of the combined image of the detection data of.

It is a block diagram which shows the structure of the optical system by one Embodiment of this invention. It is a figure which shows the outline of the photodetector by one Embodiment of this invention. It is a functional block diagram of the image processing apparatus according to one Embodiment of this invention. It is the first figure which shows the outline of the binning process by one Embodiment of this invention. It is a figure which shows the processing flow of the image processing apparatus by one Embodiment of this invention. It is a figure which shows the minimum structure of the image processing apparatus by one Embodiment of this invention. It is a figure which shows the 1st processing flow of the image processing apparatus of the minimum structure by one Embodiment of this invention. It is a figure which shows the 2nd processing flow of the image processing apparatus of the minimum structure by one Embodiment of this invention. It is a figure which shows the 3rd processing flow of the image processing apparatus of the minimum structure by one Embodiment of this invention.

Hereinafter, an optical system including an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an optical system according to the same embodiment.
As shown in this figure, the optical system 1 includes an optical system 11, a first photodetector 12, a second photodetector 13, a third photodetector 14, an image processing device 15, a communication module 16, and a storage device 17. At least prepare.

The optical system 11 spectroscopically outputs light incident from the outside into light in the first wavelength band, light in the second wavelength band, and light in the third wavelength band. In the present embodiment, the light in the first wavelength band is visible light V (Visible Light), the light in the second wavelength band is near infrared light N (Near Infrared), and the light in the third wavelength band is near short wave. Infrared light S (Short Wave Infrared). The optical system 11 outputs light of each wavelength obtained by splitting visible light V to the first photodetector 12. The optical system 11 outputs light of each wavelength obtained by splitting the near-infrared light N to the second photodetector 13. The optical system 11 outputs the shortwave near-infrared light S to the third photodetector 14 of each wavelength separated.

The optical system 11 disperses light incident from the outside into visible light V, near-infrared light N, and short-wave near-infrared light S by combining a die clock filter, a lens, and the like, and further uses a diffraction grid to disperse each of these wavelengths. The light in the band is separated into small wavelengths. The internal mechanism of the optical system 11 for these spectra may be configured by using a known technique. The light of each wavelength dispersed by the diffraction grating is detected by the light receiving element of each detector.

The first photodetector 12, the second photodetector 13, and the third photodetector 14 each include light receiving elements that are continuously arranged in a plane in the row direction and the column direction, respectively. The first photodetector 12, the second photodetector 13, and the third photodetector 14 each convert the light detected by each light receiving element into a digital signal and output it. The plurality of light receiving elements in each detector detect light corresponding to each position in the primary direction of the image pickup target. The first photodetector 12 outputs the detected light detection data of the detected visible light V wavelength band to the image processing device 15. The second photodetector 13 outputs the detected light detection data of the detected near-infrared light N wavelength band to the image processing device 15. The third photodetector 14 outputs the detected light detection data of the detected shortwave near-infrared light S wavelength band to the image processing device 15.

FIG. 2 is a diagram showing an outline of a photodetector according to the present embodiment.
As shown in FIG. 2, the first photodetector 12, the second photodetector 13, and the third photodetector 14 have light receiving elements arranged in a plane continuously in the row direction and the column direction, respectively. Be prepared. Among these light receiving elements, each light receiving element in the same row direction (horizontal direction in FIG. 2) detects light of a specific wavelength included in the wavelength band input by the detector, and each row is shifted. Light of other wavelengths in the next same wavelength band is detected respectively. Further, among the light receiving elements in the detector, each light receiving element in the same row direction (vertical direction in FIG. 2) detects the light at a specific position among the light at each continuous position in the primary direction of the imaging target. Every time the column shifts by one row, the light at the next position in the primary direction is detected. As an example, in any of the detectors, 640 light receiving elements are provided in the row direction (horizontal direction in FIG. 2). Each light receiving element in the row direction detects light at each continuous position in the primary direction of the image pickup target. In the detector, 512 light receiving elements are provided in the row direction (vertical direction in FIG. 2). The light receiving elements in the column direction detect light of different wavelengths separated by a diffraction grating or the like from the light of the input wavelength band.

The area of any one or more light receiving elements of the first photodetector 12, the second photodetector 13, and the third photodetector 14 is different from that of the light receiving elements of the other detectors. For example, as shown in FIG. 3, the length L of one side of one light receiving element having a rectangular shape is one or more of the first photodetector 12, the second photodetector 13, and the third photodetector 14. It may differ depending on the light receiving element of. As an example, it is assumed that the area of the light receiving element constituting the first photodetector 12 and the area of the light receiving element constituting the second photodetector 13 have the same length L on one side of the light receiving element and are equal in area. .. Further, since the length L of one side of the light receiving element of the third photodetector 13 is longer than that of the light receiving elements constituting the other first photodetector 12 and the second photodetector 13, the area thereof Is larger than the area of the light receiving element constituting the first photodetector 12 and the second photodetector 13. As described above, the difference in the size of the area of the light receiving element constituting each detector is determined by the difficulty and cost for the production of each detector.

The optical system 1 of the present embodiment is provided on an artificial satellite launched into outer space as an example. When the optical system 1 photographs the earth, the imaging target is the earth. Each of the first photodetector 12, the second photodetector 13, and the third photodetector 14 is the earth that is separated by the optical system 11 and input from the optical system 11 among the light incident at a certain time point. Light in a predetermined range in the primary direction is detected for each wavelength. The optical system 1 can detect the information of the light reflected from the earth in a plane shape by sequentially inputting the light whose position in the primary direction of the earth to be imaged is shifted. The optical system 1 may capture light of an imaging target other than the earth.

When the optical system 1 transmits the detected data to the destination, it may be desirable to reduce the amount of data. For example, when transmitting detection data from outer space to a receiving device on the earth, there are restrictions on the transmission capacity per unit time and the limit on the transmittable time in data transmission between outer space and the ground. , It is desirable to reduce the amount of data.

Therefore, the image processing device 15 in the present embodiment performs the binning process for the purpose of reducing the amount of data when transmitting the acquired detection data to the communication destination. The binning process is a process of calculating a virtual value by integrating the detection values of adjacent light receiving elements in a range determined by the light receiving element and virtually expanding the light receiving sensitivity.

As described above, the area of any one or more of the first photodetector 12, the second photodetector 13, and the third photodetector 14 is different from the area of the other light receiving elements. Therefore, the image processing device 15 in the present embodiment performs processing for reducing the variation in the size of the virtual light receiving area of each detected data after the binning process for each of the detected data of each detector. The details of the binning process will be described later. The image processing device 15 instructs the communication module 16 to transmit the detection data as a result of the binning process.

The storage device 17 stores information for the image processing device 15 to use for the binning process.
The communication module 16 transmits the detection data of each of the first photodetector 12, the second photodetector 13, and the third photodetector 14, which have been binned by the image processing device 15, to the transmission destination. As an example, the communication module 16 transmits detection data to a receiver on the earth. In the receiving device, image data is generated using the detected data.

FIG. 3 is a functional block diagram of the image processing apparatus according to the present embodiment.
The image processing device 15 includes a detection data acquisition unit 51 (detection data acquisition circuit), a weighted value acquisition unit 52 (weighted value acquisition circuit), and a binning processing unit 53 (binning processing circuit). The functional part exerts its function by the circuit. The image processing device 15 includes a CPU, a ROM, a RAM, and the like, and when the CPU executes an image processing program stored in the storage device 17, the detection data acquisition unit 51, the weighted value acquisition unit 52, and the binning processing unit 53 It may be a device that exerts each function.

The detection data acquisition unit 51 acquires the detection data of the light output from each of the first photodetector 12, the second photodetector 13, and the third photodetector 14.
The weighted value acquisition unit 52 acquires the weighted value for the detected value for each light receiving element from the storage device 17.
The binning processing unit 53 reduces the variation in the area of the light receiving elements of the plurality of photodetectors that detect light in different wavelength bands with respect to the detection value of each light receiving element included in the detection data. The binning process of each detected data is performed by multiplying the bid value.

Alternatively, the binning processing unit 53 determines the detection value of each light receiving element included in the detection data at a position where a larger amount of light is detected than when there is no such distortion due to the influence of light distortion in the optical system. Decrease the detection value and increase the detection value of the light receiving element at the position where the light amount is less than when there is no such distortion due to the influence of light distortion. Multiply the detection data by the weighting value according to the light receiving element. You may perform the binning process of.

Further, the weighting value is a weighting value according to the light receiving element that reduces the variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands, and in addition, the weighting value of light in the optical system. The detection value of the light receiving element at the position where a large amount of light is detected is reduced due to the effect of distortion, and the position where the amount of light is detected is small compared to the case where there is no distortion due to the effect of light distortion. It may be a weighted value according to the light receiving element that increases the detected value of the light receiving element. By multiplying the detection value of each light receiving element by such a weighted value, the binning processing unit 53 detects a plurality of lights having different wavelength bands for each detection value of each light receiving element included in the detection data. The variation in the area of the light receiving element of the detector may be reduced, and the influence of light distortion in the optical system may be further reduced.

FIG. 4 is a first diagram showing an outline of the binning process according to the present embodiment.
FIG. 4 shows one row (4A) of the light receiving elements of the first photodetector 12 and the second photodetector 13 and one row (4B) of the light receiving elements of the third photodetector 14. The length of one side of the rectangular light receiving element provided in the third photodetector 14 is longer than the length of one side of the rectangular light receiving element provided in the first photodetector 12 and the second photodetector 13. The range of the light receiving element to be subjected to one binning process is referred to as a binning range.

Assuming that one binning range includes five light receiving elements, the binning ranges L1a, L1b, in order from the reference left end in one row (4A) of the light receiving elements of the first photodetector 12 and the second photodetector 13.・ ・ Is set. Further, in the light receiving element 1 row (4B) of the third photodetector 14, the binning ranges L3a, L3b, ... Are set in order from the reference left end.

The binning range is the reference for each center of the binning range set in the light receiving element of the first photodetector 12 and the second photodetector 13 and the binning range set in the light receiving element of the third photodetector 14. As the distance from the left end increases, the position gradually shifts to length a1, length a2, and so on.

Since one line of the light receiving element detects the light at each position in the primary direction of the imaging target, if the binning range shifts in this way, the binning of the first photodetector 12 or the second photodetector 13 The position of the imaging target in the primary direction, which is indicated by the light detected by the corresponding binning range of the third photodetector 14, is deviated from the range.

Therefore, the image processing device 15 determines the area of the light receiving elements of the first photodetector 12 and the second photodetector 13 and the third photodetector 14 for each detection value of each light receiving element included in the detection data. Multiply the weighted value according to the light receiving element, which reduces the variation with the area of the light receiving element. This weighted value is assigned to each light receiving element in advance, and the storage device 17 stores a weighted table in which the identification number of the light receiving element and the weighted value are associated with each other.

As an example, when the image processing device 15 identifies 1, 2, ..., K in order from the light receiving elements on the left side of the n light receiving elements included in each binning range, the light detection value Wout in the binning range is determined. Using the light detection value Wk of the k-th light receiving element and the weighting value Ak set for each light receiving element, the calculation is performed as in the equation (1). The detection data before the binning process is imaging data in which the detection value of each light receiving element is one pixel, but the detection data after the binning process is the detection calculated based on each detection value of the light receiving element included in the binning range. The imaging data shows the value Wout as a detection value of one pixel.

As shown in FIG. 4, as an example, it is assumed that the deviation from the binning range L3a is the length of a1. When the binning range L1a and the center of the binning range L3a are aligned with each other as a reference, the positions of the left end and the right end of the binning range L3a are shifted by a1 / 2 from the positions of the left end and the right end of the binning range L1a. Since the image processing device 15 has a long binning range, the detection value of the light receiving element is set for each of the left end and right end light receiving elements of the binning range L3a in the light receiving element 1 row (4B) of the third photodetector 14. Multiply by the weighted value that is decremented by the long deviation (L × (a1 / 2)). The weighting value Ak for each light receiving element may be calculated by performing a simulation or the like on the ground in advance. In this way, the image processing device 15 corrects the binning range L1a and the binning range L3a so that they are virtually detected values in the same ground range. The setting of the binning range may be another setting. Further, the weighting value Ak can be set as long as it is a weighting value according to the light receiving element that reduces the variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. May be good.

FIG. 5 is a diagram showing a processing flow of the image processing apparatus according to the present embodiment.
Next, the processing flow of the image processing apparatus will be described step by step.
The detection data acquisition unit 51 of the image processing device 15 acquires the detection data v of light in the wavelength band of visible light V from the first photodetector 12 (step S101). The detection data acquisition unit 51 acquires the detection data n of the light in the wavelength band of the near infrared light N from the second photodetector 13 (step S102). The detection data acquisition unit 51 acquires the detection data s of the light in the wavelength band of the shortwave near-infrared light S from the third photodetector 14 (step S103).

The weighted value acquisition unit 52 acquires a preset weighted value Ak for each light receiving element of the first photodetector 12 (step S104). The weighted value acquisition unit 52 acquires a preset weighted value Ak for each light receiving element of the second photodetector 13 (step S105). The weighted value acquisition unit 52 acquires a preset weighted value Ak for each light receiving element of the third photodetector 14 (step S106).

The binning processing unit 53 sets in the detection data v by using the detection value Wk of each light receiving element k included in the detection data v and the weighting value Ak corresponding to each light receiving element k included in the detection data v. The detected value Wout of each binning range is calculated by the equation (1) (step S107). Similarly, the binning processing unit 53 uses the detection value Wk of each light receiving element k included in the detection data n and the weighted value Ak corresponding to each light receiving element k included in the detection data n to detect data. The detection value Wout of each binning range set in n is calculated by the equation (1) (step S108). Similarly, the binning processing unit 53 uses the detection value Wk of each light receiving element k included in the detection data s and the weighted value Ak corresponding to each light receiving element k included in the detection data s to detect the detection data s. The detection value Wout of each binning range set in is calculated by the equation (1) (step S109). The calculation process of these detected values Wout corresponds to the binning process.

The binning processing unit 53 calculates the detection data v'after the binning processing including the detection value Wout of each binning range set in the detection data v (step S110). The binning processing unit 53 calculates the detection data n'after the binning processing including the detection value Wout of each binning range set in the detection data n (step S111). The binning processing unit 53 calculates the detection data s'after the binning processing including the detection value Wout of each binning range set in the detection data s (step S112).

The binning processing unit 53 instructs the communication module 16 to transmit the detection data v'after the binning processing, the detection data n'after the binning processing, and the detection data s'after the binning processing (step S113). The communication module 16 transmits the detection data v'after the binning process, the detection data n'after the binning process, and the detection data s'after the binning process to the receiving device on the ground. The control unit 54 determines whether to end the process (step S114). When the processing is not completed, the control unit 54 controls to process the detection data for each of the following detectors.

According to the above processing, the image processing device 15 is a light receiving element of a plurality of photodetectors that detects light in a different wavelength band for each detection value of each light receiving element included in the detection data of each photodetector. The binning process of each detection data is performed by multiplying the weighted value according to the light receiving element that reduces the variation in the area. Therefore, the image processing device 15 reduces the amount of detection data to be transmitted and reduces the variation in the area of the light receiving element of the photodetector, so that the light reflected by the imaging target indicated by the virtual pixel value of each detection data. Can be aligned. As a result, when the data after the binning process of the detection data output from the plurality of photodetectors that detect the light of different wavelength bands is used to construct an image containing the light of a plurality of wavelengths to be imaged, it becomes more possible. It is possible to generate a highly accurate image.

The binning processing unit 53 of the image processing device 15 detects a larger amount of light for each of the detected values for each light receiving element included in the detection data than when there is no such distortion due to the influence of the distortion of light in the optical system 11. Decrease the detection value of the light receiving element at the position and increase the detection value of the light receiving element at the position where the amount of light is reduced compared to the case where there is no such distortion due to the influence of light distortion. It may be multiplied to perform the binning process of each of the detected data.

In the optical system 11, aberration may occur due to the influence of lens distortion or the like, and the image generated by the detection data of the photodetector may be distorted. The image processing device 15 may correct the deviation of the detected value due to the influence of this distortion by using the weighted value.

In this case, the storage device 17 reduces the detection value of the light receiving element at the position where a large amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system 11, and the effect of the light distortion causes the storage device 17. A table is stored in which a weighted value corresponding to a light receiving element that increases the detection value of the light receiving element at a position where the amount of light is detected is smaller than that when there is no distortion, and an identification number of the light receiving element are associated with each other. Then, similarly to the above-mentioned processing, the binning processing unit 53 acquires the weighted value corresponding to the light receiving element from the storage device, and performs the binning processing using the equation (1).

As a result, the image processing device 15 can correct the deviation of the detected value due to the influence of this distortion by using the weighted value. The weighting value in this case reduces the detection value of the light receiving element at the position where a large amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system, and the distortion is caused by the influence of the light distortion. Any value may be used as long as it is a weighted value corresponding to the light receiving element that increases the detection value of the light receiving element at the position where the amount of light is reduced as compared with the case where there is no light amount.

The above-mentioned weighting value is a weighting value according to the light receiving element that reduces the variation in the area of the light receiving element of the plurality of photodetectors that detect light in different wavelength bands, and further, the optical system 11 The detection value of the light receiving element at the position where a large amount of light is detected is reduced due to the influence of the light distortion in the above, and the amount of light is reduced as compared with the case where there is no such distortion due to the influence of the light distortion. It may be a weighted value according to the light receiving element that increases the detected value of the light receiving element at the detection position. By performing the binning process using such a weighted value, the amount of detection data to be transmitted is reduced, the variation in the area of the light receiving element of the photodetector is reduced, and the virtual pixel value of each detection data is reduced. It is possible to align the position of the light reflected by the image pickup target shown by the above, and to correct the deviation of the detected value due to the influence of distortion, and to generate the detection data for generating a more accurate image.

The image processing device 15 may receive data in a data table of weighted values for the detected values of the light receiving element for each detected data, and update the weighted values stored in the storage unit. For example, the communication module 16 receives the modified data in the data table from the ground device. Then, the image processing device 15 may record the information of the data table in the storage device 17, and rewrite the data of the data table used in the past with the data of the new data table.

FIG. 6 is a diagram showing a minimum configuration of an image processing apparatus according to the present embodiment.
FIG. 7 is a diagram showing a first processing flow of the image processing apparatus having the minimum configuration according to the present embodiment.
The image processing device 15 at least exerts the functions of the detection data acquisition unit 51 and the binning processing unit 53. The detection data acquisition unit 51 acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector (step S201). The binning processing unit 53 reduces the variation in the area of the light receiving elements of the plurality of photodetectors that detect light in different wavelength bands with respect to the detection value of each light receiving element included in the detection data. Multiply the bid price (step S202). The binning processing unit 53 performs binning processing for each of the detected data (step S203).

FIG. 8 is a diagram showing a second processing flow of the image processing apparatus having the minimum configuration according to the present embodiment.
In the processing flow of the image processing device 15 having another minimum configuration, first, the detection data acquisition unit 51 detects different wavelengths separately for the imaging target by a plurality of photodetectors having different light receiving areas of the light receiving elements for each photodetector. Acquire the detection data of the band light (step S301). Then, the binning processing unit 53 compares each of the detected values for each light receiving element included in the detection data with a weighted value according to the light receiving element, as compared with the case where there is no such distortion due to the influence of light distortion in the optical system. Then, a weighting value that reduces the detection value of the light receiving element at the position where a large amount of light is detected is multiplied (step S302). The binning processing unit 53 is a weighted value according to the light receiving element for each of the detected values for each light receiving element included in the detection data, and determines the amount of light as compared with the case where there is no such distortion due to the influence of the light distortion. Multiply by a weighted value that increases the detected value of the light receiving element at the position where it is detected less (step S303). The binning processing unit 53 performs binning processing for each of the detected data (step S304).

FIG. 8 is a diagram showing a third processing flow of the image processing apparatus having the minimum configuration according to the present embodiment.
In the processing flow of the image processing device 15 having another minimum configuration, first, the detection data acquisition unit 51 detects different wavelengths separately for the imaging target by a plurality of photodetectors having different light receiving areas of the light receiving elements for each photodetector. Acquire the detection data of the band light (step S401). Then, the binning processing unit 53 reduces the variation in the area of the light receiving elements of the plurality of photodetectors that detect light in different wavelength bands, and is compared with the case where there is no such distortion due to the influence of light distortion in the optical system. Weighting that reduces the detection value of the light receiving element at the position where a large amount of light is detected and increases the detection value of the light receiving element at the position where the amount of light is small compared to the case where there is no such distortion due to the influence of light distortion. The value is multiplied by each of the detected values of each light receiving element included in the detection data (step S402). The binning processing unit 53 performs binning processing for each of the detected data (step S403).

The image processing device 15 described above may have a computer system inside. The processing process of the image processing apparatus 15 described above is stored in a computer-readable recording medium in the form of a program, and the processing may be performed by the computer reading and executing this program.

The above program may be for realizing a part of the above-mentioned functions. Further, a so-called difference file (difference program) may be used, which can realize the above-mentioned functions in combination with a program already recorded in the computer system.

Some or all of the above embodiments may also be described, but not limited to:

(Appendix 1)
A detection data acquisition unit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each detection value of each light receiving element included in the detection data, a weighting value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. A binning processing unit that performs binning processing for each of the detected data by multiplying by
An image processing device comprising.

(Appendix 2)
The binning processing unit detects a large amount of light for each of the detected values included in the detection data for each light receiving element as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The weighting according to the light receiving element is increased by reducing the detection value of the light receiving element and increasing the detection value of the light receiving element at a position where the amount of light is detected to be smaller than in the case where there is no such distortion due to the influence of the light distortion. The image processing apparatus according to Appendix 1, which multiplies the values to perform binning processing for each of the detected data.

(Appendix 3)
A weighted value acquisition unit for acquiring the weighted value for the detected value for each of the light receiving elements from the storage unit is provided.
The binning processing unit multiplies each of the detected values for each light receiving element included in the detected data for each wavelength band by the acquired corresponding weighted value to obtain the position in the primary direction of the imaging target. The image processing apparatus according to Appendix 1 or Appendix 2, which performs the binning process for each binning range of the light receiving element set accordingly.

(Appendix 4)
The image processing apparatus according to Appendix 3, which receives a data table of the weighted values for the detected values of the light receiving element for each detected data and updates the weighted values stored in the storage unit.

(Appendix 5)
An artificial satellite having a transmitter for transmitting the detection data, which is the processing result of the binning process, to a ground device, is provided.
The image processing apparatus according to any one of Supplementary note 1 to Supplementary note 4.

(Appendix 6)
Lights in different wavelength bands are visible light, near-infrared light, and short-wave near-infrared light.
The image processing apparatus according to any one of Appendix 1 to Appendix 5, wherein the detection data acquisition unit acquires the detection data for each wavelength band of visible light, near-infrared light, and short-wave near-infrared light.

(Appendix 7)
A detection data acquisition unit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. The binning processing unit that performs each binning processing and
An image processing device comprising.

(Appendix 8)
A detection data acquisition circuit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each of the detected values for each light receiving element included in the detection data, a weighted value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. A binning processing circuit that performs binning processing for each of the detected data by multiplying by
An image processing circuit comprising.

(Appendix 9)
A detection data acquisition circuit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. A binning process circuit that performs each binning process and
An image processing circuit comprising.

(Appendix 10)
The image processing device
Multiple photodetectors with different light receiving areas of the light receiving element for each photodetector acquire detection data of light in different wavelength bands separately detected for the imaging target.
For each of the detected values for each light receiving element included in the detection data, a weighted value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. An image processing method for performing binning processing for each of the detected data by multiplying by.

(Appendix 11)
The image processing device
Multiple photodetectors with different light receiving areas of the light receiving element for each photodetector acquire detection data of light in different wavelength bands separately detected for the imaging target.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. An image processing method that performs each binning process.

(Appendix 12)
The computer of the image processing device,
A detection data acquisition means for acquiring detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of light receiving elements for each photodetector.
For each detection value of each light receiving element included in the detection data, a weighting value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. A binning processing means that performs binning processing for each of the detected data by multiplying by
A program that functions as.

(Appendix 13)
The computer of the image processing device,
A detection data acquisition means for acquiring detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of light receiving elements for each photodetector.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. Binning processing means for performing each binning processing,
A program that functions as.

1 ...
11 ... Optical system 12 ... First photodetector 13 ... Second photodetector 14 ... Third photodetector 15 ... Image processing device 16 ... Communication module 17 ... Storage device 51 ... Detection data acquisition unit 52 ... Weighted value acquisition unit 53 ... Binning processing unit 54 ... Control unit

Claims (10)

A detection data acquisition unit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each detection value of each light receiving element included in the detection data, a weighting value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. A binning processing unit that performs binning processing for each of the detected data by multiplying by
An image processing device comprising. The binning processing unit detects a large amount of light for each of the detected values included in the detection data for each light receiving element as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The weighting according to the light receiving element is increased by reducing the detection value of the light receiving element and increasing the detection value of the light receiving element at a position where the amount of light is detected to be smaller than in the case where there is no such distortion due to the influence of the light distortion. The image processing apparatus according to claim 1, wherein the binning process of each of the detected data is performed by multiplying the values. A weighted value acquisition unit for acquiring the weighted value for the detected value for each of the light receiving elements from the storage unit is provided.
The binning processing unit multiplies each of the detected values for each light receiving element included in the detected data for each wavelength band by the acquired corresponding weighted value to obtain the position in the primary direction of the imaging target. The image processing apparatus according to claim 1 or 2, wherein the binning process is performed for each binning range of the light receiving element set accordingly. The image processing apparatus according to claim 3, wherein a data table of the weighted value with respect to the detected value of the light receiving element for each detected data is received, and the weighted value stored in the storage unit is updated. An artificial satellite having a transmitter for transmitting the detection data, which is the processing result of the binning process, to a ground device, is provided.
The image processing apparatus according to any one of claims 1 to 4. Lights in different wavelength bands are visible light, near-infrared light, and short-wave near-infrared light.
The image processing according to any one of claims 1 to 5, wherein the detection data acquisition unit acquires the detection data for each wavelength band of visible light, near-infrared light, and short-wave near-infrared light. apparatus. A detection data acquisition unit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. The binning processing unit that performs each binning processing and
An image processing device comprising. A detection data acquisition circuit that acquires detection data of light in different wavelength bands separately detected by a plurality of photodetectors having different light receiving areas of the light receiving element for each photodetector.
For each of the detected values for each light receiving element included in the detection data, a weighted value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. A binning processing circuit that performs binning processing for each of the detected data by multiplying by
An image processing circuit comprising. The image processing device
Multiple photodetectors with different light receiving areas of the light receiving element for each photodetector acquire detection data of light in different wavelength bands separately detected for the imaging target.
For each of the detected values for each light receiving element included in the detection data, a weighted value according to the light receiving element that reduces variation in the area of the light receiving element of a plurality of photodetectors that detect light in different wavelength bands. An image processing method for performing binning processing for each of the detected data by multiplying by. The image processing device
Multiple photodetectors with different light receiving areas of the light receiving element for each photodetector acquire detection data of light in different wavelength bands separately detected for the imaging target.
For each of the detected values for each light receiving element included in the detection data, the detected value of the light receiving element at a position where a larger amount of light is detected as compared with the case where there is no such distortion due to the influence of the light distortion in the optical system. The detection data is multiplied by a weighting value corresponding to the light receiving element, which decreases and increases the detection value of the light receiving element at a position where the amount of light is detected to be smaller than when there is no distortion due to the influence of the light distortion. An image processing method that performs each binning process.

Images