JPH11308442A - Interpolation device and image pickup device using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent the degradation of a resolution by adaptively switching the interpolation method of a zoom and performing interpolation matched with the flow of the data of video signals. SOLUTION: This interpolation device is composed of plural interpolation means 7, 8 and 10, a selection means 11 for selecting the interpolation means, a control means 6 for controlling the selection means 11, an arithmetic means for performing an arithmetic operation by using the selected plural interpolation means and a judgement means for judging the arrangement of signals. In this case, extrapolation points in front of and at the back of interpolation data are obtained and interpolation origin data in front and at the back are used.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a signal interpolation device and an imaging device using the same. The present invention is particularly suitable for application to an image pickup apparatus provided with an electronic zoom device for enlarging and reducing a taken image.

[0002]

2. Description of the Related Art As a conventional interpolation device, a nearest neighbor method (selecting a density value at a closest point) or a linear interpolation method (linear interpolation from four neighboring points) is employed. The nearest neighbor method and the linear interpolation method are described in "Practical image processing learned in C language" co-authored by Ohmsha Yagi et al.

[0003]

When the above-described interpolation device is used in an electronic zoom device for enlarging or reducing an image, the f-characteristics are reduced, resulting in reduced sharpness and reduced resolution. As a result, it looks blurred. In particular, when the diagonal lines and circles are enlarged, it becomes conspicuous. SUMMARY OF THE INVENTION An object of the present invention is to provide an interpolating device that prevents a reduction in sharpness. Another object of the present invention is to appropriately switch and use interpolation data obtained from different interpolation means,
An object of the present invention is to provide an interpolation device capable of preventing a reduction in resolution and an imaging device using the same.

[0004]

In the interpolation apparatus according to the present invention, first interpolation means for obtaining an extrapolation point from original interpolation data generated before generated interpolation data and using the same as interpolation data; A second extrapolation point is determined from the original interpolation data generated after the generated interpolation data, and is used as interpolation data.
Interpolation means. Further, in the present invention, a third interpolation means for generating interpolation data using the original data for interpolation before and after the generated interpolation data is used. The outputs of the plurality of interpolation means are switched by the selection means. The selection means has a calculation means, and calculates the output of the third interpolation means and the output of the other interpolation means. The output of the calculation means and the output of the third interpolation means are selected and output by the selection means. Further, there is provided control means for controlling the selection means based on the arrangement of the interpolation source data. In the imaging device using the interpolation device of the present invention, zoom control means is supplied to the interpolation means,
Used to generate interpolation data.

[0005]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below using some examples. FIG. 9 is a schematic diagram showing an adaptive interpolation method. In the figure, the horizontal axis indicates the order PO of the pixel signals, and the vertical axis indicates the signal level V of the pixels. The adaptive interpolation processing will be described in detail with reference to FIG. In the following, three-point interpolation will be described, which is equivalent to 4 × zoom magnification. In FIG. 9, black dots are pixel sample data used for interpolation, and pixel samples are A,
B, C, and D are output in this order. The pixel sample data A and B are original data for interpolation generated before the generated interpolation data, and the pixel sample data C and D are original data for interpolation generated after the generated interpolation data. Further, the slope of the line connecting the black ball A and the black ball B of the pixel sample data is ta, the slope of the line connecting the black ball C and the black ball D of the pixel sample data is tb, and the black ball of the pixel sample data is tb. B
The inclination of the line connecting the black ball C and the black ball C is tk. Now, interpolation of black ball B and black ball C of the pixel sample data is performed. The positions of the interpolation data are a, b, and c from the left as shown in the figure.

For example, interpolation data at point a is obtained. First, the values of a white square point (white square point) on the line of the slope ta at the position of the point a and a black square point (black square point) on the line of the slope tb are determined. Here, the white angle points are interpolation data generated from the previous interpolation original data (black ball A of pixel sample data) and the current interpolation original data (black ball B of pixel sample data).
This is called pre-tilt interpolation data. The black square points are interpolation data generated from the current original data for interpolation (black ball C of pixel sample data) and the subsequent original data for interpolation (black ball D of pixel sample data). Called data. As shown in FIG. 9, if the data is an array of upwardly convex data, the smaller one of the data just obtained is selected and used as interpolation data at the position of the point a. Similarly, the interpolation data at the positions of the points b and c are obtained. Therefore, in this case, the interpolation data at points a and b is a white angle point on a line having a slope ta, and the interpolation data at point c is a black angle point on a line having a slope tb. Naturally, if the data is a row of downwardly convex data, the larger data is selected.
Such an interpolation method is called gradient interpolation. Incidentally, the interpolation data when the linear interpolation is performed is a white circle point on the slope tk.

By performing the gradient interpolation as described above, it is possible to perform the interpolation with a more natural data flow than the arrangement of the linear interpolation data (white circle points). Further, an interpolation point may be obtained under some conditions from the gradient interpolation data and the linear interpolation data, and may be used as the interpolation data. However, depending on the positions of the black balls A, B, C, and D of the pixel sample data for interpolation, it may occur that the judgment cannot be made only by the magnitude. In some cases, linear interpolation is better depending on the arrangement of pixel sample data. Therefore, let us consider a condition in which tilt interpolation cannot be performed by considering the pattern of arrangement of pixel sample data, or a condition in which tilt interpolation should not be performed, that is, a tilt interpolation prohibition condition.

Various patterns can be considered, but the slope tk
10A, FIG. 10B, FIG. 10C
It becomes as shown by. FIGS. 10A, 10B, and 10C are schematic diagrams showing types of arrangement patterns of the pixel sample data, respectively. The slopes tk = 0, tk> 0, and tk <0 of the black balls B and C of the pixel sample data are shown. Show the case. FIG.
In FIG. 10A to FIG. 10C,,, are the pixel sample data, tk is the slope with respect to the pixel sample data,
A pattern surrounded by a large circle is a pattern for which tilt interpolation can be performed. As shown in FIG.
Individual patterns are possible. 1 with a circle out of 59
Four patterns are patterns that can be inclinedly interpolated. For the remaining patterns, linear interpolation is appropriate. 10A and 10
B, from FIG. 10C, it can be seen that patterns that can be inclinedly interpolated can be roughly classified into data arrangements that are convex upward and convex downward.

Here, the prohibition conditions, which are conditions under which the gradient interpolation is impossible or should not be performed, are defined as gradients ta, tk, tb.
Then, the following equation is obtained.

[0010]

(Equation 1)

[0011]

(Equation 2)

[0012]

(Equation 3)

[0013]

(Equation 4)

[0014]

(Equation 5)

[0015]

(Equation 6)

Or

[0017]

(Equation 7)

In the above formula, "&&" means "and". For example, ta> = 0 && tb <= 0 indicates that the slope ta is 0 or more and the slope tb is 0 or less. “||” means “or”. For example,
tk <0 || (ta> = tk &&tb> = tk) indicates a case where the slope tk is smaller than 0 or the slope ta is equal to or greater than the slope tk and the slope tb is equal to or greater than the slope tk. Furthermore,
"!" Represents negation. The case of Equation 7 indicates that the condition is not the condition in the outer parentheses. Therefore, it can be seen that it is appropriate to perform linear interpolation when the conditions of Expressions 1 to 6 or the condition of Expression 7 are used, and to perform inclination interpolation in other cases.
By determining the above conditions, adaptive interpolation between linear interpolation and gradient interpolation, that is, appropriate interpolation can be performed based on the arrangement of pixel sample data. By doing so, the sharpness can be prevented from lowering, so that zoom processing for outputting an image closer to the original image can be performed. In addition, a decrease in resolution can be prevented. For example, in the schematic diagram showing the pixel state in FIG.
When the pixels are indicated by black squares, when the diagonal lines are enlarged vertically and horizontally by two times, when the original data of the diagonal lines shown in FIG. 11A are linearly interpolated, as shown in FIG. However, in the slope interpolation, the oblique lines become clear as shown in FIG. By using the slope interpolation in this manner, blurring when the oblique lines are enlarged is reduced.

An embodiment of an image pickup device incorporating a linear interpolation device and a gradient interpolation device will be described below with reference to FIGS. 1, 2, 3, 4, 5, and 9. FIG. 1 is a block diagram of an imaging apparatus using a first embodiment of an interpolation device according to the present invention. In FIG. 1, the inside of the broken line is the electronic zoom device 100 including the interpolation device. Reference numeral 1 denotes an image sensor that performs photoelectric conversion, 2 denotes an A / D converter that converts an analog signal from the image sensor 1 into a digital signal, 3 denotes a camera signal processing circuit that performs general signal processing of a camera, and 4 denotes brightness. And a line memory for storing color signals for each line.
Is a prohibition condition determining circuit for determining whether to perform linear interpolation or gradient interpolation, 6 is a zoom control circuit that calculates a coefficient required for interpolation, and 7 is a pre-tilt interpolation circuit that calculates interpolation data from previous data. , 8 is a post-tilt interpolation circuit that calculates interpolation data from subsequent data, 9 is an interpolation determination circuit that determines the arrangement of data and selects either pre-tilt interpolation data or post-tilt interpolation data, and 10 is inversely proportional to distance A linear interpolation circuit 11 for performing interpolation by assigning weights, and a selection circuit 11 for selecting linear interpolation data from the linear interpolation circuit 10 or gradient interpolation data from the interpolation determination circuit 9 according to a prohibition condition.

The operation of the image pickup apparatus configured as described above will be described below. The video signal photoelectrically converted by the image sensor 1 is converted into a digital signal by the A / D converter 2 and then converted into a luminance signal and a color difference signal by the camera signal processing circuit 3. In order to perform vertical interpolation, the luminance signal and the color difference signal are temporarily written to the line memory 4, and the output read from the line memory 4 is input to the inhibition condition determination circuit 5.

FIG. 2 is a block diagram showing one embodiment of the prohibition condition determination circuit. In the figure, a luminance signal and a chrominance signal input to an input terminal 50 of a prohibition condition determination circuit are stored in a holding circuit 5.
11, 512, and 513, respectively. Here, the current signal is u, the signal stored in the holding circuit 511 is t,
The signal stored in the holding circuit 512 is denoted by s, and the holding circuit 513
Let r be the signal stored in. Here, r, s, t, and u correspond to the pixel sample data A, B, C, and D in FIG. 9, respectively. Hereinafter, a case where the interpolation data of the signal s and the signal t is obtained will be described. s and t are also output to output terminals 56 and 57, respectively.

First, in order to consider the flow of data from the rear, the slope of the signal level of the signal t and the signal u is calculated by the rear slope calculating circuit 52 (corresponding to the slope tb in FIG. 9), and the data from the front is calculated. The slope of the signal level of the signal r and the signal s is calculated by the pre-slope operation circuit 54 in order to consider the flow of
Corresponding to). At the same time, the slope calculating circuit 53 calculates the slope of the signal level of the signal s and the signal level for the prohibition condition determination (FIG. 9).
(Corresponding to the slope tk). The slopes of the three signal levels obtained above are defined as tb, ta, and tk, respectively. The condition determining circuit 55 determines whether or not the slope interpolation is possible based on the slopes tb, ta and tk. As the determination conditions, the expressions of the above-described equations 1 to 6 (or 7) are used.

When the conditional expressions of Expressions 1 to 6 (or Expression 7) are satisfied, it means that the gradient interpolation is impossible or not suitable, and the condition determination circuit 55
A signal that selects the output of the linear interpolation circuit 10 at 1 is output to the output terminal 58. If number 1 to number 6 (or number 7)
Is not satisfied, the selection circuit 11 outputs to the output terminal 58 such a signal that the output of the interpolation determination circuit 9 is selected. At this time, the correct interpolation data obtained by the slope interpolation is selected and output as the output of the interpolation determination circuit 9.
The slope tb, which is the output of the rear slope calculating circuit 52, is output to the output terminal 520, and the slope tb, which is the output of the front slope calculating circuit 54, is output.
a is output to the output terminal 540. The signal s output from the output terminal 56 is input to the linear interpolation circuit 10 and the pre-tilt interpolation circuit 7 in FIG. The signal t output from the output terminal 57 is input to the linear interpolation circuit 10 and the post-tilt interpolation circuit 8 of FIG. Slope ta output from output terminal 540
Is input to the interpolation determination circuit 9 and the pre-tilt interpolation circuit 7 in FIG. The slope tb output from the output terminal 520 is shown in FIG.
Are input to the interpolation determination circuit 9 and the post-tilt interpolation circuit 8. Further, the data corresponding to the interpolation positions a, b, and c in FIG. 9, that is, the distance data from the pixel sample data B to a or the distance data from a to the pixel sample data C at the position a is calculated by interpolation. Is necessary. This is calculated by the zoom control circuit 6, and the result is input to the linear interpolation circuit 10, the front inclination interpolation circuit 7, and the rear inclination interpolation circuit 8. Here, the result calculated by the zoom control circuit 6 is called an interpolation coefficient X. The linear interpolation circuit 10 calculates interpolation data I based on the input signal s, signal t, and interpolation coefficient X.

For example, when the interpolation coefficient (distance) from the interpolation data to be obtained to the signal t is X, the interpolation data I to be obtained may be calculated by the following equation. I = s ・ X + t ・ (1-X) = t + (s-t) ・ X (8) At this time, if the distance between the signal s and the signal t is 1, 0 <X <1
However, in an actual circuit, the distance between the signals of the original data for interpolation is not normalized to 1, and may be, for example, 256. The linear interpolation circuit 10 may be assembled so as to satisfy the above expression. The calculated interpolation data I is input to the selection circuit 11. At the same time, interpolation data is calculated by the front slope interpolation circuit 7 and the rear slope interpolation circuit 8, respectively.

FIG. 3 is a block diagram showing one embodiment of the pre-tilt interpolation circuit. In the figure, after the interpolation coefficient X inputted from the input terminal 70 is converted into (1-X) by the subtraction circuit 74, The multiplication circuit 71 multiplies the slope ta input from the input terminal 540. The output and the signal s input from the input terminal 56 are added by the adding circuit 72. The result of the addition becomes the pre-tilt interpolation data Ia using the information from the previous time. Expressing the pre-tilt interpolation data Ia by an equation is as shown in Expression 9. Ia = s + ta (1-X) (9) The pre-tilt interpolation data Ia thus obtained is input to the interpolation determination circuit 9 through the output terminal 73.

FIG. 4 is a block diagram showing an embodiment of the post-tilt interpolation circuit. The multiplication circuit 81 multiplies the interpolation coefficient X inputted from the input terminal 80 by the inclination tb inputted from the input terminal 520. The output of the multiplication circuit 81 is subtracted by the subtraction circuit 82 from the signal t input from the input terminal 57. The result of this subtraction becomes the post-interpolation data Ib using the information obtained later. When expressed by an expression, it becomes like Equation 10. Ib = t−tb · X (10) The inclination interpolation data Ib obtained in this way is input to the interpolation determination circuit 9 of FIG.
Further, the subtraction circuit 74 in the front tilt interpolation circuit 7 may be built in the rear tilt interpolation circuit 8 depending on the setting of the interpolation coefficient X output from the zoom control circuit 6.

FIG. 5 is a block diagram showing an embodiment of the interpolation judging circuit. In the interpolation judging circuit shown in FIG. 5, the data of the front slope interpolation data Ia or the data of the rear slope interpolation Ib is obtained depending on the arrangement of the interpolation original data. It is determined whether to take. First, the slope tb input from the input terminal 520 and the input terminal 540
Is input to the up / down determination circuit 91. The arrangement of data for which the slope interpolation can be performed is roughly classified into upwardly convex or downwardly convex. For example, data A, B, C,
The arrangement of D is convex upward. The up / down determination circuit 91 outputs 0 if it is upwardly convex and 1 if it is downwardly convex. At the same time, the pre-tilt interpolation data Ia input from the input terminal 73
After that, the slope interpolation data Ib input from the input terminal 83 is compared by the comparison circuit 90 in magnitude. Now, assuming that the projection is upward as shown in FIG. 9, the comparison circuit 90 outputs a signal such that the selection circuit 93 outputs Ia if Ia <= Ib, and the selection circuit 93 if Ia> = Ib. Outputs a signal that outputs Ib. By doing this,
Correct interpolation data suitable for the signal flow can be selected. E
The OR circuit 92 is composed of a two-input exclusive-OR gate. If one value is 0, the other value is output through, and if one value is 1, the other value is inverted. And output. Assuming that the data arrangement is upwardly convex, the output of the up / down determination circuit 91 is 0, and the EOR circuit 92 outputs the signal of the comparison circuit 90 through. or,
If it is convex downward, since the output of the up / down determination circuit 91 is 1, the EOR circuit 92 inverts the signal of the comparison circuit 90 and outputs it. That is, in the case of a convex downward, Ia <=
If the relation is Ib, the selection circuit 93 outputs Ib,
If a> = Ib, the selection circuit 93 outputs Ia. As described above, the EOR circuit 92 can obtain correct interpolated data in which the data is arranged when the arrangement of data is convex upward or downward. The correct gradient interpolation signal selected in this way is output through an output terminal 94, and the selection circuit 1 of FIG.
1 is input. The selection circuit 11 selects the output of the linear interpolation circuit 10 if the prohibition condition is satisfied by the signal output from the prohibition condition determination circuit 5, and selects the output of the interpolation determination circuit 9 if the prohibition condition is not satisfied. The above series of operations are common to the luminance signal and the chrominance signal. Further, by configuring the line memory 4 with three lines, interpolation in the vertical direction is also possible.

As described above, according to the first embodiment, by appropriately switching the interpolation data, it is possible to perform interpolation in accordance with the flow of the video signal data, thereby preventing the sharpness from being lowered, and consequently, This also prevents the resolution from being lowered. Therefore, blurring when the magnification is increased by the electronic zoom can be prevented.

Next, a second embodiment will be described with reference to FIG. FIG. 6 is a lock diagram of an image pickup apparatus using the second embodiment of the interpolation apparatus according to the present invention, and shows blocks corresponding to the electronic zoom apparatus 100 of the image pickup apparatus of FIG. 6, the blocks having the same functions as the blocks in FIG. 1 are denoted by the same reference numerals. The output of the linear interpolation circuit 10 and the output of the interpolation determination circuit 9 are input to the interpolation circuit 20. The microcomputer 21 calculates the coefficients for the interpolation operation by the interpolation circuit 20.
To enter. Further, a signal for selecting either linear interpolation data or gradient interpolation data output from the prohibition condition determination circuit 5 is input to the interpolation circuit 20. If only the data of the gradient interpolation is used as in the first embodiment, the sharpness may be too high. For example, as shown in FIG.
As a becomes larger than 1 or the absolute value of the slope tb becomes larger than 1, the interpolation data to be obtained is far from the flow of the interpolation original data. Therefore, the interpolation circuit 20 obtains an interpolation point between the linear interpolation data and the gradient interpolation data, that is, a value between the linear interpolation data and the gradient interpolation data, and uses the value as interpolation data. Extreme sharpness can be eliminated by setting the degree of the interpolation by the microcomputer 21. For example, if the microcomputer 21 sets a coefficient for the interpolation point to be located near the middle between the linear interpolation data and the gradient interpolation data, the extreme sharpness can be eliminated and a certain degree of sharpness can be maintained. The interpolation may be calculated using a weight inversely proportional to the distance, similarly to the interpolation calculation method of the linear interpolation circuit 10.

In the interpolation circuit 20, the interpolation operation is not performed in all cases, and the interpolation operation is performed only when the prohibition condition is not satisfied. If the prohibition condition is satisfied, the linear interpolation data is output as it is. Therefore, the interpolation circuit 20 includes a selection circuit for selecting data resulting from performing the interpolation operation and linear interpolation data.

As described above, according to the second embodiment, by taking a value between the linear interpolation data and the gradient interpolation data at the time of performing the gradient interpolation, extreme sharpness can be prevented, so that an unsightly edge on the screen is obtained. The emphasis becomes inconspicuous.

As described above, in this embodiment, since a value between the linear interpolation data and the slope interpolation data is taken at the time of performing the slope interpolation, an extreme sharpness can be prevented, so that unsightly edge enhancement on the screen is performed. The parts can be made inconspicuous.

Next, a third embodiment will be described with reference to FIG. FIG. 7 is a block diagram of an imaging apparatus using a third embodiment of the interpolation apparatus according to the present invention. FIG. 7 is different from the block diagram of FIG. 5 in that the interpolation circuit 20 in FIG. 6 is changed to a variable interpolation circuit 31 and a shape determination circuit 30 is added. In FIG.
Blocks having the same functions as the blocks in FIG. 6 are assigned the same common numbers. According to the second embodiment, extreme sharpness can be eliminated by using the interpolation points of the linear interpolation data and the slope interpolation data. However, the effect is obtained unless the interpolation points are set to values close to the linear interpolation data. There is no. However, if the interpolation point is set to a value close to the linear interpolation data, the sharpness of the entire screen may be reduced. Therefore, when the absolute values of the inclinations ta and tb are large, the interpolation point is used as interpolation data as in the second embodiment, but when the absolute values of the inclinations ta and tb are not so large, the inclination interpolation data is used as interpolation data. Whether the inclination is large or small is determined here with the inclination 1 as the threshold value. Of course, this threshold value is not limited to one.

More specifically, if the data arrangement is upwardly convex as shown in FIG. 9, if ta> 1, | tb |> 1, it is determined that the flow is far from the flow of the original data. Selects interpolation points for linear interpolation and gradient interpolation. In cases other than the above conditions, the inclination interpolation data is selected. Similarly, when it is convex downward, | ta |> 1, tb
If> 1, it is determined that the flow is far from the flow of the original data. At that time, interpolation points for linear interpolation and gradient interpolation are selected. In cases other than the above conditions, the inclination interpolation data is selected. The shape determination circuit 30 performs the above-described determination based on the slopes ta and tb of the output of the prohibition condition determination circuit 5 and outputs a signal such that correct interpolation data is selected by the variable interpolation circuit 31.

FIG. 8 is a block diagram showing one embodiment of the variable interpolation circuit. In the figure, an input terminal 311 receives linear interpolation data output from the linear circuit 10. An interpolation coefficient output by the microcomputer is input to the input terminal 312. The input terminal 94 receives the slope interpolation data output by the interpolation determination circuit 9. The interpolation calculation circuit 314 calculates an interpolation point from the linear interpolation data, the interpolation coefficient, and the slope interpolation data. The calculation at this time can be performed in the same manner as the interpolation processing performed by the linear interpolation circuit 10. Selection circuit 3
Reference numeral 15 selects either the output of the interpolation operation circuit 314 or the slope interpolation data according to the output of the shape determination circuit 30 input to the input terminal 313. The selection circuit 315 suppresses unnecessary sharpness by selecting the output of the interpolation calculation circuit 314 when the shape determination circuit 30 determines that the flow is far from the flow of the original data, and does not depart from the flow of the original data. When it is determined that the inclination interpolation data is selected, sharpness can be enhanced. The selection circuit 316 is connected to the input terminal 58
Either the linear interpolation data or the output of the selection circuit 315 is output to the output terminal 317 according to the output of the prohibition condition determination circuit 5 input to the output terminal 317. That is, the selection circuit 316 selects the linear interpolation data when the prohibition condition is satisfied, and selects the output of the selection circuit 315 when the prohibition condition is not satisfied. As mentioned above,
In the embodiment, since the interpolation method is switched according to the result of the determination of the flow of the original data, unnecessary sharpness can be suppressed, and an appropriate sharpness can be maintained by setting the interpolation point, so that the entire screen becomes smaller. I can see

As described above, according to this embodiment, by switching the interpolation method based on the result of the determination of the flow of the original data, unnecessary sharpness can be suppressed, and appropriate sharpness can be maintained by setting interpolation points. So you can see the whole screen.

[0037]

As described above, according to the present invention, by appropriately switching the interpolation data obtained from different interpolation means, interpolation suitable for the data flow of the video signal can be performed, and the sharpness can be reduced. Thus, the resolution can be prevented from lowering. Therefore, blurring when the magnification is increased by the electronic zoom can be prevented.

[Brief description of the drawings]

FIG. 1 is a block diagram of an imaging device using a first embodiment of an interpolation device according to the present invention.

FIG. 2 is a block diagram showing one embodiment of a prohibition condition determination circuit of FIG. 1;

FIG. 3 is a block diagram showing one embodiment of a pre-tilt interpolation circuit of FIG. 1;

FIG. 4 is a block diagram showing an embodiment of the post-tilt interpolation circuit of FIG. 1;

FIG. 5 is a block diagram showing one embodiment of an interpolation determination circuit of FIG. 1;

FIG. 6 is a block diagram of an imaging device using a second embodiment of the interpolation device according to the present invention.

FIG. 7 is a block diagram of an imaging apparatus using a third embodiment of the interpolation apparatus according to the present invention.

FIG. 8 is a block diagram showing one embodiment of the variable interpolation circuit of FIG. 7;

FIG. 9 is a schematic diagram showing an adaptive interpolation method.

FIG. 10A is a schematic diagram showing a pattern of arrangement of pixel sample data.

FIG. 10B is a schematic diagram showing a pattern of arrangement of pixel sample data.

FIG. 10C is a schematic diagram showing a pattern of arrangement of pixel sample data.

FIG. 11 is a schematic diagram illustrating a state of a pixel.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Image sensor, 2 ... A / D converter, 3 ... Camera signal processing circuit, 4 ... Line memory, 5 ... Prohibition condition determination circuit,
6 zoom control circuit, 7 front tilt interpolation circuit, 8 rear tilt interpolation circuit, 9 interpolation determination circuit, 10 linear interpolation circuit, 1
DESCRIPTION OF SYMBOLS 1 ... Selection circuit, 100 ... Electronic zoom apparatus, 20 ... Interpolation circuit, 21 ... Microcomputer, 30 ... Shape determination circuit, 31 ... Variable interpolation circuit, 314 ... Interpolation arithmetic circuit, 315, 316 ... Selection circuit, 511, 512, 513: holding circuit, 52: rear inclination operation circuit, 53: inclination operation circuit, 54: front inclination operation circuit, 55: condition determination circuit, 71: multiplication circuit, 72: addition circuit, 74: subtraction circuit, 81 ... Multiplication circuit, 82: subtraction circuit, 91: up / down determination circuit, 92: EOR circuit, 93: selection circuit.

Claims (34)

[Claims] 1. An interpolation apparatus for generating interpolation data from data obtained from a plurality of interpolation means. 2. An interpolation apparatus comprising: a plurality of interpolation means; and a selection means for selecting the plurality of interpolation means. 3. An interpolation apparatus according to claim 2, wherein said selection means selectively outputs the outputs of said plurality of interpolation means. 4. An interpolating apparatus according to claim 2, wherein said plurality of interpolating means include first and second interpolating means, and arithmetic means for calculating data obtained from said first and second interpolating means. An interpolating device comprising: 5. An interpolation apparatus according to claim 4, wherein said selection means selects data from said first interpolation means and data from said calculation means and outputs the selected data as interpolation data. . 6. An interpolation apparatus according to claim 2, wherein said plurality of interpolation means include a linear interpolation circuit, a front slope interpolation circuit, and a rear slope interpolation circuit, and said linear interpolation data from said linear interpolation circuit; An interpolating apparatus, further comprising a calculating means for calculating the slope interpolation data from one of the front slope interpolation circuit and the rear slope interpolation circuit. 7. An interpolation apparatus according to claim 6, wherein said selection means selectively outputs linear interpolation data obtained from said linear interpolation circuit and interpolation data obtained from said calculation means. apparatus. 8. The interpolation apparatus according to claim 6, wherein said slope interpolation data includes front slope interpolation data and rear slope interpolation data, and said selecting means includes said linear interpolation data, said front slope interpolation data, and said rear slope interpolation data. An interpolation device for selectively outputting slope interpolation data and the calculated interpolation data. 9. An interpolation apparatus according to claim 6, wherein the calculation by said calculation means calculates an interpolation point between said linear interpolation data and said gradient interpolation data. 10. An interpolation apparatus comprising: a plurality of interpolation means; a selection means for selecting said interpolation means; and a control means for controlling said selection means. 11. An interpolation apparatus according to claim 10, wherein said control means has a judgment circuit for judging which output of said plurality of interpolation means is to be passed. And an interpolating device for controlling the selecting means. 12. An interpolation apparatus according to claim 10, wherein said selection means selectively outputs the outputs of said first interpolation means and another interpolation means. 13. The interpolating device according to claim 10, wherein said plurality of interpolating means comprises first, second, and third interpolating means, and said selecting means includes an output of said first interpolating means and said second interpolating means. A first selection means for selectively outputting the output of the second interpolation means, and a second selection means to which the output of the third interpolation means and the output of the first selection means are inputted. The control means includes a determination means for determining whether the first, second, and third interpolation means are appropriate, and controls the first and second selection means according to an output of the determination means. An interpolation device, characterized in that: 14. An interpolation apparatus according to claim 13, wherein said second selection means selectively outputs an output of said third interpolation means and an output of said first selection means. apparatus. 15. An interpolation apparatus according to claim 13, wherein said second selection means has a calculation means for calculating an output of said third interpolation means and an output of said first selection means. Interpolator. 16. The interpolation apparatus according to claim 13, wherein said second selecting means has a calculating means for calculating an output of said third interpolating means and an output of said first selecting means. And an output of the third interpolation means is selectively output. 17. An interpolation apparatus according to claim 13, wherein said second selection means has a calculation means for calculating an output of said third interpolation means and an output of said first selection means. And an output of the third interpolation means and an output of the first selection means are selectively output. 18. An interpolation apparatus according to claim 13, wherein said first interpolation means has a front slope interpolation circuit, said second interpolation means has a rear slope interpolation circuit, and said third interpolation means. Is an interpolation device having a linear interpolation circuit. 19. An interpolation apparatus according to claim 2, wherein said plurality of interpolation means obtains an extrapolation point from original interpolation data before the interpolation data to be generated, and sets the extrapolation point as interpolation data. Using interpolation means, obtaining an extrapolation point from the original interpolation data after the interpolation data to be generated, and using that as interpolation data, and using the interpolation original data before and after the interpolation data to be generated. An interpolation device comprising: a third interpolation unit that outputs interpolation data. 20. An interpolation apparatus according to claim 19, wherein said control means has a judging means for detecting a slope of said interpolation original data and judging whether the arrangement of signals is convex upward or downward. If the arrangement of the interpolation original data is convex upward,
The smaller of the output of the first interpolation means and the output of the second interpolation means is selected, and if the arrangement of the interpolation original data is convex downward, the output of the first interpolation means and Second
An interpolating device which selects a larger one of the outputs of the interpolating means, and selects the third interpolating means if the arrangement of the interpolation original data is neither convex nor convex. 21. An interpolation apparatus according to claim 2, further comprising an arithmetic means, wherein said arithmetic means includes means for mixing the outputs of the selected plurality of interpolation means at a certain ratio. Interpolation device. 22. An interpolation apparatus according to claim 10, wherein said plurality of interpolation means include first interpolation original data of generated interpolation data and a second interpolation original data immediately before said first original data. A first interpolation unit that uses an extrapolation point with the interpolation original data as interpolation data, a third interpolation original data of the generated interpolation data, and a fourth interpolation data subsequent to the third original data. A second interpolating unit that uses an extrapolation point with the original data for interpolation as interpolation data; and a third interpolating unit that generates interpolation data by performing weighting inversely proportional to the distance of the interpolated data. Interpolation device. 23. An interpolation apparatus according to claim 22, wherein said control means arranges said first, said second, said third and said fourth interpolation original data in the order of generation of said data, and And determining means for detecting the slope of the first to fourth interpolation original data to determine whether the signal sequence is upward or downward. If the signal sequence is upwardly convex, The smaller of the output of the first interpolation means and the output of the second interpolation means is selected, and if the arrangement of the signals is convex downward, the output of the first interpolation means and the output of the second interpolation means are selected. An interpolating apparatus, wherein the selecting means controls the selecting means so as to select the output of the third interpolating means if a signal having a larger output is selected and the arrangement of the signals is neither convex nor convex. 24. An interpolation apparatus according to claim 23, wherein the output of the interpolation means selected when the arrangement of the signals is convex upward or downward is multiplied by a coefficient, and the coefficient is changed. , An interpolating device provided with means for changing a value. 25. An interpolation apparatus according to claim 23, wherein the output of the interpolation means selected when the arrangement of the signals is upwardly convex or downwardly convex and the output of said third interpolation means are determined in advance. An interpolating device comprising means for generating interpolation data by mixing at a predetermined ratio. 26. An interpolating means for obtaining an extrapolation point from interpolation original data generated before generated interpolation data and using it as interpolation data, and extrapolating from interpolation original data generated after generated interpolation data. An interpolating apparatus comprising: another interpolating means for obtaining an insertion point and using the obtained interpolation point as interpolation data. 27. An interpolation apparatus according to claim 26, wherein the interpolation data is generated by using interpolation original data before and after the generated interpolation data. 28. An image pickup apparatus for converting an output of an image pickup device into a digital signal and processing the signal by a signal processing circuit, wherein a plurality of interpolation means for generating interpolation data from the original data for interpolation; A zoom control circuit that outputs distance data between data; and a selection unit that selects an output of the interpolation unit. The interpolation unit outputs interpolation data based on the distance data and the original data for interpolation. An imaging device characterized by the above-mentioned. 29. An imaging apparatus according to claim 28, further comprising control means for controlling said selection means. 30. An imaging apparatus according to claim 28, wherein said interpolation means comprises first, second, and third interpolation means.
The selection means selectively outputs the output of the first interpolation means and the output of the second interpolation means; the output of the third interpolation means and the first selection means; And the second selection means to which the output of the first interpolation means is inputted. The control means comprises a judgment means for judging whether the first, the second and the third interpolation means are appropriate. An imaging device that controls the third interpolation means and the second selection means by means of 31. An imaging apparatus according to claim 28, wherein said second selection means selectively outputs an output of said third interpolation means and an output of said first selection means. apparatus. 32. An imaging apparatus according to claim 28, wherein said second selecting means has an arithmetic means for performing an interpolation operation on an output of said third interpolating means and an output of said first selecting means. Imaging device. 33. An image pickup apparatus according to claim 28, wherein said second selecting means has a calculating means for calculating an output of said third interpolating means and an output of said first selecting means. And an output of the third interpolation means. 34. An image pickup apparatus according to claim 28, wherein said second selecting means has a calculating means for calculating an output of said third interpolation means and an output of said first selecting means, and said calculating means. An image pickup apparatus for selectively outputting an output of the first interpolation means, an output of the third interpolation means, and an output of the first selection means.