JPH09130728A - Image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a dynamic image with a natural motion and a sense of resolution. SOLUTION: The image pickup device is provided with a camera signal processing means B that generates a 1st video signal and a 2nd video signal in compliance with standard television signals from an image pickup signal outputted from an image pickup means A reading sequentially signals of each picture element without addition to generate the image pickup signal, an output signal selection means C that selects either of the 1st video signal and the 2nd video signal outputted from the camera signal processing means B, and a signal recording means D that records a content of the selected video signal onto a sub code recording area of a recording medium E as a signal mode. When the signal mode recorded in the sub code recording area indicates the frame image pickup mode, an interpolation filter G conducting time base interpolation is activated to reproduce continuously smoothly the data recorded in the recording medium E even when the data are all frame still images.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging device,
In particular, it is suitable for use in an image pickup apparatus including a progressive scanning solid-state image pickup element.

[0002]

2. Description of the Related Art In recent years, with the progress of semiconductor technology, a solid-state image sensor capable of sequentially reading out the signals of all pixels (all-pixel read solid-state image sensor, hereinafter referred to as all-pixel image sensor) Is being developed.

[0003] These image pickup devices have the advantages of less blurring even for a moving subject and being able to capture an image with high resolution, as compared with the conventional interlaced scan (interlaced scan) image pickup device. There is.

That is, in the interlaced image pickup device, 1
Since the image of the frame is composed of two field images which are shifted by one field period, when a fast-moving subject is imaged, there is a problem that jaggedness occurs due to a time difference between fields. If the one-field image is taken out in order to eliminate such inconvenience, the jagged edges are eliminated, but the image information in the vertical direction is halved, so that the vertical resolution becomes halved.

On the other hand, since the all-pixel image pickup element can pick up an image of a subject for one frame at the same time,
The problem as described above does not occur. Taking advantage of this feature, the all-pixel imaging device is applied to a still image capturing camera, an input device of a computer, and the like.

In still image output devices such as video printers, which have become rapidly popular in recent years, the user can arbitrarily select a preferable scene in a video image captured as a moving image as a still image. ing. Therefore, the all-pixel image pickup device is also expected as an image pickup unit of a video camera capable of shooting both still images and moving images.

[0007]

As described above, when the all-pixel image pickup device is used as an image pickup unit of a video camera capable of shooting both still images and moving images, there are several methods of generating moving images when shooting moving images. To be

For example, as shown in FIG. 7, a case where an image pickup apparatus using an all-pixel image pickup element is used as an NTSC digital video camera will be described. The all-pixel image sensor 1 is in the two-channel output mode, and each channel constantly outputs the even-numbered and odd-line video signals of the all-pixel imager 1.

In FIG. 7, the video signals of the even line and the odd line output from the all-pixel image sensor 1 are read by the TG 15 from two lines of the all-pixel image sensor 1. The CDS circuits 201 and 202 and the AGC circuit 30 which are switched independently for each one field period and are provided independently of each other
It is sent to A / D converters 401 and 402 via 1 and 302.

Then, the A / D converters 401 and 402
After being converted from an analog signal to a digital signal, the signal is sent to the camera signal processing circuit 5. The camera signal processing circuit 5 performs signal processing such as color separation, contour enhancement, and color correction after converting the video signals of even lines and odd lines into dot order.

After the above processing is completed, the camera signal processing circuit 5 divides one frame image, outputs the field image data produced in the first field period through the first channel ch1, and outputs the second field. The field image data created during the period is output via the second channel ch2.

By the way, in the all-pixel image pickup device 1, one frame image is generated in one field period, but the recording device side (hereinafter, digital VTR) can record only one field image in one field period. .

Therefore, as shown in FIG. 4A, by using only one of the video signals of the first channel ch1 and the second channel ch2, an image of one field can be obtained in one field period. It is possible to output (hereinafter referred to as field shooting mode).

The camera signal processing circuit 5 includes first and second camera signal processing circuits.
In the field period, the field image data # 1 and # from the first channel ch1 of the camera signal processing circuit 5
2 to the first frame memory 60 according to the control signal C1.
Write sequentially to 1.

Meanwhile, if the image data is already written in the second frame memory 602, the image data of the immediately preceding frame is encoded by the encoding processing circuit 7 according to the control signal C2.
Then, after being subjected to processing such as DCT and shuffling, it is recorded as a digital video signal on the magnetic tape 9 from the recording head 8 by a recording method according to the format.

When the image data for one frame is written in the first frame memory 601, the camera signal processing circuit 5 receives the data from the first channel ch1 of the camera signal processing circuit 5 in the third and fourth field periods. The field image data # 3 and # 4 are set to the second according to the control signal C2.
The frame memory 602 is sequentially written.

In the meantime, the image data of one frame before written in the first frame memory 601 is sent to the encoding processing circuit 7 and is subjected to the same processing as described above, and the recording method according to the format is adopted. And recorded as a digital video signal on the magnetic tape 9 from the recording head 8.

The video signal thus recorded is subjected to the processing shown in FIG. 4 (B) during reproduction. First, the video signal obtained from the magnetic tape 9 via the reproducing head 10 is sent to the decoding processing circuit 11 in the first and second field periods to undergo signal processing such as I-DCT and deshuffling, and then, It is written in the third frame memory 121 in accordance with the control signal C3.

Meanwhile, if the image data has already been written in the fourth frame memory 122, the decoding processing circuit 1
1 indicates the fourth frame memory 12 according to the control signal C4.
Interlace reading is performed from 2, and the image data is divided into even fields and odd fields to reproduce the image.

In the third and fourth field periods, the video signal obtained from the magnetic tape 9 through the reproducing head 10 is sent to the decoding processing circuit 11 and is subjected to processing such as I-DCT and deshuffling. , Is written in the fourth frame memory in accordance with the control signal C4.

In the meantime, the decoding processing circuit 11 performs interlaced reading from the third frame memory 121 in accordance with the control signal C3, and outputs the image data in even fields.
The image is reproduced by dividing it into odd fields.

In the encoded signal processing circuit 11 used in the above-mentioned conventional example, the video signals output from the first channel ch1 and the second channel ch2 are as shown in FIG.
Since it corresponds to the image of the even line field and the odd line field of the all-pixel image sensor 1 as shown in,
This field shooting mode can be used as a moving image shooting mode.

However, in this case, when a still image is output from a video printer or the like, the vertical resolution is obtained only to the same extent as that of a conventional vertical addition reading type image pickup element, and a moving subject is detected. There is a drawback that blurring occurs and only unsightly still images can be obtained.

Therefore, one feature of the all-pixel image sensor 1 is
As a method for effectively utilizing the output of one frame image in the field period, for example, the method shown in FIG. 5A can be considered.

In this case, the camera signal processing circuit 5 has the first
And in the second field period, field image data # 1 of the even line field from the first channel ch1 of the camera signal processing circuit 5 and the second channel ch2.
Field image data of odd line field from #
1 to the first frame memory 60 according to the control signal C1.
Write sequentially to 1.

Then, the frame image of the second field period is not taken in, and the still image of the 1-frame image of the 1-field period is set as the moving image of the 1-frame period (hereinafter, this is referred to as the frame photographing mode).

During this time, if the image data is already written in the second frame memory 602, the image data of the immediately preceding frame is encoded by the encoding processing circuit 7 according to the control signal C2.
Then, after being subjected to processing such as DCT and shuffling, it is recorded as a digital video signal from the recording head 8 on the magnetic tape 9 by a recording method according to the format.

When one frame of image data is written in the first frame memory 601, the camera signal processing circuit 5 receives the signals from the first channel ch1 of the camera signal processing circuit 5 in the third and fourth field periods. Field image data # 3 of the even line field and field image data # 3 of the odd line field from the second channel ch2 are sequentially written in the second frame memory 602 according to the control signal C2.

In the meantime, the image data of one frame before written in the first frame memory 601 is sent to the encoding processing circuit 7 and subjected to the same processing as described above, and the recording head 8 performs recording according to the format. It is recorded on the magnetic tape 9 as a digital video signal by the method.

The video signal thus recorded is subjected to the processing shown in FIG. 5B during reproduction. First, the video signal obtained from the magnetic tape 9 via the reproducing head 10 is sent to the decoding processing circuit 11 in the first and second field periods and is subjected to processing such as I-DCT and deshuffling. It is written in the third frame memory 121 in accordance with the control signal C3.

Meanwhile, if the image data has already been written in the fourth frame memory 122, the decoding processing circuit 1
1 indicates the fourth frame memory 12 according to the control signal C4.
Interlace reading is performed from 2, and the image data is divided into even and odd fields to reproduce the image.

In the third and fourth field periods, the video signal obtained from the magnetic tape 9 through the reproducing head 10 is sent to the decoding processing circuit 11 and is subjected to processing such as I-DCT and deshuffling. , Is written in the fourth frame memory in accordance with the control signal C4.

In the meantime, the decoding processing circuit 11 performs interlaced reading from the third frame memory 121 in accordance with the control signal C3, divides the image data into even and odd fields, and reproduces the image.

This system can be used as a still image capturing mode because it can capture a high-resolution image with less blur even for a moving subject. However, when reproduced as a moving image, the field configuration is as shown in the reproduced image of FIG. 5B, so that the image is captured every other frame period. Although this provides a high-resolution image, it has a drawback that, for example, a moving image with a large amount of motion is discontinuous and only an unsightly moving image can be obtained.

In view of the above problems, the present invention makes it possible to obtain a moving image with a natural motion and a high sense of resolution even when frame shooting is performed using an all-pixel image sensor. With the goal.

[0036]

SUMMARY OF THE INVENTION An image pickup apparatus of the present invention comprises an image pickup means for sequentially reading signals of respective pixels in a non-added manner to generate an image pickup signal, and a standard television signal from the image pickup signal output from the image pickup means. Camera signal processing means for generating a first video signal and a second video signal according to the above, and a first video signal and a second video signal output from the camera signal processing means.
Output signal selecting means for selecting one or the other of the video signals, and signal recording means for recording the contents of the video signal selected by the output signal selecting means in the subcode recording area of the recording medium as a signal mode. It is equipped with.

Another feature of the present invention is that
The signal mode recorded in the sub-code recording area of the recording medium is a field shooting mode indicating that a video signal of one field on one side of the first field or the second field is recorded in one field period and one field period. It is characterized in that there are two types of frame shooting modes which indicate that the one-frame image composed of the video signal of the first field and the video signal of the second field obtained in step 1 is allocated to the even field and the odd field.

Another feature of the present invention is that an interpolation filter for performing interpolation in the time axis direction according to a subcode signal recorded in a subcode recording area of the recording medium, and ON / OFF of the interpolation filter. And an interpolation filter control means for controlling the above, and when the signal mode recorded in the subcode recording area is the frame photographing mode, the interpolation filter is turned on.

Another feature of the present invention is that the interpolation filter control means controls ON / OFF of the interpolation filter according to a subcode signal recorded in a subcode recording area of the recording medium. At the same time, when a still image output is requested, the interpolation filter is turned off even if the signal mode recorded in the subcode recording area is the frame photographing mode.

Another feature of the present invention is that the one field period is one field period defined by the NTSC system.

Another feature of the present invention is that the one field period is one field period defined by the PAL system.

[0042]

Since the present invention has the above technical means, even when a moving image is captured in the frame capturing mode which is originally a still image capturing mode, the time is based on the signal mode recorded in the subcode recording area of the recording medium. By interpolating in the axial direction, the screen can be made to continue smoothly. As a result, although all the frame still images are recorded, a natural motion can be obtained and a moving image with a high resolution can be reproduced.

[0043]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of an image pickup apparatus according to the present invention. FIG. 1 is a functional configuration diagram showing a schematic configuration of an image pickup apparatus according to an embodiment of the present invention. FIG.
, A is image pickup means, B is camera signal processing means, and C
Is an output signal selecting means, D is a signal recording means, E is a recording medium, F is a signal reading and reproducing means, G is an interpolation filter, and H is H.
Is an interpolation filter control means.

The image pickup means A has an all-pixel image pickup element and sequentially reads the signals of the respective pixels in a non-added manner to generate an image pickup signal. The camera signal processing means B generates a first video signal and a second video signal based on the standard television signal from the image pickup signal output from the image pickup means A.

The output signal selecting means C is for selecting either one of the first video signal and the second video signal output from the camera signal processing means B to be recorded. .

The signal recording means D is for recording the content of the video signal selected by the output signal selecting means C in a subcode recording area (not shown) of the recording medium E as a signal mode.

The signal reading / reproducing means F is for reading out the signal recorded on the recording medium E, performing predetermined signal processing, and reproducing the video signal. The reproduced video signal is interpolated by an interpolation filter. In addition to outputting to G, the subcode signal recorded in the subcode recording area is output to the interpolation filter control means H.

The signal mode recorded in the subcode recording area of the recording medium E is the field photographing mode indicating that the video signal of one field on one side of the first field or the second field is recorded in one field period. There are two types of frame shooting modes, which indicate that an image of one frame consisting of video signals of the first field and the second field obtained in one field period is allocated to even fields and odd fields.

The interpolation filter G is provided to perform interpolation in the time axis direction according to the subcode signal recorded in the subcode recording area of the recording medium E, and the interpolation filter control means H is provided. , For controlling ON / OFF of the interpolation filter G.

The interpolation filter control means H controls ON / OFF of the interpolation filter G according to the subcode signal recorded in the subcode recording area of the recording medium. Still image output is performed by external control. Is requested, even if the signal mode recorded in the sub-code recording area is the frame photographing mode, the interpolation filter G
I'm trying to turn off.

According to the image pickup apparatus of this embodiment having such a configuration, even when a moving image is photographed in the frame photographing mode, which is originally a still image capturing mode, the interpolation filter G can perform interpolation in the time axis direction. By doing so, the screen can be made smooth and continuous.

As a result, although all the frame still images are recorded on the recording medium E, a natural motion can be obtained and a moving image with a high resolution can be reproduced. Become.

By the way, the consumer digital VTR standard provides a moving image mode and a still image mode, which are used when recording an image on a recording medium (for example, a magnetic tape).
Whether a still image or a moving image was shot is recorded in the subcode recording area. In other words, this subcode signal is for identifying the still image / moving image mode at the time of reproduction, and is completely different from the present invention.

Hereinafter, a more specific structure and operation of the image pickup apparatus of the present invention will be described with reference to the drawings. FIG. 2 is a block diagram showing the arrangement of the image pickup apparatus of this embodiment. FIG.
In the figure, the same parts as those in the conventional example are designated by the same reference numerals. The all-pixel image sensor 1 is in the two-channel output mode, and the respective channel outputs always output the even-numbered and odd-numbered line video signals of the all-pixel imager 1.
The recording / reproducing unit is, for example, a digital VTR.

The even-numbered and odd-numbered video signals output from the all-pixel image sensor 1 are switched by the TG 15 for two lines from the all-pixel image sensor 1 every one field period, and are independently supplied. C provided
It is sent to the DS circuits 201 and 202. These CDS circuits 201 and 202 perform, for example, correlated double sampling that removes clock and reset noise from the video signal output from the all-pixel image sensor 1.

The video signal subjected to the predetermined signal processing by the CDS circuits 201 and 202 is next processed by the AGC circuit 30.
The signal is supplied to the first and second circuits 302 and 302 to be controlled in gain, and then sent to the A / D converters 401 and 402 to be converted into digital signals.

The camera signal processing circuit 5 includes an A / D converter 4
Receiving digital signals from 01 and 402, dot-sequentializing the video signals of even lines and odd lines, and then performing color separation,
Signal processing such as contour enhancement and color correction is performed.

In each field, the signal selection circuit 14 determines whether the image data to be sent to the encoding processing circuit 7 is a field photographing mode signal or a frame photographing mode signal according to a signal mode set by a mode changeover switch (not shown) or the like. Whether or not the control signal S1
To the camera signal processing circuit 5. At the same time, the signal selection circuit 5 generates the subcode signal S2 and sends it to the encoding processing circuit 7.

The control signal S1 is sent to select the processing in the frame image pickup mode in the camera signal processing circuit 5, but its detailed description is omitted here. Here, when the control signal S1 and the sub-code signal S2 are in the field shooting mode, the processing in the field shooting mode of FIG. 4A and FIG. Omit it.

Further, even when the control signal S1 and the sub-code signal S2 are in the frame photographing mode, the processing in the frame photographing mode of FIG. To do.

Now, the video signal recorded as shown in FIG. 5 (A) described above can be reproduced as shown in FIG. 3 when the control signal S1 and the sub-code signal S2 are in the frame photographing mode.
The processing as shown in FIG.

That is, first, the video signal obtained from the magnetic tape 9 through the reproducing head 10 is the first and second video signals.
During the field period, it is sent to the decoding processing circuit 11 and I-
After undergoing processing such as DCT and deshuffling, it is written in the third frame memory 121 according to the control signal C3.

Meanwhile, if the image data has already been written in the fourth frame memory 122, the decoding processing circuit 1
1 indicates the fourth frame memory 12 according to the control signal C4.
The interlaced reading is performed from 2, and the image data is reproduced by dividing the image data into even fields and odd fields.

In the third and fourth field periods, the video signal obtained from the magnetic tape 9 via the reproducing head 10 is sent to the decoding processing circuit 11 and is subjected to processing such as I-DCT and deshuffling. , And is written in the fourth frame memory 122 according to the control signal C4.

In the meantime, the decoding processing circuit 11 performs interlaced reading from the third frame memory 121 according to the control signal C3, divides the image data into even and odd fields, and reproduces the image.

The linear interpolation circuit 13 receives the video signal reproduced in this way, and controls on / off of the interpolation filter for performing interpolation in the time axis direction by the control signal S3. In the example of FIG. 3, the output of the reproduced video signal starts for the first time in the third field, but at this time, the interpolation filter in the time axis direction is turned off by the control signal S3, and the even-numbered line field image is output from the third frame memory. Only data # 1 is sequentially read.

In the fourth field, the interpolation filter in the time axis direction is turned on by the control signal S3, and the odd line field image data # 1 of the third frame memory and the odd line field image data # 3 of the fourth frame memory. A linear interpolation circuit 13 creates a fourth field which is time-axis-interpolated from the two-field image data of By this interpolation, the interpolated field image data can be obtained at the correct position on the time axis.

In the fifth field, the interpolation filter in the time axis direction is turned off by the control signal S3, and only the even line field image data # 3 is sequentially read from the fourth frame memory.

In the sixth field, the interpolation filter in the time axis direction is turned on by the control signal S3, the odd line field image data # 3 of the fourth frame memory and the odd line field image data # 5 of the third frame memory. The 6th field interpolated on the time axis by the linear interpolation circuit 13 is created from the 2 fields according to By this interpolation, the interpolated field image data can be obtained at the correct position on the time axis.

By performing such interpolation in the direction of the time axis every other field, a portion having a large movement can be smoothly connected, so that even if the still image is continuous image data, it is converted into a moving image. It is possible to obtain a sufficiently smooth image.

When it is desired to output a still image to a video printer or the like, the control by the control signal S3 is canceled so that a high-resolution still image can be output as it is.

In this embodiment, two frame memories are used as the image memory during reproduction, but this is because it is assumed that deshuffling during reproduction is performed in frame units. Therefore, if it is used only as an interpolation filter in the time axis direction, two field memories can be used.

Further, although linear interpolation with two fields is performed in this embodiment, a smoother interpolation field can be generated by increasing the number of fields to be used.

[0074]

As described above, according to the present invention, the first image signal and the second image signal according to the standard television signal are obtained from the image pickup signal output from the image pickup means for sequentially reading out the signals of each pixel without addition. The video signal is generated and the first
Since either one of the video signal and the second video signal is selected and the content of the selected video signal is recorded as a signal mode in the subcode recording area of the recording medium, By subjecting the video signal reproduced from the recording medium to a predetermined process according to the subcode signal recorded in the subcode recording area of the recording medium,
It becomes possible to reproduce a moving image with natural movement and a sense of resolution.

According to another feature of the present invention, an interpolation filter for performing interpolation in the time axis direction according to the subcode signal recorded in the subcode recording area of the recording medium, and turning on / off of the interpolation filter. Since the interpolation filter control means for controlling is provided, and the interpolation filter is turned on when the signal mode recorded in the subcode recording area is the frame photographing mode, it is recorded in the recording medium. Even if all are frame still images, it is possible to obtain a moving image with natural motion and a sense of resolution.

[Brief description of the drawings]

FIG. 1 is a functional configuration diagram showing main functions of an image pickup apparatus of the present invention.

FIG. 2 is a configuration diagram showing an embodiment of an image pickup apparatus of the present invention.

FIG. 3 is a diagram for explaining the operation of the image pickup apparatus according to the embodiment.

FIG. 4 is a diagram for explaining the operation of the conventional imaging device.

FIG. 5 is a diagram for explaining the operation of the conventional imaging device.

FIG. 6 is a diagram for explaining an output from a camera signal processing unit of an all-pixel image sensor.

FIG. 7 is a configuration diagram showing an example of a conventional imaging device.

[Explanation of symbols]

 A image pickup means B camera signal processing means C output signal selecting means D signal recording means E recording medium F signal reading and reproducing means G interpolation filter H interpolation filter control means

Claims (6)

[Claims] 1. An image pickup means for sequentially reading the signals of respective pixels in a non-additive manner to generate an image pickup signal, and a first video signal and a second image signal based on a standard television signal from the image pickup signal output from the image pickup means. Camera signal processing means for generating the video signal, and output signal selecting means for selecting one of the first video signal and the second video signal output from the camera signal processing means, and the output. An image pickup apparatus, comprising: a signal recording unit that records the content of a video signal selected by the signal selecting unit in a subcode recording area of a recording medium as a signal mode. 2. A signal mode recorded in the subcode recording area of the recording medium is a field photographing mode indicating that a video signal of one field on one side of the first field or the second field is recorded in one field period. And one frame image mode indicating that one frame image consisting of the video signals of the first field and the second field obtained in the one field period is allocated to the even field and the odd field. The image pickup apparatus according to claim 1, wherein: 3. An interpolation filter for performing interpolation in the time axis direction according to a subcode signal recorded in a subcode recording area of the recording medium, and an interpolation filter control means for controlling ON / OFF of the interpolation filter. The image pickup apparatus according to claim 1, wherein the interpolation filter is turned on when the signal mode recorded in the subcode recording area is a frame photographing mode. 4. The interpolation filter control means performs on / off control of the interpolation filter in accordance with a subcode signal recorded in a subcode recording area of the recording medium, and when a still image output is requested. The image pickup apparatus according to claim 1, wherein the interpolation filter is turned off even when the signal mode recorded in the subcode recording area is a frame photographing mode. 5. The image pickup apparatus according to claim 2, wherein the one field period is one field period defined by the NTSC system. 6. The image pickup apparatus according to claim 2, wherein the one field period is one field period defined by the PAL method.