WO1998011719A1

WO1998011719A1 - Image pickup device

Info

Publication number: WO1998011719A1
Application number: PCT/JP1996/002626
Authority: WO
Inventors: Ryuji Nishimura; Yasushi Takagi; Akihito Nishizawa; Toshiro Kinugasa
Original assignee: Hitachi, Ltd.
Priority date: 1996-09-13
Filing date: 1996-09-13
Publication date: 1998-03-19

Abstract

A camera processing for changing the format of the image signals photo-electrically converted and digitized by a CCD into a predetermined output format and an image compression processing are performed. The operations for the processings are executed by an arithmetic means according to a program where the procedure of the operations are written. Thus a still picture is generated in a software manner. The degree of freedom of the signal processing in the image pickup device is raised, and accordingly the quality of image picked up by the image pickup device and the functions and operability of the device are enhanced without any additional units.

Description

Book

Imaging equipment Technical field

The present invention relates to an imaging device, and more particularly to an imaging device i of all-soft processing suitable for still image capturing. Background art

In a conventional imaging apparatus, photoelectric conversion is performed by using an imaging element such as a CCD (Charge Coupled Device), and digital processing is performed on the image to obtain a predetermined digital image signal. In such an imaging device, the analog output signal output from the CCD is converted into a digital signal by AZD conversion, and then a digital image signal is generated using a dedicated LSI or the like that performs predetermined signal processing. . Such an imaging device is provided with hardware for performing a predetermined operation necessary for generating a digital image signal, and has a feature that high-speed processing can be performed. Such an apparatus is described in, for example, Japanese Patent Application Laid-Open No. 2-280496. Further, an LSI for performing signal processing of such an imaging device and an image quality control thereof are described in, for example, pages 391 and 362 of the 1991 Annual Conference of the Institute of Television Engineers of Japan. ing. Such an LSI not only performs signal processing for generating a video signal from the signal output by the CCD, but also generates a CCD drive pulse for controlling the exposure time of the image sensor and reading of the signal. I have. This LSI is mainly for capturing moving images. Meanwhile, devices for capturing still images have also been developed. It is described in the 1995 Photographic Society of Japan, Fine Image Symposium, Final Report, pp. 59-62.

However, in the above-described conventional technology, there is a problem in that the signal processing of the imaging apparatus is configured by a dedicated window, so that the degree of freedom of the signal processing is small. For this reason, new software must be developed in order to support multiple types of CCDs or to enhance the image quality and functions. Also, the operation must be complicated accordingly. Disclosure of

An object of the present invention is to increase the degree of freedom of the ^ signal processing in an imaging device. Another object of the present invention is to increase the degree of freedom in signal processing, to enhance the functions of the imaging device without extra components, and to enhance the operability thereof.

In order to achieve the above object, in the present invention, the camera signal processing and the image compression processing in the imaging device are all performed by software.

That is, the image pickup apparatus of the present invention converts the optical signal formed by the optical system into an analog image signal and outputs the converted image signal, and converts the analog surface image signal output from the photoelectric converter into a first image signal. A second type that holds a D-converting means for converting the image signal into a digital image signal and outputting the digital image signal, and a program representing an arithmetic procedure for performing a camera process for converting the image signal into a predetermined output format and an image compression process. The first digital image signal output from the AZD conversion means and the first digital image signal output from the AZD conversion means are subjected to an operation for performing camera processing and image compression processing to generate a second digital image signal. The second digital image signal is output to the outside, and the first digital image signal is subjected to an operation based on a program stored in the second memory means. Digital image signal Controlling the arithmetic means to generate And control means for controlling the interface means so as to output the second digital image signal to the outside.

The content of the signal processing is stored as a program in the second memory means, thereby making the signal processing into software.

Further, the control means of the imaging apparatus of the present invention performs an operation based on the program held in the second memory means at least 600,000 times per second on the first digital image signal, and outputs the second digital image signal. Control the way you perform.

If the control stage for signal processing has the minimum necessary processing capability, the total processing time required for signal processing can be reduced to within one second.

Further, the imaging device of the present invention operates the control means at a predetermined timing, and includes an oscillation circuit for generating a reference clock for operating the photoelectric conversion means and the A / D conversion means in synchronization with the timing. Further prepare.

This makes it possible to perform signal processing in synchronization with reading of a signal from the photoelectric conversion means, thereby improving operating speed and facilitating control in signal processing.

Further, the image pickup apparatus of the present invention includes a character mode input means for changing a process until conversion to a predetermined output format and switching to a character mode for photographing a black and white image at a high resolution. .

At the time of character mode input, the second digital image signal is set so that there is no variation in the signal amount of the R, G, and B signals, or only the Y signal. The above processing is easily performed by the software-based processing.

Further, the imaging apparatus of the present invention changes the process of converting to a predetermined output format, and switches to a special effect mode for switching to a special effect mode for photographing while emphasizing an arbitrary area in the screen. A password input means. When the special effect mode is input, control is performed so that the fill characteristics change according to an arbitrary area in the screen. The above processing is also easily performed by software processing.

Further, the imaging apparatus of the present invention is provided with a setting change terminal for changing a process until conversion into a predetermined output match by an input from an external device to switch a shooting mode.

At the time of input, the parameters of the photographing mode stored in the rewritable memory means are rewritten.

Further, the imaging apparatus K of the present invention includes a setting change terminal for changing a process until conversion into a predetermined output format by an input from an external device and setting a new shooting mode.

At the time of input, the parameters of the new shooting mode specific stored in the rewritable memory means are rewritten.

Further, the imaging apparatus of the present invention includes a setting change terminal for performing version up of camera processing or image compression processing by input from an external device.

At the time of input, the program for executing the signal processing stored in the rewritable memory means is rewritten.

In addition, an integrated circuit which is constituted solely by the arithmetic means, the control means, and the second memory means of the imaging apparatus of the present invention is removable.

Therefore, the version of camera processing or image compression processing can be improved by replacing it with another integrated circuit that has improved performance.

FIG. 1 is a block diagram showing a first embodiment of the imaging device of the present invention. FIG. 2 is a diagram showing a color filter array in the imaging device of the present invention. FIG. 3 is a block diagram illustrating a configuration of a ghost image control path in the first embodiment of the imaging device of the present invention. FIG. 4 is a diagram illustrating operations and operations performed when capturing a still image in the imaging device of the present invention. FIG. 5 is a diagram illustrating a flow of signal processing, FIG. 5 is a diagram illustrating a flow of generating a luminance and color difference signal in the imaging device of the present invention, and FIG. 6 is a second diagram of the imaging device of the present invention. FIG. 7 is a block diagram of an imaging apparatus according to a third embodiment of the present invention. FIG. 8 is a block diagram of an imaging apparatus according to a third embodiment of the present invention. FIG. 9 is a block diagram illustrating a configuration of a CCD control circuit according to the present embodiment. FIG. 9 is a block diagram illustrating an imaging apparatus according to a fourth embodiment of the imaging device K of the present invention. FIG. 11 is a block diagram of an imaging device showing a fifth or sixth embodiment of the imaging device of the present invention, and FIG. Fig. 2 (a) shows the characteristics of the optical aperture one-pass filter when the CCD color filter array of the image pickup device shown in Fig. 2 is shown in Fig. 2 (a). FIG. 13 is a diagram showing images before and after applying the effect, and FIG. 13 is a diagram showing an appearance of the imaging device of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION

A first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration of an imaging device according to the present invention. In the figure, 1 is a lens, 2 is a CCD, 3 is an amplification circuit, and 4 is an AZD conversion circuit. Reference numeral 5 denotes a buffer memory for writing the first digital image signal output from the AZD conversion circuit 4. Reference numeral 6 denotes an image control circuit that performs signal processing, image input / output control, and the like, and 8 denotes an image memory that holds generated image signals. Reference numeral 9 denotes an interface circuit that communicates with an external computer or the like and outputs a second digital image signal generated by the imaging apparatus of the present invention. 10 denotes a generated second digital image signal. A recording medium for recording digital image signals of the You.

Next, an operation when capturing a still image in the present embodiment will be described.

The light incident on the lens 1 forms an image on the imaging surface of the CCD 2. The CCD 2 has a large number of pixels on its imaging surface, performs photoelectric conversion in each element, generates a pixel signal, and sequentially outputs the pixel signal. In order to generate a color image signal on the imaging surface of the CCD 2, color filters with a fixed pattern are arranged.Each * ί 桌 indicates a specific color filter It is configured to photoelectrically convert only color light. Figure 2 shows such a color filter array pattern. In this embodiment, a filter that transmits three primary colors R (red), G (green), and B (blue) as shown in FIGS. 2A and 2B is used. Outputs analog image signals including three types of discrete pixel signals B. Note that, in addition to the color fill arrays shown in FIGS. 2 (a) and (b), Mg (magenta), Cy (cyan), Y e (yellow), etc. shown in FIGS. 2 (c) and (d) A color filter array mainly composed of complementary colors having high light utilization may be used. The amplifying circuit 3 amplifies the above-mentioned image signal and outputs it. Here, well-known noise reduction processing such as CDS (Correlated Double Sampling) may be performed. Next, the AZD conversion circuit 4 converts the analog image signal into a first digital image signal. The first digital image signal is written into the buffer memory 5, and the written first digital image signal is subjected to signal processing by the image control circuit 6, and the second digital image signal is processed in the second format in accordance with a predetermined format. Is generated. Although the buffer memory 5 normally holds the input image signal for one screen (one frame), an image corresponding to one part of the screen (for example, several lines) according to the processing capability of the image control circuit 6 Reading and writing may be repeated sequentially while holding the signal, or a memory of a capacity that can hold image signals for several screens may be used, and the still image You may comprise so that continuous photography is possible.

Hereinafter, the signal processing performed by both image control circuits 6 will be described. FIG. 3 is a block diagram showing the configuration of the image control circuit 6. 30 is a CPU (Central Processing Unit), 31 is an arithmetic circuit, 32 is a RAM (Random Access Memory), and 33 is R. 0 M (Read Only Memory), 34 is the I / 0 port. The rain image control circuit 6 includes the above components, but may be configured using a general-purpose microcomputer DSP (Digital Signal Processor) integrating these components or a dedicated LSI.

Next, a still image capturing operation and processing will be described. Still image capturing is started when the user presses the operation switch 11 of the image capturing apparatus. The operation switch in the imaging apparatus of the present invention can realize two different switch states, that is, a half-depressed state and a fully-depressed state.First, when the operation switch is kept in a half-depressed state, Here, exposure control and white balance control are performed. Also, when there is an autofocus mechanism, the autofocus control is performed here. When these controls are completed, the user is notified of the completion of the preparation for shooting by display or sound. Here, when the user pushes the operation switch completely, a still image is captured. FIG. 4 is a diagram showing a flow of an operation when capturing a still image and a signal processing performed by the image control circuit 6. In S1 of FIG. 4, it is detected that the switch is half-pressed. If the switch is half-pressed, the process proceeds to the next step S2, where the driving of the CCD is started, and the photoelectrically converted key in the CCD is started. The analog image signal is stored. In S3, the stored analog image signal is read from the CCD. The analog image signal read from the CCD is converted to a digital image signal via the amplifier circuit 3 and the A / D converter circuit 4 separately from the signal processing flow. Written to memory 5. In S4, image control is performed on the written digital image signal. Circuit 6 controls exposure. Exposure control is a process for controlling the exposure time of the CCD (the shutter speed of the electronic shutter) to an appropriate value. For this reason, the signal levels of the two image signals are compared with a predetermined reference value, and the shutter speed in reading the next analog image signal from the CCD is set so that the signal level approaches an appropriate value. In S5, if the signal level is an appropriate value, it is determined that the exposure control has been completed, and the process proceeds to the next process. If the exposure control has not been completed, the process returns to S3. This feedback control is performed until the exposure control is completed.

In S6, exposure is performed at the shutter speed set to an appropriate value, and an analog image signal is read from the CCD. The analog image signal read from the CCD is converted into a digital image signal via the above-mentioned bandwidth circuit 3 and the A / D conversion circuit 4 separately from the signal processing flow, and then the buffer memory 5 in FIG. Is written to. In S7, the image control circuit 6 performs white balance control on the written digital image signal. In the white balance control, a gain is obtained such that the balance of each of the signals R, G, and B generated from the digital image signal becomes an appropriate value as described later. When the white balance control ends, A control end signal is generated in S8 to notify that the preparation for shooting is completed and the operation switch can be turned on.

In S9, it is detected whether the operation switch has been turned on. If O emissions state, Ana port grayed image signal read out from the _c CCD reading again Ana port grayed image signal S 1 0 from the CCD is separate from the full opening one signal processing. The amplifier circuit 3, the After being converted into a digital image signal via the AZD conversion circuit 4, it is written into the buffer memory 5 in FIG. In SI 1, a luminance signal Y and color difference signals U and V are generated by the image control circuit 6 for the written digital image signal. For detailed processing in this S 1 1 It will be described later. The generated signals Y, U, and V are input to the area image memory 8.

In S12, the generated signals, U, and V are read from the image memory 8, and both stationary image compression is performed based on a method such as JPEG (Joint Photographic Expert Group). The compressed image signal is written into the image memory 8 again. In S13, the image signal thus generated is recorded on the recording medium 10. The image signals to be recorded are usually still images, but moving images (continuous still images) may be recorded. While the recording medium 1 0 using a semiconductor memory such as a hula Tsu Shumemori, other good _c these recording media even with hard Dodi disk Ya magnetic tape, but can generally be interchangeable child removed is, In the imaging device K, [fil-defined one may be used. A recording medium, such as a memory card, from which data in the memory can be read by an external device such as a personal computer may be used.

Next, a process of generating the luminance signal Y and the color difference signals U and V in S11 in FIG. 4 will be described with reference to FIG. In S110, matrix processing and filtering for generating the luminance ^ signal Y and the color signals R, G, B are performed. In the CCD used in the present embodiment, the primary color filters R, G, and B are provided for each pixel, so that if the pixel signals are filtered, the signals R, G, and B can be generated. Filtering is performed by multiplying adjacent signals of the same type by appropriate coefficients and adding them. The luminance signal Y may be obtained by multiplying the pixel signals R, G, and B of several adjacent pixels by an appropriate coefficient and adding them.

When the primary color filter is used, the luminance signal Y and the signals R, G, B

However, when using complementary color filters such as those shown in (b) and (c) of Fig. 2, it is necessary to perform the following matrix operation to obtain signals R, G, and B is there. Hereafter, from the color signals M g, G, C y, Y e to the signal R, A method for generating G and B will be described. The relationship between the complementary color signals Mg, Cy, and Ye and the signals R, G, and B can be expressed by the following equations.

M g = R + B (1)

C y = G + B (2)

Y e = G + R (3)

Therefore, the signals R, G, and B can be obtained, for example, as follows.

R = Y e + Mg-C y (4)

G = G-Mg + C y + Y e (5)

B = C y + Mg-Y e (6)

As described above, the signals R, G, and B can be obtained even when the complementary color filter is used.

In S111, the generated signals R, G, and B are multiplied by the gain obtained in S7 in FIG. 4 to perform white balance correction. However, the processing of S110 and S111 may not be performed individually but may be performed simultaneously.

In S112, gamma correction is performed on the white balance corrected signals R, G, B and the signal Y. The gamma correction is performed according to a table representing input / output characteristics based on the gamma characteristics. The gamma correction is described in p. 362 of the Proceedings of the 1971 Annual Meeting of the Television Society of Japan, and is the same in principle.

In S113, color signals U and V are generated. The signals U and V are calculated by multiplying the luminance signal Y generated by the following equation (7) and the color difference signals R-Y and 、 -Υ obtained by calculating the signals R, G and B by a predetermined coefficient. Can be generated.

Υ = 0.3 R + 0.6 G + 0.1 Β (7)

As described above, the signals Y, U, and V can be obtained. like this Such processing is performed by the image control circuit shown in FIG. FIG. 3 is the same as the configuration of a general microcomputer, and the above processing is performed according to the program written in R0M33.

In addition, as the above-described camera signal processing, the image control circuit performs the camera processing and image compression processing until the CCD output signal is converted into a predetermined output format, that is, the above-described Y, U, and V signals. The total processing time required for performing both processes is preferably less than 1 second, considering continuous shooting in the same scene. If the processing time is longer than this, the shutter chance may be missed, so that the usability is deteriorated. In order to perform high-speed camera signal processing within one second, it is necessary for the CPU that performs signal processing to have a certain processing capability.

Therefore, the amount of operation necessary for performing the two-image compression process in the above camera signal processing is considered. Assuming that the number of pixels to be encoded is 3.8 million pixels per second, it is stated in 48, No. 1, PP 31-37 (1994) in the Journal of the Institute of Television Engineers of Japan. Approximately 130 for discrete cosine transform and approximately 50 MOPS (Mega Operation Per Second) for variable-length coding, and the compression of still images when other processing is included. Processing requires more than 200 MOPS. In the present invention, considering that a still image having a size of 640 × 480 pixels generally handled on a personal computer is generated in one second, the sampling format of the Y, U, and V signals is considered. If the output power is 4: 2: 2, then 64 x 480 x 2 = 6 144 000 The number of pixels to encode is about 600,000 per second. Therefore, the amount of computation required to perform the plane image compression process is 200 MOPS or more when the number of pixels to be encoded is 3.8 million pixels per second based on the above. When the number is 600,000 pixels per second, it is about 30 MOPS or more. Also consider the amount of computation required to perform camera signal processing other than image compression processing. I can. This is mainly a matrix operation such as filtering, and if the filter processing is performed with a filter size of 5 x 5 pixels, the filter processing includes 25 multiply-accumulate operations . Even if one operation is one processing, the amount of operation differs depending on the processing content, so the same amount of operation as image compression processing is required, and as a result, it is necessary to perform camera signal processing other than image compression processing The computational complexity is about 30 MOPS.

Therefore, in order to perform the above-described camera signal processing within one second, a computation amount of at least 60 MOPS is required. When such an operation is performed by the CPU, assuming that 1 M0PS = 1 MIPS (Mega Instraction Per Second), a minimum 6 OMIPS is required as the CPU performance.

As described above, in the present embodiment, the signal processing of still ft 'is performed by the image control circuit 6, and this signal processing is software processing in which the processing content is described by a program. Therefore, by changing the software, the content of the signal processing can be changed without changing the configuration of the imaging device, and an imaging device with a high degree of freedom in processing can be provided. Therefore, image quality and functions can be improved without increasing the circuit scale. In particular, image quality and functions can be set by input from external devices, so it is convenient to use. These will be described later.

Next, a second embodiment of the present invention will be described. FIG. 6 is a block diagram showing the configuration of the imaging device according to the present invention. ^ In the figure, 40 is an oscillation circuit, and 41 is a frequency dividing circuit. Other parts are the same as those shown in the first embodiment. In general, the clock for CCD driving and the basic clock frequency of the image control circuit 6 may be different, but in this embodiment, the clock generated by the oscillation circuit 40 for the image control circuit 6 is used. The clock divided by the frequency dividing circuit 41 is input to the CCD driving circuit 7 and the AZD converting circuit 4, and is configured to operate in synchronization with the image control circuit 6. As a result, the signal from the CCD Signal processing in synchronization with the readout of the signal, the operation timing control when the image signal output from the CCD is taken into the image control circuit can be simplified, and the buffer memory 5 shown in the first embodiment can be used. Without using it, the image signal after AZD conversion can be taken directly into the image memory.

Further, a third embodiment of the present invention will be described. FIG. 7 is a block diagram showing the configuration of the imaging device according to the present invention. In the figure, 50 is a CCD control circuit. Other parts are the same as those shown in the first or second embodiment. FIG. 8 is a block diagram showing the configuration of the CCD control circuit 50. The CCD control circuit 50 is obtained by integrating an amplifier circuit 3, an AZD conversion circuit 4 and a CCD drive circuit 7 with an I / F circuit 60 for communicating with the image control circuit 6 via the bus 12 It is. In the present embodiment, the control of the CCD can be performed from the image control circuit 6 via the CCD control circuit 50. For this reason, the image signal output from the CCD can be written into the image memory 8 at an arbitrary time, thereby further increasing the degree of freedom in processing.

Further, a fourth embodiment of the present invention will be described. FIG. 9 is a block diagram illustrating a configuration of an imaging device according to the present invention. In the figure, 70 is a shutter, 71 is an autofocus control circuit, and 72 is a strobe. Other parts are the same as those shown in the embodiment of FIG. In the present embodiment, highly accurate exposure control by the mechanical shutter 70 and the strobe 72 can be performed by the accurate focus control by the focus control circuit 71.

Further, a fifth embodiment of the present invention will be described. FIG. 10 is a block diagram showing a configuration of an imaging device according to the present invention. In the figure, reference numeral 13 denotes a mode switching switch, which allows selection of switching among normal mode, character mode, high dynamic range mode, and special effect mode. . 14 is an optical low-pass filter, 15 is polarized light It is a board. The optical low-pass filter 14 is omitted in the block diagrams of FIGS. 1, 6, 7, and 9 because it does not directly relate to the operation of the embodiment described above. Other parts are the same as those shown in the embodiment of FIG. The other parts may be as shown in FIGS. Next, the mode switching will be described. First, the mode is selected by the mode switch. The mode switching switch may be a normal dial type switch or another push type switch. The operation after the mode selection is performed is the same as that of the embodiment described above, but the content of the signal processing performed by the imaging device differs depending on the selected mode. When the normal mode is selected by the mode switching switch, normal signal processing is performed by the same operation as that of the embodiment described above.

Next, the case in which the character mode is selected by the mode switching switch will be described. The character mode is a mode for capturing a monochrome image of a document or the like at a high resolution. The signal processing in the character mode will be described. In the character mode, in order to improve the resolution, the luminance signal is generated based on the following equation (8) instead of the above-mentioned equation (7).

Y = Kr-R + Kg-G + Kb-B (8)

Here, the coefficients K r, K g, and K b in equation (8) are K r, K g, K r, K g, K b may be determined so as to be respectively proportional to Ir, Ig, and Ib. That is, Kr = α, Ir, Kg = / Ig, and Kb = a / Ib. Where α is a proportional number. By generating a luminance signal in this way, it is possible to eliminate variations in the signal amounts of the R, G, and B pixels that occur when a black-and-white subject such as a document is imaged, and the color filters are arranged. A signal equivalent to a video signal obtained when an image is captured by a black and white CCD that does not have a false signal (moire) based on the difference in sensitivity between color filters is not generated, and the resolution is improved. Can be. Up The process of setting the above coefficients can be easily performed by the software process of the image control circuit II.

Further, in the character mode, only the luminance signal may be generated, and the chrominance signal may not be generated. In this case, the effect of the optical aperture one-pass filter may be removed when the character mode is selected, so that the resolution is further improved. In order to eliminate the effect of the optical aperture-one-pass filter, a polarizer 15 may be used. In this case, by adjusting the angle of the polarizing plate, it is possible to enable or disable the one-pass filter by allowing or not allowing human light to pass through. This is described in, for example, Japanese Patent Publication No. 58-141 16. Also, to eliminate the effects of the optical low-pass filter, a polarizer is not used, and the optical one-pass filter is mechanically operated when the character mode is selected by interlocking with the mode switching switch. May be removed from the optical path.

Fig. 11 shows the characteristics of the optical low-pass filter when the C C D color filter array is as shown in Fig. 2 (a). In the figure, fs is the pixel sampling frequency in CCD. Therefore, f s / 3 is a spatial frequency having three pixels as one cycle. The optical aperture one-pass filter in this case has a characteristic that traps enter fs 3 and eliminates the moiré by removing in advance the frequency component fs Z 3 that causes moire in the color signal. However, in this case, the resolution near s Z 3 is lower than the resolution other than fs Z 3. If a luminance signal is generated by the processing as in equation (8), moire does not occur in f s / 3, and thus such an optical aperture one-pass filter becomes unnecessary. If this optical low-pass filter is removed, the response near f s / 3 is greatly improved, and the resolution can be improved.

Note that generating a luminance signal using equation (8) is for a case where a CCD equipped with a primary color filter is used. For example, the complementary color filter shown in Fig. 2 (c) is used. If there is a river with a evening CCD, the following formula is used.

Y = Km-Mg + Kg-G + Kc'Cy + Ky'Ye (9) Coefficients Km, Kg, Kc, and Ky applied to each pixel multiplication have primary color filters As in the case of using a CCD, the ratio of the coefficients may be determined so as to be half proportional to the integral value of each west element.

Next, the case where the special effect mode is selected by the mode switching switch will be described. In the special effects mode, you can switch the characteristics of the mouth-to-pass filter at the window on both sides. For example, the center of the screen has a normal filter characteristic, and the periphery of the center of the screen has another filter characteristic, so that the periphery of the center of the screen can be blurred. Such processing is performed in the filtering of S110 in the signal processing flow shown in FIG. The area for changing the characteristics of the mouth-to-mouth filter can be set arbitrarily. This is performed by rewriting the program relating to the coordinate axes in the image control circuit. The operation is performed by inputting from a button from an imaging device or input from a personal computer using a mouse or a keyboard (accordingly, a low-pass filter). The process of fixing the area to change the characteristics of the image and the process of extracting a specific subject such as a person from the screen and blurring the background can be performed. (A) shows the image before the special effect is applied, (b) shows the image with the special effect applied, and (b) uses the ordinary filtering for the person in the center of the screen. In this case, the surrounding area of the person is subjected to filtering with a strong mouth-to-pass fill, and the surrounding area of the person is blurred. In this mode, the same effect can be obtained as when the image is taken with a shallower depth of field relative to the surrounding area of the person. It can be easily done by software processing inside. Further, a sixth embodiment of the present invention will be described. FIG. 10 is a block diagram showing a configuration of an imaging device according to the present invention. 16 in the figure is a setting change terminal. FIG. 13 is a diagram showing the appearance of an imaging device according to the present invention. In the figure, 100 is an imaging device, 1 is a lens, 11 is an operation switch, 16 is a setting change terminal, and 17 is an optical finder. By connecting a setting change device 101 such as a personal computer to the setting change terminal 16 as shown in FIG. 13, the following usage form can be obtained.

The first mode of use is mode switching. In this use mode, a normal mode, a character mode, a special effect mode, or the like for performing normal shooting is selected and switched in the same manner as described in the previous embodiment. However, in the case of the first embodiment, an extra configuration for switching the mode such as a switch is required as the mode is increased, and the operation for that is also complicated. Therefore, in this use mode, a setting change device is connected to the setting change terminal 16, and the processing from input from the setting change device to conversion into a predetermined output format performed by the image control circuit is changed. Switch the mode. At the time of the above input, a rewritable memory such as an EEPROM is provided in the imaging device using a communication software of the setting change device and the imaging device, and the mode setting parameters stored therein are provided. Change the data. By switching the mode in advance in this way, a specific mode set at the time of photographing is performed, so that the imaging device does not require an extra configuration for switching the mode such as a switch. In addition, if the user only needs to use a specific mode (for example, character mode), the user can easily perform operations on the device itself during shooting. For the latter, for example, if the setting change device is used to switch to the character mode, the imaging device can be operated without switching to the character mode during imaging. Character mode shooting is automatically performed simply by operating the operation switch. The second mode of use is the setting of a new mode. When using an imaging device, users often want to create their own images. Therefore, in this mode of use, the user can set a new dedicated mode adjusted to the desired image quality by Pi. If this is to be done during the main operation of the imaging device, an extra configuration for setting a new mode is required, and the operation for that is also complicated. Therefore, in this usage mode as well, a setting change device is connected to the setting change terminal 16 and the processing from input from the setting change device to conversion to a predetermined output format performed by the I-plane image control circuit. Change the process and set a new mode. At the time of the above input, a rewritable memory such as EEPR0M is provided in the imaging device を using the setting change device and the communication software of the imaging device, and the new mode stored therein is provided. The setting parameters, specifically, parameters such as brightness, sharpness, color saturation, hue, and white balance related to image quality control are changed. By setting a new mode in advance in this way, the dedicated mode that has been set is performed at the time of shooting, so that a new mode such as a switch can be set, and each mode described above can be set. Since an extra configuration for switching between the two is not required, the imaging device can be downsized, and the operation on the device main body at the time of shooting can be easily performed. In the latter case, for example, if the new mode is set by the setting change device, it is not necessary to set the new mode at the time of imaging or to switch from each mode described above. By simply operating the operation switch, shooting in the dedicated mode is automatically performed. Also, the information about the dedicated mode once set can be conveniently stored in a setting change device such as a personal computer. The third mode of use is version-up. Improving the performance of imaging devices, specifically image quality and processing speed, and improving the functions of imaging devices, specifically new With the development of new shooting modes, users can change the software only and upgrade the version. Also in this usage mode, a setting change device is connected to the setting change terminal 16 and the version of camera processing or image compression processing performed in the image control circuit is performed by input from the setting change device S. In this case, a rewritable memory such as a flash memory is used instead of R〇M33 shown in FIG. The above ^ manpower, setting changing device is performed by the communication software Touwea of Apurikeshi ₃ down software Bok and imaging device setting change apparatus. The user only has to operate the mouse or keyboard on the screen in accordance with the instructions of the application software, and the camera processing or the image compression processing that has been upgraded in the rewritable memory can be performed. A program to execute is written.

As another embodiment, the imaging device may be configured so that the entire microcomputer part can be replaced, and the imaging device may be replaced with a microcomputer having improved performance or a new function to perform version up. This is possible for the first time because all processing is performed by the microcomputer.

When the version is updated by the software or by the hardware as described above, only the part related to the microcomputer is changed, so the other parts are not affected and the version is updated. The operation of the software is also the operation of the mouse and keyboard on the screen of the personal computer in the software, and the operation of the hardware is only replacement of the microcomputer, which affects other parts than replacing the conventional DSP or LSI. It can be done easily without giving

The above setting change terminal can be shared with an interface for connecting to a computer. Industrial applicability

The imaging apparatus of the present invention performs all signal processing by software, and therefore has a high degree of processing freedom. For this reason, dedicated hardware such as a camera DSP is not required, and the cost can be reduced. Also, the content of the signal processing can be changed without changing the configuration of the device.

For the latter, it is possible to increase the rain K and function without increasing the circuit scale.

For example, it can be photographed in the character mode, so that both black and white images can be photographed at a high resolution.

In addition, shooting can be performed in the special effect mode, so that any area in the screen can be emphasized when shooting.

More specifically, the image quality and functions can be set by input from an external device to a setting change terminal.

For example, the shooting mode can be switched. This eliminates the need for an extra configuration for switching the mode, and allows the imaging device to be downsized. In addition, the specific mode that has been switched in advance is performed at the time of shooting, so operation on the device body is simple.

Also, a new shooting mode can be set. This eliminates the need for an extra configuration for setting a new mode or switching to another shooting mode, and thus allows the imaging apparatus to be downsized. In addition, the operation of the device itself is easy because the dedicated mode processing set in advance is performed during shooting.

In addition, camera processing or image compression processing can be upgraded. As a result, the processing level of the imaging device can be raised as needed with the development of the software. For example, it can support high pixel still and moving image processing in the future. It should be noted that the version up of force camera processing or image compression processing can also be performed by replacing both image control circuits. As a result, the processing level of the imaging device can be raised as needed with the development of microcomputers and the like. For example, it can handle high pixel still images and moving image processing in the future.

The above version up can be performed without affecting parts other than the image control circuit. Also, the version up operation is as simple as operating the mouse and keyboard on a personal computer and replacing the microcomputer itself.

Claims

Claims l. Photoelectric conversion means for converting the light formed by the optical system into an analog image signal and outputting the analog image signal,

AZD conversion means for converting the analog image signal output from the optical conversion means into a first digital image signal and outputting the first digital image signal;

Second memory means for holding a program for performing a calculation process for performing a camera process for converting a ghost image signal into a predetermined output format and an image compression process;

Calculating means for performing an operation for performing the image processing and the image compression processing on the first digital image signals output from the A / D conversion means to generate a second digital image signal;

Interface means for outputting the second digital image signal generated by the arithmetic means to the outside,

Performing an arithmetic operation on the first digital image signal based on the program held in the second memory means, and controlling the arithmetic means so as to form the second digital image signal by one; An imaging apparatus, comprising: control means for controlling the interface means so as to output the second digital image signal to the outside.

2. The image pickup apparatus includes: first memory means for holding a first digital image signal output from the AZD conversion means;

The imaging device according to claim 1, further comprising a third memory unit that holds a second digital i image signal generated by the arithmetic unit.

3. The imaging device according to claim 2, wherein the third memory stage also serves as the first memory means.

4. The arithmetic means and the control means are constituted by a single dyeing circuit 2. The imaging device according to claim 1, wherein:

5. The imaging apparatus according to claim 1, wherein the arithmetic means, the control means, and the second memory means are constituted by a negative integration circuit.

6. The imaging apparatus further includes a recording medium for recording a plurality of the second digital image signals, and the control unit controls the recording of the second digital image signal into the recording medium. 2. The imaging device according to claim 1, wherein reading from the recording medium to the outside is controlled.

7. The imaging apparatus according to claim 1, wherein the camera processing includes a filter processing.

8. The photoelectric conversion means has three kinds of pixels of R (red), G (green), and B (blue), and the first digital image signal has R, G corresponding to the three kinds of elements. And the second digital image signal includes R, G, and B signals, or includes a luminance signal Y and a chrominance signal Cr, Cb. Imaging device.

9. The photoelectric conversion means has four kinds of pixels of Mg (red), G (green), Cy (cyan), and Ye (yellow), and the first digital image signal is the four kinds of pixels. The second digital image signal includes signals of R, G, and B, or the luminance signal Y, the color difference signal C r, and M g, G, C y, and Y e corresponding to the pixels of The imaging device according to claim 1, further comprising Cb.

10. A photoelectric conversion unit that converts an optical signal formed by the optical system into an analog image signal and outputs the analog image signal.

AZD conversion means for converting the analog image signal output from the photoelectric conversion means to a first digital image signal and outputting the first digital image signal,

Second memory means for holding a program representing a calculation procedure for performing image processing and image compression processing for converting an image signal into a predetermined output format; Previous 演算 The first digital image signal output from the AD conversion means is subjected to at least 600,000 times per second to perform the force camera processing and the ghost image compression processing, and the second digital image is processed. Arithmetic means for generating a signal;

The first digital image signal is subjected to an operation based on a program held in the second memory means at least 600,000 times per second to generate the second digital image signal. An imaging apparatus comprising: control means for controlling the interface means so as to control the means and output the second digital image signal to the outside.

11. The imaging apparatus according to claim 10, wherein the calculation for performing the camera processing and the image compression processing is performed in one second or less.

1 2. Light 1 conversion means for converting an optical signal formed by the optical system into an analog image signal and outputting the analog image signal;

AZD conversion means for converting an analog image signal output from the photoelectric conversion means into a first digital image signal and outputting the first digital image signal;

Second memory means for holding a program representing a procedure of an operation for performing a force-measurement process for converting an image signal into a predetermined output format and a dual-image compression process;

An arithmetic unit for performing an operation for performing the force camera process and the image compression process on the first digital image signal output from the A / D conversion unit to generate a second digital image signal;

An interface for outputting the second digital image signal generated by the arithmetic means to the outside,

The first digital dual image signal is subjected to an operation based on a program held in the second memory means to generate the second digital image signal. Control means for controlling the arithmetic means and controlling the interface means so as to output the second digital image signal to the outside,

An oscillator circuit for operating the control means at a predetermined timing and generating a reference clock for operating the photoelectric conversion means and the AZD conversion means in synchronization with the timing. Characteristic imaging device.

13. Photoelectric conversion means for converting the optical signal formed by the optical system into an analog image signal and outputting the analog image signal;

A / D conversion means for converting the analog image signal output from the light-to-light conversion means into a first digital image signal and outputting the first digital image signal;

Second memory means for holding a program representing a procedure of an operation for performing a camera process for converting an image signal into a predetermined output format and an image-image compression process;

An arithmetic unit for performing an operation for performing the image processing and the image compression process on the first digital image signal output from the AZD conversion unit and generating a second digital image signal;

Controlling the arithmetic means to generate the second digital image signal by performing an arithmetic operation on the first digital image signal based on a program held in the second memory means; Control means for controlling the interface means so as to output an image signal to the outside;

An image pickup apparatus, comprising: a character mode input means for changing a process up to the conversion to the predetermined output format and switching to a character mode for photographing a black and white image at a high resolution.

14. The imaging device according to claim 13, wherein, when the character mode is input, the second digital image signal is only a Y signal.

15. The imaging method according to claim 13, wherein, at the time of inputting the character mode, the second digital image signal has no variation in the signal amounts of R, G, and B signals. Equipment.

16. A photoelectric conversion means for converting the optical signal formed by the optical system into an analog image signal and outputting the signal.

A / D conversion means for converting the analog image signal output from the photoelectric conversion means into a first digital image signal and outputting the first digital image signal,

Second memory means for holding a program representing a procedure of an operation for converting an image signal into a predetermined output format and for performing image compression and embedding;

The first digital image signal output from the A / D conversion means is subjected to an operation for performing self-impression processing and the image compression processing to generate a second digital image signal. Computing means for performing

Interface means for outputting the second digital dual image signal generated in the operation step to the outside,

Performing an arithmetic operation on the first digital image signal based on a program stored in the second memory means, controlling the arithmetic means so as to generate the second digital image signal, and Control means for controlling the interface means so as to output a digital image signal to the outside;

A special effect mode input means for changing a process up to the conversion to the predetermined output format and switching to a special effect mode for taking a picture by emphasizing an arbitrary area in the screen is provided. Characteristic imaging device.

17. The imaging device according to claim 16, wherein, at the time of inputting the special effect mode, a filter characteristic changes according to an arbitrary area in the screen during the camera processing.

1 8. Convert the optical signal formed by the optical system into an analog image signal Photoelectric conversion means for outputting;

AZD conversion means for converting the analog image ^ output from the photoelectric conversion means into a first digital image signal and outputting the signal;

A second memory stage holding a program representing a procedure for performing a camera process for converting both image signals into a predetermined output format and a ghost image compression process;

An arithmetic unit for performing an operation for performing the force camera process and the image compression process on the first digital image signal output from the AZD conversion unit to generate a second digital image signal;

Interface means for outputting the second digital image ^ generated in the operation step to the outside,

Controlling the arithmetic means to generate the second digital image signal by performing an arithmetic operation on the first digital image signal based on a program stored in the second memory means; Control means for controlling the interface means so as to output a signal to the outside;

An imaging apparatus comprising: a setting change terminal for changing a process of converting to a predetermined output format by an input from an external device to switch a shooting mode.

19. The imaging apparatus further includes a switchable memory means for storing parameters unique to the shooting mode, and switches the shooting mode by rewriting the parameters. The imaging device according to claim 18.

20. The imaging apparatus according to claim 18, wherein one of the photographing modes is a character mode for photographing a black-and-white image at a high resolution.

21. The photographing method according to claim 18, wherein one of the photographing modes is a special effect mode for photographing by emphasizing an arbitrary area in a screen. Imaging device.

2 2. An optical signal converting means for converting the optical signal formed by the optical system into an analog dual image signal and outputting the signal;

A / D conversion means for converting the analog image signal output from the photoelectric conversion means into a first digital signal

A second memory means for holding a program representing a procedure of an operation for performing a force camera process for converting an image signal into a predetermined output format and an image compression process;

(c) calculating means for performing an operation for performing the force camera processing and the image compression processing on the first digital image signal output from the A / D conversion means to generate a second digital image signal;

An interface means for outputting the second digital image signal generated by the arithmetic means to the outside;

Controlling the arithmetic means to generate the second digital image signal by performing an operation on the first digital image signal based on a program stored in the second memory T-stage; Control means for controlling the interface means so as to output a digital image signal to the outside;

An image pickup apparatus, comprising: a setting change terminal for changing a process up to conversion to the predetermined output format by an input from an external device to set a new shooting mode.

23. The imaging apparatus further includes a rewritable memory unit for storing parameters unique to the new shooting mode, and sets the new shooting mode by rewriting the parameters. The imaging device according to claim 22, wherein the imaging device is used.

24. The imaging apparatus according to claim 22, wherein the new shooting mode is a shooting mode for shooting with a desired image quality.

25. photoelectric conversion means for converting the light image formed by the optical system into an analog image signal and outputting the analog image signal;

第 second memory means for holding a program representing a procedure of an operation for performing a camera process for converting an image signal into a predetermined output format and an image compression process;

An arithmetic means for performing an arithmetic operation for performing a force-measurement process and the ghost image compression process on the first digital image signal output from the AD conversion means to generate a second digital image signal;

Interface means for outputting the second digital dual image signal generated by the arithmetic means to the outside,

Controlling the arithmetic means to generate the second digital image signal by performing an arithmetic operation on the first digital image signal based on a program held in the second memory means; Control means for controlling the interface means so as to output a signal to the outside;

An imaging apparatus comprising: a setting change terminal for performing a version up of the camera processing or the image compression processing in response to an input from an external device.

26. The imaging apparatus further includes a rewritable memory means for storing a program for executing the camera processing or the image compression processing, and the camera is rewritten by rewriting the program. 26. The imaging apparatus according to claim 25, wherein the imaging apparatus performs processing or a version of the image compression processing.

27. A photoelectric conversion means for converting the optical signal formed by the optical system into an analog dual image signal and outputting the signal, A / D conversion means for converting an analog image signal output from the photoelectric conversion means into a first digital image signal and outputting the first digital image signal;

A second memory means for holding a program representing a procedure for calculating a force camera for converting an image signal into a predetermined output format and for performing image compression processing;

The first digital image fi † output from the A / D conversion means is subjected to dij memo era processing and an operation for performing both image compression processing, and a second digital image surface image signal is obtained. Computing means for performing

Interface means for outputting the second digital image-signal generated by the arithmetic means to the outside,

Controlling the arithmetic means to generate the second digital image signal by performing an arithmetic operation on the first digital image signal based on a program held in the second memory means; Control means for controlling the front interface means so as to output the digital image signal to the outside, and the arithmetic means, the control step, and the second memory means. An imaging device characterized in that a single integrated circuit can be removed.

28. The imaging apparatus according to claim 27, wherein the integrated circuit is removed and another integrated circuit is attached, thereby performing the version up of the camera processing or the image compression processing.