JP6323472B2 - Movie imaging device - Google Patents

Description

  The present invention relates to a moving image imaging apparatus that captures a moving image of an imaging field illuminated by a light source, and more particularly to a moving image imaging apparatus that reliably controls lighting of a light source in synchronization with an exposure period of an imaging unit.

  2. Description of the Related Art Conventionally, a moving image capturing apparatus 100 that captures a moving image in an imaging field while illuminating the imaging field with a light source captures the moving image and generates an imaging signal representing each frame image of a moving image, as shown in FIG. The image processing unit 101 performs image signal processing on the imaging signal to sequentially generate each frame image of the moving image, and generates an imaging control value for controlling the imaging operation of the imaging unit 101 from the imaging signal, and according to the imaging control value An ISP (image signal processor) 102 that feedback-controls the imaging operation of the imaging unit 101; a moving image output unit 103 that converts each frame image of a moving image generated by the ISP 102 into a moving image format that can be reproduced on the monitor 104; The light source 105 that illuminates the imaging field of view of the imaging unit 101 and the light source control unit 106 that controls blinking of the light source 105 (Patent Document 1, Patent Document) 2).

  In the moving image pickup apparatus 100, the camera module 110 and the image pickup apparatus main body 120 are connected by an LVDS (Low Voltage Differetial Signaling) cable 111, the image pickup unit 101 is connected to the camera module 110, the ISP 102 is connected to the image pickup apparatus main body 120, and a moving image output unit. 103, a light source 105, and a light source control unit 106 are incorporated. The LVDS cable 111 is capable of bidirectional communication, and imaging operation timing information for capturing the frame image is output from the imaging unit 101 to the ISP 102 together with an imaging signal representing each frame image of the moving image. In addition, an imaging operation control signal for controlling the imaging operation of the imaging unit 101 is output. The imaging operation control signal output from the ISP 102 includes an imaging timing control signal representing the exposure operation timing and signal readout timing of the pixel unit 101a of the imaging unit 101, and the ISP 102 performs light source operation during the exposure operation period of the pixel unit 101a. A light source control signal that turns on the light source 105 and turns off the light source 105 during the signal readout operation period is output to the light source control unit 106 in synchronization with the imaging timing control signal.

  The light emitted from the light source 105 incorporated in the imaging apparatus main body 120 is extracted to the tip of the camera module 110 by the light guide 108 and illuminates the imaging field of view captured by the imaging unit 101 through the lens 107. Therefore, during the exposure operation period of the pixel unit 101a of the imaging unit 101, the light source 105 is turned on to illuminate the imaging field of view, and during the signal readout operation period, the light source 105 is turned off.

  In the process of generating the frame image, the ISP 102 of the moving image capturing apparatus 100 generates a frame image by adding various signal processing such as noise reduction, shading correction, contour enhancement, and various effect functions to the imaging signal. Various optimum imaging control values for executing each function of auto white balance (AWB), automatic exposure function (AE), and automatic focus (AF) are obtained from the input imaging signal and imaging operation timing information, and the imaging control is performed. The imaging operation of the imaging unit 101 is feedback controlled with an imaging control signal generated based on the value. Since these imaging control values are obtained by comparing pixel data of all the pixels of each frame image represented by the imaging signal, the imaging device of the imaging unit 101 has high performance and the number of pixels of one frame image increases. As the amount of data to be compared increases, the data mining processing costs such as filtering, scaling, and cropping for obtaining the imaging control value increase, and the ISP 102 has a large power consumption, a complicated structure, and a high processing capability. Must be used.

  On the other hand, in a medical endoscope, a monitor camera mounted on a vehicle, a camera for a drive recorder, and the like, a position away from the monitor 104 that reproduces the moving image in order to capture a moving image with a required imaging field of view. In the moving image capturing apparatus 100 shown in FIG. 5, the ISP 102 that consumes a large amount of power, has a complicated structure, and is increased in size from the camera module 110 having the image capturing unit 101 to the image capturing apparatus main body 120 side. In other words, the camera module 110 is reduced in size with a simple structure and operates with low power consumption.

Japanese Patent Laying-Open No. 2015-119762 Japanese Patent No. 5427316

  When the ISP 102 is built in the imaging apparatus main body 120 in order to reduce the size of the camera module 110 and operate with low power consumption in this way, imaging operation timing information output from the imaging unit 101 to the ISP 102 or imaging from the ISP 102 is performed. Since the imaging timing control signal output to the unit 101 is transmitted via the LVDS cable 111, when the LVDS cable 111 is wired in an environment where noise frequently occurs, such as in a vehicle, it is affected by the noise. Thus, the imaging operation of the imaging unit 101 controlled by the imaging timing control signal and the blinking operation of the light source 105 controlled by the light source control signal cannot be synchronized. There is a risk that the light source 105 may be turned off or during the signal readout operation period.

  Furthermore, in the conventional moving image pickup apparatus 100, the light emission control signal for controlling the blinking of the light source 105 is generated by the ISP 102 having a very high processing load as described above, and therefore the output of the light emission control signal is delayed and the image pickup by the image pickup unit 101 is performed. There is a possibility that the blinking of the light source 105 controlled by the light emission control signal is delayed with respect to the operation.

  When the light source 105 or the light source control unit 106 is arranged on the camera module 110 side, the light emission control signal generated by the ISP 102 based on the imaging operation timing information output from the imaging unit 101 via the LVDS cable 111 is used. Since the signal is output again to the light source control unit 106 of the camera module 110 via the LVDS cable 111, a delay occurs and it is easily affected by noise, and a phase shift occurs between the imaging operation of the imaging unit 101 and the blinking operation of the light source 105. There was a fear.

  The present invention has been made in consideration of such conventional problems, and an object of the present invention is to provide a moving image capturing apparatus that controls blinking of a light source accurately in synchronization with an image capturing operation of an image capturing unit.

In order to achieve the above-described object, a moving image capturing apparatus according to claim 1 captures a moving image in a field of view and sequentially outputs an imaging signal representing each frame image of a moving image, and each frame from the imaging signal. An image is sequentially generated and output, and imaged by an image signal processing unit that generates an imaging control value of an imaging control signal that controls the imaging operation of the imaging unit from the imaging signal, and an imaging control signal that is generated based on the imaging control value An imaging control unit that controls the imaging operation of the image capturing unit, a moving image output unit that outputs a moving image in which each frame image sequentially output from the image signal processing unit is output to the monitor, a light source that illuminates the imaging field of view, and a blinking light source A moving image imaging device including a light source control unit to control,
The imaging unit outputs imaging operation timing information obtained by imaging the frame image together with an imaging signal representing each frame image of the moving image, and the imaging control unit is lit including at least the exposure operation period of the imaging unit from the imaging operation timing information. A light source control signal for controlling lighting of the light source during a period is generated, and the light source control unit controls blinking of the light source according to the light source control signal generated by the imaging control unit.

  Since the light source control signal for controlling the blinking of the light source is directly generated from the imaging operation timing information indicating the imaging operation timing of the imaging unit, it is possible to reliably control the lighting of the light source in synchronization with the exposure operation period of the imaging unit.

In addition, the light source control signal is generated by an imaging control unit having a simple structure with a low processing load that only controls the imaging operation of the imaging unit without involving an image signal processing unit that generates a frame image or an imaging control value. The imaging control unit can generate the light source control signal without delaying the imaging operation of the imaging unit .

  On the other hand, even in a moving image imaging device that illuminates the imaging field of view with a light source, the image signal processing unit does not generate a light source control signal that is synchronized with the imaging operation of the imaging unit. Each frame image can be sequentially generated and output without delay.

According to a second aspect of the present invention, there is provided a video imaging device including an imaging unit and an imaging control unit in a camera module, and an image signal processing unit in an imaging device body connected to the camera module via a connection cable capable of bidirectional communication. A video output unit, and the imaging unit of the camera module outputs an imaging signal representing each frame image of the moving image to the image signal processing unit of the imaging apparatus body via the connection cable, and captures the frame image Imaging operation timing information is output to the imaging control unit, and the imaging control unit generates a light source control signal from the imaging operation timing information and outputs an imaging control value output from the image signal processing unit of the imaging apparatus body via the connection cable. The imaging operation of the imaging unit is controlled by an imaging control signal generated based on the above.

  Since the image pickup apparatus body includes an image signal processing unit that generates each frame image of a moving image and an imaging control value, the processing load of the camera module is small, the camera module can be simplified, and can be operated with low power.

  Even if the image signal processing unit is separated from the camera module to the imaging device main body via the connection cable, it is not necessary to output the imaging operation timing information to the image signal processing unit via the connection cable. Therefore, the light source control signal can be generated from the imaging operation timing information.

The moving image imaging apparatus according to claim 3 further includes a light source and a light source control unit in the imaging apparatus main body,
The light source control unit controls the blinking of the light source according to the light source control signal output from the imaging control unit of the camera module via the connection cable.

  A light source control signal generated by the imaging control unit of the camera module from the imaging operation timing information is output to the light source control unit of the imaging apparatus main body via the connection cable, and the light source control unit controls blinking of the light source according to the light source control signal. As a result, the light source is controlled to blink in synchronization with the imaging operation of the imaging unit.

  Since the camera module does not include a light source or a light source control unit, it is not necessary to wire a power line for supplying power to the light source between the camera module and the imaging apparatus body, and the camera module does not generate heat due to lighting of the light source.

  In addition, a camera module having the same structure can be shared regardless of whether or not the moving image capturing apparatus includes a light source.

  According to a fourth aspect of the present invention, there is provided a moving image pickup apparatus comprising: a camera module installed in a part of a vehicle that images the periphery of the vehicle; and an image pickup apparatus main body installed around a monitor installed around a driver's seat of the vehicle. And LVDS cable capable of bidirectional communication.

  Even if the camera module and the imaging device main body are connected in a vehicle that generates a lot of noise, the imaging operation timing information does not flow through the LVDS cable, so that a light source control signal can be generated from the imaging operation timing information without being affected by noise. .

The moving image capturing apparatus according to claim 5, which captures a moving image of an imaging field of view, sequentially outputs an imaging signal representing each frame image of a moving image, and sequentially generates and outputs each frame image from the imaging signal. together, imaging controls the imaging operation of the imaging unit and the image signal processing unit that generates an image pickup control value of the imaging control signal for controlling the imaging operation of the imaging unit from the imaging signal by the imaging control signal generated based on the imaging control value A control unit; a moving image output unit that outputs a moving image in which each frame image is sequentially output from the image signal processing unit to a monitor; a light source that illuminates an imaging field; and a light source control unit that controls blinking of the light source A video imaging device,
The imaging unit outputs imaging operation timing information obtained by imaging the frame image together with an imaging signal representing each frame image of the moving image, and the light source control unit is turned on including at least the exposure operation period of the imaging unit from the imaging operation timing information A light source control signal for controlling lighting of the light source during a period is generated, and the light source is controlled to blink.

  Since the light source control signal for controlling the blinking of the light source is directly generated from the imaging operation timing information indicating the imaging operation timing of the imaging unit, it is possible to reliably control the lighting of the light source in synchronization with the exposure operation period of the imaging unit.

  The light source control signal is generated by the image signal processing unit that generates the frame image and the imaging control value and the light source control unit that is unrelated to the processing of the imaging control unit that controls the imaging operation of the imaging unit. Therefore, the light source control signal can be generated without delay.

  On the other hand, even a moving image imaging device that illuminates the imaging field of view with a light source does not cause a new processing load on the image signal processing unit or the imaging control unit, so the imaging operation control of the imaging unit and the generation of each frame image of the moving image Can be executed without delay.

  According to a sixth aspect of the present invention, the imaging unit includes a CMOS element that simultaneously exposes all pixels with a global shutter, and outputs the simultaneous exposure timing of the CMOS element as imaging operation timing information.

  While the pixels of the CMOS elements of all lines are exposed simultaneously, the light source is controlled to be turned on.

  According to the first aspect of the present invention, even if the moving image pickup device is provided with a light source that illuminates the imaging field during the exposure period of the image pickup unit, each frame image is delayed without increasing the processing load of the image signal processing unit. Can output to the monitor.

  Further, since the light source control signal is generated by the imaging control unit with a low processing load, the light source can be controlled to blink without being delayed with respect to the imaging operation of the imaging unit.

According to the second aspect of the invention, since the imaging operation timing information is output to the image signal processing unit via the connection cable, the light source control signal can be accurately generated from the imaging operation timing information that is not affected by noise.

  According to the invention of claim 3, since the camera module is not provided with a light source or a light source control unit, it is not necessary to wire a power line for supplying power to the light source between the camera module and the imaging apparatus body, No heat is generated by lighting.

  In addition, a camera module having the same structure can be shared regardless of whether or not the moving image capturing apparatus includes a light source.

  Moreover, a light source can be arrange | positioned without being restrained by the installation position of a camera module or the number of camera modules, and the imaging visual field of the imaging part of a camera module can be illuminated with a light source.

  According to the invention of claim 4, even if the camera module and the imaging apparatus main body are connected in a vehicle space where large noise is frequently generated, the imaging operation timing information does not flow through the LVDS cable. The light source control signal can be accurately generated from the non-imaging operation timing information.

  According to the invention of claim 5, even if the moving image pickup apparatus is provided with a light source that illuminates the imaging field during the exposure period of the imaging unit, the imaging unit does not increase the processing load on the image signal processing unit and the imaging control unit. The imaging operation control and the generation of each frame image of the moving image can be executed without delay.

  Further, since the light source control signal is generated by the light source control unit having a low processing load, the light source can be controlled to blink without being delayed with respect to the imaging operation of the imaging unit.

  According to the invention of claim 6. Since the light source can be reliably controlled during the exposure time of all the pixels, the flicker phenomenon does not occur.

1 is a block diagram showing a moving image capturing apparatus 1 according to an embodiment of the present invention. It is a wave form diagram which shows the relationship between the imaging operation timing of an imaging part, and a light source control signal. It is a block diagram which shows the moving image imaging device 30 which concerns on 2nd Embodiment. It is a block diagram which shows the moving image imaging device 40 which concerns on 3rd Embodiment. It is a block diagram which shows the other conventional moving image imaging device.

  Hereinafter, a moving image capturing apparatus 1 according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2. This moving image imaging device 1 is used in a driving support system for the purpose of detecting an object approaching a vehicle at high speed and taking accident prevention measures. As shown in FIG. An image that is installed in front of the vehicle so that it captures the imaging field in front of the vehicle and is located near the monitor of the driver's seat

  The camera module 10 is connected with an imaging unit 2, an imaging control unit 3, a storage unit 13, a serial-parallel / flat-serial conversion unit 5, and an LED driver 14 that controls blinking of an LED 15 that is a light source through an internal bus. A serial-parallel / flat-serial converter 21, an image signal processor (ISP) 22, and a moving image output unit 23 are connected to the imaging apparatus main body 20 connected to the LVDS cable 4 as a connection cable. Connected with.

  The imaging unit 2 of the camera module 10 captures a moving image of the imaging field of view in front of the vehicle and sequentially outputs an imaging signal representing each frame image of the moving image as a stream to the serial-parallel / flat-serial conversion unit 5 that is a serializer. The image capturing operation timing information obtained by capturing the frame image is output to the image capturing control unit 3, and the lens 6 having the focus unit 6a and the aperture unit 6b, the electronic shutter 7, the image sensor 8, the signal processing circuit 9, A / It consists of a D conversion circuit 11 and an RGB gain correction circuit 12.

  The focus unit 6 a of the lens 6 has a focus lens, and an optical path that passes through the lens 6 so that a moving image to be imaged is imaged on the image sensor 8 in accordance with an AF control signal described later output from the imaging control unit 3. adjust. The diaphragm 6b adjusts the amount of light incident on the image sensor 8 through the lens 6 in conjunction with the electronic shutter 7 of the image sensor 8 in accordance with an AE control signal (described later) output from the image capture controller 3.

The image sensor 8 is composed of a CMOS sensor composed of a large number of matrix-like pixels in which a plurality of pixel lines arranged in a row direction are arranged in a row direction, and is accumulated by a photodiode for each pixel. The signal charge is output as a pixel signal composed of a voltage signal. The imaging operation of the imaging device 8 is controlled by the timing control signal of the exposure control signal and the readout control signal output from the imaging control unit 3, and is 1/30 seconds that is the imaging cycle of one frame image, that is, one frame of about 33 msec. In the period _TF , a frame image of the entire imaging field is captured, and all pixel signals representing one frame image are read out. That is, as shown in FIG. 2, the image pickup device 8 has the electronic function of the global shutter 7 and receives the exposure control signal of the global reset, and the pixels of all the pixel lines are exposed in the same exposure operation period. In response to the readout control signal synchronized with the subsequent vertical synchronization signal, pixel signals representing signal charges accumulated in the pixels of all the pixel lines are sequentially read out for each pixel line. The image sensor may be constituted by a CCD (charge coupled device) sensor.

The imaging element 8 outputs all pixel signals representing one frame image to the subsequent signal processing circuit 9 as analog imaging signals for each frame period _TF , and also captures the one frame image. Imaging operation timing information at an exposure start time t0, an exposure end time t1, a readout start time t3, and a readout end time t4 is output to the imaging control unit 3 .

  The imaging signal output to the signal processing circuit 9 is subjected to correlated double sampling (CDS) processing, and signal processing such as color separation processing is performed on each of the R, G, and B color signals, and then the A / D conversion circuit 11 performs the processing. After being converted into a digital signal, it is input to the RGB gain correction circuit 12. The RGB gain correction circuit 12 adjusts the signal level of each color signal included in the imaging signal so as to reproduce an optimal color balance under any light source in accordance with an AWB control signal described later output from the imaging control unit 3. (White balance processing).

The RGB gain correction circuit 12 of the imaging unit 2 sequentially outputs an imaging signal representing each frame image of a moving image captured in one frame period _TF to the serial / parallel / serial conversion unit 5. The serial-parallel / flat-serial conversion circuit 5 is an input / output interface that connects the camera module 10 to the imaging apparatus body 20 via the LVDS cable 4 capable of bidirectional communication. The imaging signal output from the imaging unit 2 is small. An amplitude differential signal type LVDS signal (constant voltage differential signal) is output from the serial-parallel / flat-serial conversion circuit 5 serving as a serializer to the imaging device body 20. Here, the imaging signal output from the imaging unit 2 via the LVDS cable 4 is unprocessed imaging data (RAW data) before the ISP 22 generates a full-color moving image frame image. Compared to the case where a frame image is output via the LVDS cable 4, the amount of communication data per unit time is small, and the frame image can be output to the imaging device body 20 in a short time. Therefore, even if the LVDS cable 4 is wired in an environment where noise frequently occurs, the probability that the imaging signal is affected by the noise is small.

  The LVDS cable 4 that connects between the camera module 10 and the imaging apparatus main body 20 is a bidirectional serial transmission line, and the ISP 22 in addition to the above imaging signals from the camera module 10 to the imaging apparatus main body 20 via the LVDS cable 4. Various communication data representing the operation state of each part in the camera module 10 and each imaging control value of the imaging control signal for controlling the imaging operation of the imaging unit 2 in response to a request from the camera module 10 are transmitted superimposed on the imaging signal, Communication data representing commands from the ISP 22, imaging control values (to be described later) generated by the ISP 22, and the like are transmitted from the imaging apparatus body 20 to the camera module 10.

  The imaging control unit 3 controls the operation of each unit in the camera module 10 such as the imaging unit 2 and the series / parallel / serial conversion unit 5 and is input from the ISP 22 of the imaging device body 20 via the LVDS cable 4. AF control signals based on various focus control values (hereinafter referred to as AF control values), exposure control values (hereinafter referred to as AE control values), and white balance control values (hereinafter referred to as AWB control values). , Various imaging control signals of the AE control signal and the AWB control signal are generated, and the imaging operation of the imaging unit 2 is controlled by these imaging control signals. Further, when the imaging control unit 3 controls the imaging operation of the imaging unit 2 with the AF control signal, the AE control signal, and the AWB control signal, the AF control value and the AE control value used when the imaging control signal is generated. The various imaging control values of the AWB control value are temporarily stored in the storage unit 13 constituted by the SDRAM. Each time the imaging control unit 3 generates a new imaging control signal, the various imaging control values stored in the storage unit 13 are replaced with imaging control values used for the imaging control signal.

  Further, the imaging control unit 3 controls blinking of the LED 15 from the imaging operation timing information output from the imaging device 8 of the imaging unit 2 at the exposure start time t0, the exposure end time t1, the readout start time t3, and the readout end time t4. A light source control signal is generated. That is, the imaging control unit 3 controls the lighting of the LED 15 at least during the simultaneous exposure operation period (t0-t1) of the imaging device 8 and controls the LED 15 to be turned off at least during the reading operation period (t2-t3). A signal is generated and output to the LED driver 14.

  The LED 15 is driven by the power source of the LED power source 16 of the imaging apparatus main body 20 connected via the power line 17 and is installed in the camera module 10 toward the imaging field so as to illuminate the imaging field captured by the imaging unit 2. ing. In addition, it may replace with LED15 as a light source, and other light sources, such as white light sources, such as a laser light source and a halogen lamp, may be used. The LED driver 14 controls blinking of the LED 15 according to the light source control signal input from the imaging control unit 3, and the LED 15 is lit at least during the simultaneous exposure operation period (t0-t1) of the imaging device 8 to illuminate the imaging field. The light is extinguished at least during the read operation period (t2-t3).

  An imaging signal output from the imaging unit 2 of the camera module 10 to the imaging apparatus main body 20 via the LVDS cable 4 is converted from a serial signal into a parallel signal by a serial / parallel / serial converter 21 which is a deserializer. Input to the ISP 22.

  Each time an image pickup signal representing one frame image is input, the ISP 22 performs a mosaic process that complements luminance / color difference information on each pixel of the image pickup signal based on the pixel signal of the surrounding pixels, thereby obtaining a full-color image. A frame image of a moving image conforming to YUV422 composed of YC (luminance / color difference) data as data is generated. Further, the ISP 22 executes noise reduction, shading correction, edge enhancement, and various effect function application processes before and after the generation of the frame image.

  The ISP 22 further detects an exposure value from the imaging signal, and generates an AF control value for generating an AF control value that makes an image having the same focal point from the imaging signal, and clears the exposure value according to the brightness of the imaging field of view. An automatic exposure detection circuit that outputs an AE control value as an optimal exposure value, and an automatic white balance detection circuit that generates an AWB control value as an image with an optimal color arrangement under a light source within the imaging field from the imaging signal. Each time an imaging signal representing one frame image is input, the AF control value and AE control from the ISP 22 via the serial-parallel / flat-serial converter 21, the LVDS cable 4, and the serial-parallel / flat-serial converter 5 Value and AWB control value are output to the imaging control unit 3.

ISP22 is every 1/30 seconds which is one frame period T _F of the imaging unit 2, and outputs the generated frame images to a video output unit 23, video output section 23, can be displayed on a monitor (not shown) video format Then, the frame images are continuously output, and the moving image of the moving image captured by the imaging unit 2 is output to a monitor (not shown) installed in front of the driver's seat via an LVDS cable or the like.

  According to the present embodiment, since the light source control signal for controlling the blinking of the LED 15 is not generated in the ISP 22 having a high processing load as described above, the frame image generation and the imaging control value generation processing are not affected.

  When the imaging control unit 3 of the camera module 10 receives an imaging command from the ISP 22 of the imaging device body 20 via the LVDS cable 4, the imaging control unit 3 performs the entire camera module 10 overall. The image pickup operation of the image pickup unit 2 is controlled by an image pickup control signal based on each image pickup control value of the default value stored in the storage unit 13.

The imaging unit 2 is an imaging operation controlled by the imaging control unit 3, captures a moving image of the imaging field of view, and repeatedly generates an imaging signal representing one frame image with a 1-frame period _TF of 1/30 seconds. An imaging signal representing an image is output to the ISP 22 of the imaging apparatus main body 20 via the LVDS cable 4, and imaging operation timing information when the one frame image is captured is output to the imaging control unit 3 .

  The ISP 22 generates a frame image of the moving image from the input imaging signal, outputs the generated frame image to the moving image output unit 23 every 1/30 seconds, and the moving image output unit captures the image on a monitor connected to 23. Display a video. In addition, when generating a frame image, the ISP 22 generates three types of imaging control values, that is, an AF control value, an AE control value, and an AWB control value, based on the input imaging signal, via the LVDS cable 4. To the imaging control unit 3 of the camera module 10.

  The imaging control unit 3 generates an imaging control signal based on the imaging control value input via the LVDS cable 4 and controls the imaging operation of the imaging unit 2. When it is determined that the input imaging control value is an abnormal imaging control value, an imaging control signal is generated based on the imaging control value stored in the storage unit 13 and the imaging operation of the imaging unit 2 is controlled. To do.

  Further, based on the imaging operation timing information input from the imaging unit 2, the LED 15 is controlled to be turned on at least during the simultaneous exposure operation period (t0-t1) of the image sensor 8, and is turned off at least during the readout operation period (t2-t3). A light source control signal to be controlled is generated and output to the LED driver 14. As a result, the LED 15 is turned on during the simultaneous exposure operation period (t0-t1) of the image sensor 8 and is turned off during the readout operation period (t2-t3) by blinking control from the LED driver 14 according to the light source control signal. Here, the light source control signal can be generated without delay by the imaging control unit 3 with a light processing load, and the light source control signal generated from the imaging operation timing information and the imaging operation timing information indicating the imaging operation of the imaging unit 2 is: Since it does not flow through the LVDS cable 4, there is no influence of noise, and the LED 15 can be controlled to blink accurately during the exposure operation period and the readout operation period of the imaging unit 2.

  FIG. 3 shows a moving picture imaging apparatus 30 according to the second embodiment of the present invention, and the moving picture imaging apparatus 1 according to the above-described embodiment in that the LED driver 31 and the LED 32 are provided in the imaging apparatus main body 20. Although the structure of each part is the same or similar, the same number is attached | subjected to a common structure and the description is abbreviate | omitted.

  In this moving image imaging device 30, the imaging control unit 3 uses the light source control signal generated from the imaging operation timing information at the start of exposure t0, the end of exposure t1, the start of readout t3, and the end of readout t4 in series / parallel series. The data is output to the conversion unit 5, and is output from the serial / parallel / flat serial conversion unit 5 to the serial / parallel / flat serial conversion unit 21 of the imaging apparatus body 20 via the LVDS cable 4 together with the imaging signal.

  The LED driver 31 is connected to the serial-parallel / flat-serial conversion unit 21 via the internal bus of the imaging device main body 20, and when the light source control signal is input to the serial-parallel / flat-serial conversion unit 21, the light source control signal is The LED 32 that is turned on by the LED power source 16 is controlled to blink. As a result, the LED 32 is turned on during the simultaneous exposure operation period (t0-t1) of the image sensor 8 disposed in the camera module 10 to illuminate the imaging field of view, and a pixel signal representing the signal charge accumulated during the exposure operation period. Is turned off during the read operation period (t2-t3).

  Even in this moving image pickup device 30, the light source control signal synchronized with the image pickup operation of the image pickup unit 2 is generated by the image pickup control unit 3 having a relatively low processing load regardless of the ISP 22 having a high processing load. The LED 32 can be controlled to blink without any change.

  Compared with the moving image pickup apparatus 1, it is not necessary to wire the power supply line 17 for connecting the camera module 10 and the image pickup apparatus body 20 to supply power to the LED 32, and the camera module having the same configuration regardless of the presence or absence of a light source. 10 can be shared.

  In the moving image imaging device 30 according to the second embodiment described above, the imaging field of the imaging unit 2 of the camera module 10 remote from the imaging device body 20 cannot be illuminated because the LED 32 is built in the imaging device body 20. is there. Therefore, as in the moving image imaging apparatus 40 shown in FIG. 4, the LED 42 or the LED driver 41 that controls the blinking of the LED 42 is connected by a connection cable 43 including a power supply line and a signal line, and the LED 42 is captured by the imaging field of view of the imaging unit 2. May be installed at a position distant from the imaging device main body 20 capable of illuminating.

  In the moving image imaging device 40, the light source control signal generated from the imaging operation timing information by the imaging control unit 3 is output to the LED driver 41 via the LVDS cable 4 and the connection cable 43, and the LED driver 41 outputs the light source control signal. Accordingly, the LED 42 is controlled to blink in synchronization with the imaging operation of the imaging unit 2. Since the other configuration is the same as that of the moving image capturing apparatus 30, the same reference numerals are given to FIG.

  In each of the embodiments described above, the imaging control unit 3 that controls the imaging operation of the imaging unit 2 generates the light source control signal from the imaging operation timing information output by the imaging unit 2. If it does not participate in the generation, the light source control signal may be generated in another part. For example, the LED driver 14 of the camera module 10 controls the light source based on the imaging operation timing information input from the imaging unit 2. A signal may be generated.

  In each embodiment, the camera module 10 and the imaging device main body 20 are connected by the connection cable 4. However, the moving image imaging device in which the respective parts of the camera module 10 are built in the imaging device main body 20 is integrated. It may be.

  In addition, the moving image capturing apparatus is not limited to the one in which the camera module and the image capturing apparatus main body are mounted on the vehicle, and the present invention can be applied to all moving image capturing apparatuses including a light source that illuminates the imaging field of view.

  It is suitable for a moving image pickup apparatus that picks up a moving image in an imaging field of view with a light source, and particularly suitable for a moving image pickup apparatus provided with an image pickup device of a global shutter in which an image pickup unit exposes all pixels simultaneously.

1, 30, 40 Moving picture imaging device 2 Imaging unit 3 Imaging control unit 4 LVDS cable (connection cable)
7 Electronic shutter (global shutter)
8 Image device (CMOS device)
14 Light source controller (LED driver)
15 Light source (LED)
10 Camera Module 20 Imaging Device Body 22 ISP (Image Signal Processing Unit)
23 Video output section

Claims (6)

An imaging unit that captures a moving image of the imaging field of view and sequentially outputs an imaging signal representing each frame image of the moving image;
An image signal processing unit that sequentially generates and outputs each frame image from the imaging signal and generates an imaging control value of an imaging control signal that controls an imaging operation of the imaging unit from the imaging signal;
An imaging control unit for controlling an imaging operation of the imaging unit by an imaging control signal generated based on the imaging control value;
A moving image output unit that outputs a continuous moving image of each frame image sequentially output from the image signal processing unit to the monitor;
A light source that illuminates the imaging field;
A moving image capturing apparatus including a light source control unit that controls blinking of the light source,
The imaging unit outputs imaging operation timing information obtained by imaging the frame image together with an imaging signal representing each frame image of the moving image,
The imaging control unit generates a light source control signal for controlling lighting of the light source in a lighting period including at least an exposure operation period of the imaging unit from the imaging operation timing information,
The light source control unit controls blinking of the light source according to the light source control signal generated by the imaging control unit. The camera module includes an imaging unit and an imaging control unit,
The image pickup apparatus body connected to the camera module via a connection cable capable of bidirectional communication includes an image signal processing unit and a moving image output unit,
The imaging unit of the camera module outputs an imaging signal representing each frame image of the moving image to the image signal processing unit of the imaging apparatus body via the connection cable, and captures imaging operation timing information obtained by imaging the frame image. Output to the control unit,
The imaging control unit generates a light source control signal from the imaging operation timing information, and an imaging control signal generated based on an imaging control value output from the image signal processing unit of the imaging apparatus main body via the connection cable, The moving image imaging apparatus according to claim 1, wherein the imaging operation of the imaging unit is controlled. The imaging apparatus body further includes a light source and a light source control unit,
The moving image capturing apparatus according to claim 2, wherein the light source control unit controls blinking of the light source in accordance with a light source control signal output from the imaging control unit of the camera module via the connection cable. A camera module installed in a part of the vehicle that images the surroundings of the vehicle and an imaging device body installed around a monitor installed around the driver's seat of the vehicle are connected by an LVDS cable capable of bidirectional communication. The moving image imaging apparatus according to any one of claims 2 and 3, wherein An imaging unit that captures a moving image of the imaging field of view and sequentially outputs an imaging signal representing each frame image of the moving image;
An image signal processing unit that sequentially generates and outputs each frame image from the imaging signal and generates an imaging control value of an imaging control signal that controls an imaging operation of the imaging unit from the imaging signal;
An imaging control unit for controlling an imaging operation of the imaging unit by an imaging control signal generated based on the imaging control value;
A video output unit that outputs a moving image in which each frame image is sequentially output to the monitor, and an image signal processing unit;
A light source that illuminates the imaging field;
A moving image capturing apparatus including a light source control unit that controls blinking of the light source,
The imaging unit outputs imaging operation timing information obtained by imaging the frame image together with an imaging signal representing each frame image of the moving image,
The light source control unit generates a light source control signal for controlling lighting of the light source during a lighting period including at least an exposure operation period of the imaging unit from the imaging operation timing information, and controls blinking of the light source. 6. The imaging unit according to claim 1, wherein the imaging unit includes a CMOS element that simultaneously exposes all pixels with a global shutter, and outputs the simultaneous exposure timing of the CMOS element as imaging operation timing information. The moving image imaging device described in 1.

Images