KR101714787B1 - Camera module and system for controlling electronic device with the same - Google Patents

Abstract

The present invention relates to a camera module and an electronic apparatus control system having the camera module.
That is, the camera module of the present invention includes: an image sensor that photographs a predetermined area and outputs the image signal; An image corrector for correcting the image signal output from the image sensor; A first memory unit for storing frames of the image signal corrected by the image correction unit; A first comparing unit comparing the frame of the current video signal with the frame of the previous video signal among the frames of the video signal stored in the first memory unit and outputting the congestion degree data capable of determining the motion of the moving object in a predetermined area, .

Description

[0001] The present invention relates to a camera module and a control system thereof,

The present invention relates to a camera module and an electronic apparatus control system equipped with the camera module.

A digital camera, which is a commercially available image photographing device, a mobile communication terminal with a built-in digital camera function, a digital camcorder, etc., provide an auto focus function (hereinafter AF) for convenience of photographing.

AF (Auto Focus) is a function that automatically focuses on the subject so that the user can manually adjust the focus manually while checking the subject using the viewfinder or LCD monitor. Is being applied to improve.

This AF method is classified into an active method and a passive method according to whether or not a search signal (e.g., ultrasonic wave, infrared ray, etc.) for measuring a measurement distance is outputted.

The active system outputs, for example, an ultrasonic signal or an infrared signal, receives an ultrasonic signal or an infrared signal reflected back from the object, and measures the distance from the object based on the phase difference.

Among the active systems described above, an image capturing apparatus that performs an AF function using infrared rays includes an infrared sensor, and measures a distance to an object by transmitting and receiving an infrared signal through the infrared sensor. Thereafter, the image capturing device adjusts an actuator based on the distance measured through the infrared sensor, and the actuator moves the lens of the camera, thereby obtaining the focus of the subject.

On the other hand, in the passive type AF, an integrated value (Focus Value) is obtained by extracting a high frequency component or outline signal from a luminance signal by passing a luminance signal through an HPF (High Pass Filer) Move the lens to the largest position to automatically focus.

The present invention solves the problem that the amount of movement of a moving object can be known in a predetermined area.

According to the present invention,

An image sensor for photographing a predetermined area and outputting the image signal as an image signal;

An image corrector for correcting the image signal output from the image sensor;

A first memory unit for storing frames of the image signal corrected by the image correction unit;

A first comparing unit comparing the frame of the current video signal with the frame of the previous video signal among the frames of the video signal stored in the first memory unit and outputting the congestion degree data capable of determining the motion of the moving object in a predetermined area, A camera module is provided.

A second memory unit for storing a frame of the video signal obtained by photographing the predetermined area in which the moving object does not exist, from the image sensor; And a second comparing unit for comparing the frame of the current video signal stored in the first memory unit with the frame of the video signal stored in the second memory unit and outputting the complexity data for determining the complexity of the predetermined area.

In addition, the moving body is at least one of a person, an animal, and a vehicle.

According to the present invention,

The frame of the image signal photographed in the predetermined area is compared with each other, and congestion degree data for judging the motion of the moving object in the predetermined area is outputted, or the frame of the output image signal is photographed, A camera module for outputting complexity data that can determine a complexity of a predetermined region by comparing frames of a video signal of a predetermined region with a currently captured image signal;

There is provided an electronic device control system including a camera module including an electronic device control unit that receives electronic still image data or complexity data output from the camera module and controls the electronic device.

The electronic device control unit is one of a control unit of a lighting device, a control unit of a cooling device, and a control unit of a heating device.

The camera module may further include an image sensor that photographs a predetermined area and outputs the image signal as an image signal; An image corrector for correcting the image signal output from the image sensor; A memory unit for storing frames of the image signal corrected by the image correction unit; And a comparing unit comparing the frame of the current video signal with the frame of the previous video signal among frames of the video signal stored in the memory unit and outputting the congestion degree data that can determine the motion of the moving object in a predetermined area.

The camera module may further include an image sensor that photographs a predetermined area and outputs the image signal as an image signal; An image corrector for correcting the image signal output from the image sensor; A memory unit for storing frames of the image signal corrected by the image correction unit; A memory unit for storing a frame of the video signal obtained by photographing the predetermined area in which the moving object does not exist from the image sensor; And a comparison unit for comparing the frame of the current video signal stored in the memory unit with the frame of the video signal stored in the second memory unit and outputting the complexity data for determining the complexity of the predetermined area.

The camera module of the present invention has the effect of photographing a predetermined area, outputting the degree of congestion and the complexity data of a predetermined area, and controlling the electronic device according to the amount of movement of the moving object.

Therefore, the camera module of the present invention does not have expensive active type components and has a relatively low-cost passive type component, so that it is possible to extract information about the motion of the moving object have.

1 is a schematic block diagram of a camera module according to a first embodiment of the present invention;
FIGS. 2A and 2B are views schematically showing a frame of a current video signal and a frame of a previous video signal photographed by the camera module according to the first embodiment of the present invention. FIG.
3 is a schematic block diagram of a camera module according to a second embodiment of the present invention.
4A and 4B schematically show a frame of a current video signal stored in a first memory unit of a camera module according to a second embodiment of the present invention and a frame of a video signal stored in advance in a second memory unit
5 is a schematic block diagram of an example of an electronic device control system having a camera module according to the present invention
6 is a schematic block diagram of an electronic device control system of another example having a camera module according to the present invention
7 is a schematic block diagram of an electronic device control system of another example having a camera module according to the present invention
8 is a view showing an example in which a camera module according to the present invention is installed
9 is a view showing another example in which a camera module according to the present invention is installed

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a schematic block diagram of a camera module according to a first embodiment of the present invention.

A camera module according to the present invention includes: an image sensor (100) for photographing a predetermined area and outputting it as a video signal; An image correction unit 210 for correcting the image signal output from the image sensor 100; A first memory unit 220 for storing frames of the image signal corrected by the image correction unit 210; The first memory unit 220 compares a frame of a current video signal with a frame of a previous video signal among the frames of the video signal stored in the first memory unit 220 and outputs a congestion degree data 1 comparison unit 230. [

Here, the camera module according to the first embodiment of the present invention is provided so as to photograph the predetermined area, and photographs the predetermined area and outputs the congestion degree data which can be determined by the moving object.

That is, the camera module photographs a predetermined area in the image sensor 100 and outputs a video signal.

The image corrector 210 corrects the image signal output from the image sensor 100.

At this time, the image correcting unit 210 corrects the lens according to lens shading, corrects the lens distortion by automatically compensating the gain for each pixel, corrects the white balance, And performs correction on the image signal output from the image sensor 100.

The first memory unit 220 stores the corrected image signal frame by the image correction unit 210 and the first comparison unit 230 compares the image stored in the first memory unit 220 Signal frames and compares the frame of the current video signal with the frame of the previous video signal to output the congestion degree data that can determine the motion of the moving object in a predetermined area.

On the other hand, the moving object is at least one of a person, an animal, and a vehicle.

Therefore, the camera module of the present invention does not have expensive active type components and has an advantage of being able to extract information on the movement of the moving object by having relatively inexpensive passive type components have.

Reference numeral 200 in FIG. 1 refers to an image signal processing unit.

2A and 2B are views schematically showing a frame of a current image signal and a frame of a previous image signal photographed by the camera module according to the first embodiment of the present invention.

The frames of the video signal ('300' in FIGS. 2A and 2B) captured in real time in the camera module and stored in the first memory unit are divided into a frame of the current video signal and a frame of the previous video signal .

2A is a frame of a previous video signal, and FIG. 2B is a frame of a current video signal, the moving persons 310 and 320 move for a predetermined period of time (I.e., the person 310 is located on the left side of the frame, and FIG. 2B is a view showing the position of the person (the right side of the frame) on the right side of the frame 320 are located.

In this way, the camera module according to the first embodiment of the present invention can output the congestion degree data that can determine the motion of the moving object in a predetermined area by comparing the frame of the current video signal with the frame of the previous video signal.

Therefore, the camera module according to the first embodiment of the present invention can recognize the entry, stay, and traffic of a moving object in a predetermined area where the camera module is installed.

3 is a schematic block diagram of a camera module according to a second embodiment of the present invention.

The camera module according to the second embodiment of the present invention is provided to photograph a predetermined area and captures the predetermined area and outputs the complexity data capable of determining the complexity in the predetermined area.

That is, the predetermined area is an area that can be photographed by the camera module, and includes an area that can be photographed when the camera module is movable.

The complexity is compared with a quantitative value such as the number of moving objects in the predetermined area to output the complexity data.

The camera module according to the second embodiment of the present invention includes an image sensor 100 for photographing a predetermined area and outputting the image signal as an image signal; An image correction unit 210 for correcting the image signal output from the image sensor 100; A first memory unit 220 for storing frames of the image signal corrected by the image correction unit 210; A second memory unit 250 for storing a frame of the video signal obtained by photographing the predetermined area in which the moving object does not exist in the image sensor 100; A second comparison for comparing the frame of the current video signal stored in the first memory unit 220 with the frame of the video signal stored in the second memory unit 250 and outputting the complexity data for determining the complexity of the predetermined area (260).

Therefore, in the camera module according to the second embodiment of the present invention, first, the image sensor 100 photographs the predetermined area in which the moving object does not exist, and outputs a video signal, The image correction unit 210 corrects the image signal of the first image signal and stores the corrected image signal frame in the second memory unit 250. [

Thereafter, the image sensor 100 photographs a predetermined region of the current point of view and outputs the image signal as an image signal. The image corrector 210 corrects the image signal of the predetermined region photographed at the current point of time, And stores the frames of the signal in the first memory unit 250.

The second comparing unit 260 compares the frame of the current video signal stored in the first memory unit 220 with the frame of the video signal stored in the second memory unit 250 to determine the complexity of the predetermined area And outputs the complexity data that can be obtained.

Therefore, the camera module of the present invention has an advantage that the electronic device can be controlled according to the movement amount of the moving object by photographing a predetermined area, outputting the congestion degree and the complexity data of the predetermined area.

4A and 4B are views schematically showing a frame of a current video signal stored in a first memory unit of a camera module according to a second embodiment of the present invention and a frame of a video signal stored in advance in a second memory unit.

The frame of the current video signal stored in the first memory unit is a frame of the video signal that is captured and output in a predetermined area in the image sensor, and the frame of the video signal stored in advance in the second memory unit is a frame when the moving object does not exist in the predetermined area , And a frame of a video signal obtained by photographing and outputting the predetermined area.

4A is a frame of a video signal obtained by photographing and outputting the predetermined area when no moving object is present in a predetermined area, and FIG. 4B is a frame of a video signal obtained by photographing and outputting a predetermined area, The camera module according to the second embodiment of the present invention can output the complexity data that can determine the complexity of a predetermined region, as compared with FIG. 4A in which no moving object is present and FIG. 4B in which the moving objects 331, 332, .

FIG. 5 is a schematic block diagram of an exemplary electronic device control system including a camera module according to the present invention. FIG. 6 is a schematic block diagram of an electronic device control system of another example having a camera module according to the present invention And FIG. 7 is a schematic block diagram of an electronic device control system of another example having a camera module according to the present invention.

An electronic device control system equipped with a camera module compares frames of a video signal photographed in a predetermined area to output congestion degree data that can determine the motion of the moving object in the predetermined area, A camera module (290) for outputting complexity data for determining a complexity of a predetermined region by comparing a frame of the video signal photographed and outputted with a frame of the video signal photographed with the predetermined region; And an electronic device control unit for receiving the congestion degree data or the complexity data output from the camera module 290 and controlling the electronic equipment.

That is, the electronic device control unit controls the electronic device with the congestion degree data or the complexity data of the predetermined area output from the camera module 290.

For example, the electronic device control unit is a control unit of a lighting device, a control unit of a cooling device, and a control unit of a heating device.

5, the lighting control unit 271 of the lighting device controls the lighting unit 272 with the congestion degree data or the complexity data output from the camera module 290. [

The illumination control unit 271 controls brightness, wavelength, and color temperature of light illuminated by the illuminating unit 272 to control not only emotional illumination but also illumination intensity according to existence, flow, and complexity of the moving object in the predetermined area So that the moving object can provide an optimal illumination state in the predetermined area.

6 and 7, the congestion degree data or the complexity data output from the camera module 290 are output to the cooler 280 and the warmer 281, and the degree of congestion and complexity of the moving object in the predetermined area The temperature of the predetermined area can be maintained comfortably.

FIG. 8 is a view showing an example in which a camera module according to the present invention is installed, and FIG. 9 is a view showing another example in which a camera module according to the present invention is installed.

The above-described camera module has a plurality of areas (A, B, C, D, E, F, G, H, I, J) such as a park, a department store, a shopping center, It is possible to extract the congestion degree and the complexity data of the moving object by installing the camera module in each of the areas A, B, C, D, E, F, G, H, It is possible to control electronic devices existing in each of the areas A, B, C, D, E, F, G, H, I,

9, a camera module is installed in each of a plurality of areas (a, b, c, d, e) in which a 'passageway 600' through which a moving object such as a highway or a promenade can move is virtually separated And control the electronic devices installed in the corresponding area.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (7)

An image sensor for photographing a predetermined area and outputting the image signal as an image signal;
An image correcting unit for correcting the image signal output from the image sensor;
A first memory unit for storing frames of the image signal corrected by the image correction unit;
A second memory unit for storing the frame of the video signal obtained by photographing the predetermined area in which the moving object does not exist from the image sensor;
A first comparison unit for comparing the frame of the current video signal with the frame of the previous video signal among frames of the video signal stored in the first memory unit and outputting the congestion degree data capable of determining the motion of the moving object in a predetermined area; part; And
A first memory unit for storing a plurality of frames of a current image signal stored in the first memory unit and a second memory unit for storing a complexity data for determining a complexity of a predetermined area based on the number of moving objects corresponding to a quantitative value, And a second comparison unit for outputting the second comparison result.
delete The method according to claim 1,
Wherein:
A camera module that is at least one of a person, an animal, and a vehicle.
The frame of the image signal photographed in the predetermined area is compared with each other, and congestion degree data for judging the motion of the moving object in the predetermined area is outputted, or the frame of the output image signal is photographed, A camera module that compares a frame of a video signal photographed in a predetermined area with the currently captured image signal and outputs complexity data that can determine the complexity of a predetermined area; And
And an electronic device control unit for receiving the congestion degree data or the complexity data output from the camera module and controlling the electronic equipment,
The camera module includes:
An image sensor for photographing a predetermined area and outputting the image signal as an image signal;
An image correcting unit for correcting the image signal output from the image sensor;
A first memory unit for storing frames of the image signal corrected by the image correction unit;
A second memory unit for storing the frame of the video signal obtained by photographing the predetermined area in which the moving object does not exist from the image sensor;
And outputting the congestion degree data capable of comparing the frame of the current video signal and the frame of the previous video signal among frames of the video signal stored in the first memory unit, 1 comparison unit; And
A first memory unit for storing a plurality of frames of a current image signal stored in the second memory unit and a second memory unit for storing a complexity data for determining a complexity of the predetermined region based on the number of moving objects corresponding to a quantitative value, And a second comparator for comparing the output of the camera module with the output of the second comparator.
The method of claim 4,
The electronic device control unit includes:
An electronic device control system including a camera module which is one of a control unit of a lighting device, a control unit of a cooling device, and a control unit of a heating device.

delete delete

Images