KR20150125246A - Controlling method for setting of multiview camera and controlling apparatus for setting of multiview camera - Google Patents

Abstract

A method of adjusting shooting setting values for a multi-viewpoint camera includes the steps of photographing the same object by a plurality of cameras disposed at different positions, receiving an image shot by a plurality of cameras connected to the plurality of cameras, And adjusting a photographing setting value for at least one of the plurality of cameras such that a color of each image photographed by the plurality of cameras corresponds to a standard value.

Description

TECHNICAL FIELD [0001] The present invention relates to a method of adjusting a shooting setting value for a multi-view camera and a device for adjusting a shooting setting value for a multi-view camera.

The technique described below relates to a method and apparatus for adjusting a set value associated with a color of an image for a plurality of multi-viewpoint cameras.

A multi-view image is a field of image processing that provides users with various viewpoints in various directions through spatial synthesis of images photographed by one or more cameras. In order for an image having different viewpoints to be rendered as one scene, the color of each image captured at the same point of view must be kept constant.

Korea Patent Publication No. 2013-0135606 Korea Patent Publication No. 2011-0071854

Even if the cameras of the same type are set the same, the environment such as illuminance may vary depending on the position where the multi-viewpoint camera is disposed. In this case, the images acquired by the plurality of multi-viewpoint cameras may have different colors, brightness, etc., even though they capture the same object at the same time. The multi-view images are generated by combining images acquired by a plurality of cameras. If the multi-view images have different color values, the generated images are not natural.

The technique described below is intended to allow a plurality of multi-viewpoint cameras to acquire images of uniform color.

The solutions to the technical problems described below are not limited to those mentioned above, and other solutions not mentioned can be clearly understood by those skilled in the art from the following description.

A method of adjusting shooting setting values for a multi-viewpoint camera includes the steps of photographing the same object by a plurality of cameras disposed at different positions, receiving an image shot by a plurality of cameras connected to the plurality of cameras, And adjusting a photographing setting value for at least one of the plurality of cameras such that a color of each image photographed by the plurality of cameras corresponds to a standard value.

The step of calibrating comprises the steps of calculating an average value for each RGB of the image and calculating the average value of the camera so that the calculated image corresponds to the standard value or the standard value and the error range, .

The standard value may be an average value for each of RGB of the image captured by one of the cameras, or may be an average value for each RGB set in advance.

The shooting setting value is at least one of a white balance value, an F-number, a sensitivity value (ISO), and a shutter speed (shuuter spped).

The apparatus for adjusting the photographing setting values for the multi-viewpoint camera includes: a storage unit for storing images captured by a plurality of cameras disposed at different positions on the same object and imaging setting values determined by the processor apparatus; A processor device for determining an imaging setting value for at least one camera so that the color of the image photographed by the camera corresponds to a standard value, and an interface device for delivering the determined imaging setting value to any one of the cameras.

The processor device may calculate an average value of each of RGB of the image captured by at least one camera and determine at least one shooting setting value of the camera so that the average value corresponds to the standard value or the standard value and the error range.

The processor device may determine a photographing setting value for at least one camera such that the color of the entire image taken by at least one camera or a part of the image corresponds to a standard value.

Conventionally, an image obtained by a plurality of multi-viewpoint cameras is manually adjusted. However, in the technique described below, a plurality of multi-viewpoint cameras acquire uniform color images from the beginning, and it is convenient to generate multi-view images.

The effects of the techniques described below are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

FIG. 1 is an example showing a scene in which a specific object is photographed by a plurality of multi-viewpoint cameras.
2 is an example in which a plurality of multi-viewpoint cameras are arranged.
Fig. 3 is an example of a screen in which some of the multi-viewpoint cameras of Fig. 1 capture the same object at the same time point.
4 is an example of a flowchart of a method of adjusting a photographing setting value for a multi-view camera.
5 is an example of a process of adjusting the color of an image taken by a camera to correspond to a standard value.
6 is another example of a flowchart of a method of adjusting the photographing setting value for the multi-view camera.
7 is an example of a block diagram showing a configuration of an apparatus for adjusting a photographing setting value for a multi-view camera.

The following description is intended to illustrate and describe specific embodiments in the drawings, since various changes may be made and the embodiments may have various embodiments. However, it should be understood that the following description does not limit the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the following description.

The terms first, second, A, B, etc., may be used to describe various components, but the components are not limited by the terms, but may be used to distinguish one component from another . For example, without departing from the scope of the following description, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

As used herein, the singular " include "should be understood to include a plurality of representations unless the context clearly dictates otherwise, and the terms" comprises & , Parts or combinations thereof, and does not preclude the presence or addition of one or more other features, integers, steps, components, components, or combinations thereof.

Before describing the drawings in detail, it is to be clarified that the division of constituent parts in this specification is merely a division by main functions of each constituent part. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more functions according to functions that are more subdivided. In addition, each of the constituent units described below may additionally perform some or all of the functions of other constituent units in addition to the main functions of the constituent units themselves, and that some of the main functions, And may be carried out in a dedicated manner. Accordingly, the presence or absence of each component described in the present specification should be interpreted as a function. For this reason, a method (200, 300) of adjusting a photographing setting value for a multi-view camera It is clear that the configuration of the components according to the apparatus 400 for adjusting the photographing set values for the photographing set can be different from the corresponding figures within the scope of achieving the object of the following description.

Also, in performing a method or an operation method, each of the processes constituting the method may take place differently from the stated order unless clearly specified in the context. That is, each process may occur in the same order as described, may be performed substantially concurrently, or may be performed in the opposite order.

The technique described below is basically a technique for uniformly coloring the colors of images photographed by a plurality of multi-viewpoint cameras. In the following description, the camera includes a camera for capturing a still image and a camera for capturing a moving image. The techniques described below use digital image data and control the hardware settings for the camera. Therefore, the following camera basically means a digital image device such as a digital camera or a digital camcorder.

The values that affect the color of the camera's hardware settings are white balance, F-number, ISO value, and shutter speed. The white balance is a setting value for correcting a problem in which the color of the object to be photographed varies depending on the illumination color of the photographing place, and the F value is a value for determining the degree of opening of the camera iris. And the shutter speed is a value related to the time when the lens is exposed at the time of photographing. These values are widely used in the field of camera image, so a detailed description thereof will be omitted. Hereinafter, such a camera hardware setting value is referred to as a shooting setting value.

Hereinafter, a method (200, 300) for adjusting a photographing setting value for a multi-view camera and an apparatus (400) for adjusting a photographing setting value for a multi-view camera will be described in detail with reference to the drawings.

FIG. 1 is an example showing a scene in which a specific object is photographed by a plurality of multi-viewpoint cameras. The plurality of cameras 50 shown in FIG. 1 correspond to multi-view cameras having different viewpoints. Hereinafter, a device referred to as a camera means a multi-view camera having different viewpoints such as the camera shown in FIG. In FIG. 1, reference numerals from camera a 50a to camera f 50f are separately given in connection with the following description.

Fig. 1 shows a case where a plurality of cameras 50 are arranged in a circle around an object 5 to be imaged. More precisely, a plurality of cameras are arranged in an arc shape on a virtual horizontal plane having a constant height. Literally, an arc means a portion defined by two points on a circumference or other curve. The camera may be disposed circumferentially around the object 5 located in the central region of the circle, or may be disposed at a constant portion of the circumference. Fig. 1 shows an example in which a plurality of cameras are arranged at regular intervals on a portion indicated by a dashed line in a circumference.

A plurality of cameras (50) are placed on the pedestal device (30) where the camera is fixed. Each of the cameras may be disposed in a device such as a separate tripod or a plurality of cameras 50 may be successively disposed on one circular arc like the pedestal device 30 shown in FIG.

The same camera apparatus as shown in Fig. 1 can generate an image having the effect of rotating the object 5. [ For example, the camera apparatus of FIG. 1 can generate an image representing the motion of a person while rotating in a static state in a movie 'matrix'. This video technique is also called time slicing.

However, the technique described below does not necessarily apply to the multi-view camera of the type shown in FIG. It is sufficient for the multi-viewpoint camera to photograph the same object or adjacent object at the same time. 2 is an example in which a plurality of multi-viewpoint cameras are arranged.

2 (a) shows a case where the camera 50 is arranged in an arc shape and has a certain distance from the object 5 as an object of photography as shown in Fig. Fig. 2 (b) shows a case where the cameras 50 are arranged in a straight line and their distances from the object 5 are different from each other. 2 (c) shows a case where a plurality of cameras 50 are randomly arranged.

The technique described below is for uniformizing the color of an image when a plurality of cameras photograph the same object with each other at the same time. Therefore, it is not related to the camera layout. Depending on the placement of the camera, the size of the object in the image can vary, but this is something that needs to be corrected through a separate task if necessary. Therefore, the technique described below is not related to the arrangement state of a plurality of cameras, and can be applied to the case of shooting the same object or an object overlapping each other at the same time.

Fig. 3 is an example of a screen in which some of the multi-viewpoint cameras of Fig. 1 capture the same object at the same time point. 3 (a), 3 (b), 3 (c) and 3 (d) sequentially show the camera 50a, the camera 50b, the camera 50c and the camera 50d may be acquired images. FIG. 3 (a) shows RGB average values of 100, 50 and 80, FIG. 2 (b) shows RGB average values of 95, 55 and 81, 60, and 85, and FIG. 3 (d) shows RGB average values of 80, 60, and 75, respectively. Therefore, the color values are slightly different from each other even though the images are shot by the adjacent camera at the same time. In Figs. 3 (b), 3 (c) and 3 (d), hatching or dotted lines indicate that color values are different from each other. If the object 5 generates a rotated multi-view image, the images of FIG. 3 (a) through FIG. 3 (d) are sequentially output. At this time, the viewer can see a bright, dark, or flickering feeling .

Therefore, the conventional worker moved the photographed photographs to a computer device through a storage medium such as a USB, an SD card, etc. and compares the photographed images at the same time with each other, thereby correcting colors to generate multi-view images.

In FIG. 1, each camera 50 is connected to the control device 80 by a wire. That is, the control device 80 can receive the images acquired by the respective cameras 50 in real time or at regular time intervals. The interface device for connecting the plurality of cameras 50 and the control device 80 transfers information between the communication module (socket) built in the camera 50 and the communication module built in the control device 80 by wire or wirelessly . The interface device may be a wired device or a wireless network device that transmits data using the same protocol between the camera 50 and the control device 80, which is a computer device. Various types of devices, protocols, etc. used in the related field can be used as the interface device.

The following description relates to a computer apparatus corresponding to the control apparatus 80 in Fig. 1 or a computer apparatus used separately from image control. The computer device receives all of the images from the plurality of cameras 50, determines a color difference by comparing the image obtained by the camera 50 with a reference value, and adjusts the photographing setting of each camera 50 Control the value.

4 is an example of a flowchart for a method 200 of adjusting a photographing setting value for a multi-view camera.

First, a plurality of cameras disposed at different positions capture the same object (210). Since multi-view images capture the same object (or overlapping objects) and combine them into one image, it is desirable to capture the same object at the same time if possible. Especially when shooting moving objects. Furthermore, even if each camera photographs an object with a time lag, colors can be unified by applying the technique described below. Since the technique described below is for adjusting the hardware setting value of each camera prior to the full-scale shooting, it is sufficient to photograph another object that can be a reference for the background screen or color in step 210. [

The computer device receives an image captured by a plurality of cameras (220). A computer device receives an image captured by a plurality of cameras via a wired or wireless interface. In this process, the computer device receives the initial setting value of each camera. Thereafter, the computer device calculates an RGB average value for an image captured by each of the plurality of cameras (230).

The computer device compares the RGB average value of the images photographed by the plurality of cameras with a reference standard value (240). The standard value may be an RGB average value of an image taken by any one of a plurality of cameras, or may be a predetermined color value.

Further, the standard value is preferably a value having a certain range rather than a specific value. For example, even if the RGB average value is about 1 to 2, even if the difference is not easily noticeable in the image, the camera having a difference between the standard value and the RGB average value of 1 to 2 does not need to change the shooting setting value. Of course, you can adjust the shooting settings to exactly match the standard values.

If the average value of each of the RGB images acquired by one of the cameras is within the standard value range, the process proceeds to step 260. The expression "within the standard value range" means that the RGB average value is equal to the standard value or within the error range.

If the average value of each RGB of the image obtained by one of the cameras is out of the standard value range, the computer should adjust the photographing setting value of the camera so that the RGB average value of the image obtained by one of the cameras falls within the standard value range . Accordingly, the computer device must determine the photographing setting value of the camera in which the RGB average value of the image acquired by one of the cameras falls within the standard value range (250).

In step 250, the computer determines how much to change each set value based on the initial setting values of each camera. The white balance, the sensitivity value, the F value, and the shutter speed, or may change two or more setting values. The specific shooting setting value change may vary depending on the hardware characteristics of the camera.

If the RGB average value and the standard value are compared (240) and the determination of the shooting setting value (250) is completed for all the images acquired by all the cameras, the computer device transmits the newly determined shooting setting values to each camera (270) .

Thereafter, the plurality of cameras take an image of the object according to their shooting set values (280). Since the color of the image captured in step 280 is already constant, the operator can directly synthesize the multi-view image without color correction.

5 is an example of a process of adjusting the color of an image taken by a camera to correspond to a standard value. It is assumed that the RGB average value of the image taken by the camera should be within the standard value and the error range 2.

5 (a) shows an example of an RGB average value and a standard value of an image taken by a camera. The left diagram of FIG. 5 (a) corresponds to the image acquired by the camera a 50a shown in FIG. In FIG. 5A, the image obtained by the camera a 50a is divided into several regions, and the RGB average value is calculated by sampling the region indicated by A. FIG. The area A of the image captured by the camera a 50a has a value of R = 90, G = 40, and B = 90.

5 (a) is an image obtained by the camera f (50f) shown in Fig. 1, and is an example in which the image is used as a standard value used for color adjustment of another camera. The RGB average value (i.e., the standard value) of the A 'zone corresponding to the A zone is 95 for R, 35 for G, and 95 for B. In Fig. 5 (a), "Reference" is indicated.

The RGB average value of the image photographed by the camera a 50a has a difference of 5 from the standard value. Therefore, the camera a 50a is a situation in which the photographing set value must be corrected. 5 (a) shows an example in which the RGB average value and the standard value are compared with each other based on a part rather than a whole image acquired by the camera.

The RGB average value can be calculated using the entire image acquired by the camera, a partial image of the entire image, and the like. If only a part is used, the operation speed can be accelerated.

 5 (b) shows an example of the photographing setting value of the camera a 50a. The left side of FIG. 5 (b) is the original photographing setting value of the camera a 50a, and the right side of FIG. 5 (b) is the photographing setting value for changing the RGB average value to within the standard value and error range. You can see that the white balance, sensitivity value and shutter speed have been changed.

5A, if the RGB average value of the A zone of the image photographed by the camera a 50a is 94, G is 31, B is changed to 95 (after correction).

FIG. 6 is another example of a flowchart for a method 300 for adjusting a photographing setting value for a multi-view camera. The method 300 shown in FIG. 6 has a process that is largely similar to the method 200 shown in FIG. The description of the same process is omitted or simplified.

The computer device calculates an average value for each RGB of the image acquired by any one of the cameras (330), and determines whether the calculated average value is within the standard value range (340). If the calculated average value is not within the standard value range (340), the computer determines the shooting setting value of the camera (350).

In step 250, it is necessary to determine the shooting set value and then calculate the RGB average value again for the image acquired by the camera to check whether it is within the standard value range. It is a process to check whether the change of the hardware setting of the camera works as intended.

The computer device transmits a newly determined shooting set value to the camera, and when the camera having received the new shooting set value acquires the image with the new shooting set value, the computer device calculates the RGB average value of the image acquired by the camera again (360). This configuration is different from the method 200 shown in FIG. If the computed RGB average value is within the standard value range, the computer device proceeds to step 370. However, if the newly calculated RGB average value is out of the standard value range, the computer device again determines the shooting setting value for the corresponding camera (350) (360 and 340) to determine whether the RGB average value of the acquired image is within the standard value range.

7 is an example of a block diagram showing a configuration for an apparatus 300 for adjusting a photographing setting value for a multi-view camera. The device 400 for adjusting the photographing setting value for the multi-viewpoint camera is a device corresponding to the above-described computer device. The description of the methods 200 and 300 for adjusting the shooting setting values for the multi-viewpoint camera described above will be omitted or briefly described.

The apparatus 400 for adjusting the shooting setting values for the multi-viewpoint camera includes a plurality of cameras disposed at different positions for capturing an image of the same object, a current initial shooting setting value of each camera, and a shooting setting value determined by the processor apparatus A processor device (430) for determining a photographing setting value for at least one camera such that the color of the image photographed by at least one camera among the plurality of cameras corresponds to a standard value, And an interface device 410 for transferring the image data to any one of the cameras.

The interface device 410 corresponds to a communication module that exchanges video or control signals with a plurality of cameras.

When the images captured by the plurality of cameras and the initial setting values of the respective cameras are received through the interface device 410, they are stored in the source image storage 421 of the storage device 420. The initial shooting setting values of each camera may be stored in the storage device 420 in advance.

The processor device 430 calculates an average value for each of RGB of the image photographed by at least one camera and determines a correction shooting setting value such that the average value corresponds to the standard value or the standard value and the error range. The correction shooting setting value means the shooting setting value changed from the initial shooting setting value. The correction shooting setting values are stored in a table form for each camera. In FIG. 6, this is indicated by the photographing setting value table 422.

Meanwhile, the memory device 440 may be a cache for the operation of the processor device 430, or may be a device embedded with a program for adjusting the photographing setting value of the camera. If the shooting setting value adjustment program is embedded in the memory device 440, the processor device 430 may drive the program to adjust the shooting setting value.

The standard value may be an average value for each of RGB of an image captured by one of the plurality of cameras, or may be an average for each RGB set in advance. In addition, it is possible to compare the RGB average value and the standard value of some areas other than the entire image acquired by the camera.

The shooting setting value corresponds to at least one of a white balance value, an F-number, a sensitivity value (ISO), and a shutter speed.

It should be noted that the present embodiment and the drawings attached hereto are only a part of the technical idea included in the above-described technology, and those skilled in the art will readily understand the technical ideas included in the above- It is to be understood that both variations and specific embodiments which can be deduced are included in the scope of the above-mentioned technical scope.

5: object 30: pedestal device
50: camera 80: control device
400: Device for adjusting the shooting setting value for the multi-view camera
410: interface 420: storage device
421: Source image 422: Setting value table
430: processor device 440: memory device

Claims (12)

Photographing the same object by a plurality of cameras disposed at different positions;
The computer apparatus connected to the plurality of cameras receiving the images photographed by the plurality of cameras; And
Adjusting a photographing setting value for at least one of the plurality of cameras such that the color of each image photographed by the plurality of cameras corresponds to a standard value, Way. The method according to claim 1,
The adjusting step
Calculating a mean value for each of RGB of the image; And
And adjusting a photographing setting value of a camera that photographs an image obtained by calculating the average value so that the image calculated by the computer device corresponds to the standard value or within an error range with the standard value, How to adjust the shooting settings. The method according to claim 1,
The adjusting step
The computer device comprising: calculating an average value for each of RGB of the image;
Determining and storing an image capturing setting value of a camera that captures an image obtained by calculating the average value so that the image calculated by the computer device corresponds to the standard value or within an error range with the standard value; And
And the computer device transmits the photographing setting value to a camera in which the photographing setting value is stored, from the plurality of cameras, to the computer apparatus. 4. The method according to any one of claims 1 to 3,
Wherein the standard value is an average value for each of RGB of an image photographed by any one of the plurality of cameras or an average value for each RGB set in advance. The method according to claim 1,
Wherein the computer device adjusts the photographing setting value to adjust the photographing setting value such that the color of the image corresponds to a standard value based on the entire image or a part of the image. The method according to claim 1,
Wherein the photographing setting value is at least one of a white balance value, an F-number, a sensitivity value, and a shutter speed. The method according to claim 1,
Wherein the plurality of cameras are arranged in an arc shape on a horizontal plane. A storage device for storing images obtained by photographing the same object by a plurality of cameras disposed at different positions, an initial photographing setting value of each camera, and a correction photographing setting value determined by the processor device;
A processor device for determining the corrected photographing setting value for at least one camera such that the color of the image photographed by at least one of the plurality of cameras corresponds to a standard value; And
And an interface device for delivering the correction shooting setting value to any one of the cameras. 9. The method of claim 8,
The processor device
Calculating a corrected image pickup setting value of the at least one camera so that the average value corresponds to the standard value or is within an error range with respect to the standard value, A device that adjusts shooting settings for the camera. 9. The method of claim 8,
Wherein the standard value is an average value for each of RGB of an image photographed by any one of the plurality of cameras or an average value for each RGB set in advance. 9. The method of claim 8,
Wherein the photographing setting value is at least one of a white balance value, an F-number, a sensitivity value (ISO), and a shutter speed. 9. The method of claim 8,
The processor device
And adjusts the shooting setting value for the multi-view camera to determine a correction shooting setting value for the at least one camera such that the color of the entire image or at least a part of the image taken by at least one camera corresponds to a standard value.

Images