WO2019014842A1

WO2019014842A1 - Light field acquisition method and acquisition device

Info

Publication number: WO2019014842A1
Application number: PCT/CN2017/093344
Authority: WO
Inventors: 李乔
Original assignee: 辛特科技有限公司; 李乔
Priority date: 2017-07-18
Filing date: 2017-07-18
Publication date: 2019-01-24
Also published as: CN111164970B; CN111164970A

Abstract

Provided in the present invention are a light field acquisition method, the method comprising: (a) a plurality of light field cameras are arranged in an array to form camera groups, and the plurality of the camera groups are arranged in an array to form a camera wall, wherein a plurality of cameras in the same camera group have different focal lengths; (b) the plurality of the camera groups of the camera wall acquire spatial image information at different viewing angles, and the plurality of the cameras in the same camera group acquire image information having different spatial depths at the same viewing angle; and (c) the camera sends the acquired image information to an image processing computer, and the image processing computer carries out denoising processing and image information verification to obtain complete spatial image information. According to the light field acquisition method provided in the present invention, image information in spaces having different depths is acquired by means of cameras having different focal lengths, thereby wholly acquiring and recording an entire light field.

Description

Light field collecting method and collecting device

Technical field

The invention relates to the field of light field collection technology, in particular to a light field collection method and a collecting device.

Background technique

Almost any 3D imaging technology has been developed based on this principle of polarization. In 1839, the British scientist Winster discovered a wonderful phenomenon. The distance between the eyes of a person is about 5cm (European average). When looking at any object, the angles of the two eyes do not coincide, that is, there are two angles of view. This subtle difference in viewing angles is transmitted to the brain through the retina, which distinguishes the front and back of the object and produces a strong three-dimensional effect. This is the principle of polarization, and almost any 3D imaging technology has been developed based on this principle so far.

However, 3D equipment based on the principle of "polarization" cannot solve the dizziness problem caused by people during use. In the natural environment, the left and right parallax and the eye focus system can confirm each other, so that the brain knows that these two functions are tacit cooperation. When the user is watching the 3D image based on the "polarization principle", due to the lack of the participation of the eye focus system, the two sets of the brain's distance sensing system and the observation in the natural environment are different, and this difference makes the brain very uncomfortable. The sense of vertigo is created.

In order to solve the problem of vertigo in 3D video, the industry has introduced a light field theory solution. One of the more representative companies in the field of 3D photography is Lytro. Lytro's light field camera uses a microlens array method to solve the position and direction of recording a single light, but the lens array method currently has several major drawbacks: large pixel loss, resolution of 40 million pixel light field photos. The normal photo output resolution is only 2450×1634 (about 4 million pixels); the speed is slow, because the amount of data recorded by a single photo is as high as 50M, when the camera is too fast, the storage operation of the camera can not keep up, each picture It takes a few seconds to load.

A representative company in the field of 3D broadcasting is a solution based on light field theory made by Magic Leap, but this solution uses optical fiber scanning technology to realize light field display, fiber Due to the control of the rotation, angle and illumination of the optical fiber, it has certain difficulties in control. In addition, the multi-focus display method proposed in the prior art uses an eye detection system to detect an eye observation point and then re-render the picture, and adjusts the picture projected to the eye. Each time an image of the depth information is cast, it is difficult to completely restore the entire light field. .

Therefore, in order to solve the above problems, a light field collecting method and a collecting device capable of completely collecting and recording the entire light field and facilitating rapid and complete restoration of the light field are needed.

Summary of the invention

One aspect of the present invention provides a method of light field acquisition, the method comprising:

a) a plurality of light field camera arrays into a camera group, a plurality of the camera groups being arrayed into a camera wall, and a plurality of cameras in the same camera group having different focal lengths;

b) a plurality of the camera groups of the camera wall collect spatial image information at different viewing angles, and the plurality of the cameras in the same camera group collect image information of different spatial depths in the same viewing angle;

c) The camera sends the collected image information to the image processing computer, and the image processing computer performs denoising processing and image information verification on the collected image information to obtain complete spatial image information.

Preferably, the plurality of cameras in the same camera group are in a tight array, and each camera can acquire complete image information of the spatial region under the same viewing angle.

Preferably, the plurality of cameras in the same camera group simultaneously collect image information of different spatial depths.

Preferably, the plurality of cameras in the same camera group use different image distances to acquire image information of different spatial depths from the same focal length.

Preferably, the plurality of cameras in the same camera group use the same image distance to acquire image information of different spatial depths at different focal lengths.

Preferably, the camera wall is arrayed by a plurality of the camera groups on a planar or spherical base.

Preferably, the unfocused portion of the acquired image information is removed by a denoising process.

Preferably, the denoising and removing process removes an unfocused portion of the acquired image information by using a method of mapping.

Another aspect of the present invention provides a light field collecting device including a planar or spherical base, a camera wall mounted on the planar or spherical base, and an image processing computer;

The camera wall includes a plurality of camera groups of the array, the camera group includes a plurality of cameras of the array, and the plurality of cameras in the same camera group have different focal lengths;

The plurality of the camera groups of the camera wall are configured to collect spatial image information at different viewing angles; and the plurality of the cameras in the same camera group are used to collect image information of different spatial depths in the same viewing angle;

The image processing computer is configured to perform denoising processing and image information verification on the collected image information.

The invention provides a light field collecting method and a collecting device, which can acquire image information of different spatial depths through cameras with different focal lengths, synthesize a collection of multiple depth image information, and can completely collect and record the entire light field, and facilitate the light field. Fast and complete restore.

It is to be understood that the foregoing general descriptions

DRAWINGS

Further objects, features, and advantages of the present invention will be made apparent by the following description of the embodiments of the invention.

1a to 1b are schematic views showing a light field collecting device of the present invention;

2 is a flow chart showing the light field collection method of the present invention;

3 is a schematic view showing an image of a camera wall of the present invention for collecting different spatial regions;

4 is a schematic diagram showing an image of a corresponding spatial region of a camera group in an embodiment of the present invention;

FIG. 5 is a schematic diagram showing the acquisition of different spatial depth images by the same camera group of the present invention.

Detailed ways

The objects and functions of the present invention and the use thereof are achieved by reference to exemplary embodiments. And functional methods will be clarified. However, the invention is not limited to the exemplary embodiments disclosed below; it can be implemented in various forms. The essence of the description is merely to assist those skilled in the relevant art to understand the specific details of the invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the figures, the same reference numerals are used to refer to the same or similar parts, or the same or similar steps, unless otherwise stated.

The content of the present invention is described in detail below with reference to the accompanying drawings, in which the light field collecting device of the present invention is shown in FIG. 1a to FIG. 1b. The spherical base, the camera wall 100 mounted on the outer side of the spherical base, and the image processing computer, the spherical base is used in this embodiment, and the camera wall 100 is mounted on the outer side 100b of the spherical base to enable the camera wall 100 to collect space in all directions. Image information of the area. The base for mounting the camera wall 100 may be planar or spherical, and this embodiment preferably employs a spherical base.

The camera wall 100 includes a plurality of camera groups 110 of an array, the camera group 110 includes a plurality of cameras 111 of an array, and a plurality of cameras 111 in the same camera group 110 are closely arranged, and each camera can acquire the same viewing angle. The complete image information of the lower spatial region has multiple focal lengths within the same camera set 110. The camera 111 realizes data transmission with the image processing computer on the inner side 100a of the spherical base. Specifically, the data transmission may be a wired connection for data transmission or a wireless data transmission.

The plurality of camera groups 110 of the camera wall 100 are used to collect spatial image information at different viewing angles. The plurality of camera heads 111 in the same camera group 110 are used to collect image information of different spatial depths in the same viewing angle, and the image processing computer collects the image information. Image information is denoised and image information is verified.

As shown in FIG. 2, a flow chart of a light field collection method of the present invention includes a method for collecting light field according to the present invention:

S101: acquiring image information, wherein the plurality of light field camera arrays are formed into a camera group, the plurality of camera groups are arrayed into a camera wall, and the plurality of cameras in the same camera group have different focal lengths, and the camera wall is arrayed by the plurality of camera groups. Outside the spherical base, it is used to capture image information of the space area.

The plurality of camera groups of the camera wall collect spatial image information at different viewing angles, and the plurality of cameras in the same camera group collect image information of different spatial depths in the same viewing angle. As shown in FIG. 3, the camera wall of the present invention collects schematic images of spatial images at different viewing angles. The camera wall 100 is mounted on a spherical base, and different camera groups 110 collect image information of spatial regions at different viewing angles. In the embodiment, the adjacent three camera groups respectively collect image information of the space area A, the space area B, and the space area C. The spatial area acquired between adjacent camera sets should have overlapping portions to ensure the integrity of the acquired spatial image information.

A plurality of cameras in the same camera group are closely arranged, and each camera can acquire complete image information of a spatial region under the same viewing angle. FIG. 4 is a schematic diagram showing an image of a corresponding spatial region of a camera group according to an embodiment of the present invention. As shown in FIG. 5, the same camera group of the present invention collects images of different spatial depth images at the same viewing angle. The plurality of cameras in the same camera group simultaneously collect image information of different spatial depths. In this embodiment, the plurality of cameras in the same camera group collect image information of different spatial depths by using the same focal lengths with different focal lengths. In some embodiments, multiple cameras in the same camera group can acquire image information of different spatial depths with the same focal length of different image distances.

In this embodiment, the spatial region A at the same viewing angle corresponding to the mth camera group is taken as an example, and the image information in the spatial region A corresponding to the captured image group in the camera group includes the first image (puppy) 201 and the second image 202. (tree) and third image (sun) 203, the first image (puppies) 201 is closest to the camera wall, the second image (trees) is 202, and the third image (sun) 203 is the closest to the camera wall. far. The plurality of cameras of the mth camera group array respectively collect image information of different spatial depths. According to the light field collection method disclosed by the present invention, multiple cameras of the same camera group have different focal lengths, and image information with different spatial depths is always Focus imaging in a camera.

The following is an exemplary description. The first camera in the mth camera group focuses the first image (puppy) 201, and the first image (puppy) 201 is clearly imaged in the image information captured by the first camera. The second image 202 (tree) and the third image (sun) 203 are blurred. Similarly, in the image information captured by the second camera, the second image (tree) 202 is clearly imaged, and the first image 201 (puppy) and the third image (sun) 203 are blurred; the nth camera captures In the image information, the third image (sun) 203 is clearly imaged, and the first image 201 (puppy) and the second image (tree) 202 are blurredly imaged. It should be understood that each image in the embodiment also has different spatial depths, and different spatial depths of the same image respectively acquire image information of different spatial depths by a plurality of cameras. For example, for the first image (Puppy) 201, relative to the camera wall, the puppy's eyes are closer to the camera wall, the puppy's tail is farther from the camera wall, and the spatial depth image of the first image (puppy) 201 is separately captured by cameras with different focal lengths. information. Through the acquisition of multiple cameras, the image information of the spatial depth of the complete spatial space is collected.

S102: Image information denoising processing, and each camera of the camera wall sends the collected image information to the image processing computer. Since each camera only focuses on image information having a certain depth of space, the image information collected by each camera has only a single focus point, and the other unfocused portions are denoised, and the collected information is removed by denoising processing. The portion of the image information that is not in focus. The method of denoising is denoised according to the prior art as would occur to those skilled in the art, and the denoising process is preferably performed by a method of map.

S103: Image information verification, and performing image information verification on the image information collected by each camera after the denoising process, thereby ensuring that the image information collected by each camera has only one focus point.

S104, spatial image information collection, image information collected by multiple cameras in the same camera group is combined with A region image information having a full spatial depth in the same viewing angle, and multiple camera groups in the camera wall will collect space under different viewing angles Image information of the area, complete spatial image information, and complete light field acquisition.

The invention provides a light field collecting method and a collecting device, which acquires image information of different spatial depths through cameras with different focal lengths, collects image information from a real environment, and synthesizes a collection of multiple depth image information, which can complete the collection and Record the entire light field to facilitate the rapid and complete restoration of the light field.

Other embodiments of the invention will be apparent to those skilled in the <RTIgt; The description and the examples are to be considered as illustrative only, and the true scope and spirit of the invention are defined by the claims.

Claims

A method for collecting light field, characterized in that the method comprises:

a) a plurality of light field camera arrays into a camera group, a plurality of the camera groups being arrayed into a camera wall, and a plurality of cameras in the same camera group having different focal lengths;

b) a plurality of the camera groups of the camera wall collect spatial image information at different viewing angles, and the plurality of the cameras in the same camera group collect image information of different spatial depths in the same viewing angle;

c) The camera sends the collected image information to the image processing computer, and the image processing computer performs denoising processing and image information verification on the collected image information to obtain complete spatial image information.
The acquisition device according to claim 1, wherein the plurality of cameras in the same camera group are in a tight array, and each camera can acquire complete image information of a spatial region at the same viewing angle.
The method according to claim 1, wherein the plurality of cameras in the same camera group simultaneously acquire image information of different spatial depths.
The method according to claim 3, wherein the plurality of cameras in the same camera group collect image information of different spatial depths with the same focal length and different image distances.
The method according to claim 3, wherein the plurality of cameras in the same camera group acquire image information of different spatial depths by using the same image from different focal lengths.
The method of claim 1 wherein said camera wall is arrayed by a plurality of said camera groups on a planar or spherical base.
The method according to claim 1, wherein the unfocused portion of the acquired image information is removed by a denoising process.
The method according to claim 1 or 7, wherein the denoising and dividing process removes an unfocused portion of the acquired image information by a method of mapping.
A light field collecting device, characterized in that the device comprises a plane or spherical base, a camera wall mounted on the plane or spherical base, and an image processing computer;

The camera wall includes a plurality of camera groups of an array, the camera group including an array a plurality of cameras, the plurality of cameras in the same camera group having different focal lengths;

The plurality of the camera groups of the camera wall are configured to collect spatial image information at different viewing angles; and the plurality of the cameras in the same camera group are used to collect image information of different spatial depths in the same viewing angle;

The image processing computer is configured to perform denoising processing and image information verification on the collected image information.
The acquisition device according to claim 9, wherein the plurality of cameras in the same camera group are in a tight array, and each camera can acquire complete image information of a spatial region at the same viewing angle.