JPH0876672A - Method for automatically recognizing three-dimensional object and device therefor - Google Patents

Abstract

PURPOSE: To make it possible to recognize a three-dimensional object by using a hologram by bringing the reproduced image of the Fourier transform hologram of the matrix parallax image of a standard object and the Fourier transform hologram of the parallax image obtd. by picking up the image of an object to be examined into interference with each other and checking the correlativeness of these images. CONSTITUTION: The reproduced image of the Fourier transform hologram 1 recording the matrix parallax image of the three-dimensional standard object 1 and the image formed by subjecting the parallel image obtd. by picking up the image of the object 10 to be examined to Fourier transform image processing are brought into interference with each other and the correlativeness of these images is checked. A correlative peak appears and the resemblance of the three-dimensional object 10 to be examined with the standard object 1 is automatically recognized if the resemblance of these images is high. The position of the peak of the correlation corresponds to the respective regions of the M×N matrix parallax images and, therefore, the parallax angle of the object 10 to be examined picked up by a CCD camera 11 is known.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional object automatic recognition method and apparatus for automatically recognizing the similarity of a three-dimensional object such as a human face to a standard object by using a hologram.

[0002]

2. Description of the Related Art Generally, a hologram is used for reproducing a recorded three-dimensional object image by illuminating it with illumination light and observing the reproduced image.

On the other hand, in order to prevent an outsider from entering a building or the like, a security card is held by each person involved in the building. The security card contains information about the person concerned and a face photo. In addition, some security cards have holograms attached.

[0004]

However, although holograms are used in such security cards, the holograms are often used merely to indicate that they are concerned with the building.

Therefore, if this hologram can be used not only to show the persons involved in the building but also to recognize the persons concerned, there is a demand for higher security.

Therefore, an object of the present invention is to provide a three-dimensional object automatic recognition method and apparatus capable of recognizing a three-dimensional object using a hologram.

[0007]

According to a first aspect of the present invention, a reconstructed image of a Frierian-converted hologram in which a freeer-converted image of matrix parallax images arranged in the vertical and horizontal directions of a standard object is recorded, and an object to be inspected are imaged. This is a three-dimensional object automatic recognition method in which the parallax image obtained by the above is made to interfere with the image subjected to the free image conversion image processing and the correlation between these images is checked to achieve the above object.

According to the second aspect, the first step of photographing on the film the matrix parallax images arranged in the vertical and horizontal directions obtained by photographing the standard object, and the matrix parallax image recorded on the film are free-read. A second step of creating a freeer conversion hologram by recording on a photosensitive material through a conversion lens.

According to the third aspect, the matrix parallax image records the image of the standard object on the film through the fly-eye lens.

According to the fourth aspect, the matrix parallax image records images of a plurality of standard objects on a film for each area.

According to the fifth aspect of the present invention, the free-angle conversion hologram recording the free-angle conversion image of the matrix parallax images arranged in the vertical and horizontal directions of the standard object and the parallax image obtained by imaging the object to be inspected are converted to the free-angle conversion image. An object display means for processing and displaying on a high-resolution spatial light modulator, a free-angle conversion optical system for converting a conjugate image of a reproduced image of a free-angle conversion hologram to form an image on the high-resolution spatial light modulator, and a free-angle converter. Detect the correlation peak caused by the interference between the conjugate image of the free image converted hologram obtained by the conversion optical system and the free image converted on the high resolution spatial light modulator to detect the similarity of the object under test to the standard object. A three-dimensional object automatic recognition apparatus, which comprises a determination means for determining, and which is intended to achieve the above object.

According to the sixth aspect, the Freie conversion hologram records a plurality of standard objects for each area.

According to a seventh aspect of the present invention, the inspection object display means changes the angle with respect to the inspection object and picks up a matrix parallax image with respect to the standard object, and a matrix obtained by the imaging device. It has at least a free conversion processing means for converting the parallax image into a free conversion pattern, and a high resolution liquid crystal panel for displaying the free conversion image obtained by this free conversion processing means.

[0014]

According to the first aspect of the present invention, a reconstructed image of a Freezer-converted hologram in which a Freezer-converted image of matrix parallax images arranged in the vertical and horizontal directions of a standard object is recorded, and a parallax image obtained by capturing an object to be inspected. By interfering with the image subjected to the Frayer-transformed image processing and checking the correlation between these images, if the similarity between these images is high, a correlation peak appears and it is determined that the object to be inspected is similar to the standard object.

According to the second aspect of the present invention, the free-form conversion hologram for recording a standard object captures on a film the matrix parallax images arranged in the vertical and horizontal directions obtained by capturing the standard object, and then records on this film. It is created by recording the formed matrix parallax image on a light-sensitive material through a Freie conversion lens.

According to the third aspect, the matrix parallax image is recorded on the film through the Haenomelens image of the standard object.

According to the fourth aspect, the matrix parallax image records images of a plurality of standard objects on a film for each area.

According to a fifth aspect of the present invention, a reproduced image of a Frayer-converted hologram recorded with a Fliere-converted image of a matrix parallax image of a standard object is converted into a conjugate image, which is imaged on a high-resolution spatial light modulator. This high resolution spatial light modulator displays the parallax image obtained by picking up the object to be processed with the free image conversion image, and displays it on the high resolution spatial light modulator and the conjugate image of the free image converted hologram reproduction image at this time. Correlation peaks caused by interference with the Frieder's transformed image are detected, and the similarity of the object to be inspected to the standard object is determined.

In this case, according to the sixth aspect, the reproduced images of the plurality of standard objects stored in the Freie conversion hologram are formed on the high resolution spatial light modulator.

According to the seventh aspect, the matrix parallax image is captured by the imaging device while changing the angle with respect to the object to be inspected, and the matrix parallax image is converted into at least a free-eye conversion pattern and displayed on the high resolution liquid crystal panel. Then, interference with the conjugate image of the free image converted hologram is obtained.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram of an automatic three-dimensional object recognition apparatus.

Relay-type free-eye conversion hologram 1
Is a free-form conversion image of matrix parallax images arranged in the vertical and horizontal directions of a three-dimensional standard object.

This Freeie conversion hologram 1 is produced by the first step of photographing the matrix parallax image of the three-dimensional standard object 2 shown in FIGS. 2 and 3 on the film 3 and the matrix recorded on the film 3. The second step of free-converting the parallax image and recording it on the photosensitive material 4.

That is, in the first step, as shown in FIG. 2, the film 3 is arranged at a distance R from the standard object 2, and the fly-eye lens 5 is placed in front of the film 3.
To place.

The fly-eye lens 5 is constructed by arranging M single lenses in the vertical direction and N single lenses in the horizontal direction.

When the standard object 2 is irradiated with white light in this state, an image of the standard object 2 is formed on the film 3 for each single lens of the fly-eye lens 5. Since each image formed by these single lenses becomes each parallax image of the standard object 2 viewed from each angle, M × N matrix parallax images arranged in the vertical and horizontal directions are reduced and recorded on the film 3. To be done.

The second step is M ×, as shown in FIG.
The FRIE conversion lens 6 is arranged on the film 3 on which the N matrix parallax images are reduced and recorded, and the photosensitive material 4 is arranged at the focal position of the FRIE conversion lens 6. The free-eye conversion lens 6 has a focal length f.

In this state, when the film 3 is irradiated with a laser beam of parallel illumination light, the matrix parallax image g of the film 3 is optically converted into a free-angle pattern by the free-angle conversion lens 6, and a free-angle converted wavefront is obtained. It is incident on the photosensitive material 4.

In this state, when the reference light is incident on the photosensitive material 4 from a direction oblique to the incident direction of the Freie converted wavefront, interference occurs between the Freeee converted wavefront and the reference light, and this interference fringe is exposed. Recorded in Material 4.

At this time, if the matrix parallax image g of the film 3 is used, the recording wavefront G, which is a free Fourier transform hologram, is recorded on the photosensitive material 4.

By recording the recording wavefront G on the photosensitive material 4 as described above, the free Fourier transform hologram 1 is created.

On the other hand, a CCD camera 11 is provided with its imaging field of view facing the object 10 to be inspected and at a distance R from the object 10 to be inspected.

The CCD camera 11 outputs the image signal of the parallax image from the desired angle direction by changing the photographing angle of the object 10 to be inspected.

The image processing device 12 has a function of inputting the parallax image signal output from the CCD camera 11 and subjecting the parallax image signal to image processing such as contour and feature extraction.

The free image conversion processing device 13 converts the parallax image signal image-processed by the image processing device 12 into a high speed free image conversion pattern, and the free image converted image is a high resolution liquid crystal panel as a high resolution spatial light modulator. 1
4 has the function of displaying.

That is, the Frier conversion processing device 13 is
It has a function similar to that of performing the Friede conversion operation by the film 3 and the Friede conversion lens 6 in the second step shown in FIG.

The Frayer conversion hologram 1 and the high resolution liquid crystal panel 14 are arranged on the same optical axis a.

A free-angle conversion optical system 20 is provided between the free-angle conversion hologram 1 and the high-resolution liquid crystal panel 14.
Is arranged.

The FRIE conversion optical system 20 has a function of converting the reproduced image G of the FRIE conversion hologram 1 into a conjugate image G ^* and forming an image on the high resolution liquid crystal panel 14.

More specifically, the Frier conversion optical system 20 is arranged on the optical axis a at a position where the Ferie conversion lenses L1 and L2 are in a conjugate relationship, that is, apart from the focal lengths f of the FRIE conversion lenses L1 and L2. ing.

Hereinafter, for example, A ^* indicates a conjugate image of an image, A ^* B indicates a correlation operation between the A image and the B image, and lowercase letters g and h indicate the original image, and their uppercase letters G, H indicates the Flier conversion of the images g and h.

On the side of the high resolution liquid crystal panel 14 opposite to the side on which the Freie conversion optical system 20 is arranged, a Freie conversion lens L3 is arranged.

The FRIE conversion lens L3 performs correlation calculation h ☆ g, h ☆ g ^* by the interference between the conjugate image G ^* of the FRIE conversion hologram reproduction image G and the FRIE conversion image H displayed on the high resolution liquid crystal panel 14. I will get it.

At the focal position of the free-eye conversion lens L3, detectors 21 and 22 for detecting the correlation calculations h * g and h * g ^* and converting and outputting them into an electric signal corresponding to the light quantity thereof are arranged. .

When the judgment section 23 receives the electric signals from the detectors 21 and 22 and detects that the correlation peaks due to the correlation calculations h ☆ g and h ☆ g ^* appear, the standard object 1 is detected. It has a function of determining that the similarity of the inspection object 10 is high and determining that the inspection object 10 is not similar and not identical to the standard object 1 if there is no correlation peak.

Next, the operation of the apparatus configured as described above will be described.

First of all, the Freie conversion hologram 1 in which the standard object 1 is recorded is prepared in advance.

That is, in the first step, as shown in FIG.
As shown in, the film 3 is arranged at a distance R from the standard object 2, and the fly-eye lens 5 is arranged in front of the film 3.

When the standard object 2 is irradiated with white light in this state, the image of the standard object 2 becomes an M × N matrix parallax image for each single lens of the fly-eye lens 5 and is imaged on the film 3 for reduction recording. To be done.

In the second step, as shown in FIG. 3, the FRIEE conversion lens 6 is arranged on the film 3 on which the matrix parallax image is recorded, and the photosensitive material 4 is arranged at the focal position of the FRIEE conversion lens 6. The film 3 is irradiated with a laser beam of parallel illumination light.

By the irradiation of the laser beam, the matrix parallax image g of the film 3 is converted into a free-angle pattern by the free-angle conversion lens 6 and is incident on the photosensitive material 4 as a free-angle conversion wavefront, and in this state, the reference light is used as the photosensitive material. When the light enters the No. 4, the free wave conversion wavefront and the reference light interfere with each other, and the recording wavefront G is recorded on the photosensitive material 4.

The Freeie conversion hologram 1 is created as described above.

Next, the object 10 to be inspected is automatically recognized.

The Freee conversion hologram 1 is arranged in front of the Freee conversion lens L1 as shown in FIG.

On the other hand, the CCD camera 11 takes an image of the object 10 to be inspected from a desired angle direction and outputs a parallax image signal thereof. This parallax image signal is sent to the image processing device 12.

The image processing apparatus 12 is a CCD camera 1
The parallax image signal from No. 1 is input, the parallax image signal is subjected to image processing such as contour and feature extraction, and the parallax image signal is sent to the FRIE conversion processing device 13.

The free image conversion processing device 13 converts the parallax image signal image-processed by the image processing device 12 into a high speed free image conversion pattern, and displays the free image converted image H on the high resolution liquid crystal panel 14.

In this state, when the laser illumination light which is conjugate with the reference light used when the FRIE conversion hologram 1 is created is incident on the FRIE conversion hologram 1 from an oblique direction, the standard plane is formed on the focal plane of the FRIE conversion lens L1. Object 1
An image g ^* that is conjugate with the parallax image g appears.

This conjugate image g ^* is an image which has the same brightness and darkness as the parallax image g but whose phase is inverted.

Further, the conjugate image g ^* is subjected to Freie conversion by the following Freie conversion lens L2, and the focal plane thereof is a conjugate in which the phase is inverted with respect to the recording wavefront G recorded in the Freie conversion hologram 1. Wavefront G ^* appears.

Therefore, the high resolution liquid crystal panel 14 displays the image H which has been subjected to the Frayer conversion, and is conjugated to the recording wavefront G recorded in the Fleaer conversion hologram 1 on the same plane as the surface of the high resolution liquid crystal panel 14. Wavefront G ^* appears.

The image H displayed on the high-resolution liquid crystal panel 14 and the wavefront G ^* conjugate to the recording wavefront G of the Freie conversion hologram 1 interfere with each other to perform the correlation calculation.

Correlation calculation H ☆ between the image H and the wavefront G ^*
The result of G ^* is subjected to Freee conversion by the Freee conversion lens L3 and appears as h ^* g and h * g ^* .

Here, if the image H displayed on the high resolution liquid crystal panel 14 is similar to any of the parallax images M × N of the standard object 1, the correlation calculation h ☆ g,
A correlation peak appears at h * g ^* .

The position of this correlation peak is M × N
Corresponding to each area of the matrix parallax image.

However, the detectors 21 and 22 detect the light amounts of the correlation calculations h * g and h * g ^* , and output an electric signal corresponding to the light amounts.

When the judging section 23 receives the electric signals from the detectors 21 and 22 and detects that the correlation peaks due to the correlation calculations h ☆ g and h ☆ g ^* appear, the standard object 1
On the other hand, it is determined that the similarity of the test object 10 is high, and if there is no correlation peak, the test object 10 is not similar to the standard object 1 and is not the same.

As described above, in the above-described embodiment, the reconstructed image of the Frierian-converted hologram 1 in which the Freee-converted image of the matrix parallax image of the three-dimensional standard object 1 is recorded, and the parallax obtained by capturing the object 10 to be inspected. Since the images are made to interfere with the images subjected to the Ferrier-transformed image processing to check the correlation between these images, if the similarity between these images is high, a correlation peak appears and the three-dimensional test object 10 becomes the standard object 1.
Can automatically recognize that it is similar to.

In this case, since the position of the correlation peak corresponds to each area of the M × N matrix parallax image, the CCD camera 1
The parallax angle of the object to be inspected 10 taken from 1 can be known.

Even if the object 10 to be inspected is photographed in a wide angle range, it does not hinder the determination of the similarity between the object 10 to be inspected and the standard object 1, and the object 10 to be inspected by the CCD camera 11 is photographed. The tolerance of the angle range can be increased.

Further, the FRIEE conversion hologram 1 is created by photographing the standard object 1 as a matrix parallax image on the film 3 through the fly-eye lens 5 and performing FRIE conversion of the matrix parallax image of the film 3 to record it on the photosensitive material 4. Thus, it is possible to easily and easily create the Flier conversion hologram 1 for recording the standard object 1 with a simple optical system.

Next, a security system using the Frier conversion hologram 1 will be described.

A security card applied to this security system is constructed by adhering the above-mentioned Freie conversion hologram 1 to a hologram support 30 as shown in FIG.

Note that, for example, a human face is recorded as a standard object on the FRIE conversion hologram 1.

The hologram support 30 is formed of a substrate made of a hard material having good flatness.

In the security check using such a security card, the Freie conversion hologram 1 of the security card is arranged on the optical axis a shown in FIG.

On the other hand, the CCD camera 11 picks up an image of a human face holding a security card and outputs the image signal.

Therefore, similar to the first embodiment, the high resolution liquid crystal panel 14 displays the image F of the human face which has been subjected to the free image conversion, and the high resolution liquid crystal panel 14 is displayed.
On the same surface as the surface, a wavefront G ^{*, which} is conjugate with the recording wavefront G of the human face recorded in the Freie conversion hologram 1, appears.

The image H of the human face displayed on the high-resolution liquid crystal panel 14 is a wavefront G ^* which is conjugate to the recorded wavefront G of the human face recorded in the Freie conversion hologram 1 ^.
, The correlation peaks appear in the correlation calculations h ☆ g and h ☆ g ^* .

However, the detectors 21 and 22 detect the light amounts of these correlation calculations h * g and h * g ^* , and output an electric signal corresponding to the light amounts.

When the judging section 23 receives the electric signals from the detectors 21 and 22 and detects the appearance of the correlation peak due to the correlation calculations h * g and h * g ^* , the judgment section 23 records the pre-recorded human signals. It is determined that the face and the human face photographed by the CCD camera 11 have a high similarity and are recognized as the same person.

However, if there is no correlation peak, it is determined that the person's face recorded in advance and the person's face photographed by the CCD camera 11 are different and they are not the same person.

By applying the FRIE conversion hologram 1 to the security card as described above, it is possible to prevent an outsider from entering the building.

If different human faces are recorded in each area of M × N on the Freie conversion hologram 1,
It is possible to secure the security of a plurality of people by using one FRIE conversion hologram 1.

The present invention is not limited to the above-mentioned embodiment, but may be modified as follows.

For example, the CCD camera 11 may change the angle with respect to the object to be inspected 10 to capture a matrix parallax image, and the matrix parallax image may be converted into a free matrix conversion pattern and displayed on the high resolution liquid crystal panel. .

As a result, the object 10 to be inspected can be photographed from a plurality of parallaxes to determine the similarity to the standard object.

[0089]

As described above in detail, according to the present invention, it is possible to provide a three-dimensional object automatic recognition method and apparatus capable of recognizing a three-dimensional object using a hologram.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an embodiment of a three-dimensional object automatic recognition device according to the present invention.

FIG. 2 is a diagram showing a first step of a method of creating a Flier conversion hologram.

FIG. 3 is a diagram showing a second step of the method for creating a Flea conversion hologram.

FIG. 4 is a diagram showing a security card applied to a security system.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Freee conversion hologram, 2 ... Standard object, 3 ... Film, 4 ... Photosensitive material, 5 ... Haenome lens, 6 ... Freee conversion lens, 10 ... Inspected object, 11 ... CCD camera,
12 ... Image processing device, 13 ... FRIE conversion processing device, 1
4 ... High-resolution liquid crystal panel, 20 ... Freezer conversion optical system,
L1, L2, L3 ... FRIE conversion lenses, 21, 22 ...
Detector, 23 ... Judgment unit.

Claims (7)

[Claims] A reconstructed image of a Frayer-converted hologram in which matrix-parallax images of a standard object arranged in the vertical and horizontal directions are recorded, and a parallax image obtained by picking up an object to be inspected is subjected to Ferrier-converted image processing. Interfere with the image,
A three-dimensional object automatic recognition method characterized by checking the correlation between these images. 2. A first method for photographing on a film a matrix parallax image which is obtained by photographing a standard object and which is arranged in vertical and horizontal directions.
3. The third order according to claim 1, further comprising the step of: and a second step of creating a Friede's conversion hologram by recording the matrix parallax image recorded on the film on a photosensitive material through a Friede's conversion lens. Original object automatic recognition method. 3. The three-dimensional object automatic recognition method according to claim 1, wherein the matrix parallax image is an image of a standard object recorded on a film through a fly-eye lens. 4. The three-dimensional object automatic recognition method according to claim 1, wherein the matrix parallax image records images of a plurality of standard objects on a film for each area. 5. A Ferrier-converted hologram in which Ferrier-converted images of matrix parallax images arranged in the vertical and horizontal directions of a standard object are recorded, and a parallax image obtained by picking up an object to be inspected is subjected to Ferrier-converted image processing to obtain high resolution. An object display means for displaying on a spatial light modulator, a free-eye conversion optical system for converting the reproduction image of the free-air conversion hologram into a conjugate image and forming an image on the high-resolution spatial light modulator, and the free-air conversion optical system. Similarity of the object to be detected to the standard object by detecting a correlation peak generated by the interference between the conjugate image of the reproduction image of the Frierian-converted hologram obtained by the system and the Frierian-converted image displayed on the high-resolution spatial light modulator. A three-dimensional object automatic recognition apparatus comprising: a determination unit that determines a sex. 6. The three-dimensional object automatic recognition device according to claim 5, wherein the free-eye conversion hologram records a plurality of standard objects for each area. 7. The object display means includes at least an image sensor that captures a matrix parallax image of the standard object by changing an angle with respect to the object, and a matrix parallax image obtained by imaging the image sensor. 6. The automatic three-dimensional object recognition according to claim 5, further comprising: a free conversion processing means for converting into a free conversion pattern and a high resolution liquid crystal panel for displaying a free conversion image obtained by the free conversion processing means. apparatus.