[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

EP1537456A2 - Direct-to-digital off-axis holography with off-axis illuminated object - Google Patents

Direct-to-digital off-axis holography with off-axis illuminated object

Info

Publication number
EP1537456A2
EP1537456A2 EP03749369A EP03749369A EP1537456A2 EP 1537456 A2 EP1537456 A2 EP 1537456A2 EP 03749369 A EP03749369 A EP 03749369A EP 03749369 A EP03749369 A EP 03749369A EP 1537456 A2 EP1537456 A2 EP 1537456A2
Authority
EP
European Patent Office
Prior art keywords
spatially heterodyne
hologram
axis
axis illuminated
fourier
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03749369A
Other languages
German (de)
French (fr)
Inventor
Clarence E. Thomas
Jeffrey R. Price
Edgar Voelkl
Gregory R. Hanson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
UT Battelle LLC
Original Assignee
UT Battelle LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US10/234,042 external-priority patent/US6963406B2/en
Priority claimed from US10/234,043 external-priority patent/US7038787B2/en
Priority claimed from US10/234,044 external-priority patent/US6747771B2/en
Application filed by UT Battelle LLC filed Critical UT Battelle LLC
Publication of EP1537456A2 publication Critical patent/EP1537456A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0866Digital holographic imaging, i.e. synthesizing holobjects from holograms
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/021Interferometers using holographic techniques
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0891Processes or apparatus adapted to convert digital holographic data into a hologram
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/16Processes or apparatus for producing holograms using Fourier transform
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22Processes or apparatus for obtaining an optical image from holograms
    • G03H1/24Processes or apparatus for obtaining an optical image from holograms using white light, e.g. rainbow holograms
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/0443Digital holography, i.e. recording holograms with digital recording means
    • G03H2001/0454Arrangement for recovering hologram complex amplitude
    • G03H2001/0456Spatial heterodyne, i.e. filtering a Fourier transform of the off-axis record
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2260/00Recording materials or recording processes
    • G03H2260/50Reactivity or recording processes
    • G03H2260/54Photorefractive reactivity wherein light induces photo-generation, redistribution and trapping of charges then a modification of refractive index, e.g. photorefractive polymer

Definitions

  • the invention relates generally to the field of direct-to-digital holography (interferometry). More particularly, the invention relates to off-axis illumination for improved resolution in direct-to-digital holography.
  • FIG. 1 illustrates one simplified embodiment of a DDH system.
  • Light from a laser source 105 is expanded by a beam expander/spatial filter 110 and then travels through a lens 115. Subsequently, the expanded filtered light travels to a beamsplitter 120.
  • the beamsplitter 120 may be partially reflective.
  • the portion of light reflected from the beamsplitter 120 constitutes an object beam 125 which travels to the object 130.
  • the portion of the object beam 125 is that is reflected by the object 130 then passes through the beamsplitter 120 and travels to a focusing lens 145. This light then passes through the focusing lens 145 and travels to a charge coupled device (CCD) camera (not shown).
  • CCD charge coupled device
  • the portion of the light from the lens 115 that passes through the beamsplitter 120 constitutes a reference beam 135.
  • the reference beam 135 is reflected from a mirror 140 at a small angle.
  • the reflected reference beam 135 from the mirror then travels toward the beamsplitter 120.
  • the portion of the reference beam 135 that is reflected from the beamsplitter 120 then travels through the focusing lens 145 and toward the CCD camera (not shown).
  • the object beam 125 from the focusing lens 145 and the reference beam 135 from the focusing lens 145 constitute a plurality of object and reference waves 150 and will interfere at the CCD to produce the interference pattern characteristic of a hologram as noted in U.S. Pat. No. 6,078,392.
  • the object beam 125 is parallel to, and coincident with, the optical axis 127.
  • This type of DDH set-up can be referred to as on-axis illumination.
  • a limitation of this technology has been that the imaging resolution of the DDH system is limited by the optics of the system.
  • the most notable limitation of the optics is the aperture stop, which is required to prevent degradation of the image quality due to aberrations.
  • a process of recording an off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis comprises, reflecting a reference beam from a reference mirror at a non-normal angle; reflecting an object beam from an object at an angle with respect to an optical axis defined by a focusing lens; focusing the reference beam and the object beam at a focal plane of a digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; Fourier analyzing the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top
  • a machine operable to digitally record an off- axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis comprises: a laser; a beamsplitter optically coupled to the laser; a reference beam mirror optically coupled to the beamsplitter; a focusing lens optically coupled to the reference beam mirror; a digital recorder optically coupled to the focusing lens; and a computer that performs a Fourier transform, applies a digital filter, and performs an inverse Fourier transform, wherein a reference beam is incident upon the reference beam mirror at a non-normal angle, an object beam is incident upon an object at an angle with respect to an optical axis defined by the focusing lens, the reference beam and the object beam are focused by the focusing lens at a focal plane of the digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis which is recorded by the digital recorder
  • FIG. 1 illustrates a schematic view of a conventional direct-to-digital holography apparatus, appropriately labeled "PRIOR ART.”
  • FIG. 2 illustrates a schematic view of an off-axis illumination direct-to-digital holography apparatus (interferometer) in an on-axis position, representing an embodiment of the invention.
  • FIG. 3 illustrates a schematic view of the off-axis illumination direct-to-digital holography apparatus (interferometer) of FIG. 2 in an off-axis position.
  • FIG. 4 illustrates a two-dimensional Fourier plane for an object showing one instance of on- axis illumination and one instance of off-axis illumination, representing an embodiment of the invention.
  • FIG. 5 illustrates a two-dimensional Fourier plane for an object showing one instance of on- axis illumination and four instances of off-axis illumination, representing an embodiment of the invention.
  • FIG. 6 illustrates a two-dimensional Fourier plane for an object showing all spatial frequencies that contribute to a fused spectrum (merged image), representing an embodiment of the invention.
  • FIGS. 7A-7F illustrate the discrete Fourier spectra (7A-7E) obtained from five different holograms and a fused spectrum (7F), representing embodiments of the invention.
  • FIG. 8 illustrates an object amplitude reconstructed from the on-axis illuminated hologram, representing an embodiment of the invention.
  • FIG. 9 illustrates an object amplitude reconstructed from a fused result, representing an embodiment of the invention.
  • FIG. 10 illustrates the intersection of the two apertures W 0 (q) and W k (q) t representing an embodiment of the invention. DESCRIPTION OF PREFERRED EMBODIMENTS
  • the context of the invention can include obtaining, storing and/or replaying digital data.
  • the context of the invention can include processing digital data that represents an image.
  • the context of the invention can also include transforming data from multiple images into a merged image.
  • the invention can include a method of acquiring improved resolution holographic imagery from a direct-to-digital holography system using off-axis illumination.
  • the invention can also include an apparatus for acquiring improved resolution holographic imagery with a direct-to- digital holography (DDH) system that uses off-axis illumination.
  • DDH direct-to- digital holography
  • the object to be observed is optically coupled to an illumination source via one or more optical components.
  • the illumination beam is typically passed through the center of the target objective (i.e., lens system) along, and thus parallel to, the optical axis.
  • This type of DDH configuration can be referred to as "on-axis illumination” and allows spatial frequencies (q) of the object to be acquired up to a certain limit (qO), which is determined by the objective aperture.
  • the invention can include an "off-axis illumination” scenario, where the illumination source is displaced laterally so that the beam will pass through the object objective off-center yet still parallel to the optical axis.
  • the illumination will, due to the focusing effect of the objective, be incident upon the object at some angle to the optical axis. Due to this off-axis illumination, higher spatial frequencies (q>q0) of the object can pass through the objective aperture, and thus be observed, than can with on-axis illumination. This is an important advantage of the invention.
  • the invention can include an extended DDH system (apparatus) adapted to digitally capture the on-axis- and one, or more, off-axis-illuminated holograms of the same object.
  • the invention can also include analyzing and/or processing (fusing) the digitally captured data.
  • the resulting, fused image will contain a wider range of spatial frequencies than in any of the original holograms, thus providing a significant increase in the nominal imaging resolution of the system compared to the case where no off-axis-illuminated data is available.
  • the imaging resolution of fundamental DDH systems is limited by the optics, most notably the aperture stop, which is required to prevent degradation of the image quality due to aberrations.
  • the aperture stop is required to prevent aliasing of higher frequencies and subsequent degradation of imaging quality.
  • the optics of the DDH system are such that only object spatial frequencies within a circle of radius qO can be transmitted.
  • the aperture with radius qO appears shifted (e.g., to the left) in the frequency domain. This implies that in the direction in which the aperture is shifted, spatial frequencies with q>q0 are transmitted.
  • the invention can include an extension of the fundamental DDH system to automatically capture both on-axis and off-axis illuminated holograms.
  • the invention can also include methods to analyze and fuse the results of these holograms to produce a representation of the observed object with more spatial resolution than available in the prior DDH art.
  • the object beam 125 is parallel to the optical axis 127.
  • this set-up can be referred to as on-axis illumination.
  • Off-axis illumination refers to the case where the object beam 125 is incident upon the object 130 at some angle with respect to the optical axis 127 (an example is illustrated by the object team 215,305 shown in FIG. 3).
  • FIGS. 2 and 3 an embodiment of an off-axis illumination DDH apparatus is illustrated, hi FIGS. 2 and 3, there are two primary modifications from FIG. 1.
  • a first modification is that the laser source 105, the beam expander/spatial filter 110, and the lens 115 are grouped into a computer-controlled, moveable enclosure 205.
  • the enclosure 205 can be movable along an axis that is substantially parallel to the optical axis 127.
  • the enclosure 205 can be movable along an axis that is substantially coplanar with a normal to the beamsplitter 120.
  • a second modification is the addition of the object objective 210.
  • the laser source enclosure 205 is positioned so that the object beam 125 reflects off of the beamsplitter 120 to pass through the center of the object objective 210.
  • the object beam 125 then leaves the object objective 210 and is incident upon the object 130, centered around the optical axis 127.
  • on-axis illumination is achieved and the system of FIG. 2 is effectively the same as that in FIG. 1.
  • the laser source enclosure 205 is shifted (up in this particular configuration) so that the object beam 125 passes through the object objective 210 off-center.
  • the laser source enclosure 205 can alternatively be shifted down.
  • the object beam 215 leaving the object objective 210 is incident upon the object 130 at some angle with respect to the optical axis 127, thereby achieving off-axis illumination.
  • the object beam 215 can be incident upon the object 130 substantially non-parallel to the optic axis 127.
  • the object beam 305 reflected from the object passes back through the object objective 210 off-axis, but due to the optical properties of the object objective 210 and the focusing lens 150 is still focused on the CCD (not shown).
  • the properties of diffraction imply that the hologram formed at the CCD by the interference of the object beam 305 and the reference beam 135 will contain some spatial frequencies of the object that are not observed using on-axis illumination.
  • the invention can include an apparatus operable to digitally record a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising: a laser; a beamsplitter optically coupled to the laser; a reference beam mirror optically coupled to the beamsplitter; an object optically coupled to the beamsplitter; a focusing lens optically coupled to both the reference beam mirror and the object; a digital recorder optically coupled to the focusing lens; and a computer for performing a Fourier transform, applying a digital filter, and performing an inverse Fourier transform, wherein a reference beam is incident upon the reference beam mirror at a non-normal angle, an object beam is incident upon the object at an angle with respect to an optical axis defined by the focusing lens, the reference beam and an object beam, which constitute a plurality of simultaneous reference and object waves, are focused by the focusing lens at a focal plane of the digital recorder to form a spatially heterodyne hologram including spatially heterody
  • the apparatus can include an object objective optically coupled between the beamsplitter and the object.
  • the apparatus can include an aperture stop coupled between the object and the focusing lens.
  • the beamsplitter, the reference beam mirror and the digital recorder can define a Michelson geometry.
  • the beamsplitter, the reference beam mirror and the digital recorder can define a Mach-Zehner geometry.
  • the apparatus can also include a digital storage medium coupled to the computer for performing a Fourier transform, applying a digital filter, and performing an inverse Fourier transform.
  • the digital recorder can include a CCD camera 350 that defines pixels.
  • the apparatus can include a beam expander/spatial filter 230 optically coupled between the laser and the beamsplitter.
  • the angle between the reference beam and the object beam, and a magnification provided by the focusing lens, can be selected in order that the digital recorder may resolve features of the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis. So that the digital recorder may resolve a feature, two fringes, each having two pixels per fringe, can be provided.
  • the invention can include a spatially heterodyne hologram produced by the above-described apparatus, embodied on a computer- readable medium.
  • the invention can include a method of recording a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising: splitting a laser beam into a reference beam and an object beam; reflecting the reference beam from a reference mirror at a non-normal angle; reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens; focusing the reference beam and the object beam, which constitute a plurality of simultaneous reference and object waves, with the focusing lens at a focal plane of a digital recorder to form a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; Fourier analyzing the recorded spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded spatially heterodyne hologram including spatially heterodyne fringes in Fourier
  • the method can include refracting the object beam with an object objective before reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens and after reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens.
  • the step of transforming axes of the recorded spatially heterodyne hologram can include transforming with an extended Fourier transform.
  • the step of digitally recording can include detecting the beams with a CCD camera that defines pixels.
  • the off-axis illuminated spatially heterodyne hologram can be an off-axis illuminated spatially low-frequency heterodyne hologram; the phrase low-frequency implies that the fundamental fringe spatial frequency is below the Nyquist sampling limit.
  • the method can also include storing the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis as digital data.
  • the method can also include replaying the Fourier analyzed spatially heterodyne hologram.
  • the method can also include transmitting the Fourier analyzed spatially heterodyne hologram.
  • the invention can include a spatially heterodyne hologram prepared by the above-described method(s), embodied on a computer-readable medium.
  • a two-dimensional Fourier plane is depicted for a hypothetical object, where zero frequency 405 is the center.
  • the zero frequency for the object 405 corresponds to the heterodyne or carrier frequency in the hologram.
  • All of the spatial frequencies of the object are represented by the filled circle 410.
  • On-axis illumination will capture only those frequencies indicated by the sold-line circle 415.
  • One instance of off-axis illumination will capture the frequencies indicated by the dash-line circle 420.
  • Other instances of off-axis illumination can capture other regions of the object spectrum 410.
  • a DDH apparatus such as that shown in FIGS. 2 and 3 can be used to capture and store multiple holograms — both on-axis and off-axis illuminated — of the same object area. Realizing that each such hologram contains information about difference spatial frequencies of the object, methods to analyze these holograms and compute a single, reconstructed image will be discussed in detail below.
  • the reconstructed image can contain all of the observed spatial frequencies and thus provide a significantly higher resolution image than any single recorded image.
  • the methods presented hereafter are intended to serve as representative examples and are not intended to preclude extensions, modifications, or other approaches.
  • the solid circle 510 represents spatial frequencies observed with on-axis illumination while the dotted-line circles 515, 520, 525, 530 represent spatial frequencies observed by four different off-axis illuminated holograms.
  • ⁇ k and ⁇ k are the fringe contrast and phase offset, respectively, for hologram k andj is the square root of negative one.
  • the invention can include normalizing and/or compensating for varying fringe contrasts.
  • One such method for fringe contrast normalization can be described as follows. First we note that G k (q) above represents the Fourier transform of one acquired object wave (or image) gk (x) : where the Fourier transform operation.
  • the image g ⁇ 0 ( x ) is constructed by keeping only the frequencies of g k ( x ) common to both g k ( x ) and the reference image g 0 ( ⁇ *) • Similarly, the image g 0 , k ( ) comprises only the frequencies of g 0 ( x ) common to both go( x ) and gk ( x ) . These common frequencies can be visualized as the intersection of the two apertures W 0 (q) and W k (q) as illustrated in Fig. 10. Once g A;0 ( ) and g 0 , ⁇ W have been constructed, a ratio image ⁇ k ( ⁇ ) is computed as
  • the relative fringe contrast, M k l Mo can be estimated as the sample mean (average) of the magnitude of the ratio image Zk ( ⁇ ) ' ⁇
  • the invention can include normalizing and/or compensating for the phase offsets.
  • One method for phase offset normalization is to compute the same ratio image described above for fringe contrast normalization. Then the relative phase offset, exp /( ⁇ ⁇ - ro)), can computed as the (weighted) sample mean of the phase of the ratio image X k ( x ) ' ⁇
  • weighting factor is fixed equal to one.
  • the weighting factor may be related to the magnitudes of the individual images used to compute the ratio image. This may be used because phase data is often inaccurate when the magnitude is very small.
  • One such embodiment for computing the weighting factor is
  • phase offset estimation is described as follows. Often phase offset is due to errors in locating the carrier frequency. Under such a condition, the phase offset of the ratio image takes the form
  • the real and imaginary parts can be considered separate elements of a two-dimensional vector Re ⁇ Z ⁇ k (x)Y + ⁇ k Im yt O L + y k )
  • Wk(q) is essentially a window function that represents the region of the spectrum observed by hologram k.
  • the window functions from FIG. 5 would be equal to one inside and zero outside the respective circles 510, 515, 520, 525, 530.
  • the window function can be modeled using a circularly symmetric Butterworth function:
  • qi and q 2 represent the horizontal and spatial frequency variables of the vector q
  • ci and c represent the center point of the function in the Fourier plane
  • r represent the radius of the function
  • m is the order of the filter.
  • the goal of the fusion method is to form an estimate of F(q) from the observations Gk(q).
  • One approach to estimate F(q) is to employ a linear estimator based upon the minimum mean square error criterion; this is the well-known linear, minimum mean-square error (LMMSE) estimator.
  • LMMSE linear minimum mean-square error estimator
  • c(q) is a positive number that represents a regularization parameter that can be selected dependent upon the specifics of the system.
  • This regularization parameter is used to compensate for system noise.
  • c(q) could be set to zero, in which case the estimate for F(q) reduces to a simple average.
  • F(q) reduces to a simple average.
  • c(q) can be set (either to a constant or to vary with q) based on some computational analysis of the observed holograms and images.
  • Many such approaches for computing the regularization parameter may be devised by those skilled in the art.
  • Simple averaging or LMMSE estimation are perhaps the most straightforward approaches for computing the fused image.
  • a few alternative optimization criteria for computing the fused image might include maximum likelihood (ML) estimation, maximum a posteriori (MAP) estimation, and/or total least squares (TLS) estimation. Note that these examples are not exhaustive.
  • FIG. 7 shows the discrete Fourier spectra obtained from five different holograms.
  • the first image 705 corresponds to on-axis illumination while images 710, 715, 720, and 725 correspond to various off-axis illumination conditions.
  • the fusion method described above was employed to produce the fused spectrum shown in image 730.
  • FIG. 8 shows the object amplitude reconstructed from only the on-axis illuminated hologram.
  • FIG. 9 shows the object amplitude reconstructed from the fused result. It is important to note the grid structure that becomes apparent in FIG. 9 (and which is absent in FIG. 8) due to the increased resolution that results from the fusion.
  • the disclosed embodiments show a computer controlled, moveable enclosure as the structure for performing the function of aligning the source, beam expander/spatial filter and lens so that the object beam passes through the object objective on-center or off-center, but the structure for aligning the source, beam expander/spatial filter and lens can be any other structure capable of performing the function of aligning the object beam so that it passes through the object objective on-center or off-center, including, by way of example 1 a moveable platform for displacing the beamsplitter, the mirror, the object objective, the object, the focusing lens and the CCD camera relative to the source, beam expander/spatial filter and lens, or as another example, a series of movable optical elements (e.g., mirrors), or as another example a flexible optical fiber and/or cable.
  • a moveable platform for displacing the beamsplitter, the mirror, the object objective, the object, the focusing lens and the CCD camera relative to the source, beam expander/spatial filter and lens
  • a or an, as used herein, are defined as one or more than one.
  • the term plurality, as used herein, is defined as two or more than two.
  • the term another, as used herein, is defined as at least a second or more.
  • the terms including and/or having, as used herein, are defined as comprising (i.e., open language).
  • the term coupled, as used herein, is defined as connected, although not necessarily directly, and not necessarily mechanically.
  • the term approximately, as used herein, is defined as at least close to a given value (e.g., preferably within 10% of, more preferably within 1% of, and most preferably within 0.1% of).
  • the term substantially, as used herein, is defined as largely but not necessarily wholly that which is specified.
  • the term generally, as used herein, is defined as at least approaching a given state.
  • the term deploying, as used herein, is defined as designing, building, shipping, installing and/or operating.
  • the term means, as used herein, is defined as hardware, firmware and or software for achieving a result.
  • the term program or phrase computer program, as used herein, is defined as a sequence of instructions designed for execution on a computer system.
  • a program, or computer program may include a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer or computer system.
  • the phrase low- frequency, as used herein, can be defined as implying that the fundamental fringe spatial frequency is below the Nyquist sampling limit. Practical Applications of the Invention
  • the invention is useful in conjunction with microelectronic(mechanical) fabrication, such as for semiconductor inspection.
  • the invention is also useful in conjunction with nanotechnology research, development and manufacturing, such as nanovisualization, nanomeasurement, or the like.
  • the invention is useful in the context of an interferometer using digital processing and/or a digital data acquisition, for example, a direct-to-digital holography tool based on electron holography. There are virtually innumerable uses for the invention, all of which need not be detailed here.
  • a method, apparatus and/or computer program, representing an embodiment of the invention can be cost effective and advantageous for at least the following reasons.
  • the invention can provide computer-control of object illumination.
  • the invention can provide fusion of results from multiple holograms.
  • the invention can provide significantly increased imaging resolution.
  • the invention improves quality and/or reduces costs compared to previous approaches.
  • the individual components need not be combined in the disclosed configurations, but could be combined in virtually all configurations. Further, variation may be made in the steps or in the sequence of steps composing methods described herein. Further, although the apparatus described herein can be a separate module, it will be manifest that the apparatus may be integrated into the system with which it is associated. Furthermore, all the disclosed elements and features of each disclosed embodiment can be combined with, or substituted for, the disclosed elements and features of every other disclosed embodiment except where such elements or features are mutually exclusive.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Holo Graphy (AREA)
  • Liquid Crystal (AREA)
  • Image Input (AREA)

Abstract

Systems and methods are described for off-axis object illuminated direct-to-digital holography. A method of recording an off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, includes: reflecting a reference beam (135) from a reference mirror (140) at a non-normal angle; reflecting an object beam (215) from an object (130) at an off-axis angle with respect to an optical axis defined by a focusing lens (145); focusing the reference beam and the object beam at a focal plane of a digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; Fourier analyzing the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined as an angle between the reference beam and the object beam; applying a digital filter to cut off signals around an original origin; and then performing an inverse Fourier transform.

Description

DESCRIPTION
BACKGROUND OF THE INVENTION
The invention relates generally to the field of direct-to-digital holography (interferometry). More particularly, the invention relates to off-axis illumination for improved resolution in direct-to-digital holography.
DISCUSSION OF RELATED ART
Prior art direct-to-digital holography (DDH), sometimes called direct-to-digital interferometry, is known to those skilled in the art. For instance, FIG. 1 illustrates one simplified embodiment of a DDH system. Light from a laser source 105 is expanded by a beam expander/spatial filter 110 and then travels through a lens 115. Subsequently, the expanded filtered light travels to a beamsplitter 120. The beamsplitter 120 may be partially reflective. The portion of light reflected from the beamsplitter 120 constitutes an object beam 125 which travels to the object 130. The portion of the object beam 125 is that is reflected by the object 130 then passes through the beamsplitter 120 and travels to a focusing lens 145. This light then passes through the focusing lens 145 and travels to a charge coupled device (CCD) camera (not shown).
The portion of the light from the lens 115 that passes through the beamsplitter 120 constitutes a reference beam 135. The reference beam 135 is reflected from a mirror 140 at a small angle. The reflected reference beam 135 from the mirror then travels toward the beamsplitter 120. The portion of the reference beam 135 that is reflected from the beamsplitter 120 then travels through the focusing lens 145 and toward the CCD camera (not shown). The object beam 125 from the focusing lens 145 and the reference beam 135 from the focusing lens 145 constitute a plurality of object and reference waves 150 and will interfere at the CCD to produce the interference pattern characteristic of a hologram as noted in U.S. Pat. No. 6,078,392.
In FIG. 1, the object beam 125 is parallel to, and coincident with, the optical axis 127. This type of DDH set-up can be referred to as on-axis illumination. A limitation of this technology has been that the imaging resolution of the DDH system is limited by the optics of the system. The most notable limitation of the optics is the aperture stop, which is required to prevent degradation of the image quality due to aberrations. With regard to a two-dimensional Fourier plane, only object spatial frequencies within a circle of radius qO can be transmitted, the case of on-axis illumination, the aperture with radius qO appears centered on a zero spatial frequency (q=0). What is needed, therefore, is an approach that permits spatial frequencies outside the circle of radius qO to be transmitted.
SUMMARY OF THE INVENTION There is a need for the following aspects of the invention. Of course, the invention is not limited to these aspects.
According to an aspect of the invention, a process of recording an off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprises, reflecting a reference beam from a reference mirror at a non-normal angle; reflecting an object beam from an object at an angle with respect to an optical axis defined by a focusing lens; focusing the reference beam and the object beam at a focal plane of a digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; Fourier analyzing the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined as an angle between the reference beam and the object beam; applying a digital filter to cut off signals around an original origin; and then performing an inverse Fourier transform.
According to another aspect of the invention, a machine operable to digitally record an off- axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprises: a laser; a beamsplitter optically coupled to the laser; a reference beam mirror optically coupled to the beamsplitter; a focusing lens optically coupled to the reference beam mirror; a digital recorder optically coupled to the focusing lens; and a computer that performs a Fourier transform, applies a digital filter, and performs an inverse Fourier transform, wherein a reference beam is incident upon the reference beam mirror at a non-normal angle, an object beam is incident upon an object at an angle with respect to an optical axis defined by the focusing lens, the reference beam and the object beam are focused by the focusing lens at a focal plane of the digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis which is recorded by the digital recorder, and the computer transforms axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined by an angle between the reference beam and the object beam and cuts off signals around an original origin before performing the inverse Fourier transform.
These, and other, aspects of the invention will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following description, while indicating various embodiments of the invention and numerous specific details thereof, is given by way of illustration and not of limitation. Many substitutions, modifications, additions and/or rearrangements may be made within the scope of the invention without departing from the spirit thereof, and the invention includes all such substitutions, modifications, additions and/or rearrangements.
BRIEF DESCRIPTION OF THE DRAWINGS
The drawings accompanying and forming part of this specification are included to depict certain aspects of the invention. A clearer conception of the invention, and of the components and operation of systems provided with the invention, will become more readily apparent by referring to the exemplary, and therefore nonlimiting, embodiments illustrated in the drawings, wherein identical reference numerals designate the same elements. The invention may be better understood by reference to one or more of these drawings in combination with the description presented herein. It should be noted that the features illustrated in the drawings are not necessarily drawn to scale.
FIG. 1 illustrates a schematic view of a conventional direct-to-digital holography apparatus, appropriately labeled "PRIOR ART." FIG. 2 illustrates a schematic view of an off-axis illumination direct-to-digital holography apparatus (interferometer) in an on-axis position, representing an embodiment of the invention.
FIG. 3 illustrates a schematic view of the off-axis illumination direct-to-digital holography apparatus (interferometer) of FIG. 2 in an off-axis position.
FIG. 4 illustrates a two-dimensional Fourier plane for an object showing one instance of on- axis illumination and one instance of off-axis illumination, representing an embodiment of the invention.
FIG. 5 illustrates a two-dimensional Fourier plane for an object showing one instance of on- axis illumination and four instances of off-axis illumination, representing an embodiment of the invention.
FIG. 6 illustrates a two-dimensional Fourier plane for an object showing all spatial frequencies that contribute to a fused spectrum (merged image), representing an embodiment of the invention.
FIGS. 7A-7F illustrate the discrete Fourier spectra (7A-7E) obtained from five different holograms and a fused spectrum (7F), representing embodiments of the invention.
FIG. 8 illustrates an object amplitude reconstructed from the on-axis illuminated hologram, representing an embodiment of the invention.
FIG. 9 illustrates an object amplitude reconstructed from a fused result, representing an embodiment of the invention.
FIG. 10 illustrates the intersection of the two apertures W0(q) and Wk (q) t representing an embodiment of the invention. DESCRIPTION OF PREFERRED EMBODIMENTS
The invention and the various features and advantageous details thereof are explained more fully with reference to the nonlimiting embodiments that are illustrated in the accompanying drawings and detailed in the following description. Descriptions of well known starting materials, processing techniques, components and equipment are omitted so as not to unnecessarily obscure the invention in detail. It should be understood, however, that the detailed description and the specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only and not by way of limitation. Various substitutions, modifications, additions and/or rearrangements within the spirit and/or scope of the underlying inventive concept will become apparent to those skilled in the art from this disclosure.
Within this application several publications are referenced by Arabic numerals within parentheses. Full citations for these, and other, publications may be found at the end of the specification immediately preceding the claims after the section heading References. The disclosures of all these publications in their entireties are hereby expressly incorporated by reference herein for the purpose of indicating the background of the invention and illustrating the state of the art.
In general, the context of the invention can include obtaining, storing and/or replaying digital data. The context of the invention can include processing digital data that represents an image. The context of the invention can also include transforming data from multiple images into a merged image.
The invention can include a method of acquiring improved resolution holographic imagery from a direct-to-digital holography system using off-axis illumination. The invention can also include an apparatus for acquiring improved resolution holographic imagery with a direct-to- digital holography (DDH) system that uses off-axis illumination.
In general, the object to be observed (imaged) is optically coupled to an illumination source via one or more optical components. As discussed with regard to FIG. 1, the illumination beam is typically passed through the center of the target objective (i.e., lens system) along, and thus parallel to, the optical axis. This type of DDH configuration can be referred to as "on-axis illumination" and allows spatial frequencies (q) of the object to be acquired up to a certain limit (qO), which is determined by the objective aperture.
The invention can include an "off-axis illumination" scenario, where the illumination source is displaced laterally so that the beam will pass through the object objective off-center yet still parallel to the optical axis. The illumination will, due to the focusing effect of the objective, be incident upon the object at some angle to the optical axis. Due to this off-axis illumination, higher spatial frequencies (q>q0) of the object can pass through the objective aperture, and thus be observed, than can with on-axis illumination. This is an important advantage of the invention.
The invention can include an extended DDH system (apparatus) adapted to digitally capture the on-axis- and one, or more, off-axis-illuminated holograms of the same object. The invention can also include analyzing and/or processing (fusing) the digitally captured data. The resulting, fused image will contain a wider range of spatial frequencies than in any of the original holograms, thus providing a significant increase in the nominal imaging resolution of the system compared to the case where no off-axis-illuminated data is available.
As noted above, the imaging resolution of fundamental DDH systems is limited by the optics, most notably the aperture stop, which is required to prevent degradation of the image quality due to aberrations. The aperture stop is required to prevent aliasing of higher frequencies and subsequent degradation of imaging quality. This means the optics of the DDH system are such that only object spatial frequencies within a circle of radius qO can be transmitted. In the case of on-axis illumination, the aperture with radius qO appears centered on a zero spatial frequency (q=0). In the case of off-axis illumination, the aperture with radius qO appears shifted (e.g., to the left) in the frequency domain. This implies that in the direction in which the aperture is shifted, spatial frequencies with q>q0 are transmitted. On the downside, some spatial frequencies with q close to qO are "lost" in the opposite direction. By acquiring a second image with the illumination shifted in the opposite direction, the aperture appears shifted (e.g., to the right) and thus the spatial frequencies "lost" from the first image are regained with additional frequencies beyond qO. Fusing the information from the two images results in one image with better resolution. Since DDH records the phase information on the complex image wave, the information from both (or more) images can be fused with surprisingly advantageous results. The invention improves the resolution of generic object structures regardless of orientation.
The invention can include an extension of the fundamental DDH system to automatically capture both on-axis and off-axis illuminated holograms. The invention can also include methods to analyze and fuse the results of these holograms to produce a representation of the observed object with more spatial resolution than available in the prior DDH art.
As evident in FIG. 1, the object beam 125 is parallel to the optical axis 127. As noted above, this set-up can be referred to as on-axis illumination. Off-axis illumination, on the other hand, refers to the case where the object beam 125 is incident upon the object 130 at some angle with respect to the optical axis 127 (an example is illustrated by the object team 215,305 shown in FIG. 3). There are many methods to achieve off-axis illumination; the approach presented hereafter is intended to serve only as a representative, and therefore non- limiting example .
Referring to FIGS. 2 and 3, an embodiment of an off-axis illumination DDH apparatus is illustrated, hi FIGS. 2 and 3, there are two primary modifications from FIG. 1. A first modification is that the laser source 105, the beam expander/spatial filter 110, and the lens 115 are grouped into a computer-controlled, moveable enclosure 205. The enclosure 205 can be movable along an axis that is substantially parallel to the optical axis 127. In more detail, the enclosure 205 can be movable along an axis that is substantially coplanar with a normal to the beamsplitter 120.
Still referring to FIGS. 2 and 3, a second modification is the addition of the object objective 210. In FIG. 2, the laser source enclosure 205 is positioned so that the object beam 125 reflects off of the beamsplitter 120 to pass through the center of the object objective 210. The object beam 125 then leaves the object objective 210 and is incident upon the object 130, centered around the optical axis 127. In this configuration, on-axis illumination is achieved and the system of FIG. 2 is effectively the same as that in FIG. 1.
hi FIG. 3, however, the laser source enclosure 205 is shifted (up in this particular configuration) so that the object beam 125 passes through the object objective 210 off-center. Of course, the laser source enclosure 205 can alternatively be shifted down. Because of the focusing properties of the object objective 210, the object beam 215 leaving the object objective 210 is incident upon the object 130 at some angle with respect to the optical axis 127, thereby achieving off-axis illumination. Thus, the object beam 215 can be incident upon the object 130 substantially non-parallel to the optic axis 127. The object beam 305 reflected from the object passes back through the object objective 210 off-axis, but due to the optical properties of the object objective 210 and the focusing lens 150 is still focused on the CCD (not shown). In the off-axis illumination case, the properties of diffraction imply that the hologram formed at the CCD by the interference of the object beam 305 and the reference beam 135 will contain some spatial frequencies of the object that are not observed using on-axis illumination.
Thus, the invention can include an apparatus operable to digitally record a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising: a laser; a beamsplitter optically coupled to the laser; a reference beam mirror optically coupled to the beamsplitter; an object optically coupled to the beamsplitter; a focusing lens optically coupled to both the reference beam mirror and the object; a digital recorder optically coupled to the focusing lens; and a computer for performing a Fourier transform, applying a digital filter, and performing an inverse Fourier transform, wherein a reference beam is incident upon the reference beam mirror at a non-normal angle, an object beam is incident upon the object at an angle with respect to an optical axis defined by the focusing lens, the reference beam and an object beam, which constitute a plurality of simultaneous reference and object waves, are focused by the focusing lens at a focal plane of the digital recorder to form a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis which is recorded by the digital recorder, and the computer transforms axes of the recorded spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined by an angle between the reference beam and the object beam and cuts off signals around an original origin before performing the inverse Fourier transform. The apparatus can include an object objective optically coupled between the beamsplitter and the object. The apparatus can include an aperture stop coupled between the object and the focusing lens. The beamsplitter, the reference beam mirror and the digital recorder can define a Michelson geometry. The beamsplitter, the reference beam mirror and the digital recorder can define a Mach-Zehner geometry. The apparatus can also include a digital storage medium coupled to the computer for performing a Fourier transform, applying a digital filter, and performing an inverse Fourier transform. The digital recorder can include a CCD camera 350 that defines pixels. The apparatus can include a beam expander/spatial filter 230 optically coupled between the laser and the beamsplitter. The angle between the reference beam and the object beam, and a magnification provided by the focusing lens, can be selected in order that the digital recorder may resolve features of the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis. So that the digital recorder may resolve a feature, two fringes, each having two pixels per fringe, can be provided. The invention can include a spatially heterodyne hologram produced by the above-described apparatus, embodied on a computer- readable medium.
Accordingly, the invention can include a method of recording a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising: splitting a laser beam into a reference beam and an object beam; reflecting the reference beam from a reference mirror at a non-normal angle; reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens; focusing the reference beam and the object beam, which constitute a plurality of simultaneous reference and object waves, with the focusing lens at a focal plane of a digital recorder to form a spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; Fourier analyzing the recorded spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined as an angle between the reference beam and the object beam; applying a digital filter to cut off signals around an original origin; and then performing an inverse Fourier transform. The method can include refracting the object beam with an object objective before reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens and after reflecting the object beam from an object at an angle with respect to an optical axis defined by a focusing lens. The step of transforming axes of the recorded spatially heterodyne hologram can include transforming with an extended Fourier transform. The step of digitally recording can include detecting the beams with a CCD camera that defines pixels. The off-axis illuminated spatially heterodyne hologram can be an off-axis illuminated spatially low-frequency heterodyne hologram; the phrase low-frequency implies that the fundamental fringe spatial frequency is below the Nyquist sampling limit. The method can also include storing the spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis as digital data. The method can also include replaying the Fourier analyzed spatially heterodyne hologram. The method can also include transmitting the Fourier analyzed spatially heterodyne hologram. The invention can include a spatially heterodyne hologram prepared by the above-described method(s), embodied on a computer-readable medium.
Fusion Methodology
Referring to FIG. 4 a two-dimensional Fourier plane is depicted for a hypothetical object, where zero frequency 405 is the center. The zero frequency for the object 405 corresponds to the heterodyne or carrier frequency in the hologram. All of the spatial frequencies of the object are represented by the filled circle 410. On-axis illumination will capture only those frequencies indicated by the sold-line circle 415. One instance of off-axis illumination, however, will capture the frequencies indicated by the dash-line circle 420. Other instances of off-axis illumination can capture other regions of the object spectrum 410.
A DDH apparatus such as that shown in FIGS. 2 and 3 can be used to capture and store multiple holograms — both on-axis and off-axis illuminated — of the same object area. Realizing that each such hologram contains information about difference spatial frequencies of the object, methods to analyze these holograms and compute a single, reconstructed image will be discussed in detail below. The reconstructed image can contain all of the observed spatial frequencies and thus provide a significantly higher resolution image than any single recorded image. The methods presented hereafter are intended to serve as representative examples and are not intended to preclude extensions, modifications, or other approaches.
The invention can include the capture (digital acquisition) of k=(0, ..., N) holograms. FIG. 5 illustrates the spatial frequencies contained in each of hologram of a set of holograms where N=4. Similar to FIG. 4, FIG. 5 represents the Fourier plane of the object where the zero frequency 505 is the center point. The solid circle 510 represents spatial frequencies observed with on-axis illumination while the dotted-line circles 515, 520, 525, 530 represent spatial frequencies observed by four different off-axis illuminated holograms. By appropriately fusing the information from all five holograms, the resolution (i.e., bandwidth) of the DDH system is effectively increased and all spatial frequencies indicated by the shaded region 610 in FIG. 6 contribute to the final image.
In the Fourier domain, let the true spectrum of the object be given by F(q). The portion of F(q) (region of F(q)), Gk (q), observed by each hologram is then given by
Gk fø) = Mk e p >/fc) F(q)Wk (q),
where μk and γk are the fringe contrast and phase offset, respectively, for hologram k andj is the square root of negative one.
The invention can include normalizing and/or compensating for varying fringe contrasts. One such method for fringe contrast normalization can be described as follows. First we note that Gk (q) above represents the Fourier transform of one acquired object wave (or image) gk (x) : where the Fourier transform operation. We now define two additional images gk,o (x) = Z-1 {GΛqWo (<l)} = ^ { k ^P (jrk )F(qWk (q)W0 (q)} and g0Jc (*) = 3-1 {G0 (q)Wk (q)} = 3"10 exp(y>0 )F(q)WQ (q)Wk (q)} for k = 1, ... , N where k = 0 is assumed to be the reference image and where * indicates the inverse Fourier transform operation. The image g^0 (x) is constructed by keeping only the frequencies of gk (x) common to both gk (x) and the reference image g0 (■*) • Similarly, the image g0,k ( ) comprises only the frequencies of g0 (x) common to both go(x) and gk (x) . These common frequencies can be visualized as the intersection of the two apertures W0(q) and Wk (q) as illustrated in Fig. 10. Once gA;0 ( ) and g0,ι W have been constructed, a ratio image χk (χ) is computed as
After computing the ratio image, the relative fringe contrast, Mk l Mo , can be estimated as the sample mean (average) of the magnitude of the ratio image Zk(χ) '■
where P is the total number of pixels in the (digitized) ratio image and (χι )| represents the magnitude value of the ratio image at a single pixel location.
The invention can include normalizing and/or compensating for the phase offsets. One method for phase offset normalization is to compute the same ratio image described above for fringe contrast normalization. Then the relative phase offset, exp /(^Λ - ro)), can computed as the (weighted) sample mean of the phase of the ratio image Xk (x) '■
eχp(/( k - ro )) * x ∑ ak (χι ) Zk (χi )
1 ι=l where - **( <) is the phase (angle) of the (digitized) ratio image at a single pixel location and where ck(x,) is a weighting factor. In the most straightforward embodiment, the weighting factor is fixed equal to one. In other embodiments, the weighting factor may be related to the magnitudes of the individual images used to compute the ratio image. This may be used because phase data is often inaccurate when the magnitude is very small. One such embodiment for computing the weighting factor is
Similarly motivated weighting factors may also be employed. Another method for phase offset estimation is described as follows. Often phase offset is due to errors in locating the carrier frequency. Under such a condition, the phase offset of the ratio image takes the form
k (x) = exp /(e,x, + e2x2 + ykj) where ei and e are related to the error in finding the carrier frequency, hi this situation, both ei and e2 must be found in addition to k . The above equation can also be written as χk(x) = ∞s{elxl +e2x2 + yk)+jsin(elxl + e2x2 + yk).
The real and imaginary parts can be considered separate elements of a two-dimensional vector Re{Zχk (x)Y + γk Im yt O L + yk)
The three parameters in question on the right of the above equation - ei, e , and rk - can then be estimated from the observations (on the left of the above equation) through any standard non-linear optimization technique.
Thus, after fringe contrast and phase offset normalization, the equation for the observed spectrum in hologram k can be simplified to
Gk (q) = F(q)Wk (q)
In the above equations, Wk(q) is essentially a window function that represents the region of the spectrum observed by hologram k. As a simple example, the window functions from FIG. 5 would be equal to one inside and zero outside the respective circles 510, 515, 520, 525, 530. In a more sophisticated embodiment, the window function can be modeled using a circularly symmetric Butterworth function:
where qi and q2 represent the horizontal and spatial frequency variables of the vector q, ci and c represent the center point of the function in the Fourier plane, r represent the radius of the function, and m is the order of the filter.
The goal of the fusion method is to form an estimate of F(q) from the observations Gk(q). One approach to estimate F(q) is to employ a linear estimator based upon the minimum mean square error criterion; this is the well-known linear, minimum mean-square error (LMMSE) estimator. Using a linear estimator, the estimate for F(q), where q represents a sample in the discrete Fourier domain, is given by N
F(q) = ∑βk(q)Gk(q) k=0
where the coefficients, as determined by the LMMSE criterion, are given by
where c(q) is a positive number that represents a regularization parameter that can be selected dependent upon the specifics of the system. This regularization parameter is used to compensate for system noise. In a perfect, zero noise case c(q) could be set to zero, in which case the estimate for F(q) reduces to a simple average. In practice, such a technique produces undesirable artifacts in the fused image. The most straightforward approach is to set c(q) to some constant number for all q based on experimental observations. In more sophisticated approaches, c(q) can be set (either to a constant or to vary with q) based on some computational analysis of the observed holograms and images. Many such approaches for computing the regularization parameter may be devised by those skilled in the art.
Simple averaging or LMMSE estimation are perhaps the most straightforward approaches for computing the fused image. A few alternative optimization criteria for computing the fused image, well-known to those skilled in the art of image processing, might include maximum likelihood (ML) estimation, maximum a posteriori (MAP) estimation, and/or total least squares (TLS) estimation. Note that these examples are not exhaustive.
Experimental Results
FIG. 7 shows the discrete Fourier spectra obtained from five different holograms. The first image 705 corresponds to on-axis illumination while images 710, 715, 720, and 725 correspond to various off-axis illumination conditions. The fusion method described above was employed to produce the fused spectrum shown in image 730. FIG. 8 shows the object amplitude reconstructed from only the on-axis illuminated hologram. FIG. 9 shows the object amplitude reconstructed from the fused result. It is important to note the grid structure that becomes apparent in FIG. 9 (and which is absent in FIG. 8) due to the increased resolution that results from the fusion.
The disclosed embodiments show a computer controlled, moveable enclosure as the structure for performing the function of aligning the source, beam expander/spatial filter and lens so that the object beam passes through the object objective on-center or off-center, but the structure for aligning the source, beam expander/spatial filter and lens can be any other structure capable of performing the function of aligning the object beam so that it passes through the object objective on-center or off-center, including, by way of example1 a moveable platform for displacing the beamsplitter, the mirror, the object objective, the object, the focusing lens and the CCD camera relative to the source, beam expander/spatial filter and lens, or as another example, a series of movable optical elements (e.g., mirrors), or as another example a flexible optical fiber and/or cable.
The terms a or an, as used herein, are defined as one or more than one. The term plurality, as used herein, is defined as two or more than two. The term another, as used herein, is defined as at least a second or more. The terms including and/or having, as used herein, are defined as comprising (i.e., open language). The term coupled, as used herein, is defined as connected, although not necessarily directly, and not necessarily mechanically. The term approximately, as used herein, is defined as at least close to a given value (e.g., preferably within 10% of, more preferably within 1% of, and most preferably within 0.1% of). The term substantially, as used herein, is defined as largely but not necessarily wholly that which is specified. The term generally, as used herein, is defined as at least approaching a given state. The term deploying, as used herein, is defined as designing, building, shipping, installing and/or operating. The term means, as used herein, is defined as hardware, firmware and or software for achieving a result. The term program or phrase computer program, as used herein, is defined as a sequence of instructions designed for execution on a computer system. A program, or computer program, may include a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer or computer system. The phrase low- frequency, as used herein, can be defined as implying that the fundamental fringe spatial frequency is below the Nyquist sampling limit. Practical Applications of the Invention
A practical application of the invention that has value within the technological arts is metrology. The invention is useful in conjunction with microelectronic(mechanical) fabrication, such as for semiconductor inspection. The invention is also useful in conjunction with nanotechnology research, development and manufacturing, such as nanovisualization, nanomeasurement, or the like. The invention is useful in the context of an interferometer using digital processing and/or a digital data acquisition, for example, a direct-to-digital holography tool based on electron holography. There are virtually innumerable uses for the invention, all of which need not be detailed here.
Advantages of the Invention
A method, apparatus and/or computer program, representing an embodiment of the invention, can be cost effective and advantageous for at least the following reasons. The invention can provide computer-control of object illumination. The invention can provide fusion of results from multiple holograms. The invention can provide significantly increased imaging resolution. The invention improves quality and/or reduces costs compared to previous approaches.
All the disclosed embodiments of the invention disclosed herein can be made and used without undue experimentation in light of the disclosure. The invention is not limited by theoretical statements recited herein. Although the best mode of carrying out the invention contemplated by the inventors is disclosed, practice of the invention is not limited thereto. Accordingly, it will be appreciated by those skilled in the art that the invention may be practiced otherwise than as specifically described herein.
Further, the individual components need not be combined in the disclosed configurations, but could be combined in virtually all configurations. Further, variation may be made in the steps or in the sequence of steps composing methods described herein. Further, although the apparatus described herein can be a separate module, it will be manifest that the apparatus may be integrated into the system with which it is associated. Furthermore, all the disclosed elements and features of each disclosed embodiment can be combined with, or substituted for, the disclosed elements and features of every other disclosed embodiment except where such elements or features are mutually exclusive.
It will be manifest that various substitutions, modifications, additions and/or rearrangements of the features of the invention may be made without deviating from the spirit and/or scope of the underlying inventive concept. It is deemed that the spirit and/or scope of the underlying inventive concept as defined by the appended claims and their equivalents cover all such substitutions, modifications, additions and/or rearrangements.
The appended claims are not to be interpreted as including means-plus-function limitations, unless such a limitation is explicitly recited in a given claim using the phrase(s) "means for" and/or "step for." Subgeneric embodiments of the invention are delineated by the appended independent claims and their equivalents. Specific embodiments of the invention are differentiated by the appended dependent claims and their equivalents.
REFERENCES
(1) Goodman, Joseph W., "Introduction to Fourier Optics," McGraw-Hill, 1998.
(2) Voelkl, E. et al., "Introduction to Electron Holography," Kluwer Academics/Plenum Publishers, 1999.
(3) Eugene Hecht, "Optics, Third Edition," Addison-Wesley, 1998, page 465-469; 599- 602.

Claims

CLAIMSWhat is claimed is:
1. A method of recording an off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising, reflecting a reference beam from a reference mirror at a non-normal angle; reflecting an object beam from an object at an angle with respect to an optical axis defined by a focusing lens; focusing the reference beam and the object beam at a focal plane of a digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis; digitally recording the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis;
Fourier analyzing the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes by transforming axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined as an angle between the reference beam and the object beam; applying a digital filter to cut off signals around an original origin; and then performing an inverse Fourier transform.
2. The method of claim 1, further comprising refracting the object beam with an object objective before reflecting the object beam from the object at an angle with respect to the optical axis defined by the focusing lens; and refracting the object beam with the object objective after reflecting the object beam from the object at an angle with respect to the optical axis defined by the focusing lens.
3. The method of claim 1, further comprising fusing the off-axis illuminated spatially heterodyne hologram with at least one hologram selected from the group consisting of an on- axis illuminated spatially heterodyne hologram and another off-axis illuminated spatially heterodyne hologram to compute a single reconstructed image.
4. The method of claim 1 , wherein the off-axis illuminated spatially heterodyne hologram is an off-axis illuminated spatially low-frequency heterodyne hologram.
5. The method of claim 1, wherein a region of the true spectrum of the object observed by the off-axis illuminated spatially heterodyne hologram is represented by
Gk (q) = μk expO' * ) F(q)Wk (q), where q can represent a sample in the discrete Fourier domain or a coordinate vector in the continuous Fourier plane, μu and yu are the fringe contrast and phase offset, respectively, for the off-axis illuminated spatially heterodyne hologram k, Wk(q) is a window function that represents the region of the spectrum observed by the off-axis illuminated spatially heterodyne hologram k, F(q) is the true spectrum of the object, and j is the square root of negative one.
6. The method of claim 5, wherein Wk(q) is modeled with circularly symmetric Butterworth function.
7. The method of claim 1, further comprising fusing the off-axis illuminated spatially heterodyne hologram with at least one hologram selected from the group consisting of an on- axis illuminated spatially heterodyne hologram and another off-axis illuminated spatially heterodyne hologram to compute a single reconstructed image, wherein a region of the true spectrum of the object observed by a hologram k selected from the group consisting of the off-axis illuminated spatially heterodyne hologram and the on-axis illuminated spatially heterodyne hologram is represented by
Gk (q) ~ μk QXVU'rk ) F(q)Wk (q), where q represents a sample in the discrete Fourier domain, μk and γ are the fringe contrast and phase offset, respectively, for the hologram k, Wk(q) is a window function that represents the region of the spectrum observed by the hologram k, F(q) is the true spectrum of the object, andy is the square root of negative one, and an estimate of the computed single reconstructed image is represented by
where
where c(q) represents a regularization parameter.
8. The method of claim 1, wherein region of the true spectrum of the object observed by the off-axis illuminated spatially heterodyne hologram is represented by
Gk(q) = F(q)Wk(q) where q represents a sample in the discrete Fourier domain, Wk(q) is a window function that represents the region of the spectrum observed by the off-axis illuminated spatially heterodyne hologram k, and F(q) is the true spectrum of the object.
9. The method of claim 8, wherein Wk(q) is a function, at least in-part of a Butterworth filter.
10. The method of claim 1, further comprising fusing the off-axis illuminated spatially heterodyne hologram with at least one hologram selected from the group consisting of an on- axis illuminated spatially heterodyne hologram and another off-axis illuminated spatially heterodyne hologram to compute a single reconstructed image, wherein a region of the true spectrum of the object observed by a hologram k selected from the group consisting of the off-axis illuminated spatially heterodyne hologram and the on-axis illuminated spatially heterodyne hologram is represented by
Gk(q) = F(q)Wk(q) where q represents a sample in the discrete Fourier domain, Wk(q) is a window function that represents the region of the spectrum observed by the hologram k, and F(q) is the true spectrum of the object, and an estimate of the computed single reconstructed image is represented by
where
where c(q) represents a regularization parameter.
11. The method of claim 1 , wherein the step of digitally recording includes detecting the beams with a CCD camera that defines pixels.
12. The method of claim 1, further comprising storing the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis as digital data.
13. The method of claim 1, further comprising replaying the Fourier analyzed off-axis illuminated spatially heterodyne hologram.
14. The method of claim 1, further comprising transmitting the Fourier analyzed off-axis illuminated spatially heterodyne hologram.
15. A computer program, comprising computer or machine readable program elements translatable for implementing the method of claim 1.
16. A machine readable media comprising data generated by the method of claim 1.
17. An apparatus operable to digitally record an off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis, comprising: a laser; a beamsplitter optically coupled to the laser; a reference beam mirror optically coupled to the beamsplitter; a focusing lens optically coupled to the reference beam mirror; a digital recorder optically coupled to the focusing lens; and a computer that performs a Fourier transform, applies a digital filter, and performs an inverse Fourier transform, wherein a reference beam is incident upon the reference beam mirror at a non-normal angle, an object beam is incident upon an object at an angle with respect to an optical axis defined by the focusing.lens, the reference beam and the object beam are focused by the focusing lens at a focal plane of the digital recorder to form the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis which is recorded by the digital recorder, and the computer transforms axes of the recorded off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes in Fourier space to sit on top of a heterodyne carrier frequency defined by an angle between the reference beam and the object beam and cuts off signals around an original origin before performing the inverse Fourier transform.
18. The apparatus of claim 17, further comprising an object objective optically coupled between the beamsplitter and the object.
19. The apparatus of claim 17, wherein the laser is moveable relative to the beamsplitter.
20. The apparatus of claim 17, wherein the beamsplitter, the reference beam mirror and the digital recorder define a Michelson geometry.
21. The apparatus of claim 17, wherein the beamsplitter, the reference beam mirror and the digital recorder define a Mach-Zehner geometry.
22. The apparatus of claim 17, further comprising a digital storage medium coupled to the computer for perfonning a Fourier transform, applying a digital filter, and performing an inverse Fourier transform.
23. The apparatus of claim 17, wherein the digital recorder includes a CCD camera that defines pixels.
24. The apparatus of claim 23, wherein the angle between the reference beam and the object beam, and a magnification provided by the focusing lens, are selected in order that the digital recorder may resolve features of the off-axis illuminated spatially heterodyne hologram including spatially heterodyne fringes for Fourier analysis and two fringes, each having two pixels per fringe, are provided.
25. A machine readable media comprising data generated using the apparatus of claim 17.
EP03749369A 2002-09-03 2003-09-03 Direct-to-digital off-axis holography with off-axis illuminated object Withdrawn EP1537456A2 (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US10/234,042 US6963406B2 (en) 2002-09-03 2002-09-03 Fused off-axis object illumination direct-to-digital holography with a plurality of illumination sources
US234043 2002-09-03
US234042 2002-09-03
US10/234,043 US7038787B2 (en) 2002-09-03 2002-09-03 Content-based fused off-axis object illumination direct-to-digital holography
US10/234,044 US6747771B2 (en) 2002-09-03 2002-09-03 Off-axis illumination direct-to-digital holography
US234044 2002-09-03
PCT/US2003/027569 WO2004023217A2 (en) 2002-09-03 2003-09-03 Direct-to-digital off-axis holography with off-axis illuminated object

Publications (1)

Publication Number Publication Date
EP1537456A2 true EP1537456A2 (en) 2005-06-08

Family

ID=31982278

Family Applications (3)

Application Number Title Priority Date Filing Date
EP03749369A Withdrawn EP1537456A2 (en) 2002-09-03 2003-09-03 Direct-to-digital off-axis holography with off-axis illuminated object
EP03770283A Withdrawn EP1537458A2 (en) 2002-09-03 2003-09-03 Rapid direct-to-digital holographic acquisition of object off-axis illuminated by several illumination sources
EP03770282A Withdrawn EP1537457A2 (en) 2002-09-03 2003-09-03 Direct-to-digital holographic acquisition of content-based off-axis illuminated object

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP03770283A Withdrawn EP1537458A2 (en) 2002-09-03 2003-09-03 Rapid direct-to-digital holographic acquisition of object off-axis illuminated by several illumination sources
EP03770282A Withdrawn EP1537457A2 (en) 2002-09-03 2003-09-03 Direct-to-digital holographic acquisition of content-based off-axis illuminated object

Country Status (5)

Country Link
EP (3) EP1537456A2 (en)
JP (3) JP2005537516A (en)
KR (3) KR100717414B1 (en)
AU (3) AU2003278760A1 (en)
WO (3) WO2004023217A2 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100870967B1 (en) * 2007-03-22 2008-12-01 (주)에이피앤텍 Device and method for recording and reconstructing digital hologram without virtual image
KR101126369B1 (en) * 2008-12-31 2012-03-23 (주)와이티에스 Laser beam measurment of direct type
KR101270768B1 (en) * 2011-04-19 2013-06-05 전자부품연구원 Hologram display, Method for hologram display
CN103336369A (en) * 2013-07-15 2013-10-02 上海宏盾防伪材料有限公司 Light path system for shooting coaxial holographic lens and method thereof
WO2019044336A1 (en) * 2017-08-30 2019-03-07 公立大学法人兵庫県立大学 Holographic imaging device and data processing method therefor
WO2021117328A1 (en) * 2019-12-11 2021-06-17 富士フイルム株式会社 Control device, operation method for control device, and operation program for control device
WO2023021795A1 (en) * 2021-08-17 2023-02-23 富士フイルム株式会社 Light source control device, operation method for light source control device, operation program for light source control device, and digital holography system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6525821B1 (en) * 1997-06-11 2003-02-25 Ut-Battelle, L.L.C. Acquisition and replay systems for direct-to-digital holography and holovision
US6078392A (en) * 1997-06-11 2000-06-20 Lockheed Martin Energy Research Corp. Direct-to-digital holography and holovision
JP3759677B2 (en) * 1998-07-17 2006-03-29 株式会社ミツトヨ Dimensional measurement method in optical interferometer
US6262818B1 (en) * 1998-10-07 2001-07-17 Institute Of Applied Optics, Swiss Federal Institute Of Technology Method for simultaneous amplitude and quantitative phase contrast imaging by numerical reconstruction of digital holograms

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004023217A2 *

Also Published As

Publication number Publication date
AU2003278760A1 (en) 2004-03-29
KR20060055425A (en) 2006-05-23
WO2004023218A2 (en) 2004-03-18
WO2004023217A3 (en) 2004-04-22
WO2004023218A3 (en) 2004-04-22
AU2003268404A1 (en) 2004-03-29
AU2003278760A8 (en) 2004-03-29
WO2004023219A3 (en) 2004-04-22
JP2005537517A (en) 2005-12-08
EP1537458A2 (en) 2005-06-08
KR100715033B1 (en) 2007-05-09
JP2005537516A (en) 2005-12-08
WO2004023217A2 (en) 2004-03-18
AU2003278759A1 (en) 2004-03-29
KR100717414B1 (en) 2007-05-11
KR20050057155A (en) 2005-06-16
WO2004023219A2 (en) 2004-03-18
AU2003278759A8 (en) 2004-03-29
EP1537457A2 (en) 2005-06-08
JP2005537518A (en) 2005-12-08
AU2003268404A8 (en) 2004-03-29
KR100712708B1 (en) 2007-05-02
KR20050057154A (en) 2005-06-16

Similar Documents

Publication Publication Date Title
US6747771B2 (en) Off-axis illumination direct-to-digital holography
KR100558020B1 (en) Direct-to-digital holography, holographic interferometry, and holovision
US7978403B2 (en) Imaging interferometric microscopy
US7068375B2 (en) Direct-to-digital holography reduction of reference hologram noise and fourier space smearing
US7038787B2 (en) Content-based fused off-axis object illumination direct-to-digital holography
KR20050046769A (en) System and method for detecting differences between complex images
WO2004023217A2 (en) Direct-to-digital off-axis holography with off-axis illuminated object
US6963406B2 (en) Fused off-axis object illumination direct-to-digital holography with a plurality of illumination sources
CN114374779B (en) Full light field imaging camera, imaging method thereof and full light field imaging device
JP2019078635A (en) Measuring apparatus, data processor, method for processing data, and program
EP3994529A1 (en) Calibration-free phase shifting procedure for self-interference holography
Ferraro et al. Digital holography: recent advancements and prospective improvements for applications in microscopy
JPH11258057A (en) Complex signal detecting method, complex microscope and complex diffraction device
US20160320485A1 (en) Image processing method
WO2008020083A2 (en) High resolution digital holograms
US20230259070A1 (en) Systems and Methods for Reconstruction of Digital Holograms
CN118444545A (en) Automatic phase distortion removing method applied to digital holographic microscopy
Kocsis et al. SSR-PR: Single-shot Super-Resolution Phase Retrieval based two prior calibration tests
Xu High Quality 3D Shape Reconstruction via Digital Refocusing and Pupil Apodization in Multi-wavelength Holographic Interferometry.
Ferreira et al. Two-dimensional lensless object scanning holography
García et al. Lensless object scanning holography for diffuse objects
Khodadad Combined Digital Holography and Speckle Correlation for Rapid Shape Evaluation
Chen et al. Profiling of an object using a time-frequency analysis method in digital holographic interferometry

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050329

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1071792

Country of ref document: HK

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20080401

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1071792

Country of ref document: HK