EP3994529A1 - Calibration-free phase shifting procedure for self-interference holography - Google Patents
Calibration-free phase shifting procedure for self-interference holographyInfo
- Publication number
- EP3994529A1 EP3994529A1 EP20834451.5A EP20834451A EP3994529A1 EP 3994529 A1 EP3994529 A1 EP 3994529A1 EP 20834451 A EP20834451 A EP 20834451A EP 3994529 A1 EP3994529 A1 EP 3994529A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- recording
- orthogonally polarized
- electromagnetic radiation
- polarized beams
- interference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000001093 holography Methods 0.000 title description 21
- 230000010287 polarization Effects 0.000 claims abstract description 43
- 230000005670 electromagnetic radiation Effects 0.000 claims abstract description 32
- 238000003384 imaging method Methods 0.000 claims description 22
- 230000003287 optical effect Effects 0.000 claims description 10
- 238000013459 approach Methods 0.000 claims description 8
- 239000003086 colorant Substances 0.000 claims description 8
- 230000001427 coherent effect Effects 0.000 claims description 3
- 238000005286 illumination Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000003491 array Methods 0.000 claims 1
- 230000005855 radiation Effects 0.000 claims 1
- 238000012360 testing method Methods 0.000 description 22
- 230000010363 phase shift Effects 0.000 description 13
- 239000013078 crystal Substances 0.000 description 9
- 238000000386 microscopy Methods 0.000 description 9
- 238000000799 fluorescence microscopy Methods 0.000 description 6
- 230000015572 biosynthetic process Effects 0.000 description 5
- 238000007796 conventional method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 239000011324 bead Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005305 interferometry Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004624 confocal microscopy Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008832 photodamage Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005316 response function Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000009987 spinning Methods 0.000 description 1
- 238000010857 super resolution fluorescence microscopy Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/28—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
- G02B27/286—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
- G02B5/3083—Birefringent or phase retarding elements
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0465—Particular recording light; Beam shape or geometry
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/06—Processes or apparatus for producing holograms using incoherent light
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0087—Simple or compound lenses with index gradient
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/005—Adaptation of holography to specific applications in microscopy, e.g. digital holographic microscope [DHM]
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
- G03H2001/0447—In-line recording arrangement
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
- G03H2001/0454—Arrangement for recovering hologram complex amplitude
- G03H2001/0458—Temporal or spatial phase shifting, e.g. parallel phase shifting method
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2222/00—Light sources or light beam properties
- G03H2222/20—Coherence of the light source
- G03H2222/24—Low coherence light normally not allowing valuable record or reconstruction
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2222/00—Light sources or light beam properties
- G03H2222/31—Polarised light
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2223/00—Optical components
- G03H2223/17—Element having optical power
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2223/00—Optical components
- G03H2223/19—Microoptic array, e.g. lens array
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2223/00—Optical components
- G03H2223/20—Birefringent optical element, e.g. wave plate
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2223/00—Optical components
- G03H2223/22—Polariser
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2226/00—Electro-optic or electronic components relating to digital holography
- G03H2226/11—Electro-optic recording means, e.g. CCD, pyroelectric sensors
Definitions
- This disclosure generally relates to an apparatus and method for recording a hologram for an object derived from electromagnetic radiation received from the object, and more particularly to the processing of the recorded hologram and reconstruction of super-resolved image data describing the object.
- FINCH Fel Incoherent Correlation Holography
- a method of performing FINCH holography that avoided wavelength calibration for phase shifting and could record multiple phase factors in a single exposure would provide great advantages over previous FINCH holographic technology.
- one object of the present disclosure is to provide an apparatus in which light received from the object is transformed into a plurality of co-linear co-propagating beams, each of which carries information about the object and each of which has a unique spherical phase curvature (focal length).
- the plurality of beams is caused to interfere in multiple phase factors without requiring wavelength calibration for the control of the phase factor.
- the multiple interference pattern phase factors are recorded sequentially and then processed to form the hologram of the object and an image of the object derived from the hologram.
- Another object of the present disclosure is an apparatus in which light received from the object is transformed into a plurality of colinear copropagating beams, each of which carries information about the object and each of which has a unique spherical phase curvature (focal length).
- the plurality of beams is caused to interfere in multiple phase factors without requiring wavelength calibration for the control of the phase factor.
- the multiple phase factors of the interference are recorded in a single image capture. Subsequently, the interference patterns thus recorded are processed to form the hologram of the object and an image of the object derived from said hologram.
- Another object of the present disclosure is an apparatus that produces two geometrically separated interference recordings from light received from an object.
- Each interference recording contains data sufficient to produce the hologram of the object.
- the concurrently recorded interference recordings are processed together to increase the signal-to-noise ratio of the hologram.
- Another object of the present disclosure is a calibration-free apparatus to create super resolution images of an object or scene in a single exposure, the apparatus comprising an optical assembly to receive light from an object, transform said light into a pair of differentially focused beams with orthogonal circular polarizations, and cause a recording of the interference of the two beams at an image recording plane; wherein the transformation of the light is accomplished by the application of a birefringent lens, and wherein the conversion to circularly polarized light beams is accomplished by a broadband quarter-wave plate, and wherein the interference is created by directing the beam pair to an image detector in which every pixel is registered to a micro-polarizer array containing multiple sets of polarizer elements with predefined linear polarization orientations, wherein the interference recording is further processed computationally to recover the object hologram and super-resolved image.
- Figure 1 is a schematic depicting the formation of FINCH holograms of a point in a sample object.
- Figure 2 is a schematic depicting the formation of two differentially focused beams from a single beam received by a birefringent lens.
- Figure 4a illustrates an example embodiment using birefringent lenses and a quarter-wave plate to create differentially focused circularly polarized beams from received light, and a single polarizing element to bring the two beams to interfere.
- Figure 4b illustrates an example embodiment using birefringent lenses and a quarter-wave plate to create differentially focused circularly polarized beams from received light, and an array of polarizing elements to cause interference of the beams.
- Figure 5a illustrates recordings of a FINCH holograms of a laser beam performed by a device of the type of embodiment in Fig. 4a.
- Figure 5b illustrates phase images and respective histograms of microscopic beads imaged with a prior-art embodiment of FINCH and with a FINCH device of the type of embodiment in Figure
- Figure 6 illustrates an example embodiment with two identical optical trains of the type of the embodiment in Fig. 4b, each receiving a single linear polarization from a linear polarizer operating on the received light from the object.
- Figure 7 illustrates a pixelated imaging sensor, divided into sampled regions for both polarization of received light and wavelength of received light.
- FINCH Fresnel Incoherent Correlation Holography
- FINCH is a single beam interferometric method that can create an interference pattern (also referred to as a hologram or a recorded hologram or a raw hologram) from visible light or any kind of electromagnetic radiation, either incoherent or coherent.
- an interference pattern also referred to as a hologram or a recorded hologram or a raw hologram
- a plurality of holograms must be recorded.
- This plurality of recorded holograms or interference patterns must include at least two“phase shifted” holograms, each with a unique phase factor.
- the plurality of holograms is typically obtained in a serial manner or in a parallel manner by a variety of beam-splitting techniques.
- Figure 1 illustrates a generalized FINCH imaging system.
- An object (also referred to as sample) 101 emits or reflects light toward the FINCH optical system 102, which receives the light through a lens or other aperture and produces (from any single received beam of light) two co-propagating beams (e.g. 103, 104) with distinct phase curvatures.
- the two co-propagating beams are directed to a recording device in a manner that allow them to produce an interference pattern 105, which is then recorded by an image recording device (not shown) and stored 106 for subsequent calculated reconstruction of the image 107 computed in a computing device 108..
- phase-shifted interference patterns are recorded and stored for use in creating a complex hologram and calculated reconstructed images.
- the method of formation of the complex hologram and the reconstruction process are described in detail in references 1-5, 7-9 and are thus saved from detailed reiteration here.
- the recorded holograms with different phase factors are super-imposed on each other in a computing device by the following operation:
- the complex hologram is then reconstructed into a 2D image s representing a single in-focus plane by one of a number of different computational operations.
- Fresnel Propagation exemplified in the following equation: (equation 2)
- asterisk represents a 2D convolution operation
- z rec is the desired distance of the in focus plane at which the hologram is to be reconstructed
- the exponential term is a propagation function for optical propagation by a distance of
- Other image reconstruction methods may be applied, including angular spectrum reconstruction, image inversion, compressive sensing and deep learning computations, amongst others.
- the reconstructed image is then displayed on a computer monitor or other suitable display device Note that equation 2 or another reconstruction operation may be repeated many times for any different irec as desired to create a three-dimensional collection of images.
- FINCH uses two test beams to be interfered with one another.
- FIG. 32 in the above noted US Patent # 8, 179,578 illustrates a typical conventional non-FINCH holographic system.
- 9012 is the reference beam and 9010 is the test or sample beam.
- the test beam is the light that returns from the sample (also referred to as object) being measured.
- the sample also referred to as object
- all the information about the sample being investigated is included in the test beam.
- the reference beam in contrast, is a well-characterized beam that is either brought directly from the source (for example a single mode laser beam) or which returns from a well-characterized standard reference.
- the reference beam carries no information about the sample.
- the interference pattern that is actually obtained contains information about any differences in the shape of the test mirror. Any deviations from a perfect interference pattern can only be attributed to the new mirror, and it is possible to calculate what the test mirror shape must be.
- test beams as in FINCH
- both test beams carry information about the sample, and therefore their interference enables super-resolution of up to twice the standard resolution of the single test beam case and single reference beam case; and with two test beams, all of the light from the sample and no non-informative reference light is used to form the interference with maximum interference efficiency, resulting in the maximum possible signal and minimum possible background.
- the two co-propagating beams 103, 104 are produced by polarizing the incoming light 201 at an input polarizer 202 before it reaches the FINCH birefringent lens assembly 203 so that the light is polarized and +45° and -45° relative to the ordinary and extraordinary refractive indices of the birefringent optics.
- the birefringent lens assembly 203 includes at least one birefringent lens as well as any other optics necessary to transform the beam, including chromatic correction lenses, standard converging or diverging lenses, birefringent compensating optics, and any other optics necessary to achieve the interference of the beams as well as a final image that is free of aberrations.
- the birefringent optic thus separates the incoming beam into two outgoing beams, polarized along the ordinary and extraordinary refractive indices, each with its own phase curvature that is a function of the incoming phase curvature and the birefringent lens curvature and respective refractive index.
- the overall phase of one of the beams is changed by a dynamic and variable phase-shifting optic 204 before both beams are passed through an output polarizer 205 that projects parts of both beams along a common axis to permit mutual interference at the interference recording plane 206.
- Sequential images with differing phase shifts are recorded and used to calculate images free from the effects of bias and twin image noise that are
- phase shifting optic used is a variable waveplate that delays light of either the ordinary or extraordinary polarization before it reaches the output polarizer.
- An example hologram of a laser beam taken with such a system is shown in Figure 3, displaying three“raw” phase shifted holograms 301, 302, 303 as well as the recovered amplitude 304 and phase 305 of the complex hologram.
- birefringent lens-equipped FINCH can be further enhanced by acquiring at least a required minimum number of“phase shifted” holograms simultaneously, instead of serially as in the previous implementations.
- certain other improvements by one or both of the present inventors introducing the use of polarization to the originally proposed FINCH, such as, for example, STM (spatial light modulator) or GRIN (gradient refractive index) lens equipped FINCH may also be further enhanced by acquiring at least a required minimum number of “phase shifted” holograms simultaneously.
- Many of these single shot techniques have drawbacks in that they often require image registration that is difficult to achieve, or difficult optical geometries, all of which reduce image resolution.
- many of these single shot systems proposed previously require a test beam and a reference beam.
- FINCH is a form of self-interference interferometry in which the interference is created from two copies of the beam coming from the sample, i e. two test beams.
- FINCH while an interferometer with orthogonally polarized beams, does not have a reference beam as is the case in some conventional holography.
- FINCH requires two test (sample) beams that interfere with one another. This is a substantial difference that changes what information can be obtained from the interferometer.
- it is the fact of having two test beams that allows FINCH to achieve high spatial super-resolution that classical imaging methods and other holography methods do not, and from conventional non-FINCH interferometer methods with test and reference beams.
- each copy of the beam has all the object information in it.
- the interference pattern obtained in FINCH can be thought of (colloquially) as "amplifying" the sample information.
- some conventional techniques use a reference beam that is weaker than the test beam, and thus cannot achieve maximum efficiency in the obtained interference.
- the reference beam created is weaker than the test beam by as much as 99: 1 and therefore an efficiency loss of converting light from the sample into interference is observed.
- a point diffraction (“PDF) optic is used to produce a reference beam from a filtered copy of the test beam from the sample, this technique used to create the reference beam erases all the sample information, and thus cannot "amplify" the sample information as in FINCH.
- PDF point diffraction
- the reference beam in U.S. Patent 8,351,048, US patent 6,304,330, US patent 7,230,717, and US patent 7,777,895, is truly a reference beam in that it has no sample information.
- the ratio of the two beam intensities is 50:50, and thus the maximum efficiency in converting light into interference is obtained.
- the present inventors discovered that a modification of the polarization scheme typically used to create the test FINCH beams could be used to create higher quality holograms than those that are produced by our other techniques described in US patents 10,228,655, 10,289,070, 10,423,123, and 10,591,870 and patent application 20170185036, and“High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers”.
- the improved quality may at least in part be the result of the absence of incorrect calibration and stability of the phase shifter at any wavelength or bandwidth and the fact that more sample information creates the hologram.
- a FINCH system when a FINCH system is adapted with a polarization scheme as noted above, it also permits single shot recording, and it is then possible to advantageously apply the system to imaging that particularly benefits from single shot recording, including for example, chemiluminescent or bioluminescent imaging, or any low light system in which long exposures might exacerbate the problems inherent in sequential recording as listed above, i.e. the sample must not change during the recording of the interference patterns necessary to reconstruct the scene.
- FIG. 4a An embodiment of the current invention is illustrated in Figure 4a.
- the incoming object light 201 is linearly polarized at an input polarizer 202 and passed through the birefringent lens optics 203 such as, for example, in US patents 10,228,655, 10,289,070, 10,423,123, and 10,591,870 and patent application 20170185036, and“High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers”, producing two differentially focused beams with orthogonal linear polarizations.
- a quarter- wave plate 401 is placed in the beam path, with its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens. This has the effect of turning the linearly polarized light from the birefringent lens into circularly polarized light, one beam with right handed circular polarization and one with left-handed circular polarization.
- the birefringent lens optics 203 such as,
- this waveplate may be a broadband waveplate that applies the same quarter wave phase shift to every incoming wavelength over its range and does not need to be calibrated.
- the two circularly polarized beams may be brought to interfere by passing them through a linear polarizer 205.
- the angle of the polarizer transmission axis with respect to the waveplate slow axis controls the phase of the interference between the two beams (note that for some embodiments the exact angle of polarization needs to be known for each degree of polarization, but the angle of polarization shift can be less precise and compensated for in software by an iterative software routine to obtain the best image of a test pattern).
- Multiple phase shifted holograms may then be recorded sequentially, by rotating the polarization axis of an output polarizer 205 placed in a plane between the quarter-wave plate and the interference detection plane 206.
- FIG. 4b Another embodiment of the present invention is illustrated in Figure 4b.
- the incoming object light 201 is linearly polarized at an input polarizer 202 and passed through the birefringent lens optics 203 such as, for example, in US patents 10,228,655, 10,289,070, 10,423,123, and 10,591,870 and patent application 20170185036, and“High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers” .
- a quarter-wave plate 401 is placed in the beam path, with its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens.
- this waveplate may be a broadband waveplate that applies the same quarter- wave phase shift to every' incoming wavelength over its range and does not need to be calibrated.
- the two circularly polarized beams may be brought to interfere by passing them through an array 402 of differentially aligned micropolarizers of varying polarization orientations 403, 404, 405, 406 overlaying the image sensor at interference detection plane 206 wherein each micropolarizer is of the size of one of the detector pixels and is registered to a specific detector pixel.
- the micropolarizer array may contain micropolarizers with transmission axis orientation of 0°, 90°, 180°, and 270° (or -90°) with respect to the quarter wave plate, resulting in the collection of multiple phase shifted raw holograms with relative phase shifts of 0, p/2, p, and 3p/2 radians (or 0°, 90°, 180°, and 270°).
- the micropolarizers may be of any convenient set of axis orientations to produce multiple holograms with any desired set of relative phase shifts.
- the different phase shifted holograms may be separated from each other in the computing device. This results in a set of holograms, each of which has a quantity of blank pixels equal to (device pixel count )*(n-l)/n, where n is the number of phase shifts used.
- These pixels may reassigned with values calculated by nearest neighbor or other interpolation methods, to maintain the sampling interval of the imaging device.
- a recentering operation of single-pixel sifting the interpolated data may optionally be performed in order to improve the overlap of the raw holograms.
- polarizers isolate a single polarization component of incident light uniformly, regardless of precise wavelength over a broad wavelength band of light
- the combination of the broadband quarter wave plate and interference formation by polarizer rotation as in the embodiment described in Fig. 4a results in a FINCH system with truly achromatic, calibration- free phase shifting and therefore with optimized phase recording of the interference patterns.
- Use of the embodiment described in Fig. 4b for simultaneous single shot recording addresses further aspects that affect the quality of recorded FINCH holograms, by eliminating considerations of long exposure time, photodamage of photosensitive objects, and sample motion between sequential exposures. In summation, it is an all optical system, free of any electronic or mechanical adjustments during image recording, that is capable of producing holograms in a single exposure with precise and reproducible phase shifts.
- Sample data from the example embodiment shown in Fig 4a, with sequential interference pattern acquisition, is shown in Figure 5a, displaying four“raw” phase shifted holograms 501, 502, 503, 504 of a laser beam used as a model source object simulating an infinitesimal object point as well as the recovered amplitude 505 and phase 506 of the complex hologram.
- Example illustrative results of the performance of the polarization-based phase shifting FES1CH holographic method is shown in Figure 5b.
- the resulting complex phases of the polarization method according to embodiments were compared with the conventional variable waveplate method are shown in 507 and 508 respectively. Also shown are the image histograms of the phase values in 509 according to embodiments and the conventional phase values in 510.
- the phase patterns in 507 appear quite spherical to the eye, with fewer aberrations than seen in 508, the conventional techniques. Additionally, the histograms of the complex hologram phases show excellent performance of the embodiments of the present invention.
- histogram of a complex hologram phase shown on a 0-65,535 scale should be centered (the mean pixel value should be) at approximately 32,767, with an equal distribution on the positive and negative slopes.
- Histogram 509 from an embodiment of the present invention is centered at -37,600, much closer to the ideal than histogram 510 from the techniques of US patents 10,228,655, 10,289,070, 10,423,123, and 10,591,870 and patent application
- the input polarizer mentioned in the preceding embodiment is a polarizing beam splitter 601, which receives the input light 201.
- Each of the two linearly orthogonally polarized beams 602, 603 from this polarizing beamsplitter is then directed toward one of two identical FINCH systems 604, 605 of the general type in the preceding embodiment (though lacking discrete input polarizer as that function is shared for both 604, 605 by 601), allowing a greater efficiency of light collection.
- Each of the FINCH systems 604, 605 contains birefringent lens optics 203, broadband quarter-wave plate 401, and micro-polarizer grid camera 402, and forms co-propagating linearly orthogonally polarized beams 103, 104 that reach an interference plane 206.
- a system in which FINCH is enhanced with one of the embodiments of Fig. 4a or 4b may often improve the recorded hologram quality and/or performance of current FINCH systems.
- current FINCH systems require a high level of precision in a real-world system such as a microscope that must be sensitive to multiple wavelengths of light.
- the variable waveplate of conventional methods of phase shifting may require precise calibration for each wavelength.
- this calibration can only be fully corrected for a single wavelength, leaving the other wavelengths in the band open to be shifted by an imprecise amount.
- the single shot embodiments of the enhanced FINCH may improve upon the current FINCH systems by, for example, reducing the length of illumination of potentially delicate samples, by allowing for increased time resolution, reducing possibility of object or background changes between sequential hologram recording, particularly in the case of living or moving objects, eliminating the need for calibration of phase shifting devices for multiple wavelengths.
- the single shot embodiments of the invention may, in the case of broadband light, reduce or eliminate the impact of the inability of some serial hologram acquisition techniques to perfectly shift the phase only for a single wavelength of the light, while other wavelengths experience more or less than the desired phase shift.
- the input polarizer mentioned in the first embodiment is a polarizing beam splitter.
- Each beam from this polarizing beamsplitter is then directed toward one of two identical FINCH systems of the general type in the preceding embodiment, allowing a greater efficiency of light collection.
- the interference patterns collected at the termini of the identical FINCH systems are then correlated with each other in a coincidence imaging image recording, to enhance the signal to noise ratio in the image recording.
- the input polarizer mentioned in the first embodiment is a polarizing beam splitter.
- Each beam from this polarizing beamsplitter is then directed toward one of two almost identical FINCH systems of the general type in the preceding embodiment, each for example detecting a different bandwidth or wavelength of light by a variety of means.
- each phase shifted interference pattern only contains approximately 1 In of the pixels it would contain if all the micropolarizers were of a single orientation.
- the multiple phase shifted interference patterns are actually sparse representations of the full interference patterns.
- the sparse data sets representing the interference patterns may optionally be analyzed using compressive sensing approaches, which are powerful computational approaches that perform best on sparse data sets. Compressive sensing approaches have been applied to holographic imaging reconstruction before but have not been successful at reconstructing complicated objects.
- the sparsity of the multiplexed interference recordings, as well as the fact that they are from different phase“viewpoints”, enable the application of compressive sensing approaches to the image reconstruction in ways that are not available to sequentially recorded phase shifted interference patterns.
- the incoming object light is linearly polarized at an input polarizer and passed through the birefringent lens optics. Then the light is passed through a broadband quarter-wave plate that has its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens.
- Multiple phase shifted interference patterns are then simultaneously collected as sparse representations of full interference patterns in a single shot, by using a detector with an array of differentially aligned micropolarizers with at least two polarization orientations overlaid on its pixels.
- These phase shifted interference patterns are each then reconstructed into the full interference patterns using standard or compressive sensing computational approaches.
- the full interference patterns are then used to construct the complex hologram and reconstructed images.
- the incoming object light is linearly polarized at an input polarizer and passed through the birefringent lens optics. Then the light is passed through a broadband quarter-wave plate with that has its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens.
- Multiple phase shifted interference patterns are then simultaneously collected as sparse representations of full interference patterns in a single shot, by using a detector with an array of differentially aligned micropolarizers with at least two polarization orientations overlaid on its pixels.
- phase-shifted interference patterns are then reconstructed directly into images (without intermediately being made into complex holograms) using joint iterative computational approaches including compressive sensing and forward convolutional approaches.
- the potential reduction in spatial resolution by multiplexing the phase recordings can be overcome by reducing the size and increasing the number of multiplexed pixels.
- the resultant complex hologram pixels can be the same size as non-phase multiplexed methods.
- patterned micropolarizer masks is not limited to monochrome image recording, shown in FIG.7.
- Color cameras have a plurality of color-selective pixels arranged in patterns such for example as the Bayer pattern; each single color pixel (RGB for example) in the color image is composed of a group of color sensitive pixels 701 (one R, one B, two G, for example). It is therefore possible to align a micropolarizer mask so that each micropolarizer 702 is registered to a group 701 of individual camera pixels that represents a single color pixel in the final image, resulting in 703 a color pixel that accepts only one polarization and therefore only one phase factor of the interference in embodiments of the present invention.
- FIG. 7 for an exemplary illustration of this, including 704 an array of color pixels under an array of micropolarizers.
- This Bayer pattern implementation of FINCH works quite well since FINCH only requires 3 phase shifted holograms for the precise elimination of bias and the twin image to create a 3D representation of the subject.
- Figure 7 shows 4 different polarization orientations, however the polarizers could be arranged with only three orientations.
- the incoming broadband object light is linearly polarized at an input polarizer and passed through the birefringent lens optics. Then the light is passed through a broadband quarter-wave plate with that has its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens.
- Multiple phase shifted multi-color interference patterns are then simultaneously collected in a single shot, by using a detector with an array of differentially aligned micropolarizers with at least two polarization orientations overlaid on an array of multi-color recording pixels.
- An effective method to accomplish this goal is to fdter the light that has passed the quarter waveplate of the previous embodiment in a sequence of color filters such as dichroic mirrors, and direct the filtered colors of the light to different monochrome image sensors.
- the incoming broadband object light is linearly polarized at an input polarizer and passed through the birefringent lens optics. Then the light is passed through a broadband quarter-wave plate with that has its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens. The light is then passed through a plurality of color filters and directed to a corresponding plurality of monochrome image detectors arranged in any convenient arrangement, including by subdividing a single
- monochrome image sensor into discrete non-overlapping regions. Multiple colors of phase shifted interference patterns are then collected simultaneously, one color on each of the plurality of monochrome image detectors.
- the present inventors having practiced in and in one case having originally invented FINCH, propose the above improvements to the FINCH system generally and in particular to the birefringent lens equipped FINCH system. These proposed improvements improve upon and in many instances simplify the FINCH systems proposed previously. It should be noted, however, that although the embodiments of the present invention are discussed in relation to FINCH, the techniques may be applicable to other self-interference interferometric methods including but not limited to those practiced in other types of holography. Moreover, while embodiments of the present invention are discussed in relation to visible light for simplicity, one skilled in the art will recognize that the teachings herein are applicable to all types of electromagnetic radiation.
- One or more computers may control and/or associated with the imaging device described herein.
- the computer 108 shown in FIG. 1 may run one or more processes to collect recorded interference patterns and generate holograms and/or reconstructed images as described in this application.
- a computer such as 108 includes one or more of the following: one or more processors; one or more memory devices; one or more network interface devices; one or more display interfaces; and one or more user input adapters.
- the computing device may be connected to or includes a display device.
- these elements are hardware devices (for example, electronic circuits or combinations of circuits) that are configured to perform various different functions for the computing device. Whenever it is described in this document that a software module or software process performs any action, the action is in actuality performed by underlying hardware elements according to the instructions that comprise the software module.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Holo Graphy (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962870364P | 2019-07-03 | 2019-07-03 | |
PCT/US2020/040683 WO2021003380A1 (en) | 2019-07-03 | 2020-07-02 | Calibration-free phase shifting procedure for self-interference holography |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3994529A1 true EP3994529A1 (en) | 2022-05-11 |
EP3994529A4 EP3994529A4 (en) | 2024-02-28 |
Family
ID=74101159
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20834451.5A Pending EP3994529A4 (en) | 2019-07-03 | 2020-07-02 | Calibration-free phase shifting procedure for self-interference holography |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP3994529A4 (en) |
WO (1) | WO2021003380A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102630027B1 (en) * | 2021-03-05 | 2024-01-29 | 경북대학교 산학협력단 | Holographic camera system |
KR102560358B1 (en) * | 2021-12-24 | 2023-07-28 | (주)힉스컴퍼니 | Holographic pattern analysis software test method and device of digital holographic microscope |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2047338B1 (en) * | 2006-07-18 | 2018-12-05 | Celloptic, Inc. | Apparatus and method for extracting three-dimensional information of an object from received electromagnetic radiation |
EP3052990A4 (en) * | 2013-10-03 | 2017-05-17 | Celloptic, Inc. | Incoherent fluorescence digital holographic microscopy using transmission liquid crystal lens |
US10289070B2 (en) * | 2014-05-01 | 2019-05-14 | Cell-Optic, Inc. | Holograms using birefringent lenses |
US10591870B2 (en) * | 2014-05-01 | 2020-03-17 | Celloptic, Inc. | Birefringent lens interferometer for use in microscopy and other applications |
-
2020
- 2020-07-02 EP EP20834451.5A patent/EP3994529A4/en active Pending
- 2020-07-02 WO PCT/US2020/040683 patent/WO2021003380A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
WO2021003380A1 (en) | 2021-01-07 |
EP3994529A4 (en) | 2024-02-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Tahara et al. | Roadmap of incoherent digital holography | |
Gao et al. | A review of snapshot multidimensional optical imaging: measuring photon tags in parallel | |
Luo et al. | Synthetic aperture-based on-chip microscopy | |
US10845760B2 (en) | Digital holographic reconstruction device and method using single generation phase shifting method | |
CN105241374B (en) | The common orthogonal carrier frequency digital holographic detection device in road of dual wavelength and detection method | |
US10613478B2 (en) | Imaging method of structured illumination digital holography | |
US10108145B2 (en) | Digital holography device and digital holography play method | |
WO2019044336A1 (en) | Holographic imaging device and data processing method therefor | |
CN107991242B (en) | Method and system for measuring polarization state of sample based on polarization splitting prism | |
CN106054570B (en) | Intensity transmission equation realizes the larger Phase Build Out method of single digital hologram | |
US10006860B2 (en) | Digital holography recording device, digital holography playback device, digital holography recording method, and digital holography playback method | |
US20220163918A1 (en) | Device and method for calibration-free phase shifting procedure for self-interference holography | |
EP3994529A1 (en) | Calibration-free phase shifting procedure for self-interference holography | |
CN109283821B (en) | Phase-shift digital holographic single-exposure imaging device and method based on vortex lens | |
CN114374779B (en) | Full light field imaging camera, imaging method thereof and full light field imaging device | |
CA2006606C (en) | Incoherent light holographic method and device | |
US20210255584A1 (en) | Method and apparatus for generating full-color holographic image | |
Cossairt et al. | Digital refocusing with incoherent holography | |
CN110262206B (en) | Fresnel incoherent digital holographic single exposure imaging method and system | |
Shao et al. | Interferometer‐based structured‐illumination microscopy utilizing complementary phase relationship through constructive and destructive image detection by two cameras | |
Kim et al. | Recent Research on Self-interference Incoherent Digital Holography | |
CN108594617A (en) | The big view field imaging recording method of incoherent digital hologram and device | |
KR101498474B1 (en) | Resolution Improvement Method for Digital Holography via Multi-Step Interpolation | |
Lee et al. | Two step on-axis digital holography using dual-channel Mach-Zehnder interferometer and matched filter algorithm | |
JP2005537518A (en) | High-speed direct digital holography acquisition of objects off-axis illuminated by multiple illumination sources |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20220203 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20240125 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G02B 3/00 20060101ALN20240119BHEP Ipc: G02B 27/28 20060101ALN20240119BHEP Ipc: G03H 1/00 20060101ALI20240119BHEP Ipc: G02B 5/30 20060101ALI20240119BHEP Ipc: G03H 5/00 20060101ALI20240119BHEP Ipc: G03H 1/08 20060101ALI20240119BHEP Ipc: G03H 1/06 20060101ALI20240119BHEP Ipc: G03H 1/04 20060101AFI20240119BHEP |