WO2021206875A1 - Display driver ic (ddic) backplane for scanning microled array - Google Patents
Display driver ic (ddic) backplane for scanning microled array Download PDFInfo
- Publication number
- WO2021206875A1 WO2021206875A1 PCT/US2021/022639 US2021022639W WO2021206875A1 WO 2021206875 A1 WO2021206875 A1 WO 2021206875A1 US 2021022639 W US2021022639 W US 2021022639W WO 2021206875 A1 WO2021206875 A1 WO 2021206875A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixel
- original
- row
- display driver
- display
- Prior art date
Links
- 230000003190 augmentative effect Effects 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 24
- 238000005286 illumination Methods 0.000 claims description 12
- 230000003287 optical effect Effects 0.000 claims description 10
- 230000001902 propagating effect Effects 0.000 claims description 10
- 230000000694 effects Effects 0.000 claims description 6
- 230000001360 synchronised effect Effects 0.000 claims description 2
- 208000013057 hereditary mucoepithelial dysplasia Diseases 0.000 abstract description 2
- 238000012800 visualization Methods 0.000 abstract description 2
- 238000003491 array Methods 0.000 description 11
- 238000005457 optimization Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 238000007493 shaping process Methods 0.000 description 3
- 239000000758 substrate Substances 0.000 description 3
- 101000667816 Homo sapiens Rho-related GTP-binding protein Rho6 Proteins 0.000 description 2
- 102100039643 Rho-related GTP-binding protein Rho6 Human genes 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 108010048295 2-isopropylmalate synthase Proteins 0.000 description 1
- 241000526960 Amaranthus acanthochiton Species 0.000 description 1
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 description 1
- 229910001218 Gallium arsenide Inorganic materials 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000003679 aging effect Effects 0.000 description 1
- 230000000454 anti-cipatory effect Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000000407 epitaxy Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012001 immunoprecipitation mass spectrometry Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0816—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements
- G02B26/0833—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
Definitions
- each physical pixel represents a pixel of the displayed image (i.e., there is a 1:1 mapping).
- Each pixel row is updated sequentially as the image frame data is transferred to the display driver IC (DDIC).
- Pixel data usually needs to be buffered for only one row period prior to pixel update.
- the number of microLEDs required to construct a 2D display directly impacts the size and manufacturing cost of the headset.
- the various embodiments are directed toward the utilization of a tri-linear microdisplay for use within a augmented reality AR headset or in other applications.
- an apparatus in an exemplary embodiment, includes a display driver configured to drive a plurality of display pixels of a tri-linear microdisplay.
- the tri-linear microdisplay defines one or more stripes, wherein each of the one or more stripes has one or more rows of pixels.
- the tri-linear microdisplay is then utilized within a 1D- scanning display system to create high-resolution images in an augmented reality (“AR”) or Head Mounted Display.
- AR augmented reality
- the display driver is further configured to present one or more sub-bands of a particular image on one or more of the stripes of the tri-linear microdisplay. Further, the sub-bands can also be time-shifted.
- the display driver utilizes one or more first in first out (“FIFO”) memory blocks to create the one or more time-shifted sub-bands of the particular image for the one or more stripes.
- FIFO first in first out
- the display driver in various embodiments may operate to cause lines of the particular image to scroll through each of the one or more stripes row by row at a display line rate.
- This task can be performed utilizing a pipeline data update architecture in which data for each of the plurality of pixels in the tri-linear microdisplay propagates from an adjacent pixel in a neighboring row.
- the display driver is configured to achieve a grayscale pixel illumination by shifting the particular image through multiple rows such that the resulting perceived pixel illumination is the sum of the pixel intensities from the corresponding pixels in each row.
- the pixel intensity modulation can be achieved by a distributed pulse width modulation (“PWM”) method wherein each row is driven with fixed gain level and a global row clock, and wherein pixel data is updated by decrementing and propagating to the adjacent row.
- PWM pulse width modulation
- the pixel intensity modulation can be achieved by driving each pixel proportional to a desired intensity value, and pixel data is updated by propagating the same desired intensity value to an adjacent row.
- the pixel intensity modulation can be achieved by driving each pixel with a pulse width proportional to a desired intensity value, and pixel data is updated by propagating a related intensity value to the adjacent row.
- the display driver can be configured to reduce an effect of physical LED non-uniformity by illuminating certain pixels in multiple rows at an appropriate time such that the illumination of each certain pixel sums to create an aggregate brightness of an individual display pixel.
- pixel driver circuits within the display driver can be configured to reduce the effect of lD-scanner motion pixel blur by illuminating each row for less than 100% of an image row display time.
- pixel driver circuits within the display driver comprise a fast switch capable of a high drive current and constructed such that a performance characteristic of the fast switch will not degrade over a useful life of the AR or Head Mounted Display.
- the display driver may include one or more of the following elements:
- the display driver may include an adjustable row clock timer such that the display driver can adjust the timing to compensate for non- linearities of an optical scanner and/or an optical system.
- the display driver may include a pixel illumination circuit and/or a row update circuit that are synchronized to the position of an optical scanner.
- the display driver may be configured to cause the particular image to shift locations across a physical array of pixels to align to an interpupillary distance (“IPD”) of a current user.
- IPD interpupillary distance
- FIG. 1 illustrates an exemplary embodiment of a ID scanning relay system.
- FIG. 2 illustrates a simple cross-section drawing (stack-up of pixel and pixel LED driver circuit).
- FIG. 3 is a block diagram illustrating a striped micro-display (showing input PHY, col/row, stripes, pixels).
- FIG. 4 depicts an exemplary pipelined LED pixel circuit topology (“pipelined topology”) that can optionally be utilized in various embodiments.
- FIG. 5 depicts an embodiment for an improved light guide based AR headset having a combiner with an array of pin-mirrors.
- FIG. 6 depicts a portion of an LED array device with an arrangement of LED pixels as three linear areas or blocks such that a parallel linear array of Red (R) pixels is adjacent to a parallel linear array of Green (G) pixels, that is adjacent to a parallel linear array of Blue (B) pixels.
- R Red
- G Green
- B Blue
- the present invention is directed towards providing a ID scanning micro-display architecture for high-resolution image visualization in compact AR and Head Mounted Displays (“HMDs”).
- HMDs Head Mounted Displays
- FIG. 1 illustrates an exemplary embodiment of a ID scanning relay system.
- the ID scanning relay system receives a visual image from source which is then rendered on a stripped micro display 106.
- a micro display is organized into stripes 106 where each stripe includes one or more rows of pixels. Each stripe is utilized for one distinct color (for example, an RGB color palette).
- the striped micro-display 106 includes a red stripe 108, a green stripe 110 and a blue stripe 112. Each stripe emits a time-shifted sub-band of the image, scrolling row-by-row through image lines, for example, at a line rate, such as 25MHz as a non-limiting example.
- the three color stripe images are relayed by a scanning projection system 104, and combined through persistence of the human visual system (HVS) past location 102, ultimately rendering a flicker free image.
- HVS human visual system
- the various embodiments may operate to limit each row’s emitting time to half the line rate period, or alternatively, add a physical separation (“interstitial row”) between emitter pixel rows and thereby emit for the entire line rate period instead.
- FIG. 2 illustrates a simple cross-section drawing of an exemplary structure for a stack-up of pixels and pixel LED driver circuit that could be utilized in various embodiments.
- An LED pixel array 202 constructed of gallium arsenide LEDs as a non-limiting example, sits on a controller logic circuit 206.
- the controller logic circuit 206 includes pixel drive circuits 210 for controlling the LED pixel array 202.
- the logic circuit 206 integrated with a CMOS backplane 204 and ultimately on package substrate 208.
- Micro-bumps 212 and through-silicone vias (TSVs) 214 can be utilized for achieving better electrical performance and decreasing the form factor.
- TSVs through-silicone vias
- each perceived pixel is illuminated for just a fraction of time (that is frame duration divided by the number of physical pixel rows as a non-limiting example).
- the human visual system perceives brightness as time integrated intensity.
- reduced emit duration can be compensated for by a proportional increase in instantaneous pixel drive current.
- the perceived pixel intensity can be increased by (a) driving the microLED with more electric current, (b) driving the microLED for a longer time period of time, or (c) by adjoining more microLED emitter devices.
- FIG. 4 depicts an exemplary pipelined LED pixel circuit topology (“pipelined topology”) that can optionally be utilized in various embodiments.
- the exemplary pipelined topology illustrated in FIG. 4 includes an LED pixel array 400 of monolithic pixel elements 402, illustrated as a 3x5 array for illustrative purposes as those skilled in the art will appreciate that the array can be of varying sizes.
- the pipelined topology is illustrated as showing edge update and row scrolling PWM propagation.
- pixel data transfer is organized in a “pipelined” manner where data propagates between neighboring pixels, monolithic pixel elements 402, rather than updating the pixel data of every row by a matrix column and row peripheral controller (i.e., column data and row select drivers) .
- a matrix column and row peripheral controller i.e., column data and row select drivers
- fast and smooth row scrolling is achieved while offloading processing from the peripheral row/column driver IC circuitry.
- the distributed nature of circuit organization in various embodiments enables pixel grayscale intensity control and uniformity.
- the perceived brightness (“grayscale”) of any one image pixel is the summation of light emitted by each of the rows that the image is shifted through, where the light emitted is a function of the pixel intensity and duration of each row.
- the total perceived intensity can be decomposed and mapped onto various circuit implementations:
- a) “store-decrement” pixel circuit architecture pixel brightness is binary (on or off, with fixed gain level) and grayscale emerges from a distributed PWM (Pulse Width Modulation). Pixel gain (scale of drive current or voltage) and global row clock periods combine into grayscale PWM intensity (sum of each row “ON” state duration multiplied by row gain).
- pixel brightness is full grayscale: each source pixel emits the corresponding desired grayscale intensity level, and each subsequent row pixel, replicates the same fixed intensity, propagating it, until the last pixel row in the stripe.
- This implementation can achieve a greater maximum brightness than the prior distributed PWM method.
- microLED technology in the various embodiments is advantageous in that the various embodiments can utilize a microLED switch.
- the microLED switch is extremely fast (nanosecond range) and includes a high brightness, high drive current, and good aging properties.
- Each LED pixel circuit element of a stripe behaves as a memory cell and includes a microLED drive transistor, a clocked gate/latch, and optionally some basic processing functionality (comparison, decrement or increment, gain setting, clocked latching).
- FIG. 3 depicts an embodiment of FIFO delay memory blocks (“FIFO+delay”).
- the FIFO delay memory blocks 310 are illustrated as being between a common “color channel separation” block 320 and the corresponding “column driver” blocks for each color channel 330.
- a column driver 404 performs a serial-to-parallel deserialization function and then latches pixel data to be fed into the first monolithic pixel elements in the pixel pipeline.
- FIG. 3 depicts a phased-locked-loop (“PLL”) 322 and a “Scanning controller” 324 which orchestrate and maintain synchronization of the various system clocks with the scan mirror (“scanner sync”).
- the FIFO depth and read-out speed may be variable.
- the line clock may also be further optimized by introducing small variations between rows within a stripe of rows. As such, FIG. 4 depicts the “Clock delay” block 408 that optionally is used to generate the various row clocks for each row of monolithic pixel elements based on the line clock.
- the pixel circuit may include one or more of the following:
- memory i.e. 10 bit digital, analog voltage in capacitor, etc. as non limiting examples
- OTP/EEPROM optional one-time-programmable/electronically-erasable- programmable-read-only-memory
- embodiments may utilize a ripple decrement circuit
- embodiments may utilize a voltage follower amplifier circuit for analog implementations or a digital-to- analog converter (“DAC”) circuit for digital implementations.
- DAC digital-to- analog converter
- FIG. 5 depicts an embodiment for an improved light guide based AR headset 1400 having a combiner 1405 with an array of pin-mirrors 1430.
- FIG. 5 depicts a line scanning AR display system that can be used for left eye or right eye viewing, in which an image source 1440 (e.g., a micro-LED array) initially provides image light 1445 A, via collimation optics 1410A, a scan mirror 1420 that diverts image light 1445B through projection optics 1410B into a lightguide or combiner 1405 having pin-mirrors 1430 arranged on a plurality of pin-mirror sub-arrays 1435, such that image light 1445C is provided to an eye 1460 at an eye box 1450.
- an image source 1440 e.g., a micro-LED array
- a scan mirror 1420 that diverts image light 1445B through projection optics 1410B into a lightguide or combiner 1405 having pin-mirrors 1430 arranged on a plurality
- Optics 1410A can be refraction, diffraction, reflection, or electrical-controlled diffraction based, or combinations thereof.
- the visor or lightguide combiner 1405 can also be shaped and contoured to improve the fit to a viewer’s face.
- the LED array source can be a true ID tri-linear array that provides a line of addressable LED pixels having 1 x 4096 red light emitting pixels, parallel to a similar respective rows of green light and blue light emitting pixels.
- the image source 1540 can be a device that can be described as a 2D micro-LED array or block-width tri-linear micro-LED array. In particular, FIG.
- each block or linear array of pixels can comprise 50 x 8000 pixels.
- the LED emitters in a given line e.g., 50 pixels wide
- ARHS AR headset
- individual light emitting pixels 1542R, 1542G and 1542B can also be square or rectangular in aspect ratio.
- an individual light emitting pixel, whether R, G, or B can have a nominal side dimensions of 2.5-5.0 microns width, although the pixels can be smaller (1.0 microns wide as a non-limiting example) or larger.
- Each block or linear array of pixels, whether R, G, or B, can 8000 pixels long by 50 pixels wide.
- each of the respective color arrays would be 160 microns wide, and 25.6 mm long, to provide an overall linear type device or image source 1540 that is -0.5 mm wide and 25.6 mm long.
- the linear arrays of RGB image pixels 1542A, 1542G and 1542G in FIG. 6 can be provided with other arrangements of the colors, such R, B, G, and the number and size of image pixels need not be identical from one color array to another.
- the LED array can also be equipped with micro-optics, such as a lenslet array (not shown), to help with beam shaping.
- a custom designed micro-lens array aligned and mounted to collect and redirect light from the LED pixels, can have lenslets with customized shapes, or optical designs that are spatially variant across the LED array or by color (R, G, B).
- FIG. 6 depicts the tri-linear LED array (1540) as a straight linear RGB device, the device can also be a white light, or monochrome or single-color device, or be curved (along an arc) or shaped. Curving or shaping the array can better match an eyepiece (combiner 1405) in a way that is more conformal to the human facial structure, and increase apparent light efficiency to a viewer.
- a tri -linear micro-LED array 1540 with LED pixels 1542, whether RGB or other configuration) can be used as an image source 1540 for the improved AR headset 1400 of FIG. 5.
- the emitted image light is shaped by collimation optics (1410A) and directed onto a ID scanning micro-mirror 1420, through projection optics (1410B), and into a combiner 1405 or eyepiece, to then transit the combiner and be directed to the eye box 1450.
- this combiner has multiple sub-arrays (1435) of pin-mirrors 1430. This system can provide high brightness AR images to a viewer simultaneously along with the presence of high brightness ambient light 1465.
- the ID, 2D or customized scanning system could be provided using a variety of mechanisms, devices, materials, or modulation components, including but not limited to, microelectromechanical systems (“MEMS”) devices, solid state displays, spatial light modulators (e.g., back illuminated liquid crystal (LC) devices), modulation crystals, or beam deflectors.
- MEMS microelectromechanical systems
- solid state displays solid state displays
- spatial light modulators e.g., back illuminated liquid crystal (LC) devices
- modulation crystals e.g., LC-based modulation crystals
- beam deflectors e.g., beam deflectors.
- the individual R, G, or B LED pixels 1542 can provide emitted light with 8-10 bits of modulation depth, at a display frequency of 30-120 Hz, depending on the application and specifications. Both the modulation bit depth and display frequency can be increased (e.g., to 12-14 bits, and 144-200 Hz, respectively) depending on the available technologies and the value to the ARHS product.
- This modulated image light 1445A is then directed through optics 1410A to a linear scan mirror 1420, which can be driven by a controller (not shown).
- the scan mirror 1420 can be either a resonant or non-resonant scanner, with its scan operation calibrated by a line scan position monitoring sensor (not shown).
- Scan mirror 1420 can be a MEMs device, for example that is a single mirror with an active mirror 2.5 mm wide and 6 mm long, where the mirror tilts by ⁇ 7-10 degrees about the width direction. Improved or optimized devices with either smaller or larger (e.g., ⁇ 12o) scan angles can also be used.
- the optical scan range (angle) is 2x the mechanical scan range (angle).
- the scan mirror 1420 which can also be designed as a linear array of multiple mirrors, can be provided by vendors such as Preciseley Microtechnology Corp. (Edmonton AB, CA) or Fraunhofer IPMS (Dresden, DE).
- Scan mirror 1420 can also be enabled by other technologies, such as a piezoelectric device (e.g., using PLZT) or a galvanometer.
- a piezoelectric device e.g., using PLZT
- a galvanometer As the scan mirror 1420 tilts, the image light 1445B is swept through the light guide combiner 1405, to reflect light off of pin-mirrors 1430, and direct light 1445C to an eye box 1450.
- Image light 1445A can be provided by the LED pixels 1440, in synchronization with the scan mirror 1420 tilt, such that image light 1445C is directed into the eye box 1450 for an extended duration per sweep.
- the effective operational scanning duty cycle can be high (e.g., -90%).
- a preferred configuration for this system is to provide the image source 1440, associated optics, and scan mirror 1420, at the top, above the eyes, so image light 1445A and 1445B is directed from the forehead downwards into the combiner 1405.
- pin-mirror parameters such as a maximum and minimum size, a pitch or gap between them, and target fill factors can be defined.
- the pitch, size, shape, curvature, tilt, positioning, fill- factors, coatings, and other parameters related the pin-mirrors 1430 and the pin-mirror sub-arrays 1435, including the sub-array pitch 1432, within the combiner 1405 can be optimized.
- pin-mirrors 1430 in which the pin-mirrors have -0.4-1.2 mm widths, and are spaced apart from one another by a spatially variant pitch (1432) in the -2-5 mm range, and combiner 1405 can have a total of 300-1000 pin-mirrors 1430 distributed across one or more imbedded pin-mirror sub-arrays 1435. But depending on the design optimization of the pin-mirror based combiner or eye piece 1405, the number of pin-mirrors can be ⁇ 50, or > 2000, or somewhere in between.
- the optimization of the configurations of the individual pin-mirrors in the various embodiments and the pin-mirror sub-arrays in the various embodiments, relative to pin-mirror design parameters such as number, size, pitch, curvature, and coatings, and system parameters such as the target headset field of view (“FOV”) (e.g., a wide FOV (“WFOV”) > 90o per eye), can be motivated by many factors or performance metrics, including the lack of visible moire, the apparent headset transparency for the ambient light, and the apparent brightness for display expected light.
- Other optimization or performance metrics can include factors that are specific to a given viewer application or to the manufacturability of the pin-mirrors and pin-mirror arrays.
- a pin-mirror optimization method can also be a subset of a larger optimization method that includes the design of the entire combiner, or the entire AR headset, including the design of the imaging optics, housings, and various light trapping or light absorbing features.
- the combiner 1405 used in the improved scanning and light guide based AR headset 1400 which can be straight or curved, can be of the type with multiple planes of parallel sub-arrays of pin-mirrors 1430.
- the combiner can have curvature or shaping to help conform to the shape of a viewer’s face, and curvature can be provided only outside the area used for image display, or it can extend to within the viewed area.
- pin-mirror based combiners that are of the type with a single laterally spread pin-mirror array using a single light guide, or of the type with dual parallel light guides and a curved reflector (970) at the bottom of the eyepiece, opposite the top side image source.
- the ID scanning, pin-mirror based, AR headset 1400 of FIG. 5 also can be advantageously adjusted for variations in interpupillary distance (IPD) amongst viewers.
- the device can be designed so that nominally only 6000 pixels of an available 8000 pixels of an image source array (1440) are used at a given time. But the stripe of used pixels can be selected to shift the images provided by the left eye and right eye scanning displays, to the left or right, so as to adjust for different people’s interpupillary distance.
- This capability can be enabled by a calibration set-up process or with eye tracking.
- each of the verbs, “comprise”, “include” and “have”, and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of members, components, elements, or parts of the subject or subjects of the verb.
- circuitry is used to describe a functional element. Any functional element described as circuitry may include hardware, software, , r firmware or any combination thereof. Hardware may consist of discrete components, integrated circuits, one or more substrates, hybrids, or the like.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
A ID scanning micro-display architecture for high-resolution image visualization in compact AR and Head Mounted Displays ("HMDs"). A display driver is configured to drive a plurality of display pixels of a tri-linear microdisplay, wherein the tri-linear microdisplay defines one or more stripes. Each of the stripes are constructed of one or more rows of pixels, and is used in the lD-scanning display system to create high-resolution images in an augmented reality ("AR") or Head Mounted Display.
Description
DISPLAY DRIVER IC (DDIC) BACKPLANE FOR SCANNING MICROLED ARRAY
BACKGROUND
[0001] Presently, extreme high-resolution and high-brightness micro-displays for Augmented Reality (“AR”) applications are not currently available in the industry. Further, any anticipatory development of such extreme high-resolution and high brightness micro-displays are expected to be large in size and expensive to manufacture. These short-comings are due, among other things, to the difficulty of integrating large, defect-free, monolithic color RGB microLED (light emitting diodes) displays.
[0002] The traditional approaches to microLED displays include a two dimensional (2D) arrangement of RGB micro-led pixels. In this approach, each physical pixel represents a pixel of the displayed image (i.e., there is a 1:1 mapping). Each pixel row is updated sequentially as the image frame data is transferred to the display driver IC (DDIC). Pixel data usually needs to be buffered for only one row period prior to pixel update. For use in a AR application, such as a headset, the number of microLEDs required to construct a 2D display directly impacts the size and manufacturing cost of the headset.
[0003] There is a need on the art for a solution that would allow the benefits of microLEDs in an AR application to be realized, but that would reduce the size and manufacturing cost of the AR application.
SUMMARY
[0004] The various embodiments are directed toward the utilization of a tri-linear microdisplay for use within a augmented reality AR headset or in other applications.
In an exemplary embodiment, an apparatus includes a display driver configured to drive a plurality of display pixels of a tri-linear microdisplay. The tri-linear microdisplay defines one or more stripes, wherein each of the one or more stripes has one or more rows of pixels. The tri-linear microdisplay is then utilized within a 1D- scanning display system to create high-resolution images in an augmented reality (“AR”) or Head Mounted Display.
[0005] In some embodiments, the display driver is further configured to present one or more sub-bands of a particular image on one or more of the stripes of the tri-linear microdisplay. Further, the sub-bands can also be time-shifted. In some embodiments, the display driver utilizes one or more first in first out (“FIFO”) memory blocks to create the one or more time-shifted sub-bands of the particular image for the one or more stripes.
[0006] Even further, the display driver in various embodiments may operate to cause lines of the particular image to scroll through each of the one or more stripes row by row at a display line rate. This task, as a non-limiting example, can be performed utilizing a pipeline data update architecture in which data for each of the plurality of pixels in the tri-linear microdisplay propagates from an adjacent pixel in a neighboring row.
[0007] In some embodiments, the display driver is configured to achieve a grayscale pixel illumination by shifting the particular image through multiple rows such that the resulting perceived pixel illumination is the sum of the pixel intensities from the corresponding pixels in each row. In such embodiments, the pixel intensity modulation can be achieved by a distributed pulse width modulation (“PWM”) method wherein each row is driven with fixed gain level and a global row clock, and wherein pixel data is updated by decrementing and propagating to the adjacent row. Alternatively, in such embodiments, the pixel intensity modulation can be achieved by driving each pixel proportional to a desired intensity value, and pixel data is updated by propagating the same desired intensity value to an adjacent row. Even further, in such embodiments, the pixel intensity modulation can be achieved by driving each pixel with a pulse width proportional to a desired intensity value, and pixel data is updated by propagating a related intensity value to the adjacent row. [0008] In yet other embodiments, the display driver can be configured to reduce an effect of physical LED non-uniformity by illuminating certain pixels in multiple rows at an appropriate time such that the illumination of each certain pixel sums to create an aggregate brightness of an individual display pixel.
[0009] In yet even further embodiments, pixel driver circuits within the display driver can be configured to reduce the effect of lD-scanner motion pixel blur by illuminating each row for less than 100% of an image row display time.
[0010] In yet even further embodiments, pixel driver circuits within the display driver comprise a fast switch capable of a high drive current and constructed such that a
performance characteristic of the fast switch will not degrade over a useful life of the AR or Head Mounted Display.
[0011] In some embodiments, the display driver may include one or more of the following elements:
[0012] (a) a microLED drive transistor,
[0013] (b) a current mirror,
[0014] (c) a digital memory,
[0015] (d) a digital latch,
[0016] (e) a one-time programmable (“OTP”) or electronically erasable programmable read only memory (“EEPROM”),
[0017] (f) a programmable fuse,
[0018] (g) a ripple decrement circuit,
[0019] (h) a voltage follower amplifier,
[0020] (i) a digital-to-analog (“DAC”), and
[0021] (j ) a comparator.
[0022] In the various embodiments, the display driver may include an adjustable row clock timer such that the display driver can adjust the timing to compensate for non- linearities of an optical scanner and/or an optical system.
[0023] In the various embodiments, the display driver may include a pixel illumination circuit and/or a row update circuit that are synchronized to the position of an optical scanner.
[0024] In the various embodiments, the display driver may be configured to cause the particular image to shift locations across a physical array of pixels to align to an interpupillary distance (“IPD”) of a current user.
[0025] These afore-described embodiments, as well as methods of performing the actions are further described in connection with the figures and the detailed description.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
[0026] FIG. 1 illustrates an exemplary embodiment of a ID scanning relay system.
[0027] FIG. 2 illustrates a simple cross-section drawing (stack-up of pixel and pixel LED driver circuit).
[0028] FIG. 3 is a block diagram illustrating a striped micro-display (showing input PHY, col/row, stripes, pixels).
[0029] FIG. 4 depicts an exemplary pipelined LED pixel circuit topology (“pipelined topology”) that can optionally be utilized in various embodiments.
[0030] FIG. 5 depicts an embodiment for an improved light guide based AR headset having a combiner with an array of pin-mirrors.
[0031] FIG. 6 depicts a portion of an LED array device with an arrangement of LED pixels as three linear areas or blocks such that a parallel linear array of Red (R) pixels is adjacent to a parallel linear array of Green (G) pixels, that is adjacent to a parallel linear array of Blue (B) pixels.
DETAILED DESCRIPTION OF THE VARIOUS EMBODIMENTS
[0032] The present invention, as well as features and aspects thereof, is directed towards providing a ID scanning micro-display architecture for high-resolution image visualization in compact AR and Head Mounted Displays (“HMDs”).
[0033] The various embodiments of the present invention presented herein, as well as equivalents thereof, resolve the short-comings in the prior art and advantageously: [0034] (a) facilitate integration of Red/Green/Blue/Other (“RGB+”) native color GaN microLED epitaxy regions (202 “LED pixel arrays” in FIG. 2) onto a monolithic semiconductor substrate (204 “CMOS backplane” in FIG. 2). Each microLED element is driven by a corresponding pixel drive circuit in the CMOS backplane 204 to constitute a 402 “Monolithic pixel element” as best shown in FIG.
4;
[0035] (b) provide a compact form-factor implementation of very high- resolution displays for immersive AR;
[0036] (c) increase manufacturing yield, due to having a smaller die area compared to 2D high-resolution displays where no pixel defects are allowed; and [0037] (d) helps average out non-uniformity of microLED efficiency /brightness because perceived pixel “on” time is distributed physically over multiple microLED rows.
[0038] In the various embodiments, rather than utilizing a full 2D array of RGB pixel emitters (i.e. microLEDs), as found in laptop computer displays, a ID scanning display system is utilized. FIG. 1 illustrates an exemplary embodiment of a ID scanning relay system. In the illustrated embodiment, the ID scanning relay system receives a visual image from source which is then rendered on a stripped micro display 106. The rendered image is then directed towards a relay mirror 104, and then towards a human visual system (HSV) past point 102. In such embodiments, a micro display is organized into stripes 106 where each stripe includes one or more rows of pixels. Each stripe is utilized for one distinct color (for example, an RGB color palette). Thus, the striped micro-display 106 includes a red stripe 108, a green stripe 110 and a blue stripe 112. Each stripe emits a time-shifted sub-band of the image, scrolling row-by-row through image lines, for example, at a line rate, such as 25MHz as a non-limiting example. The three color stripe images are relayed by a scanning projection system 104, and combined through persistence of the human visual system (HVS) past location 102, ultimately rendering a flicker free image. To prevent overlap blurring of perceived pixels, the various embodiments may operate to limit each row’s emitting time to half the line rate period, or alternatively, add a physical separation (“interstitial row”) between emitter pixel rows and thereby emit for the entire line rate period instead.
[0039] FIG. 2 illustrates a simple cross-section drawing of an exemplary structure for a stack-up of pixels and pixel LED driver circuit that could be utilized in various embodiments. An LED pixel array 202, constructed of gallium arsenide LEDs as a non-limiting example, sits on a controller logic circuit 206. The controller logic circuit 206 includes pixel drive circuits 210 for controlling the LED pixel array 202. The logic circuit 206 integrated with a CMOS backplane 204 and ultimately on package substrate 208. Micro-bumps 212 and through-silicone vias (TSVs) 214 can be utilized for achieving better electrical performance and decreasing the form factor. [0040] In a 2D display system, physical pixels typically emit light for the entire duration of the image frame to create the display. However, in the exemplary ID scanning system that can be utilized in the various embodiments, each perceived pixel is illuminated for just a fraction of time (that is frame duration divided by the number of physical pixel rows as a non-limiting example). The human visual system perceives brightness as time integrated intensity. Thus, reduced emit duration can be compensated for by a proportional increase in instantaneous pixel drive current. The
perceived pixel intensity can be increased by (a) driving the microLED with more electric current, (b) driving the microLED for a longer time period of time, or (c) by adjoining more microLED emitter devices.
[0041] Further, embodiments also may employ a novel pipelined LED pixel circuit topology. FIG. 4 depicts an exemplary pipelined LED pixel circuit topology (“pipelined topology”) that can optionally be utilized in various embodiments. The exemplary pipelined topology illustrated in FIG. 4 includes an LED pixel array 400 of monolithic pixel elements 402, illustrated as a 3x5 array for illustrative purposes as those skilled in the art will appreciate that the array can be of varying sizes. The pipelined topology is illustrated as showing edge update and row scrolling PWM propagation. In the pipelined topology, pixel data transfer is organized in a “pipelined” manner where data propagates between neighboring pixels, monolithic pixel elements 402, rather than updating the pixel data of every row by a matrix column and row peripheral controller (i.e., column data and row select drivers) . Advantageously, fast and smooth row scrolling is achieved while offloading processing from the peripheral row/column driver IC circuitry.
[0042] The distributed nature of circuit organization in various embodiments enables pixel grayscale intensity control and uniformity. The perceived brightness (“grayscale”) of any one image pixel is the summation of light emitted by each of the rows that the image is shifted through, where the light emitted is a function of the pixel intensity and duration of each row. The total perceived intensity can be decomposed and mapped onto various circuit implementations:
[0043] a) “store-decrement” pixel circuit architecture: pixel brightness is binary (on or off, with fixed gain level) and grayscale emerges from a distributed PWM (Pulse Width Modulation). Pixel gain (scale of drive current or voltage) and global row clock periods combine into grayscale PWM intensity (sum of each row “ON” state duration multiplied by row gain).
[0044] b) “store-replicate” pixel circuit architecture: pixel brightness is full grayscale: each source pixel emits the corresponding desired grayscale intensity level, and each subsequent row pixel, replicates the same fixed intensity, propagating it, until the last pixel row in the stripe. This implementation can achieve a greater maximum brightness than the prior distributed PWM method.
[0045] The use of microLED technology in the various embodiments is advantageous in that the various embodiments can utilize a microLED switch. The microLED
switch is extremely fast (nanosecond range) and includes a high brightness, high drive current, and good aging properties.
[0046] The various embodiments may achieve one or more of the various advantages described herein by utilizing one or more of the below-described architectural elements:
[0047] (a) Monochrome pixel rows (i.e. 50 rows as a non-limiting example) are utilized, one for each color (i.e. RGB, W, IR, ...). The image to display is “scrolled” over physical stripes at the line rate (about row clock).
[0048] (b) Each LED pixel circuit element of a stripe behaves as a memory cell and includes a microLED drive transistor, a clocked gate/latch, and optionally some basic processing functionality (comparison, decrement or increment, gain setting, clocked latching).
[0049] (c) First-In-First-Out (“FIFO”) memory for temporal delay (time- shifting) to adjust for spatial separation of R/G/B color stripes for standard RGB pixel data image sources. It should be appreciated that depending upon the graphics processing unit (“GPU”) rendering capabilities and implementation, the use of FIFO may be optional. Nevertheless, embodiments may keep a minimum FIFO depth for each color channel to allow for small timing adjustments throughout a full image cycle. FIG. 3 depicts an embodiment of FIFO delay memory blocks (“FIFO+delay”). The FIFO delay memory blocks 310, are illustrated as being between a common “color channel separation” block 320 and the corresponding “column driver” blocks for each color channel 330. As shown in FIG. 4, a column driver 404 performs a serial-to-parallel deserialization function and then latches pixel data to be fed into the first monolithic pixel elements in the pixel pipeline.
[0050] In some embodiments, some refinements may be utilized to compensate for the image stretching and compression throughout a full image frame cycle that are due to the acceleration and deceleration of the scanning relay projection system. The line clock (406 in FIG. 4) is at first approximation the global row clock, but may need a small percentage speed-up or slow-down throughout a full image cycle. FIG. 3 depicts a phased-locked-loop (“PLL”) 322 and a “Scanning controller” 324 which orchestrate and maintain synchronization of the various system clocks with the scan mirror (“scanner sync”). In some implementations, the FIFO depth and read-out speed may be variable. The line clock may also be further optimized by introducing small variations between rows within a stripe of rows. As such, FIG. 4 depicts the “Clock
delay” block 408 that optionally is used to generate the various row clocks for each row of monolithic pixel elements based on the line clock.
[0051] In various embodiments, the pixel circuit may include one or more of the following:
[0052] (a) microLED drive transistor;
[0053] (b) current mirror, a few selectable ranges;
[0054] (c) memory (i.e. 10 bit digital, analog voltage in capacitor, etc. as non limiting examples);
[0055] (d) clocked gate/latch;
[0056] (e) optional one-time-programmable/electronically-erasable- programmable-read-only-memory (“OTP/EEPROM”) bit/fuse to skip defective pixels;
[0057] (f) for “store-decrement” pixel circuit architecture, embodiments may utilize a ripple decrement circuit; and
[0058] (g) for “store-replicate” pixel circuit architecture, embodiments may utilize a voltage follower amplifier circuit for analog implementations or a digital-to- analog converter (“DAC”) circuit for digital implementations.
[0059] FIG. 5 depicts an embodiment for an improved light guide based AR headset 1400 having a combiner 1405 with an array of pin-mirrors 1430. In particular, FIG. 5 depicts a line scanning AR display system that can be used for left eye or right eye viewing, in which an image source 1440 (e.g., a micro-LED array) initially provides image light 1445 A, via collimation optics 1410A, a scan mirror 1420 that diverts image light 1445B through projection optics 1410B into a lightguide or combiner 1405 having pin-mirrors 1430 arranged on a plurality of pin-mirror sub-arrays 1435, such that image light 1445C is provided to an eye 1460 at an eye box 1450. Optics 1410A can be refraction, diffraction, reflection, or electrical-controlled diffraction based, or combinations thereof. The visor or lightguide combiner 1405 can also be shaped and contoured to improve the fit to a viewer’s face.
[0060] It is noted that at present, it can be difficult to fabricate and source small, bright 2D micro-LED arrays 1440 with tightly packed addressable RGB image pixels. As an alternative, a tri-linear RGB LED array light source can be used (see element 1540 in FIG. 6). For example, the LED array source can be a true ID tri-linear array that provides a line of addressable LED pixels having 1 x 4096 red light emitting pixels, parallel to a similar respective rows of green light and blue light emitting
pixels. Alternately, as shown in FIG. 6, the image source 1540 can be a device that can be described as a 2D micro-LED array or block-width tri-linear micro-LED array. In particular, FIG. 6 depicts a portion of an LED array device with an arrangement of LED pixels as three linear areas or blocks such that a parallel linear array of Red (R) pixels 1542R is adjacent to a parallel linear array of Green (G) pixels 1542G, that is adjacent to a parallel linear array of Blue (B) pixels 1542B. For example, each block or linear array of pixels, whether R, G, or B, can comprise 50 x 8000 pixels. The LED emitters in a given line (e.g., 50 pixels wide) are individually addressed and controlled, and at any point in time, during scanning and image display, they can be providing an intensity of image light for different details of the displayed AR image content. This second approach, with a block-width tri-linear micro-LED array, enables embodiments of an AR headset (“ARHS”) to provide a brighter image.
[0061] Within a linear micro-LED array light source 1540, individual light emitting pixels 1542R, 1542G and 1542B (collectively referred to as 1542) can also be square or rectangular in aspect ratio. As an example, an individual light emitting pixel, whether R, G, or B can have a nominal side dimensions of 2.5-5.0 microns width, although the pixels can be smaller (1.0 microns wide as a non-limiting example) or larger. Each block or linear array of pixels, whether R, G, or B, can 8000 pixels long by 50 pixels wide. Thus, for example, with 3.2 micron square pixels, each of the respective color arrays would be 160 microns wide, and 25.6 mm long, to provide an overall linear type device or image source 1540 that is -0.5 mm wide and 25.6 mm long. The linear arrays of RGB image pixels 1542A, 1542G and 1542G in FIG. 6 can be provided with other arrangements of the colors, such R, B, G, and the number and size of image pixels need not be identical from one color array to another. The LED array can also be equipped with micro-optics, such as a lenslet array (not shown), to help with beam shaping. For example, a custom designed micro-lens array, aligned and mounted to collect and redirect light from the LED pixels, can have lenslets with customized shapes, or optical designs that are spatially variant across the LED array or by color (R, G, B). Although FIG. 6 depicts the tri-linear LED array (1540) as a straight linear RGB device, the device can also be a white light, or monochrome or single-color device, or be curved (along an arc) or shaped. Curving or shaping the array can better match an eyepiece (combiner 1405) in a way that is more conformal to the human facial structure, and increase apparent light efficiency to a viewer.
[0062] In either case, a tri -linear micro-LED array 1540 with LED pixels 1542, whether RGB or other configuration) can be used as an image source 1540 for the improved AR headset 1400 of FIG. 5. The emitted image light is shaped by collimation optics (1410A) and directed onto a ID scanning micro-mirror 1420, through projection optics (1410B), and into a combiner 1405 or eyepiece, to then transit the combiner and be directed to the eye box 1450. As shown, this combiner has multiple sub-arrays (1435) of pin-mirrors 1430. This system can provide high brightness AR images to a viewer simultaneously along with the presence of high brightness ambient light 1465. The ID, 2D or customized scanning system could be provided using a variety of mechanisms, devices, materials, or modulation components, including but not limited to, microelectromechanical systems (“MEMS”) devices, solid state displays, spatial light modulators (e.g., back illuminated liquid crystal (LC) devices), modulation crystals, or beam deflectors.
[0063] Operationally, the individual R, G, or B LED pixels 1542 can provide emitted light with 8-10 bits of modulation depth, at a display frequency of 30-120 Hz, depending on the application and specifications. Both the modulation bit depth and display frequency can be increased (e.g., to 12-14 bits, and 144-200 Hz, respectively) depending on the available technologies and the value to the ARHS product. This modulated image light 1445A is then directed through optics 1410A to a linear scan mirror 1420, which can be driven by a controller (not shown). The scan mirror 1420 can be either a resonant or non-resonant scanner, with its scan operation calibrated by a line scan position monitoring sensor (not shown). FIG. 5 depicts two tilt positions for this scan mirror, with opposite tilts. Scan mirror 1420 can be a MEMs device, for example that is a single mirror with an active mirror 2.5 mm wide and 6 mm long, where the mirror tilts by ± 7-10 degrees about the width direction. Improved or optimized devices with either smaller or larger (e.g., ±12o) scan angles can also be used. The optical scan range (angle) is 2x the mechanical scan range (angle). The scan mirror 1420, which can also be designed as a linear array of multiple mirrors, can be provided by vendors such as Preciseley Microtechnology Corp. (Edmonton AB, CA) or Fraunhofer IPMS (Dresden, DE). Scan mirror 1420 can also be enabled by other technologies, such as a piezoelectric device (e.g., using PLZT) or a galvanometer. As the scan mirror 1420 tilts, the image light 1445B is swept through the light guide combiner 1405, to reflect light off of pin-mirrors 1430, and direct light 1445C to an eye box 1450. Image light 1445A can be provided by the LED pixels
1440, in synchronization with the scan mirror 1420 tilt, such that image light 1445C is directed into the eye box 1450 for an extended duration per sweep. As image content can be provided for both directions of scan mirror tilting, the effective operational scanning duty cycle can be high (e.g., -90%).
[0064] A preferred configuration for this system is to provide the image source 1440, associated optics, and scan mirror 1420, at the top, above the eyes, so image light 1445A and 1445B is directed from the forehead downwards into the combiner 1405. As previously described, a variety of pin-mirror parameters, such as a maximum and minimum size, a pitch or gap between them, and target fill factors can be defined. Then, during optimization, the pitch, size, shape, curvature, tilt, positioning, fill- factors, coatings, and other parameters related the pin-mirrors 1430 and the pin-mirror sub-arrays 1435, including the sub-array pitch 1432, within the combiner 1405 can be optimized. As an example, the ID scanning AR display system 1400 of FIG. 5 can use an array of pin-mirrors 1430 in which the pin-mirrors have -0.4-1.2 mm widths, and are spaced apart from one another by a spatially variant pitch (1432) in the -2-5 mm range, and combiner 1405 can have a total of 300-1000 pin-mirrors 1430 distributed across one or more imbedded pin-mirror sub-arrays 1435. But depending on the design optimization of the pin-mirror based combiner or eye piece 1405, the number of pin-mirrors can be < 50, or > 2000, or somewhere in between. The optimization of the configurations of the individual pin-mirrors in the various embodiments and the pin-mirror sub-arrays in the various embodiments, relative to pin-mirror design parameters such as number, size, pitch, curvature, and coatings, and system parameters such as the target headset field of view (“FOV”) (e.g., a wide FOV (“WFOV”) > 90o per eye), can be motivated by many factors or performance metrics, including the lack of visible moire, the apparent headset transparency for the ambient light, and the apparent brightness for display expected light. Other optimization or performance metrics can include factors that are specific to a given viewer application or to the manufacturability of the pin-mirrors and pin-mirror arrays. A pin-mirror optimization method can also be a subset of a larger optimization method that includes the design of the entire combiner, or the entire AR headset, including the design of the imaging optics, housings, and various light trapping or light absorbing features.
[0065] As shown in FIG. 5, the combiner 1405 used in the improved scanning and light guide based AR headset 1400, which can be straight or curved, can be of the
type with multiple planes of parallel sub-arrays of pin-mirrors 1430. The combiner can have curvature or shaping to help conform to the shape of a viewer’s face, and curvature can be provided only outside the area used for image display, or it can extend to within the viewed area. The AR headset 1400 of FIG. 5 can also be provided with pin-mirror based combiners that are of the type with a single laterally spread pin-mirror array using a single light guide, or of the type with dual parallel light guides and a curved reflector (970) at the bottom of the eyepiece, opposite the top side image source.
[0066] The ID scanning, pin-mirror based, AR headset 1400 of FIG. 5 also can be advantageously adjusted for variations in interpupillary distance (IPD) amongst viewers. As an example, the device can be designed so that nominally only 6000 pixels of an available 8000 pixels of an image source array (1440) are used at a given time. But the stripe of used pixels can be selected to shift the images provided by the left eye and right eye scanning displays, to the left or right, so as to adjust for different people’s interpupillary distance. This capability can be enabled by a calibration set-up process or with eye tracking.
[0067] In the forgoing description and claims of the present application, each of the verbs, “comprise”, “include” and “have”, and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of members, components, elements, or parts of the subject or subjects of the verb.
[0068] In this application the word circuitry is used to describe a functional element. Any functional element described as circuitry may include hardware, software, , r firmware or any combination thereof. Hardware may consist of discrete components, integrated circuits, one or more substrates, hybrids, or the like.
[0069] The present invention has been described using detailed descriptions of embodiments thereof that are provided by way of example and are not intended to limit the scope of the invention. The described embodiments comprise different features, not all of which are required in all embodiments of the invention. Some embodiments of the present invention utilize only some of the features or possible combinations of the features. Variations of embodiments of the present invention that are described and embodiments of the present invention comprising different combinations of features noted in the described embodiments will occur to persons of the art.
[0070] It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described herein above. Rather the scope of the invention is defined by the claims that follow..
Claims
Claim 1. (original) An apparatus comprising: a display driver configured to drive a plurality of display pixels of a tri-linear microdisplay, wherein the tri-linear microdisplay defines one or more stripes, wherein each of the one or more stripes comprises one or more rows of pixels, and is used in a lD-scanning display system to create high-resolution images in an augmented reality (“AR”) or Head Mounted Display.
Claim 2. (original) The apparatus of claim 1, wherein the display driver is further configured to present one or more sub-bands of a particular image on one or more of the stripes of the tri-linear microdisplay.
Claim 3. (original) The apparatus of claim 2, wherein one or more of the sub-bands are time-shifted.
Claim 4. (original) The apparatus of claim 2, wherein the display driver is further configured to cause lines of the particular image to scroll through each of the one or more stripes row by row at a display line rate.
Claim 5. (original) The apparatus of claim 4, wherein the display driver is further configured to utilize a pipeline data update architecture in which data for each of the plurality of pixels in the tri-linear microdisplay propagates from an adjacent pixel in a neighboring row.
Claim 6. (original) The apparatus of claim 2, wherein the display driver utilizes one or more first in first out (“FIFO”) memory blocks to create the one or more time-shifted sub-bands of the particular image for the one or more stripes.
Claim 7. (original) The apparatus of claim 1, wherein the display driver is configured to achieve a grayscale pixel illumination by shifting the particular image through multiple rows such that the resulting perceived pixel illumination is the sum of the pixel intensities from the corresponding pixels in each row.
Claim 8. (original) The apparatus of claim 7, wherein a pixel intensity modulation is achieved by a distributed pulse width modulation (“PWM”) method wherein each row is driven with fixed gain level and a row clock, and wherein pixel data is updated by decrementing and propagating to the adjacent row.
Claim 9. (original) The apparatus of claim 7, wherein a pixel intensity modulation is achieved by driving each pixel proportional to a desired intensity value, and pixel data is updated by propagating the same desired intensity value to an adjacent row.
Claim 10. (original) The apparatus of claim 7, wherein a pixel intensity modulation is achieved by driving each pixel with a pulse width proportional to a desired intensity value, and pixel data is updated by propagating a related intensity value to the adjacent row.
Claim 11. (original) The apparatus of claim 1, wherein the display driver is further configured to reduce an effect of physical LED non-uniformity by illuminating certain pixels in multiple rows at an appropriate time such that the illumination of each certain pixel sums to create an aggregate brightness of an individual display pixel.
Claim 12. (original) The apparatus of claim 1, in which pixel driver circuits within the display driver are configured to reduce the effect of lD-scanner motion pixel blur by illuminating each row for less than 100% of an image row display time.
Claim 13. (original) The apparatus of claim 1, in which pixel driver circuits within the display driver comprise a fast switch capable of a high drive current and constructed such that a performance characteristic of the fast switch will not degrade over a useful life of the AR or Head Mounted Display.
Claim 14. (original) The apparatus of claim 1, wherein the display driver comprises one or more of:
(a) a microLED drive transistor,
(b) a current mirror,
(c) a digital memory,
(d) a digital latch,
(e) a one-time programmable (“OTP”) or electronically erasable programmable read only memory (“EEPROM”),
(f) a programmable fuse,
(g) a ripple decrement circuit,
(h) a voltage follower amplifier,
(i) a digital-to-analog (“DAC”), and
(j) a comparator.
Claim 15. (original) The apparatus of claim 1, wherein the display driver comprises an adjustable row clock timer such that the display driver can adjust the timing to compensate for non-linearities of an optical scanner and/or an optical system.
Claim 16. (original) The apparatus of claim 1, wherein the display driver further comprises a pixel illumination circuit and/or a row update circuit that are synchronized to the position of an optical scanner.
Claim 17. (original) The apparatus of claim 1, wherein the display driver is further configured to cause the particular image to shift locations across a physical array of pixels to align to an interpupillary distance (“IPD”) of a current user.
Claim 18. (original) A method to create high-resolution images in an augmented reality (“AR”) or Head Mounted Display, the method comprising: employing a display driver configured to drive a plurality of display pixels of a tri-linear microdisplay, wherein the tri-linear microdisplay defines one or more stripes, and wherein each of the one or more stripes comprises one or more rows of pixels and is used in a lD-scanning display system.
Claim 19. (original) The method of claim 18, further comprising configuring the display driver to present one or more time-shifted sub-bands of a particular image on one or more of stripes of the tri-linear microdisplay.
Claim 20. The method of claim 19, further comprising utilizing a first in first out (“FIFO”) memory block in the display driver to create the one or more time-shifted sub-bands of the particular image for the one or more stripes.
Claim 21. (original) The method of claim 19, further comprising configuring the display driver to cause lines of the particular image to scroll through each of the one or more stripes row by row at a display line rate.
Claim 22. (original) The method of claim 21, further comprising configuring the display driver to utilize a pipeline data update architecture in which data for each of the plurality of pixels in the tri-linear microdisplay propagates from an adjacent pixel in a neighboring row.
Claim 23. (original) The method of claim 18, further comprising configuring the display driver to a achieve a grayscale pixel illumination by shifting the particular image through multiple rows such that the resulting perceived pixel illumination is the sum of the pixel intensities from the corresponding pixels in each row.
Claim 24. (original) The method of claim 23, further comprising achieving a pixel intensity modulation by a distributed pulse width modulation (“PWM”) devcice driving each row with a fixed gain level and a row clock, and updating pixel data by decrementing and propagating to the adjacent row.
Claim 25. (original) The method of claim 23, further comprising achieving a pixel intensity modulation by driving each pixel proportional to a desired intensity value, and updating pixel data by propagating the same desired intensity value to an adjacent row.
Claim 26. (original) The method of claim 23, further comprising achieving a pixel intensity modulation by driving each pixel with a pulse width proportional to a desired intensity value, and updating pixel data by propagating a related intensity value to the adjacent row.
Claim 27. (original) The method of claim 18, further comprising configuring the display driver to reduce an effect of physical LED non-uniformity by illuminating certain pixels in multiple rows at an appropriate time such that the illumination of each certain pixel sums to create an aggregate brightness of an individual display pixel.
Claim 28. (original) The method of claim 18, further comprising reducing the effect of lD-scanner motion pixel blur by illuminating each row for less than 100% of an image row display time.
Claim 29. (original) The method of claim 18, further comprising a fast switch within the display driver, wherein the fast switch is capable of a high drive current and constructed such that a performance characteristics of the fast switch will not degrade over a useful life of the AR or head mounted display.
Claim 30. (original) The method of claim 18, further comprising configuring the display driver to comprise one or more of:
(a) a microLED drive transistor,
(b) a current mirror,
(c) a digital memory,
(d) a digital latch,
(e) a one-time programmable (“OTP”) or electronically erasable programmable read only memory (“EEPROM”),
(f) a programmable fuse,
(g) a ripple decrement circuit,
(h) a voltage follower amplifier,
(i) a digital-to-analog (“DAC”), and
(j) a comparator.
Claim 31. (original) The method of claim 18, further comprising employing a row clock timer within the display driver and utilizing the row clock timer to adjust the timing to compensate for non-linearities of an optical scanner and/or an optical system.
Claim 32. (original) The method of claim 18, further comprising employing a pixel illumination circuit and/or a row update circuit within the display driver and synchronizing with a position of a mirror scanner.
Claim 33. (original) The method of claim 18, further comprising configuring the display driver to cause the particular image to shift locations across a physical array of pixels to align to an interpupillary distance (“IPD”) of a current user.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202180029589.6A CN115552315A (en) | 2020-03-16 | 2021-03-16 | Display Driver IC (DDIC) backplane for scanning micro LED arrays |
EP21785691.3A EP4124209A1 (en) | 2020-03-16 | 2021-03-16 | Display driver ic (ddic) backplane for scanning microled array |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202062990401P | 2020-03-16 | 2020-03-16 | |
US62/990,401 | 2020-03-16 | ||
US17/117,057 US11514828B1 (en) | 2018-12-10 | 2020-12-09 | AR headset with an improved display |
US17/117,057 | 2020-12-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021206875A1 true WO2021206875A1 (en) | 2021-10-14 |
Family
ID=78023852
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2021/022639 WO2021206875A1 (en) | 2020-03-16 | 2021-03-16 | Display driver ic (ddic) backplane for scanning microled array |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP4124209A1 (en) |
CN (1) | CN115552315A (en) |
WO (1) | WO2021206875A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102021209454A1 (en) | 2021-08-27 | 2023-03-02 | Osram Gmbh | Method for controlling a laser diode and a digital micromirror device of an imaging unit in a holographic head-up display |
DE102021214545B3 (en) | 2021-12-16 | 2023-03-02 | Gixel GmbH | Screen unit and goggle display system for displaying a virtual image with improved efficiency |
DE102021006654B3 (en) | 2021-12-16 | 2023-05-04 | Gixel GmbH | Screen unit and goggle display system for displaying a virtual image with improved efficiency |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4934773A (en) * | 1987-07-27 | 1990-06-19 | Reflection Technology, Inc. | Miniature video display system |
US5612708A (en) * | 1994-06-17 | 1997-03-18 | Hughes Electronics | Color helmet mountable display |
US20030151574A1 (en) * | 2002-02-12 | 2003-08-14 | Pin Chang | Pixel signal line module of liquid crystal display |
US20110181707A1 (en) * | 2009-11-13 | 2011-07-28 | Herrmann Frederick P | Method for driving 3d binocular eyewear from standard video stream |
GB2498179A (en) * | 2011-12-23 | 2013-07-10 | Prp Optoelectronics Ltd | Projection display system |
-
2021
- 2021-03-16 WO PCT/US2021/022639 patent/WO2021206875A1/en unknown
- 2021-03-16 CN CN202180029589.6A patent/CN115552315A/en active Pending
- 2021-03-16 EP EP21785691.3A patent/EP4124209A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4934773A (en) * | 1987-07-27 | 1990-06-19 | Reflection Technology, Inc. | Miniature video display system |
US5612708A (en) * | 1994-06-17 | 1997-03-18 | Hughes Electronics | Color helmet mountable display |
US20030151574A1 (en) * | 2002-02-12 | 2003-08-14 | Pin Chang | Pixel signal line module of liquid crystal display |
US20110181707A1 (en) * | 2009-11-13 | 2011-07-28 | Herrmann Frederick P | Method for driving 3d binocular eyewear from standard video stream |
GB2498179A (en) * | 2011-12-23 | 2013-07-10 | Prp Optoelectronics Ltd | Projection display system |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102021209454A1 (en) | 2021-08-27 | 2023-03-02 | Osram Gmbh | Method for controlling a laser diode and a digital micromirror device of an imaging unit in a holographic head-up display |
DE102021214545B3 (en) | 2021-12-16 | 2023-03-02 | Gixel GmbH | Screen unit and goggle display system for displaying a virtual image with improved efficiency |
DE102021006654B3 (en) | 2021-12-16 | 2023-05-04 | Gixel GmbH | Screen unit and goggle display system for displaying a virtual image with improved efficiency |
WO2023110168A1 (en) | 2021-12-16 | 2023-06-22 | Gixel GmbH | Head-mounted display system for displaying a virtual image with improved efficiency |
Also Published As
Publication number | Publication date |
---|---|
CN115552315A (en) | 2022-12-30 |
EP4124209A1 (en) | 2023-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11727858B2 (en) | Display driver IC (DDIC) backplane for scanning microLED array | |
WO2021206875A1 (en) | Display driver ic (ddic) backplane for scanning microled array | |
CN106444137B (en) | A kind of display panel, Liquid Crystal Display And Method For Driving | |
US8976080B2 (en) | Multi-segment imager | |
US8064125B2 (en) | Color sequential illumination for spatial light modulator | |
US20120212707A1 (en) | Multi-Segment Imager | |
TWI778098B (en) | Light emitter architecture for scanning display device | |
US20080158641A1 (en) | Backlight unit and an imaging system using the same | |
US7869115B2 (en) | Display apparatus using pulsed light source | |
WO1999064912A1 (en) | Light source and display device | |
US20100053046A1 (en) | Backlight device and image display apparatus using the same | |
CN109389947B (en) | Display device | |
US9520071B1 (en) | Display system and motion simulator typically using light-emitting diodes | |
US11798471B2 (en) | Control scheme for a scanning display | |
JP2007122058A (en) | Lcd display using light-emitting body having variable light output | |
US10986707B2 (en) | Display device | |
WO2010062797A1 (en) | Display unit comprising an lcd panel backlit by a color projector | |
US20090189845A1 (en) | Image display device and electronic apparatus | |
US20220397798A1 (en) | Display device, display control method and display control device | |
US7982842B2 (en) | Interconnect structure for display device and projection display apparatus | |
US8994638B2 (en) | Backlight scanning method and liquid crystal display | |
JP2003005286A (en) | Light source device and display device | |
JP2003057746A (en) | Light source device and display device | |
CN114035339A (en) | Backlight module, display module, driving method and display device | |
WO2004111985A1 (en) | Lcd display panel including segmented illumination scheme by scrolling illumination of the corresponding panel segments |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21785691 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021785691 Country of ref document: EP Effective date: 20221017 |