WO2021182265A1

WO2021182265A1 - Display device

Info

Publication number: WO2021182265A1
Application number: PCT/JP2021/008300
Authority: WO
Inventors: 紀晃高橋; 優斗小林; 孝明鈴木
Original assignee: ソニーグループ株式会社
Priority date: 2020-03-11
Filing date: 2021-03-03
Publication date: 2021-09-16

Abstract

A display device (1) displays a three-dimensional image to a user. The display device (1) is provided with a first display unit (110) and a second display unit (120). The first display unit (110) has sub-pixels of a predetermined color. The second display unit (120) has sub-pixels of a predetermined color and is disposed such that at least a part of the display region thereof overlaps a display region of the first display unit (110) in the direction of a user's line of sight. The predetermined color of the sub-pixels of the first display unit (110), or the predetermined color of the sub-pixels of the second display unit (120) is a composite color obtained by composing at least two of red (R), green (G), and blue (B) components.

Description

Display device

This disclosure relates to a display device.

There are a lenticular lens method, a paralux barrier method, a multilayer method, and the like as a display method of a three-dimensional image that reproduces a space by a 3D display, a light field display, or the like.

In a three-dimensional display device that employs these methods, a device for displaying a three-dimensional image, such as a lenticular lens, a paralux barrier, or another image display panel, is superimposed on the image display panel to utilize binocular disparity. Then, the three-dimensional image is visually recognized.

For example, in a three-dimensional display device, a striped lens or a barrier is superimposed on an image display panel to display an image that is visually recognized only by the right eye and an image that is visually recognized only by the left eye, and a three-dimensional image is displayed by the binocular disparity effect. Make it visible.

JP-A-2009-276410

However, in the three-dimensional display device, since the device for displaying the three-dimensional image is superimposed on the image display panel, there arises a problem that the brightness of the entire three-dimensional display device is lowered.

Therefore, the present disclosure provides a display device that displays a three-dimensional image and can suppress a decrease in brightness.

According to the present disclosure, a display device is provided. The display device displays a three-dimensional image to the user. The display device includes a first display unit and a second display unit. The first display unit has sub-pixels of a predetermined color. The second display unit has at least a part of the display area overlapped with the display area of the first display unit in the line-of-sight direction of the user, and has sub-pixels of a predetermined color. The predetermined color of the sub-pixel of the first display unit or the predetermined color of the sub-pixel of the second display unit is among the R (red), G (green), and B (blue) components. It is a synthetic color obtained by synthesizing at least two components of.

It is a figure for demonstrating the display principle of a display device. It is a figure for demonstrating the display principle of a display device. It is a figure for demonstrating the display principle of a color image by a display device. It is a block diagram which shows the configuration example of a display device. It is a figure for demonstrating the outline of the display device which concerns on embodiment of this disclosure. It is a block diagram which shows the structural example of the display device which concerns on embodiment of this disclosure. It is a flowchart which shows an example of the display processing by the display device which concerns on embodiment of this disclosure. It is a figure for demonstrating the display device which concerns on a comparative example.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

The explanations will be given in the following order.
1. 1. Background 1.1. Outline of light field display 2. Overview of display device 3. Display device configuration example 4. Display processing 5. Effect 6. Other embodiments 7. supplement

<< 1. Background >>
<1.1. Overview of Lightfield Display>
A light field display is a display that reproduces light rays emitted by a three-dimensional object, and is a display device that allows a user to visually recognize a three-dimensional image with the naked eye without using special glasses. For example, a visible three-dimensional object emits light rays in various directions. Light rays mean light that reflects sunlight, lighting, and the like. Humans and others recognize an object three-dimensionally by capturing the light rays emitted by the three-dimensional object. The light field display enables stereoscopic viewing of a three-dimensional object by simulating the light rays emitted by the three-dimensional object.

As a method for reproducing light rays by a light field display, for example, there are a lenticular lens method, a parallax barrier method, a multilayer method, and the like as a display method for a three-dimensional image. In the present embodiment, a multilayer light field display will be described as a display device. Hereinafter, for the sake of brevity, the number of display panels included in the light field display will be described as two, but the number of display panels included in the light field display is not limited to two, and may be three or more. May be good.

(Multi-layer display principle)
First, the display principle of the multilayer light field display will be described with reference to FIGS. 1 and 2. 1 and 2 are diagrams for explaining the display principle of the display device 1A.

As shown in FIG. 1, the display device 1A includes a first display panel 110A, a second display panel 120A, and a backlight 130A.

The first display panel 110A and the second display panel 120A are, for example, liquid crystal panels having a plurality of pixels (pixels), and generate an image by photomodulating the light of the backlight 130A.

The backlight 130A is a light source of the display device 1A. The light emitted from the backlight 130A passes through the first display panel 110A and the second display panel 120A, and is emitted from the display device 1A.

Here, the display device 1A is a multilayer type (laminated type) light field display, and the first display panel 110A and the second display panel 120A are arranged in a laminated manner. That is, the first display panel 110A and the second display panel 120A are arranged so that at least a part of the display area overlaps in the line-of-sight direction of the user. In the example of FIG. 1, the second display panel 120A is arranged on the user side with respect to the first display panel 110A. Hereinafter, the first display panel 110A will be referred to as layer H, and the second display panel 120A will be referred to as layer U.

In the display device 1A shown in FIG. 1, a first display panel 110A and a second display panel 120A are laminated. Therefore, for example, light LF' _a having passed through the pixels 111A _a first display panel 110A includes a to users through the pixels 121A _a second display panel 120A, to view the display device 1A from the viewpoint 1 To reach.

Similarly, light rays LF' _b having passed through the pixels 111A _b of the first display panel 110A is reach the user through the pixels 121A _b of the second display panel 120A, to view the display device 1A from the viewpoint 2 do. Also, light rays LF' _c passing through the pixels 111A _c of the first display panel 110A passes through the pixels 121A _c of the second display panel 120A, and reaches to a user viewing the display device 1A from the viewpoint 3 ..

The intensity of the light ray LF'emitted from the display device 1A is represented by the integration of the pixel values (transmittance) of the pixel 111A of the first display panel 110A and the pixel 121A of the second display panel 120A.

As shown in FIG. 2, the pixel values of the pixels 111A _i of the first display panel 110A (Layer H) and _{H i,} the pixel value of pixel 121A _j of the second display panel 120A (Layer U) and _{U j} do. In this case, the intensities of the light rays LF'i _{, j} _{that have passed through the pixels 111A i} and 121A _j are expressed by the equation (1). Note that i is an integer of i = 1 to I, and I represents the total number of pixels of the first display panel 110A. Further, j is an integer of j = 1 to J, and J represents the total number of pixels of the second display panel 120A. In FIG. 2, the backlight 130A is not shown.

If you try to reproduce the beam LF _i, the pixel value _{U j} pixels 121A _j of the pixel values _{H i} and layer U of the pixels 111A _i of the _j layer H of the 3-dimensional image displayed on the display device 1A, the pixel values _H i, U _j can be a combination of multiple values. For example, when the light beam LF _i, the intensity of _j is _"0.5", the intensity of _{H i = 1.0, U j =} 0.5 Even light LF' _{i, j} is "0.5", H _{Even if i} = 0.8 and U _j = 0.625, the intensity of the light rays LF'i _{, j} becomes "0.5". The numerical values here are examples, and _{the intensities of the light rays LF i and j and} the values of the pixel values _Hi and U _j are not limited to these.

Thus, the pixel 111A, the pixel value _H i of 121A, _{U j} may take a plurality of combinations. Therefore, light LF' _i emitted from the display device _{1A, j} is the ray LF _i to be _reproduced, so as to approach the _j, all pixels 111A _i, the pixel value _H i of 121A _j, appropriately setting the _{U j} As a result, a desired three-dimensional image can be displayed on the display device 1A. More specifically, for example, by solving the optimization problem shown in equation (2), the pixel 111A _i capable of displaying a desired three-dimensional image on the display device 1A, the 121A _j pixel values _H i, the _{U j} Can be set.

Various methods for solving the optimization problem shown in Eq. (2) are known, but here, a method using Multiplicative Update will be described as a typical method. In Multiplicative Update, as shown in the update equation (3) to (5), that it continues to iteratively update the pixel values _H i, the value of _{U j} alternately, the optimum pixel value _H i, obtain _{U j} technique Is.

_{By obtaining the optimum pixel values Hi} and U _j using the equations (3) to (5), a desired three-dimensional image can be displayed on the display device 1A.

(Color image display principle)
The display device 1A described above is a light field display that displays a grayscale monochrome image, but a color image may be displayed on the light field display. Hereinafter, the display device 1B for displaying a three-dimensional color image will be described with reference to FIG. FIG. 3 is a diagram for explaining the display principle of the color image by the display device 1B.

As shown in FIG. 3, the display device 1B includes a first display panel 110B, a second display panel 120B, and a backlight 130A.

The first display panel 110B and the second display panel 120B are liquid crystal panels having a plurality of pixels (pixels) 111B and 121B.

Pixels

111B and 121B transmit sub-pixels 111SR and 121SR that transmit red (R) light, sub-pixels 111SG and 121SG that transmit green (Green) light, and blue (Blue; B) light, respectively. The sub-pixels 111SB and 121SB are used to form one

pixel

111B and 121B. The sub-pixels that transmit each color light of R, G, and B are collectively referred to as sub-pixels 111S and 121S. The light emitted from the backlight 130A passes through the sub-pixels 111SR and 121SR and is emitted from the display device 1B as a light ray having a red component. Similarly, a light ray having a green component and a light ray having a blue component are emitted from the display device 1B. The display device 1B can display a three-dimensional color image according to the pixel values (transmittance) of the sub-pixels 111S and 121S.

As described above, the intensity of the light rays of each color component of R, G, and B is represented by the integration of the pixel values of the sub-pixels 111S and 121S, as shown in the formulas (5) to (7).

Note that LF'R _{, i, j} indicates the intensity of the red light beam, that is, the red component of the intensity of the _{light beam LF'i, j.} Similarly, LF'G _{, i, j} indicates the intensity of the green ray, that is, the green component of the intensity of the _{ray LF'i, j} _{, and LF'B, i, j} indicates the intensity of the blue ray. That is, the blue component of the intensity of the light rays LF'i _{, j is shown.} _{Also, H R, i,} the pixel value of the sub-pixels 111SR _{_i, H G,} _i, the pixel value of the sub-pixels 111SG _{_i, H B,} _i represents a pixel value of the sub-pixel 111SB _i. _{Also, U R, j} is the pixel value of the sub-pixels 121SR _{_j, U G,} _j is the pixel value of the sub-pixels 121SG _{_j, U B,} _j indicates the pixel value of the sub-pixel 121SB _j. Note that i is an integer of i = 1 to I, and I represents the total number of pixels of the first display panel 110B. Further, j is an integer of j = 1 to J, and J represents the total number of pixels of the second display panel 120B.

Similar to the display device 1A described above, the pixel values of the sub-pixels 111S and 121S are calculated by solving the optimization problem using, for example, the update equations (8) to (13). As a result, a color three-dimensional image can be displayed on the display device 1B.

Next, a configuration example of the display device 1B will be described with reference to FIG. FIG. 4 is a block diagram showing a configuration example of the display device 1B. As shown in FIG. 4, the display device 1B includes a display unit 10B and a control unit 20B. The configuration shown in FIG. 4 is a functional configuration, and the hardware configuration may be different from this. Further, the functions of the display device 1B may be distributed and implemented in a plurality of physically separated configurations. For example, the display unit 10B and the control unit 20B may be configured by physically different devices.

The display unit 10B includes the above-mentioned first display panel 110B, a second display panel 120B, and a backlight 130A.

The control unit 20B controls each unit of the display unit 10B. The control unit 20B calculates, for example, the pixel values of the sub-pixels 111S and 121S of the display unit 10B, and drives the first display panel 110B and the second display panel 120B based on the calculated pixel values, respectively. The control unit 20B includes a calculation unit 210B and a drive unit 220B.

The calculation unit 210B calculates the pixel values of the sub-pixels 111S and 121S of the display unit 10B. The calculation unit 210B includes an R pixel value calculation unit 211B, a G pixel value calculation unit 212B, and a B pixel value calculation unit 213B.

R pixel value calculation unit 211B, the sub-pixel 111SR of the first display panel 110B, the pixel value _H R subpixels 121SR of the second display panel 120B, calculates the _{U R.} The R pixel value calculation unit 211B includes an R light intensity input unit 2111B, a first R pixel calculation unit 2112B, and a second R pixel calculation unit 2113B.

The R ray intensity input unit 2111B acquires the intensity of a desired red ray (hereinafter, also referred to as an R ray) to be emitted from the display device 1B, and obtains the intensity of the first R pixel calculation unit 2112B and the second R pixel calculation unit. Output to 2113B. The R ray intensity input unit 2111B acquires the intensity of the R ray intensity based on, for example, a three-dimensional image of the color to be displayed stored in the storage unit (not shown) of the display device 1B.

The first R pixel calculation unit 2112B and the second R pixel calculation unit 2113B calculates a pixel value _H R, _{U R} using the above-described update expression (5). In this case, the first R pixel calculation unit 2112B and the second R pixel calculation unit 2113B, a pixel value _H R updating each other, by exchanging _{U R,} the pixel value _H R, optimizing _{U R.}

G pixel value calculation unit 212B, as in the R pixel value calculation unit 211B, sub-pixel 111SG of the first display panel 110B, the pixel value _H G subpixels 121SG of the second display panel 120B, calculates the _{U G} .. The G pixel value calculation unit 212B includes a G light intensity input unit 2121B, a first G pixel calculation unit 2122B, and a second G pixel calculation unit 2123B. Since each part of the G pixel value calculation unit 212B operates in the same manner as each part of the R pixel value calculation unit 211B except that the red color (R) is replaced with the green color (G), the description thereof will be omitted.

Tsuzui and, B pixel value calculation unit 212B, like the R pixel value calculation unit 211B, sub Pikuseru 111SB of the first display panel 110B, the pixel value of the sub Pikuseru 121SB of the second of the display panel 120B _H _{B, U} B Is calculated. The B pixel value calculation unit 213B includes a B light intensity input unit 2131B, a first B pixel calculation unit 2132B, and a second B pixel calculation unit 2133B. Since each part of the B pixel value calculation unit 213B operates in the same manner as each part of the R pixel value calculation unit 211B except that the red color (R) is replaced with the blue color (B), the description thereof will be omitted.

The drive unit 220B drives the first display panel 110B and the second display panel 120B based on each pixel value calculated by the calculation unit 210B. The drive unit 220B includes a first drive unit 221B that drives the first display panel 110B, and a second drive unit 222B that drives the second display panel 120B.

The first drive unit 221B includes a first R pixel drive unit 2211B, a first G pixel drive unit 2212B, and a first B pixel drive unit 2213B. The first R pixel driver 2211B, based on the pixel value _{H R} of the first R pixel calculation unit 2112B is calculated, as the sub-pixel 111SR of the first display panel 110B is a pixel value _{H R,} first The display panel 110B of is driven. The first G pixel driver 2212B, based on the pixel values _{H G} of the first G pixel calculation unit 2122B is calculated, as the sub-pixel 111SG of the first display panel 110B is a pixel value _{H G,} first The display panel 110B of is driven. The first B pixel driver 2213B, based on the pixel value _{H B} of the first B pixel calculation unit 2132B is calculated, as the sub-pixel 111SB of the first display panel 110B is a pixel value _{H B,} first The display panel 110B of is driven.

The second drive unit 222B includes a second R pixel drive unit 2221B, a second G pixel drive unit 2222B, and a second B pixel drive unit 2223B. Second R pixel driver 2221B, based on the pixel value _{H R} of the second R pixel calculation unit 2113B is calculated, as the sub-pixel 121SR of the second display panel 120B is a pixel value _{H R,} the second Drives the display panel 120B of. The second G pixel driver 2222B, based on the pixel values _{H G} of the second G pixel calculation unit 2123B is calculated, as the sub-pixel 121SG of the second display panel 120B is a pixel value _{H G,} second Drives the display panel 120B of. _{The second B pixel drive unit 2223B is based on the pixel value H B} calculated by the second B pixel calculation unit 2133 _B , so that the sub pixel 121 SB of the second display panel 120B becomes the pixel value H B. Drives the display panel 120B of.

In this way, the control unit 20B calculates the pixel value and drives the display unit 10B with the calculated pixel value, so that the display device 1B can display a color three-dimensional image.

However, since the display device 1B described above has a plurality of display panels stacked on top of each other, the brightness of the display device 1B is lowered. For example, the subpixel 111SR of the display unit 10B transmits red light, but has zero transmittance for green light and blue light, and does not transmit green light and blue light. Therefore, the brightness (intensity of light rays) of the light passing through the sub-pixel 111SR is reduced to 1/3 times. Similarly, the sub-pixel 111SG of the display unit 10B also transmits only green light, and the sub-pixel 111SB also transmits only blue light. Therefore, the intensity of the light rays transmitted through the sub-pixels 111SR, 111SG, and 111SB is reduced to 1/3 times at the maximum.

The display device 1B described above has a configuration in which a first display panel 110B and a second display panel 120B are laminated. In addition, the intensity of the light beam is attenuated due to the integration as it passes through each panel. Therefore, the intensity of the light rays that have passed through the first display panel 110B and the second display panel 120B is significantly reduced as shown in the equation (14) as compared with the intensity of the light rays emitted from the backlight 130A. In the formula (14), the intensity of the red component of the light beam is shown, but the intensity of the green component and the blue component also decreases.

In the equation (14), the intensity of the light ray that decreases due to the influence of the pixel values of the sub-pixels 111S and 121S is shown, but in reality, the light ray is the first display panel 110B and the second display panel 120B. The strength is reduced by itself. In this case, the intensity of the light beam emitted from the display device 1B is lower than 1/9 shown in the equation (14) as compared with the intensity of the light ray emitted from the backlight 130A.

The discloser of this case has come to develop this technology in view of the above circumstances. Hereinafter, the details of the technology according to the present disclosure will be described in sequence.

<< 2. Overview of display device >>
In the above, the background of the present disclosure has been described. Subsequently, an outline of the display device 1 according to the embodiment of the present disclosure will be described. FIG. 5 is a diagram for explaining an outline of the display device 1 according to the embodiment of the present disclosure.

As shown in FIG. 5, the display device 1 according to the present embodiment includes a first display panel 110 (an example of a first display unit) and a second display panel 120 (an example of a second display unit). , And the backlight 130.

The first display panel 110 and the second display panel 120 are, for example, liquid crystal panels having a plurality of pixels 111 and 121, and generate an image by photomodulating the light of the backlight 130.

The backlight 130 is a light source of the display device 1. The light emitted from the backlight 130 passes through the first display panel 110 and the second display panel 120, and is emitted from the display device 1.

Here, the display device 1 is a multilayer type light field display, and the first display panel 110 and the second display panel 120 are arranged in a stacked manner. That is, the first display panel 110 and the second display panel 120 are arranged so that at least a part of the display area overlaps in the line-of-sight direction of the user. In the example of FIG. 5, the second display panel 120 is arranged closer to the user than the first display panel 110. Hereinafter, the first display panel 110 will be referred to as layer H, and the second display panel 120 will be referred to as layer U.

The display device 1 according to the present embodiment is a light field display that displays a three-dimensional color image. The pixels 111 and 121 of the first display panel 110 and the second display panel 120 of the display device 1 according to the present embodiment are each composed of a plurality of sub-pixels. The sub-pixel transmits a composite color obtained by synthesizing at least two components of the RGB (red, green, blue) components. In the example of FIG. 5, pixels 111 and 121 have RGB complementary color sub-pixels. More specifically, the pixels 111 and 121 transmit the wavelengths of the yellow (Y) subpixels 111PY and 121PY and the wavelengths of G and B (green and blue) that transmit the wavelengths of R and G (red and green). It has cyan (C) subpixels 111PC and 121PC, and magenta (M) subpixels 111PM and 121PM that transmit wavelengths of R and B (red and blue). The sub-pixels that transmit each color light of Y, C, and M are collectively referred to as sub-pixels 111P and 121P.

In FIG. 5, the sub-pixel 111P of the pixel 111 is arranged in the order of Y, C, M, and the sub-pixel 121P of the pixel 121 is arranged in the order of M, Y, C. The arrangement of is not limited to this. For example, the sub-pixels 111P and 121P may be arranged in the order of C, M, and Y. Further, the sub-pixels 111P and 121P of the first display panel 110 and the second display panel 120 may have the same or different arrangement of colors.

Light emitted from the backlight 130, e.g., sub-pixel 111PY, by passing through the 121PM, emitted from the display device 1 becomes light LF' _R of the red component. Similarly, light emitted from the backlight 130, the subpixel 111PM, by passing through the 121PY, emitted from the display device 1 becomes light LF' _R of the red component.

The intensities of the red, green, and blue components of the light rays that have passed through the pixels 111i and 121j of the display device 1 are shown in equations (15) to (17) using the pixel values (transmittance) of the sub-pixels 111P and 121P. expressed.

Note that LF'R _{, i, j} indicates a red component of the intensity of the light rays LF'i _{, j.} Similarly, LF'G _{, i, j} indicates the green component of the intensity of the light rays LF'i _{, j} _{, and LF'B, i, j} indicates the blue component of the intensity of the light rays LF'i _{, j.} ing. _{Also, H Y, i,} the pixel value of the sub-pixels 111PY _{_i, H C,} _i, the pixel value of the sub-pixels 111PC _{_i, H M,} _i indicates the pixel value of the sub-pixels 111PM _i. Further, U _{Y and j} indicate the pixel value of the sub pixel 121PY _j _{, U C and j} indicate the pixel value of the sub pixel 121PC _j , and U _{M and j} indicate the pixel value of the sub pixel 121PM _j. Note that i is an integer of i = 1 to I, and I represents the total number of pixels of the first display panel 110. Further, j is an integer of j = 1 to J, and J represents the total number of pixels of the second display panel 120.

Similar to the display device 1B described above, the pixel values of the sub-pixels 111P and 121P are calculated by solving the optimization problem using, for example, the update formulas (18) to (23).

_{LF R, i, j} shown in the update formulas (18) to (23) are red components of the light rays (desired light rays) of the three-dimensional image displayed on the display device 1, and LF'G _{, i, j} are It is a green component of a light ray of a three-dimensional image displayed on the display device 1. Further, LF _{B, i, and j} are blue components of light rays of a three-dimensional image displayed on the display device 1.

By driving the first display panel 110 and the second display panel 120 based on the calculated pixel values of the sub-pixels 111P and 121P, a color three-dimensional image is displayed on the display device 1.

Further, each of the sub-pixels 111P and 121P allows the complementary colors of the R, G, and B components, that is, the light rays of the component obtained by synthesizing at least two of the R, G, and B components to pass through. Therefore, the display device 1 can suppress a decrease in the intensity of the light rays at the sub-pixels 111P and 121P, as compared with the case where only the R, G, and B components of the light rays are passed. The details of the effect of the display device 1 will be described later.

<< 3. Display device configuration example >>
Next, the display device 1 provided with the display unit 10 according to the present embodiment will be described with reference to FIG. FIG. 6 is a block diagram showing a configuration example of the display device 1 according to the embodiment of the present disclosure.

As shown in FIG. 6, the display device 1 according to the present embodiment includes a display unit 10 and a control unit 20. The configuration shown in FIG. 6 is a functional configuration, and the hardware configuration may be different from this. For example, the display unit 10 and the control unit 20 may be configured by physically different devices, or may be configured by one device. Alternatively, a part of the functions of the control unit 20 (for example, the drive unit 220 described later) may be mounted on the display unit 10.

(Display unit 10)
The display unit 10 is a multi-layer type light field display capable of displaying a color three-dimensional image. The display unit 10 includes a first display panel 110, a second display panel 120, and a backlight 130.

The first display panel 110 is, for example, a liquid crystal panel. As described above, the first display panel 110 has a plurality of pixels 111 composed of a yellow sub-pixel 111PY, a cyan sub-pixel 111PC, and a magenta sub-pixel 111PM. The sub-pixel 111P of the first display panel 110 is driven so as to have a predetermined pixel value (transmittance) according to the control by the control unit 20.

The second display panel 120 is, for example, a liquid crystal panel. As described above, the second display panel 120 has a plurality of pixels 121 composed of a yellow sub-pixel 121PY, a cyan sub-pixel 121PC, and a magenta sub-pixel 121PM. The sub-pixel 121P of the second display panel 120 is driven so as to have a predetermined pixel value (transmittance) according to the control by the control unit 20.

The backlight 130 is a light source of the display unit 10. The light emitted from the backlight 130 passes through the first display panel 110 and the second display panel 120 in this order, and is emitted from the display unit 10.

(Control unit 20)
The control unit 20 is, for example, a dedicated or general-purpose computer. The control unit 20 is, for example, an integrated control unit that controls the display device 1.

The control unit 20 includes each function unit of a calculation unit 210, a drive unit 220, and a storage unit 230. Each functional unit of the control unit 20 is realized, for example, by executing a program stored inside the display device 1 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like with a RAM or the like as a work area. NS. Further, each functional unit may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

(Calculation unit 210)
The calculation unit 210 calculates the pixel values of the sub-pixels 111P and 121P of the display unit 10. The calculation unit 210 includes an R light intensity input unit 2111, a G light intensity input unit 2121, a B light intensity input unit 2131, a first pixel calculation unit 2102, and a second pixel calculation unit 2103.

The R light intensity input unit 2111 acquires the intensity of the red light ray (hereinafter, also referred to as R light ray) to be emitted from the display unit 10B from the storage unit 230, and obtains the intensity of the first pixel calculation unit 2102 and the second pixel calculation unit. Output to 2103. The R ray is, for example, a red component of the ray at each pixel of the three-dimensional image displayed on the display unit 10B.

The G light intensity input unit 2121 acquires the intensity of the green light ray (hereinafter, also referred to as G light ray) to be emitted from the display unit 10B from the storage unit 230, and obtains the intensity of the first pixel calculation unit 2102 and the second pixel calculation unit. Output to 2103. The G ray is, for example, a green component of the ray at each pixel of the three-dimensional image displayed on the display unit 10B.

The B light intensity input unit 2131 acquires the intensity of the blue light ray (hereinafter, also referred to as the B light ray) to be emitted from the display unit 10B from the storage unit 230, and obtains the intensity of the first pixel calculation unit 2102 and the second pixel calculation unit. Output to 2103. The B ray is, for example, a blue component of the ray in each pixel of the three-dimensional image displayed on the display unit 10B.

Here, it is assumed that the R light intensity input unit 2111, the G light intensity input unit 2121, and the B light intensity input unit 2131 acquire the intensities of the R light, G light, and B light from the storage unit 230, respectively. Not limited to this. For example, although not shown, the R light intensity input unit 2111, the G light intensity input unit 2121, and the B light intensity input unit 2131 may acquire the intensity of each light ray via the network.

The first pixel calculation unit 2102 calculates each pixel value of the sub-pixel 111P of the first display panel 110. More specifically, the first pixel calculation unit 2102 is set to the pixel value of the sub-pixel 121P of the second display panel 120 acquired from the above equations (18) to (20) and the second pixel calculation unit 2103. Based on this, the pixel value of the sub-pixel 111P is updated. The first pixel calculation unit 2102 outputs the updated pixel value to the second pixel calculation unit 2103.

The second pixel calculation unit 2103 calculates each pixel value of the sub-pixel 121P of the second display panel 120. More specifically, the second pixel calculation unit 2103 uses the pixel values of the sub-pixel 111P of the first display panel 110 acquired from the above equations (21) to (23) and the first pixel calculation unit 2102. Based on this, the pixel value of the sub-pixel 121P is updated. The second pixel calculation unit 2103 outputs the updated pixel value to the first pixel calculation unit 2102.

The first pixel calculation unit 2102 and the second pixel calculation unit 2103 update the pixel values of the sub-pixels 111P and 121P while exchanging the pixel values with each other. When the values of the pixel values to be updated have converged, the first pixel calculation unit 2102 and the second pixel calculation unit 2103 output the pixel values as the calculated pixel values to the drive unit 220.

(Drive 220)
The drive unit 220 drives each unit of the display unit 10. Alternatively, the drive unit 220 may drive the backlight 130. The drive unit 220 shown in FIG. 6 has a first drive unit 221 and a second drive unit 222.

The first drive unit 221 drives the first display panel 110. The first drive unit 221 includes a first C pixel drive unit 2211, a first M pixel drive unit 2212, and a first Y pixel drive unit 2213.

The first C pixel drive unit 2211 drives the sub pixel 111 PC so that the pixel value of the sub pixel 111 PC of the first display panel 110 becomes the pixel value of the sub pixel 111 PC calculated by the first pixel calculation unit 2102. ..

The first M pixel drive unit 2212 drives the sub pixel 111 PM so that the pixel value of the sub pixel 111 PM of the first display panel 110 becomes the pixel value of the sub pixel 111 PM calculated by the first pixel calculation unit 2102. do.

The first Y pixel drive unit 2213 drives the sub pixel 111PY so that the pixel value of the sub pixel 111PY of the first display panel 110 becomes the pixel value of the sub pixel 111PY calculated by the first pixel calculation unit 2102. do.

The second drive unit 222 drives the second display panel 120. The second drive unit 222 includes a second C pixel drive unit 2221, a second M pixel drive unit 2222, and a second Y pixel drive unit 2223.

The second C pixel drive unit 2221 drives the sub pixel 121 PC so that the pixel value of the sub pixel 121 PC of the second display panel 120 becomes the pixel value of the sub pixel 121 PC calculated by the second pixel calculation unit 2103. ..

The second M pixel drive unit 2222 drives the sub pixel 121 PM so that the pixel value of the sub pixel 121 PM of the second display panel 120 becomes the pixel value of the sub pixel 121 PM calculated by the second pixel calculation unit 2103. do.

The second Y pixel drive unit 2223 drives the sub pixel 121PY so that the pixel value of the sub pixel 121PY of the second display panel 120 becomes the pixel value of the subpixel 121PY calculated by the second pixel calculation unit 2103. do.

(Memory unit 230)
The storage unit 230 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 230 has a function of storing data related to processing in the display device 1. The storage unit 230 stores a three-dimensional image displayed on the display unit 10 by the display device 1. The three-dimensional image is, for example, a light field image captured by a light field camera, and has light ray information at each pixel.

In this way, the control unit 20 calculates the pixel values of the sub-pixels 111P and 121P of the display unit 10, and drives the display unit 10 based on the calculated pixel values. A color three-dimensional image can be displayed.

Further, the control unit 20 calculates the pixel values of the yellow, magenta, and cyan sub-pixels 111P and 121P based on the red, green, and blue components of the light intensity of the image to be displayed. As a result, the control unit 20 calculates the pixel values of the sub-pixels 111P and 121P of the display unit 10 without converting them into yellow, magenta, and cyan color components even if the image to be displayed is an RGB image, for example. Can be done.

<< 4. Display processing >>
Next, the display process by the display device 1 according to the present embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of display processing by the display device 1 according to the embodiment of the present disclosure.

The display device 1 executes the display process shown in FIG. 7, for example, when displaying a desired three-dimensional image on the display unit 10. For example, when displaying a three-dimensional moving image on the display unit 10, the display device 1 executes the display process shown in FIG. 7 for each frame of the moving image.

As shown in FIG. 7, the control unit 20 of the display device 1 first acquires a three-dimensional image to be displayed on the display unit 10 (step S101). The three-dimensional image acquired here is a color image having the intensities of the R ray, the G ray, and the B ray.

Subsequently, the control unit 20 calculates the pixel values of the sub-pixels 111P and 121P of the display unit 10 based on the RGB components of the acquired three-dimensional image (step S102). Since the sub-pixels 111P and 121P of the display unit 10 transmit any of the components of yellow, magenta, and cyan, the control unit 20 calculates the pixel values of the sub-pixels 111P and 121P of yellow, magenta, and cyan, respectively.

The control unit 20 drives the display unit 10 based on the calculated pixel values (step S103).

Thereby, the display device 1 can display a desired three-dimensional image on the display unit 10.

Here, it is assumed that the display process of FIG. 7 is executed when the display device 1 displays a three-dimensional image, but the present invention is not limited to this. For example, the control unit 20 of the display device 1 may calculate the pixel values of the first display panel 110 and the second display panel 120 from the three-dimensional image in advance. In this case, for example, the control unit 20 stores the calculated pixel values in the storage unit 230, and when displaying the three-dimensional image on the display unit 10, acquires and displays each pixel value from the storage unit 230. It is assumed that the unit 10 is driven.

<< 5. Effect >>
As described above, in the multilayer display device, since a plurality of display panels are stacked, the brightness of the display device is lowered. In particular, when display panels having RGB sub-pixels are stacked, the intensity of light rays decreases by 1/3 each time the display panels pass through the sub-pixels of each display panel. As described above, the decrease in brightness due to the transmittance of the sub-pixels may be a problem.

Therefore, in the display device 1 of the embodiment of the present disclosure, the sub-pixels 111P and 121P of the first display panel 110 and the second display panel 120 are set as sub-pixels that transmit the complementary colors of RGB, yellow, magenta, and cyan, respectively. bottom.

For example, the yellow sub-pixels 111PY and 121Y of the first display panel 110 and the second display panel 120 transmit the light rays of the R and G components other than the B component. Similarly, the magenta sub-pixels 111PM and 121M of the first display panel 110 and the second display panel 120 transmit light rays of R and B components other than the G component, and the cyan sub-pixels 111PC and 121C are R. It transmits light rays of G and B components other than the components.

Therefore, in the display device 1, the brightness is reduced 4/9 times as shown in the equation (24) by allowing the light rays to pass through the sub-pixels 111P and 121P. As shown in the above formula (14), the brightness when the display panels having RGB sub-pixels are stacked is reduced to 1/9 times, so that the display device 1 of the embodiment of the present disclosure displays RGB. It is possible to suppress a decrease in brightness as compared with the case where panels are laminated.

Here, the effects according to the above-described embodiment will be described based on comparison with comparative examples. As a technique for stacking a plurality of display panels, a display device in which an RGB display panel and a white (White: W) display panel are laminated is known in order to expand the contrast. Such a display device will be described with reference to FIG. 8 as a comparative example.

FIG. 8 is a diagram for explaining the display device 1C according to the comparative example. As shown in FIG. 8, the display device 1C includes a first display panel 110C, a second display panel 120C, and a backlight 130C.

The first display panel 110C has RGB sub-pixels (not shown). The second display panel 120C has W sub-pixels (not shown) and can transmit all RGB components. The backlight 130C is a light source of the display device 1C, and the light emitted from the backlight 130C passes through the first display panel 110C and the second display panel 120C and is emitted from the display device 1C.

The display device 1C adjusts the color displayed on the display device 1C on the first display panel 110C, and adjusts the intensity of the light displayed on the display device 1C on the first display panel 110C and the second display panel 120C. do. Although the display device 1C is not a device for displaying a three-dimensional image, the contrast of the image displayed on the display device 1C can be expanded by adjusting the light intensity in this way.

Here, the intensity of light (light rays) of the display device 1C is determined by the first display panel 110C and the second display panel 120C. In the first display panel 110, the sub-pixels transmit any one of RGB rays. Therefore, the intensity of the light beam is reduced to 1/3 times as the light ray passes through the first display panel 110C. In the second display panel 120, since the sub-pixels transmit all the light rays of RGB, the intensity of the light rays does not decrease in the second display panel 120C. Therefore, in the display device 1C, the brightness is reduced to 1/3 times as shown in the equation (25) by passing through the sub-pixels.

In this way, as in the display device 1C according to the comparative example, one of the display panels to be stacked is a display panel having sub-pixels that transmit white, so that the display panels having RGB sub-pixels are laminated. It is possible to suppress a decrease in brightness as compared with the case. However, as shown in the above formula (24), the display device 1 according to the present embodiment can suppress the brightness decrease by 4/9 times, so that the brightness decrease is suppressed as compared with the display device 1C. can do.

<< 6. Other embodiments >>
The display device 1 according to the above-described embodiment may be implemented in various different forms other than the above-described embodiment.

In the above-described embodiment, the sub-pixels 111P and 121P of the first display panel 110 and the second display panel 120 transmit any component of Y, M, or C, but the present invention is not limited to this. It suffices if the light rays of the desired three-dimensional image can be reproduced by adjusting the brightness values of the sub-pixels 111P and 121P, and the color component transmitted through the sub-pixels 111P and 121P may be a component other than Y, M, and C. .. For example, each of the sub-pixels 111P and 121P may transmit any of the R, B, and Y components.

For example, the sub-pixel 111P of the first display panel 110 is composed of three colors (α, β, γ), and the sub-pixel 121P of the second display panel 120 is composed of three colors (δ, ε, ζ). It shall be done. Here, the three colors (α, β, γ) are represented by the color matching function shown in the equation (26), and the three colors (δ, ε, ζ) are represented by the color matching function shown in the formula (27). Suppose it is represented.

In this case, the light intensity of each RGB component of the light ray LF'emitted from the display device 1 is represented by the formulas (28) to (30).

Therefore, by updating the update formulas (31) to (36), the display device 1 sets the light intensity of the light ray LF'emitted from the display device 1 to the intensity of the desired light ray LF to be displayed on the display device 1. It is possible to calculate each pixel value that brings them closer.

Equations (37) to (39) are substituted for URA, UGA, and UBA of the equation (31), respectively. Equations (40) to (42) are substituted into URB, UGB, and UBB of the equation (32), respectively. Equations (43) to (45) are substituted into URC, UGC, and UBC of equation (33), respectively. Equations (46) to (48) are substituted for HRA, HGA, and HBA of the equation (34), respectively. Equations (49) to (51) are substituted into HRB, HGB, and HBB of the equation (35), respectively. Equations (52) to (54) are substituted into HRC, HGC, and HBC of equation (36), respectively.

As described above, the color transmitted through the sub-pixels 111P and 121P of the first display panel 110 and the second display panel 120 may be a color obtained by synthesizing at least two colors of the R, G, and B color components. It can be any color.

Further, in the above-described embodiment, the sub-pixels 111P and 121P of the first display panel 110 and the second display panel 120 both transmit the same color (Y, M, C) component, but the present invention is not limited to this. .. The color components transmitted by the first display panel 110 and the second display panel 120 may be different. For example, the first display panel 110 may transmit the color components of R, G, and B, and the second display panel 120 may transmit the color components of Y, M, and C.

Further, in the above-described embodiment, the first display panel 110 and the second display panel 120 transmit the three colors of Y, M, and C, but the present invention is not limited to this. For example, as in Y, M, C, and W, the first display panel 110 and the second display panel 120 may transmit four or more color components.

Further, in the above-described embodiment, the display device 1 calculates the pixel values of the sub-pixels 111P and 121P of the display unit 10, but the present invention is not limited to this. For example, an external device (not shown) may calculate the pixel values of the sub-pixels 111P and 121P, and the control unit 20 may acquire the pixel values from the external device to drive the display unit 10.

Further, in the above-described embodiment, the display device 1 is configured by laminating two panels of the first display panel 110 and the second display panel 120, but the present invention is not limited to this. For example, three or more display panels may be laminated to form a structure.

Further, in the above-described embodiment, both the first display panel 110 and the second display panel 120 are liquid crystal panels, but the present invention is not limited to this. For example, the first display panel 110 may be an organic light emitting diode (OLED: Organic Light Emitting Diode). In this case, the backlight 130 of the display device 1 can be omitted. Further, the first display panel 110 and the second display panel 120 may be SXRD (Silicon X-tal Reflective Display).

Further, the display device 1 described above is a field display for displaying a three-dimensional image, but the present invention is not limited to this. The display device 1 may be a display in which a plurality of display panels are laminated, and display panels are laminated in order to expand the contrast.

Further, in the above-described embodiment, the display device 1 has a display panel, but the present invention is not limited to this. The display device 1 may be a device such as a projector that displays a three-dimensional image by projecting an image.

<< 7. Supplement >>
Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that anyone with ordinary knowledge in the technical field of the present disclosure may come up with various modifications or modifications within the scope of the technical ideas set forth in the claims. Is, of course, understood to belong to the technical scope of the present disclosure.

Of the processes described in the above embodiments, all or part of the processes described as being automatically performed may be performed manually, or all or one of the processes described as being performed manually. The section can also be performed automatically by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed / physically distributed in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

Further, the above-described embodiments can be appropriately combined as long as the processing contents do not contradict each other.

Further, the effects described in the present specification are merely explanatory or exemplary and are not limited. That is, the techniques according to the present disclosure may exhibit other effects apparent to those skilled in the art from the description herein, in addition to or in place of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A display device that displays a three-dimensional image to the user.
A first display unit having sub-pixels of a predetermined color,
A second display unit having at least a part of the display area overlapped with the display area of the first display unit in the line-of-sight direction of the user and having sub-pixels of a predetermined color.
With
The predetermined color of the sub-pixel of the first display unit or the predetermined color of the sub-pixel of the second display unit is among the R (red), G (green), and B (blue) components. It is a composite color that combines at least two components of
Display device.
(2)
The display device according to (1), wherein both the predetermined color of the sub-pixel of the first display unit and the predetermined color of the sub-pixel of the second display unit are the composite colors.
(3)
The display device according to (1) or (2), wherein the synthetic color is a complementary color of at least one of the R, G, and B components.
(4)
The first display unit and the second display unit are driven according to the brightness values calculated for each of the sub-pixels based on the image data of the R, G, and B components, (1) to (3). ) Is described in any one of the display devices.
(5)
The brightness value of the sub-pixel of the first display unit and the second display unit is
Each value of the R, G, and B components included in the value obtained by multiplying the brightness value of the sub-pixel of the first display unit and the brightness value of the sub-pixel of the second display unit is The display device according to (4), which is calculated by optimizing the image data so as to approach each value of the R, G, and B components.
(6)
The display device according to (4) or (5), wherein the image data is a light field image.
(7)
The display device according to any one of (1) to (6), wherein the first display unit and the second display unit are liquid crystal panels.
(8)
Of the first display unit and the second display unit, the display unit arranged far from the user is an OLED (Organic Light Emitting Diode) panel, which is any one of (1) to (6). The display device described in.

1 Display device 10 Display unit 110 First display panel 120 Second display panel 130 Backlight 20 Control unit 210 Calculation unit 220 Drive unit 230 Storage unit

Claims

A display device that displays a three-dimensional image to the user.
A first display unit having sub-pixels of a predetermined color,
A second display unit having at least a part of the display area overlapped with the display area of the first display unit in the line-of-sight direction of the user and having sub-pixels of a predetermined color.
With
The predetermined color of the sub-pixel of the first display unit or the predetermined color of the sub-pixel of the second display unit is among the R (red), G (green), and B (blue) components. It is a composite color that combines at least two components of
Display device.
The display device according to claim 1, wherein both the predetermined color of the sub-pixel of the first display unit and the predetermined color of the sub-pixel of the second display unit are the composite colors.
The display device according to claim 1, wherein the synthetic color is a complementary color of at least one of the R, G, and B components.
The first display unit and the second display unit are driven according to the luminance value calculated for each of the sub-pixels based on the image data of the R, G, and B components, according to claim 1. Display device.
The brightness value of the sub-pixel of the first display unit and the second display unit is
Each value of the R, G, and B components included in the value obtained by multiplying the brightness value of the sub-pixel of the first display unit and the brightness value of the sub-pixel of the second display unit is The display device according to claim 4, wherein the display device is calculated by optimizing the image data so as to approach each value of the R, G, and B components.
The display device according to claim 4, wherein the image data is a light field image.
The display device according to claim 1, wherein the first display unit and the second display unit are liquid crystal panels.
The display device according to claim 1, wherein the display unit located far from the user among the first display unit and the second display unit is an OLED (Organic Light Emitting Diode) panel.