TWM610904U - Dual-mode display with light sensing function - Google Patents

Abstract

A dual-mode display device with a light sensing function includes: a substrate; a control unit; and photoelectric conversion units disposed on the substrate and electrically coupled to the control unit. In a display mode, the control unit controls the photoelectric conversion units to enter a forward bias light emitting mode; and in a sensing mode, the control unit controls at least one of the photoelectric conversion units to enter a reverse bias light sensing mode.

Description

Dual-mode display device with light sensing function

The present invention relates to a dual-mode display device with light sensing function, and more particularly to a dual-mode display device that utilizes a dual-mode photoelectric conversion unit to give consideration to both display and light sensing functions.

The most important information and human-machine interface of today’s mobile electronic devices (such as mobile phones, tablets, laptops, etc.) is the display device. Therefore, the development of many sensors must cater to the development of display devices and develop new technologies, such as mobile phones. The development of full-screen displays has limited or changed the space of many sensors, including under-screen fingerprints or under-screen cameras, etc. The miniaturized optical imaging device is placed under the screen (which can be called under-screen), and the screen is partially transparent. Light (especially Organic Light Emitting Diode (OLED) screens) can capture images of objects on the top of the screen, such as fingerprint images or photos.

However, the under-screen image sensing technology has a certain degree of difficulty, because the light representing the image needs to penetrate the display panel, which causes difficulties in signal processing (because the image signal will be combined with the panel light pattern), and it needs to be complicated. At the same time, the light transmittance ratio and light transmittance pattern of different display panels are also different. It is often necessary to propose solutions for them. More importantly, as the development trend of display panels grows, it may eventually develop The opaque technology, at this time, the image sensing under the screen is useless for heroes. Therefore, in order to solve the above-mentioned problems, the present invention proposes how to design an in-screen optical sensing device, which is actually the problem to be solved by this disclosure.

Therefore, one purpose of the present invention is to provide a dual-mode display device that uses dual-mode photoelectric conversion units to take into account the functions of display, light sensing and anti-counterfeiting, which can be applied to OLED displays, micro light-emitting diode displays, and inorganic light-emitting diodes. Displays or other displays with independent light-emitting units.

To achieve the above objective, the present invention provides a dual-mode display device, which at least includes: a substrate; a control unit; and a plurality of photoelectric conversion units, which are arranged on the substrate and are electrically coupled to the control unit. In a display mode, the control unit controls the plurality of photoelectric conversion units to enter a light emitting mode; and in a sensing mode, the control unit controls at least one of the plurality of photoelectric conversion units to enter a light sensing mode.

The present invention also provides a dual-mode display device, which at least includes: a substrate; a control unit; and a plurality of photoelectric conversion units arranged on the substrate and electrically coupled to the control unit, wherein the control unit controls and adjusts the photoelectric conversion units The luminous ratio of the three primary colors of the three primary color photodiodes of the three primary color photodiodes, and the three primary color photodiodes with different three primary color energy levels are controlled to receive light of different spectra during sensing, so as to perform the function of spectral separation.

The present invention further provides a dual-mode display device, which at least includes: a substrate; a control unit; and a plurality of photoelectric conversion units arranged on the substrate and electrically coupled to the control unit, wherein the plurality of photoelectric conversion units have at least one first Energy level and a second energy level, the second energy level is higher than the first energy level, the control unit controls the photoelectric conversion units with the first energy level to receive the corresponding first spectrum to generate a first electrical signal, and the control unit The photoelectric conversion units with the second energy level are controlled to receive the corresponding second spectrum to generate a second electrical signal, and the function of spectrum separation is achieved by performing the calculation of the first electrical signal and the second electrical signal.

Through the above-mentioned embodiments, the photoelectric conversion unit in the light emitting mode and the light sensing mode can be used for display and light sensing. The photoelectric conversion unit in the light emitting mode can provide not only the light for display, but also the light for sensing. . Since there is no need to redesign and manufacture the display, and only need to change the circuit driving method, it does not need to consume a lot of cost to achieve the functions of the optical sensor in the screen. Furthermore, using the characteristics of the RGB diodes can perform spectral separation and provide sensing data for anti-counterfeiting, without the need for additional color filter elements, which can effectively save costs.

In order to make the above-mentioned content of the present invention more obvious and understandable, the following is a detailed description of preferred embodiments in conjunction with the accompanying drawings.

The spirit of this disclosure is to use, for example, any light-emitting diodes (including organic and inorganic materials, such as OLEDs, micro-light-emitting diodes (Micro LED), etc.) to provide light sensing and display functions. In order to simplify the following description, The conventional OLED will be mainly used to make it work in two modes. When the OLED is operating in the forward-biased light-emitting mode (referred to as the light-emitting mode or electro-optical conversion mode), the OLED can be used as a display. When the bias light sensing mode (abbreviated as light sensing mode, light receiving mode or photoelectric conversion mode) is operating, part or all of the OLED can be used as a photodiode and used as a light sensor. The design can be a single Point, multi-point, one-dimensional and two-dimensional, two-dimensional (2D) light sensors can sense objects. Because they operate in two modes, they are called dual-mode display devices. In an application embodiment, for example, For fingerprint sensing, part of the OLED pixels (also called light-emitting units) in a sensing area can be used as lighting, and some OLED pixels can be used as light-receiving sensors. Of course, this is only an example. The control unit can be used to set the light-emitting and sensing ratio in the sensing area according to the application scene (for example, the light-emitting and sensing ratio of a dim scene is 5:3; the light-emitting and sensing ratio of an indoor light source scene is 5:4 ; Or the ratio of light emission to sensing of the solar light source scene is 1:4, of course, this ratio is not limited), the application scene can be judged by the control unit according to the relevant information obtained by the ambient light sensor. Furthermore, it can be used The control unit controls the three-primary-color photodiodes of these photoelectric conversion units according to the application scenario, and adjusts the light-emitting ratio of the three-primary colors (RGB). In addition, during sensing, the energy gap of the three-primary colors can be used to receive Lights of different spectra perform the function of spectral separation, which is convenient for processing spectral information, such as false finger judgment. It should be noted that the "at least one" mentioned in this disclosure includes one or more conditions, or partial or partial The whole situation.

The embodiments of the present disclosure will take fingerprint sensing as an illustration, but it is not intended to be limited thereto. Any light sensing function derived from the present disclosure, whether single-point, one-dimensional (1D) or two-dimensional ( 2D) images are all within the scope of this disclosure. 1 and 2 show a schematic partial cross-sectional view of a dual-mode display device according to a preferred embodiment of the present invention when performing a display function and a light sensing function. Figure 3 shows a functional block diagram of the dual-mode display device. As shown in FIGS. 1 to 3, the dual-mode display device 100 at least includes a substrate 10 (for example, a glass or polymer flexible substrate), a plurality of photoelectric conversion units 20 and a control unit 30. It is worth noting that although the dual-mode display device 100 is described with an OLED display provided with a sensor as an example, the present invention is not limited to this. In another example, the dual-mode display device 100 can also sense biological features such as blood vessel images and blood oxygen concentration images of a finger, or be used as a point, line, or surface sensing device. In yet another example, the dual-mode display device 100 is a miniature light-emitting diode display equipped with an optical sensor or other displays that use similar light-emitting diodes as a display light source.

In one example, the substrate 10 is, for example, a dielectric substrate. A transistor layer 25 may be formed on the substrate 10 (the transistor layer 25 is used as a part of the photoelectric conversion unit 20, that is, the photoelectric conversion unit 20 includes at least the transistor layer 25), such as a thin film transistor layer. The transistor layer 25 has at least one or more transistors 25A, 25B, and 25C used as switches, and of course also includes conductor connecting wires (not shown). A plurality of photoelectric conversion units 20 such as organic light emitting diodes or micro light emitting diodes are arranged on the substrate 10. The photoelectric conversion unit 20 includes a plurality of pixels 24, and each pixel 24 includes at least one three primary color photodiode (red light photodiode 21, green light photodiode 22, and blue photodiode 23) and controls the aforementioned photodiode. At least one transistor 25A, 25B, and 25C of the polar body, and the control unit 30 is electrically coupled to the red photodiode 21 and the green photodiode through the at least one transistor 25A, 25B, 25C used as switches. Body 22 and blue photodiode 23. It is worth noting that a single photodiode can be connected to a single transistor, a single transistor can be connected to multiple photodiodes, or multiple transistors can be connected to a single photodiode. limit. Therefore, the control unit 30 is electrically coupled to these photoelectric conversion units 20. For example, the control unit 30 outputs control signals to the transistors 25A, 25B, and 25C, which can control the operation of the three primary color photodiodes. The installation location of the control unit 30 is not particularly limited. Of course, the configuration and quantity of each pixel and each transistor are explained here only with basic operation, not to be limited. Those who are familiar with this technique should understand and can change it according to the application, such as increasing the design of reverse bias voltage. , It is possible to increase the number of control transistors for each pixel.

In the display mode, the control unit 30 controls the photoelectric conversion units 20 to enter the light-emitting mode to perform electrical signal to optical signal conversion to provide, for example, light L1 for display. In this case, a display function can be provided.

In the sensing mode, the control unit 30 controls at least one (including one or more) of the photoelectric conversion units 20 to enter the light sensing mode. Entering the light sensing mode can receive the light L3 from an object F and execute the light The signal is converted to an electrical signal to obtain a sensing signal S1. Therefore, one or more photoelectric conversion units 20 can be controlled by the control unit 30 to selectively operate between the light emitting mode and the light sensing mode, or selectively operate in the light emitting mode or the light sensing mode. In another example, when one or more photoelectric conversion units 20 are controlled by the control unit 30 to operate in the light sensing mode, the remaining photoelectric conversion units 20 can be controlled by the control unit 30 to selectively operate in the light-emitting mode or not. Luminous pattern. When the OLED display is a small area display, all the photoelectric conversion units 20 can be controlled to enter the light sensing mode. When the OLED display is a large-area display (such as the size of a mobile phone screen), a part of the photoelectric conversion units 20 can be controlled to enter the light sensing mode, but it is also possible to control all the photoelectric conversion units 20 to enter the light sensing mode to Perform multi-part light sensing functions, such as sensing the fingerprints of two, three, four, or five objects (finger) at the same time. Therefore, the control unit 30 can control the photoelectric conversion unit 20 to operate in the light emitting mode and/or the light sensing mode. Such control actions can include: (a) simple display occasions; (b) full-screen sensing occasions; (c) no display Add part of the sensing (for example, when you want to unlock the screen in general); and (d) part of the display plus part of the sensing (for example, when fingerprint authentication is required to operate an application). In addition, the control unit 30 can control the three primary color photodiodes of these photoelectric conversion units 20 to perform the function of spectral separation, so as to facilitate the anti-counterfeiting procedure. The details will be described later.

Through the control of the light-emitting mode and the light-sensing mode described above, these photoelectric conversion units 20 can be used to perform electro-optical (luminescence) and photoelectric (sensing) conversion at different time points to obtain the functions of display, illumination, and light sensing. , Or photoelectric conversion units 20 in different positions (by geometric planning, the photoelectric conversion units 20 can perform partial light emission and partial light sensing) perform electro-optical (luminescence) and photoelectric (sensing) conversion to obtain display, illumination and light sensing The function of the test. Therefore, there is no need to sacrifice the resolution of the display, and there is no need to reconfigure the light-emitting unit of the display, let alone insert the light-sensing unit between the light-emitting units of the display, so that the display can have both display and light sensing functions, and The three primary color photodiodes that can control these photoelectric conversion units to perform the function of spectral separation are the most important spirit of this disclosure.

In addition, the dual-mode display device 100 may further include a display panel protective layer 40, which is disposed above the photoelectric conversion units 20, and displays information according to the display light L1. In one example, the display panel protective layer 40 includes a glass substrate or other light-transmitting materials, such as protective stickers.

Furthermore, the dual-mode display device 100 may further include a touch sensing layer 50 electrically coupled to the control unit 30 and disposed on the display panel protective layer 40 (of course, with the development of technology, the touch sensing layer shown here The layer 50 and the display panel protection layer 40 do not limit their manufacturing timing or relationship. For example, some in-cell touch technologies integrate touch technology, and the display panel protection layer is arranged on the outermost part. In this case, the touch sensing layer 50 is disposed above the photoelectric conversion units 20), and the touch sensing layer 50 senses the touch information of the object F to generate a touch signal S2. Therefore, the control unit 30 can select a region of interest (ROI) according to the touch position corresponding to the touch signal S2, and control at least one of the photoelectric conversion units 20 located in the ROI to enter the light sensing mode. To obtain the sensing signal S1.

Figures 4A and 4B show two states of the pixel. As shown in FIGS. 4A and 3, the control unit 30 further controls a first group of these photoelectric conversion units 20 (for example, the group formed by the pixels 24 used as the light-emitting unit EM in FIG. 4A) to enter the light-emitting mode The light L2 for sensing is provided, and a second group of these photoelectric conversion units 20 (for example, the group formed by the pixels 24 used as the light receiving unit RC in FIG. 4A) is controlled to enter the light sensing mode to The sensing signal S1 is obtained by using the sensing light L2. Therefore, one part of the photoelectric conversion unit 20 provides light L2 for sensing, and the other part provides light L2 for light sensing. In this case, two groups of pixels 24 can be controlled to simultaneously emit light and receive light. These photoelectric conversion units The first group and the second group of 20 can be arranged in a staggered arrangement. Of course, the staggered arrangement here is only an example for illustrating applications. Any geometric arrangement of light-emitting pixels and sensing pixels can be controlled by the control unit. All belong to the scope of this disclosure. It is worth noting that the light for sensing can also be provided by other light sources, for example, a light source for sensing is additionally provided, or ambient light is used, and it is not limited to be provided by the photoelectric conversion unit 20.

Or, as shown in FIGS. 3 and 4A, the control unit 30 may control the first group and the second group of these photoelectric conversion units 20 to enter the light-emitting mode and the light-sensing mode, respectively, so as to use the first group to perform printing. Light and use the second group for light sensing function. In addition, as shown in FIGS. 3 and 4B, the control unit 30 can control the first group and the second group of these photoelectric conversion units 20 to enter the light sensing mode and the light emitting mode, respectively, so as to use the second group to perform lighting. Light and use the first group for light sensing function. In this way, the data sensed by the first group and the second group can be combined to obtain complete data.

Of course, as shown in FIGS. 1 to 3, at least one of the photoelectric conversion units 20 may provide the light L2 for sensing before performing a light collection function (such as a proximity sensor). In this case, the control unit 30 further controls the photoelectric conversion units 20 to enter the light emitting mode to provide the sensing light L2, and the control unit 30 sequentially controls at least one of the photoelectric conversion units 20 to emit light according to the touch signal S2 Mode and light sensing mode to obtain the sensing signal S1 by using the sensing light L2.

Figures 5A to 5C show three examples of pixels. As shown in FIG. 5A, these photoelectric conversion units 20 include at least a plurality of pixels 24, and each pixel 24 includes at least one red photodiode 21, at least one green photodiode 22, and at least one blue photodiode. 23. The three can be called RGB photodiodes, corresponding to a display pixel (or a part of the display pixel). As shown in FIG. 5B, a single pixel 24 may include at least one red photodiode 21, at least one green photodiode 22 and two blue photodiodes 23. As shown in FIG. 5C, a single pixel 24 may include two red photodiodes 21, two green photodiodes 22 and one blue photodiode 23. Because there are many ways to configure the photodiode, this is only an example, and the disclosure is not limited to this. Also, as shown in FIG. 4A and FIG. 4B as a pixel 24 for light emitting or light sensing, it can be used as a pixel 24 for light emitting or light sensing. The selection is performed by at least one photodiode (R or G or B) in FIGS. 5A to 5C, that is, in a partial activation mode, the control unit 30 only activates one of the R, G, and B photodiodes Or two (not necessarily activate all the R, G, B photodiodes) to enter the light sensing mode or light emitting mode (for example, only green light and sensing), these can be independently controlled to the sub Pixels (R/G/B photodiodes 21 to 23 may be referred to as sub-pixels).

Fig. 6 shows a schematic partial cross-sectional view of the dual-mode display device performing the spectral separation function. As shown in Figure 6, because there are RGB diodes, it can perform the function of spectral separation. Therefore, in each pixel 24, the red photodiode 21, the green photodiode 22, and the blue photodiode 23 enter the light sensing mode to provide different energy levels to perform spectral separation sensing. For example, the energy level of the red photodiode 21 in the light sensing mode is relatively narrow, the energy level of the green photodiode 22 is second, and the energy level of the blue photodiode 23 is relatively wide. Because the energy of red light R is low, the energy of green light G is second, and the energy of blue light B is higher, so blue light B can excite red light photodiode 21, green light photodiode 22 and blue light photodiode. 23 for photoelectric conversion; green light G can only excite red light photodiode 21 and green light photodiode 22 for photoelectric conversion, but cannot excite blue light photodiode 23 for photoelectric conversion; while red light R can only excite The red photodiode 21 performs photoelectric conversion, but the green photodiode 22 and the blue photodiode 23 cannot be excited for photoelectric conversion. Therefore, the red photodiode 21 senses red light, green light, blue light and their mixed light and enters the light sensing mode, and the green photodiode 22 can only sense green light, blue light and their mixed light and enters The light sensing mode, and the blue photodiode 23 can only sense blue light and enter the light sensing mode. Of course, the photodiodes with different energy levels are determined by the material characteristics, and even the energy levels of light emission and light sensing are also It is not the same. The above description is only used to illustrate an advantage of spectral separation in the embodiments of the present disclosure, and is not intended to limit the specific spectral range that each sub-pixel (photodiode 21 to 23) can sense.

Therefore, in the above example, the plurality of photoelectric conversion units 20 have at least a first energy level (for example, an energy level corresponding to red light, but not limited to this) and a second energy level (for example, an energy level corresponding to green light). , But not limited to this), the second energy level is higher than the first energy level, the control unit 30 controls the photoelectric conversion units 20 having the first energy level to receive the corresponding first spectrum to generate the first electrical signal, and the control unit 30 controls the photoelectric conversion units 20 with the second energy level to receive the corresponding second spectrum to generate a second electrical signal. The function of spectrum separation can be achieved by performing calculations on the first and second electrical signals. The distribution range of the first spectrum and the second spectrum may be partially overlapped or not overlapped at all. In addition, these photoelectric conversion units 20 may further have a third energy level (for example, the energy level corresponding to blue light, but not limited to this), and the third energy level is higher than the second energy level. The control unit 30 controls the photoelectric conversion units 20 with the third energy level to receive the corresponding third spectrum to generate a third electrical signal, which can be achieved by performing calculations on the first, second, and/or third electrical signals The function of spectral separation. It is worth noting that the aforementioned calculations can be executed by the control unit 30, an external computer, or a cloud server, and the distribution ranges of the first, second, and third spectra can be partially overlapped or not overlapped at all.

Because the characteristics of photodiodes can be used to perform spectral separation, the dual-mode display device 100 can provide the sensed spectral information based on the separated spectra. For example, data required for fingerprint anti-counterfeiting can be applied, such as those of different spectra. The change in the time domain or the space domain of the sensing data, or the mathematical operation relationship of the sensing data of different spectra, etc., without any color filter, has the advantages of reducing cost and simplifying the structure.

7A and FIG. 7B show partial cross-sectional schematic diagrams of a variation of the dual-mode display device of FIG. 1 performing display functions and light sensing functions. As shown in FIGS. 7A and 7B, an example of partial sensing similar to that in FIG. 1 is provided. As shown in FIG. 7A, in the display mode, the photoelectric conversion unit 20 provides light L1 for display. As shown in FIG. 7B, in the sensing mode, the control unit 30 can simultaneously control part of the photoelectric conversion unit 20 (for example, the photodiodes on the left and right sides only shown schematically) to enter the light emitting mode to provide light for sensing. L2 and part of the photoelectric conversion unit 20 (for example, the middle three photodiodes 21, 22, and 23 shown only schematically) enter the light sensing mode to use the sensing light L2 to obtain the sensing signal S1, For example, the sensing light L2 hits the object F and then is reflected or refracted by the object F to become the light L3, but the method of generating the light L3 is not limited to this, because other light can also be used to hit the object F and then The object F is reflected or refracted and becomes light L3; or, the control unit 30 can sequentially (not at the same time) control the photoelectric conversion units 20 to enter the light emitting mode and control the photoelectric conversion units 20 to enter the light sensing according to the touch signal S2 Mode to obtain the sensing signal S1 by using the sensing light L2. In this way, in the sensing mode, the effects of local light emission and local light sensing can be achieved.

As shown in FIG. 8, it is worth noting that when multiple photoelectric conversion units 20 that can enter the light-emitting mode and the light-sensing mode cover the entire dual-mode display device 100, a full-screen display and full-screen sensing application can be provided. The sensing area SA3 at this time can selectively provide a sensing function and a display function. When the multiple photoelectric conversion units 20 that can enter the light-emitting mode and the light-sensing mode only fill a part of the dual-mode display device 100 (for example, within the sensing area SA1 or SA2), a partial screen sensing application can be provided, and Another part of the dual-mode display device 100 (for example, outside the sensing area SA1 or SA2) can provide a photoelectric conversion unit with only a light emitting mode. Therefore, the requested scope of this case includes the above two applications. In actual manufacturing, multiple photoelectric conversion units 20 can also be spread over the entire dual-mode display device 100, and the electronic device 200 equipped with the dual-mode display device 100 can be divided into two or more grades of products for sale. With the different firmware of the control unit 30, it can drive, for example, 20%, 50% and 100% of the photoelectric conversion unit 20 can enter the light sensing mode, which can create three different sizes of sensing areas SA1, SA2 and SA3 at three prices Electronic device. Of course, users who originally bought 20% of the sensing area SA1 can update the firmware or control code through a paid account upgrade to increase to 40% of the sensing area SA2 or 100% of the sensing area SA3, and get Different experience. Of course, users who originally purchased 100% of the sensing area SA3 can also set the sensing area they are accustomed to, and shrink it to any specific sensing area in any proportion and/or specific location to meet the needs of users . In this case, the aforementioned sensing mode includes a plurality of sub-sensing modes, and the control unit 30 can control the photoelectric conversion units 20 of different proportions to enter the light-sensing mode according to the sub-sensing modes. Therefore, this example has an ROI configurable architecture, allowing users to configure the ROI by themselves to enter the light sensing mode.

With the above-mentioned embodiments, the photoelectric conversion unit in the light emitting mode and the sensing mode can be used for display and light sensing. The photoelectric conversion unit in the light emitting mode can not only provide light for display but also light for sensing. Since there is no need to redesign and manufacture the display, and only need to change the circuit driving method, it does not need to consume a lot of cost to achieve the functions of the optical sensor in the screen. Furthermore, the characteristics of RGB diodes can be used to perform spectral separation and provide sensing data for anti-counterfeiting in fingerprint applications, for example, without the need for additional color filter elements, which can effectively save costs.

The specific embodiments proposed in the detailed description of the preferred embodiments are only used to facilitate the description of the technical content of the present invention, instead of restricting the present invention to the above embodiments in a narrow sense, and do not exceed the spirit of the present invention and the scope of the patent application. Under the circumstance, the various changes and implementations made belong to the scope of this new model.

B: Blu-ray EM: Light-emitting unit F: Object G: Green light L1: Light for display L2: Light for sensing L3: light R: red light RC: light receiving unit S1: sense signal S2: Touch signal SA1, SA2, SA3: sensing area 10: substrate 12: Transistor layer 20: photoelectric conversion unit 21: Red light photodiode 22: Green light photodiode 23: Blue light photodiode 24: pixel 25: Transistor layer 25A, 25B, 25C: Transistor 30: control unit 40: display panel protective layer 50: Touch sensing layer 100: Dual-mode display device 200: electronic device

[Fig. 1] shows a partial cross-sectional schematic diagram of the dual-mode display device according to the preferred embodiment of the present invention performing the display function. [Figure 2] shows a partial cross-sectional schematic diagram of the dual-mode display device performing the light sensing function. [Figure 3] Shows the functional block diagram of the dual-mode display device. [Figure 4A] and [Figure 4B] show the two states of the pixel. [Figure 5A] to [Figure 5C] show three examples of pixels. [Figure 6] A partial cross-sectional schematic diagram showing the dual-mode display device performing the spectral separation function. [Fig. 7A] and [Fig. 7B] show the partial cross-sectional schematic diagrams of the variation of the dual-mode display device of [Fig. 1] performing the display function and the light sensing function. [Figure 8] A schematic diagram showing different sensing areas of an electronic device equipped with a dual-mode display device.

B: Blu-ray

F: Object

G: Green light

R: red light

10: substrate

20: photoelectric conversion unit

21: Red light photodiode

22: Green light photodiode

23: Blue light photodiode

24: pixel

25: Transistor layer

25A, 25B, 25C: Transistor

40: display panel protective layer

50: Touch sensing layer

100: Dual-mode display device

Claims (22)

A dual-mode display device including at least: A substrate; A control unit; and A plurality of photoelectric conversion units are arranged on the substrate and electrically coupled to the control unit, wherein: In a display mode, the control unit controls the photoelectric conversion units to enter a light emitting mode; and In a sensing mode, the control unit controls at least one of the plurality of photoelectric conversion units to enter a light sensing mode. The dual-mode display device according to claim 1, wherein the photoelectric conversion units at least include a plurality of pixels, and each pixel includes: At least one red photodiode, at least one green photodiode, and at least one blue photodiode form a three-primary color photodiode. The dual-mode display device according to claim 2, wherein in a partial activation mode, the control unit only activates one or one of the red photodiode, the green photodiode, and the blue photodiode Two to enter the light sensing mode or the light emitting mode. The dual-mode display device according to claim 2 or 3, wherein each pixel further includes: At least one transistor, wherein the control unit is electrically coupled to the red photodiode, the green photodiode, and the blue photodiode through the at least one transistor used as a switch. The dual-mode display device according to claim 4, wherein in each pixel, the red photodiode, the green photodiode, and the blue photodiode enter the light sensing mode to provide different To perform spectral separation sensing. The dual-mode display device according to claim 1, wherein the photoelectric conversion units include at least one transistor layer formed on the substrate, wherein the transistor layer includes the at least one transistor. The dual-mode display device as described in claim 1, further comprising: A touch sensing layer is electrically coupled to the control unit, and senses touch information of an object to generate a touch signal. The dual-mode display device according to claim 7, wherein the control unit selects a region of interest according to the touch position corresponding to the touch signal, and controls the at least one photoelectric conversion unit located in the region of interest to enter the The light sensing mode is to receive the light from the object and perform the conversion of the light signal to the electrical signal to obtain a sensing signal. The dual-mode display device according to claim 7, wherein the control unit further controls a first group of the photoelectric conversion units to enter the light emitting mode to provide light for sensing, and controls one of the photoelectric conversion units The second group enters the light sensing mode to use the sensing light to obtain a sensing signal. The dual-mode display device according to claim 9, wherein the first group and the second group of the photoelectric conversion units are arranged in a staggered manner. The dual-mode display device according to claim 9, wherein the control unit sequentially controls the at least one photoelectric conversion unit to enter the light emitting mode and the light sensing mode according to the touch signal, so as to provide light for sensing and use the light Sensing uses light to obtain the sensing signal. The dual-mode display device according to claim 1, wherein the substrate is a glass substrate or a polymer flexible substrate. The dual-mode display device described in claim 1 is a miniature light-emitting diode display or a display that uses a light-emitting diode as a display light source. The dual-mode display device according to claim 1, wherein the control unit controls a first group and a second group of the photoelectric conversion units to enter the light emitting mode and the light sensing mode, respectively, and then controls the The first group and the second group of photoelectric conversion units enter the light sensing mode and the light emitting mode, respectively. The dual-mode display device according to claim 1, wherein the photoelectric conversion units are used to perform electro-optical and photoelectric conversion at different time points to perform partial light emission and partial light sensing, so as to obtain the functions of display, illumination and light sensing. The dual-mode display device according to claim 1, wherein the photoelectric conversion units in different positions are used to perform electro-optical and photoelectric conversion to perform partial light emission and partial light sensing, and obtain the functions of display, illumination and light sensing. The dual-mode display device according to claim 4, wherein the control unit controls and adjusts the light-emitting ratios of the three primary colors of the three primary color photodiodes of the photoelectric conversion units, and controls the light emitting ratios of the three primary colors with different energy levels of the three primary colors during sensing. These three primary color photodiodes receive light of different spectra to perform the function of spectral separation. The dual-mode display device according to claim 17, wherein the control unit controls the light emitting and sensing ratio of the three primary color photodiodes according to the application scenario. The dual-mode display device according to claim 1, wherein the sensing mode includes a plurality of sub-sensing modes, and the control unit controls the plurality of photoelectric conversion units with different proportions to enter the light sensing according to the plurality of sub-sensing modes mode. The dual-mode display device as described in claim 1 has a configurable structure for a region of interest, allowing a user to configure a region of interest to enter the light sensing mode. The dual-mode display device according to claim 1, wherein the plurality of photoelectric conversion units have at least a first energy level and a second energy level, the second energy level is higher than the first energy level, and the control unit The photoelectric conversion units with the first energy level are controlled to receive the corresponding first spectrum to generate a first electrical signal, and the control unit controls the photoelectric conversion units with the second energy level to receive the corresponding second spectrum and A second electrical signal is generated, and the function of spectral separation is achieved by performing calculations on the first electrical signal and the second electrical signal. The dual-mode display device according to claim 21, wherein the plurality of photoelectric conversion units further have a third energy level, wherein the third energy level is higher than the second energy level, and the control unit controls the third energy level The photoelectric conversion units of the energy level receive the corresponding third spectrum to generate a third electrical signal, and perform the operation of the first electrical signal, the second electrical signal and/or the third electrical signal to achieve spectral separation Function.

Images