JP2001197523A - Stereoscopic display device, display controller, display control method display system and program storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To propose a stereoscopic display device that can display any display without being deteriorated even when a two-dimensional object and a three- dimensional object are displayed on the stereoscopic display device overlappingly. SOLUTION: In storing a barrier mask pattern to a barrier mask memory, when an overlapped part is present between a plurality of objects, data at the highest position are written to the corresponding overlapped parts by priority.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional display device which allows a user to observe a three-dimensional image by using a parallax between a right eye and a left eye.
The present invention relates to a display control device and a display control method for controlling the display device, a display system for performing stereoscopic display, and a storage medium for storing a device driver program for stereoscopic display and a communication device driver program.

[0002]

2. Description of the Related Art Conventionally, there is a computer system in which a graphical user interface is mounted. There are also systems that can switch between two-dimensional display and three-dimensional display and perform mixed display.

[0003] Here, a graphical user interface will be described. Generally, input devices such as a keyboard, a tablet, a mouse, and a trackball are used to operate a computer and input data. The above-mentioned input means, particularly a tablet or a mouse capable of inputting coordinate information and trajectory information to a computer while watching a monitor, is provided by a graphical interface.
It is often used together with a user interface (hereinafter, referred to as a GUI) to improve operability of a computer and perform intuitive operations.

FIG. 1 is a hierarchical diagram of a typical computer system using a GUI as an operating system. In the figure, reference numeral 500 denotes application software (hereinafter, simply referred to as an application) used by a user, and reference numeral 501 denotes a visual shell which is an environment for the user to actually operate the computer interactively and visually. The application is a GUI component API50
2. GUI parts library / server 503, drawing API 504 for drawing on display 506, drawing library / server 505, and other peripheral devices 509
By using other APIs 507 for using the API, other libraries / servers 508, device drivers 510 for controlling each device, etc., a visual shell of a GUI environment can be constructed, and external peripherals can be constructed. This is achieved by controlling the devices.

The progress of computer software and hardware is remarkable, and the development of display devices is no exception. High-quality color, large-screen, high-definition, etc. are being promoted. On the other hand, stereoscopic observation of the display,
There is also a tendency to pursue more information and a sense of reality, and several methods have been proposed and implemented.

As a system for performing stereoscopic display on a display, a stereoscopic image display system using a parallax barrier (hereinafter, referred to as a parallax barrier system) is widely known.

For the parallax barrier method, see S.M.
H. Kaplan, “Theory of Parallax Barriers”, J. SMPTE, Vo
l.59, No. 7, pp. 11-21 (1952). According to this method, of a plurality of parallax images from a plurality of viewpoints, at least a stripe image in which left and right parallax images are alternately arranged is provided with a predetermined light transmission provided at a position separated by a predetermined distance from the image. Slit with part (Parallax ・
(Referred to as a barrier), the stereoscopic vision can be performed by observing a parallax image corresponding to each eye with the left and right eyes.

Further, in order to improve compatibility with a two-dimensional image (one viewpoint image) display device, a parallax barrier is generated electronically by a transmission type liquid crystal display device or the like, and the shape and position of the barrier stripe are formed. A three-dimensional display device that electronically variably controls such a device is disclosed in Japanese Unexamined Patent Publication No. Hei.
9 and JP-A-5-122733.

FIG. 2 is a basic configuration diagram of a three-dimensional image display device disclosed in Japanese Patent Application Laid-Open No. 3-119889.
The three-dimensional image display device includes a transmissive liquid crystal display device 101 for displaying an image and a transmissive liquid crystal display element 103 for forming an electronic parallax barrier disposed on the transmissive liquid crystal display device 101 via a spacer 102 having a thickness d. I do. The transmissive liquid crystal display device 101 displays a parallax image captured from two directions or multiple directions as a vertical stripe image. The electronic parallax barrier 103 is designated with an XY address by a control unit such as a microcomputer 104 to form a parallax barrier pattern at an arbitrary position on the barrier surface. According to the principle of 3D.

FIG. 3 is a block diagram of a display section of a three-dimensional image display device comprising a liquid crystal panel display and an electronic parallax barrier disclosed in Japanese Patent Application Laid-Open No. 3-119889. Liquid crystal layers 115, 1
25 are used as two polarizing plates 111, 118 and 12 respectively.
It is configured to be sandwiched between 1,128. In this apparatus, when displaying a two-dimensional image, the display of the electronic parallax barrier pattern is stopped, and the electronic barrier 103
By achieving a colorless and transparent state over the entire area of the image display area, compatibility with two-dimensional display is realized.

FIG. 4 is a diagram showing a difference in a parallax barrier pattern formed on the electronic parallax barrier according to a difference in the number of viewpoints. As shown in the figure, when observing a stripe image composed of two viewpoint parallax images, the width A of the light-shielding portion as the parallax barrier and the width B of the light-shielding portion may be the same, but as the number of viewpoints increases, the electronic type The aperture ratio of the parallax barrier is reduced.

A description will be given of a mixed display of a three-dimensional image and a two-dimensional image in a conventional display control device. JP-A-5-1
Japanese Patent No. 22733 discloses a structure in which a barrier stripe pattern can be generated only in a part of an electronic parallax barrier 103 composed of a transmission type liquid crystal display element as shown in FIG. An example has been disclosed in which it is possible to display an image and a two-dimensional image in the same plane.

In addition to the parallax barrier method,
As a means for displaying a stereoscopic image using binocular parallax between the right eye and the left eye, a lenticular method is widely known. In the lenticular system, a lenticular having a large number of lens-like lenses arranged in front of a display is provided to separate images spatially into the left and right eyes, thereby allowing a user to observe a stereoscopic image.

However, in a system which is connected to a computer and can switch between two-dimensional display and three-dimensional display in which a GUI is mounted, or in a system in which two-dimensional display and three-dimensional display can be mixed, a window or an icon operated by a user is used. Because there is no means on the computer system to determine whether the object is an object that can be displayed three-dimensionally or an object that should be displayed two-dimensionally, for example,
In an apparatus configured to display a mixture of a three-dimensional display and a two-dimensional display, when a two-dimensional display part is overlapped on a part performing a three-dimensional display, the display is difficult to be visually recognized by a user. This situation will be described below.

[0015] Even an application program for stereoscopic display usually operates under a general-purpose operating system (for example, the operating system shown in Fig. 1). Because these operating systems have a multi-window display system,
The window of the stereoscopic image displayed by the application program overlaps, and a window for a GUI, for example, which the operating system intends to display, overlaps and is displayed. The screen that the application program wants to display should of course be displayed in three dimensions,
A two-dimensional display is sufficient for GUI windows.

On the other hand, a so-called direct-view type stereoscopic image display device (the parallax barrier system described above is a typical example)
Although a barrier mask display device is provided as a spatial modulation element before or after the display device that displays the parallax image, the optical path of light passing through the barrier mask display device matches the optical path of the image of the display device for parallax image. Therefore, the barrier mask display device affects both the display of a two-dimensional image and the display of a three-dimensional image.

Therefore, when the window of the operating system overlaps the window of the three-dimensional display application program, the image display of any one of the windows is sacrificed. JP-A-10-74267 discloses that
When the two-dimensional display window and the three-dimensional display window overlap, the active window (that is, the window displayed at the top) is prioritized, and, for example, the three-dimensional image window is displayed on the two-dimensional image window. In that case, the barrier mask display device, by drawing the barrier mask, prioritize the three-dimensional image display, conversely, if the three-dimensional image window is displayed below the two-dimensional image window, The barrier mask display device does not draw a barrier mask, thereby giving priority to two-dimensional image display.

However, in the system disclosed in Japanese Patent Application Laid-Open No. H10-74267, in the latter case, in a partial area of the lower three-dimensional display window that is not hidden by the upper two-dimensional display window, the three-dimensional image is formed by a barrier mask. However, the image quality is degraded because the is not operating, so that improvement has been required.

Therefore, the present invention relates to a display device for displaying two-dimensional parallax images and a region for two-dimensional display and three-dimensional display in a display device in which the optical path of the display device for spatial modulation overlaps the optical path of the display device. , A display device that allows the user to observe a stereoscopic image using the parallax between the right and left eyes without deteriorating any display, a display control device that controls the display device, a display control method, and the like. The purpose is to provide.

[0020]

According to the present invention for achieving the above object, a barrier mask memory for storing barrier mask data and a display device are controlled, and a two-dimensional image object is stored on the display device. A display control device that enables display of a three-dimensional image object includes, for a plurality of objects to be displayed, display position information on a display position for displaying the object, display position information on the size of the object, and a hierarchy indicating a display hierarchy position of the object. Information and management means for managing type information indicating a type of whether the image of the object is a two-dimensional image or a three-dimensional image,
When storing the barrier mask data in the barrier mask memory, the data value of the barrier mask pattern for the upper object in the upper hierarchy is given priority over the data value of the barrier mask pattern for the lower object in the lower hierarchy. And writing control means for writing data in the barrier mask memory.

By controlling the data value of the barrier mask pattern for the upper object in the upper hierarchy to be higher than the data value of the barrier mask pattern for the lower object in the lower hierarchy, the two-dimensional image object is controlled. Even when the image and the three-dimensional image object are displayed overlapping, neither image display is deteriorated.

According to a preferred embodiment of the present invention, the display device includes a spatial modulation display device for displaying barrier mask data for spatial modulation, and light of the spatial modulation display device. Including a display device for displaying parallax images placed on the road, on the display device for displaying parallax images, together with the display device for spatial modulation, it is possible to display mixed display of two-dimensional image objects and three-dimensional image objects. The display device for spatial modulation has a transmissive liquid crystal element.

According to a preferred aspect of the present invention, the data value of the barrier mask pattern for the two-dimensional image object is converted to the data value for the two-dimensional image object on the display device for spatial modulation. The first data value is set so that the barrier mask indicates light transmittance, and the data value of the barrier mask pattern for the three-dimensional image display object is changed to the left-eye spatial modulation element and the right-eye spatial modulation element of the spatial modulation display device. The second data value and the third data value are selectively set so that the spatial modulation element alternately exhibits light transmission and light blocking properties.

According to a preferred aspect of the present invention, when writing the barrier mask pattern in the barrier mask memory, the writing control means may be configured to initialize the position information of the object, When the hierarchy information or the type information is updated, or when the object is added or deleted, all the values of the barrier mask memory and all the elements of the display device for spatial modulation have the light transmittance. Write as a data value to indicate, and then, starting from the object at the lowest hierarchical position, sequentially refer to the barrier mask pattern for the object until reaching the highest object, referring to the display position information and type information of the object. While writing to the barrier mask memory while writing.

According to a preferred embodiment of the present invention, the object is a window.

According to a preferred embodiment of the present invention, the display position information for the window object is:
Including the display position information of the window frame and the display position information for client data display, even if the client data of the window object is a three-dimensional image,
The barrier mask pattern data corresponding to the window frame of the object includes the first data value.

According to a preferred aspect of the present invention, information on the viewpoint position of the user is input, and the data value of the barrier mask pattern in the barrier mask memory is corrected based on the value of the viewpoint position. .

According to claim 8, which is a preferable aspect of the present invention, the user adds or deletes a window, moves or resizes a window, or
When the window of interest is changed, the management means updates the position information, the hierarchy information, and the type information.

According to claim 9 which is a preferred aspect of the present invention, the addition or deletion of the window is caused by an event of the user starting or stopping the application program.

According to a preferred embodiment of the present invention, a window is added or deleted, or a window is moved or resized, or a window of interest is changed by an operation event of a pointing device by a user. caused by.

According to a preferred embodiment of the present invention, the disparity image display device displays a disparity composite image in which stripe-shaped disparity images for left and right eyes are alternately arranged. Features.

[0032] The above object is achieved by a display control method according to claims 12 to 22, or by a storage medium storing a program according to claim 23.

In order to achieve the above object, a display system for displaying a three-dimensional image object together with another object according to claim 24, comprises:

In order to display the two-dimensional image object and the three-dimensional image object in a mixed manner, a display device for spatial modulation for displaying barrier mask data for spatial modulation and an optical device disposed on the optical path of the display device for spatial modulation. A stereoscopic display device having a parallax image display device that divides and displays the right and left parallax images, and a first host computer device connected to the stereoscopic display device, wherein the parallax image display device is A parallax composite image memory for displaying a parallax composite image in which striped parallax images for the left and right eyes are alternately arranged, a first operating system, and the display device for parallax image display, An object program is displayed by the application program for displaying the parallax composite image and the first operating system. For each of the objects, a display position at which the object is displayed on the display device for displaying parallax images, display position information regarding the size of the object, hierarchical information indicating a display hierarchical position of the object, and an image of the object are two-dimensionally displayed. The first host computer device having a first memory storing a first communication device driver program for managing and transmitting type information indicating a type of an image or a three-dimensional image; and the three-dimensional display device. A second host computer device connected,
A barrier mask memory for storing the barrier mask data to be displayed on the display device for spatial modulation, a second operating system, a device driver program for controlling the barrier mask memory, and a display device for displaying the object on the parallax image display Display position information regarding the display position to be displayed above and the size of the object,
A second communication device driver program for receiving and managing hierarchical information indicating a display hierarchical position of the object and type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image is stored. And a display position for displaying the object on the parallax image display device for each object in the barrier mask memory by the device driver program according to the second host computer device having the second memory. Barrier patterns are stored based on display position information related to the size of the object, hierarchical information indicating the display hierarchical position of the object, and type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image. When storing the barrier mask data in the barrier mask memory, The data value of the barrier mask pattern for superior object, in preference to the data value of the barrier mask pattern for descendants in the lower layer, and writes to the barrier mask memory.

In order to achieve the above object, a display for spatial modulation according to claim 25, wherein barrier mask data is displayed for spatial modulation in order to display a mixture of a two-dimensional image object and a three-dimensional image object. A first host computer device to which a stereoscopic display device having a device and a parallax image display device arranged on an optical path of the spatial modulation display device for dividing and displaying left and right parallax images is connected; The first communication device driver program stored in the memory of the display device includes, for each object, a display position at which the object is displayed on the display device for displaying parallax images, display position information regarding the size of the object, and display of the object. Hierarchical information indicating the hierarchical position and the type of image of the object, whether it is a 2D image or a 3D image It manages the type information, wherein the program code for sending is stored.

A display for spatial modulation for displaying barrier mask data for spatial modulation in order to achieve a mixed display of a two-dimensional image object and a three-dimensional image object according to claim 26. A second host computer device to which a stereoscopic display device having a device and a parallax image display device arranged on an optical path of the spatial modulation display device and dividing and displaying left and right parallax images is connected; The second communication device driver program stored in the memory of the display device includes, for each object, a display position at which the object is displayed on the display device for displaying parallax images, display position information regarding the size of the object, and display of the object. Hierarchical information indicating the hierarchical position and the type of image of the object, whether it is a 2D image or a 3D image It receives the type information, wherein the program code for managing is stored.

In order to achieve the above object, a spatial modulation display for displaying barrier mask data for spatial modulation so that a two-dimensional image object and a three-dimensional image object are mixedly displayed according to claim 27. A second host computer device to which a stereoscopic display device having a device and a parallax image display device arranged on an optical path of the spatial modulation display device and dividing and displaying left and right parallax images is connected; The device driver program stored in the memory of the present invention is, for each object, a display position for displaying the object on the parallax image display display device and a display position for the size of the object in the barrier mask memory by the device driver program. Information, hierarchy information indicating the display hierarchy position of the object, and the object. When storing a barrier pattern based on type information indicating a type of a two-dimensional image or a three-dimensional image of the target image and storing the barrier mask data in a barrier mask memory, A program code for writing the data value of the barrier mask pattern for the object in the barrier mask memory in preference to the data value of the barrier mask pattern for the lower object in the lower hierarchy is stored. And

Further, in order to achieve the above object, a display control device capable of displaying a mixture of a two-dimensional image object and a three-dimensional image object according to claim 28 is provided. Management for managing display position information relating to the display position and the size of the object, hierarchical information indicating the display hierarchical position of the object, and type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image Means for storing display data for displaying the object in a memory;
Write control means for writing the data value of the mask pattern for the upper object in the upper hierarchy to the memory in preference to the data value of the mask pattern for the lower object in the lower hierarchy; Display means for displaying the plurality of objects based on the mask pattern.

According to a preferred embodiment of the present invention, the display means is a display device for spatial modulation that forms the mask pattern by spatial modulation.

According to a preferred aspect of the present invention, a data value of a mask pattern for a two-dimensional image object is stored in a mask for the two-dimensional image object on the display device for spatial modulation. Is set to a first data value that indicates light transmission,

The data value of the mask pattern for the three-dimensional image display object is expressed by the spatial light modulating element for the left eye and the spatial light modulating element for the right eye of the spatial modulation display device alternately exhibiting light transmission and light blocking properties. Thus, the second data value and the third data value are selectively set.

According to a preferred aspect of the present invention, in writing a mask pattern in the mask memory, the writing control means may be configured to initialize or to store position information or hierarchical information of the object. When the type information is updated, or when the object is added or deleted, all values of the mask memory are changed to data values indicating that all elements of the display device for spatial modulation indicate optical transparency. Then, starting from the object at the lowest hierarchical position and continuing until reaching the highest object, the mask pattern for the object is sequentially referred to by referring to the display position information and the type information of the object. Write to memory.

According to a preferred aspect of the present invention, the object is a window, and the display position information for the object includes display position information of a window frame and display information for displaying client data. Even when the position information is included and the client data of the window object is a three-dimensional image, the mask pattern data corresponding to the window frame of the object includes the first data value.

According to a preferred aspect of the present invention, information on the viewpoint position of the user is input, and the data value of the mask pattern in the mask memory is corrected based on the value of the viewpoint position.

According to Claim 34 which is a preferred aspect of the present invention, when the user adds or deletes a window, moves or changes the size of the window, or changes the window of interest, The management unit updates the position information, the hierarchy information, and the type information.

According to a preferred aspect of the present invention, the addition or deletion of a window is caused by an event of a user starting or stopping an application program.

According to a preferred aspect of the present invention, a window is added or deleted, or a window is moved or changed in size, or a window of interest is changed by an operation event of a pointing device by a user. caused by.

The above object is achieved by a display control method according to claims 37 to 45, or by a storage medium storing a program according to claim 46.

[0049]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention, that is, a computer system which operates in a GUI environment and has a stereoscopic display capable of stereoscopic display will be described with reference to the accompanying drawings. Before describing the characteristic portions of the present embodiment, a three-dimensional display of a cross lenticular system will be described.

<Cross Lenticular Method> Hereinafter, the principle of the three-dimensional display of the cross lenticular method will be described with reference to the drawings. FIG. 5 is a perspective view for explaining the principle of the cross lenticular system used in the present embodiment.

Reference numeral 1 denotes a liquid crystal display device for displaying a parallax image. Reference numeral 201 denotes a display pixel portion formed of a liquid crystal layer or the like, which is formed between the glass substrates 205. In the figure, a polarizing plate,
The illustration of a color filter, an electrode, a black matrix, an antireflection film, and the like is omitted. Reference numeral 3 denotes a backlight serving as an illumination light source. A liquid crystal display device 2 for a barrier functioning as a spatial light modulator is placed in front of the device. When a three-dimensional image is displayed, a checkered pattern (a black portion does not pass through the backlight and a white Is displayed on the display screen 2, and when displaying a normal two-dimensional image, the corresponding area is displayed in white.

Between the barrier liquid crystal display device 2 and the parallax image display liquid crystal display device 1, two mutually orthogonal lenticulars 203 and 204 made of transparent resin or glass are arranged as microlenses. In the parallax image display liquid crystal display device 1, in the figure, (206R is an image for the right eye,
06L is an image for the left eye), left and right parallax images are alternately arranged in the vertical direction and displayed in a horizontal stripe shape.
The light from the backlight 3 passes through each light transmitting portion 208 of the barrier liquid crystal display device 2 and
The image liquid crystal display device 1 is illuminated through the liquid crystal display 04, and the parallax images on the left and right are separately observed by both eyes of the user.

FIG. 6 is a diagram for explaining the principle that the left and right parallax images are observed separately in the horizontal direction with both eyes of the user. This figure shows a cross section of the stereoscopic image display device described in FIG. 5 as viewed from above. When the barrier liquid crystal display device 2 is illuminated by the backlight 3, light is emitted from the light transmission unit 208. A lenticular 203 is arranged on the user side of the barrier liquid crystal display device 2, and the lens curvature is designed so that a mask pattern on the barrier liquid crystal display device 2 comes to a position substantially at the focal point of each cylindrical lens.

The light transmitting portion and the light shielding portion of the mask pattern shown in FIG. 6 correspond to the left and right horizontal stripe-shaped left and right images displayed on the parallax image display liquid crystal display device 1. Yes, it is. Therefore, the light emitted from the light transmitting unit 208 passes through the lenticular 203 and illuminates the left image of the parallax image display liquid crystal display device 1 with directivity in a range indicated by a solid line in the drawing. In the figure, E _L denotes the left eye of the user and E _R denotes the right eye. The pitch of the lenticular 203 is set so that the light from the light transmitting unit 208 is uniformly collected by the left eye over the entire width of the image. The width of the pattern 209 is slightly smaller than the width of the pitch between the pair of light transmitting portions and the light shielding portions. As a result, transverse stripes in the left image displayed on the liquid crystal display device for displaying a parallax image is observed only in the range around the left eye E _L. As for the right eye E _R, the pattern of the light shielding portion light transmitting portion of the mask pattern 209 is opposite to the Figure 6. That is, now corresponds to the stripe in the right image in the horizontal stripe-shaped left and right images which are arranged vertically alternately displayed on the parallax image display liquid crystal display device 1, the right image through the lenticular 203 in the vicinity of the right eye E _R The area is illuminated with directivity. Thus, the lateral stripes on the right image displayed on the liquid crystal display device for displaying a parallax image is observed only in the range around the right eye E _R. In this way, the left and right images on the parallax image display liquid crystal display device are observed separately in the horizontal direction to the left and right eyes.

Next, the observation area in the vertical direction will be described.
FIG. 7 is a schematic side view of a cross section in the vertical direction of the three-dimensional image display device based on the cross lenticular system shown in FIG. In FIG. 7, the lenticular 203 having no optical action and the substrate made of flat glass not directly related to the optical action are omitted in FIG. 7, and the lenticular 204 is also conceptually represented. The openings of the mask pattern of the barrier liquid crystal display device 2 are in a checkered pattern as shown in FIG. 5, and in the vertical direction, horizontal stripes are displayed in the parallax image display liquid crystal display device 1 and arranged alternately in the vertical direction. It supports left and right images.

In FIG. 7, the opening pattern of the checkered light transmitting portion 208 is for illuminating the image line for one of the eyes of the user, for example, for illuminating the image line for the left eye of the user. I do.

Here, the pitch of the mask pattern in the vertical direction is V _m , the pitch of the lenticular 204 is V _L , and the lenticular 204 has a seventh cylindrical lens.
The focal length of the direction in the plane of FIG as f _V, parallax images V _d the vertical pixel pitch of the display liquid crystal display device, the distance L ₁ from the display surface of the parallax image display liquid crystal display device to lenticular 204 , when the distance from the lenticular 204 to the mask pattern and L _2,

V _d : V _m = L ₁ : L ₂ (1)

V _d : V _L = (L ₁ + L ₂ ) / 2: L ₂ (2)

1 / f _V = 1 / L ₁ + 1 / L ₂ (3)

The relationship is set so as to satisfy the following relationship. At this time, the light transmitting portions of the mask pattern converge on the corresponding pixel lines as focal lines perpendicular to the plane of FIG. Paying attention to one of the checkered apertures, a light beam emitted from the center point A of the central light transmitting portion 208-1 and incident on the corresponding cylindrical lens 204-1 of the lenticular 204 is a corresponding pixel of the liquid crystal display device. Column 206-
The light is converged on a focal line on the center point A ′ of 1. The luminous flux emitted from the center point A of the central light transmitting portion 208-1 and incident on the cylindrical lens constituting the lenticular 204 other than 204-1 is located at the center of the pixel line for displaying the left-eye image of the liquid crystal display device. It is collected as a focal line.

The luminous flux emitted from the end points B and C of the light transmitting section 208-1 and incident on the corresponding cylindrical lens of the lenticular 204 to the pixel row 204-1 is referred to as a pixel row 206-1.
Light is condensed on focal lines on points B ′ and C ′ at one end. Similarly, a light beam emitted from another point of the light transmission unit 208-1 and incident on the cylindrical lens 204-1 is collected as a focal line on the pixel column 206-1 of the liquid crystal display device. In addition, all the light beams emitted from the light transmitting portion 208-1 and incident on the cylindrical lenses other than 204-1 are also condensed on the pixel line of the liquid crystal display device 1 that displays the image for the left eye.

Similarly, all the light fluxes emitted from the light transmitting portions other than the light transmitting portion 208-1 of the checkered pattern shown in FIG. 7 are on the pixel lines of the liquid crystal display device 1 for displaying the image for the left eye. The light is condensed, illuminates and transmits the pixel line for the left eye of the liquid crystal display device 1 and diverges only in the vertical direction according to the numerical aperture at the time of condensing. An observation area in which the left-eye image looks uniform over the entire width in the direction is obtained. Here, the image for the left eye of the user has been described, but the same operation is performed for the image for the right eye of the user.

FIG. 8 is a side view of a vertical cross section of the three-dimensional image display device shown in FIG. In FIG. 7, members omitted in FIG. 7 are also shown. Here, the pitch of the openings of the mask pattern in the vertical direction is V _m , the lenticular 204
Pitch V _L of, L ₁ vertical pixel pitch V _d, the distance from the display surface of the parallax image display liquid crystal display device to the principal plane of the user-side lenticular 204 of the parallax image display liquid crystal display device, lenticular L _{2 is} the distance from the main plane on the mask substrate side of the mask substrate to the mask pattern.
When the focal length f _V in the direction of FIG. 8 in the plane of each cylindrical lens constituting the above (1),
V _d = V _m = V _L , L ₁ so as to satisfy the relations of equations (2) and (3).
= L ₂ , and f _V = L _1/2 . That is, as already described with reference to FIG. 7, it is possible to obtain an observation area in which the left and right images appear to be uniformly separated from the predetermined eye height of the user over the entire vertical width of the screen. ing.

In the above description, as viewed from the user side,
Liquid crystal display device 1, lenticular 204, lenticular 2
03, the three-dimensional image display device is configured by arranging the checkered light transmitting portions 208 in the order, but the order of the lenticular 203 and the lenticular 204 may be reversed. In this case, the stereoscopic image display device can be configured in the same manner as the above configuration by resetting the pitch and focal length of the lenticular 203 and the lenticular 204 and the vertical and horizontal pitches of the checkered aperture so as to satisfy all the above-described conditions. It becomes possible.

Next, a method of displaying a stereoscopic image by the spatial light modulator 2 will be described. FIG. 9 is a view for explaining a stereoscopic image display method by the stereoscopic display device shown in FIG. FIG. 9 (A) shows a pattern of a light transmitting part and a light shielding part of the spatial light modulator 2, and FIGS. 9 (B) and 9 (C) show a display pixel part of the liquid crystal display device 1 for screen display. Similarly to the above-described stereoscopic image display, the left and right parallax images are alternately combined in a horizontal stripe and displayed on the liquid crystal display device 1.

In FIG. 9A, when the light transmitting portion of the spatial light modulator 2 is formed in each of the rectangular portions 281 indicated by solid lines and the rectangular portion 282 is formed as a light shielding portion, 9
As shown in FIG. 3B, a right parallax image R ₁ on the first scanning line, a left parallax image L _{2 on} the second scanning line, a right parallax image R _{3 on} the third scanning line,
.. Correspond to each other, and the left and right parallax images are separately observed by the left and right eyes of the user. On the other hand, in FIG. 9A, a light transmitting portion is formed in each of the rectangular portions 282 indicated by dotted lines,
When 1 is a light-shielding portion, as shown in FIG.
A left parallax image L ₁ on the scanning line, a right parallax image R _{2 on} the second scanning line,
The third scanning line corresponds to a second combined stripe image combined to form a left parallax image L ₃ ,..., And the left and right parallax images are separately observed by the left and right eyes of the user.

Here, by alternately displaying this state in a time-division manner, the resolution of the left and right parallax images, which has been reduced to half due to the combination of stripes, can be displayed at a high resolution without lowering the resolution.

At this time, if there is a difference between the rewriting speed of the display pixel portion of the liquid crystal display device 1 for displaying an image and the rewriting speed of the spatial light modulator, the rewriting timing of the image and the rewriting of the aperture pattern are made coincident with each other to the user. In order to make the boundary invisible, an image display controller and a spatial light modulator controller can be added for synchronization. At that time, the display pixel portion of the parallax image display liquid crystal display device and the corresponding scanning line of the spatial light modulator may be rewritten in a synchronized manner for each pixel, or may be rewritten in a synchronized manner for each corresponding scanning line. Is also good.

In a normal stereoscopic display system in which two parallax images of a right-eye image and a left-eye image are displayed in a time-division manner for each screen, the frame frequency is set to 120 Hz in order to prevent flicker.
Need to be raised. However, in the method of the present embodiment, since the left and right parallax images are combined and displayed in the form of a horizontal stripe, it is possible to observe with high resolution without feeling flicker even at a frame frequency of 60 Hz.

In this embodiment, the opening pitch of the mask pattern in the vertical direction is V _m , the pitch of the lenticular 204 is V _L ,
The focal length f _V of the individual cylindrical lenses constituting the lenticular 204 in the direction of the paper in FIG. 7, the vertical pixel pitch of the parallax image display liquid crystal display device is V _d , the display of the parallax image display liquid crystal display device Lenticular 204 from the surface
L ₁ , and the distance from the lenticular 204 to the mask pattern L ₂ , where V _d = V _m = V _L , L ₁ = L ₂ , and f _V =
It is configured to satisfy the relationship of L _1/2 . here,
Since V _d = V _m , a liquid crystal display having the same pixel pitch as the parallax image display liquid crystal display can be used as the spatial light modulator.

Next, a description will be given of a mixed display means for switching between two-dimensional display and three-dimensional display in this configuration. In the above configuration using the transmissive spatial light modulator 2 such as a transmissive liquid crystal element, a predetermined area can be displayed as a stereoscopic image by controlling the aperture pattern, and the other part can be displayed as a two-dimensional image. it can. This will be described with reference to FIG. FIG. 10 is a view for explaining a method of displaying a three-dimensional image and a two-dimensional image in a mixed manner by the stereoscopic display device shown in FIG. In the same figure, (A) shows a pattern of a light transmitting part and a light shielding part of the spatial light modulator 2, and (B) shows an image pattern of the display pixel part 1 of the parallax image display liquid crystal display device. . As shown in (B), the left and right parallax images R,
A horizontal stripe image in which L, R,... Are alternately synthesized is displayed, and a normal two-dimensional image S is displayed in other regions.

The pattern of the light transmitting part and the light shielding part of the spatial light modulator 2 corresponding to FIG. 10 (B) is shown in FIG. 10 (A).
become that way. The area 292 of the spatial light modulator 2 corresponding to the area 291 of the liquid crystal display device 1 for displaying a stereoscopic image has a checkered opening pattern. As a result, the area 29
In portions corresponding to 1, 292, left and right parallax images having directivity in transmitted light separately reach right and left eyes. In other areas, the apertures are all in a light-transmitting state so that the two-dimensional image S reaches both the left and right eyes. Thus, a stereoscopic image can be displayed only in the area 291. Further, as described above, the first composite stripe image and the second composite stripe image are displayed alternately,
If a method of changing the aperture pattern in synchronization with the method is used, the resolution of the stereoscopic image can be increased.

<Display System> FIG. 11 is a block diagram showing a hardware configuration of a display system using the above-mentioned lenticular display device, and FIG. 12 is a block diagram showing a software configuration thereof.

In FIG. 11, reference numeral 1000 denotes the lenticular display device described with reference to FIGS. Reference numeral 2000 denotes a first host computer, and 4000 denotes a second host computer.
The first host computer device 2000 and the second host computer device 4000 are so-called workstation devices (or personal computer devices).
The first host computer 2000 has a first RAM 20
In this RAM 2001, a first operating system 3001, an application program 3002 for performing stereoscopic display for a specific purpose, and a first communication device driver program 300 for performing communication
3. Parallax synthetic image memory 3004 for performing stereoscopic display
Is stored. Also, the second host computer 4
000 has a second RAM 4001 therein,
001 includes the second operating system 500
1. A device driver program 5002 for controlling the barrier mask memory, a second communication device driver program 5003 for performing communication, and a barrier mask memory 5004 for performing three-dimensional display are stored.

First operating system 300
1. The application program 3002 is downloaded to the RAM 2001 from the first hard disk 2003 connected to the first host computer.
The parallax composite image is downloaded from the hard disk 2003 to the parallax composite image memory 3004. On the other hand, the first communication device driver program 3003
Is downloaded from the first FD device 2002 connected to the first host computer device via a predetermined FD medium by the user. Once downloaded, the communication device driver program 3003 is stored in the hard disk 2003 and is not required every time the host computer is started.

Second operating system 5001
Is downloaded to the RAM 4001 from the second hard disk 4003 connected to the second host computer device. On the other hand, the device driver program 500
2. Second communication device driver program 5003
Is downloaded from the second FD device 4002 connected to the second host computer device via a predetermined FD medium by the user. Device driver program 5002, second communication device driver program 5
Once 003 is downloaded, it is stored in the hard disk 4003 and is not required every time the workstation apparatus is started.

Referring to FIG. 12, the function of the system software will be described. In FIG. 12, a window operation unit 6400 is an operation unit such as a mouse or a joystick.
A specific window is designated to be activated (or moved up) or moved. The change states of these windows are managed by the first operating system, and are sent to the image display window management unit 6300 and further to the barrier mask window management unit 6200 via this.

The barrier mask display drawing section 6000 is a section for developing a barrier mask pattern to be displayed on the barrier mask display section (that is, the barrier liquid crystal display device 2 for displaying a barrier mask). 50
04. The image display drawing unit 6100 stores a parallax composite image to be displayed on the liquid crystal display device 1 (the image display unit in FIG. 12), and includes the parallax composite image memory 3004 in FIG.

In FIG. 12, an image display window management unit 6300 represents a function realized by the first communication device driver 3003, and manages a window position and a size, a depth position between windows, and a display content. The management is performed, and the information is passed to the barrier mask window management unit 6200.

In FIG. 12, a barrier mask window management unit 6200 represents a function realized by the second communication device driver 5003, and includes a window position, a window size, a window depth position, and display contents. Is transferred from the image display window management unit 6300 to perform management. The barrier mask display drawing unit 6000
A mask pattern is generated based on these values.
This mask pattern is developed in the barrier mask memory 5004 and displayed on the display device 2.

FIGS. 13 and 14 are diagrams for explaining the principle of generating a mask pattern by the display system of the embodiment. FIG. 13 illustrates a case where the window having the highest depth position is a three-dimensional image, and FIG. 14 illustrates a case where the window having the highest depth position is a two-dimensional image. 13 and 14, reference numeral 1100 denotes a three-dimensional image memory space, and 1200 denotes a two-dimensional image memory space.

FIG. 13 shows a window 11 of a three-dimensional image.
10 (ie, the window for the application program 3002) is shown to be displayed at the topmost depth position, while the window 112 of the two-dimensional image is shown.
0 is indicated to be displayed at a depth position lower than the three-dimensional window 1110. The barrier mask display drawing unit 6000 includes a window 111 for a three-dimensional drawing area.
When 0 is detected as being at the highest level, a barrier mask value is drawn in an area corresponding to the area 1110 in the barrier mask memory 5004.

FIG. 14 illustrates the case where the window 1150 having the highest depth position is, for example, a two-dimensional image window displayed by the operating system for a user interface. In this case, the overlapping portion 1180 of the two-dimensional window 1150 and the three-dimensional window 1160 should be displayed as a two-dimensional image.
On the other hand, from the three-dimensional window 1160, the overlapping portion 11
The region excluding 80 should be displayed as a three-dimensional image. From the above, in the window system of the present embodiment, the barrier mask pattern is determined in the following procedure.

I: The barrier mask memory 5004 displays a two-dimensional image at an initial stage, when window position information, hierarchy information, type information is updated, or when a window is added or deleted. And That is, the liquid crystal panel 2 is configured to transmit light (make a white value) in all pixels. II: Depth position is represented by n, and the smaller the value of n, the lower the window position. III: comparing two windows whose depth positions are n-1 and n, and calculating the value of the mask area corresponding to the window area whose depth position is lower (n-1), if the n-position window is a three-dimensional window , A barrier mask pattern (checkered pattern), and if it is a two-dimensional window, a white value. IV: This operation is repeated until the depth value n points to the uppermost window.

FIG. 15 is a diagram showing the shape of the window display area for the application program used in this embodiment. In this embodiment, the window for the application program for displaying a three-dimensional image is not entirely used for displaying a three-dimensional image in the window, and as shown in FIG. ) Is drawn as a two-dimensional image. Usually, a multi-window window has a frame FR indicating that the window is a window. This is because the window frame FR is a frame, and thus it is preferable to display a two-dimensional image rather than a three-dimensional image. Therefore, only the client area _RC inside the window frame FR is used for three-dimensional image display.

FIGS. 16 and 17 show a control procedure for determining the mask pattern. When the application program 3002 for displaying a three-dimensional image is activated, the first communication device driver program 3003
Is notified from the first operating system 3001 that this application program 3002 uses a three-dimensional display device, and performs initialization for that in step S102. This initialization is performed when the first communication device driver program 3003 executes the following procedure from the first operating system 3001 with respect to a window for the operating system, a window of the application program, and a window of another application program. The operation of receiving information relating to the position and size of the client area and the depth position and storing them in a predetermined storage unit of the management unit 6300.

In step S104, the first communication device driver program 3003 communicates with the second communication device driver program 5003 to rewrite all pixel values of the barrier mask memory 5004 to white. The white value is a value that allows light to pass through all pixel positions of the barrier liquid crystal display device 2.

Each window is given a window number by the first operating system 3001 in advance. Therefore, in step S106, the counter n is set to "0" in order to select the deepest window (that is, the lowest window at the depth position).

In step S108, it is determined whether the window specified by the counter n is a window for displaying a three-dimensional image. The window specified by the counter n is n = 0 at first, and the lowest window is specified.

[0091] If the window (n) is a three-dimensional image, in step S110, the window of the (n), the window area position P _W · size S _W, the position P _C and the size S _C, the depth of the client area Information on the position D and the like is stored in the barrier mask window management unit 6200.

In the storing operation, the first communication device driver program 3003 sends the second communication device driver program 5003 the position and size of the window, the position and size of the client area, and the information on the depth position. And send them to the management unit 6
This means an operation of storing data in the predetermined storage unit 200.

In step S112, a white value is set for the frame area FR (FIG. 15) corresponding to the window (n) in the barrier mask memory 5004, and a barrier pattern is set for the area _RC corresponding to the client area. Write the value (checkered pattern).

The operations in steps S110 and S112 will be described with reference to FIG. 14. This corresponds to the fact that the barrier mask pattern has been written in the area in the barrier mask memory 5004 corresponding to the entire area 1160. The 14th
In the figure, illustration of the frame is omitted.

On the other hand, in step S108, window (n)
Is determined to be a two-dimensional image, step S120
Then, the window position P _W and the size of the window (n)
S _W, the information about the depth position D, and stored in the barrier mask window management unit 6200.

In the storing operation, the first communication device driver program 3003 sends information relating to the position, size, and depth position of the window to the second communication device driver program 5003, and transmits them to the management unit 6.
This means an operation of storing data in the predetermined storage unit 200.

Since the client area is also displayed two-dimensionally, there is no need to set information on the client area in the management unit 6200. In step S122, a white value is written into the barrier mask memory 5004 in an area (FR, R _C ) corresponding to the entire window of the window (n).

The operations in steps S120 and S122 will be described with reference to FIG. 13. This corresponds to writing white in the entire area in the barrier mask memory corresponding to area 1120. Note that the illustration of the frame is omitted in FIG.

At step S130 in FIG. 16, it is determined whether or not the counter n points to the uppermost window. n
Is the first operating system 3
Initially at 001, thereafter, every time a window is added or deleted, it is updated at step S144 based on the operating system.

If it does not point to the top, step S1
At 32, the value of the counter is increased by one, and a window one level higher is specified, and the process returns to step S108.

In step S108, it is determined whether or not the window (n) is for performing three-dimensional display. In the example of FIG. 14, since n = 1 is the highest order and window (n) is for two-dimensional display, the process proceeds from step S108 to step S120 and step S122, and corresponds to the highest order window (n). Write white over the entire area. In the example of FIG. 14, white is written in all areas in the barrier mask memory 5004 corresponding to the area 1150. As a result, in the area in the memory 5004, the overlapping portion of the area 1150 and the area 1160 (the area 118
Since the portion corresponding to 0) is returned to the white value, the first
In the example of FIG. 4, the part displayed three-dimensionally is a "" -shaped area.

If it is determined in step S108 that the uppermost window (n) performs three-dimensional display, that is, in the example of FIG. 13, in step S110 and step S112, the barrier mask memory 5004
In the area, the barrier mask value is drawn in an area corresponding to the area 1110.

Thus, if a window at a certain depth position n is used for three-dimensional display, except for a region common to all the two-dimensional display windows at a depth position m (> n) larger than n. , Barrier mask memory 50
Since a barrier mask pattern value for three-dimensional display is written in 04, a three-dimensional image is appropriately displayed in such an area.

On the other hand, if a window at a certain depth position p is used for two-dimensional display, an area of a common part with all three-dimensional display windows at a depth position q (> p) larger than p is excluded. And the barrier mask memory 500
Since a white value is written in 4 for two-dimensional display, a two-dimensional image is appropriately displayed in such an area.

Further, as shown in FIG. 15, even if the window is for a three-dimensional image, the surrounding frame region FR is two-dimensionally displayed, and only the client region is properly three-dimensionally displayed. Therefore, the window frame is displayed as a two-dimensional image without lowering the resolution of the frame region FR. The reason for this is that the window frame is provided with various button icons, scroll bar icons, and the like for the user interface, and it becomes difficult to use these icons instead of displaying them three-dimensionally.

Steps S106 to S132 are
Once all the windows to be displayed at a certain point have been determined, whether all of those windows should be displayed two-dimensionally or three-dimensionally, starting from the lowest window to the highest window , The value of the barrier mask memory 5004 has been determined. That is, in the processing of steps S106 to S132, the setting of the two-dimensional display or the three-dimensional display according to the display purpose of all the windows is made. Steps S140 and S142 in FIG.
Is to check whether the window state has been changed by the operation of the user. That is, depending on, for example, whether the user has activated a certain lower window, activated (stopped) another application program, and increased (decreased) the number of windows, or changed the size or position of the windows. Inspect if the window state ST has changed. Since the change ST is grasped by the operating system, the change ST is determined in step S
At 144, it is passed to the management unit 6200, and the process returns to step S106. By this processing, the latest window state,
An appropriate two-dimensional or three-dimensional display is made.

<Case where there is one three-dimensional window> The control procedure of FIG. 16 has been described for the case where there are a plurality of windows for three-dimensional images. However, the control procedure of FIG. Will be described. The difference between the control procedure of FIG. 17 and the control procedure of FIG. 16 is that, in the former, steps S110 and S112 of the latter are different.
Steps S110 'and S112' have been replaced.

In the control procedure shown in FIG. 16, that is, when there are a plurality of three-dimensional image windows, even when the three-dimensional image window overlaps the three-dimensional image window,
The frame region FR (FIG. 15) of the three-dimensional display window was displayed two-dimensionally.

The control means shown in FIG. 17, that is, one window for three-dimensional images means that the frame area FR
(FIG. 15) is always displayed in two dimensions.

In such a case, step S11
0 ', the position of the window as in step S112',
As the size, skip value of the position P _W and the window size S _W, the client area position P _C and the client area size
It may be used S _C. Further, Step S110 ', Step S112' as the window position, as the size, skip value of the window position P _W and the window size S _W, the client area position P _C and the client area size
With S _C, the process is further reduced as compared with the control method of FIG. 16.

<Improvement Considering Viewpoint Position Movement> The embodiment shown in FIG. 12 does not consider movement of the user's viewpoint position. The modification shown in FIG. 18 is obtained by adding an improvement considering the movement of the viewpoint position to the above embodiment, and the management unit 6200 is configured to input the output of the viewpoint position sensor 6500. .

In this modification, as a result of moving the viewpoint position by d in the vertical direction, as shown in FIG. 19, the moving amount d of the boundary between the two-dimensional image window and the three-dimensional image window is changed.
_The problem is that _x shifts by k (k is an integer) pixels or more of the barrier mask. In the example of FIG. 19, the shift amount is

[Equation 1]

As a result, if [] represents a rounding operation,

[Equation 2]

If [0116] the barrier window and the window area position P _W for two-dimensional and three-dimensional images, the longitudinal value of the client area position P _C for three-dimensional image window in a position moved by the value of the k Draw the mask.

<Further Modified Example> In the above embodiment, the example of the lenticular type display has been described. However, the present invention can be applied to a display device other than the lenticular type display. The present invention can be applied to all types of stereoscopic displays commonly used for three-dimensional images and three-dimensional images.

Further, in the above description, the window has been mainly described as an object. However, the same configuration holds for other objects such as icons, and the same effect can be obtained.

The present embodiment can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), and can be applied to a single device (for example, a copier, Facsimile machine, etc.).

An object of the present embodiment is to supply a storage medium storing program codes of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU or MPU) of the system or the apparatus. Needless to say, this can also be achieved by reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present embodiment.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0125]

As described above, according to the present invention, in the display device where the optical path of the display device for displaying the left and right parallax images and the optical path of the display device for spatial modulation overlap, the area to be displayed two-dimensionally. Even if the area to be displayed three-dimensionally overlaps, neither display is deteriorated.

[Brief description of the drawings]

FIG. 1 is a hierarchical diagram of a typical computer system using a GUI as an operating system.

FIG. 2 is a basic configuration diagram of a conventional stereoscopic image display device.

FIG. 3 is a configuration diagram of a display unit of a stereoscopic image display device including a conventional liquid crystal panel display and an electronic barrier.

FIG. 4 is a diagram showing a difference in a parallax barrier pattern formed on an electronic parallax barrier according to a difference in the number of viewpoints.

FIG. 5 is a diagram illustrating a three-dimensional image display device that enables a mixed display by switching between two-dimensional display and three-dimensional display.

FIG. 6 is a diagram for explaining the principle that left and right parallax images are horizontally separated and observed by both eyes of a user.

FIG. 7 is a schematic side view of a cross section in a vertical direction of a three-dimensional image display device using a cross lenticular method.

FIG. 8 is a side view of a vertical cross section of the stereoscopic image display device according to the embodiment.

9 is a diagram illustrating a stereoscopic image display method by the stereoscopic display device shown in FIG.

FIG. 10 is a diagram illustrating a method of displaying a three-dimensional image and a two-dimensional image in a mixed manner by the stereoscopic display device shown in FIG. 5;

FIG. 11 is a block diagram illustrating a configuration of a stereoscopic display system according to the embodiment.

FIG. 12 is a block diagram illustrating a software configuration of the stereoscopic display system according to the embodiment.

FIG. 13 is a diagram illustrating a procedure for drawing a barrier mask in the embodiment.

FIG. 14 is a diagram illustrating a procedure for drawing a barrier mask in the embodiment.

FIG. 15 is a diagram illustrating that display is divided into a frame and a client area in a three-dimensional image window.

FIG. 16 is a flowchart illustrating a control procedure according to the embodiment.

FIG. 17 is a flowchart illustrating a control procedure according to a modification.

FIG. 18 is a block diagram illustrating a configuration of a device according to a modification.

FIG. 19 is a diagram illustrating a principle of correcting a boundary position between two-dimensional and three-dimensional when a viewpoint position moves.

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] February 7, 2001 (2001.2.7)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claim 3

[Correction method] Change

[Correction contents]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] Claim 11

[Correction method] Change

[Correction contents]

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] Claim 19

[Correction method] Change

[Correction contents]

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] Claim 22

[Correction method] Change

[Correction contents]

[Procedure amendment 5]

[Document name to be amended] Statement

[Correction target item name] Claim 30

[Correction method] Change

[Correction contents]

[Procedure amendment 6]

[Document name to be amended] Statement

[Correction target item name] Claim 34

[Correction method] Change

[Correction contents]

[Procedure amendment 7]

[Document name to be amended] Statement

[Correction target item name] Claim 43

[Correction method] Change

[Correction contents]

[Procedure amendment 8]

[Document name to be amended] Statement

[Correction target item name] 0023

[Correction method] Change

[Correction contents]

According to a preferred aspect of the present invention, the data value of the barrier mask pattern for the two-dimensional image object is converted to the data value for the two-dimensional image object on the display device for spatial modulation. The first data value is set so that the barrier mask indicates light transmittance, and the data value of the barrier mask pattern for the three-dimensional image display object is set to the left-eye spatial modulation element and the right-eye spatial modulation element of the spatial modulation display device. The second data value and the third data value are selectively set so that the spatial modulation element alternately exhibits light transmission and light blocking properties.

[Procedure amendment 9]

[Document name to be amended] Statement

[Correction target item name] 0040

[Correction method] Change

[Correction contents]

According to a preferred aspect of the present invention, a data value of a mask pattern for a two-dimensional image object is stored in a mask for the two-dimensional image object on the display device for spatial modulation. Is set to a first data value indicating light transmission ;

[Procedure amendment 10]

[Document name to be amended] Statement

[Correction target item name] 0088

[Correction method] Change

[Correction contents]

In step S104, the first communication device driver program 3003 communicates with the second communication device driver program 5003 to rewrite all pixel values of the barrier mask memory 5004 to white. This white value is a value that transmits light at all pixel positions of the barrier liquid crystal display device 2 .

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 2H088 EA05 EA06 HA06 HA26 HA28 MA01 5C006 AF38 BB08 BB11 BC16 BF15 EC12 5C061 AA07 AA08 AA11 AB17 AB18 5C080 AA10 BB05 CC04 DD01 EE19 JJ01 JJ02 JJ27 BA023 CA62 CB01 DA54 DA87 MM10

Claims (46)

[Claims] 1. A display control device for controlling a barrier mask memory for storing barrier mask data and a display device, and capable of displaying a two-dimensional image object and a three-dimensional image object on the display device. , For a plurality of objects to be displayed, display position information indicating the display position and size of the object, hierarchical information indicating the display hierarchical position of the object, and whether the image of the object is a two-dimensional image or three-dimensional Managing means for managing type information indicating a type of image; and storing barrier mask data in the barrier mask memory, by changing a data value of a barrier mask pattern for an upper object in an upper layer to a lower value in a lower layer. Better than the data value of the barrier mask pattern for the object , The display control apparatus characterized by comprising a write control means for writing said barrier mask memory. 2. The display device includes a display device for spatial modulation for displaying barrier mask data for spatial modulation, and a display device for displaying a parallax image placed on an optical path of the display device for spatial modulation. On the display device for displaying parallax images, together with the display device for spatial modulation, mixed display of a two-dimensional image object and a three-dimensional image object is enabled, and the display device for spatial modulation includes a transmissive liquid crystal element. The display control device according to claim 1, further comprising: 3. The first data, wherein the data value of the barrier mask pattern for the two-dimensional image object is light-transmitted by the barrier mask for the two-dimensional image object on the display device for spatial modulation. The spatial light modulating element for the left eye and the spatial light modulating element for the right eye of the spatial light modulating display device alternately transmit the light transmissivity and the light blocking property of the barrier mask pattern for the three-dimensional image display object. 3. The display control device according to claim 1, wherein the display control device selectively sets the second data value and the third data value as follows. 4. 4. When writing a barrier mask pattern in the barrier mask memory, the writing control means initializes, or when position information, hierarchy information, and type information of the object are updated, or When the object is added or deleted, all values of the barrier mask memory are written as data values indicating light transmittance of all elements of the display device for spatial modulation, and Starting from an object and sequentially reaching a top-level object, a barrier mask pattern for the object is sequentially written in the barrier mask memory while referring to display position information and type information of the object. The display control device according to claim 1. 5. The display control device according to claim 1, wherein the object is a window. 6. The display position information for a window object includes display position information of a window frame and display position information for displaying client data. Even when the client data of the window object is a three-dimensional image, The display control device according to claim 5, wherein barrier mask pattern data corresponding to a window frame of the object includes the first data value. 7. The method according to claim 1, further comprising: inputting viewpoint information of a user; and correcting a data value of a barrier mask pattern in a barrier mask memory based on the value of the viewpoint position. The display control device according to claim 1. 8. A user adds or deletes a window, or moves or resizes a window,
Alternatively, when the window of interest is changed, the management means:
The display control device according to claim 1, wherein the position information, the hierarchy information, and the type information are updated. 9. The display control device according to claim 8, wherein addition or deletion of the window is caused by an event of a user starting or stopping an application program. 10. The method according to claim 8, wherein the addition or deletion of the window, the movement or size change of the window, or the change of the focused window is caused by an operation event of the pointing device by the user.
3. The display control device according to 1. 11. The parallax image display device according to claim 1, wherein the parallax image display device displays a parallax composite image in which striped parallax images for left eye and right eye are alternately arranged. A display control device according to the item. 12. A display control method for controlling a barrier mask memory for storing barrier mask data and a display device, and enabling display of a two-dimensional image object and a three-dimensional image object on the display device. , For a plurality of objects to be displayed, display position information indicating the display position and size of the object, hierarchical information indicating the display hierarchical position of the object, and whether the image of the object is a two-dimensional image or three-dimensional A management step of managing type information indicating a type of an image; and, when storing barrier mask data in the barrier mask memory, changing a data value of a barrier mask pattern for an upper object in an upper layer to a lower value in a lower layer. Than the data value of the barrier mask pattern for the object Above, the display control method characterized by comprising a write control step of writing to the barrier mask memory. 13. The display device includes a display device for spatial modulation for displaying barrier mask data for spatial modulation, and a display device for parallax image display placed on an optical path of the display device for spatial modulation. On this parallax image display device, the two-dimensional image object and the three-dimensional image object can be mixedly displayed together with the spatial modulation display device, and the spatial modulation display device includes a transmissive liquid crystal element. 13. The display control method according to claim 12, comprising: 14. The data value of a barrier mask pattern for a two-dimensional image object, the first data being such that the barrier mask for the two-dimensional image object on the display device for spatial modulation shows optical transparency. The spatial light modulating element for the left eye and the spatial light modulating element for the right eye of the spatial light modulating display device alternately transmit the light transmissivity and the light blocking property of the barrier mask pattern for the three-dimensional image display object. 14. The display control method according to claim 12, wherein the second data value and the third data value are selectively set to indicate the following. 15. When writing a barrier mask pattern in the barrier mask memory, the writing control step may be performed at an initial stage or when position information, hierarchy information, or type information of the object is updated, or When the object is added or deleted, all values of the barrier mask memory are written as data values indicating light transmittance of all elements of the display device for spatial modulation, and Starting from an object and sequentially reaching a top-level object, a barrier mask pattern for the object is sequentially written in the barrier mask memory while referring to display position information and type information of the object. The display control method according to any one of claims 12 to 14. 16. The display control method according to claim 12, wherein the object is a window. 17. The display position information for a window object includes display position information for a window frame and display position information for displaying client data. Even if the client data of the window object is a three-dimensional image, 17. The display control method according to claim 16, wherein barrier mask pattern data corresponding to a window frame of the object includes the first data value. 18. The method according to claim 12, wherein information on a viewpoint position of the user is input, and the data value of the barrier mask pattern in the barrier mask memory is corrected based on the value of the viewpoint position. Display control method described in the paragraph. 19. When a user adds or deletes a window, moves or changes the size of a window, or changes a window of interest, the management step performs the position information, the hierarchy information, and the type information. 19. The display control method according to claim 12, wherein is updated. 20. The display control method according to claim 19, wherein addition or deletion of a window is caused by an event of a user starting or stopping an application program. 21. The method according to claim 1, wherein the addition or deletion of the window, the movement or change of the size of the window, or the change of the window of interest is caused by an operation event of the pointing device by the user.
10. The display control method according to 9. 22. The parallax image display device according to claim 12, wherein the parallax image display device displays a parallax composite image in which striped parallax images for left eye and right eye are alternately arranged. Display control method described in the paragraph. 23. A program storage medium for storing a program for implementing the display control method according to claim 12 on a computer. 24. A display system for displaying a three-dimensional image object together with another object, wherein barrier mask data is displayed for spatial modulation so that a two-dimensional image object and a three-dimensional image object are mixedly displayed. A stereoscopic display device having a display device for spatial modulation, a display device for parallax image display arranged on the optical path of the display device for spatial modulation and dividing and displaying the left and right parallax images, and the stereoscopic display device is connected. The first host computer device, wherein the display device for displaying parallax images,
The parallax composite image memory for displaying a parallax composite image in which striped parallax images for the left eye and the right eye are alternately arranged, a first operating system, and the parallax image display device. An application program for displaying a composite image, and the first operating system, for each object, a display position at which the object is displayed on the display device for displaying parallax images, and display position information regarding the size of the object. And a first communication device driver program for managing and transmitting type information indicating a type of a two-dimensional image or a three-dimensional image of an image of the object, and hierarchical information indicating a display hierarchical position of the object. First
A first host computer device having a memory of the following, and a second host computer device connected to the stereoscopic display device, wherein the barrier mask memory stores the barrier mask data to be displayed on the display device for spatial modulation. A second operating system, a device driver program for controlling the barrier mask memory, a display position for displaying the object on the display device for displaying parallax images, display position information relating to a size of the object, and the object A second communication device driver program for receiving and managing hierarchy information indicating the display hierarchy position of the object and type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image. The second host computer device having a memory, The device driver program stores, in the barrier mask memory, for each object, a display position at which the object is displayed on the display device for displaying parallax images, display position information regarding the size of the object, and a display hierarchy position of the object. A barrier pattern is stored based on hierarchical information indicating the type of the image of the object and the type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image. A data value of a barrier mask pattern for an upper-level object in (1) is written to the barrier mask memory in preference to a data value of a barrier mask pattern for a lower-level object in a lower hierarchy. 25. A display device for spatial modulation for displaying barrier mask data for spatial modulation in order to display a mixture of a two-dimensional image object and a three-dimensional image object, and a display device on the optical path of the spatial modulation display device. A first communication device driver program stored in a first memory of a first host computer connected to a stereoscopic display device having a disparity image display device that disposes and displays the left and right parallax images by division. For each object, a display position at which the object is displayed on the display device for displaying parallax images, display position information relating to the size of the object, hierarchical information indicating a display hierarchical position of the object, and A type for managing and transmitting type information indicating whether the image is a two-dimensional image or a three-dimensional image. Program storage medium grams code is stored. 26. A display device for spatial modulation for displaying barrier mask data for spatial modulation in order to display a mixture of a two-dimensional image object and a three-dimensional image object, and a display device on the optical path of the spatial modulation display device. A second communication device driver program stored in a second memory of a second host computer connected to a three-dimensional display device having a display device for displaying a parallax image that is arranged and divides the left and right parallax images for display. For each object, a display position at which the object is displayed on the display device for displaying parallax images, display position information relating to the size of the object, hierarchical information indicating a display hierarchical position of the object, and A type for receiving and managing type information indicating whether the image is a two-dimensional image or a three-dimensional image. Program storage medium grams code is stored. 27. A display device for spatial modulation for displaying barrier mask data for spatial modulation in order to display a mixture of a two-dimensional image object and a three-dimensional image object, and a display device on the optical path of the spatial modulation display device. A device driver program stored in a second memory of a second host computer to which a stereoscopic display device having a display device for displaying a parallax image that is arranged and divides and displays the left and right parallax images is connected, The device driver program displays, in the barrier mask memory, for each object, a display position at which the object is displayed on the parallax image display device, display position information relating to the size of the object, and a display hierarchy position of the object. Hierarchy information and whether the image of the object is a 2D image or 3D image Based on the type information indicating the type, the barrier pattern is stored, and the barrier mask data is stored in the barrier mask memory. A program storage medium storing a program code to be written into the barrier mask memory in preference to a data value of a barrier mask pattern for a lower-order object. 28. A display control device capable of displaying a mixture of a two-dimensional image object and a three-dimensional image object, the display control device comprising: a plurality of objects to be displayed; Management means for managing hierarchy information indicating the display hierarchy position of the object, type information indicating whether the image of the object is a two-dimensional image or a three-dimensional image, and a display for displaying the object in a memory. When storing data, write control means for writing the data value of the mask pattern for the upper object in the upper hierarchy to the memory in preference to the data value of the mask pattern for the lower object in the lower hierarchy, Displaying the plurality of objects based on the mask pattern written to the memory; And a display means for performing the following. 29. The display control device according to claim 28, wherein said display means is a display device for spatial modulation that forms said mask pattern by spatial modulation. 30. The data value of a mask pattern for a two-dimensional image object into a first data value such that the mask for the two-dimensional image object on the display device for spatial modulation indicates optical transparency. The data value of the mask pattern for the three-dimensional image display object is set, and the spatial light modulating element for the left eye and the spatial light modulating element for the right eye of the spatial light modulating display device show light transmittance and light blocking property alternately. 30. The display control device according to claim 29, wherein the second data value and the third data value are selectively set as described above. 31. When writing a mask pattern in the mask memory, the writing control means may be configured to initialize, or to update position information, hierarchy information, or type information of the object, or Is added or deleted, all the values of the mask memory are written as data values indicating light transmittance of all elements of the display device for spatial modulation, and then starting from the object at the lowest hierarchical position 28. The method according to claim 28, further comprising sequentially writing a mask pattern for the object in the mask memory until the top object is reached, while referring to display position information and type information of the object. 30. The display control device according to any one of 30. 32. The object is a window,
The display position information for the object includes the display position information of the window frame and the display position information for displaying the client data. Even if the client data of the window object is a three-dimensional image, the display position information of the object is displayed in the window frame. 32. The display control device according to claim 28, wherein the corresponding mask pattern data includes the first data value. 33. The apparatus according to claim 28, wherein information on a viewpoint position of a user is input, and a data value of a mask pattern in a mask memory is corrected based on the value of the viewpoint position. A display control device according to the item. 34. When a user adds or deletes a window, moves or changes the size of a window, or changes a window of interest, the management unit sets the position information, the hierarchy information, and the type information. 34. The method according to claim 28, wherein
A display control device according to the item. 35. The display control device according to claim 34, wherein addition or deletion of a window is caused by an event of a user starting or stopping an application program. 36. The method according to claim 3, wherein the addition or deletion of the window, the movement or size change of the window, or the change of the window of interest is caused by an operation event of the pointing device by the user.
5. The display control device according to 4. 37. A display control method capable of displaying a mixture of a two-dimensional image object and a three-dimensional image object, comprising: displaying a plurality of objects to be displayed; A management step of managing hierarchy information indicating a display hierarchy position of the object and type information indicating a type of an image of the object as a two-dimensional image or a three-dimensional image; and a display for displaying the object in a memory. A writing control step of writing the data value of the mask pattern for the upper object in the upper hierarchy to the memory in preference to the data value of the mask pattern for the lower object in the lower hierarchy when storing the data; Displaying the plurality of objects based on the mask pattern written to the memory; And a display step of performing the following. 38. The display control method according to claim 37, wherein in said display step, display is performed on a spatial modulation display device that forms said mask pattern by spatial modulation. 39. The data value of a mask pattern for a two-dimensional image object into a first data value such that the mask for the two-dimensional image object on the display device for spatial modulation indicates optical transparency. The data value of the mask pattern for the three-dimensional image display object is set, and the spatial light modulating element for the left eye and the spatial light modulating element for the right eye of the spatial light modulating display device show light transmittance and light blocking property alternately. 39. The display control method according to claim 38, wherein the second data value and the third data value are selectively set as described above. 40. When writing a mask pattern in the mask memory, the writing control step may be performed at an initial stage or when position information, hierarchy information, or type information of the object is updated, or Is added or deleted, all the values of the mask memory are written as data values indicating light transmittance of all elements of the display device for spatial modulation, and then starting from the object at the lowest hierarchical position 37. The method according to claim 37, further comprising sequentially writing a mask pattern for the object in the mask memory until the top object is reached, with reference to the display position information and the type information of the object. 40. The display control method according to any one of items 39. 41. The object is a window,
The display position information for the object includes the display position information of the window frame and the display position information for displaying the client data. Even if the client data of the window object is a three-dimensional image, the display position information of the object is displayed in the window frame. The display control method according to any one of claims 37 to 40, wherein corresponding mask pattern data includes the first data value. 42. The apparatus according to claim 37, wherein information on the viewpoint position of the user is input, and the data value of the mask pattern in the mask memory is corrected based on the value of the viewpoint position. Display control method described in the paragraph. 43. When a user adds or deletes a window, moves or changes the size of a window, or changes a window of interest, the management step performs the position information, the hierarchy information, and the type information. 43. The method according to claim 37, wherein
Display control method described in the paragraph. 44. The display control method according to claim 43, wherein addition or deletion of a window is caused by an event of a user starting or stopping an application program. 45. The method according to claim 4, wherein the addition or deletion of the window, the movement or change of the size of the window, or the change of the window of interest is caused by an operation event of the pointing device by the user.
3. The display control method according to 3. 46. A program storage medium for storing a program for implementing the display control method according to claim 37 on a computer.