KR101560474B1 - Apparatus and method for providing 3d user interface using stereoscopic image display device - Google Patents

Abstract

A stereoscopic display device for providing a three-dimensional user interface according to embodiments of the present invention includes a stereoscopic display and a three-dimensional depth sensor for acquiring a three-dimensional depth image for a three-dimensional real space in front of a stereoscopic display, A 3D motion analyzer for acquiring positional information of a user's face or an eyeball using a depth image, a UI processor for generating a UI image including UI controls, and a stereoscopic UI image converted from the UI image, And a formatter for converting the UI image into the stereoscopic UI image according to the UI depth information.

Description

TECHNICAL FIELD [0001] The present invention relates to a stereoscopic display device and a stereoscopic display device,

The present invention relates to stereoscopic image technology, and more particularly, to a user interface technique for stereoscopic images.

Stereoscopic image technology is a typical stereoscopic image technology. In this stereoscopic image technology, two separated images are inputted so that they do not interfere with each other's left and right eyes. It is a technique to make a virtual three-dimensional feeling to be synthesized.

The two kinds of images to be inputted to the left eye and the right eye can be obtained based on the left and right images taken by two cameras arranged so as to be separated from each other by the binocular distance of the person. Two stereoscopic images obtained by two cameras have a disparity between pixels corresponding to the same subject. Depth of the subject is generated by the disparity, When the scopic images are input to the left and right eyes respectively, the viewer can feel the three-dimensional feeling by the subjects having different depth information.

A polarization method, a time division method, and a spectrum division method are used as methods for inputting images that do not cause interference to the left eye and the right eye, respectively.

In the polarization scheme, a polarizing filter for polarizing the light emitted from the left video lines for the left eye and the light emitted from the right video lines for the right eye to orthogonally cross each other is attached to the stereoscopic display. The left and right images are separated and recognized. The light emitted from the left image lines passes through only the left eye polarizing filter of the polarizing glasses and enters the left eye only and the light emitted from the right image lines passes through only the right eye polarizing filter of the polarizing glasses and enters only the right eye, And the right image is combined to feel a three-dimensional feeling.

In the time-division method, the left image for the left eye and the right image for the right eye are alternately displayed on the stereoscopic display, and the user sees the left image and the right image separately by wearing active shutter glasses. The active shutter glasses are synchronized with the stereoscopic display. When the left image is displayed, the left eye shutter is opened to allow the left eye to recognize the left image. When the right image is displayed, the right eye shutter is opened to allow the right eye to recognize the right image. The left image and the right image are combined and the three-dimensional image is sensed.

In the spectral method, the stereoscopic display displays the left and right images through a spectral filter having a spectrum band that does not overlap with each other in the RGB spectrum, and the user sees the left and right images by wearing the spectral filter glasses.

In any stereoscopic method, the user feels stereoscopic because the depth information is generated according to the disparity of the subject.

Traditionally, display devices have a close relationship with the user interface. Conventional display user interfaces display various user interface objects or controls superimposed on an image displayed on a 2D display device and allow the user to manipulate user interface objects or controls using a mouse, a keyboard, a wireless pointer, a finger touch screen, .

Such a 2D interface is usually used for a stereoscopic display device. A 2D interface screen superimposed on a stereoscopic image having a deep feeling can confuse the stereoscopic feeling that the user feels. Also, if you try to use a mouse, a wireless pointer, or a touch screen to look at stereoscopic images, or try to find a TV remote control, you will not be satisfied with the user's satisfaction.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a stereoscopic display apparatus and method for providing a three-dimensional user interface.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a stereoscopic display device and a method for providing a three-dimensional user interface that gives a natural depth to a user.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a stereoscopic display apparatus and method that provide a three-dimensional user interface that gives a user natural feedback on three-dimensional controls.

The solution to the problem of the present invention is not limited to those mentioned above, and other solutions not mentioned can be clearly understood by those skilled in the art from the following description.

A stereoscopic display apparatus for providing a three-dimensional user interface according to an aspect of the present invention includes:

A stereoscopic display;

A three-dimensional depth sensor for obtaining a three-dimensional depth image of a frontal three-dimensional real space of the stereoscopic display;

A 3D motion analyzer for acquiring positional information of a user's face or eyeball using the 3D depth image;

A UI processing unit for generating a UI image including UI controls; And

The UI depth information is determined so that the stereoscopic UI image converted from the UI image is recognized at a predetermined position within a user's arm length and the UI image is converted into the stereoscopic UI image according to the UI depth information .

According to one embodiment, the 3D motion analyzer

To obtain position information and motion information of a user's fingertip,

The UI processing unit

It is possible to determine whether the position information and operation information of the user's fingertip corresponds to a specific UI control in the stereoscopic UI image and generate a UI image in which a specific UI control is visually modified according to the determination result.

According to one embodiment, the 3D depth sensor

Wherein the stereoscopic display comprises at least two image sensors arranged to face the user on a plane of the stereoscopic display or on a plane parallel to the screen so that a three dimensional depth image of the front three- Lt; / RTI >

The 3D motion analyzer

Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and obtaining position information of the user's face or eyeball from the identified face region have.

According to one embodiment, the 3D depth sensor

At least two image sensors arranged to face the user on a plane of the stereoscopic display screen or on a plane parallel to the screen so that the three dimensional depth image and the two dimensional image of the front real space of the stereoscopic display Respectively,

The 3D motion analyzer

Dimensional image, and to obtain positional information of the user's face or eyeball from a specific region within the three-dimensional depth image corresponding to the face region extracted from the two-dimensional image have.

According to one embodiment, the 3D depth sensor

Dimensional depth image by emitting a structured light and detecting reflected light reflected from the subject and analyzing the deformed shape of the detected reflected light,

The 3D motion analyzer

Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and obtaining position information of the user's face or eyeball from the identified face region have.

According to one embodiment, the stereoscopic UI image is

In a polygon in which a quadrangular pyramid of a viewing angle from a user's eyeball to a screen of the stereoscopic display from a user's eye and a plane specified by the UI depth information and parallel to the screen of the stereoscopic display meet, The UI control may be recognized.

According to one embodiment, the UI depth information may be determined according to the distance between the user and the stereoscopic display.

According to one embodiment, the stereoscopic display apparatus includes:

The stereoscopic image display apparatus may further include an image synthesizing unit synthesizing the stereoscopic UI image transmitted from the formatter on the stereoscopic content image being displayed and transmitting the synthesized stereoscopic image to the stereoscopic display.

According to one embodiment, the UI processing unit

The UI control may be arranged to place the UI control such that the UI control overlaps over the background layer by avoiding the object layers that are seen to be protruding from the stereoscopic content image.

According to another aspect of the present invention, there is provided a method of providing a 3D user interface using a stereoscopic display device,

Generating a UI image including UI controls;

Determining UI depth information such that a stereoscopic UI image transformed from the UI image is recognized at a predetermined position within a user's arm length; And

And displaying the stereoscopic UI image converted from the UI image on the stereoscopic display according to the UI depth information.

According to one embodiment, determining the UI depth information comprises:

Obtaining a three-dimensional depth image of a frontal three-dimensional real space of the stereoscopic display using a three-dimensional depth sensor disposed in a plane that is the same as or parallel to the screen of the stereoscopic display;

Acquiring position information of a user's face or eyeball from the 3D depth image; And

And determining the UI depth information from the position information of the user's face or eyeball.

According to an embodiment, the 3D user interface providing method includes:

Obtaining position information and operation information of a user's fingertip from the 3D depth image; And

Determining whether the position information and the operation information of the fingertip of the user corresponds to a specific UI control in the stereoscopic UI image and generating a UI image in which a specific UI control is visually modified according to the determination result .

According to one embodiment, acquiring a 3D depth image for the 3D real space of the front of the stereoscopic display

Dimensional depth image for the three-dimensional real space in front of the stereoscopic display using at least two image sensors arranged to face the user on a plane formed by the screen of the stereoscopic display or parallel to the screen Comprising:

The step of acquiring the position information of the user's face or eyeball from the 3D depth image

Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and acquiring position information of the user's face or eyeball from the identified face region can do.

According to one embodiment, acquiring a 3D depth image for the 3D real space of the front of the stereoscopic display

Dimensional depth image and a two-dimensional image of the real space of the front face of the stereoscopic display using at least two image sensors arranged to face the user on a plane of the stereoscopic display screen or on a plane parallel to the screen, Respectively,

The step of acquiring the position information of the user's face or eyeball from the 3D depth image

A step of first extracting an area identified by the user's face in the two-dimensional image and acquiring position information of the user's face or eyeball from a specific area in the three-dimensional depth image corresponding to the face area extracted from the two- .

According to one embodiment, acquiring a 3D depth image for the 3D real space of the front of the stereoscopic display

Extracting the structured light, detecting reflected light reflected from the subject, and analyzing the deformed shape of the detected reflected light to obtain the 3D depth image,

The step of acquiring the position information of the user's face or eyeball from the 3D depth image

Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and acquiring position information of the user's face or eyeball from the identified face region can do.

According to one embodiment, the stereoscopic UI image is

In a polygon in which a quadrangular pyramid of a viewing angle from a user's eyeball to a screen of the stereoscopic display from a user's eye and a plane specified by the UI depth information and parallel to the screen of the stereoscopic display meet, The UI control may be recognized.

According to one embodiment, the UI depth information may be determined according to the distance between the user and the stereoscopic display.

According to one embodiment, the 3D user interface providing method comprises:

Synthesizing the stereoscopic UI image on the stereoscopic content image being displayed on the stereoscopic display, and displaying the synthesized stereoscopic image on the stereoscopic display.

According to one embodiment, the step of generating a UI image comprising the UI controls

And creating the UI image by disposing the UI control so that the UI control overlaps the object layers of the stereoscopic content image that appear to be overlaid on the background layer.

According to the stereoscopic display apparatus and method for providing a three-dimensional user interface of the present invention, it is possible to provide a three-dimensional user interface that gives a natural depth to a user.

According to a stereoscopic display apparatus and method for providing a three-dimensional user interface of the present invention, it is possible to provide a three-dimensional user interface that gives a user natural feedback about three-dimensional controls.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a block diagram illustrating a stereoscopic display apparatus providing a three-dimensional user interface according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a 3D user interface provided by a stereoscopic display apparatus according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating a method for providing a 3D user interface using a stereoscopic display apparatus according to an embodiment of the present invention.

For the embodiments of the invention disclosed herein, specific structural and functional descriptions are set forth for the purpose of describing an embodiment of the invention only, and it is to be understood that the embodiments of the invention may be practiced in various forms, The present invention should not be construed as limited to the embodiments described in Figs.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

1 is a block diagram illustrating a stereoscopic display apparatus providing a three-dimensional user interface according to an embodiment of the present invention.

Referring to FIG. 1, a stereoscopic display apparatus 10 for providing a 3D user interface (UI) includes a 3D depth sensor 11, a 3D motion analyzer 12, a UI processor 13, A formatter 14, an image synthesizer 15, and a stereoscopic display 16, as shown in FIG.

The user can appreciate the stereoscopic images displayed on the stereoscopic display 16 within a comfort zone at a distance from the front of the stereoscopic display 16. [

Further, the user can manipulate the 3D object or 3D control (hereinafter referred to as UI control) displayed in harmony with the stereoscopic image in a state of feeling a predetermined depth, By instantly recognizing it stereoscopically by the change of the position or the form, it can naturally perceive the feedback on the operation of the user.

In one embodiment, the three-dimensional depth sensor 11 includes at least two image sensors arranged to face the user on a plane of the screen of the stereoscopic display 16 or on a plane parallel to the screen, such that the stereoscopic display 16) and a three-dimensional depth image of the user's body.

In this case, in one embodiment, the 3D motion analyzer 12 analyzes the 3D depth image to obtain position information of the user's face or eyeball, position information of the user's finger tip, and motion information, respectively.

For example, assuming that the user is sitting in a comfortable listening position at a certain distance from the stereoscopic display 16 in front of the stereoscopic display 16, Extracts features of the body part in the 3D depth image for the space, identifies the face area and the fingertip area of the user by the extracted feature points, Position information of the fingertip, and operation information.

Here, since the position information is position information in the 3D depth image, the position information of the user's face or eyeball includes depth information of the user's face or eyeball, and the position information of the user's fingertip includes depth information of the user's fingertip do.

In another embodiment, the 3D depth sensor 11 includes at least two image sensors arranged to face the user on a plane of the screen of the stereoscopic display 16 or on a plane parallel to the screen, such that the stereoscopic display 16) and the three-dimensional depth image and the two-dimensional image of the user's body, respectively. At this time, the 3D depth image can be acquired by stereo matching the images captured by the two image sensors, and the 2D image can be acquired based on the image captured by at least one of the two image sensors.

In this case, in one embodiment, the three-dimensional motion analyzing unit 12 uses the three-dimensional depth image and the two-dimensional image together to calculate the position information of the user's face or eyeball, Respectively.

In another embodiment, the three-dimensional motion analyzer 12 first extracts the area identified by the user's face and the area identified by the finger in the two-dimensional image of the user's body in front of the real space of the stereoscopic display 16 And acquire positional information of the user's face or eyeball and positional information and operation information of the user's fingertip, respectively, from the specific regions in the three-dimensional depth image corresponding to the identification regions extracted from the two-dimensional image.

In another embodiment, the 3D depth sensor 11 emits structured light, detects reflected light reflected from the subject, and analyzes the deformed shape of the detected reflected light to obtain a 3D depth image.

To this end, in one embodiment, the three-dimensional motion analyzer 12 extracts minutiae points about the body part within the real space of the front of the stereoscopic display 16 and the three-dimensional depth image for the user's body, The face region and the fingertip region of the user are respectively identified by the minutiae points and the position information of the user's face or eyeball, the position information of the fingertip and the operation information can be obtained from the identified regions.

The position information of the user's face or eyes generated by the three-dimensional motion analysis unit 12, the position information of the user's fingertip, and the motion information are input to the UI processing unit 13 so as to determine how the UI control is performed by the user And is also passed to the formatter 14 so that the UI controls are created visually perceptually within the reach of the user.

On the other hand, the user's operation on the stereoscopic UI image is assumed to be activated before the stereoscopic UI function, and activation or initialization of such stereoscopic UI function may be implemented depending on the remote control operation of the user, or 3 Dimensional motion analysis unit 12 based on the user gesture analysis result. For example, if the user wishes to operate the UI, while gazing at the TV screen, as if he or she wanted to press a virtual button in the air, holding the four fingers with the index finger only, The 3D motion analyzing unit 12 can transmit the UI activation signal to the UI processing unit 13 and the formatter 14 when the predetermined gesture condition is satisfied.

When the UI display function is activated in accordance with the user's remote control operation or according to the gesture, the UI processing unit 13 determines whether the user is watching a 3D movie, a video conference, playing a game, or the like Generates a UI image including appropriate UI controls, and transfers the generated UI image to the formatter 14. [

At this time, the UI controls may be intentionally disposed so as to overlap over the background layer in such a manner as to avoid the protruding object layers of the stereoscopic content image so as to minimize disturbance to the viewing of the currently displayed stereoscopic content image.

When the UI display function is activated, the formatter 14 displays, on the basis of the depth information included in the user's face or eye position information or the user's fingertip position information, a predetermined (predetermined) The UI depth information for the UI controls can be determined so that the UI controls of the UI can be recognized in a cubic sense.

Further, the formatter 14 receives a UI image including UI controls from the UI processing unit 13, and generates a stereoscopic UI image by performing a stereoscopic conversion of the received UI image according to the determined UI depth information.

Also, the UI depth information can be adaptively determined according to the distance between the user and the stereoscopic display, that is, taking into account the size of the user's listening space. For example, if the user is sitting close to the stereoscopic display 16 erected on the desk, the UI depth information may be appropriate to be determined to be shorter than the UI depth information when the user is comfortably facing the stereoscopic display 16 in a spacious living room will be.

Since the depth information is in inverse proportion to the left and right disparity values of the object in the stereoscopic image, when the depth information is determined, the disparity values of the left and right images capable of recognizing the object at positions corresponding to the depth information are determined. Thus, if the UI depth information is determined, the formatter 14 can allow the user to recognize the UI control at that location.

At this time, the UI depth information, the position information of the user's face or eyeball, and the position information of the user's fingertip are all expressed on the basis of the term depth information. However, the UI depth information is expressed by a stereoscopic UI The depth information included in the position information of the user's face or eyeball and the depth information included in the user's fingertip position information indicate the geometric distance from the 3D depth sensor 11 to the position where the UI controls in the image are recognized, Quot; refers to the measured distance from the stereoscopic display 16 to the user, as measured by the user.

Specifically, the formatter 14 converts the UI image received from the UI processing unit 13 to generate a stereoscopic UI image so that all the UI controls the user wants to operate are located within the viewing angle of the stereoscopic image recognized by the user .

Further, the formatter 14 may convert the UI image to generate a stereoscopic UI image so that the UI controls that the user wants to manipulate are distinguished from each other without confusion within the viewing angle of the stereoscopic image recognized by the user.

Here, the viewing angle of the stereoscopic image recognized by the user is a viewing angle occupied by the screen of the stereoscopic display 16 viewed from the user's position. A quadrangular pyramid of viewing angles formed by the viewing angle of the user's eye from the user's eye to the screen of the stereoscopic display 16 in accordance with a predetermined basic geometric relationship and a stereoscopic display 16, A polygon where a plane in parallel with a screen of the polygon meets, that is, a square. Stereoscopic UI images can be generated to recognize UI controls within these polygons. For convenience of explanation, this virtual polygon will be referred to as a UI operation polygon in the present specification.

Since the UI controls are only present in the stereoscopic image on the stereoscopic display 16, the user will never be able to recognize the UI controls beyond the viewing angle occupied by the screen of the stereoscopic display 16. As a result, meaningful manipulation by the user's hand gestures will occur only within this UI manipulation polygon, and no user's manipulation can be interpreted in relation to the manipulation of the UI control at positions outside the UI manipulation polygon. Therefore, it is less likely that the hand movements or movements that the user performs irrespective of UI manipulation are understood as manipulations related to the UI control.

Since the positions on the three-dimensional space where the UI controls are visually recognized can be easily grasped based on the geometric principle of the stereoscopic transformation, the UI processing unit 13 compares the position where the UI controls are recognized with the position information of the fingertip, Can determine which UI control the user is trying to manipulate.

Accordingly, the UI processing unit 13 determines whether the position information and the operation information of the fingertip of the user corresponds to the specific UI control in the stereoscopic UI image, and generates a UI image in which specific UI control is visually modified according to the determination result can do.

Specifically, the UI processing unit 13 specifies the UI manipulation polygon according to the position information of the user's face (more preferably the user's eye) and the UI depth information, Identifies UI controls intended for manipulation, identifies manipulation intentions for the user's UI controls according to the motion information of the user's fingertip, and visually displays UI controls to provide feedback to the user based on the identified manipulation intent. The UI image is continuously generated while deforming. For example, if the UI control at the position corresponding to the position information of the user's fingertip is button-shaped and the operation information of the user's finger corresponds to the operation of further projecting the finger forward, the UI control may be changed To show a visual effect to the user.

Then, the formatter 14 generates a stereoscopic UI image from the UI image with the disparity determined according to the UI depth information, and transmits the generated stereoscopic UI image to the image synthesizer 15.

The image synthesis unit 15 synthesizes the stereoscopic UI image with the stereoscopic content image which is originally displayed and transmits the synthesized stereoscopic image to the stereoscopic display 16. [

2 is a conceptual diagram illustrating a 3D user interface provided by a stereoscopic display apparatus according to an exemplary embodiment of the present invention.

2, a stereoscopic UI image function is activated by a user's UI activation gesture or remote control operation while a predetermined stereoscopic image is displayed on the stereoscopic display 16 on the left side.

First, the position information of the user's face or eye is determined by the three-dimensional depth sensor 11 on the stereoscopic display 16 in order to determine the position at which the UI controls in the stereoscopic UI image are to be recognized by the user, The UI depth information is determined on the basis of the distance that the user can comfortably operate from the user's face or eye position, and in some cases, in consideration of the size of the user's listening space. For example, the UI depth information can be determined to correspond to a depth of 50 cm from the user's face, i.e., the eyeball.

Accordingly, the two-dimensional UI image generated by the UI processing unit 13 is converted into the stereoscopic UI image according to the UI depth information determined by the formatter 14. [

The user will perceive the stereoscopic UI image as if it is floating about 50 cm in front of his or her face and extend the hand about 50 cm in front of the face to place the finger tip at the point where the UI control is recognized, It is possible to receive feedback as to whether or not the UI control is normally operated.

3 is a flowchart illustrating a method for providing a 3D user interface using a stereoscopic display apparatus according to an embodiment of the present invention.

Referring to FIG. 3, a method for providing a 3D user interface using a stereoscopic display device includes the steps of providing a stereoscopic display 16 having a stereoscopic display 16, The scopic display device 10 is used.

Accordingly, in step S31, the 3D user interface providing method generates a UI image including UI controls.

Subsequently, in step S32, the UI depth information is determined such that the stereoscopic UI image converted in the UI image is recognized at a predetermined position within the arm length of the user.

Specifically, in step S32, a three-dimensional depth image for the three-dimensional real space on the front face of the stereoscopic display 16 is acquired, location information of the user's face or eye is obtained from the three-dimensional depth image, Or the UI depth information from the position information of the eyeball.

In step S33, the stereoscopic UI image converted from the UI image is displayed on the stereoscopic display 16 according to the UI depth information.

In step S34, it is determined whether the position information and the operation information of the user's fingertip correspond to a specific UI control in the stereoscopic UI image, and a UI image in which a specific UI control is visually modified in accordance with the determination result is generated.

After the UI image is generated, the procedure may return to step S32 and repeat.

Also, if the UI display function is deactivated at any time, or if the operation objective for the UI control is achieved, the procedure may be terminated at the step of creating or displaying the UI image.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. It will be understood that variations and specific embodiments which may occur to those skilled in the art are included within the scope of the present invention.

Further, the apparatus according to the present invention can be implemented as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the recording medium include ROM, RAM, optical disk, magnetic tape, floppy disk, hard disk, nonvolatile memory and the like. The computer-readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

10 stereoscopic display device
11 3D depth sensor
12 Three-dimensional motion analysis unit
13 UI processing section
14 formatter
15 image synthesis unit
16 Stereoscopic Display

Claims (19)

A stereoscopic display;
A three-dimensional depth sensor for obtaining a three-dimensional depth image of a frontal three-dimensional real space of the stereoscopic display;
A three-dimensional motion analyzer for obtaining positional information of a user's face or eyeball, positional information of a user's fingertip, and motion information using the 3D depth image;
The UI control unit generates UI images including UI controls, determines whether the position information and operation information of a user's fingertip corresponds to a specific UI control in the UI image, and controls the UI A UI processing unit for generating an image; And
And a formatter for determining the UI depth information such that the stereoscopic UI image converted from the UI image is recognized at a predetermined position within the arm length of the user and converting the UI image into the stereoscopic UI image according to the UI depth information and,
Wherein the stereoscopic UI image includes a quadrangular pyramid of a viewing angle formed by a viewing angle of a user's eyeball from a user's eyeball toward a screen of the stereoscopic display and a plane that is specified by the UI depth information and is parallel to the screen of the stereoscopic display The UI control is formed so as to be recognized in the polygon where the UI control is performed,
Wherein the 3D motion analyzing unit is operable to obtain position information and operation information of the user's fingertip in a region corresponding to a space in the quadrangular pyramid in the 3D depth image, Display device. delete The apparatus of claim 1, wherein the three-dimensional depth sensor
Wherein the stereoscopic display comprises at least two image sensors arranged to face the user on a plane of the stereoscopic display or on a plane parallel to the screen so that a three dimensional depth image of the front three- Lt; / RTI >
The 3D motion analyzer
Extracting feature points related to a user's body part in the 3D depth image, identifying the face region of the user by the extracted feature points, and obtaining position information of the user's face or eyeball from the identified face region Wherein the stereoscopic display device is a stereoscopic display device. The apparatus of claim 1, wherein the three-dimensional depth sensor
At least two image sensors arranged to face the user on a plane of the stereoscopic display screen or on a plane parallel to the screen so that the three dimensional depth image and the two dimensional image of the front real space of the stereoscopic display Respectively,
The 3D motion analyzer
Extracting an area identified by the face of the user from the two-dimensional image, and obtaining position information of the user's face or eyeball from a specific area within the three-dimensional depth image corresponding to the face area extracted from the two- Wherein the stereoscopic display device is a stereoscopic display device. The apparatus of claim 1, wherein the three-dimensional depth sensor
Dimensional depth image by emitting a structured light and detecting reflected light reflected from the subject and analyzing the deformed shape of the detected reflected light,
The 3D motion analyzer
Extracting feature points related to a user's body part in the 3D depth image, identifying the face region of the user by the extracted feature points, and obtaining position information of the user's face or eyeball from the identified face region Wherein the stereoscopic display device is a stereoscopic display device. delete The stereoscopic display apparatus of claim 1, wherein the UI depth information is determined according to a distance between a user and the stereoscopic display. The method according to claim 1,
Further comprising an image synthesizing unit synthesizing the stereoscopic UI image transmitted from the formatter on the stereoscopic content image being displayed and transmitting the synthesized stereoscopic image to the stereoscopic display / RTI > The system according to claim 8, wherein the UI processing unit
Wherein the UI control is arranged to place the UI control so that the UI control overlaps the background layer by avoiding the protruding object layers of the stereoscopic content image. A three-dimensional user interface providing method using a stereoscopic display apparatus,
Generating a UI image including UI controls;
Determining UI depth information such that a stereoscopic UI image transformed from the UI image is recognized at a predetermined position within a user's arm length; And
And displaying the stereoscopic UI image converted from the UI image on the stereoscopic display according to the UI depth information,
Wherein the step of determining the UI depth information comprises:
Obtaining a three-dimensional depth image of a frontal three-dimensional real space of the stereoscopic display using a three-dimensional depth sensor disposed in a plane that is the same as or parallel to the screen of the stereoscopic display;
Acquiring position information of a user's face or eyeball from the 3D depth image;
Determining the UI depth information from position information of the user's face or eyeball;
Obtaining position information and operation information of a user's fingertip from the 3D depth image; And
Determining whether the position information and the operation information of the fingertip of the user corresponds to a specific UI control in the UI image and generating a UI image so that the specific UI control is visually modified according to the determination result;
Wherein the stereoscopic UI image includes a quadrangular pyramid of a viewing angle formed by a viewing angle of a user's eyeball from a user's eyeball toward a screen of the stereoscopic display and a plane that is specified by the UI depth information and is parallel to the screen of the stereoscopic display The UI control is formed so as to be recognized in the polygon where the UI control is performed,
Wherein the position information and operation information of the user's fingertip is obtained in a region corresponding to a space in the quadrangular pyramid in the 3D depth image. delete delete 11. The method of claim 10, wherein obtaining the 3D depth image for the 3D real space of the front of the stereoscopic display
Dimensional depth image for the three-dimensional real space in front of the stereoscopic display using at least two image sensors arranged to face the user on a plane formed by the screen of the stereoscopic display or parallel to the screen Comprising:
The step of acquiring the position information of the user's face or eyeball from the 3D depth image
Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and acquiring position information of the user's face or eyeball from the identified face region Dimensional user interface using the stereoscopic display device. 11. The method of claim 10, wherein obtaining the 3D depth image for the 3D real space of the front of the stereoscopic display
Dimensional depth image and a two-dimensional image of the real space of the front face of the stereoscopic display using at least two image sensors arranged to face the user on a plane of the stereoscopic display screen or on a plane parallel to the screen, Respectively,
The step of acquiring the position information of the user's face or eyeball from the 3D depth image
A step of first extracting an area identified by the user's face in the two-dimensional image and acquiring position information of the user's face or eyeball from a specific area in the three-dimensional depth image corresponding to the face area extracted from the two- Dimensional user interface using a stereoscopic display device. 11. The method of claim 10, wherein obtaining the 3D depth image for the 3D real space of the front of the stereoscopic display
Extracting the structured light, detecting reflected light reflected from the subject, and analyzing the deformed shape of the detected reflected light to obtain the 3D depth image,
The step of acquiring the position information of the user's face or eyeball from the 3D depth image
Extracting feature points related to a user's body part in the 3D depth image, identifying a face region of the user by the extracted feature points, and acquiring position information of the user's face or eyeball from the identified face region Dimensional user interface using the stereoscopic display device. delete 11. The method of claim 10, wherein the UI depth information is determined according to a distance between a user and the stereoscopic display. The method of claim 10,
Further comprising synthesizing the stereoscopic UI image on the stereoscopic content image being displayed on the stereoscopic display and displaying the synthesized stereoscopic image on the stereoscopic display. A method for providing a 3D user interface. 19. The method of claim 18, wherein generating a UI image including the UI controls comprises:
And creating the UI image by disposing the UI control so that the UI control overlaps the object layers of the stereoscopic content image that appear to be overlaid on the background layer. A method for providing a three-dimensional user interface using the method.

Images