KR20140049865A - Device for providing a floating image - Google Patents

Abstract

A device for providing a spatial image is disclosed. A projection unit projects a light beam to generate a three-dimensional image based on image data. A three-dimensional image forming unit forms the three-dimensional image by imaging the light beam which the projection unit projected. A projecting unit generates the spatial image by reconstructing the three-dimensional image formed by the three-dimensional image forming unit. A projecting optical unit is located between the three-dimensional image forming unit and the projecting unit, and projects the three-dimensional image formed by the three-dimensional image forming unit. [Reference numerals] (110) Display unit; (120) Projection unit; (130) Sensing unit; (140) Control unit; (150) Feedback providing unit; (160) Storage unit; (170) Communications unit

Description

Device for providing a spatial image {Device for providing a floating image}

The present invention relates to a spatial image providing apparatus, and more particularly, to a spatial image providing apparatus for displaying a three-dimensional image.

Looking at the direction of technology development for display and media expression, from the black-and-white TV to the color CRT CRT TV to the flat-panel widescreen TV, and in 2000, the development of the slim flat screen high-definition panel TV. Until now, a 3D display of a glasses type and a glassesless type using binocular disparity has been developed. In addition, the function of the display system is also transformed into a convergent service function. The display system is an internet and telephony function, and recently, in addition to the communication function and some image information transmission functions in both directions in the existing medium that transmits information in one direction. Is transforming into a smart display that incorporates the functionality of a computer.

According to the recent technology trends and technical plans announced by domestic and foreign companies and research institutes, they can directly experience historical artifacts or events with time constraints, macroscopic spaces with limited space, invisible micro-environments, or risks. The development plan of learning education system that realizes this indirectly and realistically has been announced, and the technology development plan that can reproduce realistic images in virtual space has been announced so that it can be experienced in the external space even in the personal space on the ubiquitous system.

Conventionally, a panel-based 2D, 2.5D, and binocular parallax 3D display image has been developed as a technique for controlling an image by directly touching or motion sensing in the air. Existing images provide image information of some field of view at limited viewing angle and are implemented as image contents with a little real feeling.

Recently, 3D image providing distance depth information by binocular parallax method is provided, but also, deterioration of image quality due to human factor influence or depth due to binocular parallax, dead zone, There are cross talks and the like, and there are still limitations in providing 360 degree image information. In addition, some glasses-free 3D needs to overcome the technology that can be viewed by multiple viewers at the same time.

An object of the present invention is to provide a spatial image providing apparatus capable of displaying a real three-dimensional image having 360-degree information in a position where a user can face.

Another object of the present invention is to provide a spatial image providing apparatus that allows a user to feel a touch on a real 3D image displayed in a space.

Another object of the present invention is to provide a spatial image providing apparatus that can move and change a real 3D image displayed in a space according to a user's taste.

In order to achieve the above object, the apparatus for providing a spatial image according to the present invention includes a projection unit for projecting a light beam to generate a 3D image based on the image data, and a 3D image forming the projected light beam. A 3D image forming unit, a projection unit regenerating the formed 3D image to generate a spatial image, and a projection optical unit positioned between the 3D image forming unit and the projection unit and projecting the formed 3D image to the projection unit. It may include. Here, the spatial image may be displayed at a position facing an observer located in a direction opposite to the front of the projection unit. In addition, the formed 3D image may be observable in any direction 360 degrees without limiting the viewing angle.

The 3D image forming unit and the projection unit may be positioned to be inclined at a predetermined angle to each other.

The projection unit may be a display panel or a projector. The projector may be a multi-projector, and the screen of the 3D image forming unit may have a curvature.

The projection optical unit may include at least one lens. The projection optical unit may enlarge or reduce the size of the 3D image.

The projection unit may include at least one of a mirror hole pattern element, a lens pattern element, and a diffractive optical element. The projecting unit may form an image by reflecting a light beam incident from the projection optical unit.

The 3D image forming unit may include at least one of a transmissive screen display, a rotating screen display, a scattering scan display, and a holographic display.

The spatial image providing apparatus may include a sensing unit configured to detect a position or movement of an external object located around the spatial image providing apparatus, the space according to the detected position of the external object or in response to the movement of the detected external object. The controller may further include a controller configured to control an image to be converted, and a feedback provider configured to provide feedback based on the detected position of the external object or in response to the movement of the detected external object.

The apparatus for providing a spatial image may further include at least one of a communication unit for receiving the image data and a storage unit for storing the image data.

According to the spatial image providing apparatus according to the present invention, it is possible to display a real three-dimensional image having 360-degree information in a position where the user can face, so that the user can feel the touch on the displayed real three-dimensional image In addition, the user can move and change the displayed real 3D image according to his or her taste.

1 is a block diagram showing the configuration of a preferred embodiment of a spatial image providing apparatus according to the present invention;
2 is a structural diagram showing a structure of a preferred embodiment of a spatial image providing apparatus according to the present invention;
3 is a view illustrating embodiments of a display unit;
4 is a view showing embodiments of the projection unit,
5 illustrates an example of a change of a spatial image in response to a user action of touching the spatial image;
6 is a diagram illustrating an example of a motion of a spatial image according to a movement of a user's hand;
7 is a view showing an embodiment of an upper surface of a table of a spatial image providing apparatus according to the present invention;
8 is a flowchart illustrating a process of performing a preferred embodiment of the method for providing a spatial image according to the present invention;
9 is a structural diagram showing another preferred embodiment of the spatial image providing apparatus according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The structure and operation of the present invention shown in the drawings and described by the drawings are described as at least one embodiment, and the technical ideas and the core structure and operation of the present invention are not limited thereby.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, it is possible to use general terms that are currently widely used, but this may vary depending on the intention or custom of a person skilled in the art or the emergence of new technology. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, it is to be understood that the term used in the present invention should be defined based on the meaning of the term rather than the name of the term, and on the contents of the present invention throughout.

1 is a block diagram showing the configuration of a preferred embodiment of a spatial image providing apparatus according to the present invention.

Referring to FIG. 1, the apparatus 100 for providing a spatial image according to the present invention may include a display unit 110, a projection unit 120, a sensing unit 130, a control unit 140, a feedback providing unit 150, and a storage unit. It may include at least one of the 160 and the communication unit 170.

The display 110 reproduces the 3D image based on the image data. The reproduced 3D image may be observable in any direction of 360 degrees without limiting the viewing angle. The reproduced 3D image may be a real 3D image that provides 360 degree image information.

The image data may be stored in the storage 160, or may be received by the communication unit 170. The image data may be image data for displaying a 3D video (3D video) including a plurality of 3D image frames. In some embodiments, the 3D image frame may include a 2D image frame having a specific width and width and a depth image corresponding thereto. Here, the 2D image frame includes color image data. The color image data includes pixel values. The depth image may be represented by a gray level and may have the same resolution as the pixel resolution of the 2D image frame. The pixels included in the depth image may each have a depth value corresponding one-to-one with the pixels included in the 2D image frame. The depth value may be displayed in gray level. For example, the gray level may have a value of 0 to 255.

The projection unit 120 projects the 3D image reproduced by the display 110 in a specific space to form an image of the 3D image. That is, the projection unit 120 generates a spatial image that is an image of the 3D image. Hereinafter, the spatial image is defined as meaning a 3D image in which the 3D image reproduced by the display 110 is projected onto a specific space.

The sensing unit 130 detects the position or movement of an external object located near the spatial image providing apparatus 100. The external object may include at least one of a user's hand, a user's finger, and a stick.

The sensing unit 130 detects the voice of the surroundings of the spatial image providing apparatus 100.

The sensing unit 130 may include at least one of a camera, an infrared sensor, a wavelength sensor, and a voice sensor. The sensing unit 130 may track the movement of the external object through the image captured by the camera, the infrared sensor, and the wavelength sensor. In addition, the sensing unit 130 may sense a user's voice through a sound ray sensor.

The controller 140 controls the spatial image to be converted according to the position of the external object sensed by the sensing unit 130. The controller 140 may control the display 110 and the projector 120 to convert at least one of a material, a color, a size, a shape, a position, and a direction of the spatial image according to the position. The controller 140 may control the spatial image to be rotated or moved according to the position of the external object.

In addition, the controller 140 may control the spatial image to be realized according to the position of the external object. For example, when the spatial image is a handbag and an external object is located at a button of the handbag, the controller 140 may control to display a video in which the handbag is opened. In other words, the spatial image is converted from a closed handbag to an open handbag.

The controller 140 controls the spatial image to be converted in response to the movement of the external object sensed by the sensing unit 130. The controller 140 may control the display 110 and the projector 120 to convert at least one of the material, color, size, shape, position, and direction of the spatial image according to the movement. The controller 140 may control the size of the spatial image to be larger or smaller according to the movement of the external object. In addition, the controller 140 may control the spatial image to be separated according to the movement of the external object.

The controller 140 may control the display 110 and the projector 120 to move the spatial image in response to the movement of the external object. For example, the spatial image may move up and down according to the vertical movement of the external object. In this case, the controller 140 may control the spatial image to move up and down by adjusting the distance between the display 110 and the projector 120 according to the vertical movement of the external object. The controller 140 may control the display 110 and the projector 120 to rotate the spatial image in response to the movement of the external object.

The controller 140 may control the display 110 and the projector 120 to convert at least one of the material, color, size, shape, position, and direction of the spatial image according to the sound sensed by the sensing unit 130. Can be. The controller 140 may control the spatial image to be realized according to the sound sensed by the sensing unit 130. Accordingly, the user may input a command for converting the spatial image through the voice to the spatial image providing apparatus 100.

The feedback provider 150 provides feedback based on the position of the external object sensed by the sensing unit 130. The feedback includes at least one of touch, temperature and odor. When the user touches the spatial image, the feedback provider 150 may provide a touch to give the user a touch.

The feedback provider 150 provides feedback in response to the movement of the external object sensed by the sensing unit 130. The feedback includes at least one of touch, temperature and odor. When the user performs an operation of touching the spatial image, the feedback provider 150 may provide a different touch to the user according to a change in position of the spatial image and the user's finger, thereby giving the user a sense of touch and volume.

The storage unit 160 provides a place for storing program codes and data used by the spatial image providing apparatus 100. Here, the program code may be an application program code received by the communication unit 170 and an application program code stored when the spatial image providing apparatus 100 is manufactured. Applications can also be written in programming languages such as HTML, XML, HTML5, CSS, CSS3, JavaScript, Java, C, C ++, Visual C ++, and C #. In addition, the storage unit 160 includes image data. The image data may include data for displaying a 3D image and data for displaying a manual image.

The storage unit 160 may be implemented as a read only memory (ROM), a random access memory (RAM), a hard disk drive, or the like. The program code and data may reside in a removable storage medium, and may be loaded or installed on the spatial image providing apparatus 100 when necessary. Removable storage media may include CD-ROM, PC-CARD, memory cards, floppy disks, magnetic tape, and network components.

The communicator 170 may receive broadcast data, image data, audio data, information data, and application data from an external device by wire or wirelessly. The image data may be image data for displaying a 2D image and image data for displaying a 3D image. The external device may be a multimedia device such as a computer, a notebook, a mobile terminal, a recording medium reproducing apparatus, or a server located on the Internet such as a broadcasting station and a service provider.

The communicator 170 may include a tuner unit, a demodulator, a mobile communication unit, a network interface unit, and an external signal receiver. The tuner may receive a stream signal including data through a broadcasting network, and the demodulator demodulates the received stream signal. The mobile communication unit may receive data through a mobile communication network such as a 2G communication network, a 3G communication network, and a 4G communication network. In addition, the network interface may transmit and receive data through a network, and the external signal receiver may receive an application and content from a peripheral device.

2 is a structural diagram showing a structure of a preferred embodiment of a spatial image providing apparatus according to the present invention.

Referring to FIG. 2, the display 110 displays a 3D image 210 at the bottom of the projection unit 120 based on image data received from the external devices 201 and 205. The three-dimensional image 210 is an image that can be observed in any direction through 360 degrees without viewing angle limitation.

The projector 120 may be located above the display 110. The projection unit 130 projects the 3D image 210 to its upper space to generate a spatial image 220 which is an image of the 3D image. The height of the location of the spatial image 220 may be changed according to the distance between the display 110 and the projector 120. In addition, the projection unit 120 may adjust the size of the spatial image 220 by adjusting the magnification.

The display 110 may change or convert image data to change the size, shape, color, material, and position of the 3D image 210. According to the transformation of the 3D image 210, the size, shape, color, material, and position of the spatial image 220 may be changed.

3 is a diagram illustrating embodiments of a display unit.

Referring to FIG. 3, the display unit 110 may include at least one of a transmissive screen display 310, a rotation screen display 330, a scattering scan display 350, and a holographic display (not shown). have.

The transmissive screen type display 310 stacks depth image information for each tomography layer 311 to 319 to implement a real 3D image 320.

The rotating screen display 330 implements a real 3D image 340 by rotating the screen 331 to implement image information for each angle.

The scattering scan type display 350 optically focuses the scattering scan in the chamber 351 containing the gas to implement the real 3D image 360.

Holographic displays generate holograms to produce real three-dimensional images.

4 is a diagram illustrating embodiments of a projection unit.

Referring to FIG. 4, the projection unit 120 may include at least one of the mirror hole pattern element 410, the lens pattern element 430, and the diffractive optical element 450. The projector 120 may generate the spatial image 420 by projecting the 3D image 210 illustrated in FIG. 2 through the mirror hole pattern element 410. The projector 120 may generate the spatial image 440 by projecting the 3D image 210 illustrated in FIG. 2 through the lens pattern element 430. The projection unit 120 may generate the spatial image 460 by projecting the 3D image 210 illustrated in FIG. 2 through the diffractive optical element 450.

5 is a diagram illustrating an example of a change of a spatial image in response to a user action of touching the spatial image.

Referring to FIG. 5, the controller 140 recognizes the position of the surface of the spatial image 510 and checks whether the external object 501 is located on the surface of the spatial image 510. When the external object 501 is located on the surface of the spatial image 510, the controller 140 controls the preset operation to proceed according to the surface on which the external object 501 is located. For example, when the external object 501 arrives at the button position of the bag 510, the controller 140 controls to play a video in which the bag is opened.

6 is a diagram illustrating an example of a motion of a spatial image according to a user's hand movement.

Referring to FIG. 6, the controller 140 recognizes the position of the surface of the spatial image 610 and checks whether the external object 601 moves along the surface of the spatial image 610. When the external object 601 moves along the surface of the spatial image 510, the controller 140 controls the preset operation to proceed according to the surface on which the external object 601 is located. For example, when the external object 601 moves left, right, up, and down along the bag surface 610, the controller 140 may control to provide a spatial image in which a bag type is changed or a color is changed. have.

The sensing unit 130 detects a movement of the external object 601 located at a point 601 away from the spatial image 610. The controller 140 may control the manual image to be displayed according to the detected movement of the external object 601, and may control the spatial image 610 to be moved or rotated. Accordingly, the user may display a manual image by moving a finger and move or rotate the spatial image 610.

7 is a diagram illustrating an embodiment of an upper surface of a table of the spatial image providing apparatus according to the present invention.

Referring to FIG. 7, when the user touches the spatial image 710, the apparatus 100 for providing a spatial image provides a touch to the user. For example, when the user 701 presses a button of the spatial image 710, the spatial image providing apparatus 100 makes the user's finger 701 feel the pressure through an oil pressure such as air.

The sensing unit 130 and the feedback providing unit 150 may be installed on the upper surface 705 of the spatial image providing apparatus 100. The sensing unit 130 may include a plurality of cameras (or sensors) 720.

The feedback provider 150 may include a plurality of air pressures 730 and a fragrance 740. The air pressure 730 provides a touch feeling to the user through the air pressure. Fragrance 740 provides odor to the user. The fragrance 740 may be detachably embedded, and the spatial image providing apparatus 100 may emit various odors by combining various fragrances.

8 is a flowchart illustrating a process of performing a preferred embodiment of the method for providing a spatial image according to the present invention.

Referring to FIG. 8, the display 110 reproduces a 3D image based on the image data (S100). The reproduced 3D image may be observable in any direction of 360 degrees without limiting the viewing angle. The reproduced 3D image may be at least one of the 3D image 210 illustrated in FIG. 2 and the 3D images 320, 340, and 360 illustrated in FIG. 3.

The projector 120 generates a spatial image that is an image of the 3D image by projecting the 3D image reproduced by the display 110 to a specific space (S110). The generated spatial image may be at least one of the spatial image 220 illustrated in FIG. 2 and the spatial images 420, 440, and 460 illustrated in FIG. 4.

The sensing unit 130 detects the position or movement of an external object located around the spatial image providing apparatus 100 (S120).

The feedback provider 150 provides feedback in response to the position and movement of the external object sensed by the sensing unit 130 (S130). The feedback may include at least one of touch, temperature and odor. The controller 140 may select the feedback to be provided according to the detected position and movement of the external object and control the feedback provider 150 to provide the selected feedback.

The controller 140 controls the spatial image to be converted according to the position of the external object sensed by the sensing unit 130 or in response to the movement of the detected external object (S140). The controller 140 may control the display 110 and the projector 120 to convert at least one of a material, a color, a size, a shape, a position, and a direction of the spatial image according to the position. The controller 140 may control the display 110 and the projector 120 to convert at least one of the material, color, size, shape, position, and direction of the spatial image according to the movement.

9 is a structural diagram showing another preferred embodiment of the spatial image providing apparatus according to the present invention.

Referring to FIG. 9, the display 110 may include a projection unit 910, a 3D image forming unit 920, and a projection optical unit 940.

The projection unit 910 projects a light beam that generates a 3D image based on the image data. The image data may be stored in the storage 160, or may be received by the communication unit 170. The image data may be image data for displaying a 3D video (3D video) including a plurality of 3D image frames.

The projection unit 910 may be a display panel or a projector. In addition, the projection unit 910 may be a multi-projector. In this case, the screen of the 3D image forming unit 920 may be formed with curvature.

The 3D image forming unit 920 forms a 3D image 930 by imaging the light beam projected by the projection unit 910. The formed 3D image 930 may be observable in any direction of 360 degrees without viewing angle limitation. In addition, the formed 3D image 930 may be a real 3D image.

The 3D image forming unit 920 may be located between the projection unit 910 and the projection optical unit 940.

The projection optical unit 940 projects the 3D image 930 onto the projection unit 120. The 3D image 930 is incident to the projection unit 120 through the projection optical unit 940. The projection optical unit 940 guides the 3D image 930 formed by the 3D image forming unit 920 to the projection unit 120.

The projection optical unit 940 may enlarge or reduce the size of the 3D image 930. At this time, under the control of the controller 140, the projection optical unit 940 may adjust the size of the 3D image 930.

The projection optical unit 940 may be positioned between the 3D image forming unit 920 and the projection unit 120 and may include at least one lens.

The projection unit 120 reimages the 3D image 930 to generate a spatial image 960. The projection unit 120 generates a spatial image 960 that is an image of the 3D image 930 incident through the projection optical unit 940. The spatial image 960 may be displayed at a position facing the observer 901 positioned in a direction opposite to the front surface 950 of the projection unit 120. Accordingly, the apparatus 100 for providing a spatial image according to the present invention may increase the face of the observer 901 with respect to the spatial image. If the spatial image is a human image, the spatial image providing apparatus 100 according to the present invention may provide a human image having the same size as a real person at a position facing the observer 901, so that the observer 901 is a human. You can feel the face to face.

In some embodiments, the projection unit 120 may form an image by reflecting a light beam incident from the projection optical unit 940. That is, the projection unit 120 may generate the spatial image 960 by reflecting the 3D image 930 incident from the projection optical unit 940.

The projection unit 120 may be installed in a direction perpendicular to the ground. In addition, the projection unit 120 may be positioned above the projection unit 910, the 3D image forming unit 920, and the projection optical unit 940.

The 3D image forming unit 920 and the projection unit 120 may be inclined with respect to each other at a predetermined angle. The predetermined angle may be a value greater than 0 degrees and less than 180 degrees.

The projection unit 910 and the projection unit 120 may be positioned to be inclined with each other at a predetermined angle. The predetermined angle may be a value greater than 0 degrees and less than 189 degrees.

The projection unit 910 may change or transform the image data to change the size, shape, color, material, and position of the 3D image 930. According to the transformation of the 3D image 930, the size, shape, color, material, and position of the spatial image 960 may be changed.

In some embodiments, the front surface 950 of the projection 120 may correspond to the upper surface 705 shown in FIG. 7. The sensing unit 130 and the feedback providing unit 150 may be installed on the front surface 950 of the projection unit 120.

The spatial image providing apparatus and its operation method according to the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments are all or all of the embodiments so that various modifications can be made. Some may be optionally combined.

On the other hand, the operating method of the spatial image providing apparatus of the present invention can be implemented as code that can be read by the processor in a processor-readable recording medium provided in the spatial image providing apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

Claims (14)

A projection unit projecting a light beam to generate a 3D image based on the image data;
A three-dimensional image forming unit configured to form the three-dimensional image by forming the projected light beams;
A projection unit for reimaging the formed 3D image to generate a spatial image; And
And a projection optical unit positioned between the three-dimensional image forming unit and the projection unit and projecting the formed three-dimensional image to the projection unit. The method of claim 1,
And the three-dimensional image forming unit and the projection unit are inclined at a predetermined angle to each other. The method of claim 1,
And the spatial image is displayed at a position facing an observer positioned in a direction opposite to the front of the projection unit. The method of claim 1,
The formed 3D image may be observed in any direction 360 degrees without limiting the viewing angle. The method of claim 1,
And the projection unit is a display panel or a projector. The method of claim 1,
The projection unit is a spatial image providing apparatus, characterized in that the multi-projector. 7. The method according to claim 1 or 6,
And the screen of the 3D image forming unit is formed to have a curvature. The method of claim 1,
The projection optical unit,
Spatial image providing apparatus comprising at least one lens. The method of claim 1,
The projection optical unit,
Spatial image providing device, characterized in that to enlarge or reduce the size of the three-dimensional image. The method of claim 1,
The projection unit includes at least one of a mirror hole pattern element, a lens pattern element and a diffractive optical element. The method of claim 1,
And the projection unit reflects a light beam incident from the projection optical unit to form an image. The method of claim 1,
The 3D image forming unit includes at least one of a transmissive screen display, a rotating screen display, a scattering scan display and a holographic display. The method of claim 1,
A sensing unit configured to detect a position or a movement of an external object located around the spatial image providing apparatus;
A controller for controlling the spatial image to be converted according to the detected position of the external object or in response to the movement of the detected external object; And
And a feedback providing unit configured to provide feedback based on the sensed position of the external object or in response to the movement of the detected external object. The method of claim 1,
And at least one of a communication unit for receiving the image data and a storage unit for storing the image data.

Images