KR20160048269A - Viewing device and method for 2 dimensional image display and 3 dimensional image display - Google Patents

Abstract

The purpose of the present invention is to provide a wearable electronic device and a controlling method thereof, wherein seamless position recognition and image recognition can be conducted by using the visible-ray communications of the wearable electronic device to improve user convenience and safety, and the seamless position recognition and the image recognition can be used in navigation, target advertisement provision, security position tracking, etc. Disclosed is a wearable electronic device. The wearable electronic device comprises: a lens part functioning both for polarization and as a shutter; a camera part for photographing a front view recognized by the sight of the wearer of the wearable electronic device; a communication part for transmitting a real image corresponding to the photographed front view to a server for providing position information; a display part for displaying additional information on the lens part to provide visually additional information in addition to the front view recognized by the view of the wearer of the wearable electronic device; and a control part for receiving the position information, which has been calculated by the server depending on the transmitted real image, generating direction information to a destination based on the received position information, and controlling the display part to display the generated direction information as the additional information if the operation mode of the wearable electronic device is a navigation mode.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a two-dimensional image display apparatus and a three-

The present invention recognizes an external display using a wearable electronic device such as a spectacle, and displays a 2D (2-Dimension) image and a 3D (3-Dimension) image using both a polarization method and a shutter method And more particularly,

The augmented reality is different from the virtual reality technology in that the virtual reality is supplemented and displayed to the user by superimposing the virtual world on the real world, which is advantageous in providing a better sense of reality to the user than the virtual reality.

Generally, the augmented reality uses a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display) to display various information in front of the user's eyes. In addition, researches on manipulating an augmented object in augmented reality using gesture recognition are actively under way.

The HMD is mounted on the user's head or other part and presents independent projected images to the left and right eyes so that when the user watches the object of view, An image is generated and the binocular parallax enables the perception of the depth sense.

The HUD also projects images in a transparent glass such as glass to allow the user to visually recognize the information projected from the HUD and the external background simultaneously through the transparent glass.

An object of the present invention is to provide a wearable type electronic device capable of performing continuous position recognition and image recognition by using visible light communication of a wearable electronic device and improving navigation and target advertisement, And a control method thereof.

Another object of the present invention is to provide a method of recognizing an external display by combining a visible light communication of a wearable electronic device with a GPS, an inertial navigation and an image recognition technology, And a three-dimensional (3D, 3-dimensional) image, and a control method thereof.

According to an aspect of the present invention, there is provided a wearable electronic device including a polarizing shutter lens unit, a camera unit for photographing a foreground recognized by the wearer's wearer's eye, To the server providing the positional information, a display unit for displaying the additional information in the lens unit in order to provide visual additional information in addition to the foreground recognized by the wearer's wearing time When the operation mode of the display unit and the wearable electronic device is the navigation mode, receives position information calculated by the server according to the transmitted real image, and generates direction information to a destination based on the received position information And controlling the display unit to display the generated direction information as the additional information It includes.

The communication unit may include a visible light communication module, and the control unit may control the communication unit to transmit the real image to the server using the visible light communication module.

The sensing unit may further include a sensing unit including at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and the control unit may control the sensing unit to sense the sensed value of the wearable electronic device The control unit can control the communication unit to transmit the location information to the server together with the real image.

The communication unit may further receive advertisement information from the server, and the control unit may control the display unit to display the generated direction information and the received advertisement information as the additional information.

According to another aspect of the present invention, there is provided a method of controlling a wearable electronic device having a polarizing shutter and a lens unit according to an embodiment of the present invention includes the steps of photographing a foreground recognized by a wearer of the wearable electronic device Transmitting a real image corresponding to the photographed foreground to a server providing position information, if the operation mode of the wearable electronic device is a navigation mode, Generating direction information to the destination based on the received position information, and displaying the generated direction information in addition to the foreground recognized by the wearer's wearer's viewpoint do.

The transmitting step and the receiving step may be performed using a visible light communication method.

The method of claim 1, further comprising calculating position information of the wearable electronic device by applying an inertial navigation based on a sensed value measured using at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, , And transmit the calculated position information to the server together with the real image.

And receiving advertisement information from the server, wherein the displaying step adds the generated direction information and the received advertisement information to a foreground recognized by the wearer's wearer's eyesight Can be displayed.

According to various embodiments of the present invention, the wearable electronic device and visible light communication are used, and GPS, inertial navigation, and image recognition technology are fused to perform continuous precision position recognition and image recognition, and navigation, Location tracking and so on.

In addition, since the communication-related device must exist in the field of view (FOV) of the visible light communication using the illumination and display infrastructure, the wearable electronic device to be worn is an optimal device for visible light communication, .

In addition, by combining visible light communication of a wearable electronic device with GPS, inertial navigation, and image recognition technology, an external display is recognized and a two-dimensional (2D, two-dimensional) Image and 3-dimensional (3-dimensional) image.

1 and 2 are perspective views showing a configuration of a wearable electronic device according to an embodiment of the present invention.
Figure 3 is an illustration of an example of a view seen by a user through a wearable electronic device.
Figs. 4 and 5 are perspective views showing still another embodiment of the configuration of the wearable electronic device. Fig.
6 is a block diagram illustrating an embodiment of a configuration of a wearable electronic device according to the present invention.
7 is a view showing a lens combined with a polarizing shutter using linearly polarized light according to an embodiment of the present invention.
8 is a view showing a lens combined with a polarizing shutter using circularly polarized light according to an embodiment of the present invention.
9 is a diagram of a system according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is a perspective view showing the construction of a wearable electronic device according to an embodiment of the present invention. The wearable electronic device 1 shown in Fig. 1 can be manufactured in the form of glasses so as to be positioned close to the user's eyes.

1, which shows a front view of a wearable electronic device 1, a wearable electronic device 1 according to an embodiment of the present invention includes left and right lens frames 10 and 11, 20, left and right hooking portions 30, 31, and right and left lenses 50, 51.

1, a camera 110 may be mounted on a front surface of the frame connector 20, for example, as shown in FIG. 1, Can be disposed.

 Accordingly, the user wears the wearable electronic device 1 in the form of a glass, and can photograph or store or share the picture or the moving picture using the camera 110 while moving.

In this case, the viewpoint of the image captured by the camera 110 may be very similar to the viewpoint of the scene recognized by the user.

In addition, a gesture such as a user's hand movements is recognized using the camera 110, and the operation or function of the wearable electronic device 1 can be controlled according to the recognized gesture.

The position or the number of the camera 110 may be changed as needed, and a special-purpose camera such as an infrared camera may be used.

Further, units for performing a specific function may be arranged in each of the right and left fastening portions 30 and 31. [

The right side-arm 31 may be equipped with user interface devices for receiving user input for controlling the function of the wearable electronic device 1. [

For example, a track ball 100 or a touch pad 101 for selecting or moving an object such as a cursor on a screen, a menu item, or the like may be disposed on the right hook 31.

The user interface device provided in the wearable electronic device 1 is not limited to the track ball 100 and the touch pad 101 but may be a variety of devices such as a key pad dome switch, Input devices may be provided.

On the other hand, a microphone 120 may be mounted on the left side-arm 30, and the operation or function of the wearable electronic device 1 may be detected by using the voice of the user recognized through the microphone 120 Lt; / RTI >

The sensing unit 130 is disposed on the left hook 30 to sense the current state of the wearable electronic device 1 such as the position of the wearable electronic device 1, presence or absence of user contact, bearing, acceleration / deceleration, Thereby generating a sensing signal for controlling the operation of the wearable electronic device 1. [

For example, the sensing unit 130 may include a motion sensor such as a gyroscope or an accelerometer, a position sensor such as a GPS device, a magnetometer, a theodolite, A direction sensor, a temperature sensor, a humidity sensor, a wind direction / wind speed sensor, and the like. However, the present invention is not limited thereto and may include sensors capable of detecting various information in addition to the above sensors.

For example, the sensing unit 130 may further include an infrared sensor. The infrared sensor includes a light emitting unit that emits infrared rays and a light receiving unit that receives infrared rays. The infrared sensor may be used for infrared communication, .

The wearable electronic device 1 according to an embodiment of the present invention may include a communication unit 140 for communication with an external device.

For example, the communication unit 140 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, and a local communication module.

The broadcast receiving module receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast- The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast-related information may be provided through a mobile communication network, and in this case, it may be received by a mobile communication module.

Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module may be a DMB-T (Digital Multimedia Broadcasting-Terrestrial), a DMB-S (Digital Multimedia Broadcasting-Satellite), a MediaFLO (Media Forward Link Only), a DVB- And a digital broadcasting system such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module may be configured to be suitable not only for the digital broadcasting system described above but also for all broadcasting systems that provide broadcasting signals.

The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in a memory.

On the other hand, the mobile communication module transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module is a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

In addition, the wearable electronic device 1 according to an embodiment of the present invention may include a display device for displaying an image to transmit visual information to a user.

The display device may be configured to include a transparent or light transmissive unit so that a user can see a front view that is displayed in front of the information displayed by the display device.

The left and right lenses 50 and 51 shown in FIG. 1 are stacked with a polarizing shutter lens film capable of viewing an external display in 2D or 3D, and at least one of the left and right lenses 50 and 51 is a transparent The film is further laminated to serve as a display so that the user can visually recognize the text or image formed on the lens while viewing the foreground.

For this purpose, the wearable electronic device 1 can display various information in front of the user by using a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display).

The HMD includes a lens that enlarges an image to form a virtual image, and a display panel disposed at a position closer to the focal distance of the lens. When the HMD is mounted near the user's head, the user can visually recognize the virtual image by viewing the image displayed on the display panel through the lens.

In the HUD, an image displayed on a display panel is enlarged through a lens, the enlarged image is reflected by a half mirror, and the reflected light is displayed to a user, thereby forming a virtual image. In addition, since the half mirror transmits external light, the user can see the foreground as well as the virtual image formed by the HUD by the light from the outside passing through the half mirror.

The display device may be implemented using various transparent display methods such as TOLED (Transparent OLED).

Hereinafter, an embodiment of the present invention will be described by exemplifying that the wearable electronic device 1 has the HUD, but the present invention is not limited thereto.

Referring to the rear surface configuration of the wearable electronic device 1 shown in Fig. 2, HUDs 150 and 151, which function similar to a projector, are provided on the rear surface of at least one of the left hooking portion 30 and the right hooking portion 31, Can be mounted.

The image formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51 and is displayed to the user so that the object 200 formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51, 51). ≪ / RTI >

In this case, the object 200 and the foreground 250 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 can be observed together with the user's field of view, as shown in Fig.

The object 200 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 is not limited to the menu icon as shown in Fig. 3 and may be an image such as text, a picture, a moving picture, or the like.

1 and 2, the wearable electronic device 1 can be used for shooting, telephone, message, social network service (SNS), navigation, , Search, and so on.

The functions of the wearable electronic device 1 may be various functions in addition to the functions described above according to the provided modules.

For example, functions that combine two or more functions may be implemented by transmitting a moving image photographed through the camera 110 to the SNS server through the communication unit 140 and sharing the same with other users.

Figures 4 and 5 show another embodiment of the construction of the wearable electronic device in perspective view.

4, the wearable electronic device 1 is provided with only one of the right and left lenses (for example, the right lens 51), so that only one eye can display the wearable electronic device 1 internal display So that an image displayed on the device can be displayed.

5, one eye (e.g., left eye) portion of the user is completely uncovered without being covered by the lens, and only an upper portion of another eye (e.g., right eye) The wearable electronic device 1 may be embodied in a structure that is shielded by the wearable electronic device 1.

The shape and configuration of the above-described wearable electronic device 1 may be selected or changed according to various needs such as the field of use, main function, main use layer, and the like.

Hereinafter, a method of controlling a wearable electronic device according to an exemplary embodiment of the present invention will be described in detail with reference to FIGS.

FIG. 6 is a block diagram of an embodiment of a wearable electronic device according to the present invention. The wearable electronic device 300 includes a control unit 310, a camera 320, a sensing unit 330, A display unit 340, a communication unit 350, and a storage unit 360.

Referring to FIG. 6, the control unit 310 typically controls the overall operation of the wearable electronic device 300 and may include, for example, associated controls for shooting, phone, message, SNS, navigation, And processing. The controller 310 may include a multimedia module (not shown) for multimedia playback. The multimedia module may be implemented in the controller 310 or may be implemented separately from the controller 310.

The control unit 310 includes a camera 320, a sensing unit 330, a display unit 340, a communication unit 350, and a storage unit 350, including one or more processors and a memory for performing the functions described above. And processing the signal input from the controller 360 and analyzing the processed signal.

On the other hand, the camera 320 processes an image frame such as still image or moving image obtained by the image sensor in a video communication mode or a photographing mode, and the processed image frame can be displayed through the display unit 340.

The image frame processed by the camera 320 may be stored in the storage unit 360 or may be transmitted to the outside via the communication unit 350. The camera 320 may be provided at two or more different positions depending on the use environment.

The sensing unit 330 may perform the function of the sensing unit 130 described above.

Meanwhile, the storage unit 360 may store a program for the operation of the control unit 310 and temporarily store input / output data (e.g., a message, a still image, a moving picture, and the like).

The storage unit 360 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk.

The wearable electronic device 300 may also operate in association with a web storage that performs storage functions of the storage 360 on the Internet.

The display unit 340 displays (outputs) information to be processed in the wearable electronic device 300. For example, when the wearable electronic device 300 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. In the video communication mode or the photographing mode, Image, UI, and GUI can be displayed.

1 to 3, the display unit 340 may include an HMD, a HUD (HUD), and a display unit (not shown) to allow the user to visually recognize an object displayed through the display unit 340, Or a transparent display method such as TOLED.

The communication unit 350 may include one or more communication modules for enabling the wearable electronic device 300 to perform data communication with the external device 400 and may include, for example, a broadcast receiving module, a mobile communication module, An Internet module, a local area communication module, a location information module, and the like.

The wearable electronic device 300 may further include an interface unit (not shown) serving as a path for communication with all external devices connected to the wearable electronic device 300.

The interface unit receives data from an external device or supplies power to each component in the wearable electronic device 300 or allows data in the wearable electronic device 300 to be transmitted to an external device.

For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit.

The identification module is a chip for storing various information for authenticating the usage right of the wearable electronic device 300. The identification module includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Thus, the identification device can be connected to the wearable electronic device 300 through the port.

In addition, the interface may be a path through which power from the cradle is supplied to the wearable electronic device 300 when the wearable electronic device 300 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

Meanwhile, the wearable electronic device 300 may further include a power supply unit (not shown) that receives external power and internal power under the control of the control unit 310 and supplies power required for operation of the respective components have. The power supply unit may include a system capable of charging using solar energy.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof. According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 360 and executed by the control unit 310. [

Hereinafter, a mounting electronic device and a control method thereof according to an embodiment of the present invention will be described in more detail based on the configuration of the wearable electronic device 300 described above.

The camera 320 can photograph the foreground recognized by the user's eyes in accordance with the line of sight of the wearer wearing the wearable electronic device 300. [ In this case, the camera 320 can generate an image corresponding to the foreground (hereinafter referred to as a real image) recognized by the user's viewpoint in accordance with the user's gaze.

The control unit 310 compares the real image photographed through the camera 320 with the stored image, and detects the position information of the wearable electronic device 300 when photographing the real image using the comparison result. Specifically, the stored image may be tagged with location information, and the control unit 310 compares the captured real image with the stored image, and detects a stored image having a predetermined degree of similarity using the comparison result . Accordingly, position information can be extracted from the detected stored image. Here, the pre-stored image may be an image generated by photographing by orientation at the corresponding position. Here, at the time of the above-mentioned comparison, the control unit 310 can compare the moving object such as a person, an automobile, etc. in the real image. Here, the above-described comparison can be repeatedly performed, thereby continuously detecting the position information according to the movement of the user wearing the wearable electronic device 300. [

In addition, if the wearable electronic device 300 is in the visible light communication area, the control unit 310 may use the detected position information and the position information received from the owner of the visible light communication light source in visible light communication together, The position of the electronic device 300 can be recognized. Here, the communication unit 350 may include an optical sensor such as a photodiode for performing the above-described visible light communication. On the other hand, if the wearable electronic device 300 is in the visible light communication area, the control unit 310 converts the photographed real image (image looking at the visible light communication light source) into a device (e.g., a server) corresponding to the owner of the visible light communication light source, The communication unit 350 can control the communication unit 350 to transmit the information. In this case, the device corresponding to the owner of the visible light communication light source compares the various images looking at the owner light source at various positions around the user and the real image received from the wearable electronic device 300 to determine the distance and orientation to the owner light source Can be measured. Then, the device corresponding to the owner of the visible light communication light source transmits the measured distance and orientation to the wearable electronic device 300, and accordingly, the control unit 310 determines the position of the wearer wearing the wearable electronic device 300 Can be detected. Meanwhile, the controller 310 may control the communication unit 350 to activate the visible light communication or to increase the frequency of the visible light communication transmission / reception when the user is moving, such as whether the user is moving or moving. Accordingly, the wearable electronic device 300 can receive the visible light communication of the LED lighting and the LED billboard / display to perform precise position recognition. Particularly, it is possible to activate visible light communication or increase the frequency of visible light communication when there is a user in an area where GPS reception is weak, such as indoor or underground, or when the user is moving.

In addition, the user can measure the movement and the movement of the user with acceleration, gyro, gravity, tilt, geomagnetic sensor, proximity sensor, optical sensor, etc., and activate the visible light communication or increase the frequency of visible light communication when the user is moving. For low power, it is possible to increase the reception frequency of visible light communication of smart glasses while on the move and reduce the reception frequency when stopping. Also, it is possible to increase the frequency of storing the position value in the user life log when there is movement based on the motion measurement.

In addition, the control unit 310 determines the position of the user wearing the wearable electronic device 300 using inertial navigation based on the measured values measured by the sensing unit 330 such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, Can be calculated.

Also, the control unit 310 may calculate the position of the wearer wearing the wearable electronic device 300 using the 4G / WiFi information.

According to the embodiment of the present invention, when the user wearing the wearable electronic device 300 enters the area where the visible light communication with the GPS can not be achieved, the controller 360 uses the 4G / Wifi information to determine the position of the user It is possible to roughly calculate the position of a user using inertial navigation based on position recognition through image comparison or acceleration sensor and gyro / geomagnetic sensor. In addition, the control unit 360 can correct the position of the wearable electronic device 300 using GPS or visible light communication when the user enters the area where GPS or visible light communication is again performed.

Here, in order to increase the accuracy and processing speed of the image comparison, approximate position is calculated by the inertial navigation method, and the number of stored photographs to be compared can be reduced by comparing only stored photographs corresponding to the calculated positions with real images. If the image comparison matching succeeds and the success position is set as the new position of the user, the inertial navigation calculation is initialized and the inertial navigation calculation is performed to increase the accuracy of the inertial navigation by eliminating the drift.

On the other hand, the position recognition described above for low power may be transmitted to the wearable electronic device 300 after calculation in a terminal device such as a connected smart phone. When the photograph / movie is photographed in the wearable electronic device 300 and transmitted to the smart phone, the smart phone can perform the position recognition through the inertial navigation calculation and the image comparison.

7 is a view showing a lens combined with a polarizing shutter using linearly polarized light according to an embodiment of the present invention.

The polarizing film and the liquid crystal are arranged in a manner different from the conventional shutter spectacle lens so as to have the mutual orthogonal polarization characteristics of the right and left lenses as the polarization lens and the shutter opening / closing characteristics of the shutter lens at the same time. FIG. 7 shows the core components that largely affect the transmission light characteristics (light intensity, polarization direction, etc.) of the lens. The degree of influence on the transmission light characteristics such as the adhesive film and the reinforcing film added to the core components is small Parts have been omitted from the display.

Each lens of the polarizing shutter and the lens according to an embodiment of the present invention includes an initial polarized light separating unit, a polarized light converting unit, and a final polarized light separating unit. The incident light of the image emitted by the external display is first encountered by the first polarized light separator. The first polarizing section of the polarizing shutter using the linearly polarized light is, for example, a polarizing film such as the polarizing film 1. The first polarizing selector of the left and right lenses selects and transmits polarized light mutually orthogonal to the left eye lens and the right eye lens. That is, when the first polarized light separating section of the left eye lens transmits vertical linearly polarized light, the first polarized light separating section of the right eye lens transmits the mutually orthogonal polarized light so as to transmit the horizontal linearly polarized light. After the polarized light orthogonal to each other passes through the first polarizing section of the left and right lenses, the polarized light conversion section keeps the polarized light intact or converts the polarized light into orthogonal polarized light according to the applied voltage. Here, the polarization conversion unit is, for example, a TN liquid crystal. The final polarization selector of the left and right lenses transmits or blocks the polarized light that has passed through the polarization conversion section. The final polarized light selector is, for example, a polarizing film.

In the case of Fig. 7, no voltage is applied to both the right and left lens TN liquid crystals in the polarization viewing mode. In another embodiment, the transmissive direction of one of the left and right lenses is changed to be orthogonal to the transmissive direction of the polarizing film 2 shown in Fig. 7. In this case, in the polarized light viewing mode, A voltage may be applied only to the TN liquid crystal in contact with the polarizing film 2 arranged.

In the embodiment of Fig. 7, TN liquid crystal is used as the polarization conversion section, but other types of liquid crystals can also be applied as the polarization conversion section. It is also possible to dispose one or both of the liquid crystals shown in Fig. 7 in an orthogonal direction.

The polarizing shutter combination lens shown in FIG. 7 can be used as shutter glasses if the external 3D display device is implemented by a shutter type and can be used as polarizing glasses if it is a polarizing type. You can view various shutter type 3D display devices and polarizing type 3D display devices with one polarizing shutter lens, and you can also watch polarized 3D movies by using them in a movie theater.

One of the basic conditions of the shutter glasses and polarized glasses is that the difference in the amount of light entering the human eye should not be large. Thus, it is necessary to satisfy the condition of the left and right light amount difference, so that the 3D image can be clearly viewed and the eye fatigue is small. A situation in which the lens serving as both the polarization shutter according to the present invention satisfies the right-left light quantity difference condition is as follows.

The display system of the shutter type 3D display device in which the polarizing shutter-combined lens of Fig. 7A can be utilized is a stereoscopic display system in which left and right stereoscopic images It is a display system that emits video light. This is the case with many shuttered 3D display methods.

The polarized 3D display device in which the polarizing shutter combination lens of Fig. 7A can be utilized is configured so that the left eye image is linearly polarized light having the same polarization direction as the polarization direction of the left eye lens polarizing film 1 and the right eye image is displayed with the linear polarization same as the polarization direction of the right eye lens polarizing film 1 do. That is, the left eye image is displayed as horizontal linearly polarized light, the right eye image is displayed as vertical linearly polarized light, or the left eye image is displayed as vertical linearly polarized light and the right eye image is displayed as horizontal linearly polarized light. In the latter case, the right and left lenses of the polarizing shutter combination lens of Fig. 7A may be changed. This is the case with many polarized 3D display schemes.

The display system of the shutter type 3D display device in which the polarizing shutter combination lens of Fig. 7B can be utilized is a display system of a circular polarized light and a non-polarized light display system, and a polarized linear polarized light or a horizontal linear polarized light, Emitting display. This is the case with many shuttered 3D display methods.

The polarizing 3D display device in which the polarizing shutter combination lens of Fig. 7B can be utilized is configured so that the left eye image is linearly polarized in the same direction as the polarization direction of the left eye lens polarizing film 1 and the right eye image is displayed in the same linear polarization as the polarization direction of the right- do. That is, the left eye image is displayed as +45 degrees linearly polarized light from the vertical, the right eye image is displayed as -45 degrees linearly polarized light from the vertical direction, or the left eye image is displayed as -45 degrees linearly polarized light from the vertical direction, Is displayed. In the latter case, the left and right lenses of the polarizing shutter combination lens of Fig. 7B may be changed. This is the case with many polarized 3D display schemes.

8 is a view showing a lens combined with a polarizing shutter using circularly polarized light according to an embodiment of the present invention.

(90-degree phase delay plate), a polarizing film and a liquid crystal are arranged in a manner different from the conventional shutter glasses to have right and left lens mutual orthogonal polarization characteristics as polarizing glasses and shutter opening and closing characteristics as shutter glasses. Each lens of the polarizing shutter combination lens is composed of an initial polarized light separating portion, a polarized light converting portion, and a final polarized light separating portion. The incident light emitted by the external display is first encountered by the first polarized light selector. The polarized-light selecting section of the polarizing shutter-combined spectacle lens using circularly polarized light is constituted by, for example, a light phase delaying section and a polarizing filter section. In FIG. 8, the optical phase retarder is a 1/4 wavelength plate, and the polarization filter portion is a polarizing film such as the polarizing film 1. The first polarizing selector of the left and right lenses selects and transmits polarized light mutually orthogonal to the left eye lens and the right eye lens. That is, when the first polarized light selecting section of the left eye lens transmits the right circularly polarized light, the first polarized light selecting section of the right eye lens transmits the mutually orthogonal polarized light so as to transmit the left circularly polarized light. 8, when the 1/4 wave plate and the polarizing film 1 are used, it is preferable that the optical axis of the 1/4 wave plate forms an angle of +45 degrees or -45 degrees with the polarization transmission axis of the polarizing film 1. After the polarized light orthogonal to each other passes through the first polarizing section of the left and right lenses, the polarized light conversion section keeps the polarized light intact or converts the polarized light into orthogonal polarized light according to the applied voltage. The polarization conversion unit is, for example, a TN liquid crystal. The final polarization selector of the left and right lenses transmits or blocks polarized light that has passed through the polarization conversion section. The final polarized light selector is, for example, a polarizing film, and the polarizing film 2 is illustrated in Fig.

In the case of Fig. 8, no voltage needs to be applied to both the right and left lens TN liquid crystals in the polarization viewing mode. In another embodiment, the transmissive direction of one of the left and right lenses is changed so as to be orthogonal to the transmissive direction of the polarizing film 2 shown in Fig. 8. In this case, in the polarized light viewing mode, A voltage may be applied only to the TN liquid crystal in contact with the polarizing film 2 arranged. In another embodiment, all of the polarizing films 2 of the left and right lenses are arranged so that the transmission direction is orthogonal to the direction shown in Fig. 8. In this case, a voltage may be applied to all the liquid crystal in the polarized light viewing mode.

Although an example of the TN liquid crystal is described as the polarization conversion section in Fig. 8, other types of liquid crystals as the polarization conversion section can be similarly applied. It is also possible to dispose one or both of the liquid crystals shown in Fig. 8 in the orthogonal direction.

The polarizing shutter combination lens shown in Fig. 8 can be used as shutter glasses if the external 3D display is implemented by a shutter type, and can be used as polarized glasses if it is a polarizing type. A situation in which the lens serving as both the polarization shutter of the present invention satisfies the right-left light quantity difference condition is as follows.

The display method of the shutter type 3D display device in which the polarizing shutter combination lens of Fig. 8A can be utilized is a linear polarization and a non-polarization display method. This is the case with many shuttered 3D displays. In order to utilize the shutter type circularly polarized 3D display, the optical axis of the 1/4 wave plate of FIG. 8A and the polarized light transmission axis of the polarizing film 1 may be adjusted to 0 degree or 90 degrees. In another embodiment of the present invention, the lens of the polarizing shutter lens has an angle of 0 degree or 90 degrees with the first state in which the optical axis of the 1/4 wave plate and the polarization transmission axis of the polarizing film 1 form +45 degrees or -45 degrees To switch between the first and second states.

The polarized 3D display device in which the polarizing shutter combination lens of FIG. 8A can be utilized displays the right eye image as right circularly polarized light with left-handed circularly polarized light or rightwardly polarized light with right-handed circularly polarized light. This is the case with many polarized 3D display schemes.

A display system of a shutter type 3D display device in which the polarizing shutter combination lens of Fig. 8B can be utilized is a linear polarization and a non-polarization display system. For use in a shuttered circular polarization 3D display device, the optical axis of the quarter wave plate of FIG. 8B and the polarization transmission axis of the polarizing film 1 may be adjusted to 0 degree or 90 degrees. In another embodiment of the present invention, the lens of the polarizing shutter glasses may have an angle of 0 degree or 90 degrees with the first state in which the optical axis of the 1/4 wave plate and the polarized light transmission axis of the polarizing film 1 form +45 degrees or -45 degrees To switch between the first and second states.

The polarized 3D display device in which the polarizing shutter combination lens of FIG. 8B can be utilized displays the left eye image as right circularly polarized light with left-handed circularly polarized light, or displays right-eye image with left-handed circular polarized light with right-

In one embodiment, the left eye lens of the polarizing shutter combination lens of Fig. 8 may be replaced with a right eye lens and a right eye lens by a left eye lens.

9 is a diagram of a system according to an embodiment of the present invention. Referring to FIG. 9, the wearable electronic device 300 of the user and the smartphone of the user cooperate to perform networking. Specifically, when the user enters an area where the visible light communication with the GPS does not reach, the smartphone roughly calculates the position of the user using the 4G / Wifi information or uses the image recognition (marker or markerless) or the acceleration sensor and the gyro / The position of the user can be roughly calculated using inertial navigation based on a geomagnetic sensor or the like and transmitted to the wearable electronic device 300. In addition, in a region where the user again becomes GPS or visible light communication, the smart phone can calculate the position of the user using GPS or visible light communication and transmit it to the wearable electronic device 300. [

In this operation, when the photographing / moving picture is taken in the wearable electronic device 300 and transmitted to the smartphone, a method of recognizing the image and calculating the position in the smart phone can be used.

Meanwhile, the owner of the visible light communication light source can simultaneously provide the location information and the advertisement. In this case, the user wearing the wearable electronic device 300 can be provided with the position information together with the advertisement only when the user is allowed to receive the advertisement. In this case, the wearable electronic device 300 can transmit and receive positional information and advertisement information at the same time.

Meanwhile, the method according to various embodiments of the present invention described above may be implemented in program code and provided to each server or devices in a state stored in various non-transitory computer readable media.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

300: wearable electronic device 310:
320: camera 330: sensing unit
340: display unit 350: communication unit
360: storage unit 400: external device

Claims (7)

In a wearable electronic device,
A polarizing shutter combined lens unit;
A camera unit for photographing a foreground recognized by the wearer's wearer's vision;
A communication unit for transmitting a real image corresponding to the taken foreground to a server providing position information;
A display unit for displaying additional information on the lens unit to provide visual additional information in addition to a foreground recognized by the wearer's wearer's vision; And
Receiving position information calculated by the server according to the transmitted real image when the operation mode of the wearable electronic device is a navigation mode, generating direction information to a destination based on the received position information, And controlling the display unit to display the generated direction information as the additional information. The method according to claim 1,
Wherein the communication unit includes a visible light communication module,
Wherein the control unit controls the communication unit to transmit the real image to the server using the visible light communication module. 3. The method of claim 2,
And a sensing unit including at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor,
Wherein,
And controls the communication unit to transmit the position information of the wearable electronic device calculated by applying inertia navigation to the server together with the real image based on the sensing value measured by the sensing unit . The method according to claim 1,
Wherein the communication unit further receives advertisement information from the server,
Wherein,
And controls the display unit to display the generated direction information and the received advertisement information as the additional information. A control method for a wearable electronic device having a polarizing shutter and a lens unit,
Photographing a foreground recognized by the wearer's wearer's vision;
Transmitting a real image corresponding to the taken foreground to a server providing position information;
Receiving location information calculated by the server according to the transmitted real image when the operation mode of the wearable electronic device is a navigation mode;
Generating direction information to a destination based on the received location information; And
And displaying the generated direction information in addition to the foreground recognized by the wearer's wearer's eyesight. 6. The method of claim 5,
Wherein the transmitting and receiving comprises:
Wherein the method is performed using a visible light communication method. The method according to claim 6,
Further comprising calculating positional information of the wearable electronic device by applying an inertial navigation based on the sensed value measured using at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor,
Wherein the transmitting comprises:
And transmits the calculated position information to the server together with the real image.

Images