KR20140130332A - Wearable electronic device and method for controlling the same - Google Patents

Abstract

A wearable electronic device is disclosed. The wearable electronic device comprises: a transparent or transmissive lens unit; a camera unit which captures a foreground recognized by a view of a user wearing the wearable electronic device; a communications unit which transmits a real image corresponding to the captured foreground to a server that provides position information; a display unit which displays additional information on the lens unit so as to provide visual additional information by adding the additional information to the foreground recognized by the view of the user wearing the wearable electronic device; and a control unit which, when an operation mode of the wearable electronic device is a navigation mode, receives position information calculated by the server according to the transmitted real image, generates direction information on a direction to a destination based on the received position information, and displays the generated direction information as the additional information.

Description

[0001] Wearable electronic device and method for controlling same [0002]

The present invention relates to a method of controlling a wearable electronic device in the form of a pair of glasses or the like.

The augmented reality is different from the virtual reality technology in that the virtual reality is supplemented and displayed to the user by superimposing the virtual world on the real world, which is advantageous in providing a better sense of reality to the user than the virtual reality.

Generally, the augmented reality uses a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display) to display various information in front of the user's eyes. In addition, researches on manipulating an augmented object in augmented reality using gesture recognition are actively under way.

The HMD is mounted on the user's head or other part and presents independent projected images to the left and right eyes so that when the user watches the object of view, An image is generated and the binocular parallax enables the perception of the depth sense.

The HUD also projects images in a transparent glass such as glass to allow the user to visually recognize the information projected from the HUD and the external background simultaneously through the transparent glass.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a wearable electronic device capable of performing continuous position recognition using visible light communication with a wearable electronic device to improve convenience and safety of a user and utilize for navigation, And a control method.

It is another object of the present invention to provide a wearable electronic device capable of performing accurate position recognition by blending visible light communication of a wearable electronic device with GPS, inertial navigation, and image recognition technology, and a control method thereof.

According to another aspect of the present invention, there is provided a wearable electronic device including a transparent or light transmissive lens unit, a camera unit for photographing a foreground recognized by the wearer's wearer's vision, A communication unit for transmitting a real image corresponding to the photographed foreground to a server providing position information; a communication unit for transmitting additional information to the lens unit in order to provide visual additional information in addition to the foreground recognized by the wearing- When the operation mode of the wearable electronic device is the navigation mode, receives the position information calculated by the server according to the transmitted real image, and based on the received position information, And controls the display unit to display the generated direction information as the additional information It is a control unit.

The communication unit may include a visible light communication module, and the control unit may control the communication unit to transmit the real image to the server using the visible light communication module.

The sensing unit may further include a sensing unit including at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and the control unit may control the sensing unit to sense the sensed value of the wearable electronic device The control unit can control the communication unit to transmit the location information to the server together with the real image.

The communication unit may further receive advertisement information from the server, and the control unit may control the display unit to display the generated direction information and the received advertisement information as the additional information.

According to another aspect of the present invention, there is provided a method of controlling a wearable electronic device having a transparent or light transmissive lens unit according to an embodiment of the present invention, A step of transmitting a real image corresponding to the photographed foreground to a server providing position information, a step of, when the operation mode of the wearable electronic device is a navigation mode, Receiving the position information, generating direction information to the destination based on the received position information, and displaying the generated direction information in a foreground recognized by the wearer's wearer's viewpoint .

The transmitting step and the receiving step may be performed using a visible light communication method.

The method of claim 1, further comprising calculating position information of the wearable electronic device by applying an inertial navigation based on a sensed value measured using at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, , And transmit the calculated position information to the server together with the real image.

And receiving advertisement information from the server, wherein the displaying step adds the generated direction information and the received advertisement information to a foreground recognized by the wearer's wearer's eyesight Can be displayed.

According to the various embodiments of the present invention described above, a seamless position recognition function is added to the wearable electronic device, thereby greatly improving convenience and safety of the user.

In addition, using wearable electronic devices and visible light communication, it can integrate GPS, inertial navigation, and image recognition technology to perform continuous precision position recognition, and can be utilized for navigation, targeted advertisement provisioning, and security location tracking.

In addition, since the communication-related device must exist in the field of view (FOV) of the visible light communication using the illumination and display infrastructure, the wearable electronic device to be worn is an optimal device for visible light communication, .

1 and 2 are perspective views showing a configuration of a wearable electronic device according to an embodiment of the present invention.
Figure 3 is an illustration of an example of a view seen by a user through a wearable electronic device.
Figs. 4 and 5 are perspective views showing still another embodiment of the configuration of the wearable electronic device. Fig.
6 is a block diagram illustrating an embodiment of a configuration of a wearable electronic device according to the present invention.
7 is a diagram of a system according to an embodiment of the present invention.
8 is a diagram illustrating visible light communication according to an embodiment of the present invention.
9 is a diagram showing a control method of the electronic device for mounting according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is a perspective view showing the construction of a wearable electronic device according to an embodiment of the present invention. The wearable electronic device 1 shown in Fig. 1 can be manufactured in the form of glasses so as to be positioned close to the user's eyes.

1, which shows a front view of a wearable electronic device 1, a wearable electronic device 1 according to an embodiment of the present invention includes left and right lens frames 10 and 11, 20, left and right hooking portions 30, 31, and right and left lenses 50, 51.

1, a camera 110 may be mounted on a front surface of the frame connector 20, for example, as shown in FIG. 1, Can be disposed.

 Accordingly, the user wears the wearable electronic device 1 in the form of a glass, and can photograph or store or share the picture or the moving picture using the camera 110 while moving.

In this case, the viewpoint of the image captured by the camera 110 may be very similar to the viewpoint of the scene recognized by the user.

In addition, a gesture such as a user's hand movements is recognized using the camera 110, and the operation or function of the wearable electronic device 1 can be controlled according to the recognized gesture.

The position or the number of the camera 110 may be changed as needed, and a special-purpose camera such as an infrared camera may be used.

Further, units for performing a specific function may be arranged in each of the right and left fastening portions 30 and 31. [

The right side-arm 31 may be equipped with user interface devices for receiving user input for controlling the function of the wearable electronic device 1. [

For example, a track ball 100 or a touch pad 101 for selecting or moving an object such as a cursor on a screen, a menu item, or the like may be disposed on the right hook 31.

The user interface device provided in the wearable electronic device 1 is not limited to the track ball 100 and the touch pad 101 but may be a variety of devices such as a key pad dome switch, Input devices may be provided.

On the other hand, a microphone 120 may be mounted on the left side-arm 30, and the operation or function of the wearable electronic device 1 may be detected by using the voice of the user recognized through the microphone 120 Lt; / RTI >

The sensing unit 130 is disposed on the left hook 30 to sense the current state of the wearable electronic device 1 such as the position of the wearable electronic device 1, presence or absence of user contact, bearing, acceleration / deceleration, Thereby generating a sensing signal for controlling the operation of the wearable electronic device 1. [

For example, the sensing unit 130 may include a motion sensor such as a gyroscope or an accelerometer, a position sensor such as a GPS device, a magnetometer, a theodolite, A direction sensor, a temperature sensor, a humidity sensor, a wind direction / wind speed sensor, and the like. However, the present invention is not limited thereto and may include sensors capable of detecting various information in addition to the above sensors.

For example, the sensing unit 130 may further include an infrared sensor. The infrared sensor includes a light emitting unit that emits infrared rays and a light receiving unit that receives infrared rays. The infrared sensor may be used for infrared communication, .

The wearable electronic device 1 according to an embodiment of the present invention may include a communication unit 140 for communication with an external device.

For example, the communication unit 140 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, and a local communication module.

The broadcast receiving module receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast- The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast-related information may be provided through a mobile communication network, and in this case, it may be received by a mobile communication module.

Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module may be a DMB-T (Digital Multimedia Broadcasting-Terrestrial), a DMB-S (Digital Multimedia Broadcasting-Satellite), a MediaFLO (Media Forward Link Only), a DVB- And a digital broadcasting system such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module may be configured to be suitable not only for the digital broadcasting system described above but also for all broadcasting systems that provide broadcasting signals.

The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in a memory.

On the other hand, the mobile communication module transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module is a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

In addition, the wearable electronic device 1 according to an embodiment of the present invention may include a display device for displaying an image to transmit visual information to a user.

The display device may be configured to include a transparent or light transmissive unit so that a user can see a front view that is displayed in front of the information displayed by the display device.

For example, at least one of the left and right lenses 50, 51 shown in Fig. 1 functions as a transparent display as described above, so that the user can visually recognize the text or image formed on the lens, Can be seen.

For this purpose, the wearable electronic device 1 can display various information in front of the user by using a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display).

The HMD includes a lens that enlarges an image to form a virtual image, and a display panel disposed at a position closer to the focal distance of the lens. When the HMD is mounted near the user's head, the user can visually recognize the virtual image by viewing the image displayed on the display panel through the lens.

In the HUD, an image displayed on a display panel is enlarged through a lens, the enlarged image is reflected by a half mirror, and the reflected light is displayed to a user, thereby forming a virtual image. In addition, since the half mirror transmits external light, the user can see the foreground as well as the virtual image formed by the HUD by the light from the outside passing through the half mirror.

The display device may be implemented using various transparent display methods such as TOLED (Transparent OLED).

Hereinafter, an embodiment of the present invention will be described by exemplifying that the wearable electronic device 1 has the HUD, but the present invention is not limited thereto.

Referring to the rear surface configuration of the wearable electronic device 1 shown in Fig. 2, HUDs 150 and 151, which function similar to a projector, are provided on the rear surface of at least one of the left hooking portion 30 and the right hooking portion 31, Can be mounted.

The image formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51 and is displayed to the user so that the object 200 formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51, 51). ≪ / RTI >

In this case, the object 200 and the foreground 250 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 can be observed together with the user's field of view, as shown in Fig.

The object 200 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 is not limited to the menu icon as shown in Fig. 3 and may be an image such as text, a picture, a moving picture, or the like.

1 and 2, the wearable electronic device 1 can be used for shooting, telephone, message, social network service (SNS), navigation, , Search, and so on.

The functions of the wearable electronic device 1 may be various functions in addition to the functions described above according to the provided modules.

For example, functions that combine two or more functions may be implemented by transmitting a moving image photographed through the camera 110 to the SNS server through the communication unit 140 and sharing the same with other users.

A 3D glasses function for allowing a user to view a stereoscopic image may be implemented in the wearable electronic device 1. [

For example, the external display device alternately displays the left eye image or the right eye image alternately on a frame basis, so that the wearable electronic device 1 can selectively open or shut off the user's binocular to allow the user to feel a stereoscopic effect have.

That is, the wearable electronic device 1 opens the user's left-side shutter when the display device displays the left-eye image, opens the right-eye-side shutter of the user when the display device displays the right- 3-D images can be recognized.

Figures 4 and 5 show another embodiment of the construction of the wearable electronic device in perspective view.

4, the wearable electronic device 1 is provided with only one of the right and left lenses (for example, the right lens 51), so that only one eye can display the wearable electronic device 1 internal display So that an image displayed on the device can be displayed.

5, one eye (e.g., left eye) portion of the user is completely uncovered without being covered by the lens, and only an upper portion of another eye (e.g., right eye) The wearable electronic device 1 may be embodied in a structure that is shielded by the wearable electronic device 1.

The shape and configuration of the above-described wearable electronic device 1 may be selected or changed according to various needs such as the field of use, main function, main use layer, and the like.

Hereinafter, a method of controlling a wearable electronic device according to an exemplary embodiment of the present invention will be described in detail with reference to FIGS.

FIG. 6 is a block diagram of an embodiment of a wearable electronic device according to the present invention. The wearable electronic device 300 includes a control unit 310, a camera 320, a sensing unit 330, A display unit 340, a communication unit 350, and a storage unit 360.

Referring to FIG. 6, the control unit 310 typically controls the overall operation of the wearable electronic device 300 and may include, for example, associated controls for shooting, phone, message, SNS, navigation, And processing. The controller 310 may include a multimedia module (not shown) for multimedia playback. The multimedia module may be implemented in the controller 310 or may be implemented separately from the controller 310.

The control unit 310 includes a camera 320, a sensing unit 330, a display unit 340, a communication unit 350, and a storage unit 350, including one or more processors and a memory for performing the functions described above. And processing the signal input from the controller 360 and analyzing the processed signal.

On the other hand, the camera 320 processes an image frame such as still image or moving image obtained by the image sensor in a video communication mode or a photographing mode, and the processed image frame can be displayed through the display unit 340.

The image frame processed by the camera 320 may be stored in the storage unit 360 or may be transmitted to the outside via the communication unit 350. The camera 320 may be provided at two or more different positions depending on the use environment.

The sensing unit 330 may perform the function of the sensing unit 130 described above.

Meanwhile, the storage unit 360 may store a program for the operation of the control unit 310 and temporarily store input / output data (e.g., a message, a still image, a moving picture, and the like).

The storage unit 360 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk.

The wearable electronic device 300 may also operate in association with a web storage that performs storage functions of the storage 360 on the Internet.

The display unit 340 displays (outputs) information to be processed in the wearable electronic device 300. For example, when the wearable electronic device 300 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. In the video communication mode or the photographing mode, Image, UI, and GUI can be displayed.

1 to 3, the display unit 340 may include an HMD, a HUD (HUD), and a display unit (not shown) to allow the user to visually recognize an object displayed through the display unit 340, Or a transparent display method such as TOLED.

The communication unit 350 may include one or more communication modules for enabling the wearable electronic device 300 to perform data communication with the external device 400 and may include, for example, a broadcast receiving module, a mobile communication module, An Internet module, a local area communication module, a location information module, and the like.

The wearable electronic device 300 may further include an interface unit (not shown) serving as a path for communication with all external devices connected to the wearable electronic device 300.

The interface unit receives data from an external device or supplies power to each component in the wearable electronic device 300 or allows data in the wearable electronic device 300 to be transmitted to an external device.

For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit.

The identification module is a chip for storing various information for authenticating the usage right of the wearable electronic device 300. The identification module includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Thus, the identification device can be connected to the wearable electronic device 300 through the port.

In addition, the interface may be a path through which power from the cradle is supplied to the wearable electronic device 300 when the wearable electronic device 300 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

Meanwhile, the wearable electronic device 300 may further include a power supply unit (not shown) that receives external power and internal power under the control of the control unit 310 and supplies power required for operation of the respective components have. The power supply unit may include a system capable of charging using solar energy.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof. According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 360 and executed by the control unit 310. [

Hereinafter, a mounting electronic device and a control method thereof according to an embodiment of the present invention will be described in more detail based on the configuration of the wearable electronic device 300 described above.

The camera 320 can photograph the foreground recognized by the user's eyes in accordance with the line of sight of the wearer wearing the wearable electronic device 300. [ In this case, the camera 320 can generate an image corresponding to the foreground (hereinafter referred to as a real image) recognized by the user's viewpoint in accordance with the user's gaze.

The control unit 310 compares the real image photographed through the camera 320 with the stored image, and detects the position information of the wearable electronic device 300 when photographing the real image using the comparison result. Specifically, the stored image may be tagged with location information, and the control unit 310 compares the captured real image with the stored image, and detects a stored image having a predetermined degree of similarity using the comparison result . Accordingly, position information can be extracted from the detected stored image. Here, the pre-stored image may be an image generated by photographing by orientation at the corresponding position. Here, at the time of the above-mentioned comparison, the control unit 310 can compare the moving object such as a person, an automobile, etc. in the real image. Here, the above-described comparison can be repeatedly performed, thereby continuously detecting the position information according to the movement of the user wearing the wearable electronic device 300. [

In addition, if the wearable electronic device 300 is in the visible light communication area, the control unit 310 may use the detected position information and the position information received from the owner of the visible light communication light source in visible light communication together, The position of the electronic device 300 can be recognized. Here, the communication unit 350 may include an optical sensor such as a photodiode for performing the above-described visible light communication. On the other hand, if the wearable electronic device 300 is in the visible light communication area, the control unit 310 converts the photographed real image (image looking at the visible light communication light source) into a device (e.g., a server) corresponding to the owner of the visible light communication light source, The communication unit 350 can control the communication unit 350 to transmit the information. In this case, the device corresponding to the owner of the visible light communication light source compares the various images looking at the owner light source at various positions around the user and the real image received from the wearable electronic device 300 to determine the distance and orientation to the owner light source Can be measured. Then, the device corresponding to the owner of the visible light communication light source transmits the measured distance and orientation to the wearable electronic device 300, and accordingly, the control unit 310 determines the position of the wearer wearing the wearable electronic device 300 Can be detected. Meanwhile, the controller 310 may control the communication unit 350 to activate the visible light communication or to increase the frequency of the visible light communication transmission / reception when the user is moving, such as whether the user is moving or moving. Accordingly, the wearable electronic device 300 can receive the visible light communication of the LED lighting and the LED billboard / display to perform precise position recognition. Particularly, it is possible to activate visible light communication or increase the frequency of visible light communication when there is a user in an area where GPS reception is weak, such as indoor or underground, or when the user is moving.

In addition, the user can measure the movement and the movement of the user with acceleration, gyro, gravity, tilt, geomagnetic sensor, proximity sensor, optical sensor, etc., and activate the visible light communication or increase the frequency of visible light communication when the user is moving. For low power, it is possible to increase the reception frequency of visible light communication of smart glasses while on the move and reduce the reception frequency when stopping. Also, it is possible to increase the frequency of storing the position value in the user life log when there is movement based on the motion measurement.

In addition, the control unit 310 determines the position of the user wearing the wearable electronic device 300 using inertial navigation based on the measured values measured by the sensing unit 330 such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, Can be calculated.

Also, the control unit 310 may calculate the position of the wearer wearing the wearable electronic device 300 using the 4G / WiFi information.

According to the embodiment of the present invention, when the user wearing the wearable electronic device 300 enters the area where the visible light communication with the GPS can not be achieved, the controller 360 uses the 4G / Wifi information to determine the position of the user It is possible to roughly calculate the position of a user using inertial navigation based on position recognition through image comparison or acceleration sensor and gyro / geomagnetic sensor. In addition, the control unit 360 can correct the position of the wearable electronic device 300 using GPS or visible light communication when the user enters the area where GPS or visible light communication is again performed.

Here, in order to increase the accuracy and processing speed of the image comparison, approximate position is calculated by the inertial navigation method, and the number of stored photographs to be compared can be reduced by comparing only stored photographs corresponding to the calculated positions with real images. If the image comparison matching succeeds and the success position is set as the new position of the user, the inertial navigation calculation is initialized and the inertial navigation calculation is performed to increase the accuracy of the inertial navigation by eliminating the drift.

On the other hand, the position recognition described above for low power may be transmitted to the wearable electronic device 300 after calculation in a terminal device such as a connected smart phone. When the photograph / movie is photographed in the wearable electronic device 300 and transmitted to the smart phone, the smart phone can perform the position recognition through the inertial navigation calculation and the image comparison. This will be described in detail with reference to FIG.

7 is a diagram of a system according to an embodiment of the present invention. Referring to FIG. 7, the wearable electronic device 300 of the user and the smartphone of the user cooperate to perform networking. Specifically, when the user enters an area where the visible light communication with the GPS does not reach, the smartphone roughly calculates the position of the user using the 4G / Wifi information or uses the image recognition (marker or markerless) or the acceleration sensor and the gyro / The position of the user can be roughly calculated using inertial navigation based on a geomagnetic sensor or the like and transmitted to the wearable electronic device 300. In addition, the smartphone can calculate the position of the user using the GPS or visible light communication in the area where the user again becomes the GPS or visible light communication, and transmit the calculated position to the wearable electronic device 300. [

In this operation, when the photographing / moving picture is taken in the wearable electronic device 300 and transmitted to the smartphone, a method of recognizing the image and calculating the position in the smart phone can be used.

8 is a diagram illustrating visible light communication according to an embodiment of the present invention. Referring to FIG. 8, the wearable electronic device 300 in the visible light communication coverage capable of performing visible light communication of LED lighting, LED billboard / display receives position information of the wearable electronic device 300 using visible light communication can do.

9 is a diagram illustrating a control method of a wearable electronic device according to an embodiment of the present invention. Referring to FIG. 9, when the wearable electronic device is in a navigation mode for indicating a destination, the control unit 310 may provide the display unit 340 with direction information to a destination using the calculated position information. In this case, the display unit 340 can display the received direction information in synchronization with the position of the corresponding area. Accordingly, a user who wears the wearable electronic device 300 can view the foreground displayed in front of the user together with the change information displayed by the display unit 340. [

Meanwhile, the owner of the visible light communication light source can simultaneously provide the location information and the advertisement. In this case, the user wearing the wearable electronic device 300 can be provided with the position information together with the advertisement only when the user is allowed to receive the advertisement. In this case, the wearable electronic device 300 can transmit and receive positional information and advertisement information at the same time.

Meanwhile, the method according to various embodiments of the present invention described above may be implemented in program code and provided to each server or devices in a state stored in various non-transitory computer readable media.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

300: wearable electronic device 310:
320: camera 330: sensing unit
340: display unit 350: communication unit
360: storage unit 400: external device

Claims (8)

In a wearable electronic device,
A transparent or light transmissive lens unit;
A camera unit for photographing a foreground recognized by the wearer's wearer's vision;
A communication unit for transmitting a real image corresponding to the taken foreground to a server providing position information;
A display unit for displaying additional information on the lens unit to provide visual additional information in addition to a foreground recognized by the wearer's wearer's vision; And
Receiving position information calculated by the server according to the transmitted real image when the operation mode of the wearable electronic device is a navigation mode, generating direction information to a destination based on the received position information, And controlling the display unit to display the generated direction information as the additional information. The method according to claim 1,
Wherein the communication unit includes a visible light communication module,
Wherein the control unit controls the communication unit to transmit the real image to the server using the visible light communication module. 3. The method of claim 2,
And a sensing unit including at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor,
Wherein,
And controls the communication unit to transmit the position information of the wearable electronic device calculated by applying inertia navigation to the server together with the real image based on the sensing value measured by the sensing unit . The method according to claim 1,
Wherein the communication unit further receives advertisement information from the server,
Wherein,
And controls the display unit to display the generated direction information and the received advertisement information as the additional information. A control method of a wearable electronic device having a transparent or light transmissive lens portion,
Photographing a foreground recognized by the wearer's wearer's vision;
Transmitting a real image corresponding to the taken foreground to a server providing position information;
Receiving location information calculated by the server according to the transmitted real image when the operation mode of the wearable electronic device is a navigation mode;
Generating direction information to a destination based on the received location information; And
And displaying the generated direction information in addition to the foreground recognized by the wearer's wearer's eyesight. 6. The method of claim 5,
Wherein the transmitting and receiving comprises:
Wherein the method is performed using a visible light communication method. The method according to claim 6,
Further comprising calculating positional information of the wearable electronic device by applying an inertial navigation based on the sensed value measured using at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor,
Wherein the transmitting comprises:
And transmits the calculated position information to the server together with the real image. 6. The method of claim 5,
And receiving advertisement information from the server,
Wherein the displaying step displays the generated direction information and the received advertisement information in a foreground recognized by the wearer's wearer's time.

Images