KR20160120131A - Wearalbe terminal and display device wireless communicating with the same - Google Patents

Abstract

The present invention provides a wearable terminal. The present invention comprises: a body unit capable of being worn on the neck of a user; an input unit which receives a control command for activating an eating trace mode; a trace sensor unit which senses at least one among sound information and motion information if the eating trace mode is activated; and a control unit which forms eating result information including kind of eating food, the quantity of eating food, and eating state information based on the motion information and the sound information.

Description

TECHNICAL FIELD [0001] The present invention relates to a wearable terminal and a display device that wirelessly communicates with the wearable terminal.

The present invention relates to a wearable type terminal that can be worn on a user's neck.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable. The glass-type terminal can be divided into a handheld terminal and a vehicle mount terminal depending on whether the user can directly carry the glass-type terminal.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

2. Description of the Related Art [0002] Recently wearable-type terminals that can be mounted on a part of a person's body and perform various functions have been developed. In particular, in the case of a neckband type terminal formed to be mounted near a mouth and neck of a user, a user's voice can be received more easily. In addition, in the case of a neckband-type terminal, it is possible to detect a sound that occurs even when the user speaks, as well as when eating food.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to provide a wearable terminal that senses a user's food intake state, records a food eaten by the user, and analyzes an intake state.

According to another aspect of the present invention, there is provided a wearable terminal including a wearable body part mounted on a user's neck, an input part for receiving a control command for activating an intake tracking mode, And a controller for generating intake result information including the type of food consumed based on the motion information and the sound information, the amount of the food, and the intake state information, .

As an example related to the present invention, management data based on the care mode set by the user and the intake result information may be output by the user while the user is eating the food or after eating the food. Thereby providing personalized information to the health status of each user and enabling the user to immediately recognize and improve erroneous eating habits based on management data provided during ingestion of the food.

As an example related to the present invention, the control command may include a voice including words frequently occurring when a user eats food, a voice formed by vibrations generated when food is consumed, or formed through an image of a food sensed by a camera The user can record the food and the intake state to be consumed without needing to apply a separate control command.

As an example related to the present invention, the intake result information is transmitted to a display device including a display unit, and the user can confirm and correct the intake result information, so that accurate intake result information can be provided.

According to the present invention, when a user wearing a wearable terminal consumes food, information on the food consumed based on the user's voice and the detection of physical movement for consuming the food, and the ingestion result information including the intake state .

Accordingly, the user does not need to separately input or memorize the type of food and the amount of food to be eaten, and can confirm the information on the state of intake that the user can not recognize while consuming the food.

1 is a block diagram illustrating components of a wearable terminal according to an embodiment of the present invention;
FIG. 2 is a view of a wearable terminal in one direction according to an embodiment. FIG.
FIG. 3A is a flowchart illustrating a method of controlling a wearable terminal according to an embodiment of the present invention; FIG.
FIG. 3B is a conceptual diagram illustrating a control method of a wearable terminal according to another embodiment; FIG.
4A to 4H are conceptual diagrams for explaining a control method for activating the intake tracking mode.
5A to 5D are conceptual diagrams for explaining a control method of outputting warning data based on an intake state.
6A to 6F are conceptual diagrams for explaining a control method of providing intake result information based on a care mode.
7A to 7D are conceptual diagrams for explaining a control method of setting a care mode according to various embodiments;
8A to 8H are conceptual diagrams for explaining a control method of outputting management data according to various embodiments.
9A to 9D are conceptual diagrams for explaining a control method of a wearable terminal in cooperation with an external device.
10 is a perspective view of a wearable terminal having a camera according to another embodiment;
11A to 11C are conceptual diagrams for explaining a control method of the wearable terminal of FIG.
12A and 12B are views of a wearable terminal having a tracking sensor module according to another embodiment from one direction.
13A is a conceptual diagram illustrating a wearable terminal having an additional sensor module.
13B and 13C are conceptual diagrams for explaining a control method of outputting warning vibration using Fig. 13A. Fig.
14A to 14E are conceptual diagrams for explaining a control method of a wearable terminal according to various embodiments.
15A and 15B are conceptual diagrams for explaining a control method of a wearable device according to various embodiments when eating earphones and eating food.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

1 is a block diagram illustrating components of a wearable terminal according to an embodiment of the present invention. The wearable terminal according to the present invention corresponds to a neckband type terminal worn on a user's neck.

The wearable terminal 200 according to the embodiment of the present invention includes a wireless communication unit 201, an input unit 202, a sensing unit 204, an output unit 205, an interface unit 206, a memory 207, 208, a USIM unit 203, a power supply unit 209, and the like. The wireless communication unit 201 may include one or more modules for enabling wireless communication between the wearable terminal 200 and the mobile terminal or between the wearable terminal 200 and an external server.

The wireless communication unit 201 may include at least one of a radio receiving module 201a, a mobile communication module 201b, a local area communication module 201c, and a location information module 201d.

The input unit 202 may include a microphone 202b for inputting an audio signal or an audio input unit and a user input unit 202c for receiving information from a user. The microphone 202b includes a microphone 248 (see FIG. 4) provided in the wearable terminal 200. FIG.

The sensing unit 204 may include a proximity sensor 204a, an illuminance sensor 204b, a touch sensor, an acceleration sensor, a magnetic sensor, a gravity sensor, a gyroscope sensor, And may include at least one of a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, and an ultrasonic sensor. Particularly, the illuminance sensor 204b may include an illuminance sensor 260 provided in the body 220 of the wearable terminal 200. [

The output unit 205 may include at least one of an acoustic output unit 205a, a haptic module 205b, and a light output unit 205c. The sound output unit 205a may include a speaker module 243 (see FIG. 4) provided in the body 220 of the wearable terminal 200 and a speaker module provided in the earphone 240.

The interface unit 206 serves as a pathway to various kinds of external devices connected to the wearable terminal 200. The interface unit 206 may include an external charger port, a data port such as the USB port 228, a memory card port, a device having an identification module such as the USIM unit 203, And a port for connecting the first terminal and the second terminal.

The memory 207 stores data supporting various functions of the wearable terminal 200. The memory 207 may store a plurality of application programs driven by the wearable terminal 200, data for operating the wearable terminal 200, and commands. At least some of these applications may be downloaded from an external server via wireless communication.

The control unit 208 controls the overall operation of the wearable terminal 200 in addition to the operations related to the application program. The control unit 208 processes signals, data, and information input or output through the above-mentioned components, or drives an application program stored in the memory 207 to provide or process appropriate information or functions to the user have.

Under the control of the controller 208, the power supply unit 209 supplies power to the components included in the wearable terminal 200 by receiving external power or internal power. The power supply unit 209 includes a battery 270 (see FIG. 4), which may be an internal battery or a replaceable battery.

Meanwhile, the radio reception module 201a of the radio communication unit 201 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. More than one such radio receiving module may be provided to the mobile terminal 200 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information.

The mobile communication module 201b may be a mobile communication module or a mobile communication module that can be used in a mobile communication system such as a mobile communication system, (WCDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only) Long Term Evolution-Advanced), and the like, to a base station, an external terminal, and a server. The mobile communication module 201b and the USIM card are installed in the wearable terminal 200 so that the wearable terminal 200 itself can perform the function of the mobile phone.

The wireless signal may include various types of data according to a voice call signal or a text / multimedia message transmission / reception. If the wearable terminal 200 is provided with a display window, transmission / reception of text / multimedia messages will also be possible.

The short-range communication module 201c includes a short-

(Bluetooth), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi- Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short distance communication module 201c may support wireless communication between the wearable terminal 200 and another wireless communication system through the wireless area network or between the wearable terminal 200 and an external device . The short-range wireless communication network may be a short-range wireless personal area network.

The positional information module 201d is a module for acquiring the position of the wearable terminal 200. As a representative example thereof, there is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, in the case of a GPS module, the position of the wearable terminal 200 can be acquired using a signal transmitted from a GPS satellite. As another example, in the case of a Wi-Fi module, the position of the wearable terminal 200 can be acquired based on information of a wireless access point (AP) that transmits or receives a wireless signal with the Wi-Fi module.

The microphone 202b processes the user's voice signal input during the call process as electrical voice data. The processed voice data is transmitted to the external device. Meanwhile, various noise elimination algorithms may be implemented in the microphone 202b to remove noise generated in receiving an external sound signal.

The user input unit 202c may include a button, a dome switch, a jog wheel, a jog switch, and a touch type input unit.

Meanwhile, the sensing unit 204 senses at least one of information in the wearable terminal 200, surrounding environment information surrounding the wearable terminal 200, and user information, and generates a corresponding sensing signal. The control unit 208 may control the driving or operation of the wearable terminal 200 or may perform data processing, function or operation related to the application program installed in the wearable terminal 200 based on the sensing signal.

The sound output unit 205a may output audio data received from the wireless communication unit 201 or stored in the memory 207 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 205a also outputs an acoustic signal related to a call signal reception sound. The sound output unit 205a may include an earphone 240 and a speaker module 243.

The haptic module 205b generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 205b may be vibration. The intensity and pattern of the vibration generated in the haptic module 205b can be controlled by the user's selection or setting of the control unit 208. [ For example, vibration may be generated by tapping the body 220 of the wearable terminal 200 with a finger, and the vibration may be sensed by the haptic module 205b so that a photographing operation of an image or an image may be performed .

The haptic module 205b can transmit a tactile effect through direct contact, and can be implemented so that a user can feel a tactile effect through a muscular sense such as a finger or an arm. At least two haptic modules 205b may be provided.

The light output unit 205c may output a signal for notifying the occurrence of an event by using light emitted from a light source provided in the wearable terminal 200. [ For example, a call signal reception, a missed call, an alarm, and the like may be included in the notification event.

Meanwhile, the identification module including the USIM unit 130 includes a user identification module (UIM), a subscriber identity module (SIM), and the like in addition to the universal subscriber identity module (USIM) can do. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the wearable terminal 200 through the interface unit 206. [

The memory 207 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk.

FIG. 2 is a view showing a wearable terminal in one direction according to an embodiment. The body 220 may include a first body 220a and a second body 220b. The earphone 240 is detachably attached to the end of each of the pair of body parts 220a and 220b.

Here, the first body 220a may be defined as a right body portion, and the second body portion 220b may be defined as a left body portion. A battery corresponding to the power supply unit 209 may be mounted inside the right side body.

The volume button 224a, the power switch 229 and the usb port 228 are mounted in the internal space of the body portion and the volume button 224a, the power switch 229, and the usb port 228 Holes for mounting can be formed separately.

A circuit board 250 is also installed in the body and a speaker module 243, a wireless communication unit 110, a microphone 248, and the like may be mounted on the circuit board 250. The speaker module 243 is disposed directly below the speaker hole 241 and outputs sound through the speaker hole 241 when the earphone 240 is not used.

A plurality of functional modules and electrical components are provided separately, and the mounting positions of the plurality of functional modules and electrical components can be appropriately changed.

FIG. 3A is a flowchart illustrating a method of controlling a wearable terminal according to an embodiment of the present invention, and FIG. 3B is a conceptual diagram illustrating a method of controlling a wearable terminal according to another embodiment.

The user can perform an arbitrary function while wearing the wearable terminal 200 on the shoulder. For example, the user can listen to music using the earphone 240. In step S110, the wearable terminal 200 receives a control command for activating the ingestion tracking mode while the wearable terminal 200 is mounted on the user's body.

The input unit 202 receives the control command. The input unit 202 includes the microphone 202b and the user input unit 202c. If the control command is a voice command or a specific sound of the user, the microphone 202 a may be driven in a doze mode in which the active state and the inactive state are repeated at predetermined time intervals.

The user input unit 202c may receive a touch method for activating the intake tracking mode, or may include a push button.

Referring to FIG. 3B, the microphone 202b receives a first voice command 11 corresponding to a control command. The first voice command 11 may correspond to a meaningful word or sentence. The first voice command 11 may be a word, a sentence, a simple word, an impostor, or the like frequently used by a user before food is consumed. For example, the first voice command 11 may be composed of the sentence 'I will eat well'. The first voice command 11 may be set by a user, but is not limited thereto. For example, when a voice substantially similar to a different type of control command is input to the microphone 202b repeatedly, the control unit 208 sets the voice as the second voice command 11, can do.

The control unit 208 determines whether the voice input to the microphone 202b corresponds to the user's voice. The memory 207 stores the voice of the user and the controller 208 compares the characteristics of the voice of the user stored in the memory 207 with the characteristics of the voice inputted thereto to determine the voice of the user of the wearable terminal 200 Or not.

The microphone 202b may be a directional microphone. The directional microphone selectively receives sound heard in a specific direction in a predetermined angle range. The microphone 202b may sense only the sound heard from the user while the wearable terminal 200 is worn by the user.

Alternatively, the microphone 202b may be implemented as an ear mike mounted on a user's ear.

And the intake tracking mode is activated based on the control command. When the intake tracking mode is activated, at least one other function being driven may be stopped or switched to an inactive state, but the present invention is not limited thereto. The control unit 208 can continuously perform the function of the application for outputting music even when the consumption tracking mode is activated.

However, when an application driven by the user's voice, for example, a control function through speech recognition, a call function, a voice memo function, or the like is being executed, the control unit 208 controls the above- The user can provide a guide signal to select whether or not to do so. When the function of using the voice and the tracking mode of the intake are both operated, the control unit 208 performs a step of distinguishing sounds generated when food is consumed and users' voices for performing different functions.

When the intake tracking mode is activated, the tracking sensor unit detects the sound information and the motion information (S120). When the use tracking mode is activated, the notification information 310 indicating the activation of the use tracking mode is output. The announcement information 310 may correspond to a voice signal (what?) Output from the sound output unit 205a.

In the present invention, the tracking sensor unit may include a sound scope for sensing a sound generated when a user chews or swallow food, in this case, a stethoscope for sensing vibration (sound) And may include an electromyographic sensor that senses the movement of the muscles that occurs when chewing (chewing) or turning over. The stethoscope and the hearing apparatus sense vibrations (sound) generated inside the user's body from the state where food is inserted into the mouth of the user to the state of chewing. In this case, the unit of sound due to the vibration is decibel.

In addition, the tracking sensor unit includes a microphone 202b for receiving a user's voice. That is, the microphone 202b functions as a sensor unit for collecting information according to the ingestion of food when the intake tracking mode is activated. The microphone 202b included in the tracking sensor unit can collect information on food consumed by the user's voice.

3B, the sound signal 21 to be sensed may correspond to the user's voice corresponding to the announcement information 310. FIG. You can type in the type of food you want to eat (sandwiches and a glass of cola). After the sound signal 21 is inputted, the control unit 208 controls the tracking sensor unit to collect sound information and motion information from the user. The control unit 208 collects the sound information and the motion information from the user until a predetermined end command for terminating the intake tracking mode is applied. According to the present embodiment, the termination command 12 may be formed of a predetermined voice command (well-eaten). The termination command 12 may be set in substantially the same manner as the control command 11.

In addition, the type of food consumed by the user can be predicted using the sound information generated when the food is mangled.

The control unit 208 forms the intake result information based on the sound information and the motion information collected by the tracking sensor unit (S130). The intake result information may include information on the type of food consumed by the user, the amount of food, and the intake state information. The intake status information includes the calories calculated by the type and amount of food, the time the user takes the food, the rate of food intake, the movement of the oral structure when chewing or swallowing food, the friction noise caused by the movement of the oral structure, The use state pattern of the teeth according to the movement of the oral structure, and the like.

For example, the consumed amount of food may be determined by the sound sensed by the tracking sensor unit and the time taken from the control command 11 to the termination command 12.

In addition, the intake state information may include an intake analysis result analyzed based on a care mode preset by a user. An explanation of the results of the intake analysis will be specifically discussed below with reference to Figs. 6A to 6F.

The control unit 208 performs a function of outputting the formed result information in various ways. 3B, the control unit 208 controls the wireless communication unit 201 to transmit the intake result information to the external device 910. [ The external device 910 may correspond to a display device having a display unit capable of outputting time information.

The external device 910, which has received the intake result information, outputs a result page 500. The result page 500 may include information such as the time taken to take the food, the time taken, the type and amount of the consumed food, and the calculated calories. The information included in the result page 500 may be set by the user. On the other hand, the external device 910 may use the intake result information as driving information of another application performing health management.

However, the method of outputting the intake result information is not limited thereto. Various embodiments for outputting the intake result information will be described in detail with reference to Figs. 5A to 5D.

According to the present invention, when a user wearing a wearable terminal consumes food, information on the food consumed based on the user's voice and the detection of physical movement for consuming the food, and the ingestion result information including the intake state .

Accordingly, the user does not need to separately input or memorize the type of food and the amount of food to be eaten, and can confirm the information on the state of intake that the user can not recognize while consuming the food.

That is, the wearable terminal activates the ingestion tracking mode according to a specific control command to form ingestion result information. Hereinafter, various embodiments for executing the ingestion tracking mode will be described.

4A to 4H are conceptual diagrams for explaining a control method for activating the intake tracking mode.

FIG. 4A illustrates a control method of activating the intake tracking mode according to the voice extracted by the external noise. The microphone 202b according to the present embodiment receives a noise (hereinafter referred to as ambient sound) of the surrounding environment while maintaining a doze mode state.

When a voice for a specific word is detected from the ambient sound, the control unit 208 forms the control command as a control command. The voice that forms the specific word may correspond to a voice that is mainly generated in the surroundings when the user consumes the food. The voice may correspond to a voice often occurring in a particular area (e.g., a restaurant). For example, the voice can extract a voice to receive an order ('Can I order you?'), A voice to order ('A sandwich and a cola.'). The control unit 208 may form the control command according to a specific word (for example, 'order') of the voice input to the microphone 202b. The intake trace mode is activated based on a control command formed by the specific word.

The control unit 208 extracts the name of the food from the voice of the user when the intake tracking mode is activated, and outputs a confirmation voice (14 o'clock lunch, sandwich, cola?) To confirm the intake of the extracted food Output. The confirmation voice may include information on the time at which the food is started to be consumed.

The control unit 208 stores information on the food intake according to an answer to the confirmation voice (yes or no). And switches the intake tracking mode to the inactive state. The control unit 208 forms the intake state information according to the confirmation voice and controls the radio communication unit 201 to transmit the intake result information to the external device 910. [ The external device 910 receiving the intake result information outputs the intake result screen 510.

Although not shown in the figure, when a voice indicating that the information of the food included in the confirmation voice is different from the food consumed by the user is inputted, the control unit 208 controls the microphone 202b based on the voice inputted to the microphone 202b A confirmation voice can be output.

According to the present embodiment, it is predicted that the user is eating the food through the noise generated in the surrounding environment, and the user does not need to input a separate control command since the intake tracking mode is activated. In addition, the user can more accurately record the food he / she eats through the confirmation voice.

Referring to FIG. 4B, the location information module 201d included in the wearable terminal 200 detects the location of the user. The location information module 201d is activated at predetermined intervals to detect the location of the user. The controller 208 may activate the ingestion tracking mode using information about the position sensed by the positional information module 201d. The controller 208 activates the ingestion tracking mode when the user is detected as entering the restaurant by the location information module 201d. Information about the location may be received from a particular server, or information about the location may be stored by the memory 207. [

The control unit 208 activates the microphone 202b when the intake tracking mode is activated, receives a voice of the user, determines whether the food is consumed by the tracking sensor unit, Lt; / RTI > The control unit 208 stores the ingestion result information in the memory 207 based on the information of the food extracted from the voice of the user and the data sensed by the tracking sensor unit, 910 of the wireless communication device.

Meanwhile, the control unit 208 does not form the intake result information when data related to the user's food intake is not formed by the tracking sensor unit even though the information about the food is extracted from the voice. That is, the intake result information is formed based on whether or not the user chews and swallows the food.

The control unit 208 may transmit the intake result information to the external device 910 when the user exits the food judged position.

The external device 910 outputs an intake result screen 520 including the intake result information. The intake result information 520 includes the information 521 of the food and the graphic image 522 representing the intake amount of the food. The graphical image 522 can receive the user's touch and change the amount of display. The graphic image 522 may have a bar shape or a number representing a number.

The intake result information may be output when a specific application is executed by a user, but is not limited thereto. When the external device 910 receives the intake result information from the wearable terminal 200, the external device 910 can activate the display unit and output the intake result screen 520.

According to the present embodiment, the ingestion tracking mode is activated according to the location of the user, and the food that is supposed to be consumed by the user without any additional input is recorded. In addition, the external device can provide information on the result of intake when the user is out of a restaurant or the like, and can control the amount of food, thereby allowing the user to record a more accurate amount of intake.

FIG. 4C illustrates a control method for activating the intake tracking mode based on detection of a specific space. For example, the location information module 201d detects the location of the user by WiFi or the like set in the indoor space.

The control unit 208 activates the intake tracking mode when the user's position corresponds to an area related to the intake of food (e.g., in front of the refrigerator, kitchen, table, etc.). When the intake tracking mode is activated, the sound output unit 205a outputs the guide signal 311 of the intake tracking mode. The microphone 202b receives a voice confirming activation of the ingestion tracking mode. The user may enter a voice command to activate or deactivate the ingestion tracking mode.

FIG. 4D is a conceptual diagram for explaining a control method of activating an intake tracking mode by sensing a chewing motion. The tracking sensor unit according to the present embodiment includes a microphone 202b for sensing voice and a sensor unit for sensing a user's chewing motion and swallowing motion.

Referring to FIGS. 3B and 4D, the microphone 202b periodically senses the user's voice. The control unit 208 activates the intake tracking mode when a predetermined voice command is input to the microphone 202b. On the other hand, the control unit 208 continuously detects the voice command even when a specific application (e.g., a call application) is activated.

When the microphone 202b is activated and the user's voice is being input, the controller 208 activates the intake tracking mode when movement for taking food by the tracking sensor unit is sensed.

The control unit 208 forms intake result information including an intake time indicating a time at which the movement is not sensed from the time when the movement is detected by the tracking sensor unit. The intake result screen 530 including the intake result information and displayed by the external device 910 may include a graphic image 531 indicating a predicted intake and an input window 532 for inputting an additional intake have.

The expected intake can be analyzed based on the movement of the user by the tracking sensor unit and the sound generated as the food is chewed. In addition, the control unit 208 can analyze the food consumed by the user based on the vibration pattern of the chewing and swallowing operation. For example, it can be classified into a high-stagnation state and a liquid state by the vibration pattern, and it can be determined whether the food is a hard food or a soft food. In addition, the controller 208 can predict the ingestion based on the user's intake history information recorded in the memory 207.

The graphical image 531 may comprise an image of the expected ingestion. The user can touch the graphic image 531 to select the food consumed during the intake time. In addition, when the graphic image 531 does not contain the food, the user can directly input the food into the input window 532 and record the food.

According to the present embodiment, the microphones 202b can sense the movement of the user even while the user's voice is being received for the execution of other functions, and execute the intake tracking mode.

FIG. 4E illustrates a control method for activating the intake tracking mode according to time. The control unit 208 may automatically activate the intake tracking mode at a predetermined time. The time may be entered by the user.

Alternatively, the memory 207 stores the user's intake history information. The intake history information includes a time at which the user takes the food, a kind of the intake, and the like. The control unit 208 activates the intake tracking mode based on the intake history information. If the user records daily eating at about 14 o'clock, the control unit 208 may activate the intake tracking mode at about 14 o'clock.

However, the control unit 208 may suspend the activation of the intake tracking mode when another application is running at 14:00.

The control unit 208 controls the sound output unit 205a to activate the intake tracking mode at the set time or to output the notification information 310 (start eating). The announcement information corresponds to an interactive voice signal. If the voice command (yes) for the execution of the intake tracking mode is input from the user based on the notification information, the intake tracking mode is activated.

According to the present embodiment, since the food intake information can be recorded using the recorded or statistical meal time, it is possible to more accurately record the user's intake of the regular meal time.

FIG. 4F illustrates a control method of recording the user's intake information based on the position information associated with the information of the food. The control unit 208 can receive menu information associated with the location information of the user, which is sensed by the location information module 201d, from a specific server. For example, when a user is located in a restaurant that provides menus that are distinguished in different areas, the location information module 201d senses a specific area. The menu information may include a type, amount, calorie information, GI index, etc. of food that the user can receive in a specific area.

The control unit 208 may store the received menu information as the ingestion result information of the user or transmit the information to the external terminal 910. On the other hand, when the control unit 208 enters the specific area and receives the menu information, the control unit 208 can activate the tracking sensor unit. In this case, the control unit 208 may not form the intake result information unless the movement of the user who consumes the food by the tracking sensor unit is detected.

The external device 910 outputs an intake result screen 540 including the intake result information. The intake result information includes menu information 541 and food information 542 included in the menu information. The user can change the menu information 541 and the food information 542 by touching the ingestion result screen. For example, the user can exclude unhealthy foods from the record or change the amount of food they eat.

 According to the present embodiment, since information of the food to be provided is used, more precise information of the ingested food can be recorded.

Referring to FIGS. 2 and 4G, the user may activate or deactivate the ingestion tracking mode by a specific button of the user input unit 223. The haptic module 205b may output vibration based on activation / deactivation of the intake tracking mode. Accordingly, the user can use the button of the user input unit 223 to activate the intake tracking mode when the intake tracking mode is not automatically activated by various sensors, or to switch the intake tracking mode to the inactive state.

Referring to FIG. 4H, the control unit 208 may form the intake result information based on the intake information 13 applied by the user. The control unit 208 switches the intake monitoring mode to the inactive state based on the intake information 13. For example, the intake information 13 may include information on the amount of remaining food.

The wearable terminal 200 records the food consumed by the user and delivers the food to the external terminal. Hereinafter, a method of outputting warning data based on the user's intake state collected by the tracking sensor unit will be described.

5A to 5D are conceptual diagrams for explaining a control method of outputting warning data based on an intake state. The warning data may include information to be taken into account when ingesting food due to the user's eating habits or health conditions.

Referring to FIG. 5A, the controller 208 controls the haptic module 205b to output a notification vibration to start tracking the intake when the intake tracking mode is activated without a user's control command. The user can recognize that the ingestion is being recorded based on the vibration of the notification, and can take food while reminding the user of the meal.

Referring to FIG. 5B, the sound output unit 205a outputs a warning sound (slow down). For example, the sound output unit 205a forms the warning voice based on the previously stored intake result information, and outputs the warning sound when the intake tracking mode is activated. The warning voice may include information on a warning corresponding to a user's intake habit or a food to be eaten according to a user's health condition.

The wearable terminal 200 according to FIG. 5C includes a light output unit 205c that outputs light. The light output unit 205c outputs light of a predetermined color when the consumption tracking mode is activated and outputs light of a different color when the user's chewing motion is detected while the consumption tracking mode is activated.

5D illustrates a control method of outputting warning data when the user wears the earphone 240. FIG. The user may be provided with the auditory data by the earphone 240 in a state in which the consumption tracking mode is activated. For example, a user can eat while listening to music.

The control unit 208 outputs a warning sound to the earphone 240 when it is necessary to output a warning sound based on the intake result information. The output of the auditory data may be interrupted while the warning sound is output. For example, when the user senses that food is eaten too fast by the tracking sensor unit, the warning sound may be output to the earphone 240.

The control unit 208 may output the warning sound for a predetermined time (e.g., several seconds). Alternatively, the control unit 208 may continuously detect an intake state of the user by the tracking sensor unit while the alarm sound is output, and may release the alarm sound based on the detected state. That is, when the user's feeding speed is reduced, the earphone 240 stops outputting the warning sound and outputs music again.

6A to 6F are conceptual diagrams for explaining a control method of providing the intake result information based on the care mode. The care mode may be set by the user or based on the recorded intake result information. The care mode may be determined by the physical condition of the user in order to improve the user's health condition.

For example, in a diet mode, management data on the amount of food intake, calorie, and food intake rate are formed, management data on the type, amount, and time of food consumption are formed in a care mode of a patient suffering from diabetes, In the case of a patient with a jaw joint, management data relating to the strength of the food, the chewing habit, and the force applied to the jaw can be formed. In addition, there are a care mode for pregnant women, a care mode for managing the weight of athletes, and a care mode for preventing various diseases, and a care mode according to weather changes and the like can also be set. In each care mode, the management data according to the intake result information may be outputted while the user is eating the food or may be output together with the analysis result after the food is consumed.

Referring to FIG. 6A, a control method of outputting management data according to an embodiment will be described. The tracking sensor unit senses a sound signal 21 corresponding to a voice of a user who speaks the type of food and the controller 208 controls the sound sensor 21 based on the sound signal 21 and the motion of the user sensed by the tracking sensor unit. Thereby forming intake result information.

The control unit 208 controls the wireless communication unit 201 to transmit the result information to the external device 910 when the result information is formed. The external device 910, when receiving the intake result information, outputs a noti icon 541 of the application for confirming the intake result information. For example, the Noti icon 541 may be displayed on a notification bar displayed in one area to display a driving state of the external device 910.

When the application is executed by the Noti icon 541, the external device 910 outputs an intake result screen 540 including the intake result information. The intake result screen 540 includes mode information 542, a food intake time 543, information on the type and amount of food 544, and management information 545. The management information 545 includes items that the user should pay attention to at the next meal based on the set care mode. The management information 545 may be displayed as text, images, or the like.

According to the present embodiment, after the meal, the user can check the information on the ingested food again, and the management information corresponding to the information can be provided.

FIG. 6B illustrates a control method of outputting the warning vibration for improving the eating habits. The wearable terminal 200 according to the present embodiment may include a pair of haptic modules 205b disposed at both ends of the body 220. [

The tracking sensor unit according to the present embodiment detects movement of the user's mouth when food is consumed. By using a sound scope and a stethoscope of the tracking sensor unit, vibrations of the left and right regions can be sensed when food is chewed. In addition, the tracking sensor unit can sense the movement of the jaw muscle of the user through the EMG device.

For example, when the user uses only one region (left or right) muscles to chew food by the tracking sensor unit, the control unit 208 can output an alert vibration for use of both muscles. When it is detected that the user is chewing food using only the right muscle, the control unit 208 can control the left haptic module 205b to vibrate. Based on the vibrations detected in the left area, the user uses both roots to chew food.

When the force is applied to the jaw joint by the electromyographic device of the tracking sensor unit, the haptic module 205b may be activated and alerted when the force mode is set for the patient with weak jaw joint. For example, when it is judged that chewy food is chewed, the warning vibration may be output.

Accordingly, since the warning vibration is output by the movement of the root which is sensed in real time while chewing the food, the user can immediately recognize the vibration and improve the eating habit. Therefore, it is possible to effectively improve erroneous eating habits occurring unconsciously and to prevent disease.

6C is a conceptual diagram for explaining a method of providing intake result information in which motion is sensed upon ingestion. The control unit 208 may record a vibration pattern of the tracking sensor unit while the user performs a chewing motion. The control unit 208 forms intake result information including the vibration pattern 552. The external device 910 receives the intake result information and displays an intake result screen 550 including the intake result information.

The intake result screen 550 may selectively include the intake result information based on the set care mode. For example, the intake result screen 550 may include the care mode information 551, the left and right vibration patterns 552, and management information 553 according to the intake result information. The vibration pattern 552 may be formed in a graph shape.

According to the present embodiment, the user can check not only the information on the ingested food, but also the tracking result on the eating habits of the food, and the management data for improving the eating habit can be also provided.

Referring to FIG. 6D, the tracking sensor unit can detect movement of food swallowing. Whether swallowing a fluid such as water or a drink or swallowing a food made of solid can be distinguished by the tracking sensor unit. For example, the control unit 208 may control the sound output unit 205a to output a warning voice 561 when a large amount of beverage is sensed for a predetermined time.

Alternatively, the control unit 208 transmits warning data to the external device 910 when a large amount of beverage is sensed during the predetermined time. The external device 910 outputs the warning data 562. [ For example, when the display unit of the external device 910 is in an inactive state, upon reception of the alert data 562, the display unit is activated and outputs a popup window including the alert data 562.

However, the warning according to the amount of intake is not limited to fluid (water). When the food intake is detected to be more than the predetermined amount, warning data may be output to limit the intake.

A control method for providing a recommended dietary reference will be described with reference to Fig. 6E. The control unit 208 outputs recommended diet information 562 based on the recorded result information 561 and the set care mode. The recommended diet information 562 is formed by the result information 561 of a predetermined period. For example, the next day's meal information may be provided based on the result information for one day, or the meal information for the next meal may be provided based on the result information collected at the previous meal time.

The recommended diet information 562 may be output at the next meal time or may be provided at night so that the user can check the previous meal and adjust the meal suitable for the user according to the recommended food information.

FIG. 6F is a conceptual diagram for explaining a control method for selecting and inputting an ingestion based on a vibration pattern. FIG. The control unit 208 records a vibration pattern corresponding to the motion of the user sensed by the tracking sensor unit. The vibration pattern may be independently recorded by the movement of the left and right oral cavity, but is not limited thereto. The vibration pattern data may be transmitted to the external device 910 together with the sensed time information.

The display unit of the external device 910 outputs an intake result screen 570 including the time information 571 and the vibration pattern 572 corresponding to the time information 571. The control unit 208 estimates an intake based on the vibration pattern 572 and outputs a selection icon 573 corresponding to the estimated intake. The expected intake is indicated to correspond to one area of each vibration pattern 572. [ For example, in areas of low vibrations, the intake is expected to be of the fluid type, and the areas of high vibrations may be expected to be solid foods with the expected ingestion.

The selection icon 573 corresponding to the ingested item can be selected by the user. The user can select and record the food he / she has consumed. The selection icon receiving the user's touch can be displayed in a different shape.

According to the present embodiment, the user can be provided with the anticipated intake food by the vibration pattern together with the vibration pattern of the oral cavity according to the movement when the food is consumed. As a result, the user can memorize the food he or she has eaten.

Various intake result information can be provided based on the set care mode. Hereinafter, a method of setting a care mode according to various embodiments will be described.

7A to 7D are conceptual diagrams for explaining a control method of setting a care mode according to various embodiments. The wearable terminal 200 according to an exemplary embodiment may receive the care mode information set by the external device 910.

7A shows a first setting window for setting the output of the intake result information. Referring to the first setting window 581, the user can set the intake result information formed to be notified in real time. In this case, the wearable terminal 200 can output the voice signal or the vibration data as the result information is formed.

The user can store the intake result information in the memory 207 of the wearable terminal 200 or control the external device to wirelessly communicate. Or to output the formed result information at a predetermined time interval.

FIG. 7B illustrates a second setting window for setting a care mode according to a health state. The second setting window 582 provides various kinds of care modes. The care mode includes information for improving a health condition. Such information may be stored in the external device or may be provided from a specific server. In addition, when the specific care mode is selected, the external device 910 may output a third setting window 583 for recording the user's body information.

FIG. 7C illustrates a fourth setting window 584 for storing the intake result information. The user can store the intake result information by day, week, and month. Further, the user can set the intake result information to be transmitted to a specific server. For example, the recorded result of intake information can be set to be transmitted to the doctor's server so that the doctor who treats the user can receive it. Accordingly, the doctor can be provided with the information on the result of the ingestion of the recorded patient.

7D shows a fifth setting window 585 for setting the activation of the intake tracking mode. The user can set a control command for activating the intake tracking mode. For example, the user can set the intake tracking mode to be executed at a specific time, the intake tracking mode to be executed by a command such as voice of the user, or the intake tracking mode to be executed at a specific position.

8A to 8H are conceptual diagrams for explaining a control method of outputting management data according to various embodiments.

A control method of providing management data on food to be ingested will be described with reference to FIG. The control unit 208 may output a question voice 320 ('What do you do?') For collecting food information to the user while the tracking mode is activated by the tracking sensor unit. The microphone 202b receives the user's voice for the question voice 320. [ The user can input the name of the food to be eaten by voice.

The controller 208 analyzes the voice of the user applied to the microphone 202b to determine the food and outputs the first management data 410 for the food based on the predetermined care mode. For example, the first management data 410 includes information determined based on the care mode to determine whether the food can be consumed by the user. For example, if a care mode is set in which information indicating that a user causes an allergic reaction to a specific food is set, the first management data 410 includes information indicating that the food is allergenic.

Accordingly, the user can check whether or not food intake is desirable before eating the food.

8B is a conceptual diagram for explaining a control method of providing management data based on peripheral information. The wearable terminal 200 may collect current state information such as current time, weather, temperature, and position. The control unit 208 may output a question voice 320 ('What do you do?') For collecting food information to the user while the tracking mode is activated by the tracking sensor unit. The microphone 202b receives the user's voice for the question voice 320. [ The user can input the name of the food to be eaten by voice.

The controller 208 analyzes the voice of the user applied to the microphone 202b to determine the food, and forms related data related to the food based on the ambient information. For example, when the ambient temperature is high, the second management data 420 for confirming the expiration date or condition of the food can be outputted by voice. According to the present embodiment, when a user eats a food, the user can automatically output a voice so that the user can confirm whether the food is a desirable one.

FIG. 8C illustrates a control method of providing the user with third management data 430 based on the care information included in the care mode. Here, care information may be relevant to the user's health, such as taking medication, drinking more than a certain amount of water, or checking blood sugar.

The control unit 208 senses a user's food intake and outputs third management data 430 consisting of a voice suggesting taking a medicine when a predetermined time has elapsed since the vibration caused by food intake was not detected do. The third management data 430 may be output by the sound output unit 205a as audio information as shown in the figure, but is not limited thereto. For example, a vibration or a warning sound indicating the taking of medicine may be output as management data.

In this way, the control unit 208 can analyze the food intake time interval by the tracking sensor unit. Management data may be output so that food can be ingested at regular time intervals based on the analyzed food intake time interval or the set care mode

For example, if the consumption of food is not detected for more than the reference time, a voice requesting the consumption of food may be output. Or when the number of times of intake is large within a certain time, management data indicating that the number of times the food is consumed is reduced. In this case, the management data may include information on the recommended intake time or the recommended amount of food, which may include medications or health supplements to be taken.

According to the present embodiment, the time of taking the medicine is not calculated by the control command of the user but is calculated by the meal end time sensed by the tracking sensor unit. Therefore, the user can more easily receive the management data and can memorize the things to be forgotten.

Referring to FIG. 8D, a method of outputting the fourth management data according to the user's motion state will be described. The wearable terminal 200 according to the present embodiment further includes a motion detection sensor unit for sensing the motion of the user. For example, the motion detection sensor unit may include a gravity sensor, a gyroscope sensor, an acceleration sensor, and the like.

The control unit 208 forms the fourth management data 440 when a user's exercise state is detected by the motion detection sensor and the user's food consumption is detected by the tracking sensor. The fourth management data 440 may correspond to a warning voice for limiting food intake during movement,

On the other hand, the management data can be output even when the ingestion of food is not detected. For example, the control unit 208 outputs management data corresponding to the care mode after a predetermined time has elapsed since the ingestion of the food is detected.

Referring to FIG. 8E, fifth management data 450 indicating that water is to be consumed is periodically output to the user, and sixth management data 460 indicating a blood glucose check is output when the diabetic patient is in the care mode. .

According to the present embodiment, the user can memorize items that are easy to forget even after eating the food.

The wearable terminal 200 according to FIGS. 8F and 8G may analyze or recommend food based on the care mode. The sound output unit 205a recognizes the user's voice including the type of food. The control unit 208 analyzes the type of the food based on the care mode, and forms the seventh management data 470 including the analysis result. The seventh management data 470 may include whether the food is suitable for the user and information about the recommended food.

For example, the seventh management data 470 may include a nutritional analysis result of the food, a recommended intake amount, a recommended intake time, a recommended cooking method, and the like.

If the controller 208 determines that the user is located at a specific restaurant, the control unit 208 activates the intake tracking mode. The control unit 208 analyzes the information on the restaurant where the user is located and outputs eighth management data 480 including information on the recommended menu. The control unit 208 may receive menu information on the restaurant from a specific server and determine a recommendation menu based on the care mode.

According to the embodiments, the user can check whether the food is suitable for the user's care mode before the user takes the food or can receive the information on the food that the user desires to eat.

FIG. 8H illustrates a control method of outputting management data according to a motion sensed at the time of ingesting food in the ingestion tracking mode. The control unit 208 controls the operation of the control unit 208 when it is determined that the user's tooth root is excessively consumed at the time of consuming the food based on the care mode, for example, when the vibration pattern is irregular, 9 management data 490 are formed. The ninth management data 490 may be composed of voice information for refraining from ingesting food or may be formed by vibration.

The ninth management data is output in real time while the user is eating the food, so that the user can directly control the consumption of the food.

9A to 9D are conceptual diagrams for explaining a control method of a wearable terminal in cooperation with an external device. The external device according to the present embodiments may correspond to a watch-type terminal and / or a glass-type terminal. The external device and the wearable terminal are configured to perform wireless communication.

Referring to FIG. 9A, the wearable terminal may perform wireless communication with a watch-type terminal that is worn on a user's wrist and includes a display unit.

When the intake tracking mode is activated, the tracking sensor unit may detect a movement of a user and form a vibration pattern. The control unit 208 controls the wireless communication unit 201 to transmit the vibration pattern to the watch-type terminal 920 in real time.

The display unit of the watch-type terminal 920 outputs a vibration image 610 reflecting the vibration pattern in real time on the display unit. The vibration image 610 is formed to vary according to the intensity of the vibration pattern, and is displayed along an edge of the display portion. The present embodiment can be implemented in a care mode in which management of the oral joints and muscles is required. Also, an indicator 611 corresponding to the care mode may be output on the display unit of the watch-type terminal 920.

9B, a warning image 620 corresponding to the care mode is output on the display unit of the watch-type terminal 920 while the intake tracking mode is being executed. When the watch-type terminal 920 receives information that the user is consuming food, the warning image 620 can be output.

In the case of a care mode for obesity management, the controller 208 controls the watch-type portable terminal 200 to output the warning image 620 when it is sensed that the user is consuming food or when the user judges that he / (920). For example, the warning image 620 may include a shape of a fat person (user) repeatedly output and a shape of a thin person (user). Also, the watch-type terminal 920 may output a vibration based on the control signal.

According to the present embodiment, a user who needs to control the intake of food can provide a warning image during consumption of the food to limit the intake of excessive food or the intake of food that is not suitable for the user's health.

FIG. 9c illustrates a control method for photographing food to be ingested. According to the present embodiment, the wearable terminal 200 may be interlocked with an external device 930 having a camera, but may not be interlocked.

When the consumption tracking mode is activated based on a specific control command, the control unit 208 outputs the shooting suggestion sound 330 to the sound output unit 205a. The user can take a picture of the food by the camera of the external device 910 according to the voice of the shooting suggestion 330. [ The external device 910 may transmit the image of the food to the wearable terminal 200 or may store the image in the memory of the external device 910.

On the other hand, if it is determined by the tracking sensor unit that the user has stopped eating the food, the controller 208 outputs the shot suggestion voice 330 again. The user can take food again. That is, the external device 910 can store the food and the food image after eating together, and can predict the amount of food consumed by the user.

The wearable terminal or the external device can form the result information that can not only know the type of the food consumed by the user but also the amount of the consumed food based on the images before and after the food is consumed. According to the present embodiment, the amount consumed by the user can be more accurately calculated.

FIG. 9D illustrates an embodiment in which the wearable terminal 200 is interlocked with the glass-type terminal 930. FIG. The glass-type terminal 930 may further include a camera for photographing an external environment included in the field of view of the user.

The control unit 208 transmits a control signal to the glass type terminal when the intake tracking mode is activated. Based on the control signal, the camera of the glass-type terminal 930 takes an image of food to be consumed by the user. When the controller 208 detects that the user stops eating the food, the control unit 208 transmits a control signal for capturing an image again.

Meanwhile, when the control signal is not received, the glass-type terminal 930 can image the food when the food is sensed by the camera while the wearable terminal 200 executes the intake tracking mode.

According to the present embodiment, since the image of the food consumed by the control signal is formed, the user does not need a separate movement for photographing.

10 is a perspective view of a wearable terminal having a camera according to another embodiment.

The components of the wearable terminal according to this embodiment are substantially the same as the components of the wearable terminal of Fig. 2 except for the camera 202a. The same reference numerals are assigned to the same constituent elements, and redundant explanations are omitted.

The camera 202a may be disposed on the first body 202a or the second body 202b. The camera 202a is preferably disposed at an end of the first body 202a or the second body 202b.

And processes an image frame such as a still image or moving image obtained by the camera 202a in the photographing mode. The processed image frame can be stored in the memory 207. The processed image frame may be transmitted to the external device through the local area communication module 201c and stored in the memory of the external device.

11A to 11C are conceptual diagrams for explaining the control method of the wearable terminal of FIG.

Referring to FIG. 11A, the camera 202a is activated based on the activation of the intake tracking mode. The camera 202a photographs the food before the user eats the food. The camera 202a may be arranged to facilitate shooting of food. Alternatively, the camera 202a may correspond to a rotary camera whose photographing angle is changed.

The control unit 208 controls the camera 202a to photograph the food again if it is detected by the tracking sensor unit that the user has finished eating. That is, the camera 202a can take a photograph of a food left by a user or a state of eating food. The control unit 208 predicts the amount of food consumed by the user using the two images captured by the camera 202a, and forms the intake result information accordingly.

The external device 910 outputs an intake result screen including the two images. According to the present embodiment, the amount of food consumed by the user can be more accurately predicted through the image taken by the camera, and the user can actually confirm the image of the food he or she has eaten.

Referring to FIG. 11B, the controller 208 can determine the start and end of the meal through the images sensed through the camera 202a. The camera 202a according to the present embodiment can continuously photograph the external environment while the intake tracking mode is activated.

For example, the control unit 208 determines that the meal starts when the user's hand is detected together with the food through the camera 202a. The controller 208 determines that the user has finished eating through the camera 202a if it is detected that the user is distant from the place where the food was present. In addition, the controller 208 determines the final image of the food (or an empty bowl, etc.) as an image at the end of the meal, and forms the intake result information using the final image.

FIG. 11C illustrates a control method of forming the intake result information using the QR code. A QR code 10 may be attached to various foods. The camera 202a senses the QR code 10 and receives food information according to the QR code 10 from a specific server. The information on the food may include kind, quantity, calorie, image and the like of the food. The control unit 208 may form the intake result information using the information of the food received by the QR code 10. [

The QR code 10 may be displayed on a food container, a receipt after purchasing food, a menu plate provided by a restaurant, or the like.

According to the present embodiment, the type and amount of the food consumed by the user can be more accurately recorded, and detailed information of the food that can not be confirmed by the tracking sensor unit and the input of the user can be provided.

12A and 12B are views showing a wearable terminal having a tracking sensor module according to another embodiment in one direction.

The components of the wearable terminal according to the present embodiment are substantially the same as the components of the wearable terminal of Fig. 2 except for the tracking sensor module 300. [ The same reference numerals are assigned to the same constituent elements, and redundant explanations are omitted.

The tracking sensor module 300 is mounted at an end of the first body part 202a. The camera 202a may be disposed in one area of the tracking sensor module 300. [ The tracking sensor module 300 may be rotatably mounted on the first body 202a in order to adjust the shooting range of the camera 202a.

For example, when the intake tracking mode is activated, the controller 208 may rotate the tracking sensor module 300 at an angle that allows easy shooting of food.

Although not shown in the drawings, the tracking sensor module 300 may further include an additional sensor module for sensing a vibration pattern or sound generated when food is consumed.

In this case, the tracking sensor module 300 may be configured to be detachable from the first body part 202a. According to the present embodiment, the user can use the tracking sensor module with the tracking sensor module only when the user needs to use the tracking mode.

FIG. 12B is a view of a wearable terminal having a structure in which first and second body parts are attachable according to another embodiment.

According to the present embodiment, the magnet portion 220 'that forms attraction between both ends of the first and second body portions 220a and 220b and the movement of the first and second body portions 220a and 220b A sensing sensor 220 'may be formed. The first and second body parts 220a and 220b may be formed of a material elastically deformable by an external force. The first and second body parts 220a and 220b may be held in contact with each other based on an external force applied by a user.

The control unit 208 activates the intake tracking mode when both ends of the first and second body units 220a and 220b are in contact with each other by the sensor 220 '.

The tracking sensor unit is located at the ends of the first and second body parts 220a and 220b and when the first and second body parts 220a and 220b are in contact with each other, And more closely arranged. Therefore, it is possible to more effectively detect vibrations occurring when food is consumed.

In addition, when the wearable terminal according to the present embodiment includes a camera, the camera is disposed at an angle such that the first and second body portions 220a and 220b can take food in a state of being in contact with each other.

According to the present embodiment, since the control command for activating the intake tracking mode is formed by the mechanical modification of the wearable terminal, the activity of the intake tracking mode can be controlled without error.

The structure for fixing the first and second body parts 220a and 220b is described as being a magnet part, but the present invention is not limited thereto.

FIG. 13A is a conceptual diagram for explaining a wearable terminal having an additional sensor module, and FIGS. 13B and 13C are conceptual diagrams for explaining a control method of outputting warning vibration using FIG. 13A.

The wearable terminal according to FIG. 13A includes a body temperature sensor 204c and a blood flow sensor 204d for sensing the body temperature of the user. It is preferable that the body temperature sensor 204c is arranged in a region where the first and second body parts 220a and 220b meet with each other so that the wearer can wear the wearable terminal.

The blood flow sensor 204d may be implemented as a PPG sensor. The blood flow sensor 204d is composed of a light output part 205c (for example, formed of an LED), and is driven in such a manner that the blood flow amount is detected by the amount of light stored in the light receiving part. The blood flow sensor 204d may be formed in an area adjacent to the earphone 240 and mounted on a user's ear ball. However, the area in which the blood flow sensor 204d is disposed is not limited thereto. However, it is preferable that the blood flow sensor 204d is disposed adjacent to a skin region of a user who can receive light again.

Referring to FIG. 13B, the controller 208 activates the body temperature sensor 204c and the blood flow sensor 204d according to the activation of the intake tracking mode, thereby detecting the user's biometric change.

For example, when the body temperature of the user who drinks is higher than a certain reference level or when it is detected that the pulse is jumping at a certain speed or more, the control unit 208 controls to output a warning vibration. Or a user who is allergic to certain foods, will be notified that the user will be alerted if the temperature rises or falls beyond the normal range.

According to the present embodiment, the change of the user's body can be sensed more sensitively so that the user can pay attention to health by oneself.

The wearable terminal according to FIG. 13C further includes a motion detection sensor unit, and the motion detection sensor unit may include a gravity sensor, a gyroscope sensor, an acceleration sensor, and the like.

The control unit 208 activates the motion detection sensor unit when the physical condition of the user exceeds the normal range by the body temperature sensor 204c and the blood flow sensor 204d. The control unit 208 may output a warning sound when the motion of the user is included in the abnormal range by the motion detection sensor unit.

According to the present embodiment, the user can be warned to pay attention to himself or herself by utilizing heat or pulse change that occurs when the body is out of the normal range.

14A to 14E are conceptual diagrams for explaining a control method of a wearable terminal according to various embodiments.

Referring to FIG. 14A, the tracking sensor unit including the microphone 202b detects vibrations together with the user's voice in the state in which the intake tracking mode is activated. When the wearable terminal includes the motion detection sensor, the user's movement is detected in a state in which the intake tracking mode is activated. The control unit 208 forms intake result information including a result of sensing the user's voice, vibration, and motion.

The external device outputs a tracking result screen 580 including a vibration pattern 581, voice data 582, and a motion detection graph 583 according to the ingestion of food. As a result, the user can identify the characteristics of talking or moving while eating the food. For example, if children are eating, they can check their eating habits.

Referring to FIG. 14B, an intake result screen 510 output to the external device 910 may include a satisfaction input window 511. After finishing the meal, the user is provided with an intake result screen 510 and can input the satisfaction level of the food. The external device can recommend food to a subsequent user according to the input satisfaction.

Meanwhile, when the external device 910 judges that the user has pleasantly eaten the food through the intake result information, the external device 910 may provide the food recipe 512. For example, if a regular vibration is detected by the tracking sensor or a voice 'delicious' is input by the user, it can be determined by the user's taste for the food.

Referring to FIG. 14C, the control unit 208 may output the management data 411 indicating the next meal time with the starting point of the time at which the food is consumed. For example, when the control unit 208 records that the meal is finished at about 14 o'clock, the control unit 208 outputs the management data 411 indicating that it is the meal time at 20 o'clock six hours later.

However, the control unit 208 may not output the management data 411 when it is detected that the user is eating food before 20:00. Accordingly, the user is provided with information so that he can eat regularly at a proper time.

Referring to FIG. 14D, the control unit 208 provides an ingestion result screen capable of recording pain in a care mode of a patient who feels pain according to food.

An ingestion result screen 590 according to one embodiment includes an input image 591 that can input a pain level based on a user's touch. The external device 910 provides the screen information 592 including the recommended food information based on the care mode when the pain level is inputted in the reference range or more.

The ingestion result screen 593 according to another embodiment includes information on the sensed heart rate along with information on the ingested food, and includes management information on the sensed heart rate. The management information corresponds to a result analyzed based on changes in the body of food and the user.

According to the embodiments of the present invention, the user can record changes in the body that occurs upon ingesting a specific food, thereby consuming food to alleviate the pain.

Referring to FIG. 14E, the tracking sensor unit may sense a user's biometric change. For example, the user can sense a cough, a non-uniform breath, or the like by the tracking sensor unit.

When the abnormal change is detected by the tracking sensor unit, the control unit 208 outputs management data 412 corresponding thereto. The management data 412 may be a voice for encouraging the ingestion of food that can alleviate the abnormal change.

15A and 15B are conceptual diagrams for explaining a control method of a wearable device according to various embodiments when eating earphones and eating food.

The control unit 208 may determine an intake state of the user while eating the food based on the intake tracking sensor. For example, the control unit 208 may control the earphone 240 to output music at a slow tempo when eating food too fast.

Alternatively, if the control unit 208 detects that the meal is started by the intake tracking sensor, the control unit 208 may transmit a playback command of the media file to the external device 910. The control unit 208 may output a recommended moving image to be played during a meal time based on the recorded meal time information of the user.

15B is a control method for outputting conversation voice based on the intake state sensed by the intake tracking sensor. The controller 208 outputs a first conversation voice 421 when it is detected that the user's food consumption rate is slower than the reference speed. The first conversation voice 421 may consist of 'Do you want to finish the meal?' Or 'Are you not satisfied with your taste?' four

Or if the food intake rate is detected to be excessively faster than the reference speed, the second conversation voice 422 is output. The second conversation voice 422 may be formed of 'enjoy slowly' or the like.

However, the type of the conversation voice output during the meal is not limited to this, and various conversation voices can be output according to the user's habits to be sensed.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a control unit 208 of the HMD. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (32)

A body part wearable on a user's neck;
An input unit for receiving a control command for activating an intake tracking mode;
A tracking sensor for sensing at least one of sound information and motion information when the tracking mode is activated; And
And a controller for generating intake result information including the type of food consumed, the amount of the food, and the intake state information based on the motion information and the sound information. The method according to claim 1,
Wherein the control unit outputs management data based on the intake state information and the predetermined care mode. 3. The method of claim 2,
An audio output unit for outputting the management data composed of voice; And
And a haptic module for outputting the management data formed by vibration. The method of claim 3,
Wherein the management data is formed based on the care mode, and is output after a predetermined time has elapsed based on the care mode from the activated time. The method of claim 3,
The control unit controls the sound output unit to output a voice asking about the type of food to be consumed when the intake tracking mode is activated,
Wherein the management data includes information on the food to be consumed based on the care mode. 3. The method of claim 2,
Wherein the control unit forms management data including information on the food based on a user's movement state and surrounding environment information. The method according to claim 1,
Wherein the control unit senses a chewing motion and a swallowing motion based on the vibration pattern of the tracking sensor unit,
Wherein the control command is formed by a vibration sensed by the tracking sensor unit. 8. The method of claim 7,
Wherein the tracking sensor unit includes at least one of a stethoscope for sensing the vibration, a hearing device, and an electromyogram sensor for detecting movement of a muscle. 9. The method of claim 8,
And a pair of haptic modules disposed at both ends of the body portion,
Wherein the control unit drives at least one of the pair of haptic modules when the chewing motion is unbalanced based on the electromyographic sensor. 9. The method of claim 8,
Wherein the control unit calculates the amount of food consumed based on the vibration sensed by the tracking sensor unit. 8. The method of claim 7,
Wherein the control unit records, when the chewing motion and the swallowing motion are detected in the ingestion tracking mode, that the food is consumed. 8. The method of claim 7,
Wherein the control unit predicts the food consumed by using the pattern of the vibration sensed by the tracking sensor unit and forms the intake trace information including the information of the expected food. The method according to claim 1,
Wherein the control unit sets a voice of a user including a specific word as the control command. 14. The method of claim 13,
Wherein the input unit comprises a directional microphone for selectively receiving a voice of a user. The method according to claim 1,
The control unit may further include an output unit for outputting a notification signal indicating activation of the tracking sensor unit,
Wherein the output unit includes at least one of an acoustic output unit for outputting the announcement signal by voice, an optical output unit for outputting the announcement signal as light, and a haptic module for outputting the announcement signal as vibration. The method according to claim 1,
Further comprising a position information module for sensing a position,
Wherein the control unit receives the information related to the position and activates the consuming tracking mode. 17. The method of claim 16,
Wherein when the information related to the position includes information on the food, the controller forms the eating result information using the information on the food. The method according to claim 1,
Further comprising a wireless communication unit for performing wireless communication with an external device,
Wherein the control unit controls the wireless communication unit to transmit the intake result information to the external device. 19. The method of claim 18,
Wherein the control unit transmits the intake result information when the intake tracking mode is switched to the inactive state. The method according to claim 1,
Further comprising a camera for imaging the food when the intake tracking mode is activated. 21. The method of claim 20,
The camera captures the food, captures the remaining food after consuming the food,
Wherein the control unit calculates an intake amount based on the images photographed by the camera. 22. The method of claim 21,
Wherein the control command is formed by detecting food by the camera. 21. The method of claim 20,
Wherein the control unit receives food information associated with a QR code detected by the camera from a specific server. The method according to claim 1,
Further comprising an acoustic output section for outputting auditory data,
Wherein the control unit controls the sound output unit to reproduce music based on the intake result information. The method according to claim 1,
An acoustic output unit for outputting a conversation voice about the ingestion of food while the intake tracking mode is activated; And
And a microphone for receiving a user's voice after the conversation voice is output. A display device for performing wireless communication with a wearable terminal that is formed to be mountable on a user's neck and forms intake result information including information on the type of food taken, the amount of the food, and the intake state information,
A display unit for outputting an intake result screen including the intake result information; And
And a controller for changing the intake result information based on a touch applied to the display unit. 27. The method of claim 26,
Wherein the intake result screen includes management data based on the type and amount of the ingested food, the ingestion time, the position, the predetermined care mode, and the intake result information. 28. The method of claim 27,
The display unit receives a touch applied to the intake result screen,
Wherein the controller corrects at least one of a type and amount of the food, an intake time, and a position based on the touch. 28. The method of claim 27,
Wherein the intake result screen includes a vibration pattern sensed when the food is consumed and a food that is expected to be consumed by the vibration pattern. 27. The method of claim 26,
Wherein the intake result screen includes an image corresponding to a vibration pattern sensed when the food is consumed in real time. 27. The method of claim 26,
Wherein the control unit reproduces a predetermined media file when receiving information on the consumption of the food. 27. The method of claim 26,
Wherein the control unit provides recommendation menu information based on the intake result information.

Images