KR20160081084A - A method for displaying contents and an eletronic device therefor - Google Patents

Abstract

According to another aspect of the present invention, there is provided a method of operating an electronic device, the method comprising: determining motion information of an electronic device based on sensed data measured through a sensor module; analyzing one or more biometric signals to determine biometric information for the user; And controlling an operation of the electronic device according to the motion information and the biometric information. Other embodiments are also possible.

Description

[0001] METHOD FOR DISPLAYING CONTENTS AND AN ELECTRONIC DEVICE THEREFOR [0002]

The present invention relates to an electronic device for displaying contents.

Due to the recent remarkable development of information communication technology and semiconductor technology, the spread and use of various mobile terminals are rapidly increasing. In particular, recent mobile terminals have reached the stage of mobile convergence, which does not stay in the conventional inherent domain but covers the area of other terminals. Typically, in the case of a mobile communication terminal, in addition to a general communication function such as voice communication and message transmission / reception, a TV viewing function (for example, a mobile broadcasting such as DMB (Digital Multimedia Broadcasting) or DVB (Digital Video Broadcasting) MP3 (MPEG Audio Layer-3) photo shooting function, and Internet access function.

2. Description of the Related Art In recent years, a wearable device has been developed as a kind of portable terminal, in which a user has a form such as a wristwatch, a headset, and a glass so that a user can wear it on a part of the body. The wearable device may operate independently or may operate as a companion device in cooperation with other portable terminals (host devices) to provide the user with at least some of the functions of the portable terminal (e.g., a call, message, ) To the user.

By being embodied in a form that can be spanned over a portion of the user's body, the display of the wearable device also spans a portion of the user's body. If the user moves the wrist by moving the wrist or wears the wearable device, the wearable device also moves according to the movement of the user. For example, assume that the wearable device is a wristwatch type and the user is in the middle of running. While the user is running violently, it is not easy for the user to confirm data displayed on the display of the wearable device worn on the wrist, for example an alarm. Particularly, the wearable device of the wristwatch type is difficult to confirm because the direction in which the data is displayed, i.e., the wrist direction and the user's gaze direction do not coincide with each other.

It is therefore an object of the present invention to provide a method and an electronic device in which an electronic device displays the contents so that the user can easily check the contents according to the state of the electronic device or the state of the user.

According to an embodiment of the present invention, there is provided a method of operating an electronic device, the method comprising: determining motion information of an electronic device based on sensor data measured through a sensor module; analyzing one or more biometric signals to determine biometric information And an operation of controlling the operation of the electronic device according to the motion information and the biometric information.

A method of operating an electronic device according to another embodiment of the present invention includes the steps of determining whether a communication module communicating with an external device is connected to the external device, Lt; / RTI >

A method of operating an electronic device according to another embodiment of the present invention includes the steps of: pairing with one or more external devices, determining motion information of the electronic device using the motion sensor, analyzing one or more bio- The method comprising the steps of: determining biometric information for a user; determining a service that can be provided to the user from the electronic device based on the motion information or the biometric information; And may provide an operation to the user.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of: obtaining sensing data; determining a current state of a user based on the sensing data; Determining a content to be displayed on the screen, and displaying the content on the screen.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of obtaining sensing data for determining a direction of a screen, determining a direction of the screen based on the sensing data, Determining a display direction of the content along the direction of the screen, and displaying the content along the display direction.

An electronic device for displaying content according to an embodiment of the present invention includes a display including a screen for displaying content, a display device for acquiring sensing data, determining a current status of the user based on the sensing data, Determining a content to be displayed on the screen based on the content, and controlling the display to display the content.

There is provided a machine-readable storage medium having recorded thereon a program for executing a method of displaying an electronic device according to an embodiment of the present invention, the method comprising: acquiring sensing data; Determining a current state of the user, determining a content to be displayed on the screen based on the current state, and displaying the content on the screen.

According to the present invention, the display of the content can be controlled so that the user can easily confirm the content according to the state of the display included in the electronic device or the current state of the user using the electronic device.

1 is a diagram illustrating a network environment 100 including an electronic device, in accordance with various embodiments of the present invention.
2 is a block diagram of a control module of an electronic device (e.g., an electronic device) in accordance with various embodiments of the present invention.
3 is a flow chart illustrating an example of a method by which an electronic device according to various embodiments of the present invention displays content.
4 is a flow diagram illustrating another example of a method for an electronic device to display content in accordance with various embodiments of the present invention.
5 is a flowchart illustrating another example of a method of displaying an electronic device according to various embodiments of the present invention.
6 is a flow chart illustrating another example of a method of displaying an electronic device according to various embodiments of the present invention.
7 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content.
8 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
9 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
10 is a diagram illustrating another example in which an electronic device according to various embodiments of the present invention displays content.
11 is a diagram illustrating another example in which an electronic device according to various embodiments of the present invention displays content.
12 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
13 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
14 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
15 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
16 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
17 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
18 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
19 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
20A to 20D are views showing still another example in which an electronic device according to various embodiments of the present invention displays contents.
21A and 21B are diagrams illustrating another example in which an electronic device according to various embodiments of the present invention displays contents.
22 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
23 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.
24 is a diagram illustrating an example in which a plurality of electronic devices according to various embodiments of the present invention display contents.
25 is a block diagram of an electronic device in accordance with various embodiments of the present invention.
26 is a diagram illustrating a communication protocol between a plurality of electronic devices (e.g., an electronic device and an electronic device) in accordance with various embodiments of the present invention.

Best Mode for Carrying Out the Invention Various embodiments of the present invention will be described below with reference to the accompanying drawings. The various embodiments of the present invention are capable of various changes and may have various embodiments, and specific embodiments are illustrated in the drawings and the detailed description is described with reference to the drawings. It should be understood, however, that it is not intended to limit the various embodiments of the invention to the specific embodiments, but includes all changes and / or equivalents and alternatives falling within the spirit and scope of the various embodiments of the invention. In connection with the description of the drawings, like reference numerals have been used for like elements.

The use of "including" or "including" in various embodiments of the present invention can be used to refer to the presence of a corresponding function, operation or component, etc., which is disclosed, Components and the like. Also, in various embodiments of the present invention, the terms "comprise" or "having", etc. are intended to specify the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, Steps, operations, elements, components, or combinations of elements, numbers, steps, operations, components, parts, or combinations thereof.

The " or " in various embodiments of the present invention includes any and all combinations of words listed together. For example, " A or B " may comprise A, comprise B, or both A and B.

The expressions " first ", " second ", " first ", or " second ", etc. used in various embodiments of the present invention are capable of modifying various elements of various embodiments, . For example, the representations do not limit the order and / or importance of the components. The representations may be used to distinguish one component from another. For example, both the first user equipment and the second user equipment are user equipment and represent different user equipment. For example, without departing from the scope of the various embodiments of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it is to be understood that the element may be directly connected or connected to the other element, It should be understood that there may be other new components between the different components. On the other hand, when it is mentioned that an element is " directly connected " or " directly connected " to another element, it is understood that there is no other element between the element and the other element It should be possible.

The terminology used in the various embodiments of the present invention is used only to describe a specific embodiment and is not intended to limit the various embodiments of the present invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of the present invention belong. Terms such as those defined in commonly used dictionaries should be interpreted to have the meanings consistent with the contextual meanings of the related art and, unless expressly defined in the various embodiments of the present invention, It is not interpreted as meaning.

The electronic device according to various embodiments of the present invention includes a motion management function such as detecting a health state of a user using the electronic device and guiding the user to an exercise schedule, a progress state of a motion, Device. For example, the electronic device may include at least one of an acceleration sensor, a gyro sensor, a heart monitoring (HRM) sensor, or an illuminance sensor to determine a user's motion state. Such an electronic device may be implemented as a wearable device in the form of a wristwatch, a glass, a head-mounted display (HMD), an earphone, a necklace, a shoe, a waist belt, an ankle band, have.

An electronic device according to various embodiments of the present invention may be a device including a communication function. For example, the electronic device can be a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer, a laptop Such as a laptop personal computer (PC), a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device For example, at least one of a head-mounted-device (HMD) such as an electronic eyeglass, an electronic garment, an electronic bracelet, an electronic necklace, an electronic appsetory, an electronic tattoo, or a smart watch.

According to some embodiments, the electronic device may be a smart home appliance with communication capabilities. [0003] Smart household appliances, such as electronic devices, are widely used in the fields of television, digital video disk (DVD) player, audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air cleaner, set- And may include at least one of a box (e.g., Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), game consoles, electronic dictionary, electronic key, camcorder, or electronic frame.

According to some embodiments, the electronic device may be used in various medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), photographic equipment, ultrasound, etc.) A global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a marine electronic device (e.g., a marine navigation device and a gyro compass) an automotive head unit, an industrial or household robot, an ATM (automatic teller's machine) of a financial institution, or a point of sale (POS) of a store.

According to some embodiments, the electronic device may be a piece of furniture or a structure / structure including a communication function, an electronic board, an electronic signature receiving device, a projector, (E. G., Water, electricity, gas, or radio wave measuring instruments, etc.). An electronic device according to various embodiments of the present invention may be one or more of the various devices described above. The electronic device according to various embodiments of the present invention may also be a flexible device. It should also be apparent to those skilled in the art that the electronic device according to various embodiments of the present invention is not limited to the above-described devices.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user, as used in various embodiments, may refer to a person using an electronic device or an apparatus using an electronic device (e.g., an artificial intelligence electronic device).

1 is a diagram illustrating a network environment 100 including an electronic device 101, in accordance with various embodiments of the present invention.

1, the electronic device 101 includes a bus 110, a processor 120, a memory 130, an input / output interface 140, a display 150, a communication interface 160, a control module 170, And a sensor module 180.

The bus 110 may be a circuit that interconnects the components described above and communicates (e.g., control messages) between the components described above. For example, control messages generated from the processor 120 or the control module 170 may be communicated to the display 150 or the communication interface 160 via the bus 110. [

The processor 120 may communicate with other components (e.g., the memory 130, the input / output interface 140, the display 150, the communication 150, The interface module 160, the control module 170, or the sensor module 180), decrypt the received command, and execute an operation or data processing according to the decrypted command.

The memory 130 may be coupled to the processor 120 or other components (e.g., the input / output interface 140, the display 150, the communication interface 160, the control module 170, Sensor module 180, or the like) or store instructions or data generated by the processor 120 or other components. The memory 130 may include programming modules such as, for example, a kernel 131, a middleware 132, an application programming interface (API) 133, or an application 134. Each of the above-described programming modules may be composed of software, firmware, hardware, or a combination of at least two of them.

In the memory 130, data for determining the direction of the display 150 may be stored in advance. In addition, the memory 130 may store sensing data measured by one or more sensors included in the sensor module 180. The memory 130 stores the sensing data (e.g., the moving speed, the moving acceleration, the moving direction of the electronic device 101, or the moving direction of the electronic device 101) measured by the acceleration sensor or the gyro sensor included in the sensor module 180 Slope) can be stored.

The memory 130 may store sensor values for determining the current movement of the user (for example, walking, jogging, cycling, swimming, badminton, tennis, soccer, baseball, basketball, etc.). For example, the control module 170 may measure the blood pressure, blood flow, heart rate, body temperature, respiratory rate, oxygen saturation, pace of the heart, blood glucose or the speed of movement of the electronic device 101, Or the inclination of the electronic device 101 and so on to determine a jogging exercise performed by the user. The blood pressure, blood flow, heart rate, body temperature, respiration rate, oxygen saturation, cardiopulmonary blood glucose or the movement speed of the electronic device 101, the movement acceleration, the direction of movement or the inclination of the electronic device 101 measured for 1 minute May be stored in the memory 130.

The memory 130 may store a kind of exercise or an exercise schedule input from the user through the input / output interface 140 or the display 150. The memory 130 may store blood pressure, blood flow, heart rate, body temperature, respiration rate, oxygen saturation, cardiopulmonary function, blood glucose, etc. previously input by the user. Also, each time the user performs exercise, the control module 170 controls the type of exercise, exercise schedule, blood pressure during exercise, blood flow, heart rate, body temperature, respiratory rate, oxygen saturation, And may be recorded in the memory 130. [ Also, the sensing data measured by the sensors included in the sensor module 180 may be written into the memory 130 by the control module 170.

The kernel 131 may include system resources used to execute operations or functions implemented in other programming modules, such as the middleware 132, the API 133 or the application 134 (E.g., the bus 110, the processor 120, or the memory 130). The kernel 131 may also provide an interface for accessing and controlling or managing the individual components of the electronic device 101 at the middleware 132, the API 133 or the application 134 have.

The middleware 132 can act as an intermediary for the API 133 or the application 134 to communicate with the kernel 131 to exchange data. The middleware 132 may also be operable to provide at least one application of the application 134 with the system resources of the electronic device 101, for example, (E.g., scheduling or load balancing) a work request using a method such as assigning a priority that can be used by the processor (e.g., the bus 110, the processor 120, or the memory 130) Can be performed.

The API 133 is an interface for the application 134 to control the functions provided by the kernel 131 or the middleware 132. For example, the API 133 may be a file control, a window control, an image processing, (E. G., Instructions) for the < / RTI >

According to various embodiments, the application 134 may be an SMS / MMS application, an email application, a calendar application, an alarm application, an SNS application, a messenger application, a multimedia application, a health care application (e.g., Etc.) or environmental information applications (e.g., applications that provide air pressure, humidity or temperature information, etc.). Additionally or alternatively, the application 134 may be an application related to the exchange of information between the electronic device 101 and an external electronic device (e.g., electronic device 104). The application associated with the information exchange may include, for example, a notification relay application for communicating specific information to the external electronic device, or a device management application for managing the external electronic device .

For example, the notification delivery application may be configured to provide information to other applications (e.g., SMS / MMS applications, email applications, SNS applications, messenger applications, multimedia applications, healthcare applications, To the external electronic device (e. G., Electronic device 104). ≪ RTI ID = 0.0 > Additionally or alternatively, the notification delivery application may receive notification information from, for example, an external electronic device (e.g., electronic device 104) and provide it to the user. The device management application may be configured to perform functions for at least a portion of an external electronic device (e.g., electronic device 104) that communicates with the electronic device 101 (e.g., (E.g., power on / power off or adjustment of the brightness (or resolution) of the display) of an external electronic device, a service provided by the external electronic device (E.g., install, delete, or update) call services or message services.

According to various embodiments, the application 134 may include an application that is specified according to attributes (e.g., the type of electronic device) of the external electronic device (e.g., electronic device 104). For example, if the external electronic device is an MP3 player, the application 134 may include an application related to music playback. Similarly, if the external electronic device is a mobile medical device, the application 134 may include applications related to health care. According to one embodiment, the application 134 includes at least one of an application specified in the electronic device 101 or an application received from an external electronic device (e.g., server 106 or electronic device 104) .

The input / output interface 140 connects commands or data input from a user via an input / output device (e.g., a sensor, a keyboard, or a touch screen) to the processor 120, To the memory (130), the communication interface (160), the control module (170), or the sensor module (180). For example, the input / output interface 140 may provide the processor 120 with data on the user's touch input through the touch screen. The input / output interface 140 may be connected to the processor 120, the memory 130, the communication interface 160, or the display module 170 via the bus 110, for example, Command or data through the input / output device (e.g., a speaker or a display). For example, the input / output interface 140 can output voice data processed through the processor 120 to a user through a speaker. The input / output interface 140 may receive user input for displaying content (e.g., text, image, video, etc.) on the display 150

The display 150 may display various information (e.g., multimedia data or text data) to the user. The display 150 may be implemented as a touch screen, for example, and may function as an input / output interface 140 for inputting touch input or hovering input from a user.

The display 150 may be implemented in a form that includes a screen or a touch screen. The screen or touch screen may indicate the surface of the display 150 on which one or more content is displayed.

The communication interface 160 may connect communications between the electronic device 101 and an external device (e.g., electronic device 104 or server 106). For example, the communication interface 160 may be connected to the network 162 via wireless or wired communication to communicate with the external device. The wireless communication may be, for example, wireless fidelity (WIFI), Bluetooth (BT), Zigbee near field communication (NFC), global positioning system , CDMA, WCDMA, UMTS, WiBro or GSM, etc.). The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232) or a plain old telephone service (POTS).

According to one embodiment, the network 162 may be a telecommunications network. The communication network may include at least one of a computer network, an internet, an internet of things, or a telephone network. According to one embodiment, a protocol (e.g., a transport layer protocol, a data link layer protocol, or a physical layer protocol) for communication between the electronic device 101 and an external device is provided by an application 134, an application programming interface 133 ), The middleware 132, the kernel 131, or the communication interface 160.

The control module 170 may be configured to communicate with other components (e.g., the processor 120, the memory 130, the input / output interface 140, the communication interface 160, or the sensor module 180) And may provide it to the user in a variety of ways. For example, the control module 170 may communicate with other electronic devices (e.g., electronic device 104 or server 106) using the processor 120, or independently, At least some of the functions of the electronic device 101 may be controlled

The control module 170 measures the moving speed, the moving acceleration, the moving direction, the inclination, and the like of the electronic device 101 by performing the sensing by the sensor module 180, or the user's blood pressure, heart rate, respiratory rate, The heart rate, the calorie consumption, the EMG, and the electrocardiogram.

The control module 170 may be configured to detect sensing data obtained by the sensor module 180, such as the current position of the electronic device 101 measured by one or more sensors, the speed of movement, The orientation of the display 150 may be determined using at least one of the tilts of the display device 101.

When the electronic device 101 is implemented in the form of a wearable device (e.g., a smart watch, etc.), the size or resolution of the screen included in the display 150 of the electronic device 101 may be constrained have. In addition, when the electronic device 101 is implemented as a wearable device, the electronic device 101 can be mounted on a body part having many movements. Therefore, the control module 170 controls the electronic device 101 to provide various types of user interfaces can do. As a result, the usability of the electronic device 101 can be increased.

According to one embodiment, the electronic device 101 can display text, pictures, graphics, and the like displayed on the screen of the display 150, such as a home screen or an application screen, The kind of motion, or the strength of the motion, and provide the user with the information. For example, suppose a user swims. Since swimming has a unique movement pattern according to the style, the electronic device 101 can detect the movement pattern and provide contents to the user through the display 150, which is suitable for swimming. For example, assume that the user is running. The electronic device 101 can detect the movement of the user wearing the electronic device 101 and the motion of the arm to detect that the user's movement is running. As described above, the electronic device 101 can determine the motion the user is doing by analyzing the movement pattern of the user.

According to another embodiment, the electronic device 101 may receive the type of movement from the user before or during the exercise of the user. At this time, the control module 170 may also provide contents to the user through the display 150 according to the kind of the input motion.

The control module 170 may use at least one of sensing data acquired by the sensor module 180 such as blood pressure, heart rate, respiration rate, oxygen saturation, pace sound, calorie consumption, The state of the user can be determined. For example, the control module 170 may analyze the sensing data to determine that the user is moving or is exercising. For example, if the user's heart rate measured through the HRM sensor included in the sensor module 180 is 100 or more, the control module 170 can determine that the user is in motion. For example, if the user's HR measured by the HRM sensor is 100-120, if the user's exercise intensity is weak and the heart rate is 121-140, if the user's exercise intensity is in the middle and 141-170, It can be determined that the exercise intensity is strong.

For example, suppose the user is exercising for 30 minutes. 00: 00: 00 ~ 00: 10: 00 by dividing the exercise time of the user into 30 minutes, , 00: 20: 01 ~ 00: 30: 00, it is assumed that it is a post-exercise period (step 3). The control module 170 may determine that the user's motion progression state is the initial motion, the middle motion, or the late motion based on the time from the time when the user started the motion to the current time.

The control module 170 according to one embodiment may receive at least one of the sensing data obtained by the sensor module 180, for example, the user's blood pressure, heart rate, respiratory rate, oxygen saturation, pace, calorie consumption, The user can determine at least one of the type of motion the user is performing, the progression state of the motion, and the intensity of the motion. For example, assume that a user jogs for 30 minutes a week. The memory 130 stores sensing data recorded while jogging the user for the past week, for example, sensing data received from the sensor module 180 immediately before the user starts jogging, sensing data received from the sensor module 180 while the user is jogging 180 or sensing data received from the sensor module 180 immediately after the user jogs can all be stored under the control of the control module 170. [ That is, the sensing data received from the sensor module 180 may be stored in the memory 130. The sensing data may be stored in memory 130 of the electronic device 101 as well as in another separate device (e.g., electronic device 104 or a server on the network (e.g., server 106) . If the previously acquired sensing data is stored in the other device or the server according to an embodiment, the sensing data may be updated by transferring the newly obtained sensing data to the devices.

In addition, the control module 170 can determine the kind of the user's exercise, the progress of the exercise, the exercise intensity, etc. based on the sensing data accumulated in the memory 130. For example, assume that the user is jogging. The control module 170 generates sensing data representing the state of the user jogging (e.g., blood pressure, heart rate, respiratory rate, oxygen saturation, cardiac pace, calorie consumption, EMG, electrocardiogram, acceleration, angular velocity, , It is possible to determine that the user is currently jogging if the sensing data stored in the memory 130 is similar to the sensing data when the user is jogging (for example, 70% or more). According to one embodiment, the control module 170 may determine sensing data to be used to determine similarity of sensing data. For example, assuming that there are 10 kinds of sensing data in total, the control module 170 uses 7 kinds of sensing data out of the 10 types of sensing data to calculate the kind of exercise the user is doing, Strength and the like can be determined.

The control module 170 may control the electronic device 101 based on one or more of the type of movement, the progress of movement, the intensity of exercise, and the user state. The control module 170 controls the content displayed on the screen of the display 150 based on at least one of the kind of the movement, the movement progress state, and the exercise intensity (for example, the current time, temperature, , Heart rate, blood pressure, respiration rate, oxygen saturation, etc.) may be changed. For example, the control module 170 controls the display 150 to display six pieces of data of the current time, temperature, weather, exercise time, heart rate, and blood pressure when the user's exercise intensity is weak (weak) If the exercise intensity of the user is strong, the data displayed on the screen of the display 150 may be changed to display only three data, i.e., exercise time, heart rate, and blood pressure. The control module 170 may change not only the type of content displayed on the screen of the display 150 but also the size, color, direction, duration, etc. of the content to be displayed.

According to yet another embodiment, the control module 170 may limit the operation of the electronic device 101 based on at least one of the type of movement, the progress of movement, the strength of movement, and the user state. The control module 170 displays the received call alert, that is, the call is received on the display 150 so that the call is received, Can be controlled. The user can confirm the incoming call notification displayed on the screen of the display 150 and make a telephone call as a response thereto. However, if the user's intensity is strong, the control module 170 may control the display 150 not to display the incoming call notification even if the incoming call is being received. Since the received call notification has not been displayed, the user may not know that an incoming call is being received. By controlling the electronic device 101 so that the incoming call notification is not displayed as described above, the control module 170 can prevent the user from making telephone calls during the exercise or not allowing the user to stop exercising for telephone calls . In addition, the control module 170 may notify the user that an incoming call has been received by displaying the received call notification (missed call notification) through the display 150 after the user's movement is terminated.

For example, suppose the electronic device 101 supports a music player function and the user has launched the music player to listen to music while exercising. If the user's exercise intensity is weak, the control module 170 controls the electronic device 101 so that the user can control all functions of the music player (play, stop, rewind, fast forward, Can be controlled. If the user's intensity is weak, the control module 170 controls the electronic device 101 such that, for example, all of the buttons corresponding to each of the functions of the music player are displayed on the screen of the display 150, And control the electronic device 101 to execute the music player according to user inputs for each of the buttons.

However, if the exercise intensity of the user is strong, for example, equal to or higher than a preset level, the control module 170 controls the functions of the music player (play, stop, rewind, fast forward, It is possible to control the electronic device 101 so that only the volume control function can be controlled by the user. For example, the control module 170 may control the display 150 such that only the buttons corresponding to the volume control function among the buttons corresponding to the respective functions of the music player are displayed on the screen of the display 150 .

Additional information about the control module 170 is provided through FIGS. 2-5, described below. Although the processor 120 and the control module 170 are shown as separate components in the electronic device 101 in Figure 1, the processor 120 may be implemented in a form that includes the control module 170 And can perform all the operations that are performed by the control module 170. [

The sensor module 180 may measure a sensor numerical value or an operation state of the electronic device 101, and may convert the measured or sensed information into an electric signal. The sensor module 180 may measure the moving speed, the moving acceleration, the moving direction or the inclination of the electronic device 101. For this purpose, the sensor module 180 may be implemented in a form including an acceleration sensor or a gyro sensor.

According to one embodiment, the sensor module 180 may measure a user's biological signal (for example, blood pressure, blood flow, heart rate, body temperature, respiratory rate, oxygen saturation, cardiac pace, calorie consumption, It can also be measured. For this purpose, the sensor module 180 includes an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (electroencephalogram sensor, not shown), an ECG sensor (not shown) , An IR (infra red) sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). In addition, the sensor module 180 may include a heart rate variability (HRV) sensor, and the HRV sensor may sense a user's pulse wave signal. The HRV sensor can sense the pulse wave signal and calculate the average heart rate, heart rate distribution, etc. of the user.

The sensor module 180 including at least one of the sensors described above may further include a control circuit for controlling at least one or more sensors belonging to the sensor module 180. [

One or more sensors included in the sensor module 180 may measure the blood pressure, blood flow, heart rate variability (HRM), body temperature, respiratory rate, oxygen saturation, One or more biometric signals such as blood glucose, waist circumference, height, body fat mass, calorie consumption, brain waves, voice, skin resistance, electromyogram, electrocardiogram, gait, ultrasonic, sleep state and facial expression, Collected or measured. The control module 170 may analyze the raw data to determine biometric characteristic information for a user using the electronic device 101. [ For example, the control module 170 may analyze a pulse wave signal obtained through a heart rate variability (HRV) sensor to determine a user's average heart rate, heart rate distribution, and the like. At this time, the pulse wave signal corresponds to the row data, and the control module 170 can calculate the average heart rate, heart rate distribution, etc. of the user using the pulse wave signal collected through the HRV sensor.

The sensor module 180 may include non-blood-collecting measurement sensors such as an ultrasonic blood-sugar-free blood glucose meter using Raman spectroscopy. The sensor module 180 may also include, for example, a cholesterol measurement device that can easily measure cholesterol.

According to one embodiment, the sensor module 180 may include an electrocardiograph sensor. The electrocardiogram sensor can sense a pattern signal of an activity current of the heart. The electrocardiogram sensor can be divided into a current electrocardiograph and a voltage electrocardiograph according to a signal detection method. The electrocardiogram sensor can be implemented by attaching a plurality of ECG electrodes to a side of a portable electrocardiograph monitor device or a portable electronic device 101 called PEM (Portable EM) . The waveform of the electrocardiogram measured by the electrocardiogram sensor may be composed of P, Q, R, S, and T waves, and the R wave corresponds to the peak signal. The heart rate can be measured by the number of R-wave signals generated per unit time.

The electrocardiogram sensor can check the heart rate using an HRV (Heart Rate Variability) method. HRV is a technique for measuring the variation of the time interval between the R waves as the peak signal. It enables the control module 170 to analyze the activity of the autonomic nerves from minute changes between the heartbeats, To be predictable. The control module 170 may use the electrocardiographic sensor included in the sensor module 180 to acquire information for calculating the user's stress index in relation to the user's sympathetic nerve or parasympathetic nerve.

For example, in a healthy person, although the HRV variation through the electrocardiogram sensor is large and complicated, the complexity of the HRV variation is markedly reduced in a disease state or stressful state. The electrocardiogram sensor detects the HRV variation as described above, so that the control module 170 can provide data necessary for calculating the user's stress index.

According to one embodiment, the sensor module 180 may include a heart rate sensor. Heart rate sensors include HRM (heart rate monitor) sensors that can measure heart rate per unit time and sensors that can measure heart rate variability (HRV), which is a variation of the time interval between heartbeats. In addition, PPG (Photoplethysmography), which is a type of heart rate sensor, measures changes in blood vessel volume in the peripheral blood vessels caused by repeated heart contraction and relaxation, .

The electronic device 101 implemented in the form of a wearable device, such as a wearer's ear, a wrist, a carotid artery, a finger, or an ankle, is attached or brought into contact with the electronic device 101 so that the heartbeat sensor included in the electronic device 101 measures . Also, the user's heart rate can be measured using a non-contact method such as a camera or an infrared ray. The heart rate measured by the heart rate sensor may vary depending on the user's age, health condition, and emotional state. The heart rate pattern may also vary depending on the user's age, health condition, and emotional state. Accordingly, the control module 170 can calculate the blood vessel elasticity of the user by analyzing the heart rate or the heartbeat pattern measured by the heart rate sensor, and can determine the degree of blood vessel aging of the user. By determining the blood vessel elasticity or the degree of vascular aging of the user as described above, the control module 170 can determine the current state of the user.

According to one embodiment, the sensor module 180 may include an oxygen saturation sensor. The oxygen saturation sensor can measure the ratio of the hemoglobin which is saturated with oxygen to the total hemoglobin. The control module 170 can calculate the calorie consumption according to the user's motion, in particular through the oxygen saturation sensor. In addition, the oxygen saturation sensor can be used to detect a dangerous situation that can occur to a user such as respiratory distress, conscious disorder, shock, lung disease, acute respiratory distress syndrome (ARDS), high altitude zone hypoxia, gas poisoning, .

According to one embodiment, the sensor module 180 may include a surface sensor. The sleep sensor measures the sleep state of the user and may include at least one of an acceleration sensor, a gyro sensor, a pulse wave measurement sensor, a respiration rate measurement sensor, and a blood pressure measurement sensor.

According to one embodiment, the sensor module 180 may include a pedometer, which may include an acceleration sensor, a gyro sensor, etc. to measure the number of steps of the user and to estimate the calories consumed by the user can do. The pedometer can also use GPS or indoor positioning techniques to calculate the distance traveled by the user.

According to another embodiment, the sensor module 180 may be implemented as being included in the outside of the electronic device 101. For example, the sensor module 180 may be implemented in the form of being included in the electronic device 104. At this time, the user may be wearing the electronic device 104, and the electronic device 104 may transmit the sensing data to the electronic device 101 that is not worn by the user. The control module 170 of the electronic device 101 receives the sensing data from the electronic device 104 via the communication interface 160 and determines based on the sensing data that the user The type of exercise being performed, the progress of the exercise, the intensity of exercise, or the current state of the user. In addition, the control module 170 may control the type of content to be displayed on the screen of the display 150 or the manner of displaying the content according to the current state of the user such as the type of the motion, the progress of the motion, You can decide.

According to one embodiment, the electronic device 101 is a host device, and the electronic device 104 is a companion device, which may interwork with one another via wireless or wired communication. The electronic device 101 serving as the host device may include a control module 170 to receive sensing data from an electronic device 104 operating as a companion device and to receive the sensed data from a screen included in the companion device Direction can be determined. The control module 170 of the electronic device 101 may also control the companion device to display the content according to the screen direction of the electronic device 104. [ 23 shows an example in which the electronic device 101 is a host device and is interlocked with the electronic device 104 which is a companion device. Details of FIG. 23 will be described later.

The control module 170 may generate control signals according to the operation of the electronic devices 101 and 104. [ The control module 170 may also transmit the control signal to the electronic device 104 via the communication interface 160. [ The electronic devices 101 and 104 may perform operations according to each of the control signals. The operation of the electronic device 104 determined by the control module 170 at this time may be similar or identical to the operations performed in the electronic device 101. [

For example, the control module 170 may control to transmit an incoming call notification from the electronic device 101 to the electronic device 104 when the user's exercise intensity is weak (weak) and receiving an incoming call . However, if the exercise intensity of the user is higher than the middle level, the electronic device 101 may be controlled not to transmit the received telephone notification to the electronic device 104. [

For example, suppose the electronic device 104 supports a music player function, and a user carrying the electronic device 104 has launched the music player to listen to music while exercising. If the user's exercise intensity is weak, the control module 170 may control the electronic device 104 such that all of the buttons corresponding to all of the functions of the music player are displayed on the screen. On the other hand, if the user's intensity is strong, the control module 170 controls the volume of the music player to be used only by the user, The electronic device 104 can be controlled so that only the buttons corresponding to the adjustment function are displayed on the screen.

2 is a block diagram 200 of a control module 170 of an electronic device (e.g., electronic device 101), in accordance with various embodiments of the present invention.

Referring to FIG. 2, the control module 170 may include a status determination module 210, a direction determination module 220, and a content control module 230.

The status determination module 210 determines the status of the electronic device 101 based on the sensing data collected from one or more sensors (for example, an acceleration sensor, a gyro sensor, an HRV sensor, etc.) included in the sensor module 180 And can determine the current state of the user (hereinafter, user state). For example, if the user's heart rate measured by the HRV sensor is 85-130, the status determination module 210 may determine that the user is in motion.

The user state determined by the state determination module 210 may include a type of a user's exercise, a progress state of the exercise, an exercise intensity, and a health state of the user. According to one embodiment, the electronic device 101 may receive the user's body information such as the age, the key, and the weight of the user in advance in order to more accurately grasp the user state.

According to one embodiment, the status determination module 210 may determine a stress index for a user. For example, assume that the heart rate of a user is 70 to 90, which is normal. The state determination module 210 determines a stress index for the user when the user's heart rate is 91 to 100 and determines a stress index for the user if the heart rate is 101 to 115 And if the heart rate is 116 or more, the stress index for the user can be determined as the upper (upper). In addition, the state determination module 210 may control the display 150 to display a motion interruption alarm so that the user can stop the current motion when the stress index is out of a predetermined numerical range. For example, even if the stress index for the user corresponds to one or more of the top, middle, and bottom, the control module 170 may be configured to display a motion interruption alarm 150 to allow the user to stop the current motion Can be controlled.

The orientation determination module 220 analyzes the signals collected from one or more sensors (e.g., an acceleration sensor, a gyro sensor, etc.) included in the sensor module 180, i.e., sensing data, Can determine the direction of the screen on which they are displayed.

The direction determination module 220 may calculate the rotation direction of the screen. For example, if the electronic device 101 is a wristwatch type, the screen on which the one or more contents are displayed may be rotated 30 degrees with respect to the center of the user's left wrist.

The content control module 230 can determine the display direction of the content displayed on the screen based on the orientation of the screen determined by the orientation determination module 220. [ For example, when the content displayed on the screen is text, the content control module 230 may determine to display the text in the horizontal or vertical direction according to the direction of the screen. That is, the content control module 230 controls the display 150 so that the text is output in the left-to-right direction, or when the text is in the upper-to- The display 150 may be controlled so that the display 150 is output.

According to one embodiment, the content control module 230 may control the display 150 such that each of two or more contents displayed on one screen is output in different directions. For example, assume that the first text, the second text, and the image are displayed on the screen. The content control module 230 may determine that the first text and the image are displayed on the screen in the 'left to right' direction, and that the second text is displayed on the screen in the 'up to down' direction.

The content control module 230 may determine the display method of the content displayed on the screen based on the user status determined by the status determination module 210. [ For example, if the user's movement is intense (e.g., the user is performing a movement with a high degree of motion intensity), the status determination module 210 may determine the number of contents displayed through the display 150 or the size of each of the contents Can be limited. In addition, the status determination module 210 may increase the size of the content so that the user can easily check the content. For example, if the user's movement is not intense (e.g., the user is not exercising), such as when the user does not exercise or is walking lightly, The number of contents to be displayed may not be limited. In addition, the status determination module 210 reduces the size of the content, controls the display 150 to display a plurality of contents on one screen, or displays the display 150 in order that the screens including a plurality of contents are sequentially displayed Can be controlled.

An electronic device for displaying content according to an embodiment of the present invention includes a display including a screen for displaying content, a display device for acquiring sensing data, determining a current status of the user based on the sensing data, Determining a content to be displayed on the screen based on the content, and controlling the display to display the content.

3 is a flow chart illustrating an example of a method by which an electronic device according to various embodiments of the present invention displays content.

Referring to FIG. 3, the sensor module 180 may collect sensing data under the control of the control module 170 (S302). The sensing data may include various sensor values measured by the sensor module 180 (e.g., blood pressure, heart rate, body temperature, respiration rate, oxygen saturation, cardiac pace, blood glucose, etc.) of the user.

The control module 170 of the electronic device 101 may determine the current state of the user based on the sensing data (S304). The current state of the user may be whether or not the user is exercising, the kind of exercise when the user is exercising, the exercise progress state, the exercise intensity, the health state of the user, and the like.

If the current state of the user is determined in step S304, the content control module 230 may determine the content to be displayed on the screen of the display 150 based on the current state of the user (S308). For example, if the exercise intensity of the user is upward, the content control module 230 can determine the current time and consumed calories as content to be displayed on the screen. On the other hand, if the exercise intensity is lower (lower), the content control module 230 displays content to be displayed on the screen as the current time, exercise time, consumed calories, heart rate and blood pressure, You can decide to display a lot of content.

The display 150 may display the content determined by the content control module 230 on the screen in step S306 (S308).

4 is a flow chart illustrating an example of a method by which an electronic device according to various embodiments of the present invention displays content.

Referring to FIG. 4, the sensor module 180 may collect sensing data under the control of the control module 170 (S402). The sensing data may include various sensor values (e.g., speed, acceleration, tilt, GPS coordinates, etc.) of the electronic device 101 measured by the sensor module 180.

The control module 170 of the electronic device 101 may determine the direction of the screen of the display 150 based on the sensing data (S404). The direction of the screen may indicate the direction in which light is emitted from the LCD, for example, assuming that the screen is implemented as an LCD. For example, assuming that the electronic device 101 is implemented as a circular wristwatch type, the orientation determination module 220 determines in step S404 whether or not the sensing data measured by the acceleration sensor or the gyro sensor of the electronic device 101 (E.g., the movement speed of the electronic device 101, the movement acceleration, the direction of movement, or the inclination of the electronic device 101) (I.e., a tilt movement of the tilt axis).

If the direction of the screen is determined in step S404, the content control module 230 may determine the display direction of the content based on the direction of the screen (S406). For example, the content control module 230 may decide to display the text displayed on the screen in the horizontal direction or in the vertical direction.

The display 150 may display one or more contents on the screen according to the display direction of the screen determined in step S406 (S408).

In FIG. 4, the direction of the screen is described as indicating the direction in which the screen is directed. However, according to another embodiment, the direction in which the screen is directed may be the orientation of the content displayed on the screen. For example, assume that the screen is implemented as a rectangular LCD. The direction of the screen may be an alignment direction (e.g., 'left to right', 'up to down', etc.) of the content displayed on the rectangular LCD. According to one embodiment, the content control module 230 determines the user's arm motion or the user's gaze direction, and determines the angle of rotation of the screen with reference to the gaze direction based on the arm motion or the gaze direction of the user It can also be determined. For example, the content control module 230 may determine whether the electronic device 101 is closer to either a landscape mode or a portrait mode.

5 is a flowchart illustrating another example of a method of displaying an electronic device according to various embodiments of the present invention.

Referring to FIG. 5, the sensor module 180 may collect sensing data under the control of the control module 170 (S502). The sensing data generated by the sensor module 180 may include at least one of a moving speed of the electronic device 101, a moving acceleration, a moving direction, and a slope of the electronic device 101, Blood pressure, heart rate, respiratory rate, oxygen saturation, calorie consumption, electromyogram, electrocardiogram.

The control module 170 of the electronic device 101 may determine the current state of the user or the direction of the screen of the display 150 based on the sensed data (S504). The orientation of the screen may indicate, for example, the direction in which light is emitted from the LCD, assuming that the screen is implemented as an LCD. For example, assuming that the electronic device 101 is embodied as a full-time wristwatch type, the direction determination module 220 determines that the direction of the screen is rotated 30 degrees clockwise with respect to the center of the user's left wrist in step S504 . ≪ / RTI > The current state of the user determined by the control module 170 in step S506 may be determined by a user who wears the electronic device 101 implemented as a wearable device, for example, by exercising (for example, walking, jogging, Lt; / RTI >

If the current state of the user or the direction of the screen is determined in step S504, the content control module 230 may determine the content to be displayed on the screen and the display direction of the content based on the current state of the user or the direction of the screen S506). For example, assume that the content to be displayed on the screen is 'Message from Jim', and the font sizes of the characters of the text are the same. The content control module 230 can control the display 150 to display the text in the horizontal direction or in the vertical direction according to the direction of the screen. Also, if it is determined that the user state is in motion, the content control module 230 may control the output sizes of 'Message from' and 'Jim' among the text to be different from each other. According to one embodiment, the control module 170 may process the text 'Message from Jim' having the same font size to reduce the font size of 'Message from' and increase the font size of 'Jim'. At this time, 'Jim' font color may be different color from other text.

The display 150 may display the content on the screen according to the display direction determined in step S506 (S508).

An operation method of an electronic device according to an embodiment of the present invention includes an operation of determining movement information of an electronic device through an acceleration sensor or a gyro sensor, an operation of analyzing one or more biological signals to determine biometric information for a user, And controlling the operation of the electronic device according to the motion information and the biometric information.

A method of operating an electronic device according to another embodiment of the present invention includes the steps of determining whether a communication module communicating with an external device is connected to the external device, Lt; / RTI >

A method of operating an electronic device according to another embodiment of the present invention includes the steps of: pairing with one or more external devices, determining motion information of the electronic device using the motion sensor, analyzing one or more bio- The method comprising the steps of: determining biometric information for a user; determining a service that can be provided to the user from the electronic device based on the motion information or the biometric information; And may provide an operation to the user.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of: obtaining sensing data; determining a current state of a user based on the sensing data; Determining a content to be displayed on the screen, and displaying the content on the screen.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of obtaining sensing data for determining a direction of a screen, determining a direction of the screen based on the sensing data, Determining a display direction of the content along the direction of the screen, and displaying the content along the display direction.

6 is a flow chart illustrating another example of a method of displaying an electronic device according to various embodiments of the present invention. In Fig. 6, it is assumed that the user is exercising.

Referring to FIG. 6, the sensor module 180 may acquire sensing data under the control of the control module 170 (S602). The sensing data obtained by the sensor module 180 may include at least one of a moving speed of the electronic device 101, a moving acceleration, a moving direction, and a slope of the electronic device 101, Blood pressure, heart rate, respiratory rate, oxygen saturation, calorie consumption, electromyogram, electrocardiogram (ECG).

The control module 170 of the electronic device 101 may determine the current state of the user based on the sensing data (S604). The current state of the user determined by the control module 170 in step S604 may be determined based on, for example, the kind of exercise the user wears the electronic device 101 implemented in the wearable device, the exercise intensity, . If the user is exercising, the current state of the user may include the user's stress index. According to one embodiment, the control module 170 may determine the user's stress index in step S604. The stress index can be determined on the basis of the exercise performed by the user, the intensity of the exercise, the progress state of the exercise, the exercise time, the body temperature of the user, the blood pressure, the heart rate,

If the current state of the user is determined in step S604, the control module 170 may determine whether the stress index of the user is equal to or greater than a threshold value (S606). The threshold value may be a reference value for determining whether or not the user can continue to exercise. For example, if the user's heart rate is 100 or greater, the control module 170 may determine that the stress index is above a threshold. If the systolic blood pressure of the user is 160 mmHg or more, the control module 170 can determine that the stress index is equal to or greater than the threshold value. If the stress index is greater than or equal to the threshold value, the control module 170 may request the user to stop the exercise.

If it is determined in step S606 that the stress index is equal to or greater than the threshold value (S606: YES), the control module 170 controls the display 150 to display a motion interruption alarm on the screen requesting the user to stop the motion (S608). By displaying the motion interruption alarm as described above, the electronic device 101 can prevent the user from harming the health by performing excessive exercise.

If it is determined in step S606 that the stress index is less than the threshold value (S606: NO). The control module 170 may determine an operation according to the current state of the user (S612). The control module 170 may control the electronic device 101 to execute the operation determined in step S614. If the stress index is below a threshold value, the control module 170 may control the display 150 to display a screen, for example, an exercise course or the like, so that the user continues the exercise.

According to an embodiment of the present invention, there is provided a method of operating an electronic device, the method comprising: determining motion information of an electronic device based on sensor data measured through a sensor module; analyzing one or more biometric signals to determine biometric information And an operation of controlling the operation of the electronic device according to the motion information and the biometric information.

A method of operating an electronic device according to another embodiment of the present invention includes the steps of determining whether a communication module communicating with an external device is connected to the external device, Lt; / RTI >

A method of operating an electronic device according to another embodiment of the present invention includes operations of pairing with one or more external devices, determining motion information of an electronic device using an acceleration sensor or a gyro sensor, Determining the biometric information for the user based on the motion information or the biometric information and determining a service that can be provided to the user from the electronic device based on the motion information or the biometric information; And providing the service to the user.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of: obtaining sensing data; determining a current state of a user based on the sensing data; Determining a content to be displayed on the screen, and displaying the content on the screen.

A method of displaying an electronic device according to another embodiment of the present invention includes the steps of obtaining sensing data for determining a direction of a screen, determining a direction of the screen based on the sensing data, Determining a display direction of the content along the direction of the screen, and displaying the content along the display direction.

7 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content. 7A and 7B, it is assumed that the user wears the electronic device 101 on a part of the body. Various contents displayed on the screen by the display 150 can be displayed in the form of an image, and an image displayed on the entire screen is referred to as a 'screen image'.

7A is a basic screen image 701 of the electronic device 101. The screen includes the current time, date, and day of the week. For example, if the user is not in motion, the control module 170 may control the display 150 to display the base screen image 701. [

7B shows an example of the content that the electronic device 101 displays on the screen through the display 150 when the user is exercising. In FIG. 7 (b), it is assumed that the user is jogging. 7B, the control module 170 of the electronic device 101 may control the display 150 to display one or more motion mode screen images 711, 712, 713, 714 . In the exercise mode screens, contents such as type of exercise, exercise time, remaining time, movement distance, consumed calories, heart rate of the user, stress level due to exercise, and progress of the exercise can be displayed. Each of the exercise mode screen images 711-714 shown in FIG. 7B includes a screen image 711 showing a motion index, a screen image 712 showing a movement time, a screen image 713 showing a user's degree of stress, And a screen image 714 showing the progress of the exercise. Each of the motion mode screen images 711, 712, 713, and 714 may be converted to other screen images by a user input that is input through a screen of the display 150, such as a scroll input. For example, if a scrolling input moving from top to bottom or a scrolling input moving from right to left is input while the motion mode screen image 711 is displayed on the screen 150, the display 150 displays the motion mode screen image 711) to the exercise mode screen image 712 and display it. Although FIG. 7 illustrates only the user input through the screen, according to another embodiment, the user input may be a voice input, a gesture input, or the like. Also, the electronic device 101 can track the user's gaze and can recognize the traced user's gaze as a user input. The control module 170 controls the electronic device 101 according to various user inputs such as the voice input, the gesture input, and the user's gaze, for example, to switch the screen image displayed on the screen or to control the scrolling.

When the electronic device 101 is executing the exercise mode, the electronic device 101 displays an exercise mode screen image (e.g., exercise mode screen images 711, 712, 713, 714) May be displayed together with vibration or the like, the user may not be able to confirm. If the user can not confirm the exercise mode screen image, the electronic device 101 can automatically set the exercise mode screen image that the user has not confirmed as the initial screen image or the basic screen image. For example, if it is determined that the specific motion mode screen image is displayed together with the vibration but the user can not confirm it, the control module 170 may set the home motion image until the user confirms the specific motion mode screen image. Accordingly, the user does not need to input a separate input to the electronic device 101 to check the specific motion mode screen image. In addition, by setting the specific motion mode screen image as the initial screen image, it is possible to reduce the number of times of display of the screen image that the user does not need to check, thereby reducing the current consumption of the electronic device 101.

8 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays contents. In FIGS. 8A and 8B, it is assumed that the user wears the electronic device 101 on a part of the body, and the user is in motion.

8A is a message notification screen image 810 for notifying the number of messages received by the electronic device 101 or a new message. Through the message notification screen image 810, the display 150 can display the number of new messages not confirmed by the user, the sender of the message, and the current time. In FIG. 8 (a), there are six new messages not confirmed by the user.

The electronic device 101 may receive a user input for displaying the contents of the new message while displaying the message notification screen image 810. [ For example, a message notification screen image 810 is displayed on the screen, and in the state, the electronic device 101 is a user input for displaying the contents of a message, such as a user who fills the screen surface with a finger tip or stylus pen Input can be received. The control module 170 controls the display 150 to switch the screen image from the message alarm screen image 810 to the message display screen image 820 when a user input for displaying the contents of the message is input to the electronic device 101 Can be controlled.

8 (b) shows a message display screen image 820 displaying the contents of one of the new messages. Through the message screen image 820, the display 150 can display on the screen the originator, the content of the message, the current time, or the reception time.

According to one embodiment, the electronic device 101 may switch the screen image from the message display screen image 820 to a message alarm screen image. In a state where the message display screen image 820 is displayed on the display 150 as shown in FIG. 8 (b), the electronic device 101 can receive a user input for displaying the contents of the message. For example, the message notification screen image 810 is displayed on the display 150 and, in the state, the electronic device 101 is a user input for displaying the contents of the message, You can receive user input to tap the surface. The control module 170 controls the display 150 to switch the screen image from the message alarm screen image 810 to the message display screen image 820 when a user input for displaying the contents of the message is input to the electronic device 101 Can be controlled.

9 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content. 9 (a) and 9 (b), it is assumed that the user wears the electronic device 101 on a part of the body.

9A and 9B illustrate screen images displayed on the display 150 of the electronic device 101 in order. FIG. 9A shows a screen image when the user is not exercising And FIG. 9 (b) is screen images when the user is exercising.

According to an exemplary embodiment, when the electronic device 101 is implemented as a wearable device, a screen may be configured with a card type UI in consideration of a limited size of the screen. For example, each of the screen images displayed on the screen may be configured in the form of a page, and the user can sequentially look up other pages while flicking the page through touch or flick input. In this case, the order of the pages may be determined in advance, and FIGS. 9A and 9B show an example in which a card-type UI, for example, one page is displayed on one screen and displayed on the screen will be. At this time, the order of the pages may be changed according to user input or arbitrarily changed by the electronic device 101.

For example, when the electronic device 101 is connected to another electronic device (e.g., electronic device 104) and communication means (e.g., communication interface 160) Preferentially display on the screen GUIs, i.e. pages, associated with the connection event with the other electronic device.

9, it is assumed that the initial screen image of the electronic device 101 is the current time screen image 920 indicating the current time. The control module 170 of the electronic device 101 sets the current time screen image 920 as the initial screen image and displays the current time screen image 920 prior to the other screen images 910, 930, 940 The display 150 may be controlled.

According to one embodiment, electronic device 101 may receive a message from another electronic device (e.g., electronic device 104). When receiving the message reception event, the control module 170 of the electronic device 101 transmits a message related to the message to the electronic device 1010. [ The display 150 may reset the message alarm screen image 910 to other screen images 910. The message alarm screen image 910 may then be reset to the initial screen image, 920, 930, and 940. In addition, a message alarm screen image 910, a current time image 920, an exercise mode screen image 930, a music playback screen image 940 ) &Quot;. < / RTI >

According to another embodiment, the control module 170 may again control the electronic device 101 to reset the current time image 920 to the initial screen image once a predetermined time has elapsed after the occurrence of the message reception event .

As described above, the electronic device 101 can change the priority of the screen images displayed through the display 150. According to one embodiment, the electronic device 101 may be configured to receive events (e.g., message reception events, user status alarm events, exercise mode alarm events, etc.) generated by other electronic devices or the like, The display order of each of the screen images can be changed so that the screen images associated with the screen images are preferentially displayed. Thus, the user can easily check the latest event or information generated in the electronic device 101. According to an exemplary embodiment, after a predetermined time has elapsed after the event is generated, the electronic device 101 may display the display order of the screen images without receiving a separate user input, . Thus, the user can easily confirm the screen images displayed on the electronic device 101 in order.

Referring to FIG. 9A, the electronic device 101 displays a message alarm screen image 910 as an initial screen image. The electronic device 101 displays a message alarm screen image 910, a current time screen image 920, an exercise mode screen image 930, a music playback screen image 940, The contents can be displayed in the order of According to one embodiment, the message alarm screen image 910, which is an initial screen image, may include an initial screen image designated by the user, an initial screen image designated as the default of the electronic device 101, Lt; RTI ID = 0.0 > image < / RTI > The electronic device 101 can switch the screen image according to user input. If a user input (swipe input) pushing the surface of the screen from above to the top is detected while the message alarm screen image 910 is displayed, the electronic device 101 displays the current time screen image 920 Can be displayed. Conversely, when a user input pushing the surface of the screen 150 from left to right is input, the electronic device 101 may display the music playback screen image 940. Similarly, when a user input pushing the surface of the screen from left to right or a user input pushing the surface of the screen from left to right in a state where the current time screen image 920 is being displayed is input, a message alarm screen image 910 or a motion mode screen image (930) may be displayed.

When a user input pushing the surface of the screen from left to right or a user input pushing the surface of the screen from left to right is input with the exercise mode screen image 930 being displayed, 940) may be displayed. When a user input pushing the surface of the screen from left to right or a user input pushing the surface of the screen from left to right in a state that the music playback screen image 940 is being displayed is input, a motion mode screen image 930 or a message alarm screen image 910) may be displayed.

According to another embodiment, the electronic device 101 is a companion device in which the electronic device 101 is a host device and the other electronic device 104 is a wearable device, and the host device and the companion device communicate with each other It is assumed that they are connected to each other. It is also contemplated that a host device (e.g., electronic device 101) may display data being displayed on the companion device to the host device and likewise the companion device may display data being displayed on the host device to the companion device .

The host device may prioritize events that occur in a companion device (e.g., a wearable device) that is equipped with one or more sensors. The host device (e. G., Electronic device 101) may display an event associated with the companion device prior to an event occurring in the host device.

For example, suppose the companion device is a SmartWatch with a PPG sensor. The companion device may measure the biometric information (e.g., heart rate) of the user wearing the companion device using the PPG sensor and display the measured biometric information on the screen of the companion device. Further, the companion device can transmit the biometric information measured through the PPG sensor to the host device. The host device can display the biometric information received from the SmartWatch preferentially on the screen thereof so that the user can confirm the biometric information. In other words, the host device gives priority to the biometric information and transmits the biometric information from the companion device At the same time, the biometric information can be displayed on its screen in real time.

Generally, synchronization between a host device and a companion device as a wearable device is not performed in real time, but can be performed at preset predetermined intervals. Also, the connection between the host device and the companion device may be broken so that synchronization between the two devices may not be achieved. Accordingly, the user may be unable to confirm the health related notification such as the biometric information through the host device.

(E. G., Electronic device 101) in accordance with an embodiment of the present invention may be configured to receive a biometric information-related event (e. G. Can give priority to.

9B shows a state in which the electronic device 101 implemented in the wearable device includes the user's momentum (e.g., moving distance, consumed calories, etc.) when the user starts or starts exercising The motion mode screen image 930 is displayed as an initial screen image.

The control module 170 of the electronic device 101 analyzes the sensing signal measured by the acceleration sensor or the biosensor and determines whether the current state of the user is a motion state if the momentum of the user is equal to or greater than a predetermined amount of exercise, You can decide. If the user is determined to be in motion, the control module 170 may automatically set the exercise mode screen image 930 as an initial screen image and display it on the screen, even if no separate user input has been received. 9B, the electronic device 101 displays a 'motion mode screen image 930', a music reproduction screen image 940, a message alarm screen image 910, a current time screen image 920 ) &Quot;. < / RTI > In a manner similar to FIG. 9A, the screen images 910-940 may be switched according to user input also in FIG. 9B.

10 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content. 10 (a) and 10 (b), it is assumed that the user wears the electronic device 101 on a part of the body.

FIG. 10 (a) is screen images displayed by the screen of the display 150 when the user is not exercising, and FIG. 10 (b) is screen images when the user is exercising.

Referring to FIG. 10A, when the user is not performing a movement, the display 150 of the electronic device 101 displays a message alarm screen image 1010 as an initial screen image. Also, when an operation for pushing the surface of the screen from top to bottom with the input for switching the screen image, for example, the user's finger or the stylus pen, is input to the electronic device 101, the control module 170 displays another screen image The display 150 may be controlled. In FIG. 10 (a), the missed call notification screen image 1020 and the exercise schedule notification screen image 1030 are displayed next to the message alarm screen image 1010.

When the user is performing a motion, the control module 170 may control the display 150 to display the degree of stress of the user according to the motion as an initial screen image. 10 (b) is a stress level screen image 1040 showing the stress level of the user. When the user starts the exercise, the control module 170 can automatically set the stress level screen image 1040 as the initial screen image even if no separate input from the user has been received. By setting the stress level screen 1040 to the initial screen image, the electronic device 101 can allow the user who is exercising to check his / her stress level in real time.

According to one embodiment, when the user's exercise amount is less than a preset exercise amount or when the stress index of the user measured by the HRV sensor is less than or equal to a predetermined index as in the case where the user slowly walks, The screen image 1010 can be set as an initial screen image. Also, if it is determined that the user's stress index is higher than a predetermined threshold value by excessive exercise, the stress level screen image 1040 may be set as an initial screen image as shown in FIG. 10 (b) The current status can be displayed separately at the top of the screen.

11 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content. In Figures 11 (a) and 11 (b), the user assumes that the electronic device 101 is worn on a part of the body. It is also assumed in Fig. 11 that the electronic device 101 is a companion device and is interlocked with the other electronic device 104. Fig.

11A shows the contents displayed on the screen through the display 150 when the electronic device 101 is interlocked with the electronic device 104 as a host device. Referring to FIG. 11A, the electronic device 101 displays a message alarm screen image 1110 as an initial screen image. 11A, the electronic device 101 displays a message alarm screen image 1110, a current time screen image 1120, a motion mode screen image 1130, a media playback screen image 1140, The contents can be displayed in the order of

The electronic device 101 can switch the screen image displayed on the screen according to user input. If a user input that pushes the surface of the screen from right to left or a user input that pushes the surface of the screen from left to right is input while the message alarm screen image 1110 is being displayed, 1120) image or media playback screen image 1140 on the screen. Similarly, when a user input pushing the surface of the screen 150 from left to right or a user input pushing the surface of the screen from left to right in a state where the current time image 1120 is being displayed is input, A mode screen image 1130 can be displayed on the screen.

Further, the electronic device 101 can provide the contents stored in the host device or the functions provided in the host device to the user via the interlocking of the electronic device 104. [ 11A, a message alarm screen image 1110 and a media playback screen image 1140 are displayed on the electronic device 101, assuming that the message function and music playback function are provided from the electronic device 104, May be displayed on the screen via the display 150 only when the electronic device 104 is associated with the host device.

11B shows the display 150 when the electronic device 101 is not interlocked with the electronic device 104 as a host device, that is, when the electronic device 101 operates in a stand alone mode. The screen images are displayed on the screen through the screen. The functions provided by the electronic device 104 can not be provided to the user by the electronic device 101 when the interaction with the electronic device 104 that was the host device is terminated. The control module 170 controls the display 150 to provide only those screen images according to the functions that can be provided to the user regardless of whether they are connected to the electronic device 104, can do.

The functions according to the message alarm screen image 1110 and the media playback screen image 1140 of the screen images 1110 to 1140 shown in FIG. 11A are functions provided by the electronic device 104, It can not be provided to the user if the device 101 does not cooperate with the electronic device 104. [ Therefore, only the current time image 1120 and the current mode image 1130 can be displayed on the screen through the display 150 in FIG. 11 (b).

If the electronic device 101 implemented in the wearable device according to one embodiment operates alone, for example, it may not receive a message transmitted from the host device (e.g., electronic device 104) The control module 170 may remove the screen image associated with the mode requiring communication with the electronic device 104. [ That is, when the electronic device 101 operates alone, the control module 170 can display only the mode screen images that can be displayed when the electronic device 101 operates alone through the display 150. [ The control module 170 can display the media playback screen image 1140 through the display 150 only when the multimedia content stored in the electronic device 101 implemented in the wearable device can be controlled.

According to yet another embodiment, the control module 170 may write to the memory 130 a usage history of an application that the user has frequently used at a particular time or location. When one or more events occur in which the current time arrives at the specific time or the event that the electronic device 101 enters the specific location, the control module 170 automatically detects the specific time Or an initial entry screen image of an application that the user frequently uses at a particular location may be displayed on the screen via the display 150. According to one embodiment, the control module 170 may change the screen image so that the user can easily select an application frequently used by the user when the specific time or specific position is reached.

The control module 170 may calculate the preference of each of the applications based on one or more of the frequency of use or total usage time of each of the applications. The control module 170 may arbitrarily arrange a menu or an execution icon for selecting each of the applications according to the preferences of the respective applications. For example, the control module 170 displays the execution icon corresponding to the high-priority application through the display 150 in a larger size than the other execution icons, or displays the execution icon at the center of the screen so as to be easily visible to the user's eyes . According to one embodiment, the control module 170 may evaluate the preferences corresponding to the respective applications according to the location information of the electronic device 101. [ When the electronic device 101 enters the location where the preference is high for each application or when the user selects the area where the location is included (for example, a geofence setting area, an access point (AP) Area, etc.), the control module 170 may control the display 150 to display and change at least one of the location, size, and color of the menu or execution icon for executing the application .

12 is a diagram showing an example in which the electronic device 101 displays contents according to various embodiments of the present invention.

12A is a diagram showing a user input 1251 for rejecting a telephone call when the user 1201 is not exercising, and FIG. 12B is a diagram showing a case where the user 1201 is exercising And a user input 1252 for rejecting telephone reception. It is assumed in Figures 12 (a) and 12 (b) that an incoming call from "Peter smith" is receiving an incoming call from the electronic device 101.

12A and 12B, a user 1201 can be dragged left at any one point 1230 on the screen 1210 as user inputs 1251 and 1252 for rejecting telephone reception. have. The user input to be input to the electronic device 101 by dragging from one arbitrary point to another point as described above will be referred to as a 'drag input'.

Both the drag input 1251 of Figure 12 (a) and the drag input 1252 of Figure (b) are for rejecting the reception of a telephone call to the electronic device 101, but the drag inputs 1251, The respective drag lengths d1 and d2 are different from each other. 12, the drag length d2 of the drag input 1252 shown in (b) is longer than the drag length d1 of the drag input 1251 shown in (a). 12, when the user 1201 is not moving, the electronic device 101 can reject the reception of the telephone if the length of the drag input 1251 is d1 or more. Also, when the user 1201 is exercising, the electronic device 101 may reject the reception of the telephone if the length of the drag input 1252 is equal to or greater than d2.

Although Figures 12 (a) and 12 (b) are both the drag inputs 1251 and 1252 for rejecting the reception of a call, the current state of the user 1201, i.e., whether the user 1201 is exercising The reference values for determining whether the drag inputs 1251 and 1252 are valid may be different from each other. The user 1201 is likely to input an erroneous user input to the electronic device 101 because the user 1201 is more motivated than when the user is not exercising. Accordingly, as shown in Figs. 12A and 12B, the reference value when the user 1201 is exercising may be larger than the reference value when the user is not exercising.

As shown in FIGS. 12A and 12B, even if the same user inputs 1251 and 1252 are used, different reference values for determining whether or not the user input is valid may be applied differently, It is possible to prevent the electronic device 101 from malfunctioning in accordance with the input.

According to one embodiment, the user input 1230 may be at least one of a swipe, a tap, a long press, and a hovering. When receiving the user input 1230, the control module 170 may apply a reference value for identifying the user input 1230 according to the current state of the electronic device 101 or the user. For example, if the user's motion is fast or if the user is exercising violently, it may be difficult for the user to identify the screen of the electronic device 101 because of the rapid movement at the location where the electronic device 101 is mounted. Also, if the user is doing violent movement, the user may not be able to spread the attention due to the violent movements or to afford the screen for a long time. In such a case, the user input (e.g., touch, flick, etc.) input through the electronic device 101 may be controlled by the user The error of the input value (for example, the input position, the input pattern, the input intensity, etc.) depending on the input may be large or inaccurate.

Accordingly, the control module 170 controls the touch intensity of the user input, the distance of the flick or drag, the area to be touched, the size of the gesture inputted through the camera module (not shown) It is possible to determine whether each of the functions of the electronic device 101 is operated according to the speed of the gesture input or the like.

13 is a diagram showing an example in which an electronic device according to various embodiments of the present invention displays contents. In Fig. 13, the electronic device 101 displays the vertical UI through the display 150. Fig. The vertical UI is a UI that provides a vertically long screen, and the horizontal UI is a UI that provides a horizontally long screen.

Referring to FIG. 13, first to third screen images 1311, 1312, and 1313 may be displayed on the screen of the display 150. The first screen image 1311 includes content related to the alarm, the second screen image 1312 includes content related to healthcare, and the third screen image 1313 may include content related to the message . 13, the electronic device 101 can switch the screen image displayed on the screen upon receipt of the first through the fourth inputs 1321, 1322, 1323, and 1324. 13, it is assumed that the first through fourth inputs 1321-1324 for switching the screen image are inputted while the second screen image 1312 is displayed on the display 150. [

Referring to FIG. 13, the first input 1321 pushes up the second screen image 1312 from the bottom up, with the user selecting a point on the screen using a finger or a stylus pen. When the first input 1321 is input, the control module 170 may control the display 150 to switch the screen image from the second screen image 1312 to the third screen image 1313.

The second input 1322 is to push down the second screen 1312 from the top down with the user selecting a point on the screen using a finger or a stylus pen. When the second input 1322 is input, the control module 170 may control the display 150 to switch from the second screen image 1312 to the first screen image 0 1311.

The third input 1323 is to push the second screen image 1312 from left to right with the user selecting a point on the screen using a finger or a stylus pen. When the third input 1323 is input, the control module 170 may control the display 150 to switch the screen image from the second screen image 1312 to the first screen image 1311.

The fourth input 1324 is to push the second screen 1312 from right to left with the user selecting a point on the screen using a finger or a stylus pen. When the fourth input 1324 is input, the control module 170 may control the display 150 to switch from the second screen image 1312 to the third screen image 1313.

A screen image or a menu GUI displayed through the display 150 of the electronic device 101 even when a user input (e.g., a swipe input) is input in either the vertical or horizontal direction, can be changed. Thereby, the user who uses the electronic device 101 can feel no confusion due to the automatic switching of the screen image in the electronic device 101 using the horizontal / vertical screen. Also, by switching the screen image in the manner as shown in FIG. 13, the user can input the user input to the electronic device 101 in a uniform and simple input manner.

According to another embodiment, even when the electronic device 101 shown in FIG. 13 is not of a vertically elongated shape but a vertically elongated shape, a user input as shown in FIG. 13, for example, And receive input / flick signals. Also, the screen image of the electronic device 101 can be automatically switched by the switching method of the screen image as described with reference to FIG.

14 is a diagram showing an example in which an electronic device according to various embodiments of the present invention displays contents.

14, electronic device 101 may be implemented as a host device and associated with electronic device 104, which is a companion device. As shown in Fig. 14, the electronic device 104, which is a companion device, may be implemented as a wearable device (e.g., a wearable device of a circular wrist watch type) and may be worn on a part of the user's body. The electronic device 101, which is also a host device, may be located in a possible location with the electronic device 104 to control the electronic device 104. 14, the electronic device 104 is in the exercise mode under the control of the electronic device 101 and reproduces the audio file under the control of the electronic device 101. [

According to one embodiment, the electronic device 104 may determine the degree of movement of the wearer of the electronic device 104 (e.g., sprint or walk, etc.), and output audio and speech Levels can be changed and applied differently. The electronic device 104 may thereby provide an output level and an input level (e.g., a microphone, etc.) of sound optimized for the hearing of the user.

For example, if the user is engaged in a busy workout, the electronic device 104 may raise or lower the output of the speaker or microphone as compared to when the user is not exercising. The electronic device 104 can control the input and output levels through, for example, volume adjustment, sensitivity adjustment, noise filtering adjustment, etc. of a speaker, a microphone, a Bluetooth headset, a headphone, etc., This allows the user to easily hear the sound from the electronic device 104 or to input sound into the electronic device 104 during exercise.

15 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention displays content. The electronic device 104 of Fig. 15 may be a circular wrist watch type wearable device shown in Fig. 14 and may be interlocked with the host device 101. Fig.

FIG. 15 shows a case where the electronic device 104 outputs a sound at a maximum level when the user's motion is equal to or greater than a preset reference value, that is, when the user is intensively exercising. The electronic device 104 in Fig. 15 is playing a song file entitled " Let it Be ", and the song file can be output through the speaker at the maximum volume.

According to one embodiment, when the degree of motion of the user is equal to or greater than a preset reference value, for example, when the strength of the motion of the user is strong, the electronic device 104 worn by the user can notify the user through the display The display operation can be temporarily stopped.

The electronic device 104 may store the alarm in the memory of the electronic device 104 without a notification interrupt. Thereafter, if the degree of movement of the user detected through the sensor module is determined to be less than the preset reference value, the alarm stored in the memory can be displayed to the user. This allows the electronic device 104 to reduce power consumption and allow the user to conveniently view the alarm.

According to one embodiment, the electronic device 104 may receive various user inputs from a user, such as a swipe, a tap, a long press, hovering, and the like. According to one embodiment, the electronic device 104 implemented as a wearable device can reduce an input error by blocking some user input when the user is in motion or the operation of the user is greater than a preset reference value. For example, if the user is doing a push-up operation or immediately after doing the push-up operation, then the hovering input may not be correctly entered into the electronic device 104. [ Accordingly, the control module 170 may ignore or not input the hovering input for a predetermined period of time (e.g., during a user push-up operation).

According to one embodiment, when a specific application (e.g., health care, SNS, telephone, alarm, image viewer, application related to one or more of media playback) is executed in the electronic device 101, The device 104 may display a counter application. The counter application may be an application that is associated with the particular application running on the electronic device 101 or that includes at least some of the functionality of the particular application. For example, if the host device (e.g., electronic device 101) is driving a user's health care application (e.g., an application related to a heart rate sensor, food calorie management, calorie expenditure check, exercise coaching, etc.) , And the electronic device 104, which is a companion device, may also display a health coaching screen associated with the user's health care application.

As another example, if the host device (e.g., electronic device 104) is displaying photos via a gallery application, then electronic device 101, which is a companion device, may also be used to launch a gallery application, A user interface (UI) can be provided to the user. This allows the user to easily access the gallery application via the electronic device 101. As another example, when a user executes a moving image playback application via a host device (e.g., electronic device 103), the moving image playback application may also be executed in the electronic device 101 as a companion device. At this time, the moving picture is reproduced on the host device, and the companion device can display the information (for example, TV channel information, movie title, casting information, etc.) or the reproduction list on the screen on the screen. The screens of the host device and the companion device may simultaneously display the same content.

As another example, assume that a user is running a document editing application (e.g., a note, word processor, etc.) via a host device (e.g., electronic device 104). In such a case, the control module 170 of the electronic device 101, which is a companion device implemented as a wearable device, can pop-up the document editing application directly on the screen through the display 150 . The control module 170 may also control the electronic device 101 to execute the document editing application in response to a single user input by the user. For example, the control module 170 of the electronic device 101, which is a companion device, can display on the screen via the display 150 an icon associated with the document editing application or a content containing at least a portion of the document content, up. When the user selects or operates the pop-up, the control module 170 may control the display 150 to drive the document editing application or to display a document editing window instead of the pop-up .

16 is a diagram showing an example in which an electronic device according to various embodiments of the present invention displays contents.

In Fig. 16, it is assumed that the electronic device 101 and the electronic device 104 are interlocked. According to one embodiment, the electronic device 101 may be a host device and the electronic device 104 may be a companion device.

Since the electronic devices 101 and 104 are interlocked with each other, an application running on the electronic device 101 that is a host device can also be executed on the electronic device 104 which is a companion device.

Referring to Fig. 16, in electronic device 101, an application related to a note is executed and displayed on the screen through display 150. Fig. Accordingly, an application related to the note is also executed in the electronic device 104, which is a companion device, and is displayed on the screen 1650.

According to the embodiment, when the electronic apparatuses 101 and 104 interlocked with each other execute and display the same application, the operation according to the user's input, which is input to the electronic apparatus 101 or the electronic apparatus 104, And can be simultaneously executed and displayed on the electronic device 101 and the electronic device 104. [ For example, if the user has created a new note via the electronic device 104, then the electronic device 101, as well as the electronic device 104, will also create a new note and display it on the screen via the display 150 Can be displayed.

17 is a diagram showing an example in which an electronic device according to various embodiments of the present invention displays contents. In FIG. 17, the electronic device 101 displays a horizontal UI through which a screen of a long form is provided on the screen through the display 150. FIG. It is also assumed in FIG. 17 that the user is exercising.

17A shows contents (e.g., screen images 1711 and 1712) that can be displayed on the screen through the display 150 according to each of the cases where the user's exercise intensity is weak and strong, respectively. At this time, the control module 170 may determine the exercise intensity based on a user's movement change amount, a movement speed, an exercise duration time, a calorie consumption amount per unit time, and the like.

Referring to FIG. 17A, when the user's motion intensity is weak, the screen displays information on the motion the user is doing, such as the type of motion (e.g., running), the movement distance (e.g., 6.2 (e.g., 234 cal), the user's heart rate (e.g., 95), and the exercise time (e.g., 00:28:30). It is easy for the user to check the screen of the electronic device 101 at the same time when the exercise intensity is weak. The user's exercise intensity is on the weak side so that while the user is constantly exercising, the display 150 of the electronic device 101 displays the above content, such as the type of exercise, travel distance, calorie consumption, heart rate, A first screen image 1711 including the first screen image 1711 may be provided from the electronic device 101. The first screen image 1711 includes five kinds of contents, but according to another embodiment, five or more contents can be displayed through the display 150. A plurality of contents may be displayed on the screen through the display 150 while the screen image is switched according to another embodiment.

If the user's intensity of movement is intensified, a second screen image 1712 including only the user's exercise time (for example, 28:30) may be provided to the user by the display 150. [ If the exercise intensity is strong, it may be difficult for the user to exercise and check the screen of the electronic device 101 at the same time. Accordingly, the control module 170 may control the display 150 to provide the user with a limited number of pieces of information about the motion the user is doing. If the content provided to the user via the display 150 is limited, the control module 170 may control the display 150 to first display the highest priority content according to the priority of each of the contents. In FIG. 17 (a), it is assumed that the type of exercise, the movement distance, the consumed amount of heat, the heart rate, and the exercise time have higher priorities than other contents.

17B shows the contents (for example, the screen images 1713, 1713, and 1713) that can be displayed on the display 150 according to the weak and strong cases of the user's exercise intensity, respectively, 1714).

Referring to FIG. 17B, when the exercise intensity of the user is weak, the schedule of the user may be displayed as the third screen image 1721 on the screen. The third screen image 1321 includes the current time, schedule contents, date, location, and the like. The control module 170 can easily display various contents displayed on the screen of the display 150 as compared with a case in which the intensity of the exercise intensity is weak, The electronic device 101 may be controlled so that the electronic device 101 is included in the display screen.

On the other hand, if the exercise intensity of the user is strong, the schedule of the user may be displayed as the fourth screen image 1722 on the screen. The fourth screen image 1322 includes only schedule contents. In the case where the exercise intensity is strong, it is difficult for the user to confirm various contents displayed on the screen of the display 150 as compared with the case in which the exercise intensity is weak, so that the control module 170 can display one content on one screen, It is possible to control the electronic device 101 to be included in the fourth screen image 1722 and displayed. At this time, the control module 170 may determine the content to be displayed on the screen of the display 150 according to the priority. In FIG. 17 (b), the content having the highest priority may be a schedule content. Accordingly, the control module 170 can control the display 150 to display only the schedule contents on the screen.

17, the electronic device 101 may display only important information (e.g., a second screen image 1712 and a fourth screen image 1722) among a variety of information, but in another embodiment Accordingly, the control module 170 of the electronic device 101 may sequentially display various information at predetermined time intervals (for example, 10 seconds) to display the information. The control module 170 controls the display 150 to display information such as an image, a letter, a number, a symbol, a symbol, an animation, a video, an icon, a GUI Or the shape can be variously adjusted according to the user's exercise level or exercise intensity.

18 is a diagram showing an example in which an electronic device according to various embodiments of the present invention displays contents. In FIG. 18, the electronic device 101 displays a horizontal UI that provides a screen of a long shape through the display 150. In Fig. 18, it is assumed that the user is jogging as a motion.

18 (a) to 18 (c) show that the content displayed on the display 150, for example, the screen image varies depending on the exercise intensity of the exercise the user is doing. For example, the control module 170 may vary the amount of information included in the screen image displayed on the screen or the size of the GUI depending on the intensity of the exercise.

18 (a) shows contents displayed on the screen when the exercise intensity is weak, (b) shows contents displayed on the screen when the exercise intensity is high, and , and (c) are contents displayed on the screen when the exercise intensity is high.

Referring to FIG. 18A, when the exercise intensity is 'weak', the control module 170 calculates the type of exercise (jogging), the exercise time (00:28:30), the exercise distance (6.2 km) The user can control the display 150 to display on the screen a first screen image 1810 that includes a calorie (234 kcal) heart rate 95. The display 150 may also display a menu button 1811. Upon receiving the user input for selecting the menu button 1811 from the user, the electronic device 101 displays the content displayed on the first screen image 1810 (type of exercise, duration of exercise, exercise distance, consumed calories, Heart rate) can be displayed.

In addition, the control module 170 may display the motion path as the second screen image 1815 together with the first screen image 1810. The control module 170 determines that the second screen image 1815 is in a state in which the second screen image 1815 is displayed on the display screen of the second screen image 1815 in accordance with the map, the current position of the user, the moving distance of the user, (Left after 120m movement). The display 150 may also display a menu button 1811.

Referring to FIG. 18B, when the exercise intensity is 'middle', the control module 170 includes a type of exercise (jogging), a time required for exercise (00:28:30), and a distance for exercise (6.2 km) The display 150 may be controlled to display the first screen image 1820 on the screen. The display 150 may also display a menu button 1821 on the screen. The electronic device 101 receives a user input for selecting the menu button 1821 from the user so that the contents of the first screen image 1820 Other content can be displayed.

In addition, the control module 170 may display the motion path as the second screen image 1825 together with the second screen image 1820. The control module 170 determines that the image of the second screen 1825 is displayed on the display screen of the second screen 1825 in accordance with the map, the current position of the user, the moving distance of the user, the moving speed of the user, The display 150 may be controlled to include a left turn. The display 150 may display a menu button 1811 and the map included in the second screen image 1825 in Fig. 18B may correspond to the second screen image 1825 in Fig. 18A 1815, which is shown in FIG.

Referring to FIG. 18C, when the exercise intensity is 'strong', the control module 170 controls the display 150 to display a first screen image 1830 including a motion distance of 6.2 km on the screen Can be controlled. The display 150 may also display a menu button 1831. The electronic device 101 can display contents other than the contents (exercise distance) included in the first screen image 1830 when receiving a user input for selecting the menu button 131 from the user.

In addition, the control module 170 may display the moving direction as the second screen image 1835, together with the first screen image 1830. The control module 170 determines that the second screen image 1835 is displayed on the display so that the second screen image 1835 includes the remaining distance (3 km), the estimated time (00:15:20), and the moving direction 150 can be controlled. The display 150 may display the menu button 1831 and the second screen image 1835 in FIG. 18C may be displayed on the second screen images 182a, (1815, 1525), and a map of the contents may be omitted.

According to one embodiment, the electronic device 101 may adjust the amount of various content displayed through the display 150. The control module 170 of the electronic device 101 may adjust the amount of content displayed on the display 150 by level. Hereinafter, the level of the content displayed through the display 150 will be referred to as 'display level'. The control module 170 of the electronic device 101 may summarize the information corresponding to the content step by step by reducing the amount of content displayed through the display 150 according to the display level.

For example, it is assumed that the schedule includes detailed information such as a scheduled time, a place, an objective, an attendee, a current time of the meeting schedule, and an icon corresponding to the schedule schedule. If the display level is 3, the control module 170 can display on the screen such that the detailed information is all included in one screen image. If the display level is 2, the control module 170 may control the display 150 to include only the scheduled time, place, and purpose of the meeting schedule in one screen image. If the display level is 1, the control module 170 may control the display 150 to display only the remaining time and place to the meeting schedule on one screen.

As another example, assume that the electronic device 101 displays a call message screen image. If the display level is 3, the control module 170 may control the display 150 such that the name, face image, and telephone number of the sender are included in one screen image. If the display level is 2, the control module 170 may control the display 150 such that the name and telephone number of the sender are included in one screen image. If the display level is 1, the control module 170 may control the display 150 such that only the name of the caller is displayed in one screen image.

As another example, assume that the electronic device 101 displays a news article or message (SMS or MMS) on the screen.

If the display level is 3, the control module 170 can control the display 150 to display the details of the news article or the message in a single screen image. If the display level is 2, the control module 170 may control the display 150 to display the headline and abbreviated abbreviation of the news article or an abbreviation of the message in a single screen image. If the display level is 1, the display 150 may be controlled so that only the headline of the news article or a part of the front part of the message is displayed in a single screen image. In addition, a document summarization engine using natural language processing or statistical techniques may be installed in advance in the electronic device 101 for data processing as described above. According to another embodiment, the document engine may be included in an external device or server, and electronic device 101 may receive and display news articles or messages summarized by the document summarizing engine via communication interface 160 have.

As another example, the control module 170 of the electronic device 101 may determine the importance of each of the contents displayed through the display 150 according to the current status or the current status of the user on a level basis. In addition, the control module 170 may determine the contents to be displayed through the display 150 according to the importance. For example, as shown in FIG. 18 (a), the control module 170 may control the display 150 to display contents having an importance level of 1 immediately after the user starts running. The content having the importance level of 1 may be a detailed map including the user's running path, a user's calorie consumption amount, and an exercise amount, and the control module 170 may display the calorie consumption amount and the exercise amount on the detailed map 150 can be controlled. The control module 170 may control the display 150 to display contents having the importance level of 2 after a certain time has elapsed since the user started running as shown in Fig. 18 (b). As shown in FIG. 18 (b), the content having the importance level of 2 may be a map showing a user's running path, a running speed of the user, and a calorie consumption amount. The control module 170 may control the display 150 to display the user's running speed and calorie consumption together on the simple map. The control module 170 may control the display 150 to display contents having an importance level of 3 when a considerable time has passed since the user started running as shown in FIG. 18 (c). The content having the importance level 3 is the moving direction of the running user, and the control module 170 can control the display 150 to simply display the moving direction in the form of an arrow or text. Lt; / RTI > is an example of an electronic device according to various embodiments of the present invention. 19 shows a case where six screen images 1910, 1920, 1930, 1940, 1950, and 1960 are displayed through the display 150. Fig. The user is currently running in FIGURE 19 so that the control module 170 controls the display 150 such that each screen image 1910-1960 can include only one content and menu button 1905 .

19, the first screen image 1910 includes consumed calories 234kcal and a menu button 1905. The second screen image 1920 includes a moving distance (6.2km) and a menu button 1905 A third screen image 1530 includes a heart rate 120 and a menu button 1905 and a fourth screen image 1940 includes a moving speed 12.2 km / h and a menu button 1905 And the fifth screen image 1950 includes a type of exercise (running) and a menu button 1905. The sixth screen image 1960 includes a duration time (00:28:30) and a menu button 1905 can do.

According to one embodiment, the electronic device 101 may be configured to change from a first screen image 1910 to a second screen image 1920, for example, when a user input pushing from right to left with a selected point on the screen selected is input The third screen image 1930 to the fourth screen image 1940 from the second screen image 1920 to the third screen image 1930 and the fifth screen image 1950 from the fourth screen image 1940 to the third screen image 1930, The user can switch the screen image from the fifth screen image 1950 to the sixth screen image 1960 or from the sixth screen image 1960 to the first screen image 1910.

According to an embodiment, the electronic device 101 may display screen images for displaying respective contents displayed on the display 150 at predetermined time intervals. For example, the first screen image 1920 may be changed from the first screen image 1910 to the second screen image 1920, from the second screen image 1920 to the third screen image 1930, A fourth screen image 1940 to a fourth screen image 1940 to a fifth screen image 1950, a fifth screen image 1950 to a sixth screen image 1960, a sixth screen image 1960 to a sixth screen image 1960, It is possible to switch to the first screen image 1910, and the above switching operation can be repeated. Also, the electronic device 101 can receive input from the user as a user input, such as touch, tab, flick, swipe, voice input, and button presses pre-installed in the electronic device 101. [ The electronic device 101 may execute a desired mode according to the user input, display a desired screen image or switch the screen image.

According to one embodiment, the electronic device 101 may display a sixth screen image 1960 in the first screen image 1910, for example, when a user input pushing from left to right is selected while a point on the screen is selected, From the second screen image 1920 to the first screen image 1910, from the third screen image 1930 to the second screen image 1920, from the fourth screen image 1940 to the third screen image 1930 The screen image can be switched from the fifth screen image 1950 to the fourth screen image 1940 or from the sixth screen image 1960 to the fifth screen image 1650.

20A to 20C are views showing an example in which an electronic device 101 according to various embodiments of the present invention displays contents. 20A to 20C, it is assumed that the electronic device 101 is implemented as a wearable device of a wristwatch type. 20A to 20C are views showing cases where the user confirms the content output from the wearable device worn on the wearer's wrist when the wearer wears the electronic device 101 implemented with the wearable device of the wristwatch type.

20A shows a case where the user wears the electronic device 101 on the right hand 2001 and FIG. 20D shows a case where the electronic device 101 is worn on the left hand 2002. FIG. 20C shows a coordinate system 2015 when the user wears the electronic device 101 on the right hand 2001 and a line of sight incident on the screen of the electronic device 101. FIG.

Referring to FIG. 20A, the electronic device 101 may be worn on the user's right or left hand 2001 or 2002. FIG. When the electronic device 101 is worn on the user's right or left hand 2001, the direction W (opposite to the direction in which the user looks at the screen, that is, the direction opposite to the eye) W Referring to the coordinate system 2051, the direction Z of the screen, that is, the direction in which the screen faces is similar or similar.

The angle of the angle formed by the direction Z of the screen and the direction opposite to the line of sight W or the direction Z of the screen and the direction opposite to the line of sight is equal to or less than a predetermined reference angle If the direction Z of the screen is similar to the direction opposite to the line of sight W, the control module 170 controls the display 150 so that the content is output in the horizontal direction (left to right) as shown in FIG. 20A Can be controlled. According to the embodiment, when the angle of the angle formed by the direction Z of the screen and the direction opposite to the visual line W exceeds the predetermined reference angle, that is, the direction Z of the screen and the direction W opposite to the visual line are similar The control module 170 may control the display 150 to not display the content on the screen. According to one embodiment, when the direction Z of the screen is not similar to the direction of the line of sight W, the control module 170 turns off the screen or switches the electronic device 101 to a low- Or may control the display 150 to output other contents such as a clock, a screen saver, weather information, a lock screen image or the like to the screen.

According to one embodiment, when the direction Z of the screen is similar to the direction opposite to the line of sight W, the control module 170 determines whether the content on the screen through the display 150, based on the security level of the content, It is possible to judge whether or not to output it. For example, it is assumed that the user wearing the electronic device 101 is in a situation where it is not easy to confirm the contents. When the security level of the content is high, for example, if the content is personal information, health information, sender information of an incoming call, etc., the control module 170 displays the content on the display 150, Can be controlled. On the other hand, when the security level of the content is low, for example, when the content is weather or time, the control module 170 may control the display 150 to display the content. According to one embodiment, in the case of content having a low security level, the content may be output to the screen through the display 150 at any time regardless of the current state of the user.

As mentioned above, the content may have a security level divided into two or more stages. According to one embodiment, the security level for each of the contents may be predetermined, and the security level of each of the contents by the control module 170 may be determined.

According to one embodiment, the control module 170 controls the display 150 to output only content whose security level is above a certain level or below a certain level, when the direction Z of the screen is similar to the direction opposite to the line of sight W ).

20A, the control module 170 determines whether the screen of the electronic device 101 has a horizontally elongated shape with respect to the x-axis and the y-axis of the coordinate system 2051 shown in Fig. 20 (a) . In addition, the contents output through the screen of (a) and (c) of FIG. 20a may be displayed in a form having a long width or a long width. 20A, the y-axis of the coordinate system 2051 corresponds to two long sides of the screen on the screen surface (for example, a center point of the screen surface) of the electronic device 101, , And the x axis is the direction of the line segment perpendicular to the y axis at the screen surface (e.g., the center point of the screen surface). The control module 170 may determine the direction Z of the screen (e.g., the direction of the screen, the norm vector on the screen surface) using the point where the x and y axes meet. At this time, the control module 170 can determine that the direction (W) of the user's gaze direction is closer to the y-axis than the x-axis. For example, the control module 170 determines whether the y-axis direction of the electronic device 101 is similar to the gravitational or gravitational direction of the opposite direction, or a user who wears the electronic device 101 based on the movement of the user's arm or wrist It can be determined that the current pose of the screen is a pose having a longer side of the screen. Accordingly, the control module 170 can control the display 150 such that the content is output in the form of a horizontally long shape.

20B shows a case where the user wears the electronic device 101 on the right hand 2001 and FIG. 20C shows a case where the electronic device 101 is worn on the left hand 2002. FIG. 20B shows a coordinate system 2015 when the user wears the electronic device 101 on the right hand 2001 and a sight 2012 that is incident on the screen of the electronic device 101. [

Referring to FIG. 20B, the screen of the electronic device 101 is vertically long with respect to the x-axis and the y-axis of the coordinate system 2052 to the user. In addition, the contents output through the screen of (a) and (c) of FIG. 20a may be displayed in a form having a long form or a form arranged in a long form. If the direction Z of the screen coincides with or is similar to the direction of the line of sight as described above, the control module 170 determines whether the content is in a horizontal direction (e.g., To " right " direction or " right to left " direction). That is, the control module 170 may control the display 150 to adjust the layout so that the content is aligned with a longitudinally long screen so that the contents are arranged in a row-wise manner. According to another embodiment, the control module 170 may control the display 150 such that the content is output in the vertical direction, i.e., from top to bottom. For example, letters may be arranged vertically (aligned in columns) and output as in ancient Chinese textbooks.

According to one embodiment, the direction in which the content is placed on the screen (e.g., the horizontal direction, the vertical direction, the 'left-right direction', the 'up-down' direction) may be determined according to user input. The user input may be, for example, a user operation such as selection of a menu, selection of a button, or selection of an icon. The control module 170 controls the display 150 so that the content is output according to the arrangement manner according to the user input. can do. According to one embodiment, the arrangement manner of the contents may be changed according to the user input. For example, the user inputs what is the hand wearing the electronic device 101 in the electronic device 101, thereby allowing the control module 170 to adjust the content arrangement manner. If the screen on which the content is displayed is a square or a rectangle, if the user determines the hand wearing the electronic device 101, the control module 170 determines which side of the four sides of the screen is used as a reference for outputting the content Can be specified. Thus, the arrangement manner of the contents can be determined.

According to one embodiment, one or more sensors pre-installed in the electronic device 101 are capable of sensing a pose of the electronic device 101, specifically a screen, and generating pose information (hereinafter, screen pose information) accordingly have. For example, the electronic device 101 may be pitch, yaw or roll, and one or more sensors previously provided in the electronic device 101 may sense the pose . At this time, the screen included in the electronic device 101 may also be pitch, or may be yawed or rolled to one side. The screen pose information indicates information indicating a pose currently taken by the screen. The control module 170 may determine whether to output the content or change the arrangement manner of the content based on the screen pose information. For example, the control module 170 can determine the direction Z of the screen based on the sensing data measured by the acceleration sensor or the gyro sensor provided in the electronic device 101. [ In addition, the control module 170 may display the content in a landscape mode (horizontal mode) or display the content in a portrait mode (vertical mode) according to the direction Z of the screen You can decide how to arrange it.

According to one embodiment, the one or more sensors may detect motion of the electronic device 101 and generate motion information (hereinafter referred to as device motion information). For example, the electronic device 101 may be tilted or rotated, and the one or more sensors may sense movement of the electronic device 101. The device motion information indicates information on various motions generated in the electronic device 101. The control module 170 can determine whether to output the content or change the arrangement manner of the content based on the device motion information.

According to one embodiment, the control module 170 controls the angle at which the user's eye forms with the screen of the display 150 (e.g., the direction of the line of sight toward the screen -W and the direction of orientation Z of the screen) Angle or the like) of the content or the layout of the content.

According to one embodiment, the user's gaze direction W may be determined based on a separate sensor (e.g., a camera, IR camera, or gaze tracking device) embedded in the electronic device 101. For example, the electronic device 101 is equipped with a camera device (not shown) facing the same direction as the screen, and analyzes the area including the face area or the eyes in the image input through the camera, It is possible to determine whether or not the face of the user is facing the screen. For example, the control module 170 may extract the user's eye area, face area, or pupil area from the image of the user's face or the eye. The control module 170 can determine the direction opposite to the user's gaze direction based on at least one of the eye region, the face region, and the pupil region. At this time, the control module 170 may determine the opposite direction W of the user's eyes based on the shape or area of each of the eye region, the face region, and the pupil region.

According to one embodiment, pose information (hereinafter referred to as face pose information) of the user's face can be confirmed based on the face image or the eye image. For example, the control module 170 can know the layout of each of the components constituting the face of the user's eyes, nose, mouth, and the like through the face image. Through the eye image, You can see the shape of each eye. The control module 170 may sense one or more of the facial pose information based on the information, for example, the orientation of the face or the pupil of the user.

According to one embodiment, the control module 170 may determine the device pose information or the screen pose information based on the facial pose information, and may determine the content to be displayed on the screen based on the device pose information or the screen pose information May be determined. That is, the control module 170 may determine the orientation or device pose information of the camera module pre-installed in the electronic device 101 using the face pose information. Also, the control module 170 may determine the screen pose information or the orientation of the camera module using the face pose information.

According to one embodiment, the direction opposite to the user's line of sight W may include information indicating the motion or pose (e.g., pitch, yaw, roll) of the electronic device 101 such as device pose information, Information, and the like. Information indicating the motion or pose of the electronic device 101 may also be sensed or determined using one or more of an acceleration sensor, a gyro sensor, and a geomagnetic sensor.

20A and 20B correspond to an example in which the user looks down on the wrist wearing the electronic device 101 from above. 20A and 20B, the direction Z of the screen of the electronic device 101 is directed in the direction opposite to the surface of the earth or in the direction similar to the direction opposite to the surface of the earth. The electronic device 101 uses at least one of the sensors described above to determine information indicating the motion or pose of the electronic device 101. [ Subsequently, the electronic device 101 can determine the direction in which the screen is oriented, i.e., the direction Z of the screen, based on the information indicating the movement or pose of the electronic device 101. [ The electronic device 101 then causes the content to be output to the screen through the display 150 if the direction Z of the screen is within a predetermined reference angle (e.g., 45 degrees) from the opposite direction (not shown) Can be controlled.

According to another embodiment, it can be predicted that the user will not be able to identify the screen if the direction Z of the screen is facing the ground surface. If the angle between the direction Z of the screen and the direction of the ground surface (not shown) is within a predetermined reference angle (for example, 45 degrees), the control module 170 of the electronic device 101 determines It can be controlled not to be output to the screen of the display 150.

According to one embodiment, motion or pose of the screen may be sensed using one or more sensors to determine the placement direction of the content displayed on the screen. For example, the control module 170 may display a content in a horizontal mode (horizontal mode) or a portrait mode (vertical mode) The display 150 may be controlled so that the display 150 is displayed.

20C shows a case where the user wears the electronic device 101 on the right hand 2001 and FIG. 20C shows a case where the electronic device 101 is worn on the left hand 2002. FIG. 20B shows a coordinate system 2015 when the user wears the electronic device 101 on the right hand 2001 and a sight 2012 that is incident on the screen of the electronic device 101. FIG.

Referring to FIG. 20C, the electronic device 101 is worn on the user's right or left hand 2001 or 2002. When the electronic device 101 is worn by the user's right hand 2001 or the left hand 2002, the direction (direction opposite to the visual line) W toward the user's eye is referred to as the coordinate system 2053, (Z) of the screen included in the display 150, i.e., the direction in which the display 150 is oriented, or are opposite to each other. For example, depending on the state in which the user wears the electronic device 101, the direction Z in the screen shown in Fig. 20C may not be similar to the opposite direction W, or may be opposite to each other.

The angle of the angle formed by the direction Z of the screen and the direction opposite to the visual line W is opposite to each other or the direction Z of the screen and the direction opposite to the visual line W is equal to or larger than a predetermined reference angle The control module 170 may control the display 150 such that the content is not output to the screen if the direction Z of the screen is not similar to the direction opposite to the line of sight W. [ If the direction Z of the screen and the direction opposite to the line of sight W are not the same or opposite to each other, it may mean that the direction of the user's gaze coincides with or is similar to the direction Z of the screen. Therefore, even if the content is output to the screen, the user can not confirm the content. In such a case, the control module 170 may prevent power waste that may be caused by turning on the screen by turning off the screen or turning off the display 150 to display the content on the screen.

According to one embodiment, the control module 170 controls the orientation of the screen of the electronic device 101 worn by the user moving based on the sensing data acquired from, for example, the acceleration sensor or the gyro sensor, Z ). ≪ / RTI > Table 1 below shows the parameters that the control module 170 can use to determine the orientation (Z) of the screen. The parameters may be stored in memory 130.

Table 1 below assumes that the electronic device 101 is a wearable device implemented as a bracelet type or a wristwatch type that can be worn on the user's wrist. When the electronic device 101 is implemented with the wearable device as described above, the control module 170 refers to Table 1 below to determine whether or not the body 101 of the user wearing the electronic device 101 (for example, A wrist, a portion adjacent to the hand, a position adjacent to the palm, etc.) and the direction Z of the screen.

According to one embodiment, the user can move while wearing the electronic device 101, after wearing the electronic device 101 for the first time. Particularly, when the user rotates or tilts the wrist part, the electronic device 101 senses the direction of the movement of the user smoothly, so that the body part of the user, on which the electronic device 101 is mounted, It can be judged.

For example, it is assumed that the electronic device 101 is mounted at a position adjacent to the back of the hand of the left-handed wrist as shown in Fig. 20B. At this time, it is assumed that the direction (Z) of the screen on which the content is displayed is the opposite direction of the surface of the earth. When the user moves or moves so that the palm is upward, that is, when the direction Z of the screen of the electronic device 101 is directed toward the surface of the ground, the user rotates the left- It can be easily tilted in the direction of the arrow. However, it is not easy for the user to move or move the directional Z of the screen of the electronic device 101 toward the ground surface by tilting the left wrist with the electronic device 101 in the clockwise direction, It is also relatively limited. The electronic device 101 can detect the position or position on the body of the electronic device 101 on which the electronic device 101 is mounted by sensing the direction of smooth motion after the user mounts the electronic device 101, You can also identify candidates.

If the user does not know which hand the electronic device 101 is mounted on, the control module 170 can determine two mounting position candidates of the electronic device 101 in accordance with the movement of the wrist. According to another embodiment, as in Table 1, the control module 170 may be configured to have a tendency to direct a person in the opposite direction of the surface of the hand (e.g., The orientation of the electronic device 101 may be determined based on the orientation of the electronic device 101. [

The main direction (Z) of the screen of the electronic device Direction of rotation of electronic devices smoothly during wrist tilt exercise The direction (Z) of the screen after wrist tilt movement Smooth rotation direction when the wrist is tilted and then tilted Mounting position of the discriminated electronic device Opposite surface Counterclockwise
(The clockwise direction is relatively limited) Surface direction Clockwise
(Counterclockwise is relatively limited) Location of the hand on the left hand wrist Opposite surface Clockwise
(Counterclockwise is relatively limited) Surface direction Counterclockwise
(The clockwise direction is relatively limited) Adjacent to the back of the hand of the right hand Surface direction Counterclockwise
(The clockwise direction is relatively limited) Opposite surface Clockwise
(Counterclockwise is relatively limited) Position of the palm of the left wrist Surface direction Clockwise
(Counterclockwise is relatively limited) Opposite surface Counterclockwise
(The clockwise direction is relatively limited) Adjacent position of palm of right hand

20D is a view showing a user's right arm on which the electronic device 101 is worn from above. Referring to Table 1 and FIG. 20D, when the right hand of a user wearing the electronic device 101 implemented as a wearable device faces upward (a state in which the screen of the electronic device 101 faces the surface opposite to the ground surface) The user can rotate the wrist clockwise to rotate the user's palm so that the user's palm is visible, i.e., when the user is supine and the direction Z of the screen of the electronic device 101 is directed toward the ground surface .

Thereafter, when the user rotates the user's hand so that the user's right hand is pointed upward (i.e., the screen is facing the ground surface), that is, the user's pronation is pronounced so that the screen of the electronic device 101 You can rotate your wrist counterclockwise to point in the opposite direction of the earth's surface.

One or more sensors included in the sensor module 180 of the electronic device 101, for example, an acceleration sensor or a gyro sensor, may be used to detect the position of the electronic device 101 such that the user moves the wrist together, The tilt or acceleration of the device 101 can be obtained. The control module 170 controls the electronic device 101 such that the electronic device 101 is attached to the user's body using the main direction Z of the screen as described above and the direction of the rotational motion in the electronic device 101 generated by the user's movement Or not. The control module 170 can also determine the position where the electronic device 101 is mounted using the direction Z of the screen and the directionality of the rotational motion in the electronic device 101. [

FIGS. 21A and 21B are diagrams illustrating an example of an electronic device according to various embodiments of the present invention displaying content on a screen via a display 150. FIG. In particular, FIGS. 21A and 21B are views showing contents that a user wearing the electronic device 101 implemented in the form of a wearable device can receive from the electronic device 101. FIG.

21A, the direction Z of the screen included in the display 150 of the electronic device 101 and the direction opposite to the user's gaze direction do not coincide with each other. The angle between the direction opposite to the user's gaze direction W and the direction Z of the screen 2150 is A °. That is, the screen 2150 of the electronic device 100 is rotated in the counterclockwise direction by an angle of? Referring to FIG. 21A, the direction opposite to the line of sight W is directed toward the left side of the screen 2150. It can be seen that the user's line of sight is deflected to the left side of the screen 2150. When the user's gaze is deflected to a part of the screen 2150 as described above, the control module 170 can control the display 150 such that the content is displayed in a deflected direction toward the gaze direction. 21A, since the user's line of sight is biased to the left, the control module 170 may control the display 150 such that the content is displayed biased to the left of the screen 2150. [ The content displayed on the screen 2150 via the display 150 in FIGS. 21A and 21B is '7:06' as the current time. 21A, if the user's line of sight is from the left side of the electronic device 101 to the screen 2150 of the electronic device 101, then the control module 170 will leave the right side of the screen 2150 empty, The display 150 may be controlled to display '7:06'.

21B, the direction Z of the screen 2150 of the electronic device 101 and the direction opposite to the user's visual line W do not coincide with each other. The angle between the direction opposite to the user's gaze direction W and the direction Z of the screen 2150 is B °. That is, the screen 2150 of the electronic device 100 is rotated clockwise by B ° with respect to the direction opposite to the visual line W. [ Referring to Fig. 21B, the direction opposite to the line of sight W is directed to the right side of the screen 2150. Fig. It can be seen that the user's line of sight is deflected to the right side of the screen 2150. When the user's gaze is deflected to a part of the screen 2150 as described above, the control module 170 can control the display 150 such that the content is displayed in a deflected direction toward the gaze direction. 21B, since the user's line of sight is biased to the right, the control module 170 may control the display 150 such that the content is displayed biased to the right of the screen 2150. [ The content displayed on the screen 2150 via the display 150 in FIGS. 21A and 21B is '7:06' as the current time. 21A, if the user's gaze is from the right side of the electronic device 101 to the screen 2150 of the electronic device 101, then the control module 170 will leave the left side of the screen 2150 empty, The display 150 may be controlled to display '7:06'.

According to one embodiment, the display 150 may display the UI displayed on the screen in the horizontal direction or in the vertical direction under the control of the control module 170. [ Hereinafter, the UI displayed in the horizontal direction will be referred to as a horizontal UI, and the UI displayed in the vertical direction will be referred to as a vertical UI. The display 150 can switch the UI displayed on the screen under the control of the control module 170 from the horizontal UI to the vertical UI or from the vertical UI to the horizontal UI.

The transitions between the horizontal UI and the vertical UI can be predicted using a user profile or the like stored in advance in the electronic device 101, such as the range of motion of the user's body stored in advance. After the user mounts the electronic device 101, the control module 170 can determine the UI displayed on the screen by comparing the user's profile stored in advance with the range of motion of the user's current physical activity have. At this time, the control module 170 may determine whether to display the horizontal UI or the vertical UI on the screen.

According to another embodiment, the electronic device 101 may determine the UI displayed on the screen in accordance with the user input. At this time, the control module 170 may determine whether to display the horizontal UI or the vertical UI on the screen according to the user input. The user input may include an input for selecting a virtual button, an input for selecting an icon, or a physical button input such as a hard key.

According to one embodiment, the control module 170 can detect a motion input (e.g., a motion input, a gesture input, etc.) input through the electronic device 101 using a motion sensor. The control module 170 may compare the motion input sensed by the motion sensor with the motion data previously stored in the memory 130 and change the UI even if the similarity is equal to or greater than the reference value. At this time, the control module 170 may control the display 150 to change the horizontal UI to the vertical UI or to change the vertical UI to the horizontal UI.

For example, a user wearing the electronic device 101 implemented as a wearable device can change the direction of the UI displayed on the screen by tilting the wrist or head, or shaking the wrist. For example, the user can make a gesture having a predetermined angle, a specific direction or a specific speed, and the electronic device 101 can perform motion recognition for the gesture. The control module 170 may change the direction of the UI displayed on the screen according to the motion recognition result. As another example, the user can change the direction of the UI by wearing the electronic device 101 in his / her arm and greatly drawing a circle with his / her arm, or after mounting the electronic device 101 on the wrist or finger and then tilting the hand .

According to one embodiment, the control module 170 may switch the horizontal UI to the vertical UI or the vertical UI to the horizontal UI based on the user's motion state and type. That is, the display 150 may automatically convert the UI according to the movement state or the type of the user and display the UI on the screen. The control module 170 may determine at least one of the user's motion state or type using at least one of the sensors included in the electronic device 101, for example, one or more of a motion sensor, a position sensor, and a biometric sensor.

For example, in a general situation in which no exercise is performed, a horizontal UI, a horizontal UI in the case of a bicycle exercise, and a vertical UI in a running exercise can be provided to the user. That is, if the signal intensity below the predetermined reference is detected through the acceleration sensor or the heart rate is below the predetermined reference, the control module 170 can determine that the user is not exercising. If the movement of the user is detected by the acceleration sensor and the signal pattern measured by the acceleration sensor is more similar to the running state than the predetermined reference, the control module 170 can determine that the user is running.

As another example, if the signal pattern of the acceleration sensor provided on the electronic device 101 mounted on the wrist is not in a running state but the user moves left and right, and the movement distance of the user measured by the GPS sensor is a predetermined distance or more , The control module 170 can determine the state of the user as the bicycle riding state. In other words, the state information such as the position and the moving speed is sensed by the acceleration sensor or the gyro sensor, and the control module 170 uses the data outputted from the sensors to decide whether to display the horizontal UI or the vertical UI on the screen . Also, using the data output from the sensors, the control module 170 may control the display 150 to change the horizontal UI to the vertical UI or to change the vertical UI to the horizontal UI.

As an example, there may be users who want UI in different directions within a company, a house, a frequent café, a bus, or a subway. When the moving speed measured by the GPS sensor or the position sensor included in the electronic device 101 is equal to or higher than a predetermined reference value or the user is determined to be on the road, the control module 170 determines that the user It can be determined that the vehicle is moving. Also, the control module 170 can determine whether the user operates the vehicle by using an acceleration sensor or a gyro sensor.

According to one embodiment, the electronic device 101 can determine whether the user is indoors or outdoors by measuring and receiving sound around the user with an audio device such as a mic. For example, if the ambient noise is loud, users are likely to be in a complex place, such as an outside location, or using public transportation. When the control module 170 determines that it is a bus or a subway under such a determination condition, the control module 170 may display a small font or a small image size when executing an application such as a message, a personal schedule, or a diary. This allows the electronic device 101 to reduce the privacy exposure of the user and protect the user's privacy. If it is determined that the user is driving, alone in a quiet home, or indoors, the control module 170 may control the display 150 to display a large size of letters or images . The control module 170 analyzes the position information of the electronic device 101 to determine whether the position where the electronic device 101 is located, i.e., the position of the user, is indoors or outdoors, and displays a horizontal UI Or to control the display 150 to display the vertical UI.

According to another embodiment, when the user places importance on readability or the like, the control module 170 increases the font of the character or enlarges the font when the user executes an application such as a message, a personal calendar, or a diary, It is possible to display a larger size.

The control module 170 may use a brightness sensor, a temperature sensor, or a pressure sensor included in the electronic device 101 to determine which space is located. That is, the control module 170 can determine the space where the user is located by using the data output through the illuminance sensor, the temperature sensor, or the pressure sensor. Also, the control module 170 may control the operation of the electronic device 101 according to the space where the user is located. For example, when the illuminance is high, the control module 170 may determine that outdoor sunlight is reflected, and the control module 170 may additionally adjust the screen brightness of the electronic device 101. [

22 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.

22A shows an electronic device 101 executing a horizontal writing mode. The electronic device 101 includes a screen of a display 150 in which contents are input in a horizontal direction (left-right direction) from a user Fig. 2 is a view showing the electronic device 101. Fig. In FIG. 22 (a), the content input from the user through the screen of the display 150 is' an urgent meeting scheduled at 10:00 today. Need to attend '. According to one embodiment, the electronic device 101 may support horizontal writing in the horizontal writing mode, and may receive characters from the user in a horizontal direction.

22A shows an electronic device 101 executing a vertical writing mode. The electronic device 101 includes a display 150 in which contents are input in a vertical direction (from top to bottom) Fig. The content input from the user through the display 150 in FIG. 22 (b) is also scheduled for an emergency meeting at 10:00, which is being input from the display 150 of FIG. Need to attend '. According to one embodiment, the electronic device 101 may support vertical writing in the vertical writing mode, and may receive characters in the vertical direction.

As described above, the electronic device 101 can output content in the horizontal direction or the vertical direction of the display 150 as well as receive input from the user. According to an embodiment, the electronic device 101 may receive content (e.g., text, images, etc.) from a user via a virtual keypad, handwriting recognition, or the like. The horizontal writing mode as shown in FIG. 22 (a) and the vertical writing mode as shown in FIG. 22 (b) can be performed in parallel. For example, the top of the display 150 may be displayed or entered in the content in the landscape mode. The lower end of the display 150 may display or enter content in vertical writing mode.

22C shows an electronic apparatus 101 in which contents are output in the horizontal direction and in the vertical direction through the display 150. Fig. Referring to (c) of FIG. 22, a part of the display 150 of the electronic device 101 is executing the horizontal writing mode, and the remaining part is executing the vertical writing mode. The first content 2201, the second content 2202 and the fourth content 2204 of the contents 2201, 2202, 2203 and 2204 displayed on the display 150 are horizontally → right). The third content 2203 is output in the vertical direction (from top to bottom) according to the vertical writing mode. As shown in (c) of FIG. 22, the horizontal writing mode and the vertical writing mode can be concurrently performed on one screen, which can be applied not only to output of contents but also to input of contents.

According to one embodiment, when a screen image including various contents such as a web browser screen is provided to a user, a search engine name (for example, NAVER) among the layouts constituting the screen image and a horizontal The contents can be arranged in the form of a horizontal writing or a vertical writing depending on the shape of the area. According to one embodiment, the control module 170 may recognize the portrait mode or the landscape mode using the tilt information for the screen included in the display 150. The control module 170 selects a writing mode capable of displaying more information, such as horizontal writing and vertical writing, using the tilt information, or determines the shape of the areas constituting the layout of the screen image, The display 150 may be controlled such that the content is arranged horizontally in the corresponding area and the display 150 may be controlled such that the content is arranged vertically in the corresponding area if the content is long.

23 is a diagram showing another example in which an electronic device according to various embodiments of the present invention displays contents.

Referring to FIG. 23, the electronic device 101 may display content in a color requiring a lower power consumption or in a color similar to the color. According to an embodiment, the electronic device 101 may display an edit window 2302 for receiving content from a user or an edit window 2302 for editing content.

According to one embodiment, the control module 170 can adjust the font or color so as to save current according to the remaining amount of the battery and the charged state. When the electronic device 101 is implemented as a wearable device or a mobile device, the capacity of the battery may be limited due to the characteristics of the device. Therefore, the control module 170 can control the operation of the electronic device 101 so that the power consumed by various operations of the electronic device 101 can be reduced as much as possible.

For example, when the remaining battery power of the electronic device 101 falls below 30%, the control module 170 controls the display image so that the display 150 including the screen can be driven with only a small amount of power to minimize the amount of power consumed. Can be configured. For example, the control module 170 can configure a screen image with a color that can be implemented with less power or a color close to the color. As an example, if the screen is an LCD, the control module 170 may configure the background color of the screen image with a black color. As an example, when the screen is an OLED, the control module 170 controls some OLEDs to output a background color of red color, and controls the color and size of the rest of the background, for example, It can be transformed into a form that can be easily recognized by the user. In addition, when only a part of the screen can be lighted up like the OLED, the control module 170 can control the display 150 to light only a part of the screen in consideration of the characteristics of the OLED. For example, the control module 170 may control the display 150 to light off the area of the screen on which the content is displayed, which is outside the user's viewing angle.

According to one embodiment, the control module 170 may control the display 150, which includes a screen for displaying content according to the type of exercise. For example, an operation of determining whether or not the screen is in a position conspicuous to the user during the movement can be made easier by discriminating what kind of the motion is. For example, in the case of swimming, the control module 170 can determine the motion of the user as swimming if it is determined that the unique motion pattern according to the above-mentioned method is generated. As another example, in the case of outdoor running, the control module 170 may determine that the corresponding motion is running through the movement distance and the motion information of the arm.

According to one embodiment, the electronic device 101 may receive a type of exercise from a user in advance. The user may enter the type of motion in the electronic device 101 before starting the motion.

The control module 170 can obtain a pattern inherent to the motion through the information indicating the motion, that is, the motion information. In addition, the control module 170 can use the information of the user's body movement range to find the position and orientation information of the electronic device 101 mounted. The control module 170 can obtain the user's gaze direction or gaze position information based on the position or direction information of the electronic device 101. [ The control module 170 may also recognize or estimate the user's gaze direction or gaze position information together with the position and orientation information of the electronic device 101. [ The control module 170 controls the display 150 to display information suitable for the situation, that is, the content, based on the user's gaze direction, gaze position information, and the position and direction information of the electronic device 101, It can be light off.

In particular, when the electronic device 101 automatically recognizes the type of the user's movement, the control module 170 controls the electronic device 101 to provide necessary information to the user using the pose of the user, The device 101 can be controlled. For example, the electronic device 101 may provide only the necessary information (e.g., coaching information, pose correction, etc.) at a point in time required by the user. On the other hand, if it is determined that the point in time is not necessary for the user, the electronic device 101 can reduce power consumption or display only general information by not displaying additional information.

24 is a diagram illustrating an example in which a plurality of electronic devices according to various embodiments of the present invention display contents. The electronic device 101 is a host device and the electronic device 104 is implemented as a companion device so that the electronic device 101 and the electronic device 104 can interlock with each other. It is assumed in Fig. 24 that the electronic device 101, which is a host device, controls the electronic device 104, which is a companion device.

Referring to Fig. 24, the electronic device 104, which is a companion device, is worn on the wrist of the user 2401 and is executing the exercise mode under the control of the electronic device 101. [ The electronic device 101 can be configured so that the sensor module (not shown) of the electronic device 104 is connected to the user 2401 via the wrist of the user 2401, (Blood pressure, blood flow, heart rate, body temperature, respiration rate, oxygen saturation, cardiopulmonary function, blood sugar, etc.) of the electronic device 2401 or the moving speed, moving acceleration, moving direction or tilt of the electronic device 104. The electronic device 101 may determine the current state of the user 2401 or the orientation of the display of the electronic device 104 based on the sensor values measured through the sensor module of the electronic device 104. [ The electronic device 101 may determine the content to display on the display in accordance with the current state of the user 2401 or the orientation of the display of the electronic device 104. [ The electronic device 101 may also send content to be displayed on the display of the electronic device 104 to the electronic device 104 and the electronic device 104 may display the content received from the electronic device 101 have.

The electronic device 101 senses that the user 2401 is in motion through the sensor values measured by the sensor module of the electronic device 104 and converts the electronic device 101 or the electronic device 104 into a motion mode . When the exercise mode is executed, the electronic device 101 or the electronic device 104 can display the contents according to the exercise mode on the display 190. [

The electronic device 101 in Fig. 24 assumes that the user 2401 is determined to be in motion based on the sensor value measured through the sensor module of the electronic device 101. Fig. In Fig. 24, the control module 170 of the electronic device 101 has switched all of the operation modes of the electronic device 101 and the electronic device 104 to the exercise mode. Accordingly, the type of exercise (running), calories consumed (234 Kcal), moving distance (6.2 km), pulse rate 95 and exercise time (00:28:30) are displayed on the display of the electronic device 104. Also, the contents according to the exercise mode can be displayed on the electronic device 101, which is a host device interlocked with the electronic device 104. [ In addition, on the display 190 of the electronic device 101, an operation mode (motion mode), consumed calories (234 Kcal), a moving distance (6.2 km), a heart rate 95, 30) are displayed.

At this time, the content displayed on the display of the electronic device 104 may be the content transmitted from the electronic device 101. [ The electronic device 104 can continuously measure the bio-signal of the user 2401 using the sensor module under the control of the electronic device 101 and transmit the sensor value measured by the sensor module to the electronic device 101. [ .

25 is a block diagram 2500 of an electronic device 2501 in accordance with various embodiments.

The electronic device 2501 may constitute all or part of the electronic device 101 or the electronic device 104 shown in Fig. 1, for example. 25, the electronic device 2501 includes at least one application processor (AP) 2510, a communication module 1220, a SIM (subscriber identification module) card 2524, a memory 2530, Module 2540, an input device 2550, a display 2560, an interface 2570, an audio module 2580, a camera module 2591, a power management module 2595, a battery 2596, an indicator 2597, And a motor 2598.

The AP 2510 may control a plurality of hardware or software components connected to the AP 2510 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. The AP 2510 may be implemented as a system on chip (SoC), for example. According to one embodiment, the AP 2510 may further include a graphics processing unit (GPU) (not shown).

The communication interface 2560 may communicate with the electronic device 2501 (e.g., the electronic device 101) and other electronic devices (e.g., The communication module 2520 may be a cellular module 2521, a Wifi module 2523, a BT module (e. G., An electronic device 104 or a server 106) 2525, a GPS module 2527, an NFC module 2528, and a radio frequency (RF) module 2529.

The cellular module 2521 may provide voice, video, text, or Internet services over a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM). The cellular module 2521 may also perform identification and authentication of electronic devices within the communication network, for example, using a subscriber identity module (e.g., SIM card 2524). According to one embodiment, the cellular module 2521 may perform at least some of the functions that the AP 2510 can provide. For example, the cellular module 2521 may perform at least a portion of the multimedia control function.

According to one embodiment, the cellular module 2521 may include a communication processor (CP). The cellular module 2521 may be implemented as an SoC, for example. 25, components such as the cellular module 2521 (e.g., a communication processor), the memory 2530, or the power management module 2595 are shown as separate components from the AP 2510 According to one embodiment, the AP 2510 may be implemented to include at least a portion of the aforementioned components (e.g., a cellular module 2521).

According to one embodiment, the AP 2510 or the cellular module 2521 (e.g., a communications processor) may send commands or data received from at least one of non-volatile memory or other components coupled to each to a volatile memory Can be loaded and processed. The AP 2510 or the cellular module 2521 may also store data generated by at least one of the other components or received from at least one of the other components in the non-volatile memory.

Each of the WIFI module 2523, the BT module 2525, the GPS module 2527 or the NFC module 2528 includes a processor for processing data transmitted and received through a corresponding module . Although the cellular module 2521, the WIFI module 2523, the BT module 2525, the GPS module 2527 or the NFC module 2528 are shown as separate blocks in FIG. 25, according to one embodiment, At least some (e.g., two or more) of the WIFI module 2523, the BT module 2525, the GPS module 2527, or the NFC module 2528 may be integrated into one integrated chip (IC) . For example, at least some of the processors corresponding to the cellular module 2521, the WIFI module 2523, the BT module 2525, the GPS module 2527, or the NFC module 2528, respectively (e.g., 2521) and a WIFI processor corresponding to the WIFI module 2523) may be implemented in one SoC.

The RF module 2529 can transmit and receive data, for example, transmit and receive RF signals. The RF module 2529 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA). The RF module 2529 may further include a component for transmitting and receiving electromagnetic waves in free space in a wireless communication, for example, a conductor or a lead wire. 25, the cellular module 2521, the WIFI module 2523, the BT module 2525, the GPS module 2527, and the NFC module 2528 are shown to share one RF module 2529, At least one of the cellular module 2521, the WIFI module 2523, the BT module 2525, the GPS module 2527 or the NFC module 2528 transmits and receives an RF signal through a separate RF module can do.

According to one embodiment, the electronic device 2501 may be coupled to a companion device (e.g., electronic device 104) via a WIFI module 2523, a BT module 2525, or an NFC module 2528. Electronic device 2501 may also be connected to a base station (e.g., server 106) via cellular module 2521 and may be coupled to a host device (e. G., Electronic device 101) have.

The SIM card 2524 may be a card including a subscriber identity module and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 2524 may include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 2530 (e.g., the memory 2530) may include an internal memory 2532 or an external memory 2534. The built-in memory 2532 may be a volatile memory such as a dynamic RAM (DRAM), a static random access memory (SRAM), a synchronous dynamic RAM (SDRAM), or a non-volatile memory Such as one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, And may include at least one.

According to one embodiment, the internal memory 2532 may be a solid state drive (SSD). The external memory 2534 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital A Memory Stick, and the like. The external memory 2534 may be functionally connected to the electronic device 2501 through various interfaces. According to one embodiment, the electronic device 2501 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 2540 may measure a physical quantity or sense an operating state of the electronic device 2501, and convert the measured or sensed information into an electrical signal. The sensor module 2540 includes a gesture sensor 2540A, a gyro sensor 2540B, an air pressure sensor 2540C, a magnetic sensor 2540D, an acceleration sensor 2540E, a grip sensor 2540F, A light sensor 2540G and a color sensor 2540H (for example, an RGB (red, green and blue) sensor), a living body sensor 2540I, a temperature / humidity sensor 2540J, And a sensor 2540M. Additionally or alternatively, the sensor module 2540 may include, for example, an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (not shown) (Not shown), an iris sensor (not shown), a fingerprint sensor (not shown), and the like. The sensor module 2540 may include a heart rate variability (HRV) sensor or a heart rate monitor (HRM) sensor. The sensor module 2540 may further include a control circuit for controlling at least one sensor included in the sensor module 2540.

The input device 2550 includes a touch panel 2552, a (digital) pen sensor 2554, a key 2556 or an ultrasonic input device 2558 . The touch panel 2552 can recognize the touch input in at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type, for example. In addition, the touch panel 2552 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 2552 may further include a tactile layer. In this case, the touch panel 2552 may provide a tactile response to the user.

The (digital) pen sensor 2554 may be implemented using the same or similar method as receiving the touch input of the user, or using a separate recognizing sheet, for example. The key 2556 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 2558 is an apparatus that can sense data by sensing a sound wave from the electronic device 2501 to a microphone (for example, a microphone 2588) through an input tool for generating an ultrasonic signal , And wireless recognition is possible. According to one embodiment, the electronic device 2501 may use the communication module 2520 to receive user input from an external device (e.g., a computer or a server) connected thereto.

The display 2560 (e.g., the display 2560) may include a panel 2562, a hologram device 2564, or a projector 2566. The panel 2562 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 2562 can be embodied, for example, flexible, transparent or wearable. The panel 2562 may be composed of one module with the touch panel 2552. [ The hologram device 2564 can display stereoscopic images in the air using interference of light. The projector 2566 can display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the electronic device 2501. According to one embodiment, the display 2560 may further include control circuitry for controlling the panel 2562, the hologram device 2564, or the projector 2666.

The interface 2570 may include a high-definition multimedia interface (HDMI) 2572, a universal serial bus (USB) 2574, an optical interface 2576, or a D- ) ≪ / RTI > The interface 2570 may be included, for example, in the communication interface 160 shown in FIG. Additionally or alternatively, the interface 2570 may be implemented with a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association . ≪ / RTI >

The audio module 2580 can convert both sound and electrical signals in both directions. At least some of the components of the audio module 2580 may be included, for example, in the input / output interface 140 shown in FIG. The audio module 2580 may process sound information input or output through, for example, a speaker 2582, a receiver 2584, an earphone 2586, a microphone 2588, or the like.

The camera module 2591 can capture still images and moving images. In one embodiment, the camera module 2591 includes at least one image sensor (e.g., a front sensor or a rear sensor), a lens (not shown), an image signal processor (not shown) or a flash (not shown) (e.g., LED or xenon lamp).

The power management module 2595 may manage the power of the electronic device 2501. Although not shown, the power management module 2595 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery, and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging scheme or a wireless charging scheme. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have.

The battery gauge can measure, for example, the remaining amount of the battery 2596, the voltage during charging, the current or the temperature. The battery 2596 may store or generate electricity, and may supply power to the electronic device 2501 using the stored or generated electricity. The battery 2596 may include, for example, a rechargeable battery or a solar battery.

The indicator 2597 may indicate a specific state of the electronic device 2501 or a portion thereof (e.g., the AP 2510), for example, a boot state, a message state, or a charged state. The motor 2598 can convert the electrical signal into mechanical vibration. Although not shown, the electronic device 2501 may include a processing unit (e. G., A GPU) for mobile TV support. The processing device for supporting the mobile TV can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device according to various embodiments of the present invention may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The electronic device according to various embodiments of the present invention may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to various embodiments of the present invention may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

According to various embodiments of the present invention, an electronic device for displaying content comprises a display, a display device for acquiring the sensing data, determining the orientation of the display based on the sensing data, and based on the orientation of the display, And a control module for controlling the display to display the content according to the display direction.

26 is a diagram illustrating a communication protocol 2600 between a plurality of electronic devices (e.g., electronic device 2610 and electronic device 2630) in accordance with various embodiments.

26, for example, the communication protocol 2600 includes a device discovery protocol 2651, a capability exchange protocol 2653, a data / session protocol ) 2655, an application protocol 2657, and the like.

According to one embodiment, the device discovery protocol 2651 may be configured to detect an external electronic device capable of communicating with the electronic devices (e.g., the electronic device 2610 or the electronic device 2630) Lt; / RTI > For example, an electronic device 2610 (e.g., electronic device 101) may communicate with a communication method available on the electronic device 2610 using the device discovery protocol 2651 (E. G., Electronic device 104) to a device that is capable of communicating with the electronic device 2210, such as via a Bluetooth, BT, USB, or the like. The electronic device 2610 may obtain and store identification information for the sensed electronic device 2630 using the device discovery protocol 2651 for a communication connection with the electronic device 2630. [ The electronic device 2610 may establish a communication connection with the electronic device 2630, for example, based at least on the identification information.

According to some embodiments, the device discovery protocol 2651 may be a protocol for mutual authentication between a plurality of electronic devices. For example, the electronic device 2610 may include at least communication information (e.g., media access control (MAC) address, universally unique identifier (UUID), subsystem identification (SSID) information provider address) of the electronic device 2610 to perform authentication between the electronic device 2610 and the electronic device 2630.

According to one embodiment, the function exchange protocol 2653 may be a protocol for exchanging information relating to a function of a service that can be supported by at least one of the electronic device 2610 or the electronic device 2630. For example, the electronic device 2610 and the electronic device 2630 may exchange information related to the function of the service currently provided through each of the functions exchange protocol 2653 with each other. The exchangeable information may include identification information indicating a specific service from a plurality of services that can be supported by the electronic device 2610 and the electronic device 2620. [ For example, the electronic device 2610 may receive identification information of the particular service provided by the electronic device 2630 from the electronic device 2630 via the function exchange protocol 2633. [ In this case, the first electronic device 2610 may determine, based on the received identification information, whether the electronic device 2610 can support the particular service.

According to one embodiment, the data / session protocol 2655 may be used to provide, for example, interworking between electronic devices (e. G., Electronic device 2610, electronic device 2630) And may be a protocol for controlling data flow. For example, at least one of the electronic device 2610 or the electronic device 2630 may perform error control, data quality control, or the like, using the data / session protocol 2655. Additionally or alternatively, the data / session protocol 2655 can determine the transmission format of data transmitted and received between the electronic device 2610 and the electronic device 2630. Also, at least one of the electronic device 2610 or the electronic device 2630 may be configured to manage at least a session for exchanging data with each other using the data / session protocol 2655 (e.g., )can do.

According to one embodiment, the application protocol 2657 may be a protocol for providing procedures or information for exchanging data associated with services provided to external electronic devices. For example, an electronic device 2610 (e.g., electronic device 101 or electronic device 104) may communicate with an electronic device 2630 (e.g., electronic device 104) via the application protocol 2657, Or the server 106).

According to one embodiment, the communication protocol 2600 includes a standard communication protocol, a communication protocol specified by an individual or a group (e.g., a communication protocol specified by the communication device manufacturer or a network vendor itself), or a combination thereof can do.

The term " module " as used in various embodiments of the present invention may mean a unit including, for example, one or a combination of two or more of hardware, software or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a " module " in accordance with various embodiments of the present invention may be implemented as an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) And a programmable-logic device.

There is provided a machine-readable storage medium having recorded thereon a program for executing a method of displaying an electronic device according to an embodiment of the present invention, the method comprising: acquiring sensing data; Determining a current state of the user, determining a content to be displayed on the screen based on the current state, and displaying the content on the screen.

According to various embodiments, at least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to various embodiments of the present invention may be, for example, a computer readable And may be implemented with instructions stored on a computer-readable storage medium. The instructions, when executed by one or more processors (e.g., the processor 120), may cause the one or more processors to perform functions corresponding to the instructions. The computer readable storage medium may be, for example, the memory 130. [ At least some of the programming modules may be implemented (e.g., executed) by the processor 120, for example. At least some of the programming modules may include, for example, modules, programs, routines, sets of instructions or processes, etc. to perform one or more functions.

The computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc) A magneto-optical medium such as a floppy disk and a program command such as a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, etc. ) ≪ / RTI > and a hardware device that is specifically configured to store and perform operations. The program instructions may also include machine language code such as those generated by the compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the various embodiments of the present invention, and vice versa.

Modules or programming modules according to various embodiments of the present invention may include at least one or more of the elements described above, some of which may be omitted, or may further include other additional elements. Operations performed by modules, programming modules, or other components in accordance with various embodiments of the invention may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

According to various embodiments, there is provided a storage medium storing instructions which, when executed by at least one processor, cause the at least one processor to be configured to perform at least one operation, Determining an orientation of the display based on the sensing data; determining an orientation of the display of the content along the orientation of the display; And displaying the content according to the direction.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. It is not intended to be limiting. Accordingly, the scope of various embodiments of the present invention should be construed as being included in the scope of various embodiments of the present invention without departing from the scope of the present invention, all changes or modifications derived from the technical idea of various embodiments of the present invention .

101: electronic device 104: electronic device
106: server 110: bus
120: processor 130: memory
131: Kernel 132: Middleware
133: Application Programming Interface
134: Application 140: I / O interface
150: Display 160: Communication interface
162: network 170: control module
180: Sensor module

Claims (57)

A method of operating an electronic device,
Determining motion information of the electronic device based on the sensed data measured through the sensor module,
Analyzing one or more biological signals to determine biometric information for a user,
And controlling the operation of the electronic device according to the motion information and the biometric information. The method according to claim 1,
Further comprising storing the usage pattern in the electronic device by identifying and recording a usage pattern of the electronic device by the user. 2. The method according to claim 1, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
And changing the order or configuration of the UI screen displayed by the screen of the electronic device. The method as claimed in claim 3,
A message screen or a notification screen. 2. The method according to claim 1, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
Changing the horizontal UI to a vertical UI or changing the vertical UI to the horizontal UI. 6. The method according to claim 5, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
And changing the horizontal UI to the vertical UI or changing the vertical UI to the horizontal UI according to the user input. The method of claim 1, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
A font size change, a color change, and a content reduction of a content displayed on a screen. The method according to claim 1,
Wherein the biometric information includes a heart rate measured by an HRM sensor or an HRV sensor,
The operation of analyzing the at least one living body signal to determine the biometric information for the user includes:
And determining the current state of the user based on the heart rate measured by the HRM sensor or the HRV sensor. 9. The method of claim 8, wherein the determining the current state of the user based on the heart rate measured by the HRM sensor or the HRV sensor comprises:
And determining the current state of the user by applying different criteria according to the type or intensity of the motion the user is performing. 10. The method according to claim 9, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
The intensity of the vibration, the input or output level of audio input / output from / to the electronic device, and the input / output level of audio input / output from / to the electronic device, And changing at least one of the types of audio. 2. The method according to claim 1, wherein the operation of controlling the operation of the electronic device according to the motion information and the biometric information comprises:
Determining a position of a screen displaying the content based on orientation information or mounting position information of the electronic device, and adjusting a size or a ratio of the content. The method according to claim 1,
Determining an orientation of the screen indicating the wear position or content of the electronic device;
Further comprising changing and displaying the content according to the wear position or the orientation of the screen. A method of operating an electronic device,
Determining whether a communication module communicating with an external device is connected to the external device,
And controlling the operation of the electronic device according to a connection state with the external device. 14. The method according to claim 13, wherein the operation of controlling the operation of the electronic device according to the connection state with the external device comprises:
And controlling the electronic device to output multimedia through the external device when the electronic device is connected to the external device. 14. The method of claim 13,
And controlling the electronic device according to the changed state when the connection state with the external device is changed. A method of operating an electronic device,
Paired with one or more external devices,
Determining motion information of the electronic device using the motion sensor,
Analyzing one or more biological signals to determine biometric information for a user,
Determining a service that can be provided to the user from the electronic device based on the motion information or the biometric information;
And providing the service to the user using the external devices. 17. The method of claim 16, wherein providing the service to the user using the one or more external devices comprises:
And providing the user with an alarm, an outgoing call or a change via the at least one external device based on the motion information or the bio-signal. 17. The method of claim 16,
Further comprising limiting some of the provision of multimedia through the one or more external devices based on the motion information or the bio-signals. 17. The method of claim 16,
Further comprising changing an input or output level of audio output through the one or more external devices based on the motion information or the bio-signal. 17. The method of claim 16,
Further comprising stopping external input through the one or more external devices based on the motion information or the bio-signal. A method for an electronic device to display content,
Acquiring sensing data,
Determining the current state of the user based on the sensing data,
Determining a content to be displayed on the display based on the current status;
And displaying the content on the display. 22. The method of claim 21,
Wherein the at least one of the user's blood pressure, blood flow, heart rate, body temperature, respiration rate, oxygen saturation, cardioplegia, or blood sugar. 22. The method of claim 21, wherein the determining the current state of the user based on the sensing data comprises:
And determining at least one of a type of the user's movement, a movement intensity, a movement progress state, a movement direction of the user, and a movement speed. 24. The method of claim 23, wherein the determining the content to display on the display based on the current state comprises:
And adjusting the number or the color of the content to be displayed on the display according to the intensity of the exercise. 25. The method of claim 24,
Wherein the number of contents to be displayed on the display decreases as the exercise intensity increases, and as the exercise intensity decreases, the number of contents to be displayed on the display increases. 24. The method of claim 23, wherein the determining the content to display on the display based on the current state comprises:
And adjusting the number or the color of the content to be displayed on the display according to the moving speed. 27. The method of claim 26,
Wherein as the moving speed increases, the number of contents to be displayed on the display decreases, and as the moving speed decelerates, the number of contents to be displayed on the display increases. 22. The method of claim 21, wherein the determining the current state of the user based on the sensing data comprises:
Determining a stress index of the user;
And determining whether the stress index is equal to or greater than a preset threshold value. 29. The method of claim 28, wherein the determining the content to display on the display based on the current state comprises:
And determining to display a motion stop alarm if the stress index is above the threshold. 29. The method of claim 28, wherein the determining the content to display on the display based on the current state comprises:
And determining to display the content that allows the user to continue exercising if the stress index is below the threshold value. A method for an electronic device to display content,
Obtaining sensing data for determining a direction of the screen,
Determining an orientation of the screen based on the sensing data,
Determining a display direction of the content along the direction of the screen,
And displaying the content on the screen in accordance with the display direction. 32. The method of claim 31, wherein the act of determining the display direction of the content along the direction of the screen comprises:
And if the width of the screen is longer than the length, determining to display the content in a horizontal direction. 32. The method of claim 31, wherein the act of determining the display direction of the content along the direction of the screen comprises:
And determining to display the content in the vertical direction when the height of the screen is longer than the width. 32. The method of claim 31, wherein the act of determining the display direction of the content along the direction of the screen comprises:
And determining to display the content in a horizontal direction in a part of the screen and to display the content in a vertical direction in a remaining part of the screen. 32. The method of claim 31, wherein the determining of the orientation of the screen based on the sensing data comprises:
And determining an angle of rotation of the screen based on a slope of the electronic device included in the sensing data. 32. The method of claim 31, wherein the determining of the orientation of the screen based on the sensing data comprises:
And determining an angle of rotation of the screen based on a slope of the electronic device included in the sensing data. 32. The method of claim 31, wherein the act of displaying the content along the display direction comprises:
And displaying the content on the screen when the angle between the direction of the screen and the direction opposite to the user's gaze is less than a preset reference value. 39. The method of claim 37,
Further comprising the step of not displaying the content on the screen when the angle between the direction of the screen and the direction opposite to the user's gaze is greater than or equal to a preset reference value. An electronic device for displaying contents,
A display including a screen for displaying content;
Determining a current state of the user based on the sensed data, determining a content to be displayed on the screen based on the current state, and controlling the display to display the content on the screen And a module. 40. The method of claim 39,
A blood pressure of the user, blood flow, heart rate, body temperature, respiratory rate, oxygen saturation, cardioplegia or blood sugar. 40. The apparatus of claim 39,
Wherein the determination unit determines at least one of a type of a motion the user is performing, a motion intensity, a motion progress state, a movement direction of the user, and a movement speed. 42. The apparatus of claim 41,
And controls the number of contents to be displayed on the screen according to the exercise intensity. 43. The system of claim 42,
Wherein the number of contents to be displayed on the screen is reduced as the exercise intensity is stronger and the number of contents to be displayed on the screen is increased as the exercise intensity is weak. 42. The apparatus of claim 41,
And controls the number of contents to be displayed on the screen according to the moving speed. 45. The apparatus of claim 44,
The number of contents to be displayed on the screen is decreased as the moving speed increases, and the number of contents to be displayed on the screen is increased as the moving speed is decreased. 40. The apparatus of claim 39,
And controls the display to display a motion interruption alarm on the screen when the stress index is greater than or equal to the threshold value by determining whether the stress index is greater than or equal to a preset threshold value, Lt; / RTI > 47. The apparatus of claim 46,
And controls the display to display, on the screen, content that allows the user to continue exercising if the stress index is less than the threshold. 40. The apparatus of claim 39,
Determines the direction of the screen based on the sensing data, determines a display direction of the content based on the direction of the screen, and controls the display to display the content along the display direction Device. 49. The apparatus of claim 48,
And controls the display to display the content in a horizontal direction when the width of the screen is longer than the length. 49. The apparatus of claim 47,
And controls the display to display the content in the vertical direction when the height of the screen is longer than the width. 49. The apparatus of claim 48,
Wherein some of the screens control the display to display the content in a horizontal direction and the rest of the screens control the display to display the content in a vertical direction. 49. The apparatus of claim 48,
Wherein the control unit determines the rotation angle of the screen based on the inclination of the electronic device included in the sensing data and controls the display so that the content is displayed in a biased direction of the screen based on the rotation angle Electronic device. 49. The apparatus of claim 48,
And controls the display to display the content in a horizontal direction when an angle between a direction of the screen and a direction opposite to a line of sight of the user is less than a preset reference value. 49. The apparatus of claim 48,
And controls the display not to display the content on the screen when the angle between the direction of the screen and the direction opposite to the user's gaze is equal to or greater than a preset reference value. 49. The apparatus of claim 48,
Determines the degree of motion of the user as a user state determined based on the sensing data, and limits the number of contents displayed on the screen when the degree of motion of the user is equal to or greater than a preset reference value. 56. The system of claim 55,
And does not limit the number of contents displayed on the screen if the degree of movement of the user is less than a preset reference value. A machine-readable storage medium having recorded thereon a program for executing a method of displaying an electronic device, the method comprising:
Acquiring sensing data,
Determining the current state of the user based on the sensing data,
Determining a content to be displayed on the screen based on the current status;
And displaying the content on the screen.

Images