KR102620967B1 - Electronic apparatus and method of correcting posture thereof - Google Patents

Abstract

An electronic device for correcting a user's posture is disclosed. An electronic device according to an embodiment of the present disclosure includes a communication unit, an output unit, a memory including at least one instruction, and a processor connected to the communication unit, the output unit, and the memory to control the electronic device, and the processor includes at least one By executing the command, a communication connection is made with the wearable device worn by the user through the communication unit, and sensing data detected by the wearable device is received from the wearable device through the communication boot, and the received sensing data satisfies preset conditions. In this case, the output unit is controlled to output a message corresponding to a preset condition to guide the user's posture.

Description

Electronic apparatus and method of correcting posture thereof}

The present disclosure relates to an electronic device and a method for correcting its posture. More specifically, it provides a message for correcting the user's posture by measuring the distance to an object the user is looking at to protect the user's eyesight or by measuring the surrounding illumination. It relates to an electronic device that can output a message to correct a user's posture by measuring the tilt of the user's head and a method of controlling the same.

Nowadays, many people use computers at work to perform office work. Office workers spend most of their day looking at computer monitors, and outside of work hours, they watch a variety of content, including smartphones and videos. Accordingly, people's eye fatigue is rapidly increasing, and according to one study, 50% to 90% of workers who use computers experience eye fatigue and uncomfortable symptoms related to the eyes. For example, although people know that the posture shown on the right side of FIG. 1 is the correct posture, they often perform work in an incorrect posture as shown on the left side of FIG. 1. Many people work for long periods of time without realizing that their posture is incorrect.

Meanwhile, in recent years, methods have been disclosed to guide users in correcting their lifestyle habits or posture through various wearable devices. However, conventional wearable devices provide functions that measure and inform the user of the user's sleeping habits, walking posture correction, daily exercise amount, etc., but do not measure and provide data related to the user's eye fatigue.

The present disclosure is intended to solve the above-mentioned problems and relates to electronic devices and wearable devices that help users correct their posture.

An electronic device for correcting a user's posture according to an embodiment of the present disclosure for solving the above problem includes a communication unit, an output unit, a memory including at least one command, and is connected to the communication unit, the output unit, and the memory. and a processor that controls an electronic device, wherein the processor performs a communication connection with a wearable device worn by a user through the communication unit by executing the at least one command, and transmits communication from the wearable device through the communication boot. Sensing data detected by a wearable device is received, and when the received sensing data satisfies a preset condition, the output unit is controlled to output a message corresponding to the preset condition to guide the user's posture.

At this time, the sensing data includes data about the distance between the external device and the object detected by the distance measurement sensor of the wearable device, data about the angle detected by the gyro sensor of the wearable device, and illuminance of the wearable device. It may include at least one of data about illuminance detected by the sensor.

At this time, when the sensing data is data about the distance between the wearable device and the object detected by the distance measurement sensor, the processor guides the user's posture when the detected distance is less than or equal to a first threshold. The output unit can be controlled to output information for:

At this time, the processor matches the sensed distance with time information and stores it in the memory, and when the sensed distance is below the first threshold for a preset time, it outputs information to guide the user's posture. The output unit can be controlled to do this.

At this time, when the sensing data is data about the angle detected by the gyro sensor, the processor outputs information for guiding the user's posture when the sensed angle is less than a second threshold. The output part can be controlled.

At this time, the processor matches the sensed angle with time information and stores it in the memory, and when the sensed angle is below the second threshold for a preset time, it outputs information to guide the user's posture. The output unit can be controlled to do this.

At this time, when the sensing data is data about the illuminance detected by the illuminance sensor, the processor is configured to output information for guiding the user's posture when the sensed illuminance is greater than or equal to a third threshold. The output part can be controlled.

At this time, the processor includes first sensing data obtained from a first sensor for detecting the illumination around the wearable device through the communication unit and second sensing data for detecting the illumination of the area viewed by the user wearing the wearable device. When receiving second sensing data obtained from a sensor, and the difference between the first illuminance value obtained from the first sensing data and the second illuminance value obtained from the second sensing data is greater than or equal to a fourth threshold, the user's The output unit can be controlled to output information for guiding posture.

Meanwhile, a method of controlling an electronic device for correcting a user's posture according to another embodiment of the present disclosure for solving the above-described problem includes performing a communication connection with a wearable device worn by a user, It includes receiving sensing data sensed by a wearable device and, when the received sensing data satisfies a preset condition, outputting a message corresponding to the preset condition to guide the user's posture.

At this time, the sensing data includes data about the distance between the external device and the object detected by the distance measurement sensor of the wearable device, data about the angle detected by the gyro sensor of the wearable device, and illuminance of the wearable device. It may include at least one of data about illuminance detected by the sensor.

At this time, the output step is to determine the user's posture when the sensing data is data about the distance between the wearable device and the object detected by the distance measurement sensor, and the detected distance is less than or equal to a first threshold. Information for guidance can be printed.

At this time, the output step includes matching the sensed distance with time information and, if the sensed distance is less than the first threshold for a preset time, outputting information for guiding the user's posture. may include.

At this time, in the output step, if the sensing data is data about the angle detected by the gyro sensor and the detected angle is less than or equal to a second threshold, information for guiding the user's posture can be output. there is.

At this time, the output step includes matching the sensed angle with time information and, if the sensed angle is below the second threshold for a preset time, outputting information for guiding the user's posture. It can be included.

At this time, in the output step, if the sensing data is data about the illuminance detected by the illuminance sensor and the sensed illuminance is greater than or equal to a third threshold, information for guiding the user's posture may be output. .

At this time, the receiving step includes first sensing data obtained from a first sensor for detecting the illuminance around the wearable device through the communication unit and illuminance of the area viewed by the user wearing the wearable device. Receiving second sensing data obtained from a second sensor, wherein the outputting step includes a first illuminance value obtained from the first sensing data and a second illuminance value obtained from the second sensing data. If the difference is greater than or equal to the fourth threshold, information for guiding the user's posture may be output.

According to various embodiments of the present disclosure described above, the electronic device may output a message for correcting the user's posture by measuring at least one of the object the user is looking at, ambient illumination, and the tilt of the user's neck.

Figure 1 is an example diagram for explaining incorrect and correct postures of conventional people.
2A and 2B are exemplary diagrams for explaining a posture correction system according to an embodiment of the present disclosure.
FIG. 3A is a block diagram for explaining the configuration of another electronic device 100 according to an embodiment of the present disclosure.
FIG. 3B is a block diagram for explaining in detail the configuration of the electronic device 100 according to an embodiment of the present disclosure.
Figure 4 is a block diagram for explaining the configuration of a wearable device according to an embodiment of the present disclosure.
FIGS. 5A to 5C are diagrams illustrating a method of determining the distance between a user and an object and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.
FIGS. 6A to 6E are exemplary diagrams for explaining a method of determining the tilt of a user's neck and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.
FIGS. 7A to 7D are diagrams illustrating a method of determining the illuminance around a user and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.
FIG. 8 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present disclosure.

Terms used in this specification will be briefly described, and the present disclosure will be described in detail.

The terms used in the embodiments of the present disclosure have selected general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but this may vary depending on the intention or precedent of a technician working in the art, the emergence of new technology, etc. . In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the relevant invention. Therefore, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of this disclosure, rather than simply the name of the term.

Embodiments of the present disclosure may be subject to various changes and may have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, and should be understood to include all transformations, equivalents, and substitutes included in the disclosed spirit and technical scope. In describing the embodiments, if it is determined that a detailed description of related known technology may obscure the point, the detailed description will be omitted.

Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. Terms are used only to distinguish one component from another.

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “consist of” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are intended to indicate the presence of one or more other It should be understood that this does not exclude in advance the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In an embodiment of the present disclosure, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' are integrated into at least one module and implemented by at least one processor (not shown), except for 'modules' or 'units' that need to be implemented with specific hardware. It can be.

In an embodiment of the present disclosure, when a part is said to be “connected” to another part, this means not only when it is “directly connected” but also when it is “electrically connected” with another element in between. Also includes. Additionally, when a part is said to “include” a certain component, this means that it may further include other components, rather than excluding other components, unless specifically stated to the contrary.

Below, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily practice them. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present disclosure in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Additionally, in embodiments of the present disclosure, “application” refers to a set of computer programs designed to perform a specific task. In embodiments of the present disclosure, applications may vary. For example, game applications, video playback applications, map applications, memo applications, calendar applications, phone book applications, broadcasting applications, exercise support applications, payment applications, photo folder applications, medical device control applications, and user interfaces of many medical devices. There may be provided applications, but it is not limited thereto.

FIG. 2A is an exemplary diagram for explaining a posture correction system according to an embodiment of the present disclosure.

As disclosed in FIG. 2A, the posture correction system 100 may be comprised of an electronic device 100 and a wearable device 200.

The electronic device 100 is configured to determine whether the user's posture is incorrect based on the sensing data received from the wearable device 200 and output a message to correct the user's posture to the correct posture.

At this time, the electronic device 100 may be implemented as a smart phone, but this is only an example and may be implemented as a smart phone, a tablet personal computer, a mobile phone, a video phone, or an e-book. e-book reader, desktop PC, laptop PC, netbook computer, workstation, server, PDA (personal digital assistant), PMP (portable multimedia player) , and may include at least one of an MP3 player.

As another example, the electronic device 100 may be a home appliance. Home appliances include, for example, televisions, DVD players (Digital Video Disk players), stereos, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, and home automation. Home automation control panel, security control panel, TV box (e.g. Samsung HomeSync™, Apple TV™, or Google TV™), game console (e.g. Xbox™, PlayStation™), electronic It may include at least one of a dictionary, an electronic key, a camcorder, or an electronic photo frame.

The wearable device 200 is configured to collect sensing data. At this time, the wearable device 200 is an accessory type (e.g., watch, ring, bracelet, anklet, necklace, glasses, contact lenses, or head-mounted-device (HMD)), earphone, head phone, It may include at least one of a fabric or clothing-integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or tattoo), or a bioimplantable type (e.g., an implantable circuit).

In another embodiment, the wearable device 200 may be an independent device. Specifically, as shown in FIG. 2B, a wearable device is an independent device that includes a component that can collect sensing data, and may be attached to various external devices. For example, the wearable device 200 may be configured to be attached to various accessories worn on the user's head, such as glasses, earphones, headbands, and headphones. In the present disclosure, the wearable device 200 is described as a device worn on the user's head or a device attached to a device worn on the user's head, but is not limited thereto, and can be worn or attached in various positions. am.

FIG. 3A is a block diagram for explaining the configuration of another electronic device 100 according to an embodiment of the present disclosure. As shown in FIG. 3A, the electronic device 100 includes a communication unit 110, an output unit 120, a memory 130, and a processor 140.

The communication unit 110 is configured to communicate with an external device. Specifically, the electronic device 100 may be connected to the wearable device 200 through the communication unit 110. Furthermore, of course, the electronic device 100 can transmit and receive various data to other external devices through the communication unit 110.

The output unit 120 is configured to output various data of the electronic device 100. Specifically, the electronic device 100 may output a message for correcting the user's posture through the output unit 120. At this time, the message output through the output unit 120 may be a UI screen related to posture correction or an audio signal related to posture correction.

The memory 130 can store various programs and data necessary for the operation of the electronic device 100. The memory 130 may be implemented as non-volatile memory, volatile memory, flash-memory, hard disk drive (HDD), or solid state drive (SSD). Specifically, the memory 130 may include at least one instruction, and the at least one instruction may be executed by the processor 140.

The processor 140 controls the overall operation of the electronic device 100. Specifically, the processor 140 may control the communication unit 110 to establish a communication connection with the wearable device 200 and receive sensing data from the wearable device 200. If the received sensing data satisfies a preset condition, the processor 140 may control the output unit 120 to output a message corresponding to the preset condition to guide the user's posture.

At this time, the sensing data may be data sensed by a distance sensor, gyro sensor, or illuminance sensor included in the wearable device 200. Specifically, the sensing data may include at least one of distance data from the wearable device 200 to the object, tilt data of the wearable device 200, and ambient illuminance data.

Meanwhile, preset conditions may vary depending on the type of sensing data. Specifically, when the sensing data is data about the distance between the wearable device 200 and an object detected by the distance measurement sensor of the wearable device 200, the preset condition is the distance between the wearable device 200 and the object. There can be a condition as to whether it is above or below the first threshold. Alternatively, the preset condition may be a condition related to the time for which the distance between the wearable device 200 and the object remains below the first threshold. The preset condition may be a condition regarding whether the average value of the distance between the wearable device 200 and the object is less than or equal to the first threshold.

In another embodiment, when the sensing data is tilt data detected by the gyro sensor of the wearable device 200, the preset condition is a condition for whether the tilt of the wearable device 200 is above or below the second threshold. You can. Alternatively, the preset condition may be a condition related to the time for which the inclination of the wearable device 200 is maintained below the second threshold. Alternatively, the preset condition may be a condition regarding whether the average slope value of the wearable device 200 is less than or equal to the second threshold.

In another embodiment, when the sensing data is illuminance data detected by the illuminance sensor of the wearable device 200, the preset condition is whether the illuminance around the wearable device 200 is above or below the third threshold. There are conditions. Alternatively, the preset condition may be a condition related to the time for which the illuminance around the wearable device 200 remains below the third threshold. Alternatively, the preset condition may be a condition regarding whether the difference between the illuminance value around the wearable device 200 and the illuminance value of the object area is greater than or equal to the fourth threshold. The above-mentioned preset conditions will be described in detail in various embodiments described later.

FIG. 3B is a block diagram for explaining in detail the configuration of the electronic device 100 according to an embodiment of the present disclosure. As shown in FIG. 3B, the electronic device 100 may further include an input unit 150, an audio processing unit 160, etc. in addition to a communication unit 110, an output unit 120, a memory 130, and a processor 140. You can. However, it is not limited to the above-described configuration, and of course, some configurations may be added or omitted as needed.

The communication unit 110 can communicate with an external device. In particular, the communication unit 110 may include various communication chips such as a Wi-Fi chip 111, a Bluetooth chip 112, a wireless communication chip 113, and an NFC chip 114. At this time, the WiFi chip 111, the Bluetooth chip 112, and the NFC chip 114 perform communication in the LAN method, WiFi method, Bluetooth method, and NFC method, respectively. When using the Wi-Fi chip 111 or the Bluetooth chip 112, various connection information such as SSID and session key are first transmitted and received, and various information can be transmitted and received after establishing a communication connection using this. The wireless communication chip 113 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution).

The output unit 120 is configured to output various data of the electronic device 100. Specifically, the output unit 120 may include a display 121 and an audio output unit 122.

As described above, the display 121 can display various screens. At this time, the display 121 may be implemented as various types of display panels. For example, display panels may be LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes), AM-OLED (Active-Matrix Organic Light-Emitting Diode), LcoS (Liquid Crystal on Silicon), or DLP (Digital Light Processing). It can be implemented with various display technologies.

Additionally, the display 121 may be coupled to at least one of the front area, side area, and rear area of the electronic device 100 in the form of a flexible display. Flexible displays can be characterized by being able to bend, bend, or roll without damage through a paper-thin, flexible substrate. Such flexible displays can be manufactured using not only commonly used glass substrates but also plastic substrates. When using a plastic substrate, it can be formed using a low-temperature manufacturing process rather than using a conventional manufacturing process to prevent damage to the substrate. Additionally, the glass substrate surrounding the flexible liquid crystal can be replaced with a plastic film to provide flexibility to fold and unfold. These flexible displays have the advantage of being not only thin and light, but also resistant to impact, and being able to bend or bend and be manufactured into various shapes.

The audio output unit 122 is configured to output various notification sounds or voice messages as well as various audio data on which various processing tasks such as decoding, amplification, and noise filtering have been performed by the audio processing unit 160. Specifically, the audio processing unit 160 is a component that processes audio data. The audio processing unit 160 may perform various processing such as decoding, amplification, noise filtering, etc. on audio data. Audio data processed in the audio processing unit 160 may be output to the audio output unit 160. In particular, the audio output unit 122 may be implemented as a speaker, but this is only an example and may be implemented as an output terminal capable of outputting audio data.

The input unit 150 may include a touch panel 151, a pen sensor 152, a key 153, and a microphone 154 to receive various inputs. The touch panel 151 may be configured by combining a display 121 and a touch sensor (not shown), and the touch sensor may use at least one of a capacitive type, a resistive type, an infrared type, and an ultrasonic type. The touch panel may have not only a display function but also the function of detecting not only the touch input location and touched area but also the touch input pressure, and may also have the function of detecting not only real-touch but also proximity touch. You can. The pen sensor 152 may be implemented as part of the touch panel 151 or may include a separate recognition sheet. Keys 153 may include physical buttons, optical keys, or keypads. The microphone 154 may include at least one of a built-in microphone or an external microphone.

In particular, the input unit 150 may receive external commands from the various components described above and transmit them to the processor 140. The processor 140 may control the electronic device 100 by generating a control signal corresponding to the received input.

The processor 140 can control the overall operation of the electronic device 100 using various programs stored in the memory 130.

The processor 140 may be composed of RAM 141, ROM 142, graphics processing unit 143, main CPU 144, first to n interfaces (145-1 to 145-n), and bus 146. there is. At this time, RAM 141, ROM 142, graphics processing unit 143, main CPU 144, first to n interfaces (145-1 to 145-n), etc. may be connected to each other through bus 146. .

RAM 141 stores O/S and application programs. Specifically, when the electronic device 100 is booted, the O/S is stored in the RAM 141, and various application data selected by the user may be stored in the RAM 141.

The ROM 142 stores a set of instructions for booting the system. When a turn-on command is input and power is supplied, the main CPU 144 copies the O/S stored in the memory 110 to the RAM 141 according to the command stored in the ROM 142 and executes the O/S. Boot the system. When booting is complete, the main CPU 144 copies various application programs stored in the memory 130 to the RAM 141 and executes the application programs copied to the RAM 141 to perform various operations.

The graphics processing unit 143 uses a calculation unit (not shown) and a rendering unit (not shown) to create a screen including various objects such as items, images, and text. Here, the calculation unit may be configured to calculate attribute values such as coordinate values, shape, size, color, etc. for each object to be displayed according to the layout of the screen using the control command received from the input unit 150. Additionally, the rendering unit may be configured to generate screens of various layouts including objects based on attribute values calculated by the calculation unit. The screen generated by this rendering unit may be displayed within the display area of the display 121.

The main CPU 144 accesses the memory 130 and performs booting using the OS stored in the memory 130. And, the main CPU 144 performs various operations using various programs, contents, data, etc. stored in the memory 130.

The first to n interfaces 145-1 to 145-n are connected to the various components described above. One of the first to n interfaces 145-1 to 145-n may be a network interface connected to an external device through a network.

Figure 4 is a block diagram for explaining the configuration of a wearable device according to an embodiment of the present disclosure. As shown in FIG. 4 , the wearable device 200 includes a communication unit 210, a sensor 220, and a processor 230.

The communication unit 210 is a component for communicating with an external device, and as described above, may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, and an NFC chip. The communication unit 210 may transmit various sensing data detected by the sensor 220 to the electronic device 100.

The sensor 220 is configured to detect various sensing data. As shown in FIG. 4, the sensor 220 may include a distance measurement sensor, an illumination sensor, a noise detection sensor, a gyro sensor, etc.

The distance measurement sensor is a sensor for measuring the distance between the wearable device 200 and an object. At this time, the distance sensor may be comprised of an optical sensor, but is not limited thereto, and may of course be comprised of an infrared sensor, an ultrasonic sensor, etc., if necessary.

The illuminance sensor is configured to measure the surrounding illuminance. At this time, the illuminance sensor may consist of two or more. Specifically, when the illuminance sensor consists of a first illuminance sensor and a second illuminance sensor, the first illuminance sensor detects the illuminance around the wearable device 200, and the second illuminance sensor detects the illuminance near the area where the object is located. It can be detected.

The noise measurement sensor is designed to measure ambient noise, and the gyro sensor is a sensor that recognizes 6-axis directions by rotating each of the existing acceleration sensors, helping to recognize more detailed and precise movements. It is a wearable device ( 200) is configured to detect the location.

Of course, the sensor 220 may include various types of sensors, such as an acceleration sensor, a proximity sensor, an impact sensor, a gravity sensor, and a geomagnetic sensor, in addition to the above configurations.

The processor 230 is configured to control the wearable device 200 and can control the communication unit 210 to transmit various information detected by the sensor 220 to the electronic device 100.

Meanwhile, the wearable device 200 may further include additional components as needed in addition to the configuration described above. For example, when the wearable device 200 is implemented as an earphone, the wearable device 200 may further include an audio output unit. In this case, the wearable device 200 may receive data about an audio message related to posture correction from the electronic device 100 and output it. Alternatively, when the wearable device 200 is implemented as a head mounted display (HMD), the wearable device 200 may further include a display. In this case, the wearable device 200 may receive data about a UI message related to posture correction from the electronic device 100 and output it. In addition to this, of course, various configurations can be added depending on what device the wearable device 200 is implemented with.

Below, we will look at various posture correction methods using FIGS. 5A to 7C.

FIGS. 5A to 5C are diagrams illustrating a method of determining the distance between a user and an object and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.

If a user stares too close at an object or stares at an object at the same distance for a long time, it can lead to diseases such as astigmatism or myopia. Therefore, the electronic device 100 needs to guide the user's posture by measuring the distance to the object the user gazes at and the object gaze time.

As shown in FIG. 5A , the distance measurement sensor 221 of the wearable device 200 may measure the distance w between the wearable device 200 and the object 500 and transmit it to the electronic device 100. At this time, the wearable device 200 may measure distance data at preset time intervals (for example, every 10 seconds) and transmit it to the electronic device 100. At this time, the transmission method of the distance w may vary. For example, the wearable device 100 may transmit the distance data to the electronic device 100 every time it obtains data about the distance w, or at regular time intervals.

The electronic device 100 may determine the user's posture by analyzing distance data received from the wearable device 200. For example, when the distance between the wearable device 200 and the object is less than or equal to the first threshold (eg, 0.4 m), the electronic device 100 may determine that the user's posture correction is necessary. The method for determining the threshold will be described later.

At this time, when the distance between the wearable device 200 and the object becomes less than or equal to the first threshold (for example, 0.4 m), the electronic device 100 may output a message guiding the user's posture. For example, as shown in FIG. 5B, the electronic device 100 may output a message UI such as “The distance to the object in front is too close. Please maintain an appropriate distance for eye health.” there is. At this time, in order to notify that the message UI is being output, the electronic device 100 may vibrate the electronic device 100 or output an alarm sound when the message UI is displayed. At this time, data about the message UI may be transmitted to the wearable device 200 and displayed by the wearable device 200. That is, when the wearable device 200 is a head-mounted display device, the message UI may be output from the wearable device 200.

In another embodiment, the message UI may be output in the form of audio data. As described above, depending on the type of electronic device 100 or wearable device 200, audio data saying "The distance to the object in front is too close. Please maintain an appropriate distance for eye health" may be transmitted to the electronic device 100 or the wearable device 200. It may be output from the device 100 or the wearable device 200.

Meanwhile, as shown in FIG. 5C, the electronic device 100 may match the received distance data with time information and store it. The electronic device 100 may obtain the average gaze distance at which a user gazes at an object based on distance data matched with time information. If the obtained average gaze distance is less than or equal to the first threshold (eg, 0.4 m), the electronic device 100 may output a message guiding the user's posture.

In another embodiment, the electronic device 100 may measure changes in distance data over time. If the distance data does not change for a preset time, the electronic device 100 may output a message guiding the user's posture. For example, electronic device 100 may say, "You are staring too long at an object at the same distance. For your eye health, look further away." A message like this can be output.

In conclusion, the electronic device 100 uses distance data to determine 1) whether the object the user is staring at is close, 2) whether the average distance of the object the user is staring at is close, and 3) whether the user is looking at the same object (the same By determining how long the user is looking at an object located in the distance, a message that guides the user's posture can be output.

FIGS. 6A to 6E are exemplary diagrams for explaining a method of determining the tilt of a user's neck and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.

If the head posture is incorrect, conditions such as neck tension, fatigue, turtle neck syndrome, and headaches may occur. Therefore, the electronic device 100 needs to guide the user's posture by measuring the user's head posture and neck tilt, as shown in FIG. 6A.

Specifically, the electronic device 100 may measure the tilt of the user's neck using a gyro sensor, gravity sensor, geomagnetic sensor, etc. As shown in FIG. 6B, the electronic device 100 may receive angle data about the inclination of the wearable device 200 based on the direction of gravity from the wearable device 200. If the received angle data is greater than or equal to the second threshold (eg, 30 degrees), the electronic device 100 may output a message to guide the user's posture. For example, as shown in FIG. 6C, the electronic device 100 may output a message UI such as “Please maintain correct posture for the health of your neck.” At this time, in order to notify that the message UI is being output, the electronic device 100 may vibrate the electronic device 100 or output an alarm sound when the message UI is displayed. At this time, data about the message UI may be transmitted to the wearable device 200 and displayed by the wearable device 200. That is, when the wearable device 200 is a head-mounted display device, the message UI may be output from the wearable device 200.

In another embodiment, the message UI may be output in the form of audio data. As described above, depending on the type of the electronic device 100 or the wearable device 200, the audio data saying “Please maintain a correct posture for the health of your neck” is transmitted to the electronic device 100 or the wearable device 200. It can be output from .

Meanwhile, in order to obtain accurate angle data, the wearable device 200 needs to be worn correctly. In other words, the user must wear the wearable device 200 in a correct posture so that the tilt measured by the sensor is 0 to accurately determine the posture of the user of the electronic device 100. To this end, the electronic device 100 may output a message to guide wearing the wearable device.

Specifically, as shown in FIG. 6D, the electronic device 100 may display a message UI that guides the user to wear the wearable device 200 correctly. For example, the electronic device 100 may output a message UI such as “Please wear the wearable device. If you click OK, you will proceed to the step for adjusting the position of the wearable device.”

When a confirmation command is input through the message UI, the electronic device 100 may display a UI for adjusting the position of the wearable device 200, as shown in FIG. 6E. When the position of the wearable device 200 is adjusted so that the angle measured by the sensor becomes 0 and a confirmation command is input, the electronic device 100 determines that wearing of the wearable device 200 is complete and uses the sensing data. Thus, the user's posture can be determined.

Meanwhile, similar to the case of FIGS. 5A to 5C, the electronic device 100 may match angle data with time information. The electronic device 100 may obtain the average time that the user's head is tilted based on the angle data matched with the time information. If the obtained average time is greater than or equal to the second threshold (eg, 0.4 m), the electronic device 100 may output a message guiding the user's posture.

In another embodiment, the electronic device 100 may measure changes in angle data over time. If the angle data does not change for a preset time, the electronic device 100 may output a message guiding the user's posture. For example, the electronic device 100 may say, “You are maintaining the same posture for a long time. Please stretch for your neck health.” A message like this can be output.

FIGS. 7A to 7D are diagrams illustrating a method of determining the illuminance around a user and outputting a message guiding the user's posture according to the determined result, according to an embodiment of the present disclosure.

Ambient illuminance values can affect the user's vision. Therefore, the electronic device 100 needs to determine the ambient illuminance and the illuminance of the object area and guide the ambient illuminance value.

Specifically, the electronic device 100 may receive ambient illuminance data from the wearable device 200. If the received ambient illuminance is above (or below) the third threshold (e.g., 500 lux), the electronic device 100 may display the message “Ambient is too bright. Lower the illuminance for eye health,” as shown in FIG. 7B. You can output a message UI such as “Please” or “The surroundings are too dark. Please increase the illumination for eye health.” As described above, the message may be output as audio, and of course, it can be output from the wearable device 200.

Meanwhile, as shown in FIG. 7C, there are cases where an object is a light source that emits light. In this case, the electronic device 100 may determine the user's health status by determining the ambient illumination and the intensity of light emitted by the object. For example, when the difference between the ambient illuminance value and the illuminance value of the object area is greater than the fourth threshold, the electronic device 100 displays the message “The brightness of the monitor is too bright.” As shown in FIG. 7D, the brightness of the monitor is adjusted. You can output a message UI such as “Please reduce it.” However, as necessary, the electronic device 100 may display messages such as “The brightness of the monitor is too dark. Please brighten the monitor,” “The surroundings are too bright. Please lower the illumination for eye health,” or “The surroundings are too dark.” Of course, UI such as “Please increase the illumination for eye health” can be output.

Hereinafter, we will look at a method of determining the various threshold values described above (thresholds related to the distance between the wearable device 200 and the object, the tilt of the wearable device 200, the ambient illuminance, and the illuminance of the object area). The various threshold values described above may be determined by the electronic device 100, but may also be determined by an external server. Below, it will be explained that the external server determines the threshold.

First, an external server can collect medically approved raw data. At this time, the raw data acquired from all sensors during a given time can be expressed as a variable vector Vi. Collected data can be classified by various experts. At this time, experts can add a binary mark to the raw data. That is, the raw data may be given a binary mark of 0 (eg, bad posture) or 1 (eg, correct posture).

The external server can classify the raw data to which the binary mark is attached in various ways. For example, an external server can train a classifier trained to automatically select key line segments by Programmable Counter Array (PCA). At this time, the classifier may be implemented as a Naive Bayes Classifier, but is not limited to this. For example, raw data can be classified through supervised learning. Alternatively, raw data can be classified through unsupervised learning, which discovers classification criteria by learning on its own using learning data without any guidance.

Alternatively, the raw data classification model may be based on a neural network model. Neural network models can be designed to simulate human brain structure on a computer. A neural network model may include a plurality of network nodes with weights that simulate neurons of a human neural network. A plurality of network nodes can each form a connection relationship to simulate synaptic activity in which neurons send and receive signals through synapses. Furthermore, the raw data classification model may include a neural network model or a deep learning model developed from a neural network model. In a deep learning model, multiple network nodes are located at different depths (or layers) and can exchange data according to convolutional connections.

For example, models such as Deep Neural Network (DNN), Recurrent Neural Network (RNN), and Bidirectional Recurrent Deep Neural Network (BRDNN) may be used as classification models, but are not limited thereto. The various models described above can be learned using a learning algorithm including error back-propagation or gradient descent.

The electronic device 100 may receive information about the various thresholds described above from an external server and compare the sensing data received from the wearable device 200 with the threshold value received from the external server to determine the user's posture. . At this time, the electronic device 100 may receive information about the threshold from an external server at a preset period. Alternatively, when the threshold determined by the external server changes, the electronic device 100 may receive information about the changed threshold.

Meanwhile, in the above-described embodiment, it has been described that the electronic device 100 receives information about the threshold from an external server, but it goes without saying that the electronic device 100 can obtain the threshold through the above-described method.

FIG. 8 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

The electronic device 100 may establish a communication connection with the wearable device 200 (S810).

The electronic device 100 may receive sensing data detected by the wearable device 200 from the wearable device 200 that is connected to communication (S820). As described above, the sensing data received by the electronic device 100 includes data about the distance between objects of the wearable device 200 detected by the distance measurement sensor of the wearable device 200, and the gyro sensor of the wearable device 200. It may be at least one of data about the angle detected by and data about the illuminance detected by the illuminance sensor of the wearable device 200.

When the received sensing data satisfies a preset condition, the electronic device 100 may output a message corresponding to the preset condition to guide the user's posture (S830). At this time, the preset conditions may be conditions for the sensing data and the threshold value corresponding to the sensing data. Specifically, when the sensing data is distance data between the wearable device 200 and an object, the preset condition may be a condition for whether the distance between the wearable device 200 and the object is less than or equal to the first threshold. Alternatively, the preset condition may be a condition regarding whether the distance between the wearable device 200 and the object is maintained below the first threshold for more than a preset time (for example, 5 minutes). In another embodiment, when the sensing data is angle data detected by a gyro sensor, the preset condition may be a condition for whether the angle of the wearable device 200 is less than or equal to the second threshold. Alternatively, the preset condition may be a condition regarding whether the angle of the wearable device 200 is maintained below the second threshold for more than a preset time (for example, 5 minutes). In another embodiment, when the sensing data is illuminance data detected by an illuminance sensor, the preset condition may be a condition for whether the ambient illuminance is less than or equal to the third threshold. Alternatively, the preset condition may be a condition regarding whether the ambient illuminance is maintained below the third threshold for a preset time (for example, 5 minutes) or more. Alternatively, the preset condition is that the difference between the ambient illuminance obtained from the first illuminance sensor of the wearable device 200 and the illuminance of the area viewed by the user obtained from the second illuminance sensor of the wearable device 200 is greater than or equal to the fourth threshold. It may be a condition for recognition.

The methods described above may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and constructed for the present invention or may be known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The above hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, although the present disclosure has been described with limited examples and drawings, the present disclosure is not limited to the above embodiments, and various modifications and variations can be made from these descriptions by those skilled in the art. This is possible. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be determined by the claims and equivalents thereof as well as the claims described later.

100: Electronic device 110: Communication department
120: output unit 130: memory
140: Processor 200: Wearable device

Claims (16)

In an electronic device for correcting a user's posture,
Ministry of Communications;
output unit;
a memory containing at least one instruction; and
It includes a processor connected to the communication unit, the output unit, and the memory to control the electronic device,
The processor executes the at least one instruction,
Performs a communication connection with a wearable device worn by the user through the communication unit,
Receiving sensing data detected by the wearable device from the wearable device through the communication unit,
When the received sensing data satisfies a preset condition, controlling the output unit to output a message corresponding to the preset condition to guide the user's posture,
The processor,
First sensing data obtained from a first sensor for detecting the illumination intensity around the wearable device through the communication unit, and second sensing data obtained from a second sensor for detecting the illumination intensity of the area viewed by the user wearing the wearable device. Receive sensing data including sensing data,
When the condition that the difference between the first illuminance value obtained from the first sensing data and the second illuminance value obtained from the second sensing data is greater than or equal to a preset value is satisfied, output a message for guiding the user's posture. Electronic device that controls the output unit. According to paragraph 1,
The sensing data includes data on the distance between the wearable device and the object detected by the distance measurement sensor of the wearable device, data on the angle detected by the gyro sensor of the wearable device, and data on the illuminance sensor of the wearable device. An electronic device comprising at least one of data on illuminance detected by an electronic device.
According to paragraph 2,
When the sensing data is data about the distance between the wearable device and the object detected by the distance measurement sensor,
The processor controls the output unit to output information for guiding the user's posture when the detected distance is less than or equal to a first threshold.
According to paragraph 3,
The processor,
The sensed distance is matched with time information and stored in the memory, and when the sensed distance is below the first threshold for a preset time, the output unit is controlled to output information for guiding the user's posture. An electronic device characterized in that:
According to paragraph 2,
If the sensing data is data about the angle detected by the gyro sensor,
The processor controls the output unit to output information for guiding the user's posture when the sensed angle is less than or equal to a second threshold. According to clause 5,
The processor,
The sensed angle is matched with time information and stored in the memory, and when the sensed angle is below the second threshold for a preset time, the output unit is controlled to output information for guiding the user's posture. An electronic device characterized in that:
According to paragraph 2,
If the sensing data is data about the illuminance detected by the illuminance sensor,
The processor controls the output unit to output information for guiding the user's posture when the sensed illumination level is greater than or equal to a third threshold. delete In a method of controlling an electronic device for correcting a user's posture,
Performing a communication connection with a wearable device worn by a user;
Receiving sensing data detected by the wearable device from the wearable device;
When the received sensing data satisfies a preset condition, outputting a message corresponding to the preset condition to guide the user's posture,
The control method is,
Includes first sensing data obtained from a first sensor for detecting the illuminance around the wearable device and second sensing data obtained from a second sensor for detecting the illuminance of the area viewed by the user wearing the wearable device. receiving sensing data; and
When the second condition is satisfied that the difference between the first illuminance value obtained from the first sensing data and the second illuminance value obtained from the second sensing data is more than a preset value, output a message to guide the user's posture A control method comprising: According to clause 9,
The sensing data includes data on the distance between the wearable device and the object detected by the distance measurement sensor of the wearable device, data on the angle detected by the gyro sensor of the wearable device, and data on the illuminance sensor of the wearable device. A control method comprising at least one of data on illuminance detected by a control method.
According to clause 10,
The output step is,
When the sensing data is data about the distance between the wearable device and an object detected by the distance measurement sensor, and the detected distance is less than or equal to a first threshold, control for outputting information for guiding the user's posture. method.
According to clause 11,
The output step includes matching the sensed distance with time information; and
If the detected distance is less than or equal to the first threshold for a preset time, outputting information to guide the user's posture; A control method comprising:
According to clause 10,
The output step is,
A control method for outputting information for guiding the user's posture when the sensing data is data about an angle detected by the gyro sensor and the sensed angle is less than or equal to a second threshold. According to clause 13,
The output step is,
Matching the sensed angle with time information; and
If the sensed angle is below the second threshold for a preset time, outputting information to guide the user's posture; A control method comprising:
According to clause 10,
The output step is,
A control method for outputting information for guiding a user's posture when the sensing data is data about the illuminance detected by the illuminance sensor and the sensed illuminance is greater than or equal to a third threshold.
delete

Images