KR102475626B1 - Smart terminal service system and smart terminal processing data - Google Patents

Abstract

In the present specification, a smart terminal service system according to the present invention and a smart terminal processing data are disclosed. Here, the smart terminal service system according to an embodiment of the present invention includes a sensor unit for collecting motion data, a memory, a communication unit for exchanging signals with the smart terminal, and a first message related to put-on and pairing request. A smart shoe including a control unit that transmits, generates and transmits a second message regarding a take-off and unpairing request, transmits and controls the collected motion data to a smart terminal, and a memory, and transmits and receives signals with the smart shoe The communication unit controls execution of the smart shoe application, receives a first message from the smart shoe, determines whether or not to register the smart shoe in the mobile terminal based on the received first message, and determines whether or not the smart shoe is registered in the mobile terminal. A control unit for pairing with, receiving motion data from the smart shoe after the pairing, receiving a second message from the smart shoe, and controlling unpairing with the corresponding smart shoe based on the received second message, and the smart A smart terminal including an output unit for outputting a shoe application execution screen and a GUI (Graphic User Interface) based on the received motion data.

Description

Smart terminal service system and smart terminal processing data {SMART TERMINAL SERVICE SYSTEM AND SMART TERMINAL PROCESSING DATA}

The present invention relates to a smart terminal service system and a smart terminal processing data.

A mobile terminal is implemented as a multimedia player equipped with complex functions in addition to conventional simple communication functions. A typical example of such a mobile terminal may be a smart phone, but it is being expanded or developed into a wearable device, for example, a wearable device. Here, the wearable device includes devices such as smart watches, smart glasses, head mounted displays (HMDs), and products worn by users, such as clothes and shoes. .

On the other hand, mobile terminals are also taking the lead in implementing the Internet of Things (IoT) through data communication with various things around them together with conventional stationary terminals or individually.

In this way, in the recent digital environment, various attempts have been made to satisfy user needs or improve convenience through data communication between terminals. However, a smooth service has not yet been achieved due to a related standard for data communication between a plurality of terminals or an insufficiency of the system. In particular, a preliminary process for data communication between the plurality of terminals, for example, a connection or pairing process between the terminals must be preceded, but this process is complicated and requires several steps or depths. etc., there are problems that cause inconvenience to users. In addition, such a problem eventually limits the user's use frequency or number of uses or interest in use, which is recognized as an obstacle to service activation and may hinder the development of the overall system or environment. And, as described above, the data communication process between the reference terminal and a plurality of other terminals is more complicated and passive, causing inconvenience to the user.

The present invention is to solve the above problems or remove obstacles.

An object of the present invention is to enable seamless data communication between a plurality of smart terminals.

Another task of the present invention is to reduce the data communication time by compressing data according to various standards in the process of data communication between smart terminals, thereby increasing system efficiency and realizing low power required for the smart terminals. do it with

Another object of the present invention is to provide an intuitive and highly visible user interface based on data obtained through data communication between smart terminals.

The technical problem to be achieved in the present invention is not limited to the above-mentioned technical problem, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. .

In the present specification, a smart terminal service system according to the present invention and a smart terminal processing data are disclosed.

A smart terminal performing data communication with smart shoes according to an embodiment of the present invention includes a memory; a communication unit that transmits and receives signals with the smart shoe; After controlling the execution of the smart shoe application, receiving a first message about a put-on and pairing request from the smart shoe, and determining whether to register the smart shoe in the mobile terminal based on the received first message, the determination Pairing with the corresponding smart shoe according to the result, receiving motion data from the smart shoe after the pairing, receiving a second message about a take-off and unpairing request from the smart shoe, and based on the received second message a control unit for controlling unpairing with the corresponding smart shoe; and an output unit for outputting a GUI (Graphic User Interface) based on the smart shoe application execution screen and the received motion data.

A smart terminal service system according to an embodiment of the present invention generates and transmits a first message related to a sensor unit for collecting motion data, a memory, a communication unit for exchanging signals with a smart terminal, and a put-on and pairing request, , a smart shoe including a control unit that generates and transmits a second message regarding a take-off and unpairing request, and transfers and controls the collected motion data to a smart terminal, and a memory, a communication unit that transmits and receives signals with the smart shoe, Controls the execution of a smart shoe application, receives a first message from the smart shoe, determines whether the corresponding smart shoe is registered in the mobile terminal based on the received first message, and then pairs with the corresponding smart shoe according to the determination result. and, after the pairing, receiving motion data from the smart shoe, receiving a second message from the smart shoe, and controlling unpairing with the corresponding smart shoe based on the received second message, and the smart shoe application. and a smart terminal including an output unit for outputting an execution screen and a GUI (Graphic User Interface) based on the received motion data.

The technical solutions obtainable in the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned will become clear to those skilled in the art from the description below. You will be able to understand.

According to the present invention, there are the following effects.

According to at least one of the embodiments of the present invention, there is an effect of achieving seamless data communication between smart terminals.

According to at least one of the embodiments of the present invention, by compressing data according to various standards in a data communication process between smart terminals, the time of the data communication is shortened to increase the efficiency of the system and through this, the required of the smart terminals It has the effect of realizing low power.

According to at least one of the embodiments of the present invention, there is an effect of providing an intuitive and highly visible user interface based on data acquired through data communication between smart terminals.

The effects obtainable in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 is a diagram schematically showing a smart terminal service system including smart shoes according to an embodiment of the present invention;
2 is a block diagram for explaining a smart shoe sensor module 200 according to an embodiment of the present invention;
3 is a yz plane cross-sectional view of a smart shoe 110 equipped with a smart shoe sensor module 200 according to an embodiment of the present invention;
4 is a time-sequential diagram showing the walking of a smart shoe wearer 400 equipped with a smart shoe sensor module 200 according to an embodiment of the present invention and the response to signals generated accordingly;
5 is a flowchart of operation of the smart shoe sensor module 200 according to an embodiment of the present invention;
6 is a diagram showing a system or circuit configuration of a smart shoe sensor module 200 according to an embodiment of the present invention;
7 is a view showing an example of the appearance of a smart shoe sensor module 200 including the circuit configuration of FIG. 6;
8 is a diagram showing an individual configuration of a smart shoe sensor module 200 according to an embodiment of the present invention;
9 is a cross-sectional view in the direction A-A' of FIG. 7;
10 is a diagram to explain a time difference between the time of the on signal measured by the motion sensor 243 of the smart shoe 100 and the time difference between the time of the on signal measured by the pressure sensor 246 according to an embodiment of the present invention. one drawing,
11 and 12 are, respectively, an algorithm and flow chart for correcting the smart shoe on signal time measurement value through the pressure sensor 246 to the smart shoe on signal time through the motion sensor 243 according to an embodiment of the present invention;
13 is a diagram showing a configuration block diagram for a tracking algorithm in a smart shoe system according to an embodiment of the present invention;
14 is a diagram showing a smart shoe tracking data graph according to an embodiment of the present invention;
15 and 16 show smart shoe tracking data graphs according to another embodiment of the present invention;
17 is a UX diagram for an example of a service scenario according to an embodiment of the present invention;
18 is a flowchart of a data processing method using a tracking algorithm in a smart shoe system according to an embodiment of the present invention.
19 and 20 are diagrams for explaining a pairing process between a smart shoe and a mobile terminal according to the present invention;
21 and 22 are sequence diagrams illustrating a process of automatically pairing a smart shoe with a plurality of mobile terminals according to an embodiment of the present invention;
23 and 24 are diagrams for explaining a data communication process between smart shoes according to an embodiment of the present invention;
25 and 26 are diagrams for explaining a data communication process between smart terminals according to an embodiment of the present invention;
27 and 28 are diagrams for explaining a data communication process between smart terminals according to another embodiment of the present invention;
29 is a diagram showing an example of a user interface provided by a smart terminal based on smart shoe data according to an embodiment of the present invention; and
30 is a flowchart illustrating a data communication process between smart terminals according to an embodiment of the present invention.

Hereinafter, the embodiment(s) disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numerals regardless of reference numerals, and overlapping descriptions thereof will be omitted.

The suffixes "module" and "unit" for components used in the following description are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinct from each other by themselves.

In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of related known technologies may obscure the gist of the embodiment disclosed in this specification, the detailed description will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

BACKGROUND ART Mobile terminals are expanding from a smart phone that performs a function of producing and consuming contents in addition to a communication function to a form of performing various functions by interlocking with various things. Examples of such mobile terminals include things worn by users, that is, wearable devices, such as smart watches, smart glasses, HMD (head mounted display), EMD (eye mounted display) The wearable device may include a device such as a device and a product worn by a user, such as clothes and shoes.

Hereinafter, in the present specification, shoes among wearable devices, so-called smart shoes, will be described as an example to help understanding of the present invention and for convenience of explanation. The smart shoes analyze information on the wearer's movement (activity or movement) and provide various information and feedback to the user through a mobile terminal such as a smart phone or smart watch or by itself, such as the analysis result and related recommendation information. (feedback) can be provided. Here, the smart shoes sense, track, analyze, and record information about the movement of the user wearing the smart shoes, such as activity time, activity distance, and activity trajectory. ), proposal function, etc. can be performed. Information about the movement of the wearer is sensed using, for example, a motion sensor. Such a motion sensor may include a Global Positioning System (GPS), an acceleration sensor, a gyro sensor, and the like. have.

A smart terminal performing data communication with a smart shoe according to an embodiment of the present invention controls a memory, a communication unit that sends and receives signals with the smart shoe, and executes a smart shoe application, and requests put-on and pairing from the smart shoe. After receiving a first message about the received first message, determining whether or not the corresponding smart shoe is registered in the mobile terminal based on the received first message, pairing with the corresponding smart shoe according to the determination result, and motion from the smart shoe after the pairing. A controller that receives data, receives a second message regarding a take-off and unpairing request from the smart shoe, and controls unpairing with the corresponding smart shoe based on the received second message, and executes the smart shoe application It includes an output unit that outputs a screen and a GUI (Graphic User Interface) based on the received motion data.

A smart terminal service system according to an embodiment of the present invention generates and transmits a first message related to a sensor unit for collecting motion data, a memory, a communication unit for exchanging signals with a smart terminal, and a put-on and pairing request, , a smart shoe including a control unit that generates and transmits a second message regarding a take-off and unpairing request, and transfers and controls the collected motion data to a smart terminal, and a memory, a communication unit that transmits and receives signals with the smart shoe, Controls the execution of a smart shoe application, receives a first message from the smart shoe, determines whether the corresponding smart shoe is registered in the mobile terminal based on the received first message, and then pairs with the corresponding smart shoe according to the determination result. and, after the pairing, receiving motion data from the smart shoe, receiving a second message from the smart shoe, and controlling unpairing with the corresponding smart shoe based on the received second message, and the smart shoe application. and a smart terminal including an output unit for outputting an execution screen and a GUI (Graphic User Interface) based on the received motion data.

1 is a diagram schematically illustrating a smart terminal service system including smart shoes according to an embodiment of the present invention.

Referring to FIG. 1 , the smart terminal service system includes a smart shoe 110, a server 150, and one or more mobile terminals. At this time, the server 150 may not be essential depending on the system.

The smart shoe 110 is implemented as a pair including a pair of shoes for the left foot (hereinafter referred to as 'left (L) smart shoe') and a pair of shoes for the right foot (hereinafter referred to as 'right (R) smart shoe'). In this case, a sensor module for smart shoes related to the present invention may be included in at least one of the left (L) smart shoe and the right (R) smart shoe. However, in the present specification, to help understanding of the present invention and for convenience of description, a case in which the sensor module for the smart shoe is included in both the left (L) smart shoe and the right (R) smart shoe will be described as an example.

The smart shoe 110 senses motion information of a user, that is, the wearer of the smart shoe, and transmits the sensed motion information of the user directly to one or more mobile terminals or indirectly via the server 150. Here, the one or more mobile terminals may include a smart phone 120, a smart watch 130, and the like. In addition, the smart shoe 110 may transmit the motion information to a digital TV 140 or a digital signage (not shown). However, it is obvious that the smart shoe 110 can perform data communication with various devices other than the above-described terminals or the illustrated device.

Meanwhile, the smart shoe 110 mainly performs direct data communication with terminals located in a short distance using a short-range communication protocol, but can perform data communication with terminals located in a long distance using the server 150. have. Alternatively, unlike the above, regardless of the distance, the smart shoe 110 periodically/non-periodically uploads the user's motion information on the server 150 such as the Cloud, and at a desired point in time through the terminal. You can also conveniently download and use it at any place you want.

In addition, the smart shoe 110 may simultaneously or sequentially perform data communication with at least two or more terminals.

Figure 2 is a block diagram for explaining the smart shoe sensor module 200 according to an embodiment of the present invention. Here, Figure 2 is described as a configuration of the smart shoe sensor module 200, but this may be viewed as a configuration of a mobile terminal. At this time, some configurations may be different from those shown.

The smart shoe sensor module 200 includes a wireless communication unit 210, an input unit 220, a sensor unit 240, an output unit 250, an interface unit 260, a memory 270, a control unit 280, a power supply unit ( 290) and the like. The components shown in FIG. 2 are not essential for implementing the smart shoe sensor module 200, so the smart shoe sensor module 200 described in this specification has more or less components than the components listed above. can have elements.

More specifically, among the components, the wireless communication unit 210 is between the smart shoe sensor module 200 and the wireless communication system, between the smart shoe sensor module 200 and other mobile terminals, or between the smart shoe sensor module 200 It may include one or more modules enabling wireless communication between the server and an external server. In addition, the wireless communication unit 210 may include one or more modules connecting the smart shoe sensor module 200 to one or more networks.

The wireless communication unit 210 may include at least one of a short-distance communication module 211 and a location information module 212 .

The short-distance communication module 211 may transmit/receive data by being connected to the smart shoe module 200 through a Bluetooth method.

The location information module 212 serves to measure or transmit location information of the smart shoe module 200, and may include a concept overlapping with the motion sensor 243 to be described later.

The input unit 220 may include a user input unit 221 (eg, a touch key, a mechanical key, etc.) for receiving information from a user. Voice data or image data collected by the input unit 220 may be analyzed and processed as a user's control command. The input unit 220 may serve to receive an on/off function for activating or deactivating the function of the smart shoe module 200, and may be omitted if necessary to reduce production cost or lighten the weight.

The sensor unit 240 may include one or more sensors for sensing at least one of information within the smart shoe module 200, surrounding environment information surrounding the smart shoe module 200, and user information. For example, the sensor unit 240 may include a proximity sensor 241, an illumination sensor 242, a touch sensor, an acceleration sensor 244, and a magnetic sensor. , gravity sensor (G-sensor), gyroscope sensor (245, gyroscope sensor, hereinafter 'gyro sensor'), motion sensor (243, motion sensor), RGB sensor, infrared sensor (IR sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor, optical sensor, battery gauge, environmental sensor (e.g. barometer, hygrometer, thermometer, radiation detection sensor, heat detection sensor, gas detection) sensors, etc.) and chemical sensors (eg, electronic nose, healthcare sensors, biometric sensors, etc.). Meanwhile, the smart shoe module 200 disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors.

In particular, the acceleration sensor 244 and the gyro sensor 345 mentioned in the present invention may be included in the motion sensor 243 .

The motion sensor 243 mounted on the smart shoe sensor module 200 may mean a configuration that directly senses the motion of the smart shoe sensor module 200 . The motion sensor 243 may include an acceleration sensor 244 and a gyro sensor 245 . If necessary, only one of the acceleration sensor 244 and the gyro sensor 245 may be provided.

Through the motion sensor 243, movements such as the 2D or 3D position of the smart shoe sensor module 200 and position change with respect to time may be sensed.

The controller 280 may control the power supply 290 to supply current required for the motion sensor 243 . The control unit 280 may include a physical configuration of a micro controller unit (MCU) such as a central processing unit (CPU).

The motion sensor 243 and the control unit 280 may be included in the smart shoe sensor module 200 or may be mounted on the smart shoe 110 as a separate configuration.

The pressure sensor 246 is mounted on the smart shoe sensor module 200 to sense pressure. The pressure sensor 246 may be a concept included in the motion sensor 243 in terms of function, but in the present invention, it is referred to as the motion sensor 243 including the acceleration sensor 244 and the gyro sensor 245, and the pressure sensor 246 ) is classified as a component independent of the motion sensor 243 and described.

The output unit 250 is for generating an output related to sight, hearing or touch, and includes at least one of a display unit 251, a sound output unit 252, a haptic module 253, and an optical output unit 254. can do.

The interface unit 260 serves as a passageway with various types of external devices connected to the smart shoe sensor module 200 . The interface unit 260 includes at least one of an external charger port, a wired/wireless data port, a memory card port, and a port connecting a device having an identification module. can do. In the smart shoe sensor module 200, in response to the external device being connected to the interface unit 260, appropriate control related to the connected external device can be performed.

In addition, the memory 270 stores data supporting various functions of the smart shoe sensor module 200 . The memory 270 may store data and instructions for the operation of the control unit driven by the smart shoe sensor module 200 .

The control unit 280 controls overall operations of the smart shoe sensor module 200 in addition to operations related to applications. The control unit 280 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the components described above, or by using data or commands stored in the memory 270. .

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power to each component included in the smart shoe sensor module 200 . The power supply unit 290 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the above components may operate in cooperation with each other to implement the operation, control, or control method of the smart shoe sensor module 200 according to various embodiments described below. In addition, the operation, control, or control method of the smart shoe sensor module 200 may be implemented on the smart shoe sensor module 200 through at least one data or command stored in the memory 270.

3 is a y-z plane cross-sectional view of the smart shoe 110 equipped with the smart shoe sensor module 200 according to an embodiment of the present invention.

The outsole frame 310 of the smart shoe 110 means a direct/indirect area where the wearer's sole touches. In other words, in the smart shoe sensor module 200, it may mean a frame of an area provided between the wearer's foot and the floor. The outsole frame 310 includes an insole 311 that directly touches the sole of the wearer's foot, an outsole 313 provided at the bottom of the smart shoe module 200 and directly contacting the outside, that is, the ground, and an insole 311 And it may be composed of a midsole (312, midsole) provided between the outsole 313 to form a certain volume.

The insole 311 may be a so-called insole, but if necessary, the insole 311 and the midsole 312 may be integrally configured without distinction, or may be provided in a combined form by a separate member or adhesive.

The smart shoe sensor module 200 may be provided on the sole frame 310 . The smart shoe sensor module 200 can signal or dataize the pressure applied by the wearer's walking or running.

FIG. 4 is a time-sequential diagram showing the walking of the smart shoe wearer 400 equipped with the smart shoe sensor module 200 according to an embodiment of the present invention and the response to signals generated accordingly.

When the wearer 400 steps on the floor wearing the smart shoe 110, an on ('1') signal is sent to the smart shoe sensor module 200, and when the wearer 400 falls off the floor wearing the smart shoe 200, the smart shoe sensor An off signal ('0') may be generated by the module 200.

In the states of ② to ④ of FIG. 4, a pressure value higher than or equal to a certain value acts to generate a value '1', that is, an on signal, in the smart shoe sensor module 200, and in the case of the remaining ① and ⑤-⑦, the pressure value is less than a specific value. This action may generate a value '0', that is, an off signal, in the smart shoe sensor module 200.

The on signal generated by the smart shoe sensor module 200 may be generated by a predetermined threshold pressure value.

The predetermined threshold pressure value may be determined according to the material stiffness and elasticity of the smart shoe sensor module 200, the size of the smart shoe sensor module 200, or the distance between the conductive member and the first circuit unit.

For example, when the predetermined threshold pressure value is increased, the pressure threshold at which an on signal can be generated is further increased, so that the value '1', that is, an on signal, is generated in the smart shoe module 200 only in the case of ② or ③. And, in the case of ① and ④-⑦, a value of '0', that is, an off signal, may be generated in the smart shoe module 200.

Therefore, it is possible to determine the start and end of one step of the wearer through these results, and when the step is repeated, the cycle of each step can be grasped.

Referring to FIG. 4 , ② is interpreted as the start of a step, and the point where ① passes through ⑦ can be interpreted as the end of one step.

In addition, when the change from ② to ① is repeated, a plurality of steps can be analyzed by recognizing one cycle as one step.

If the unit of step is interpreted only by the acceleration sensor (244, see FIG. 2) and/or the gyro sensor (245, see FIG. 2) among the motion sensors (243, see FIG. 2), the speed value of the smart shoe sensor module 200 is In the case of interpreting the '0' point, errors may occur due to various variables, that is, noise. However, in the present invention, the noise can be removed through an on/off signal using a pressure sensor in the smart shoe sensor module 200 to distinguish an accurate step unit.

The smart shoe sensor module 200 may operate in a direction from the sole of the foot toward the outsole frame 310 (see FIG. 3), that is, whether pressure is applied to the bottom direction. However, it is not necessarily required to be in the lower direction, and if necessary, it may operate based on pressure in a direction that is displaced at a certain angle from the lower direction, and when a plurality of smart shoe sensor modules 200 are provided, various It can also act on the direction.

The direction of this pressure may be based on the normal gait and force exerted by the wearer, or it may vary based on the individual gait and force exerted by the wearer.

The predetermined critical pressure value may be differently applied according to physical and habitual factors such as height, weight, foot size, sex, and age of the wearer. However, since whether the smart shoe sensor module 200 is turned on/off may depend on the material and structure, the smart shoe sensor module 200 whose material and structure are determined may have a predetermined threshold pressure value. However, although not shown, the critical pressure value may be arbitrarily changed in consideration of accuracy of sensing data for the wearer, noise, and the like.

5 is a flowchart illustrating the operation of the smart shoe sensor module 200 according to an embodiment of the present invention.

The controller 280 may supply and control current to the motion sensor 243 based on an on or off signal of the smart shoe sensor module 200 .

If the smart shoe sensor module 200 continues to receive an OFF signal for a certain period of time or more, it may be interpreted as not being moved by the user not wearing the smart shoe 110 or wearing the smart shoe 110 . Alternatively, even if the user wears the smart shoe 110, it can be interpreted that the movement that generates more than the predetermined threshold pressure is not performed. For example, this may correspond to a case in which the user wears the smart shoes 110 and sits on a chair and moves lightly even though the user touches the floor or does not touch the floor.

Accordingly, the controller 280 may deactivate the motion sensor 243 to perform a system sleep mode to minimize power consumed by the smart shoe sensor module 200 (S501).

When an on signal is generated in the smart shoe sensor module 200 during the system sleep mode, it can be interpreted as the user wearing the smart shoe 110 and performing an activity (S502).

Accordingly, the ON signal of the smart shoe sensor module 200 generated during the system sleep mode may activate the controller 280 (S503). If the controller 280 is already activated, this step may be omitted.

The control unit 280 may release the system sleep mode of the smart shoe sensor module 200 and drive the system (S504). Here, the operation of the system may mean that various electronic components, circuits, sensors, etc. provided in the smart shoe sensor module 200 are turned on.

The control unit 280 compares the generation time interval of the on/off signal of the smart shoe sensor module 200 with a preset time interval in real time (S505).

If the generation time interval of the on and off signals of the smart shoe sensor module 200 is within a predetermined time interval, that is, when the on value '1' is received within a predetermined time, the system operation of the smart shoe sensor module 200 can be maintained. Yes (S506).

On the other hand, if the generation time interval of the on and off signals of the smart shoe sensor module 200 exceeds a preset time interval, that is, if the off value '0' continues for a predetermined time or more, the control unit 280 controls the smart shoe sensor module The entire system of 200 can be deactivated, that is, the system operation can be switched to the system sleep mode. Here, the control unit 280 may perform current blocking or inactivation of the motion sensor 243 .

6 is a diagram showing a system or circuit configuration of the smart shoe sensor module 200 according to an embodiment of the present invention.

As one of the key components of the smart shoe sensor module 200, the pressure conductive member 630 according to the present invention may operate in conjunction with the first circuit unit 651. The first circuit unit 651 may be mounted on the board 650 so that at least one region may be exposed on the board 650 .

Here, for convenience, FIG. 6 shows a state before coupling the conductive member 630 and the first circuit part 651, and the conductive member 630 is fixed at a distance from the substrate 650 by another member or fixed in contact with the substrate 650. It can be.

When pressure less than the threshold value acts on the smart shoe sensor module 200, the conductive member 630 is electrically separated from the first circuit unit 651.

Until the first circuit portion 651 is connected by the pressure conductive member 630, the first circuit portion 651 may maintain an open circuit, that is, an electrically open state.

When pressure greater than the threshold value acts on the smart shoe sensor module 200, the conductive member 630 may be electrically connected to the contact terminal 6511 of the first circuit unit 651.

The two spaced apart contact terminals 6511 may be electrically connected by the conductive member 630 so that the first circuit part 651 becomes a closed circuit. When the first circuit unit 651 constitutes a closed circuit, an electrical signal may be generated.

The control unit 280 (see FIG. 2) may recognize the electrical signal generated in the first circuit unit 651 as the on/off signal of FIG. 5, and the recognized on/off signal Based on this, various operations can be controlled.

Since the control unit 280 (see FIG. 2) recognizes the on/off signal according to the electrical signal, it can be interpreted as a separate and independent process, but it can also be interpreted as one operation performed in the same circuit.

Meanwhile, as an exemplary embodiment, FIG. 6 illustrates and describes two contact terminals 6511 related to electrical connection and disconnection between the pressure conductive member 630 and the first circuit unit 651, but the present invention is not limited thereto. don't For example, at least one contact terminal 6511 is sufficient. In addition, although not shown, electrical connection and disconnection may be implemented in a non-contact manner instead of the contact method using the contact terminal 6511.

7 is a diagram showing an example of the appearance of the smart shoe sensor module 200 including the circuit configuration of FIG. 6 .

Figure 7a is a front perspective view of the smart shoe sensor module 200 appearance, Figure 7b is a rear perspective view of the smart shoe sensor module 200 appearance.

The housing 760 forming the exterior of the smart shoe sensor module 200 may include an upper case 761 and a lower case 762 . Alternatively, the upper case 761 and the lower case 762 may be formed in a uni-body shape, but in the present invention, the upper case 761 and the lower case 762 are formed as separate bodies. Take the case of combining as an example.

In addition, in the present specification, for convenience, a structure in which the smart shoe sensor module 200 is combined with two cases, an upper case 761 and a lower case 762, is shown, but the present invention is not limited thereto, and in some cases three or more The smart shoe sensor module 200 may be formed by combining the cases.

8 is a diagram showing an individual configuration of the smart shoe sensor module 200 according to an embodiment of the present invention.

The smart shoe sensor module 200 may refer to a structural unit for mounting parts that perform the function of the pressure sensor 246 (see FIG. 2), and may physically include all components mounted in the housing 760. have.

The housing 760 may mount components such as the board 650 . It may be composed of a combination of an upper case 761 and a lower case 762 provided on the front surface of the housing 760 .

The power supply 290 may be mounted in the housing 760 to supply power to the control unit 280 and the like. For smooth replacement of the power supply unit 290, a battery cover 774 coupled to the lower case 762 may be included. A gap between the battery cover 774 and the lower case 762 may be blocked by the waterproof ring 775 to prevent problems with waterproofing.

9 is a cross-sectional view in the direction A-A′ of FIG. 7 .

The upper case 761 forms the upper exterior of the smart shoe sensor module 200 and may act elastically by a pressure equal to or greater than a threshold value acting in the first direction. In particular, the first direction may mean a direction from the wearer's foot to the ground. In other words, the first direction may mean a direction from the upper case 761 to the lower case 762 .

The upper case 761 may be formed in a thin flat shape so that pressure can be well transmitted from the sole of the wearer's foot to the conductive member 630, and may be provided in direct contact with the conductive member 630. The outer surface of the upper case 761 is formed convexly so that the pressure from the wearer's foot or the insole to which pressure is transmitted from the wearer's foot is well transmitted to the upper case 761 . The upper case 761 may include a material having elasticity as necessary so that pressure can be well transmitted to the conductive member 630 . For example, the upper case 761 may be formed of a silicon material.

The lower case 762 may be coupled to the lower end of the upper case 761 to form the lower outer appearance of the smart shoe sensor module 200 .

The first circuit unit 651 may be mounted in the housing 760 formed by the upper case 761 and the lower case 762 and may be particularly fixed to the lower case 762 .

A portion of the first circuit unit 651 is exposed from one surface of the substrate 650 and may come into contact with a conductive member 630 to be described later.

The first circuit unit 651 may be implemented in the form of a combination of a film and a metal electrode or in the form of a film and a conductive polymer. Alternatively, it may be implemented in the form of a film and CNT or a film and graphene.

Alternatively, the first circuit unit 651 may be provided in the form of an injection molding product and MID (Mold Interconnect Devices).

The substrate 650 may mount the first circuit unit 651 thereon. A second circuit unit for driving the motion sensor 243 may be mounted on the board 650 . The board 650 may also mount the controller 280 (see FIG. 2). However, it is not necessary to include the motion sensor 243, the second circuit unit or the controller 280 in the smart shoe sensor module 200, and the smart shoe 110 is independently separated and separate motion sensor according to the need or system. 243, a second circuit unit or control unit 280 (see FIG. 2) may be included.

The conductive member 630 may generate an electrical signal to the first circuit unit 651 .

The conductive member 630 may be mounted in the housing 760 formed by the upper case 761 and the lower case 762, in particular. It may be provided inside the upper case 761 .

The conductive member 630 is provided to form a first gap with the first circuit part 651 on the inner side 7611 of the upper case, and elastic behavior is obtained by a pressure equal to or greater than a threshold value acting on the upper case 761 in the first direction. By contacting the first circuit unit 651, a signal may be generated.

That is, the conductive member 630 may contact the first circuit unit 651 and perform the function of the pressure sensor 246 (see FIG. 2 ) depending on whether or not the pressure applied to the upper case 761 is greater than or equal to a threshold value. When a pressure higher than the threshold value acts on the smart shoe sensor module 200, an electrical signal may be generated in the first circuit unit 651.

The conductive member 630 may serve to electrically connect the first circuit unit 651 when in contact with the first circuit unit 651 . The conductive member 630 may include a conductive material. Accordingly, the conductive member 630 may be implemented with conductive silicon, metal gasket, metal plate or metal deposition, conductive polymer, CNT, graphene, or the like.

Alternatively, the first circuit unit 651 may be configured by combining an injection molding product and a Mold Interconnect Device (MID).

For convenience of description, a state in which no pressure is applied to the smart shoe sensor module 200 is referred to as a first state, and a state in which a pressure equal to or higher than a threshold value is applied to the smart shoe sensor module 200 is referred to as a second state. do.

In the first state, the conductive member and the first circuit portion 651 may form a first gap G1. The first gap G1 may be a specific value greater than 0 mm.

In the first state, the first gap G1 is maintained, and in the second state, the conductive member 630 and the first circuit part 651 may come into contact with each other due to the elastic behavior of the upper case 761 .

When the smart shoe sensor module 200 is formed, manufacturing tolerances of the upper case 761 and the lower case 762, manufacturing tolerances and coupling of the substrate 650 having the first circuit unit 651 and the conductive member 630 are formed. The first gap G1 may vary due to tolerances, tolerances of coupling of the conductive member 630 with the upper case 761 , and tolerances of coupling between the upper case 761 and the lower case 762 .

When the first gap G1 does not have a constant value, a threshold pressure value for generating a signal is different, so that an accurate boundary between an on signal and an off signal cannot be formed.

If there is an offset in the distinction between the on signal and the off signal, and if a step is not recognized even though it has occurred, or if it is recognized as occurring even though no step has occurred, an error occurs in the analysis of the wearer's step pattern and an accumulated error If this occurs, problems such as bringing completely different results may occur.

Therefore, it is necessary to have reliability so that the first gap G1 is maintained in the first state, that is, the contact between the conductive member 230 and the first circuit unit 651 does not generate an on signal.

The upper case 761 and the lower case 762 may be coupled with a pair of coupling holes and coupling protrusions.

The coupling hole and the coupling protrusion may be fixed in a fit-fitting manner, and unintentional opening of the upper case 761 and the lower case 762 may be prevented.

The coupling hole may be provided on one side of the upper case 761 or the lower case 762, and the coupling protrusion may be provided on the other side.

The coupling hole and the coupling protrusion may exhibit a fitting effect by contacting each other on each side.

The coupling hole and the coupling protrusion may form a second gap G2 in a longitudinal direction, which is a coupling direction. The second gap G2 may serve to prevent the width of the first gap G1 from being varied due to a tolerance occurring between the coupling hole and the coupling protrusion.

In a similar manner, a third gap G3 may be formed at an outer boundary of the combination of the upper case 761 and the lower case 762 .

The support rib protrudes downward from the inside of the upper case 761 to support the substrate 650 including the first circuit part 651 . When the first circuit unit 651 is mounted on the lower case 762, the substrate 650 including the first circuit unit 651 is moved to minimize the tolerance generated in the first gap G1 due to the gap. It can play a role in preventing this from happening.

The hook part may protrude from the inside of the lower case 762 to fix the substrate 650 including the first circuit part 651 .

The conductive member 730 may be coupled to the inner surface 7611 of the upper case 761 . The coupling method may be through an adhesive tape or a double injection method at the same time or at the same time as the upper case 761 is formed.

When the conductive member 730 is coupled to the inner surface 7611 of the upper case 761, the conductive member 730 may be provided in the recessed area of the upper case 761 to improve the reliability of the coupling. have. The depressed area may increase a contact area between the conductive member 630 and the inner surface 7611 of the upper case, and may serve to secure a space so that the thickness of the conductive member 630 is equal to or greater than a predetermined thickness. .

10 is a diagram to explain a time difference between the time of the on signal measured by the motion sensor 243 of the smart shoe 100 and the time difference between the time of the on signal measured by the pressure sensor 246 according to an embodiment of the present invention. it is a drawing

The motion sensor 243 may grasp the position of the smart shoe 100 in a 3D space in real time through the acceleration sensor 244 and the gyro sensor 245 .

Through this, the control unit 280 can confirm and analyze whether the smart shoe 200 is in an on-signal state supported on the ground, that is, a '1' value state, or an off-signal state away from the ground, that is, a '0' value state. have.

Meanwhile, the pressure sensor 246 may analyze whether or not the pressure is greater than or equal to the signal generation threshold as an on-signal state estimated to be ground support or an off-signal state estimated to be separated from the ground.

However, when determining an on signal or an off signal through the pressure sensor 246, an error may occur due to manufacturing tolerances or coupling tolerances of the smart shoe module 200 described above.

Therefore, the state of the on signal or off signal measured and analyzed through the pressure sensor 246 needs to be corrected to the state of the on signal or off signal measured and analyzed through the motion sensor 243 . The reverse is also possible.

11 and 12 are algorithms and flowcharts for correcting the measured value of the smart shoe on signal time through the pressure sensor 246 to the smart shoe on signal time through the motion sensor 243, respectively, according to an embodiment of the present invention. .

The smart shoe sensor module 200 may be provided in the left (L) smart shoe and the right (R) smart shoe, respectively, to analyze the walking pattern of the wearer.

The smart shoe sensor module 200 provided in the left (L) smart shoe is the left (L) smart shoe sensor module, the smart shoe sensor module 200 provided in the right (R) smart shoe is the right (R) smart shoe sensor It can be defined as a module, and a unit in which the left (L) smart shoe sensor module and the right (R) smart shoe sensor module are organically measured and analyzed is defined as a smart shoe sensor module system.

That is, the measured value or analysis value of either of the left (L) smart shoe sensor module and the right (R) smart shoe sensor module may be transmitted to the other smart shoe sensor module, or a separate terminal may be used for each smart shoe sensor module. Calibration may be performed by receiving measurement values and analysis values of the sensor module.

In the former, the left (L) smart shoe sensor module and the right (R) smart shoe sensor module can be viewed as a smart shoe sensor module system, and in the latter, the left (L) smart shoe sensor module and the right (R) smart shoe sensor The module and a separate terminal may be viewed as a smart shoe sensor module system.

The error between the pressure sensor 246 and the motion sensor 243 of FIG. 10 described above may be extended to the problem of on-signal times of the left smart shoe and the right smart shoe.

The left (L) smart shoe and the right (R) smart shoe may have different support times on the ground, that is, times or ratios of pressures greater than or equal to a threshold value, depending on the wearer's walking pattern. Accordingly, such a deviation may lead to inaccurate results when analyzing a wearer's walking pattern. Accordingly, correction of such a balance difference may be required.

Left / right (L / R) smart shoe sensor module 200 due to complex factors such as deviation due to the left / right weight imbalance of the wearer as well as causes due to manufacturing tolerances of each of the above-mentioned left / right (L / R) smart shoe sensor module 200 ) Left/right deviation may occur in the analysis of the time the smart shoe sensor module 200 supports on the ground.

Therefore, it is necessary to correct the ground support time deviation of the left/side (L/R) smart shoe measured by the pressure sensor 246 .

Calibration can be implemented by analyzing the ground support time of the motion sensors 243 provided in each of the left/side (L/R) smart shoes.

As described above, the motion sensor 243 can measure the position of the left/right (L/R) smart shoe 110 in 3D space in real time through the acceleration sensor 244 and the gyro sensor 245. have.

Based on this, the controller 280 may analyze the start point and end point at which the smart shoe 110 is actually supported on the ground by the motion sensor 243 .

The left/right smart shoe 110 identified through the pressure sensor 246 based on the ratio of the ground support time of each of the left/right (L/R) smart shoes 110 analyzed through the motion sensor 243 as a reference ) can calibrate the on-signal time ratio deviation.

For example, when the smart shoe 110 is used for the first time, a correction algorithm may be automatically operated (S1201).

The controller 280 determines the ground support time ratio through the three-dimensional movement of the left/right (L/R) smart shoe 110 measured by the motion sensor 243 including the acceleration sensor 244 and the gyro sensor 245. It can be analyzed (S1202), and the ratio of time when the pressure sensor 246 acts on the left/right smart shoes 110 at or above the threshold pressure value can be analyzed (S1203).

The measuring or analyzing step may be performed simultaneously or at different times.

For example, the ground support time ratio measured and analyzed through the motion sensor 243 is 0.8:1.2, and the ratio of the time when the signal generation threshold pressure value or more acts as measured and analyzed through the pressure sensor 246 is 0.9. Let's say :1.1.

In this case, the controller 280 multiplies the value measured by the pressure sensor 246 of the left (L) smart shoe by 0.8/0.9, and multiplies the value measured by the pressure sensor 246 of the right (R) smart shoe by 1.2. A correction algorithm that multiplies /1.1 may be applied (S1204, S1206).

However, in order to minimize power consumption, the controller 280 may drive the motion sensor 243 only in the initial calibration stage of the pressure sensor 246 and deactivate the driving of the abnormal motion sensor 243 without a separate need. .

That is, when performing calibration, the controller 280 may temporarily activate the motion sensor 243 that is being deactivated.

The correction of the control unit 280 may be performed at a cycle set by the wearer, or may be automatically performed at a preset cycle (S1205).

In the above-described FIGS. 1 to 12, the smart shoe system according to the present invention has been mainly described. Hereinafter, a smart shoe tracking algorithm based on the sensing data of the pressure sensor described above in the Pedestrian Dead Reckoning (PDR) algorithm will be described in detail.

Hereinafter, a smart shoe system operated based on a smart shoe tracking algorithm will be described in more detail.

Here, the smart shoe tracking algorithm may refer the sensing data of the pressure sensor to the PDR algorithm in order to accurately sense the movement (eg, every step or step) of the smart shoe wearer without missing it. Using such a smart shoe tracking algorithm, it is possible to more easily and accurately calculate motion data for a walking trajectory, walking direction, stride, and height of a smart shoe wearer. In addition, by using the smart shoe tracking algorithm, power consumption can be minimized and efficiency can be maximized compared to conventional smart shoe systems in conjunction with the pressure switch or pressure sensor circuit or module described above.

As described above, the smart shoe according to the present invention measures the movement time, velocity, distance or position, orientation, and trajectory of the user while wearing the smart shoe. Motion data such as trace or path, attitude, and stride can be tracked, sensed, and recorded. At this time, it is very important to accurately track, sense, etc. without missing every step of the wearer of the smart shoe.

In relation to the present invention, in sensing the motion data of the wearer of smart shoes, if the motion data of the wearer is measured only through a motion sensor such as an acceleration sensor or a gyro sensor (also called a PDR sensor or an inertial sensor), the motion sensor Measurable conditions must be maintained at all times. However, activation of the motion sensor causes continuous battery consumption. In addition, when motion data is sensed through the motion sensor, if the wearer's steps cannot be accurately distinguished due to noise generated in the motion sensor, there is a possibility of error occurrence, such as missing one step. Errors occur in the motion data of the wearer acquired through this and it becomes difficult to trust. In order to solve this problem, in the present invention, the above-described pressure switch or pressure sensor is further employed in the motion sensor, and the above-described information is used, and redundant description is omitted here.

Hereinafter, a smart shoe tracking algorithm, movement data sensing through the algorithm, and a smart shoe system for the same will be described in detail.

13 is a block diagram illustrating a configuration for a tracking algorithm in a smart shoe system according to an embodiment of the present invention.

Referring to FIG. 13 , the smart shoe tracking algorithm may be processed by a component named the smart shoe tracking data processing unit 1300 or the tracking data processing unit 1300 (for convenience, hereinafter referred to as the 'tracking data processing unit'). However, it is not limited to the name of the above configuration, and the scope of rights should be determined by referring to its function or role. The tracking data processing unit 1300 may be implemented as hardware such as a circuit or module or embedded software in one component of the smart shoe system described above. However, the tracking data processing unit 1300 described in FIG. 13 or this specification does not necessarily have to be a component of a smart shoe, and other devices such as a mobile terminal capable of receiving and processing sensing data of the sensors of the smart shoe (including a server) included) may be designed as one configuration.

In this regard, the tracking data processing unit 1300 estimates the moving speed (Velocity (3D)) and the moving direction (Attitude (3D)) of the smart shoe wearer through a sensor module mounted on the smart shoe, and thus the moving distance. (Position (3D)) can be cumulatively calculated.

The tracking data processing unit 1300 may process tracking data for the smart shoe wearer based on sensing data of a sensor module mounted on the smart shoe using the processing unit 1320 and the filter unit 1350. This is related to the PDR algorithm related to the conventional inertial navigation system, and the detailed description thereof uses the description of the conventional PDR algorithm, and the detailed description of the PDR algorithm is omitted here.

A process of processing tracking data through the processing unit 1320 and the filter unit 1350 will be described first.

The processing unit 1320 includes a first processing unit 1322 and a second processing unit 1324 .

The first processing unit 1322 receives data sensed by the first sensor 1312, processes the received sensing data, and outputs the processed data to the first integrator. Here, the first sensor 1312 includes, for example, an accelerator sensor. In particular, the first processor 1322 subtracts gravity from the data sensed by the first sensor 1312 .

The second processing unit 1324 receives data sensed by the second sensor 1314 and processes the received sensing data. The processed data is output to the first processing unit 1322 and the mixer. Here, the second sensor 1314 includes, for example, a gyro sensor. The movement direction data may include yaw data, pitch data, roll data, and the like. The second processing unit 1324 calculates the moving direction A of the insole of the smart shoe based on the data sensed by the second sensor 1314 .

In the above, the output data of the first integrator may itself be movement speed data (V), and the data processed by the second processing unit 1324 may itself be movement direction data (A) of the smart shoe wearer. have.

In the above, data excluding the movement speed data v1 from the output data of the first integrator, that is, the movement distance data p0, is input again to the second integrator and accumulated. The movement speed data v1, output data of the second integrator, that is, movement distance data p1, and movement direction data a1 of the second processor 1324 are input to the filter unit 1350. The filter unit 1350 filters input movement speed data v1, movement distance data p1, and movement direction data a1 using, for example, a Kalman filter mainly used in the aforementioned PDR algorithm. . The input movement speed data v1, movement distance data p1, and movement direction data a1 are filtered in the filter unit 1350 to obtain movement speed data v2, movement distance data p2, and Movement direction data a2 is output. The movement speed data v2, movement distance data p2, and movement direction data a2 thus output are output to the mixer unit 1360.

The mixer unit 1360 includes a first mixer for a movement distance, a second mixer for a movement speed, and a third mixer for a movement direction.

The first mixer mixes the movement distance data p1, which is an output of the second integrator, and the movement distance data p2, which is an output of the filter unit 1350, to calculate final movement distance data P.

The second mixer mixes the movement velocity data v1 extracted from the first integrator with the movement velocity data v2 output from the filter unit 1350 to calculate final movement velocity data V.

The third mixer mixes the movement direction data a1 output of the second processing unit 1324 and the movement direction data a2 output of the filter unit 1350 to calculate final movement direction data A.

When the tracking data processing unit 1300 processes the tracking data for the smart shoe wearer based on the sensing data of the sensor module mounted on the smart shoe by using the processing unit 1320 and the filter unit 1350 of FIG. 13 described above, Sensing data such as the graph of FIG. 14 may be obtained.

However, referring to FIG. 14 , based only on the data sensed by the first sensor 1312 and the second sensor 1314, each step of the smart shoe wearer may not be accurately detected due to the noise area 1410. This is because it is difficult to accurately measure the zero velocity for each step of the wearer according to the influence of the noise, and it is ambiguous to distinguish between the previous step and the next step, so that one step may be missed without being detected. This may not be a big problem when, for example, the wearer of smart shoes is just walking or is in a static state. Also, since the noise may occur at every step, it may cause a large error in the entire data. Therefore, as described above, the error according to the noise area may affect the reliability of the sensed tracking data, causing a problem. On the other hand, in this specification, the noise area 1410 may not necessarily mean only the area where noise occurs, unlike its name, and may mean a point or area where there is a possibility of error occurrence in the data sensing process in relation to the present invention. have.

In order to minimize or eliminate errors due to the aforementioned noise, the present invention further refers to the sensing data of the aforementioned pressure sensor.

Referring to FIG. 13 , the tracking data processing unit 1300 further includes a detection unit 1330 and a fourth mixer 1340 .

The detector 1330 receives data sensed from the third sensor 1316, processes the received data, and outputs the processed data to the fourth mixer 1340. Here, the third sensor 1316 may be the pressure sensor according to the present invention described above. Therefore, here, the detailed description of the pressure sensor is used and omitted from the foregoing. Data sensed by the pressure sensor may be generated for each step of the wearer of the smart shoe, for example. This may be, for example, a graph like FIG. 15 or 16 .

The detector 1330 detects zero velocity from data sensed by the third sensor 1316 and input. This can be easily detected from the graph data as shown in FIG. 14 sensed as the third sensor 1316 operates as a pressure switch according to the wearer's every step.

The zero velocity data z1 detected by the detection unit 1330 is mixed with the movement speed data v1 extracted from the first integrator in a fourth mixer 1340, and the mixed data is the filter unit 1350 ) becomes an input (v1') different from the input (v1). As described above, after filtering in the filter unit 1350, the movement distance (P), movement speed (V), and movement direction (A) data are calculated.

If this is explained with reference to FIGS. 14 and 15, in FIG. 14, a noise area 1410 exists as described above. However, referring to FIG. 15, the data 1510 filtered through the detection unit 1330 and the fourth mixer 1340 cancels the noise as shown in FIG. 14 so that zero velocity is minimized, so that each step is clearly to be recognized and dealt with. Therefore, in the case of the above-described FIG. 14 , a part that may be missed for a specific step that may occur is compensated, and thus accurate data calculation is possible.

Therefore, according to FIG. 16, since the zero velocity is minimized for the movement data of the smart shoe wearer, that is, the movements of the x, y, and z axes, each step can be accurately calculated, based on this, the present invention including the PDR technique According to this, foot angle data or foot angle correction data can be easily and accurately calculated, and as shown in FIG. 16, the wearer's movement trajectory, movement speed, movement direction, step length, report, etc. can be accurately and easily calculated. This can increase the efficiency of the system much more and reduce power consumption compared to the case where correction is required due to accumulated errors because the zero velocity of each step cannot be accurately obtained with only the PDR sensor or the inertial sensor. In addition, when only PDR sensor data is used, wireless positioning correction is required based on Wi-Fi or Bluetooth, but more accurate data sensing is possible without using such a wireless positioning technique when pressure sensor data is also used.

In addition, in relation to step length or reporting, conventionally, an air pressure sensor was used to determine altitude when hiking or using stairs in a building. Due to other factors such as the opening and closing of the air pressure, the change in air pressure was severe and accurate data sensing was impossible, and the reliability of the sensed data was also low. In contrast, in the present invention, by minimizing zero velocity based on sensing data of a simple pressure sensor (pressure switch), it is possible to easily and accurately calculate data without an air pressure sensor or other components.

The tracking data processing algorithm according to the present invention is used for the wearer's exercise information tracking and management service to measure the wearer's calorie consumption, weight change, etc., and also automatically recognizes bike riding, walking, running, etc., and navigates accordingly. A scheduling service is also available. In addition, according to the tracking data processing algorithm according to the present invention, walking posture tracking and management service of wearer (soldiers, etc.), indoor navigation service such as mart, library, public institution, outdoor bicycle, walking navigation accuracy correction Services, tracking history management of walking areas, exercise measurement and management services using stride length and reporting, and wearer tracking management services in areas where GPS or Wi-Fi are unavailable will become possible.

17 is a UX diagram for an example of a service scenario according to an embodiment of the present invention.

17A is a case of walking at an average speed for a moving distance of 10 m, and FIG. 17B is a UX of data acquired through the tracking data processing unit in FIG. 17A. Referring to FIG. 17B , it can be seen that the data acquired through the tracking data processing unit for a movement distance of 10 m in FIG. 17A is 10.072 m.

FIG. 17c is a case of walking at a high speed like an alarm at a moving distance of 10 m, and FIG. 17d is a UX of data acquired through the tracking data processing unit in FIG. 17c. Referring to FIG. 17D , it can be seen that the data acquired through the tracking data processing unit for a movement distance of 10 m in FIG. 17C is 10.066 m.

In addition, FIG. 17E is a UX for stride length, speed, and total distance data accumulated and acquired through the tracking data processing unit for a certain period of time.

18 is a flowchart of a data processing method using a tracking algorithm in a smart shoe system according to an embodiment of the present invention.

According to the present invention, the tracking data processing unit of the smart shoe system receives sensing data from one or more first sensors (S1802), and receives the data sensed based on the operation of the second sensor to obtain zero velocity data. is detected (S1804). Here, the first sensors include, for example, the first sensor (acceleration sensor) and the second sensor (gyro sensor) of FIG. 13 described above. Also, here, the second sensor includes the aforementioned third sensor (pressure sensor) of FIG. 13 .

The tracking data processor removes step noise from the sensing data received from the first sensors based on the detected zero velocity data (S1806). The step noise means noise 1410 shown in FIG. 14, and removing the step noise means processing as in FIG. 15.

The tracking data processing unit filters the sensing data from which the step noise has been removed (S1808).

The tracking data processing unit acquires motion data of the smart shoe based on the filtered sensing data and a predefined threshold (S1810). Here, the predefined threshold may indicate a value according to data normalization according to filtering in the filter unit. As such, normalizing data can help with data management and the like.

19 and 20 are diagrams for explaining a pairing process between a smart shoe and a mobile terminal according to the present invention.

Based on the above-described embodiments, the smart shoe 1910 senses motion data, and the mobile terminal 1920 can obtain meaningful data from the data sensed by the smart shoe 1910 in this way. At this time, in order to smoothly perform data communication between the smart shoe 1910 and the mobile terminal 1920 as described above, a pairing process for data communication between them must be preceded.

For convenience, in this specification, it is assumed that the data communication is based on a Bluetooth communication protocol. Accordingly, pairing for the data communication is also performed according to the definition in the Bluetooth communication protocol. However, here, as described above, the communication protocol is an example of the Bluetooth communication protocol, but the present invention is not limited thereto, and all communications currently defined for data communication, such as Wi-Fi, LTE, and Zigbee A protocol or a communication protocol to be defined in the future may also be included.

Meanwhile, not necessarily one communication protocol is used in the data communication process, but a plurality of communication protocols may be used according to circumstances according to various criteria such as data amount and data property. For example, if a predefined communication protocol exists for emergency data processing or corresponding data processing, such as an emergency alert message (EAS), it may be followed. In addition, if data communication is not smooth depending on the communication environment or the like, other communication protocols may be used.

Referring to FIG. 19A, a first smart shoe sensor module 1912 is mounted on the left (L) smart shoe constituting the smart shoe, and a second smart shoe sensor module 1914 is mounted on the right (R) smart shoe. . The first smart shoe sensor module 1912 and the second smart shoe sensor module 1914 may each have unique identification data according to a communication protocol for data communication. For example, referring to FIG. 19A, the first smart shoe sensor module 1912 has unique identification data called 'SHV-EKJ2KPS' for data communication. And the second smart shoe sensor module 1914 has unique identification data called 'PK-A14TS62' for data communication.

Such unique identification data may be assigned at the time of manufacture according to a method promised or defined in a predefined communication protocol, for example, Bluetooth. Even if such unique identification data is assigned for a specific communication protocol, it can be used as it is when other communication protocols are used, and unique identification data may be assigned for general purposes from the beginning at the time of manufacture. Alternatively, it may be arbitrarily changed for user identification convenience within a range that does not impair a method defined in a data communication or communication protocol by a user in the future.

When the mobile terminal 1920 activates or turns on Bluetooth communication for data communication with the smart shoe 1910, for example, a Bluetooth communication list 1925 that can be connected can be provided on the screen of the mobile terminal as shown in FIG. 19B. have.

Accordingly, the user can perform pairing by selecting a desired device from the list provided on the mobile terminal 1920 . However, at this time, if a password or the like is set for the selected device, the pairing process can be completed through providing an appropriate UX and inputting the password. In addition, when pairing is completed, since it is difficult for the user to identify whether pairing has been properly performed, depending on the system, a UX in the shape of a smart shoe is provided on the screen of the mobile terminal to show the pairing process, or the paired smart shoe vibrates. Feedback can be given to easily recognize the result of the pairing.

Unlike FIG. 19 , in FIG. 20 , automatic pairing may be performed based on a result of a predetermined action of the wearer of the smart shoe, rather than providing a separate list as shown in FIG. 19B . This can help perform pairing more intuitively and conveniently in various situations, such as, for example, inability of a user to input a touch or the like on a mobile terminal, inconvenience, or difficulty in selecting a list when too many devices are provided on the list.

As shown in FIG. 20A, the mobile terminal 1920 requests an additional operation for pairing as shown in FIGS. 20B and 20C, for example, when wearing smart shoes according to a guide on the UX and pressing or selecting Connect. In FIG. 20A, when a request for pairing with a smart shoe is selected in the mobile terminal, in FIG. 20B, it is requested to roll the left foot 3 times to check whether the sensor and application work well. When the smart shoe wearer performs an operation according to the request of the mobile terminal, the left (L) smart shoe sensor module and the mobile terminal are automatically registered and paired. Then, as shown in FIG. 20B, when the operation requested for the right (R) smart shoe sensor module in FIG. 20C is performed, the mobile terminal automatically performs registration and pairing. 20b and 20c are for registering and pairing both smart shoe sensor modules, and the sequence is arbitrary and unimportant. Meanwhile, if the sensor module is mounted on only one side of the smart shoe, only one of FIG. 20b or 20c is sufficient.

20 , for example, a mobile terminal performs not only automatic registration and pairing of sensor modules mounted on smart shoes, but also a function of pre-checking whether smooth data communication is achieved. In addition, since it is difficult for the user to determine whether data sensing is properly performed when the user does not perform the operations shown in FIG. 20 , correction work for more accurate data sensing can be performed through this process. For example, through FIGS. 20B and 20C , the user can intuitively recognize the strength or degree of pressure for recognizing a step, and can independently determine whether a sensor module malfunctions or has an error. Through this, the user may correct the sensing sensitivity of the sensor module according to circumstances. In other words, the sensor module of the smart shoe may have a preset sensing sensitivity and threshold pressure standard based on average data.

However, since the degree of data sensing felt by the corresponding user may be different even according to such a criterion, it can be easily corrected through the process shown in FIGS. 20B or 20C. For example, it is assumed that the user has performed the process of FIG. 20b or 20c for pairing as described above. In the process, if the sense is sensed differently than the smart shoe wearer feels, a threshold pressure correction is requested, and it is provided in a form similar to the UX provided in FIGS. 20B or 20C to adjust the threshold pressure, etc. In this case, the threshold pressure adjusted or corrected by FIG. 20b or 20c is transmitted from the mobile terminal to the smart shoe, and the control unit of the smart shoe appropriately controls the sensor module based on it or reads the data sensed by the sensor module. It can be classified or transformed.

Meanwhile, in FIG. 20 , pairing, etc. is performed to the smart shoe wearer through an operation such as stomp, but the present invention is not limited to the number of stomps or the stomp itself, and through various actions that the wearer of the smart shoe can easily perform. can be performed Meanwhile, in addition to foot stomping, a list for various operations, such as pairing, may be provided, and the pairing process may be performed according to the operation selected by the user. In this case, the operation selected by the user may be used later when the application is executed or to identify the corresponding user. Alternatively, if a signal is continuously received with a smart shoe that is not a predetermined pattern after requesting pairing with the smart shoe, the mobile terminal may automatically pair it. Meanwhile, the mobile terminal may automatically pair a device with the highest signal strength, that is, a smart shoe, upon request for pairing.

Meanwhile, in relation to the present invention, the mobile terminal can distinguish the left (L) smart shoe and the right (R) smart shoe through a predetermined gesture input when the sensor of the smart shoe, in particular, the gyro sensor is 3-axis, and the 9-axis In the case of sensors (3-axis accelerometer sensor, 3-axis gyro sensor, 3-axis geomagnetic sensor), the data received from each sensor module is compared and automatically can be distinguished.

In addition, in a predetermined case, such as registering a smart shoe application as a basic application in a mobile terminal, the mobile terminal locks and releases the mobile terminal, performs a specific function, and performs a specific function based on a predetermined operation of the smart shoe wearer. Execution of an application, control of an executed application, and the like may be performed in various ways.

In addition, request, selection, function execution, etc. related to smart shoes on a mobile terminal can be made in various ways, such as voice, gesture, and eye-tracking, as well as touch of the mobile terminal, or a combination of a plurality of the above methods. have.

However, FIG. 20 may be performed together with FIG. 19 . For example, after pairing through FIG. 19 , actual data communication start or end may be performed through FIG. 20 or vice versa.

Meanwhile, referring to FIGS. 19 and 20 , the mobile terminal 1920 automatically performs pairing with a smart shoe 1910 for the first time or when pairing is performed through a smart shoe application, based on pre-stored pairing data. Pairing can also be performed. However, at this time, when the mobile terminal 1920 uses an application for smart shoes, at the time of initial pairing, a list based on the unique identification data of smart shoe sensor modules as shown in FIG. 19B is provided, but unlike the above, smart shoes Bluetooth unique identification data of non-mobile terminals may be filtered from the list to provide selection convenience. In addition, the automatic pairing described above acquires sensing data, calculates various motion data using a tracking algorithm, and acquires and calculates smart shoe data according to the setting or in consideration of the user's existing usage pattern, even if there is no additional operation or input by the user. , provision of relevant UX, etc. may be performed automatically.

21 and 22 are sequence diagrams illustrating a process of automatically pairing a smart shoe with a plurality of mobile terminals according to an embodiment of the present invention.

For example, FIG. 21 illustrates a pairing process through a gesture between a mobile terminal and smart shoes equipped with a 3-axis sensor, and FIG. 22 illustrates pairing through a gesture between a mobile terminal and smart shoes equipped with a 9-axis sensor. It shows the process.

First, with reference to FIG. 21 , a pairing process between the mobile terminal 2110 and the first smart shoe 2120 and the second smart shoe 2130 through gestures will be described in more detail. At this time, the first smart shoe 2120 represents a left (L) smart shoe including, for example, a 3-axis based smart shoe sensor module, and the second smart shoe 2130 is, for example, a 3-axis based smart shoe sensor. The right (R) smart shoe including the module may be represented.

The mobile terminal 2110 first transmits a pairing start request signal to the first smart shoe 2120 (S2102). At this time, the first smart shoe 2120 transmits the pairing start request signal of the mobile terminal 2110 to the sensor unit and activates it. The first smart shoe 2120 returns a pairing start response signal in response to the pairing start request signal of the mobile terminal 2110 (S2104). Typically, the returned pairing start response signal of the first smart shoe 2120 includes a response agreeing to the pairing start request.

The mobile terminal 2120 then transmits a pairing start request signal to the second smart shoe 2130 (S2106). At this time, the second smart shoe 2130 transmits the pairing start request signal of the mobile terminal 2110 to the sensor unit and activates it. The second smart shoe 2130 returns a pairing start response signal in response to the pairing start request signal of the mobile terminal 2110 (S2108).

Steps S2102 to S2104 or steps S2106 to S2108 are processes performed when the smart shoe sensor module is mounted on the shoe. Therefore, when the sensor module is mounted on both smart shoes, steps S2102 to S2108 may be performed, but when the sensor module is mounted on only one smart shoe, steps S2102 to S2104 or steps S2106 to S2106 are performed. Only certain steps of step S2108 can be performed. Also, the order of steps S2102 to S2104 or steps S2106 to S2108 may be different from that shown.

Steps S2102 to S2108 described above are, for example, a connection step for pairing and can be regarded as an initial pairing step.

In this way, after performing the initial pairing step, the mobile terminal 2110 provides a UX as shown in FIG. 19 or 20 to attempt pairing with the smart shoe.

Specifically, the mobile terminal 2110 first performs an authentication procedure with the first smart shoe 2120 . Referring to FIG. 20 , this authentication is performed by the wearer of the smart shoe stomping the smart shoe on the side corresponding to the first smart shoe a predetermined number of times. At this time, the mobile terminal 2110 counts the number of stampings of the first smart shoe 2120 (S2110), and when the predetermined count is reached, the corresponding smart shoe is authenticated. In this case, the above process may be repeatedly performed in a loop until authentication is successful.

On the other hand, in the authentication process, for example, if authentication fails more than a predetermined number of times or fails to succeed within a predetermined time, the repeated authentication process itself is reset to return to the pairing initialization step or is executed for pairing on the mobile terminal 2110. You can also terminate the execution of the application.

The authentication process for the first smart shoe 2120 of the mobile terminal 2110 is performed in the same way for the second smart shoe 2130 (S2112).

When the pairing authentication process for both smart shoes is completed through steps S2110 and S2112 described above, the mobile terminal 2110 transmits a pairing stop request signal to each smart shoe 2120 and 2130 (S2114 and S2118), and the corresponding A response signal to the pairing stop request signal is received from each of the smart shoes 2120 and 2130 (S2116 and S2120).

Through the above process, the pairing process is completed and data communication is performed between the mobile terminal 2110 and the smart shoes 2120 and 2130 .

Meanwhile, the process shown in FIG. 21 is not necessarily limited to the shown order. For example, steps S2106 to S2108 may be performed after step S2110 or step S2114.

Next, with reference to FIG. 22 , a pairing process through gestures between the mobile terminal 2110 and the first smart shoe 2120 and the second smart shoe 2130 will be described in more detail. At this time, the first smart shoe 2120 represents a left (L) smart shoe including, for example, a 9-axis based smart shoe sensor module, and the second smart shoe 2130 is, for example, a 9-axis based smart shoe sensor. The right (R) smart shoe including the module may be represented.

22 , the initial stage of pairing between the mobile terminal 2110 and the smart shoes 2120 and 2130 is the same, so the contents described in FIG. 21 are used and repeated description will not be made. However, there may be more sensors activated based on 9-axis sensors in the initial pairing stage in FIG. 22 than sensors activated based on 3-axis sensors in the initial stage of pairing in FIG. 21 .

Meanwhile, in FIG. 22 , after the initial pairing step, that is, a pairing authentication process is different from that of FIG. 21 . For example, in FIG. 21, the mobile terminal 2110 provides an authentication UX and accordingly receives a gesture input of a smart shoe, but in FIG. 22, a different method is used. In other words, the mobile terminal 2110 first detects at least one of the first smart shoe 2120 and the second smart shoe 2130 (S2210).

The mobile terminal 2110 authenticates the searched smart shoes. At this time, it is assumed that both the first smart shoe 2120 and the second smart shoe 2130 are searched. The mobile terminal first calculates the trace of the first smart shoe 2120 (S2212), and calculates the same trace for the second smart shoe 2130 (S2214). Then, the mobile terminal 2110 compares the traces calculated for the searched first smart shoe 2120 and the second smart shoe 2130 (S2216). Here, the mobile terminal 2110, for example, calculates the trace of each smart shoe previously stored in the mobile terminal 2110 (or server, etc.) for authentication and the trace of each smart shoe calculated through steps S2212 and S2214. Calculated values can be compared. However, the present invention is not limited thereto, and in relation to the comparison, various objects capable of recognizing or authenticating each smart shoe may be used.

As a result of the comparison in step S2216, the mobile terminal 2110 may re-perform the above-described authentication process for the corresponding smart shoe or all smart shoes when authentication has failed for at least one of the smart shoes. In other words, the authentication process may be repeatedly performed in a loop structure. Meanwhile, this repetition may be performed only for a predetermined number of times, and the entire pairing process may be reset and re-performed for the smart shoes that finally fail authentication or for all smart shoes.

The mobile terminal 2110 proceeds to the next procedure when each smart shoe is authenticated as a result of the comparison in step S2216. Referring to FIG. 22, the mobile terminal 2110 transmits a 'LEFT' request allocation signal to the first smart shoe 2120 (S2218), and the first smart shoe 2120 sends a 'LEFT and Stop' corresponding allocation signal. Returns (S2220). The request-response process for the first smart shoe is performed in the same way for the second smart shoe (S2222 and S2224).

Through the above process, the pairing process between the mobile terminal 2110 and the smart shoes 2120 and 2130 equipped with the 9-axis sensor can be completed, and data communication can be performed after the pairing is completed.

The above-described pairing process between a smart shoe equipped with a 3-axis sensor and a smart shoe equipped with a 9-axis sensor and a mobile terminal shown in FIGS. 21 and 22 is only an embodiment and is not necessarily limited to the illustrated sequence. In addition, each pairing sequence shown in FIGS. 21 and 22 may not necessarily be an essential sequence, and at least one sequence may be omitted or skipped, and conversely, at least one sequence may be added depending on the system or situation.

Among the processes shown in FIG. 21 , the processes for the first smart shoe 2120 and the second smart shoe 2130 may be performed in reverse. For example, in FIG. 21, the first smart shoe 2120 accesses the mobile terminal first compared to the second smart shoe 2130, but it may be the opposite. This is also true of FIG. 22 .

On the other hand, although the present specification assumes and describes the case where the sensor module is mounted on both smart shoes, even so, as shown in FIGS. 21 and 22, pairing initialization, pairing authentication, etc. does not have to be performed. For example, when the pairing process is completed for one smart shoe, the other shoes may be automatically paired as a set or pair without a process such as authentication. If there is an error or problem in the data communication process later, it is enough to resolve it through new authentication or re-authentication.

In the present specification, in particular, seamless data communication between smart terminals will be described. Here, smart terminals include all terminals capable of data communication through wired/wireless communication means, such as, for example, smart phones, tablet PCs, wearable devices, PCs, laptops, and digital TVs. However, for convenience, at least one reference smart terminal and one or more smart shoes will be described in this specification. However, the smart terminal is not limited to the above examples.

Meanwhile, in the present specification, the data communication process between the smart terminals uses a data compression method according to various standards in the present invention. Such data compression may shorten the data communication time to increase system efficiency and may be an embodiment for realizing low power required for the smart terminals. In addition, in the present invention, by providing an intuitive and highly visible user interface based on data obtained through data communication between the smart terminals, it is intended to increase the convenience of smart terminal users and increase the desire to purchase products. .

With reference to the following drawings, seamless data communication between smart terminals will be described. At this time, it is assumed that the smart terminals are basically registered with each other with reference to at least one of FIGS. 19 to 22 .

Data communication between these smart terminals can be largely divided into a case without a standard smart terminal or server and a case with a standard smart terminal or server.

The former may mean data communication between smart shoes.

In the latter, the reference smart terminal may be a smart phone, a tablet pc, a laptop computer, a digital TV, a PC, and the like. For convenience, a smart phone will be described as an example in this specification. Meanwhile, here, the smart phone may download and install an application (eg, a smart shoe application) related to data processing of smart shoes according to the present invention.

On the other hand, data communication between smart terminals in this specification may be based on various wired / wireless communication protocols such as BT (Bluetooth), BLE (Bluetooth Low Energy), ZigBee, Wi-Fi, Wi-Fi Direct, but the understanding of the present invention For convenience of description, the BLE communication protocol will be described as an example in consideration of the low power of smart terminals, especially smart shoes.

23 and 24 are diagrams for explaining a data communication process between smart shoes according to an embodiment of the present invention.

23 and 24 describe a data communication process between smart terminals, that is, smart shoes. Here, data communication between the smart shoes may be performed by, for example, a contact/non-contact method between the smart shoes. The contact refers to a method of directly contacting a smart shoe with another smart shoe. In addition, the non-contact method refers to automatically transmitting and receiving data from one smart shoe to another smart shoe as a smart shoe user goes in/out of a specific event or a specific location such as a gesture, button, voice, handle, weight, etc. say

Briefly, the scenario is described with reference to FIG. 23 as follows. Here, for convenience, three shoes of a user are taken as an example in FIGS. 23 and 24 .

23 and 24, there are a first smart shoe (shoes) 2310, a second smart shoe (slipper) 2320, and a third smart shoe (sneakers) 2330, and for convenience, they are the same user's smart shoes. It is assumed that the first smart shoe 2310 is a reference smart shoe. The reference smart shoe may refer to a smart shoe that serves as a reference in data communication with other smart shoes or receives data from other smart shoes. Alternatively, a smart shoe having a relatively larger memory capacity than other smart shoes may be the reference smart shoe.

Hereinafter, in the present specification, “put-on” refers to a case in which motion data sensed by a pressure sensor provided in a smart shoe is collected as a user wearing smart shoes moves, and take- By take-off, I mean the opposite. In other words, take-off refers to a case in which motion data is no longer collected from the corresponding smart shoe, such as, for example, when there is no movement of the user wearing the smart shoe or the user takes off the corresponding smart shoe.

First, referring to FIG. 23, it is as follows.

When the second smart shoe 2320 is put-on, the second smart shoe 2320 transmits a first message including a request for at least one of put-on and pairing to the first smart shoe 2310 ( S2302). Here, messages exchanged between smart terminals in the present specification may be defined in a specific communication protocol, for example, and may be, for example, an advertisement message based on a BLE protocol. When the first message is received from the second smart shoe 2320, the first smart shoe 2310 parses or decodes the received first message and pairs with the second smart shoe 2320. It does (S2304). After the foot-on, the second smart shoe 2320 compresses and stores data collected through sensors including a pressure sensor. Then, when the second smart shoe 2320 is taken off, it can request its take-off and unpairing/unpairing to the first smart shoe 2310 (S2306). At this time, the second smart shoe 2320 may transmit the data collected and compressed and stored to the first smart shoe 2310 (or server) at the same time or before the step S2306, that is, unpairing. Here, the step S2306 may also be performed in the form of the message described above.

When the third smart shoe 2330 is put on, the same process as the data communication between the first smart shoe 2310 and the second smart shoe 2320 described above may be performed.

For example, when the third smart shoe 2330 is put on, the third smart shoe 2330 sends a second message including a request for at least one of the put-on and pairing request to the first smart shoe 2310. It is transmitted to (2308). When the second message is received, the first smart shoe 2310 parses or decodes the received second message and pairs it with the third smart shoe 2330 (S2310). Then, when the third smart shoe 2330 is taken off, it can request its own take-off and unpairing/unpairing to the first smart shoe 2310 (S2312). Similarly, at the same time as or before the step S2312, that is, the unpairing, the third smart shoe 2330 may transmit the data collected and compressed until then to the first smart shoe 2310 (or server). Here, the step S2312 may also be performed in the form of the message described above.

Meanwhile, when a message is received from the second smart shoe 2320 and/or the third smart shoe 2330, the first smart shoe 2310 may perform registration and authentication of the corresponding smart shoe. Here, if the smart shoe that sent the message is not registered with the first smart shoe 2310 or is registered but fails to authenticate, the processes of FIGS. 19 to 22 may be performed. However, if the corresponding smart shoe fails to register or authenticate without performing the processes of FIGS. 19 to 22, the process may be terminated without pairing.

23, the third smart shoe 2330 also transmits the message to the first smart shoe 2310, which is the standard smart shoe, but if the smart shoe that was put on immediately before is the second smart shoe 2320, the first smart shoe 2320 The message may be transmitted to the second smart shoe 2320 instead of the shoe 2310.

Meanwhile, pairing between smart shoes in FIG. 23 may be for data transmission/reception between the smart shoes, for example. Therefore, as will be described later, if there is a separate reference smart terminal other than smart shoes, even though they have been put on before or there are smart shoes around, they do not transmit/receive messages or perform pairing/unpairing processes. Maybe not.

In FIG. 24 , the data communication process between each smart shoe is basically the same as the data communication process between the smart shoes of FIG. 23 described above. However, in FIG. 23 described above, the first smart shoe 2310 always serves as a reference smart terminal as a reference between other smart shoes and receives compressed data, but in FIG. 24, for example, the currently put-on smart shoe It is different in that it serves as a standard smart terminal. Hereinafter, among the processes of FIG. 24, processes overlapping with those of FIG. 23 are omitted or simplified, and different process(s) will be mainly described.

The first smart shoe 2310 stores data collected and sensed through a pressure sensor provided in the smart shoe according to the user's movement in a memory. In this case, the motion data described in this specification may be stored in the memory as raw data, or may be compressed or double-compressed and stored in the memory.

Steps S2402 to S2406 in FIG. 24 are the same as steps S2302 to S2306 in FIG. 23 described above. However, the second smart shoe 2320 may directly transmit the first message related to its put-on and pairing request to the previously put-on first smart shoe 2310 in step S2402, but collectively broadcast )You may. In the case of the direct transmission, the second smart shoe 2320 should know that the previous put-on smart shoe is the first smart shoe 2310. In this regard, the first smart shoe 2310 is a take-off You can also broadcast your own take-off fact at the same time. Meanwhile, unlike FIG. 23 , in FIG. 24 , the second smart shoe 2320 may not necessarily inform the first smart shoe 2310 of its own take-off fact. Meanwhile, as described above, in FIG. 24, the currently put-on smart shoe performs the function of the reference smart terminal, and the second smart shoe 2320 transmits the first message to the first smart shoe ( 2310) may receive pre-stored motion data (S2406). The second smart shoe 2320 stores motion data in the memory periodically/non-periodically after the foot-on. At this time, the compressed data received from the first smart shoe 2310 through step S2406 is also divided into memory or can be compressed together.

In the same way, steps S2408 to S2412 in the third smart shoe 2330 are almost the same as steps S2402 to S2406 described above. However, in steps S2408 to S2412, since the third smart shoe 2330 is currently put-on, it becomes a reference smart terminal, and the compressed data received from the second smart shoe 2320 is, for example, of the first smart shoe 2310. It can even include motion data.

On the other hand, referring to FIGS. 23 and 24, registration or data transmission between smart shoes includes gestures, buttons, voices, handles, weights, LBS (Local based System) or in-out for a specific location, etc. It can be performed manually or automatically according to various events.

25 and 26 are diagrams for explaining a data communication process between smart terminals according to an embodiment of the present invention.

25 and 26 are diagrams for explaining a method of data communication between smart shoes and a smart terminal, that is, a smart phone. Here, the smart phone is named and described as a reference smart terminal.

In FIGS. 25 and 26 , it is assumed that all smart shoes have been pre-registered or have gone through registration and authentication processes with reference to the reference smart terminal and FIGS. 19 to 22 .

25 and 26 , the smart terminal service system includes a reference smart terminal 2510, a first smart shoe 2520, a second smart shoe 2530, and a third smart shoe 2540.

First, referring to FIG. 25 , when a first smart shoe 2520 is put-on, the first smart shoe 2520 sends a first pairing request to the reference smart terminal 2510 including at least one of put-on and pairing request. The message is transmitted (S2502).

When the first message is received from the first smart shoe 2520, the reference smart terminal 2510 checks whether the corresponding smart shoe is registered and performs pairing (S2504).

Then, when the first smart shoe 2520 is taken off, it notifies the reference smart terminal 2510 that it has been taken off and requests unpairing (S2506).

Meanwhile, the first smart shoe 2520 collects motion data from the moment of sensing the second pressure at the same time as the time of putting-on or after sensing the first pressure until take-off, and compresses and stores the motion data in memory. For convenience, it is named and described as first data.

The first smart shoe 2520 may transmit the compressed and stored first data to the reference smart terminal 2510 at the same time as or immediately before the take-off reporting and unpairing time.

The second smart shoe 2530 and the third smart shoe 2540 also perform the same process as the data communication process between the first smart shoe 2520 and the reference smart terminal 2510 described above.

In other words, when the second smart shoe 2530 is put on, a second message is transmitted from the second smart shoe 2530 to the reference smart terminal 2510 (S2508).

When the second message is received, the reference smart terminal 2510 determines whether the second smart shoe 2530 is registered and then pairs with the second smart shoe 2530 (S2510).

The second smart shoe 2530 collects, compresses and stores its own motion data in the same way as the first smart shoe 2520 described above, and when taken off, indicates that it has been taken off to the reference smart terminal 2510. and transmits motion data (second data) pre-stored by itself along with an unpairing request to the reference smart terminal 2510 (S2512).

In addition, when the third smart shoe 2540 is put on, a third message is transmitted from the third smart shoe 2540 to the reference smart terminal 2510 (S2514).

When the third message is received, the reference smart terminal 2510 determines whether the third smart shoe 2540 is registered and then pairs with the third smart shoe 2540 (S2516).

The third smart shoe 2540 collects and compresses its own motion data in the same way as the first smart shoe 2520 and the second smart shoe 2530 described above, and the third smart shoe 2540 takes -If it is turned off, it reports that it has been taken off to the reference smart terminal 2510 at that time, and transmits motion data (third data) pre-stored by itself to the reference smart terminal 2510 along with an unpairing request. It does (S2518).

In FIG. 25, each smart shoe compresses and stores motion data collected after foot-on in memory, and compresses and stores the motion data pre-compressed and stored before unpairing with the reference smart terminal at the time of take-off. send to terminal

Next, in FIG. 26 , instead of each smart shoe directly transmitting compressed and stored motion data to the reference smart terminal as in FIG. 25 described above, the previous put-on smart shoe transmits itself to the next put-on smart shoe The compressed and stored motion data is transmitted, and the last put-on smart shoe transmits the compressed and stored motion data received from the previous smart shoe and its own motion data to the reference smart terminal 2510 at once. Meanwhile, the last put-on smart shoe is determined, for example, if there is no smart shoe put-on within a predetermined time after the take-off of the previous put-on smart shoe, the smart shoe may be determined as the last smart shoe. . Alternatively, based on a predetermined time criterion, for example, 24 o'clock, the last smart shoe put-on and/or taken-off before the standard time may be determined as the last smart shoe.

Here, steps S2602 to S2612 of FIG. 26 are the same as steps S2402 to S2412 of FIG. 24 , for example. After the step S2612, if the corresponding smart shoe is determined to be the last smart shoe, the compressed and stored motion data is transmitted to the reference smart terminal 2510 at a predetermined time (S2614). At this time, the motion data transmitted from the last smart shoe 2540 includes at least one of the first smart shoe 2520 and the second smart shoe 2530 in addition to the motion data of the third smart shoe 2540. Motion data is further included.

In FIGS. 25 and 26 , data transmission may be performed at the same time as or before the time of unpairing when the corresponding smart shoe is taken off, as shown.

Meanwhile, in FIG. 25, motion data stored in each smart shoe is not taken off and transmitted to the reference smart terminal at the same time as or before unpairing, but at that time if the reference smart terminal is taken-off or corresponding If the smart shoe application is inactive in the reference smart terminal, the data stored in the corresponding smart shoe may be transmitted to the server or the next smart shoe as shown in FIG. 26 at the same time as or before the unpairing time. . Alternatively, the smart shoe stores motion data, and when the power of the reference smart terminal is turned on, the smart shoe application is executed in the reference smart terminal, or the smart shoe is put on again, the device Motion data being stored may be transmitted to the reference smart terminal.

27 and 28 are diagrams for explaining a data communication process between smart terminals according to another embodiment of the present invention.

27 and 28 , the smart terminal service system includes a server 2710, a smart phone 2720, and smart terminals 2730 and 2740. Here, the server 2710 may correspond to the reference smart terminal in FIGS. 25 and 26 . Meanwhile, the server 2710 includes a processor capable of storing data and communicating, like a cloud server.

Steps S2702 to S2712 of FIG. 27 are the same as steps S2502 to S2512 of FIG. 25 described above. However, it may be different that the server (reference smart terminal) 2710 performs data communication with the smart shoes 2730 and 2740 in FIG. 27 instead of the smartphone (reference smart terminal) 2510 in FIG. 25. only

During or after data communication including motion data is performed between the above-described server 2710 and the smart shoes 2730 and 2740, the smart shoe application is executed on the smart phone 2720 (S2714), and the smart phone When data is requested from the server 2710 in 2720 (S2716), the server 2710 transmits the received and compressed motion data of the smart shoes 2730 and 2740 to the smartphone 2720. (S2718).

On the other hand, the server 2710 may check whether the corresponding smart shoe that has sent the message is registered or not, and make a response such as confirmation. At this time, the server 2710 may use the smartphone 2720 for the registration and the like. Meanwhile, the server 2710 may pair or control the first smart shoe 2730 directly, using at least one of a smartphone 2720, a repeater (not shown), and other communication servers.

In addition, the server 2710 may wait after storing the data of the first smart shoe 2730 and the second smart shoe 2740 at a predetermined address through steps S2702 to S2712 described above. After that, the reference smart terminal 2720 is turned on or, as shown, the smart shoe application is executed in the reference smart terminal 2720 (S2714), or as shown after the execution, the reference smart terminal 2720 When the data of the smart shoes stored from is requested (S2716), the stored data can be transmitted to the reference smart terminal 2720 (S2718).

In other words, in FIG. 27 , the server 2710 does not transfer the data received from the smart shoes to the reference smart terminal 2720 every time, but when there is a request from the reference smart terminal 2720 or at a predetermined point in time (eg, one day). Only once at 9:00 p.m., etc.) and transmits the saved data.

28 shows that the process of transmitting and receiving data between the server 2710 and the first smart shoe 2730/second smart shoe 2740 is the same as that of FIG. 27, but in FIG. Each corresponds to steps S2702 to S2706 and steps S2708 to S2712 of FIG. 27, and detailed descriptions thereof are omitted and the above description is used.

However, in FIG. 28, after the server 2710 receives data from the first smart shoe 2730 and stores it in a specific address, at least one of the stored fact, the stored specific address information, or the stored data is directly transferred to the smartphone. It can be transmitted to (2720) (S2808). This is also true for step S2816 for the second smart shoe 2740.

In other words, in FIG. 28 , the server 2710 may transmit data to the reference smart terminal 2720 after storing or immediately whenever data is received from the smart shoes. On the other hand, this is also the case when a plurality of messages are received from one smart shoe.

In FIG. 28, when the reference smart terminal 2720 receives the data in this way, it stores it in memory, and then, when the smart shoe application is executed, it reads the data stored in the memory to construct a user interface (UI) as shown in FIG. 29. can provide

Meanwhile, although not shown, when each put-on smart shoe transmits a message to the server, the server transmits the message to the smart phone, and the smart phone can determine whether to register the smart shoe and pair. Afterwards, the motion data of the smart shoe may be transmitted directly to the smartphone or through a server. In other words, the server receives the message of the smart shoe, receives and stores the motion data, and processes or determines whether to register the smart shoe, pairing, etc. according to the reception of the message can be made by the smartphone or by it. Alternatively, as shown in FIGS. 25 and 26, each of the put-on smart shoes sends and receives messages directly with the smartphone, checks whether they are registered, and performs pairing, but uploads only motion data to the server and later, at the request of the smartphone or smart shoes. It can also be downloaded by executing a smart shoe application installed on the phone.

In the above, the smart terminals (including the reference smart terminal) exchange data with each other through the BLE communication protocol, but the server 2710 may use a different communication method. For example, the server 2710 classifies and stores data received from smart terminals at specific addresses, and transmits only the extensible markup language (xml) address corresponding to the specific address when transmitting to the reference smart terminal 2720, and actually Data may not be transmitted. Accordingly, the reference smart terminal 2720 can access the delivered xml address to download and use actual smart shoe data.

On the other hand, although not shown, data communication between the aforementioned smart terminals may be achieved by combining at least two or more of the methods shown in FIGS. 23 to 28 with each other.

For convenience, only two or three smart shoes among smart terminals are illustrated in FIGS. 23 to 28 , but the present invention is not limited thereto and may be applied to a larger number of smart shoes in the same or similar manner. In addition, although only one server or smartphone was exemplified above, there may be a plurality of them, and the above-described process may be applied in the same or similar manner to other smart terminals as well as the smart shoes.

29 is a diagram illustrating an example of a user interface provided by a smart terminal based on smart shoe data according to an embodiment of the present invention.

FIG. 29 illustrates user interfaces configured based on data collected by at least one of FIGS. 23 to 28 through a smart shoe when a smart shoe application is executed in a reference smart terminal.

29A illustrates a screen on which a smart shoe application is executed in a reference smart terminal, that is, a screen before a smart shoe is connected to a user interface screen of the smart shoe application.

Meanwhile, FIG. 29b shows a user interface in a paired state with a first smart shoe, FIG. 29c shows a user interface in a state in which a second smart shoe is paired, and FIG. 29d shows a user interface in a state in which a third smart shoe is paired. example is shown. As described above, FIG. 29C shows a case where the second smart shoe is paired. In this case, the data provided by the user interface may be provided based on motion data collected from the paired second smart shoe or the previous pairing. It may be based data including motion data collected from the first smart shoe. 29d may also be the same as that of FIG. 29c described above.

On the other hand, although not shown, in FIGS. 29B to 29D, only icons indicating currently paired smart shoes are displayed on the screen, but in contrast, in FIGS. 29C and 29D, icons indicating previously paired smart shoes will also be provided. can Therefore, in FIG. 29c or 29d, for example, it is possible to check the smart shoes worn on the corresponding day at once, and at this time, the previously worn smart shoes except for the paired smart shoes worn by the user are deactivated to provide the smart shoes currently worn to be identifiable. You may. Through this, if a smart shoe other than the smart shoe currently being worn is activated, the user can intuitively know the error and take immediate action on data errors. In addition, the reference smart terminal accesses FIGS. 29B to 29C in response to a user input of a left and right swipe method, for example, even when the screen of FIG. 29D is currently being provided through the smart shoe terminal, and acquired through previously worn smart shoes. You can check the motion data immediately.

30 is a flowchart illustrating an algorithm for collecting and storing data in a smart shoe according to an embodiment of the present invention.

Referring to FIG. 30 , the smart shoe collects motion data through a pressure sensor (S3002), and grasps a user's movement from the collected motion data. At this time, the algorithm used may use, for example, the algorithm described below in FIG. 13 described above (S3004).

Afterwards, the smart shoe stores the motion data collected and identified in this way (S3006). At this time, the smart shoe compresses and stores the motion data during the storage.

In the present specification, data communication between smart terminals in a wireless environment (eg, BLE communication protocol) has been described as an example. The BLE communication is particularly advantageous for low power consumption, but the BLE communication method such as BLE beacon and BLE speaker has a bandwidth (BW: BandWidth) less than 1/100 of that of general BT, so data transmission and reception time may be longer. As a result, current consumption increases, which may rather increase power consumption. Therefore, in the present specification, when storing data collected from smart shoes in memory, it is intended to minimize the limitation according to the bandwidth (BW) by compressing or double-compressing it. Here, the compression or double compression method may use a known compression technique. Meanwhile, since motion data collected through smart shoes is binary data, compression efficiency is very good. For example, about 98% of conventional non-compressed raw data can be compressed. Meanwhile, the compression or double compression is preferably a lossless compression or double compression method. In this way, through compression or double compression, the transmission time is greatly reduced even when synchronization of data has not been performed for a long time (eg, about a month) or when data is transmitted with , even if it takes about 10 seconds or more, (Hang) processing can be prevented, and transmission power, which consumes the most current in a wireless environment, can be minimized, thereby contributing to low power consumption.

Meanwhile, data compression in this specification may not compress all raw data, for example. In other words, if all of the raw data is not compressed, which data to compress may be a problem. After all, how smart shoes sort data and what meaningful data to extract and compress from the sorted data may depend on various criteria. Based on these criteria, for example, smart shoes are located in a specific location, enter or exit a specific area, a specific event occurs in a smart shoe, the network environment is unstable or the data transmission speed is below a predetermined value, the amount of data is above a predetermined value, Data compression can be performed according to the remaining battery level of smart shoes below a predetermined value and other time zones (compression only during the day, raw data used at night). In addition, the corresponding data may be compressed by classifying cases in which the state of a user wearing smart shoes is changed, such as sitting, standing, walking, or running.

Meanwhile, before the smart shoe battery is discharged, data may be compressed or double-compressed and stored, and transmitted to a reference smart terminal or server. However, at this time, if the data that could not be transmitted uses a flash memory for the memory of the smart shoe, there is no fear of data loss even if the transmission fails.

Meanwhile, in the present specification, a case in which only one smart shoe is turned on among a plurality of smart shoes is mainly described, but is not necessarily limited thereto. In other words, at least two or more smart shoes may be simultaneously turned on for a predetermined time, and even in this case, processing may be performed according to the processes described above through this specification. In addition, in the present invention, the left (L) smart shoe and the right (R) smart shoe constituting the smart shoe are described without being particularly distinguished, but they can be processed using the above-described method.

According to the various embodiments of the present invention described above, each or a combination thereof, it is possible to achieve seamless data communication between smart terminals, and by compressing data according to various standards in the data communication process between the smart terminals The efficiency of the system can be increased by shortening the data communication time, and low power required for the smart terminals can be realized through this, and the intuitive and highly visible user can use data obtained through data communication between the smart terminals. interfaces can be provided.

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

The above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

240: sensor unit 243: motion sensor
244: acceleration sensor 245: gyro sensor
246: pressure sensor 270: memory
280: control unit 290: power supply unit
310: outsole frame 311: insole
312: midsole 313: outsole
630: conductive member 650: main board
651: first circuit part 6511: contact terminal

Claims (12)

In a smart terminal that performs data communication with a wearable device,
Memory;
a communication unit that transmits and receives signals with the wearable device;
After controlling execution of a wearable device application, receiving a first message regarding a put-on and pairing request from the wearable device, and determining whether to register the wearable device in the mobile terminal based on the received first message, the determination Pairing with a corresponding wearable device according to the result, receiving motion data from the wearable device after the pairing, receiving a second message about a take-off and unpairing request from the wearable device, and based on the received second message a control unit controlling unpairing with a corresponding wearable device; and
An output unit for outputting a GUI (Graphic User Interface) based on the wearable device application execution screen and the received motion data;
The motion data,
Collecting motion data of a pressure sensor provided in the wearable device, determining a motion of a user wearing the wearable device from the collected motion data, classifying and storing the collected data according to a result of determining the motion of the user, ,
The classified motion data,
A smart terminal that is compressed or double-compressed based on a communication protocol and transmission/reception power between the wearable device and the smart terminal. According to claim 1,
The motion data,
The smart terminal, characterized in that received at the same time or before the unpairing according to the reception of the second message. delete delete According to claim 1,
The control unit,
When the wearable device application is executed,
The smart terminal, characterized in that for requesting motion data from the wearable device, analyzing the motion of the wearer of the wearable device based on the received motion data, configuring and outputting the GUI based on the analysis result. A sensor unit that collects motion data;
Memory,
A communication unit that sends and receives signals to and from the smart terminal, and
A control unit for generating and transmitting a first message related to a put-on and pairing request, generating and transmitting a second message related to a take-off and unpairing request, and controlling transmission of the collected motion data to a smart terminal. wearable device; and
Memory,
a communication unit that transmits and receives signals with the wearable device;
Control the execution of a wearable device application, receive a first message from the wearable device, determine whether or not to register the wearable device in the mobile terminal based on the received first message, and pair with the wearable device according to the determination result After the pairing, a control unit for receiving motion data from the wearable device, receiving a second message from the wearable device, and controlling unpairing with the corresponding wearable device based on the received second message; and
A smart terminal including an output unit for outputting a GUI (Graphic User Interface) based on the wearable device application execution screen and the received motion data,
The control unit of the wearable device,
Motion data is collected through the pressure sensor of the sensor unit, motion of a user wearing the wearable device is determined from the collected motion data, and the collected motion data is divided into the memory according to a result of determining the motion of the user and storing the classified motion data based on a communication protocol and transmission/reception power between the wearable device and the smart terminal and controlling the motion data to be compressed or double-compressed and stored in the memory. According to claim 6,
The smart terminal,
The smart terminal service system, characterized in that the motion data is received at the same time as or before unpairing according to receiving the second message from the wearable device. delete delete According to claim 6,
The control unit of the smart terminal,
When the wearable device application is executed, requesting motion data from the wearable device, analyzing the motion of the wearer of the wearable device based on the received motion data, configuring and controlling the GUI based on the analysis result to output the Characterized by a smart terminal service system. According to claim 1,
The smart terminal, characterized in that the wearable device is one of smart shoes, smart watches, smart glasses, HMDs, EMDs, and smart clothes. According to claim 6,
The smart terminal service system, characterized in that the wearable device is one of smart shoes, smart watches, smart glasses, HMDs, EMDs, and smart clothes.

Images