[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Next Article in Journal
Laser Scanner-Based Hyperboloid Cooling Tower Geometry Inspection: Thickness and Deformation Mapping
Previous Article in Journal
Cubature Kalman Hybrid Consensus Filter for Collaborative Localization of Unmanned Surface Vehicle Cluster with Random Measurement Delay
Previous Article in Special Issue
Development of Surface EMG for Gait Analysis and Rehabilitation of Hemiparetic Patients
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The FeetMe® Insoles System: Repeatability, Standard Error of Measure, and Responsiveness

1
Pôle Parasport—ISPC Synergies, CHU Raymond Poincaré, APHP, 92380 Garches, France
2
Service de Médecine Physique et Réadapatation Locomotrice et Respiratoire, CHU Nantes, Nantes Université, 44093 Nantes, France
3
Movement-Interactions-Performance (MIP), EA 4334, CHU Nantes, Nantes Université, 44000 Nantes, France
4
U1179 Endicap, UVSQ, 78000 Versailles, France
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(18), 6043; https://doi.org/10.3390/s24186043
Submission received: 12 July 2024 / Revised: 3 September 2024 / Accepted: 17 September 2024 / Published: 18 September 2024

Abstract

:
Background: Three-dimensional motion analysis using optoelectronic cameras and force platforms is typically used to quantify gait disorders. However, these systems have various limitations, particularly when assessing patients in an ecological environment. To address these limitations, several wearable devices have been developed. However, few studies have reported metrological information regarding their repeatability and sensitivity to change. Methods: A healthy adult performed 6 min walking tests with FeetMe® system insoles under different walking conditions overground and on a treadmill. The standard error of measurement (SEM), the minimum detectable differences (MDDs), and the effect size (ES) were calculated for spatio-temporal parameters, and the ground reaction force was calculated from the 16,000 steps recorded. Results: SEM values were below 3.9% for the ground reaction force and below 6.8% for spatio-temporal parameters. ES values were predominantly high, with 72.9% of cases between overground and treadmill conditions with induced asymmetry, and 64.5% of cases between treadmill conditions with and without induced asymmetry exhibiting an ES greater than 1.2. The minimum detectable differences ranged from 4.5% to 10.7% for ground reaction forces and 2.1% to 18.9% for spatio-temporal parameters. Conclusion: Our study demonstrated that the FeetMe® system is a reliable solution. The sensitivity to change showed that these instrumented insoles can effectively reflect patient asymmetry and progress.

1. Introduction

Three-dimensional (3D) analysis of movement using optoelectronic cameras and force platforms is commonly used to quantify gait parameters for monitoring gait disorders and their therapeutic management [1]. Although three-dimensional motion analysis in a laboratory setting enables physiologically realistic quantification through the use of biomechanical models [2] and repeatable protocols [3], this assessment only reflects a portion of a patient’s locomotor potential.
Analysis of walking with wearable sensors offers the possibility of quantifying movement in environments typically encountered by a patient, such as slopes, descents, inclines, holes, etc. These sensors also enable the collection of a greater number of steps, making it possible to quantify spatio-temporal fluctuations in order to understand motor control during walking, or to quantify the effect of therapeutic treatments [4,5,6,7,8]. Del Din et al. proposed an analysis of the relevance, validity, and interest of using an inertial measurement unit (IMU) positioned at the lumbar level to quantify the gait of Parkinson’s disease patients [4]. This comparative work on numerous gait parameters highlights that an IMU placed at this location does not provide the precision expected by clinicians but allows the detection of movement situations. According to these authors, the use of embedded sensors facilitates monitoring of movement quantity, particularly for the studied population. This work underscores the scientific community’s interest in evaluating these new technological solutions for clinical use. This point is also emphasized by other authors [1], who recommend, in addition to clinical gait disorder analysis service management, that the reliability of data collected by these solutions is paramount.
Over the last decade, a number of wearable devices were designed to quantify the spatio-temporal parameters of walking [9]. These authors have analyzed the use and characteristics of existing solutions such as instrumented socks and insoles for quantifying gait parameters and foot pressure. Although this analysis provides researchers with a comprehensive view of existing solutions, it is also necessary for the scientific community to continue testing the practical validity of these solutions independently of their metrological precision.
Among recent devices, instrumented insoles (FeetMe® Monitor, Paris, France; Loadsol® Novel, Munich, Germany; and Xsensor®, Calgary, Canada) appear to be attractive and reliable solutions for quantifying gait cycle parameters and offer an estimation of ground reaction forces [10,11,12,13,14,15,16,17,18,19,20]. To integrate instrumented insoles into the ecosystem of 3D motion analysis laboratories [20], it is crucial to conduct metrological validations of these sensors in accordance with COSMIN recommendations [21]. McGinley et al. conducted a literature review to evaluate the reliability of joint kinematic measurements using biomechanical models with optoelectronic camera systems [20]. The authors noted two points: First, the average joint angle measurement error is 5°, but this error varies with different joints and degrees of freedom quantified. In evaluating industrial or scientific movement analysis solutions, this study highlights the impact of choosing the appropriate biomechanical model for joint kinematics quantification. It also emphasizes the gap between the sensor metrology’s reliability and the calculated parameters after sensor data processing. Specifically, the marker localization inaccuracy is about 1 mm for many optoelectronic camera-based solutions, whereas the biomechanical model’s inaccuracy is due to simplification assumptions. Users must consider both the solution’s precision and the calculated parameters’ validity within their clinical context.
Recently, ref. [10] conducted a study on the validity of the Feetme® system for spatio-temporal gait cycle parameters. The authors quantified differences in spatio-temporal gait parameters in healthy volunteers using the Feetme® system and a reference system (GAITRite®). They found a high concordance between the two systems in measuring these parameters. Whilst the accuracy of FeetMe® insoles were studied [10,12], the literature lacks information about repeatability and sensitivity to change, which are both essential for clinical decision-making [22,23,24,25,26] and patient monitoring [27,28,29,30,31,32]. Boekesteijn et al. conducted a literature review to determine the feasibility of using inertial measurement units to quantify gait disorders in individuals with knee osteoarthritis [28]. Although the authors did not find standardized positioning for the inertial units, their analysis clearly showed that inertial sensors could detect gait disorders in individuals with knee osteoarthritis. According to these authors, spatiotemporal parameters sufficiently reflect gait disorders in this population, making them relevant for monitoring mobility. This study highlights a new aspect of using these technological solutions. Indeed, we have indicated that the metrological validity of sensors and the calculated parameters, such as spatiotemporal gait cycle parameters, are crucial, as evidenced by numerous studies [33,34,35,36,37,38,39,40,41]. However, it is equally important for clinical applications to determine if these solutions can detect changes. This concept is also known as minimal detectable difference (MDD). Wells et al. emphasize its importance in clinical study design and have reviewed methods for quantifying it [25].
Induced asymmetry is utilized to simulate gait abnormalities commonly observed in clinical populations, such as stroke patients or individuals with musculoskeletal disorders, who often exhibit asymmetric gait patterns [13,42]. By introducing controlled asymmetry in a healthy individual, we can rigorously assess the FeetMe® system’s capacity to detect and measure variations in gait parameters, which is a crucial factor for its application in clinical settings [27]. This approach enables us to evaluate the system’s responsiveness and reliability in identifying clinically relevant changes, thereby ensuring its effectiveness for monitoring and evaluating therapeutic interventions in patients with gait disorders [25,43].
Our study builds on the scientific community’s work on the validity and reliability of embedded technological solutions for quantifying spatiotemporal gait cycle parameters, particularly in detecting sensitivity to change. The aim of our study is to measure the repeatability of FeetMe® system output data, i.e., estimating ground reaction forces and spatio-temporal parameters, as well as sensitivity to change by using induced-asymmetry walking.

2. Materials and Methods

2.1. Participant

An asymptomatic adult (60 kg, 1.75 m, 25 years) completed all 24 6 min walking tests, taking 8363 left-foot steps and 8359 right-foot steps. A single model of shoe was used during the different conditions (Kiprun KD500). At the start of each test, the insoles were placed in the subject’s shoes and calibrated according to the FeetMe® recommended calibration procedure [10]. For each walking condition, data were recorded after a 5 min accommodation period on a treadmill. This evaluation was carried out within the framework of a database of healthy subjects for the “No-Barriers” study, aimed at identifying the barriers to physical activity for people with disabilities (NCT05294068).

2.2. Material: Insole System

FeetMe® system insoles consist of an IMU and 18 capacitive cells. The IMU samples at a frequency of 140 Hz and comprises an accelerometer (±8 g) and a gyroscope (±1000 dps). The capacitive cells have a surface area of 15 mm², an 8-bit digital signal, and an acquisition frequency of 110 Hz. The internal algorithm of the insoles uses the pressure values of the capacitive cells to calculate the spatio-temporal parameters of the gait cycle (i.e., duration of the stance phase, duration of the single stance phase, duration of the double stance phase, and duration of the oscillating phase). The detection of initial contact is calculated from the sum of the signal from the sensors in each cell over time (S) and the derivative of the sum of the sensor signals (dS/dt) [10]. A Savitzky–Golay filter is then applied [44]. Initial contact is detected when the derivative of the sum of the sensor signals is greater than 0.2 at time (t) and the sum of the signal from the sensors in each cell is greater than 50 at time (t + 100 ms). Toe-off is detected if the sum of the signals in each cell is less than 30 at time (t) and the sum of the signal from the sensors in each cell is less than 30 at time (t + 100 ms) [10]. All the pressure sensors in the capacitive cells provide the distribution of the ground reaction force along the vertical axis. All the signal processing described above is performed by the internal algorithms of the FeetMe® system insoles as described by Jacobs et al. [10].

2.3. Procedure and Data Analysis

We used a dual-belt force-instrumented treadmill (M-Gait®, Motek Medical B.V., Amsterdam, The Netherlands) to induce asymmetry by modifying the speed of its belts [45,46,47]. We asked the subject to perform 6 min walk tests (TDM6) in different conditions as described in Table 1 (Table 1). For each walking condition, three TDM6 were performed in order to limit intra-individual variability [20]. These three tests were carried out during the same session, with 5 min rest periods between each test. All walking tests were performed over two consecutive days, ensuring adequate rest periods for the participant to mitigate the impact of fatigue. The order of the different walking conditions was randomized.
All the parameter recordings provided by the FeetMe® system are accessible from two comma-separated values files. We specifically selected the following from among all the available parameters:
-
Mean force during single stance phase: the ground reaction force in the vertical axis, representing the force exerted by the ground on a body in contact with it;
-
Stance duration: the duration of the support phase, representing the time during which the foot is in contact with the ground supporting the body’s weight;
-
Single stance duration: the duration of the single support phase, representing the time when only one foot is in contact with the ground while the other foot is in the air;
-
Double stance duration: the duration of the double support phase, representing the time when both feet are simultaneously in contact with the ground;
-
Swing duration: the duration of the oscillating phase, representing the time when the foot is swinging through the air between ground contacts.
All the raw data from the FeetMe® insoles were collected and processed using Python 3.9.7 to create a database stored in a CSV file. A custom Python 3.9.7 module, containing various classes and functions for calculating the parameters listed in Table 2, was developed and is available on GitHub (https://github.com/NathanMartinCOE/semelle_connecte (16 September 2024)). All statistical analyses were performed using R software 4.2.1.
To assess the repeatability of the FeetMe® system outputs, the Intraclass Correlation Coefficient (ICC) was calculated using a two-way mixed-effects model, specifically ICC(3,k). The ICC(3,k) assesses the reliability of the average of multiple measurements. The formulas for these calculations are based on the variance components derived from an ANOVA table, following the guidelines outlined by Shrout and Fleiss [48,49].
The standard error of measurement (SEM) was calculated using the following formula [50]:
S E M = i = 1 i = n σ i 2 n
where SEM = standard error of measurement; n = the number of tests per condition; and σ i 2 = the variance measured for test i.
For the parameter of mean force during the single support phase, the SEM was calculated at each instant of the gait cycle, and then averaged. The SEMs were calculated separately for each leg (right and left), and the lowest and highest average values are reported in the results. The SEMs calculated for the test–retest were reported both in the actual unit and expressed as percentages of the mean values (SEM%). A smaller score indicates a more reliable measurement [51].
To assess the degree of sensitivity to change, the minimum detectable difference (MDD) was calculated at 95% using the following formula [25]:
M D D 95 % = 1.96 × S E M × 2
where M D D 95 % = minimum detectable difference at 95%; and SEM = standard error of measurement.
The MDD is defined as the minimum change that can occur during the measurement that is not due to random variation. Since it represents the degree of sensitivity to change, the MDD is needed to assess whether or not a real change occurs during the execution of two sessions [52]. The authors report that a 90% confidence interval is commonly used, but some studies employ a 95% confidence interval. We chose to use a stricter 95% confidence interval.
The MDDs were calculated for each parameter in three conditions: (i) TDM6 overground, (ii) TDM6 on a treadmill without induced asymmetry, and (iii) TDM6 on a treadmill with induced asymmetry. For the condition TDM6 on a treadmill with induced asymmetry, the maximum SEM value for all conditions with induced asymmetry was used. To obtain a single MDD value for each parameter, the largest SEM value between the right and left leg was used. Absolute reliability indexes were examined in terms of raw units (MDD) and percentages to the parameter mean value (MDD%) [53].
To assess the magnitude of sensitivity to change, the effect size (ES) was calculated using the following formula [43,54]:
E S = x ¯ a s y m x ¯ w i t h o u t   a s y m σ w i t h o u t   a s y m  
where ES = effect size; x ¯ a s y m = the mean during walking with induced asymmetry; x ¯ w i t h o u t   a s y m = the mean during walking without induced asymmetry; and σ w i t h o u t   a s y m = the standard deviation measured during a walk without induced asymmetry.
In addition, statistical tests were carried out to assess whether asymmetry in different gait parameters was detected when inducing asymmetry on the treadmill. The effect size was used to measure the magnitude of the differences observed [54]. These authors also mention that the absolute effect size is useful when the studied variables have intrinsic significance. In our study, preserving the value of spatiotemporal parameters is crucial as they hold significance for the clinical community. Since we had only one participant, comparison of the time series did not seem relevant to us as the results would be too influenced by the individual walking pattern. Therefore, we decided not to calculate the effect size or any other comparison on the ground reaction forces curves. This is different from spatio-temporal parameters, which are much less related to an individual’s pattern in healthy subjects. The spatio-temporal parameters are more robust and less affected by individual variability, making them more suitable for meaningful analysis and comparison in this context.

3. Results

This section is divided by subheadings. It provides a concise and precise description of the experimental results, their interpretation, and the conclusions that can be drawn from the experiment.

3.1. Standard Error of Measurement

The SEM% found for the ground reaction forces did not exceed 3.9% for overground walking, 1.6% for treadmill walking without induced asymmetry, and 3.7% for treadmill walking with induced asymmetry (Table 2). The SEM% found for the spatio-temporal parameters did not exceed 6.8% for overground walking, 1.7% for treadmill walking without induced asymmetry, and 2.6% for treadmill walking with induced asymmetry (Table 2).

3.2. Repeatability

High repeatability was observed when computing ICC values. More specifically, the ICC values were very good (ICC > 0.80) in most cases (44); good (0.60 < ICC < 0.80) in three cases; moderate (0.40 < ICC < 0.60) in two cases; and poor (ICC < 0.40) in one case (Table 3).

3.3. Magnitude of Sensitivity to Change; Effect Size (ES)

Very large ESs were observed when comparing conditions with and without induced asymmetry. More specifically, the ESs were very large (ES > 1.2) in most cases (72.9%); large (0. 8 < ES < 1.2) in four cases (8.3%); moderate (0.5 < ES < 0.8) in seven cases (14.6%); small (0.2 < ES < 0.5) in two cases (4.2%); and no effect size was very small (ES < 0.2) (Table 2).

3.4. Degree of Sensitivity to Change; Minimum Detectable Difference (MDD)

The MDD% values calculated in our study are low for both ground reaction force (range: [4.5 to 10.7%]) and spatio-temporal parameters (range [2.1 to 18.9%]). More specifically, the smallest MDD% (2.1%) was found for the duration of the double stance phase during a treadmill walking test without induced asymmetry and the largest MDD% (18.9%) was found for the duration of the single stance phase during the overground walking test.

4. Discussion

Our study provides essential metrological information for the clinical application of FeetMe® system insoles by examining their repeatability and responsiveness to change. Complementing previous accuracy investigations [10,11,12,13], we demonstrate that FeetMe® system insoles offer a reliable solution. Farid et al. quantified the precision and reliability of the Feetme® system compared to a reference system (GAITRite®) [11]. The authors demonstrated that this system is reliable for quantifying spatio-temporal gait cycle parameters in a population of 29 adult post-stroke patients. However, they noted a lower Intraclass Correlation Coefficient (ICC) for quantifying the swing phase duration on the paretic side. The authors explained that this result might be related to testing conditions, suggesting that more cycles would be needed for stronger concordance. Our study, aiming to analyze sensitivity to change, was based on more than 16,000 recorded gait cycles from our trials. Granja et al. also focused on the concordance of walking speed, cadence, and stride during a timed 25-foot walk test (T25WT) in adult patients with multiple sclerosis [12]. They observed a high ICC across three patient groups categorized by their Expanded Disability Status Scale (EDSS) scores. This work highlights the relevance of using this embedded solution to monitor disease progression characterized by gait cycle parameter deterioration. Parati et al. focused specifically on the impact of experimental conditions [13]. This work complements previous studies showing that for the Feetme® system compared to a GAITRite® system when the same patient is subjected to a condition that could alter their gait, minimal detectable changes are low and acceptable. Our study complements previous work by indicating that the Feetme® insole system’s sensitivity to changes in spatio-temporal parameters effectively identifies gait variations in individuals.
The minimum detectable difference (MDD) of the spatio-temporal parameters is lower than the differences deemed significant for quantifying changes in various patient populations, such as children with cerebral palsy, patients with Parkinson’s disease, and stroke patients [55,56,57,58]. Yang et al. showed significant differences between the spatio-temporal parameters of the paretic and non-paretic legs in stroke patients, with a 6.18% difference in stance and swing phases [58]. The MDD for ground reaction forces falls within the physiological range of asymmetry observed in healthy subjects (−5 to 5%) [59]. Furthermore, the MDD for spatio-temporal parameters aligns with those detected using an OPTOGait photoelectric cell system (6.0–16.5%) [60]. Our study also confirmed the insoles’ high magnitude of sensitivity to change, with very large effect sizes observed between conditions with and without induced asymmetry. Notably, the use of a dual-band treadmill yielded an effect size that increased with the speed of induced asymmetry.
The standard error of measurement (SEM) [SEM%] (<0.34 kg·cm−2, [0.9–3.9%]) for ground reaction forces and (<48 ms [0.1–6.8%]) for spatio-temporal parameters indicated high reliability. These SEM values are comparable to those found by Lee et al. (SEM < 30 ms [2.8–6%]) using the OPTOGait photocell system [60]. For ground reaction forces, the SEM values were also comparable to those reported by Farius et al., who used force platforms [26]. However, the SEM scores cannot be directly compared with the literature due to the use of different units (kg·cm−2 vs. the conventional N·kg). Nevertheless, these scores are consistent with the sensor margin of error provided by the manufacturer (±0.85 kg·cm−2 above 5 kg·cm−2) [10].
The participants’ response to induced asymmetry revealed two trends. Firstly, there was a reduction in the variability of gait parameters as the level of induced asymmetry increased. Secondly, the spatio-temporal parameters evolved differently depending on whether the leg was driven by the increase in speed. The increase in speed tended to reduce the duration of the stance phase, single stance phase, and swing phase for the leg that was driven by the treadmill, while these phases remained constant for the leg that was not driven by the treadmill. The duration of the double support phase decreased similarly for both legs with increased speed.
Our study has several limitations. Only one subject was included, preventing generalization of the observed functional trends. However, this single inclusion does not impact our metrological findings. The SEM values are robust and can be adjusted based on the number of participants and repetitions [61]. A second limitation concerns the reaction force profile. The force profiles used in our study were calculated from raw capacitive cell data, which depend on the configuration of the capacitive cells and are not representative of typical force profiles measurable by a force platform.

5. Conclusions

Our study reveals the reliability and high sensitivity to change of FeetMe® system insoles. These instrumented insoles could be integrated into the array of measurement tools available to motion analysis laboratories, thereby broadening the scope of investigations by enabling the assessment of subjects in ecological situations.

Author Contributions

Conceptualization, N.M., D.P. and F.L.; methodology, N.M. and F.L.; software, N.M. and F.L.; validation, N.M. and F.L.; formal analysis, N.M.; investigation, N.M. and F.L.; resources, N.M. and F.L.; data curation, N.M.; writing—original draft preparation, N.M., D.P. and F.L.; writing—review and editing, N.M., D.P. and F.L.; visualization, N.M. and F.L.; supervision, D.P. and F.L.; project administration, D.P. and F.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of APHP-ISPC Synergies (protocol code NCT05294068 and 2022-01-05).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.

Acknowledgments

The authors would like to thank the FeetMe® company for loan of the equipment and all explanations relating to the sensors and the algorithms used to calculate the software and sensors.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Baker, R.; Esquenazi, A.; Benedetti, M.G.; Desloovere, K. Gait Analysis: Clinical Facts. Eur. J. Phys. Rehabil. Med. 2016, 52, 560–574. [Google Scholar] [PubMed]
  2. Leboeuf, F.; Baker, R.; Barré, A.; Reay, J.; Jones, R.; Sangeux, M. The Conventional Gait Model, an Open-Source Implementation That Reproduces the Past but Prepares for the Future. Gait Posture 2019, 69, 126–129. [Google Scholar] [CrossRef]
  3. Roche, N.; Bonnyaud, C.; Reynaud, V.; Bensmail, D.; Pradon, D.; Esquenazi, A. Motion Analysis for the Evaluation of Muscle Overactivity: A Point of View. Ann. Phys. Rehabil. Med. 2019, 62, 442–452. [Google Scholar] [CrossRef] [PubMed]
  4. Del Din, S.; Godfrey, A.; Rochester, L. Validation of an Accelerometer to Quantify a Comprehensive Battery of Gait Characteristics in Healthy Older Adults and Parkinson’s Disease: Toward Clinical and at Home Use. IEEE J. Biomed. Health Inform. 2016, 20, 838–847. [Google Scholar] [CrossRef]
  5. Bussmann, J.; Veltink, P.; Koelma, F.; Van Lummel, R.; Stam, H. Ambulatory Monitoring of Mobility-Related Activities: The Initial Phase of the Development of an Activity Monitor. Eur. J. Phys. Med. Rehabil. 1995, 5, 2–7. [Google Scholar]
  6. Watanabe, K.; Hokari, M. Kinematical Analysis and Measurement of Sports Form. IEEE Trans. Syst. Man Cybern. Part. A Syst. Hum. 2006, 36, 549–557. [Google Scholar] [CrossRef]
  7. Michaud, M.; Guérin, A.; Dejean de La Bâtie, M.; Bancel, L.; Oudre, L.; Tricot, A. The Analytical Validity of Stride Detection and Gait Parameters Reconstruction Using the Ankle-Mounted Inertial Measurement Unit Syde®. Sensors 2024, 24, 2413. [Google Scholar] [CrossRef]
  8. Schall, M.; Chen, H.; Cavuoto, L. Wearable Inertial Sensors for Objective Kinematic Assessments: A Brief Overview. J. Occup. Environ. Hyg. 2022, 19, 501–508. [Google Scholar] [CrossRef]
  9. Drăgulinescu, A.; Drăgulinescu, A.-M.; Zincă, G.; Bucur, D.; Feieș, V.; Neagu, D.-M. Smart Socks and In-Shoe Systems: State-of-the-Art for Two Popular Technologies for Foot Motion Analysis, Sports, and Medical Applications. Sensors 2020, 20, 4316. [Google Scholar] [CrossRef]
  10. Jacobs, D.; Farid, L.; Ferré, S.; Herraez, K.; Gracies, J.-M.; Hutin, E. Evaluation of the Validity and Reliability of Connected Insoles to Measure Gait Parameters in Healthy Adults. Sensors 2021, 21, 6543. [Google Scholar] [CrossRef]
  11. Farid, L.; Jacobs, D.; Do Santos, J.; Simon, O.; Gracies, J.-M.; Hutin, E. FeetMe® Monitor-Connected Insoles Are a Valid and Reliable Alternative for the Evaluation of Gait Speed after Stroke. Top. Stroke Rehabil. 2021, 28, 127–134. [Google Scholar] [CrossRef] [PubMed]
  12. Granja Domínguez, A.; Romero Sevilla, R.; Alemán, A.; Durán, C.; Hochsprung, A.; Navarro, G.; Páramo, C.; Venegas, A.; Lladonosa, A.; Ayuso, G.I. Study for the Validation of the FeetMe® Integrated Sensor Insole System Compared to GAITRite® System to Assess Gait Characteristics in Patients with Multiple Sclerosis. PLoS ONE 2023, 18, e0272596. [Google Scholar] [CrossRef]
  13. Parati, M.; Gallotta, M.; Muletti, M.; Pirola, A.; Bellafà, A.; De Maria, B.; Ferrante, S. Validation of Pressure-Sensing Insoles in Patients with Parkinson’s Disease during Overground Walking in Single and Cognitive Dual-Task Conditions. Sensors 2022, 22, 6392. [Google Scholar] [CrossRef] [PubMed]
  14. Renner, K.E.; Williams, D.S.B.; Queen, R.M. The Reliability and Validity of the Loadsol® under Various Walking and Running Conditions. Sensors 2019, 19, 265. [Google Scholar] [CrossRef] [PubMed]
  15. Peebles, A.T.; Maguire, L.A.; Renner, K.E.; Queen, R.M. Validity and Repeatability of Single-Sensor Loadsol Insoles during Landing. Sensors 2018, 18, 4082. [Google Scholar] [CrossRef] [PubMed]
  16. Loiret, I.; Villa, C.; Dauriac, B.; Bonnet, X.; Martinet, N.; Paysant, J.; Pillet, H. Are Wearable Insoles a Validated Tool for Quantifying Transfemoral Amputee Gait Asymmetry? Prosthet. Orthot. Int. 2019, 43, 492–499. [Google Scholar] [CrossRef]
  17. Seiberl, W.; Jensen, E.; Merker, J.; Leitel, M.; Schwirtz, A. Accuracy and Precision of Loadsol® Insole Force-Sensors for the Quantification of Ground Reaction Force-Based Biomechanical Running Parameters. Eur. J. Sport. Sci. 2018, 18, 1100–1109. [Google Scholar] [CrossRef]
  18. Burns, G.T.; Deneweth Zendler, J.; Zernicke, R.F. Validation of a Wireless Shoe Insole for Ground Reaction Force Measurement. J. Sports Sci. 2019, 37, 1129–1138. [Google Scholar] [CrossRef]
  19. Parker, D.; Andrews, J.; Price, C. Validity and Reliability of the XSENSOR In-Shoe Pressure Measurement System. PLoS ONE 2023, 18, e0277971. [Google Scholar] [CrossRef]
  20. McGinley, J.L.; Baker, R.; Wolfe, R.; Morris, M.E. The Reliability of Three-Dimensional Kinematic Gait Measurements: A Systematic Review. Gait Posture 2009, 29, 360–369. [Google Scholar] [CrossRef]
  21. Mokkink, L.B.; Terwee, C.B.; Knol, D.L.; Stratford, P.W.; Alonso, J.; Patrick, D.L.; Bouter, L.M.; de Vet, H.C. The COSMIN Checklist for Evaluating the Methodological Quality of Studies on Measurement Properties: A Clarification of Its Content. BMC Med. Res. Methodol. 2010, 10, 22. [Google Scholar] [CrossRef] [PubMed]
  22. Squara, P.; Scheeren, T.W.L.; Aya, H.D.; Bakker, J.; Cecconi, M.; Einav, S.; Malbrain, M.L.N.G.; Monnet, X.; Reuter, D.A.; van der Horst, I.C.C.; et al. Metrology Part 1: Definition of Quality Criteria. J. Clin. Monit. Comput. 2021, 35, 17–25. [Google Scholar] [CrossRef] [PubMed]
  23. Papa, E.V.; Addison, O.; Foreman, K.B.; Dibble, L. Reproducibility and Responsiveness of Gait Initiation in Parkinson’s Disease. J. Biomech. 2019, 87, 197. [Google Scholar] [CrossRef]
  24. Milne, S.C.; Kim, S.H.; Murphy, A.; Larkindale, J.; Farmer, J.; Malapira, R.; Danoudis, M.; Shaw, J.; Ramakrishnan, T.; Rasouli, F.; et al. The Responsiveness of Gait and Balance Outcomes to Disease Progression in Friedreich Ataxia. Cerebellum 2022, 21, 963–975. [Google Scholar] [CrossRef]
  25. Wells, G.; Beaton, D.; Shea, B.; Boers, M.; Simon, L.; Strand, V.; Brooks, P.; Tugwell, P. Minimal Clinically Important Differences: Review of Methods. J. Rheumatol. 2001, 28, 406–412. [Google Scholar]
  26. Fairus, F.Z.; Joseph, L.H.; Omar, B.; Ahmad, J.; Sulaiman, R. Intra-Rater Reliability and Minimal Detectable Change of Vertical Ground Reaction Force Measurement during Gait and Half-Squat Tasks on Healthy Male Adults. Malays. J. Med. Sci. MJMS 2016, 23, 21. [Google Scholar]
  27. Weerdesteyn, V.; Hollands, K.L.; Hollands, M.A. Gait Adaptability. Handb. Clin. Neurol. 2018, 159, 135–146. [Google Scholar] [CrossRef] [PubMed]
  28. Boekesteijn, R.J.; van Gerven, J.; Geurts, A.C.H.; Smulders, K. Objective Gait Assessment in Individuals with Knee Osteoarthritis Using Inertial Sensors: A Systematic Review and Meta-Analysis. Gait Posture 2022, 98, 109–120. [Google Scholar] [CrossRef]
  29. Brady, R.A.; Peters, B.T.; Batson, C.D.; Ploutz-Snyder, R.; Mulavara, A.P.; Bloomberg, J.J. Gait Adaptability Training Is Affected by Visual Dependency. Exp. Brain Res. 2012, 220, 1–9. [Google Scholar] [CrossRef]
  30. Geerse, D.J.; Roerdink, M.; Marinus, J.; van Hilten, J.J. Assessing Walking Adaptability in Stroke Patients. Disabil. Rehabil. 2021, 43, 3242–3250. [Google Scholar] [CrossRef]
  31. Martelli, D.; Xia, B.; Prado, A.; Agrawal, S.K. Gait Adaptations during Overground Walking and Multidirectional Oscillations of the Visual Field in a Virtual Reality Headset. Gait Posture 2019, 67, 251–256. [Google Scholar] [CrossRef] [PubMed]
  32. Eikema, D.J.A.; Chien, J.H.; Stergiou, N.; Myers, S.A.; Scott-Pandorf, M.M.; Bloomberg, J.J.; Mukherjee, M. Optic Flow Improves Adaptability of Spatiotemporal Characteristics during Split-Belt Locomotor Adaptation with Tactile Stimulation. Exp. Brain Res. 2016, 234, 511–522. [Google Scholar] [CrossRef] [PubMed]
  33. Simon, S.R. Quantification of Human Motion: Gait Analysis-Benefits and Limitations to Its Application to Clinical Problems. J. Biomech. 2004, 37, 1869–1880. [Google Scholar] [CrossRef] [PubMed]
  34. Muro-de-la-Herran, A.; Garcia-Zapirain, B.; Mendez-Zorrilla, A. Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications. Sensors 2014, 14, 3362–3394. [Google Scholar] [CrossRef] [PubMed]
  35. Tao, W.; Liu, T.; Zheng, R.; Feng, H. Gait Analysis Using Wearable Sensors. Sensors 2012, 12, 2255–2283. [Google Scholar] [CrossRef]
  36. Lord, S.; Galna, B.; Rochester, L. Moving Forward on Gait Measurement: Toward a More Refined Approach. Mov. Disord. 2013, 28, 1534–1543. [Google Scholar] [CrossRef]
  37. Salarian, A.; Russmann, H.; Vingerhoets, F.J.G.; Dehollain, C.; Blanc, Y.; Burkhard, P.R.; Aminian, K. Gait Assessment in Parkinson’s Disease: Toward an Ambulatory System for Long-Term Monitoring. IEEE Trans. Biomed. Eng. 2004, 51, 1434–1443. [Google Scholar] [CrossRef]
  38. Brognara, L.; Palumbo, P.; Grimm, B.; Palmerini, L. Assessing Gait in Parkinson’s Disease Using Wearable Motion Sensors: A Systematic Review. Diseases 2019, 7, 18. [Google Scholar] [CrossRef]
  39. Patel, M.; Pavic, A.; Goodwin, V.A. Wearable Inertial Sensors to Measure Gait and Posture Characteristic Differences in Older Adult Fallers and Non-Fallers: A Scoping Review. Gait Posture 2020, 76, 110–121. [Google Scholar] [CrossRef]
  40. Petraglia, F.; Scarcella, L.; Pedrazzi, G.; Brancato, L.; Puers, R.; Costantino, C. Inertial Sensors versus Standard Systems in Gait Analysis: A Systematic Review and Meta-Analysis. Eur. J. Phys. Rehabil. Med. 2019, 55, 265–280. [Google Scholar] [CrossRef]
  41. Figueiredo, J.; Carvalho, S.P.; Vilas-Boas, J.P.; Gonçalves, L.M.; Moreno, J.C.; Santos, C.P. Wearable Inertial Sensor System Towards Daily Human Kinematic Gait Analysis: Benchmarking Analysis to MVN BIOMECH. Sensors 2020, 20, 2185. [Google Scholar] [CrossRef] [PubMed]
  42. Stroke Rehabilitation and Recovery. In Stroke Prevention and Treatment: An Evidence-Based Approach; Hankey, G.J.; Saver, J.L. (Eds.) Cambridge University Press: Cambridge, UK, 2020; pp. 485–550. ISBN 978-1-107-11314-5. [Google Scholar]
  43. Kazis, L.E.; Anderson, J.J.; Meenan, R.F. Effect Sizes for Interpreting Changes in Health Status. Med. Care 1989, 27, S178–S189. [Google Scholar] [CrossRef] [PubMed]
  44. Savitzky, A.; Golay, M.J.E. Smoothing and Differentiation of Data by Simplified Least Squares Procedures. Anal. Chem. 1964, 36, 1627–1639. [Google Scholar] [CrossRef]
  45. Ducharme, S.W.; Liddy, J.J.; Haddad, J.M.; Busa, M.A.; Claxton, L.J.; van Emmerik, R.E.A. Association between Stride Time Fractality and Gait Adaptability during Unperturbed and Asymmetric Walking. Human. Mov. Sci. 2018, 58, 248–259. [Google Scholar] [CrossRef]
  46. Ito, T.; Tsubahara, A.; Shinkoda, K.; Yoshimura, Y.; Kobara, K.; Osaka, H. Excitability Changes in Intracortical Neural Circuits Induced by Differentially Controlled Walking Patterns. PLoS ONE 2015, 10, e0117931. [Google Scholar] [CrossRef]
  47. Carr, S.; Rasouli, F.; Kim, S.H.; Reed, K.B. Real-Time Feedback Control of Split-Belt Ratio to Induce Targeted Step Length Asymmetry. J. Neuroeng. Rehabil. 2022, 19, 65. [Google Scholar] [CrossRef] [PubMed]
  48. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef]
  49. Shrout, P.E.; Fleiss, J.L. Intraclass Correlations: Uses in Assessing Rater Reliability. Psychol. Bull. 1979, 86, 420–428. [Google Scholar] [CrossRef]
  50. Portney, L.G.; Watkins, M.P. Foundations of Clinical Reseach: Applications to Practice, 3rd ed.; Prentice Hall: Hoboken, NJ, USA, 2009; ISBN 978-0-13-234470-8. [Google Scholar]
  51. Atkinson, G.; Nevill, A.M. Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine. Sports Med. 1998, 26, 217–238. [Google Scholar] [CrossRef]
  52. Haley, S.M.; Fragala-Pinkham, M.A. Interpreting Change Scores of Tests and Measures Used in Physical Therapy. Phys. Ther. 2006, 86, 735–743. [Google Scholar] [CrossRef]
  53. Beninato, M.; Portney, L.G. Applying Concepts of Responsiveness to Patient Management in Neurologic Physical Therapy. J. Neurol. Phys. Ther. 2011, 35, 75–81. [Google Scholar] [CrossRef] [PubMed]
  54. Sullivan, G.M.; Feinn, R. Using Effect Size—Or Why the P Value Is Not Enough. J. Grad. Med. Educ. 2012, 4, 279–282. [Google Scholar] [CrossRef] [PubMed]
  55. Malone, A.; Kiernan, D.; French, H.; Saunders, V.; O’Brien, T. Do Children with Cerebral Palsy Change Their Gait When Walking over Uneven Ground? Gait Posture 2015, 41, 716–721. [Google Scholar] [CrossRef]
  56. Chakraborty, S.; Nandy, A.; Kesar, T.M. Gait Deficits and Dynamic Stability in Children and Adolescents with Cerebral Palsy: A Systematic Review and Meta-Analysis. Clin. Biomech. 2020, 71, 11–23. [Google Scholar] [CrossRef]
  57. Pau, M.; Corona, F.; Pili, R.; Casula, C.; Sors, F.; Agostini, T.; Cossu, G.; Guicciardi, M.; Murgia, M. Effects of Physical Rehabilitation Integrated with Rhythmic Auditory Stimulation on Spatio-Temporal and Kinematic Parameters of Gait in Parkinson’s Disease. Front. Neurol. 2016, 7, 126. [Google Scholar] [CrossRef]
  58. Yang, S.; Zhang, J.-T.; Novak, A.C.; Brouwer, B.; Li, Q. Estimation of Spatio-Temporal Parameters for Post-Stroke Hemiparetic Gait Using Inertial Sensors. Gait Posture 2013, 37, 354–358. [Google Scholar] [CrossRef] [PubMed]
  59. Winiarski, S.; Rutkowska-Kucharska, A.; Pozowski, A.; Aleksandrowicz, K. A New Method of Evaluating the Symmetry of Movement Used to Assess the Gait of Patients after Unilateral Total Hip Replacement. Appl. Bionics Biomech. 2019, 2019, 1–11. [Google Scholar] [CrossRef]
  60. Lee, M.M.; Song, C.H.; Lee, K.J.; Jung, S.W.; Shin, D.C.; Shin, S.H. Concurrent Validity and Test-Retest Reliability of the OPTOGait Photoelectric Cell System for the Assessment of Spatio-Temporal Parameters of the Gait of Young Adults. J. Phys. Ther. Sci. 2014, 26, 81–85. [Google Scholar] [CrossRef]
  61. Confidence Limits in the SEM. Walking with Richard 2016. Available online: https://wwrichard.net/ (accessed on 16 September 2024).
Table 1. Summary of the walking conditions for the 6-minute walk tests (TDM6).
Table 1. Summary of the walking conditions for the 6-minute walk tests (TDM6).
ConditionDescriptionBelt Speed (m/s)Belt Speed (m/s)Asymmetry
RightLeft
1TDM6-SYM-GROUNDTDM6 overgroundN/AN/ASymmetric
2TDM6-SYM-MGAITTDM6 treadmill: equal belt speeds1.21.2Symmetric
3TDM6-ASYM-MGAIT-16LTDM6 treadmill: 16% left asymmetry1.21.4 s+16% left asymmetry
4TDM6-ASYM-MGAIT-33LTDM6 treadmill: 33% left asymmetry1.21.6+33% left asymmetry
5TDM6-ASYM-MGAIT-50LTDM6 treadmill: 50% left asymmetry1.21.8+50% left asymmetry
6TDM6-ASYM-MGAIT-16RTDM6 treadmill: 16% right asymmetry1.41.2+16% right asymmetry
7TDM6-ASYM-MGAIT-33RTDM6 treadmill: 33% right asymmetry1.61.2+33% right asymmetry
8TDM6-ASYM-MGAIT-50RTDM6 treadmill: 50% right asymmetry1.81.2+50% right asymmetry
Table 2. Summary of value, standard error of measure (SEM), minimal detectable difference (MDD95), and effect size for all gait parameters.
Table 2. Summary of value, standard error of measure (SEM), minimal detectable difference (MDD95), and effect size for all gait parameters.
Gait
Parameters
Overground Walking
(TDM6-SYM-GROUND)
Treadmill without Induced Asymmetry
(TDM6-SYM-MGAIT)
Treadmill with Induced Asymmetry
(TDM6-ASYM-MGAIT)
Effect Size
Values
Mean (sd)
SEM
Value (%)
MDD95
Value (%)
Values
Mean (sd)
SEM
Value (%)
MDD95
Value (%)
Values
Mean (sd)
SEM
Value (%)
MDD95
Value (%)
O-TA
Value
T-TA
Value
Mean force during single stance phase (kg·cm−2)8.13 (0.02)
8.75 (0.01)
0.31 (3.8%)
0.34 (3.9%)
0.86 (10.58%)
0.94 (10.74%)
8.32 (0.05)
8.72 (0.04)
0.09 (1.1%)
0.14 (1.6%)
0.25 (3%)
0.39 (4.47%)
8.04 (0.03)
8.6 (0.03)
0.08 (0.9%)
0.31 (3.7%)
0.22 (2.56%)
0.86 (10.23%)
--
Stance duration (ms)730.3 (19.2)
744.8 (18.5)
42.89 (5.9%)
47.82 (6.4%)
118.89 (16.28%)
132.55 (17.8%)
706.9 (11.5)
719.5 (11.7)
3.44 (0.5%)
6.14 (0.9%)
9.54 (1.33%)
17.02 (2.41%)
583.8 (9.8)
714.1 (13.4)
0.91 (0.1%)
12.17 (1.8%)
2.52 (0.36%)
33.73 (5.01%)
−7.85
−1.66
−10.7
−0.46
Single stance duration (ms)413.6 (24.2)
428.6 (18.0)
23.99 (5.8%)
29.22 (6.8%)
66.5 (16.08%)
80.99 (18.9%)
395.3 (16.2)
407.5 (20.0)
3.17 (0.8%)
6.3 (1.6%)
8.79 (2.16%)
17.46 (4.42%)
314.9 (10.9)
420.7 (11)
1.8 (0.4%)
8.84 (2.6%)
4.99 (1.19%)
24.5 (7.16%)
−5.78
−0.28
−4.96
0.71
Double stance duration (ms)314.9 (17.9)
315.3 (13.4)
19.28 (6.1%)
19.76 (6.3%)
53.44 (16.97%)
54.77 (17.37%)
310.6 (16.0)
310.9 (12.5)
2 (0.6%)
2.37 (0.8%)
5.54 (1.78%) 6.57 (2.12%)268.2 (8.6)
297.9 (11.1)
1.43 (0.5%)
5.12 (1.7%)
3.96 (1.45%)
14.19 (4.78%)
−3.51
−1.01
−3.36
−0.79
Swing duration (ms)414.5 (14.3)
429 (13.9)
24.24 (5.8%)
29.04 (6.8%)
67.19 (16.21%)
80.49 (18.76%)
395.7 (11.7)
408.3 (10.4)
2.45 (0.6%)
6.77 (1.7%)
6.79 (1.66%)
18.77 (4.74%)
315.0 (10.9)
420.7 (11.0)
1.77 (0.4)
8.32 (2.5%)
4.91 (1.17%)
23.06 (7.07%)
−7.47
−0.51
−8
1.19
Values are expressed as mean (standard deviation) and SEM; MDDs are expressed as value (%); effect size is expressed as value. For SEM, MDD, and effect size, the values indicated are the smallest (1st cell line) and the largest (2nd cell line). Effect sizes were calculated between the overground (O) and treadmill with induced asymmetry (TA) conditions and between the treadmill without induced asymmetry (T) and treadmill with induced asymmetry (TA) conditions.
Table 3. Intraclass Correlation Coefficient (ICC) for all spatio-temporal gait parameters.
Table 3. Intraclass Correlation Coefficient (ICC) for all spatio-temporal gait parameters.
ConditionLegStance DurationSingle Stance DurationDouble Stance DurationSwing Duration
TDM6-SYM-GROUNDLeft0.9890.9910.9430.95
Right0.9630.9480.9390.99
TDM6-SYM-MGAITLeft0.9960.9910.9720.978
Right0.9880.9780.9710.991
TDM6-ASYM-MGAIT-16LLeft0.9760.9810.9410.875
Right0.4530.8810.9560.988
TDM6-ASYM-MGAIT-33LLeft0.9920.9940.9350.95
Right0.9130.9510.9360.994
TDM6-ASYM-MGAIT-50LLeft0.9990.9990.9990.999
Right0.9990.9990.9990.999
TDM6-ASYM-MGAIT-16RLeft0.9940.9690.9820.995
Right0.9970.9950.9840.983
TDM6-ASYM-MGAIT-33RLeft0.9430.9950.9480.994
Right0.9640.9850.9750.995
TDM6-ASYM-MGAIT-50RLeft0.9040.9580.9170.995
Right0.9940.9950.9170.958
ICC(3,k) values were computed following guidelines outlined by Shrout and Fleiss [48,49].
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Martin, N.; Leboeuf, F.; Pradon, D. The FeetMe® Insoles System: Repeatability, Standard Error of Measure, and Responsiveness. Sensors 2024, 24, 6043. https://doi.org/10.3390/s24186043

AMA Style

Martin N, Leboeuf F, Pradon D. The FeetMe® Insoles System: Repeatability, Standard Error of Measure, and Responsiveness. Sensors. 2024; 24(18):6043. https://doi.org/10.3390/s24186043

Chicago/Turabian Style

Martin, Nathan, Fabien Leboeuf, and Didier Pradon. 2024. "The FeetMe® Insoles System: Repeatability, Standard Error of Measure, and Responsiveness" Sensors 24, no. 18: 6043. https://doi.org/10.3390/s24186043

APA Style

Martin, N., Leboeuf, F., & Pradon, D. (2024). The FeetMe® Insoles System: Repeatability, Standard Error of Measure, and Responsiveness. Sensors, 24(18), 6043. https://doi.org/10.3390/s24186043

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop