[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Next Article in Journal
Evaluating the Influence of Chromatic and Luminance Stimuli on SSVEPs from Behind-the-Ears and Occipital Areas
Next Article in Special Issue
Flexible, Stretchable Sensors for Wearable Health Monitoring: Sensing Mechanisms, Materials, Fabrication Strategies and Features
Previous Article in Journal
An Activity Recognition Framework Deploying the Random Forest Classifier and A Single Optical Heart Rate Monitoring and Triaxial Accelerometer Wrist-Band
Previous Article in Special Issue
Infrared Thermography as a Non-Invasive Tool to Explore Differences in the Musculoskeletal System of Children with Hemophilia Compared to an Age-Matched Healthy Group
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Feature-Level Fusion of Surface Electromyography for Activity Monitoring

School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(2), 614; https://doi.org/10.3390/s18020614
Submission received: 4 January 2018 / Revised: 1 February 2018 / Accepted: 14 February 2018 / Published: 17 February 2018
(This article belongs to the Special Issue Sensors for Health Monitoring and Disease Diagnosis)

Abstract

:
Surface electromyography (sEMG) signals are commonly used in activity monitoring and rehabilitation applications as they reflect effectively the motor intentions of users. However, real-time sEMG signals are non-stationary and vary to a large extent within the time frame of signals. Although previous studies have focused on the issues, their results have not been satisfactory. Therefore, we present a new method of conducting feature-level fusion to obtain a new feature space for sEMG signals. Eight activities of daily life (ADLs), including falls, were performed to obtain raw data from EMG signals from the lower limb. A feature set combining the time domain, time–frequency domain, and entropy domain was applied to the raw data to establish an initial feature space. A new projection method, the weighting genetic algorithm for GCCA (WGA-GCCA), was introduced to obtain the final feature space. Different tests were carried out to evaluate the performance of the new feature space. The new feature space created with the WGA-GCCA effectively reduced the dimensions and selected the best feature vectors dynamically while improving monotonicity. The Davies–Bouldin index (DBI) based on fuzzy c-means algorithms of the space obtained the lowest value compared with several fusion methods. It also achieved the highest accuracy when applied to support vector machine classifier.

1. Introduction

As the concept of healthcare shifted from disease diagnosis and treatment to disease prevention, the importance of technical development in systematic and continuous exercise management has been emphasized [1]. As a consequence of the growth of the aging population, the number of elderly or frail people who need help in their daily activities is rapidly increasing [2,3,4]. This change has led to the focus on the importance of activity monitoring. To name a few, Mantilla quantitatively determined the reliability of longitudinal diaphragm EMG analyses and provided an important tool for evaluating the progression of diseases or injuries that impair ventilation [5]; the effects of shoulder flexion/extension combined with elbow flexion angle on discomfort score were investigated by Farooq for repetitive gripping task [6]. Also, the expansion of activity tracking and personal data collection offers the potential for patient engagement in the management of chronic diseases. Consumer wearable devices for activity tracking also have shown promise in post-surgery recovery in cardiac patients, pulmonary rehabilitation, and activity counseling in diabetic patients, among others [7].
With the rapid development of wireless networks and wearable sensing technologies, advances in microelectromechanical systems and information and communications technology have created new opportunities for automatic activity monitoring, which can improve the quality of life of the elderly and frail people and provide them with adequate medical services [8]. Wireless and wearable sensors, such as accelerator sensors, inertial sensors, and gyroscopes, have been widely used in numerous studies.
Electromyography (EMG) sensors are widely applied in medical diagnosis, rehabilitation, and human–computer interaction [9,10,11]. Compared with other wearable sensors, EMG sensors can directly indicate the human body’s electrophysiological responses to various activities. EMG detects which muscles are recruited for an action, generates information about the behavior being performed, and determines the effort required to perform such behavior [12]. In the behavior monitoring context, this ability of EMG has significant advantages for classifying behavior [13]. Specifically, EMG has the inherent advantages of distinguishing between passive and active activities, predicting movements, and achieving a short calculating time [14]. Many existing technologies use EMG together with mechano-myographic sensors to acquire signals that can be used to control prosthetic devices, thus enabling people with disabilities to train and restore control over their residual muscles [15]. For example, Betthauser et al. presented a sparsity-based adaptive classification method for the EMG, which aims to achieve a good performance in the offline and online contexts involving untrained upper-limb positions for amputees and able-bodied subjects [16].
Nevertheless, in the search for the best feature set from original datasets, considerable challenges continue to exist [17]. This difficulty is due to the bioelectrical of EMG signals; hence, they can be influenced by many disturbing factors, such as electrode displacement, postural changes, and individual-dependent features such as condition of muscles, subcutaneous fat, skin surface, etc. [18]. At the same time, EMG is sensitive to external factors, such as experimental setting, recording site, or natural environment. Another realistic problem is that EMG involves an excessive number of inputs. Different feature vectors extracted from the same pattern always reflect different characteristics of patterns. By optimizing and combining these different features, effective discriminant information of multiple features is retained, and redundant information is eliminated to a certain degree [19]. Thus, extensive efforts need to be done to obtain optimal feature sets before their application to classifiers. Liu investigated the effects of feature dimensionality reduction strategies on the classification of surface EMG (sEMG) and employed a Markov random field method and a forward orthogonal search algorithm to evaluate the contribution of each individual feature to the classification [20]. Buchenrieder combined selection and projection and applied them in the time and frequency domain [21]. A cross-correlation-based feature extraction technique for EMG signals was proposed in [22], and the results of support vector machine (SVM) and k-nearest neighbor were evaluated to have a high classification accuracy and increased efficiency and robustness.
Feature fusion has been increasingly used in the field of pattern recognition as a result of the richness of nature records in the database. Feature fusion typically comprises three levels: pixel-level fusion, feature-level fusion, and decision-level fusion. Pixel-level fusion refers to the fusion at the original data layer. Decision-level fusion combines results from different methods, algorithms, sources, or classifiers to generate estimates that are of better quality than those obtained from any individual source alone [23]. Feature-level fusion is the most important pre-processing step for any classifier.
The main goal of feature fusion is to utilize all relevant lower dimensional features extracted from the same or different modality profiles of objects for classification. However, the extracted features (or signals) may contain redundant and irrelevant information, which increases the dimensionality and degrades the quality of feature spaces. In such a case, conventional data integration techniques fail to provide proper interpretation. In addition, dimensionality increases the learning parameters of classifiers and thus increases the calculation complexity and the memory requirement. Thus, dimensionality reduction by feature mapping is needed.
Feature mapping or feature projection, as the most widely used method for feature fusion, can be described as mapping from an original feature space to an appropriate subspace such that a learning criterion is optimized. Feature projection enables high-dimensional feature vectors to be visualized in a low dimension and allows the distribution of the reduced feature vectors to be analyzed [24]. The canonical correlation analysis (CCA) method is developed in feature fusion to extract the feature pairs depicting the intrinsic correlation between two sets of features [19]. CCA finds the correlation between two sets of multidimensional vectors extracted from raw data, and then maximizes the correlation in the transformed space to seek a pair of projection vectors (PVs). As a result, CCA provides an effective strategic tool to extract intrinsic sets of features by integrating two views of the same object for viable clinical application [25], particularly for the classification of normal and pathological EMG signals [26]. The identified features after fusion are especially robust in real-life applications, especially when the best feature sets are unknown. Therefore, many scholars have begun to study the correlation of multiset variables.
In the current work, we propose a feature-level fusion technique, the weighting genetic algorithm for GCCA (WGA-GCCA). Firstly, the original feature is directly extracted by self-defined feature sets. Secondly, global canonical correlation analysis (GCCA) is applied to the feature sets to obtain the generalized canonical projective vector (GCPV) of the projected space. Thirdly, GA was used to select better projective vectors from GCPV. After weighing the projective vectors, it was used to create the final feature space.
The feature space obtained with the proposed method exhibits good characteristics in terms of dimensionality reduction. Apart from evaluating the performance of the feature space in the EMG region using the Davies–Bouldin index (DBI) of fuzzy c-means, we also investigate the accuracy and characteristics of monotonicity by SVM.

2. Subjects and Experiment Protocol

Eight healthy, able-bodied subjects (six males and two females: age, 24–26 years; height, 160–180 cm; weight 46–75 kg) participated in the experiments. Each subject wore sensors on their gastrocnemius, rectus femoris, tibialis anterior, and semitendinosus from left lower limbs, shown in Figure 1, and performed eight ADLs: stand-to-squat (st–sq), squat-to-stand (sq–st), stand-to-sit (st–si), sit-to-stand (si–st), stair-ascending (a–s), stair-descending (d–s), walking (w), and falling (f). The participants repeated the procedure six times in each experiment day; the total number of repetition of each activity should be at least 240. Each behavior lasted for nearly two seconds, and the sampling frequency of sensors were set as 1000 Hz. The whole duration time was used for feature computation later. Experimental process was shown in Figure 2. Figure 2f was trip-fall, the ankle of the participant was fixed by a sponge ring, which limits the ankle movement and also plays an important role in protecting the ankle.
Our experiments were carried out in an air-conditioned laboratory to prevent heat from causing severe sweating for the participants. Each participant wore athletic shorts during the experiments, and the sensors were fixed to parts of the skin that were exposed to air so as to prevent physical contact or pressure. To keep the skin surface free from oil and dust, we scrubbed the skin with alcohol wipes before placing the sensors. Every half an hour, we scrubbed the skin again and replaced the sensors in the same place to prevent the influence of secretions. As for the daily activities, a large amount of data is needed. Hence, completing all the activities in one day is easy for causing muscle fatigue. Nevertheless, muscle condition varies in different days. Thus, we opted to have the participants complete a set of movements (eight ADLs) in a period of time. After each action, the participants were given 5 min of rest time; they were also given an appropriate rest time of 15 min after each round. We ensured the completion of three rounds in the morning and in the afternoon. We also aimed to complete the data collection within five days. In this way, we were able to collect the required data.
Sensors we used in this study are Trigno™ Wireless EMG (Delsys Inc, Natick, MA, USA). It has 8-channel surface electromyography plus 24-channel acceleration acquisition. It is a sensor with motion artifact suppression (patent) that can be freely moved, the sensor directly transmits data wirelessly. It provided a 16-bit resolution, a bandwidth of 20–450 Hz, and a baseline noise <1.25 µV (rms) and has a typical operating range of 40 m and the communication protocol is Bluetooth. The sEMG signals were sampled at 1000 Hz using EMG works 4.0 (Delsys Inc, Natick, MA, USA), as show in Figure 3.

3. Feature Extraction

3.1. Feature Extraction

In machine learning, feature extraction starts from an initial set of measured data and builds the derived values (features) that are intended to be informative and non-redundant [27]. In this way, the process facilitates the subsequent learning and generalization steps and even improves human interpretations in some cases [27]. Feature extraction is generally divided into the time domain, frequency domain, time–frequency domain, and sometimes information entropy. A single time domain feature does not offer enough features for the system to recognize activities properly. Moreover, the time domain method suffers from poor robustness. Frequency domain methods are typically used in studies on muscle fatigue. Entropy spectrum features have a robust feature set for recognition systems of EMG [28]. The time–frequency domain characterizes varying frequency information at different time locations, thereby providing plenty of non-stationary information about the analyzed signals [29]. Thus, a combination of several feature extraction methods is considered to provide an effective feature set.
In our study, we created a feature set consisting of Wilson amplitude (WAMP), fuzzy entropy (FE), permutation entropy (PE), auto-regressive coefficient (ARCU) from third-order cumulant, and energy of wavelet coefficient (EWT). These methods have been found to be effective in [29].

3.2. New Feature Space

Feature sets obtained from the previous session would be a complex high-dimensional space. The ordinary method to turn complexity to simplicity is projection [30], and the most commonly used method is CCA. CCA is used to measure the linear relationship between two multidimensional variables. It aims to find a new set of bases that are optimal with respect to correlation and measures the corresponding correlations.
In our study, we aim to obtain an optimal feature space from the feature set mentioned above. This feature space should be based on, but better than, CCA.

3.2.1. Global Canonical Correlation Analysis (GCCA)

GCCA is an extension of CCA and considers a class matrix in the correlation analysis.
Let S W x and S W y denote the within-class scatter matrix of samples X and Y, respectively
S W x = i = 1 n j = 1 n ( x i j m x i ) T ( x i j m x i )
S W y = i = 1 n j = 1 n ( y i j m y i ) T ( y i j m y i )  
where x i j X , y i j Y is the j-th training sample of class i, n is the number of training samples in class I, and m x i , m y i denote the mean vectors of samples x and y in class i, respectively.
The between-set covariance matrix of X and Y is given by
S b x y = 1 n i = 1 n ( x i m x ) ( y i m y ) T
On the basis of the introduction above, we obtain the generalized canonical correlation discriminant criterion as
J ( x , y ) = u T S b x y v u T S W x u v T S W y v
where u and v are pair vectors that maximize J ( x , y ) and are regarded as the projective directions. The combined features that are extracted using the linear transformation, which are composed of GCPV, are called the generalized canonical discriminant features.
X * = ( u 1 T x , u 2 T x , u d T x ) T = ( u 1 , u 2 , u d ) T x = U T x ,
Y * = ( v 1 T y , v 2 T y , v d T y ) T = ( v 1 , v 2 , v d ) T y = V T y
The following two linear transformations will form the combined features projected, which will then be used for classification. W1 and W2 are named type I and type II in this paper.
W 1 = [ X * Y * ] = [ U T x V T y ] = [ U T   V T ] [ x 0 0 y ]
W 2 = X * + Y * = U T x + V T y = [ U T   V T ]   [ x y ]

3.2.2. Weighting Genetic Algorithm of GCCA (WGA-GCCA)

GCCA combined the feature samples into one-plane including the information of class matrices, which resulted in a high-dimensional eigenvector. High dimensionality not only increases the complexity of the calculation but also causes the peaking phenomenon. This means that the classifier performance begins to degrade after a certain number of features. In such a case, feature reduction is needed.
The application of feature selection methods to our dataset of EMG features is expected to reduce dimensionality and aid in finding reliable subsets [31]. Our aim is to reduce the dimensionality of GCPV and thus make a second projection to gain a new feature space. Feature reduction methods were considered here.
Genetic algorithm (GA) belongs to a large class of evolutionary algorithms, which is a metaheuristic algorithm inspired by the process of natural selection. Compared with commonly used methods like principal component analysis (PCA) that uses an orthogonal transformation to produce uncorrelated and relevant features [32], and singular value decomposition (SVD) that factorizes a single matrix into three matrices, GA has an automatic learning process aimed at achieving good feature group selection. It is commonly used to generate high-quality solutions to optimization and search problems by relying on bio-inspired operators, such as mutation, crossover, and selection [33].
In the present work, the chromosomes of GA are composed of the features extracted in Table 1. Binary coding is used as the coding method of the genetic algorithm. The initial population is generated randomly. Fisher function value is used as the fitness.
Finally, we weighted each feature vector in a new space. General weighting methods include using the degree of separation of feature sets as basis. However, this type of weighting is not conducive for each feature to play their respective proportions. Thus, we adopted the dynamic weighting method based on clustering. We utilized the rates of clustering classifiers as the weight of each channel. The formulas are given by
W i = a c c u i a c c u m i n + W m i n
r i = W i i = 1 n W i
where a c c u i and W i are the recognition rate and weight of the i-th feature set, respectively; a c c u m i n and W m i n are the recognition rate and weight of the feature set with a minimum recognition rate, respectively; and r i is the weight coefficient of the i-th feature set.
The additional processes in GA can cause severe computational cost, and thus crossover rate and mutation rate based on evolutionary algebra are used. The evolutionary algebraic decreasing function is
x = cos ( g e n g e n _ max π 2 )
where g e n and g e n _ max represent the current evolutionary algebra and total evolution algebra, respectively. Figure 4 depicts the sensitivity and specificity of the WGA-GCCA with trial times in two examples, showing the sensitivity (SEN) and specificity (SPE) can reach the highest value in the 15th iteration.

4. Classification and Results

Figure 5 represents the three-dimensional projection figure of the sEMG of gastrocnemius after WGA-GCCA. The ADLs after projection showed a general distinction, especially for the sharp ones, such as stand–squat (st–sq), squat–stand (sq–st), and fall (f).
However, the evaluation of the performance of the proposed mapping strategy and fusion method for EMG signal fusion is not a straightforward task due to the many factors that characterize performance. Therefore, we first evaluated the performance of the new feature space using the DBI. Thereafter, we evaluated the classification performance together with accuracy, complexity, and monotonicity. Accuracy was evaluated with a kernel–SVM classifier to obtain the best recognition rates. Complexity was evaluated by comparing the obtained feature space with the GCCA feature space. Monotonicity was evaluated by adding muscle channel datasets, with the channel numbers ranging from one to six.

4.1. Davies–Bouldin Index (DBI) of New Feature Space

The DBI is a non-fuzzy clustering validity index. It is mainly based on the geometrical principle, which is rooted in the degree of discrepancy between clusters and the degree of data of objects located in the same class [34].
The DBI formula is given by
D B I = 1 K i = 1 K m a x { S i + S j d i . j }
where Si represents the degree of data object dispersion in the i-th class; similarly, Sj represents the degree of data object dispersion in the j-th class; di,j represents the distance between the i-th and the j-th class; K denotes the number of clusters. Thus, a small DBI equates to a good feature space.
The DBI is typically used with the help of clustering methods. Thus, to evaluate the feature space we obtained, we adopted a fuzzy clustering method. Clustering is an unsupervised classification method that is used when the only data available are unlabeled and no structural information about such data is available [35]. C-means algorithms comprise one of the well-known partitional clustering methods that produce minimum squared-error partitions [36]. In the current work, we employed fuzzy c-means clustering (FCM). This is a clustering algorithm that uses membership degrees to determine the extent to which each data point belongs to a cluster. It divides the n vectors x i (i = 1, 2, ..., n) into c-fuzzy groups and finds the clustering centers of each group to minimize the value function of the non-similarity index.
The value of K varies in the range of 2–10. The variation of the DBI with the number of clusters for the above-mentioned feature spaces is shown in Figure 6. The figure shows that the DBI peaks at 8 for WGA-CCA and GA-GCCA; hence, these two feature spaces have better characteristics than GCCA and CCA. WGA-GCCA also exhibits a large variance, which means that the feature space can be classified into correct clusters effectively.

4.2. Accuracy

Accuracy improvement is essential for fusion method. We selected four muscle signals as inputs to evaluate accuracy performance. The four EMG channels were from gastrocnemius, tibialis anterior, rectus femoris, and semitendinosus. Four fusion methods—namely, CCA, GCCA, GA-GCCA, and WGA-GCCA—were then applied. The fused feature space was inputted into the classifier of kernel–SVM for recognition.
Kernel–SVM uses kernel methods in the support vector machine (SVM) models. Radial basis function (RBF) was used as the kernel function, given by
K ( x , x i ) = exp { | x x i | 2 σ 2 }
where σ is the width of nucleus, key to the effectiveness of classification. Particle swarm optimization (PSO) was utilized to seek optimum parameters in RBF, which has already been proved to be efficient in several existing studies [37,38].
From Section 2, at least 240 signals for each activity were collected, from which we chose 180 comparably clear signals, and six-fold cross validation was considered. The data sets were partitioned into six equal sized subsets, making the number of data for each set being 30. The first subset was used for calculating accuracy after using the remaining subsets as the training data. This process was repeated for each subset, and then averaged over six results. Table 2 shows the details of SEN (sensitivity) and SPE (specificity) of each method for the eight ADLs.
The table shows that type I is usually better than type II, as the former has more inputs to form a feature set. For each daily activity recognition, WGA-GCCA resulted in the best performance among all other methods.
Considering many popular feature selection techniques, such as the aforementioned PCA and SVD, this paper also introduced PCA-GCCA and SVD-GCCA. Generally speaking, GA based methods are computationally expensive. Table 3 thus shows not only the SEN and SPE of three selection-GCCA fusion methods, but also the calculation time.
In terms of the calculation time, SVD-GCCA fusion method has the lowest computational cost, as we chose to retain 1/4 the number of dimensions after GCCA. However, SEN and SPE of SVD-GCCA were comparably low. WGA-GCCA has a relatively slow calculating speed, but it has a high SEN and SPE. For off-line recognition, a recognition time of 0.5 s can be acceptable; for on-line recognition such as the use in self-rehabilitation robots, it can work efficiently as long as a self-run-up time is allowed.
To gain a clear result of the distinction of ADLs using WGA-GCCA, we form a confusion matrix as shown in Table 4, which indicates the frequency of correct and misclassified actions. The results showed that the fall action had the best SEN and SPE because the raw signal underwent an abrupt change. Some activities, such as stand-to-sit and sit-to-stand, are not easily distinguished each other, which make the SEN and SPE relatively low. For the gait action, WGA-GCCA SVM exerted a relatively satisfactory recognition effect. This result is due to the cyclical behavior of gait in the raw signals, which made this action different from the conversion action. For gait action, which utilizes different muscle weights, the dynamic weighting method used for it can be used employed for the action of specific gravity weighting. Thus, the identification of ADLs, especially gait recognition, offers a significant advantage.

4.3. Complexity

Complexity, especially space complexity, affects the total amount of memory space of a classifier. Space complexity can be explained as a dimension in a sense. The feature space projected by GCCA expanded to four sets of 20-dimensional feature combinations, as it did not override the concern that the system needs to deal with relatively high dimensional data, as is often implicated in many practical applications of use-centered computing schemes, in which computation resources are limited [20]. To take into account the computational resource issue, we used feature selection to obtain few feature vectors while retaining the good features. For GCCA and GA-GCCA (WGA-GCCA), the recognition rates showed a similar trend. However, GA-GCCA and WGA-GCCA achieved feature selection and a good combination with minimal feature inputs. Figure 7 shows the dimension of feature sets after GA-GCCA fusion.
For the feature space after GCCA, the dimension was extended to 20 dimensions, as indicated by the original coordinate item. GA was then applied to achieve the dimensionality reduction effect. Although the GA is random, the test results showed that the overall dimension has been reduced to about half of the original; hence, the recognition rate is ensured (as described above).

4.4. Monotonicity

Monotonicity reflects in the improvement of results when adding a new feature descriptor. To verify the monotonic experiment, we added two sets of EMG signals from the medial femoral and lateral muscles. We tested varying numbers of muscle sets, from one muscle to six muscles, and get their recognition rates. Each EMG signal was pre-produced using the extraction method. Table 5 shows the average recognition rates of different numbers of sets of EMG signals by the SVM classifier. The features obtained without using fusion (non-fusion) and those obtained with the CCA fusion method showed no significant optimization when the number of inputs increased; on the contrary, the recognition rate decreased in a sense. Fusion methods based on GCCA exhibit obvious monotonicity (Figure 8). The figure shows the increasing rate of recognition as the input increased from n to n + 1 (n = 1, 2, 3, 4, 5). As can be seen, the increasing rate of WGA-GCCA is the highest among all groups, especially the input muscle number, which increased from one muscle to two muscles. Both the table and figure prove that WGA-GCCA has the best monotonicity.

5. Discussion

The purpose of this work is to solve the shortcoming of large inputs and the weakness of EMG signals and ultimately provide a reference for daily activity monitoring. Feature projection is a widely used feature-level fusion method. However, many similar methods have been used in image processing. Feature projection typically exploits the correlations between various data dimensions with the goal of creating dimensions/axes that are uncorrelated and sufficiently describe the data [39]. Thus, using feature projection in the EMG region makes sense, as it makes full use of corresponding muscles and thus reduces the effects of external factors on a single channel. The growth of data dimensionality poses challenges to many existing mining and learning algorithms. Feature selection has been proven to be an effective and efficient way to prepare high-dimensional data for data mining and machine learning [39]. We used GA as our selection method due to their automatic learning process.
This method could further be used in other regions or for a combination of different signals. This idea helps to achieve a high recognition rate and reliability for the development of activity monitoring systems.

6. Conclusions

A feature-level fusion method based on GCCA to detect surface EMG for activity monitoring is proposed, studied, and experimentally evaluated. The GCPV created by GCCA is optimum and selected by the GA to form a new feature space. The new feature space exhibits low dimensions and good monotonicity. The results also show that the feature space has the lowest DBI of the c-means cluster and the highest recognition rate of SVM.
This study, however, has several limitations and thus needs further development. First, the method presented did not reduce the calculation time because the GA selection method generally requires long calculations. Moreover, we are not certain about how well this algorithm would work in a real scenario with unscripted free-form activities performed by elderly or frail patients. Further experiments and studies will be performed to use the method in clinical assistive devices, walking assistance devices, and robotics or prosthetic devices.

Acknowledgments

This work was supported by Zhejiang Public Welfare Technology Research (LGF18F010006), and National Natural Science Foundation of China (NSFC61671197). The authors would like to thank members of the bio-prosthesis Lab of Hangzhou Dianzi University for their contributions to being experiment participants and cooperation for data collection and processing.

Author Contributions

All authors contributed to conceptualization and design of the work, data interpretation, and review and revision of the manuscript. All authors approved the final version of the manuscript. M.T. performed data collection and data analysis. X.X. performed initial drafting of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Park, K.H.; Lim, S.H. A multipurpose smart activity monitoring system for personalized health services. Inf. Sci. 2015, 314, 240–254. [Google Scholar] [CrossRef]
  2. Leone, A.; Rescio, G.; Caroppo, A.; Siciliano, P. An EMG-based system for pre-impact fall detection. IEEE Sens. 2016, 1–4. [Google Scholar] [CrossRef]
  3. Tobón, D.P.; Falk, T.H.; Maier, M. Context awareness in WBANs: A survey on medical and non-medical applications. IEEE Wirel. Commun. 2013, 20, 30–37. [Google Scholar] [CrossRef]
  4. Roy, S.H.; Cheng, M.S.; Chang, S.S.; Moore, J.; De Luca, G.; Nawab, S.H.; De Luca, C.J. A Combined sEMG and Accelerometer System for Monitoring Functional Activity in Stroke. IEEE Trans. Neural Syst. Rehabil. Eng. 2009, 17, 585–594. [Google Scholar] [CrossRef] [PubMed]
  5. Mantilla, C.B.; Seven, Y.B.; Hurtado-Palomino, J.N.; Zhan, W.Z.; Sieck, G.C. Chronic assessment of diaphragm muscle EMG activity across motor behaviors. Respir. Physiol. Neurobiol. 2011, 177, 176–182. [Google Scholar] [CrossRef] [PubMed]
  6. Farooq, M.; Khan, A.A. Effects of shoulder rotation combined with elbow flexion on discomfort and EMG activity of ECRB muscle. Int. J. Ind. Ergon. 2014, 44, 882–891. [Google Scholar] [CrossRef]
  7. Chiauzzi, E.; Rodarte, C.; Dasmahapatra, P. Patient-centered activity monitoring in the self-management of chronic health conditions. BMC Med. 2015, 13, 77. [Google Scholar] [CrossRef] [PubMed]
  8. Liu, K.C.; Chan, C.T. Significant Change Spotting for Periodic Human Motion Segmentation of Cleaning Tasks Using Wearable Sensors. Sensors 2017, 17, 187. [Google Scholar] [CrossRef] [PubMed]
  9. Frauscher, B.; Iranzo, A.; Gaig, C.; Gschliesser, V.; Guaita, M.; Raffelseder, V.; Ehrmann, L.; Sola, N.; Salamero, M.; Tolosa, E.; et al. Normative EMG Values during REM Sleep for the Diagnosis of REM Sleep Behavior Disorder. Sleep 2012, 35, 835–847. [Google Scholar] [CrossRef] [PubMed]
  10. Istenic, R.; Kaplanis, P.A.; Pattichis, C.S.; Zazula, D. Multiscale entropy-based approach to automated surface EMG classification of neuromuscular disorders. Med. Biol. Eng. Comput. 2010, 48, 773–781. [Google Scholar] [CrossRef] [PubMed]
  11. Buchner, H.; Petersen, E.; Eger, M.; Rostalski, P. Convolutive blind source separation on surface EMG signals for respiratory diagnostics and medical ventilation control. Eng. Med. Biol. Soc. IEEE 2016. [Google Scholar] [CrossRef]
  12. Behm, D.G.; Whittle, J.; Button, D.; Power, K. Intermuscle differences in activation. Muscle Nerve 2002, 25, 236–243. [Google Scholar] [CrossRef] [PubMed]
  13. Lowe, S.A.; Ólaighin, G. Monitoring human health behaviour in one’s living environment: A technological review. Med. Eng. Phys. 2014, 36, 147–168. [Google Scholar] [CrossRef] [PubMed]
  14. Kuula, A.S. Energy expenditure and muscle activity in active and passive commute among elderly. 2011. [Google Scholar]
  15. Muhammed, H.H.; Jammalamadaka, R. A new approach for rehabilitation and upper-limb prosthesis control using optomyography (OMG). In Proceedings of the International Conference on Biomedical Engineering, Yogyakarta, Indonesia, 5–6 October 2016; pp. 1–6. [Google Scholar]
  16. Betthauser, J.L.; Hunt, C.L.; Osborn, L.E.; Masters, M.R.; Levay, G.; Kaliki, R.R.; Thakor, N.V. Limb Position Tolerant Pattern Recognition for Myoelectric Prosthesis Control with Adaptive Sparse Representations from Extreme Learning. IEEE Trans. Biomed. Eng. 2017. [Google Scholar] [CrossRef] [PubMed]
  17. Hazarika, A.; Dutta, L.; Barthakur, M.; Bhuyan, M. Fusion of projected feature for classification of EMG patterns. In Proceedings of the International Conference on Accessibility to Digital World, Guwahati, India, 16–18 December 2016. [Google Scholar]
  18. Ishii, A.; Kondo, T.; Yano, S. Improvement of EMG Pattern Recognition by Eliminating Posture-Dependent Components. In International Conference on Intelligent Autonomous Systems; Springer: Cham, Switzerland, 2016; pp. 19–30. [Google Scholar]
  19. Sun, Q.S.; Zeng, S.G.; Liu, Y.; Heng, P.A.; Xia, D.S. A new method of feature fusion and its application in image recognition. Pattern Recognit. 2005, 38, 2437–2448. [Google Scholar] [CrossRef]
  20. Liu, J. Feature dimensionality reduction for myoelectric pattern recognition: A comparison study of feature selection and feature projection methods. Med. Eng. Phys. 2014, 36, 1716–1720. [Google Scholar] [CrossRef] [PubMed]
  21. Buchenrieder, K. Processing of Myoelectric Signals by Feature Selection and Dimensionality Reduction for the Control of Powered Upper-Limb Prostheses. In Computer Aided Systems Theory—EUROCAST 2007; Moreno Díaz, R., Pichler, F., Quesada Arencibia, A., Eds.; Springer: Berlin&Heidelberg, Germany, 2007; Volume 4739, pp. 1057–1065. ISBN 978-3-540-75867-9. [Google Scholar]
  22. Bose, R.; Samanta, K.; Chatterjee, S. Cross-correlation based feature extraction from EMG signals for classification of neuro-muscular diseases. In Proceedings of the International Conference on Intelligent Control Power and Instrumentation, Kolkata, India, 21–23 October 2016; pp. 241–245. [Google Scholar]
  23. Akkaladevi, S.; Katangur, A.K.; Luo, X. Protein Structure Prediction by Fusion, Bayesian Methods. Encycl. Artif. Intell. 2009, 23, 2179–2184. [Google Scholar]
  24. Chu, J.U.; Moon, I.; Lee, Y.J.; Kim, S.-K.; Mun, M.-S. A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control. IEEE/ASME Trans. Mechatron. 2007, 12, 282–290. [Google Scholar] [CrossRef]
  25. Khushaba, R.N. Correlation Analysis of Electromyogram Signals for Multiuser Myoelectric Interfaces. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 745–755. [Google Scholar] [CrossRef] [PubMed]
  26. Correa, N.M.; Li, Y.O.; Adalı, T.; Calhoun, V.D. Canonical Correlation Analysis for Feature-Based Fusion of Biomedical Imaging Modalities and Its Application to Detection of Associative Networks in Schizophrenia. IEEE J. Sel. Top. Signal Process. 2008, 2, 998–1007. [Google Scholar] [CrossRef] [PubMed]
  27. Mehdi, N.; Somayeh, S. Multi-scale Image Fusion Based on Invariant Moments. International Research J. Appl. Basic Sci. 2017, 11, 134–139. [Google Scholar]
  28. Tkach, D.; Huang, H.; Kuiken, T.A. Study of stability of time-domain features for electromyographic pattern recognition. J. Neuroeng. Rehabil. 2010, 7, 21. [Google Scholar] [CrossRef] [PubMed]
  29. Xi, X.; Tang, M.; Miran, S.M.; Luo, Z. Evaluation of Feature Extraction and Recognition for Activity Monitoring and Fall Detection Based on Wearable sEMG Sensors. Sensors 2017, 17, 1229. [Google Scholar] [CrossRef] [PubMed]
  30. Martins, R.M.; Coimbra, D.B.; Minghim, R.; Telea, A.C. Visual analysis of dimensionality reduction quality for parameterized projections. Comput. Graph. 2014, 41, 26–42. [Google Scholar] [CrossRef]
  31. Sang, W.L.; Yi, T.; Jung, J.W.; Bien, Z. Design of a Gait Phase Recognition System That Can Cope with EMG Electrode Location Variation. IEEE Trans. Autom. Sci. Eng. 2017, 14, 1429–1439. [Google Scholar]
  32. Ronao, C.A.; Cho, S.B. Anomalous Query Access Detection in RBAC-Administered Databases with Random Forest and PCA. Inf. Sci. 2016, 369, 238–250. [Google Scholar] [CrossRef]
  33. Deb, K. An introduction to genetic algorithms. Sadhana 1999, 24, 293–315. [Google Scholar] [CrossRef]
  34. Davies, D.L.; Bouldin, D.W. A Cluster Separation Measure. IEEE Trans. Pattern Anal. Mach. Intell. 1979, 1, 224–227. [Google Scholar] [CrossRef] [PubMed]
  35. Pakhira, M.K.; Bandyopadhyay, S.; Maulik, U. Validity index for crisp and fuzzy clusters. Pattern Recognit. 2004, 37, 487–501. [Google Scholar] [CrossRef]
  36. Suganya, R.; Shanthi, R. Fuzzy c-means algorithm-a review. Int. J. Sci. Res. Publ. 2012, 2, 1. [Google Scholar]
  37. Ranaee, V.; Ata, E.; Reza, G. Application of the PSO–SVM model for recognition of control chart patterns. ISA Trans. 2010, 49, 577–586. [Google Scholar] [CrossRef] [PubMed]
  38. Subasi, A. Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders. Comput. Biol. Med. 2013, 43, 576–586. [Google Scholar] [CrossRef] [PubMed]
  39. Wang, S.; Tang, J.; Liu, H. Feature Selection. In Encyclopedia of Machine Learning and Data Mining; Sammut, C., Webb, G.I., Eds.; Springer: Boston, MA, USA, 2017; pp. 503–511. ISBN 978-1-4899-7687-1. [Google Scholar]
Figure 1. Muscles in Schematic and real placement.
Figure 1. Muscles in Schematic and real placement.
Sensors 18 00614 g001
Figure 2. Eight activities of daily living. (a) stand-to-squat; (b) squat-to-stand; (c) stand-to-sit; (d) sit-to-stand; (e) walking, stair-ascending and stair-descending; (f) trip-fall.
Figure 2. Eight activities of daily living. (a) stand-to-squat; (b) squat-to-stand; (c) stand-to-sit; (d) sit-to-stand; (e) walking, stair-ascending and stair-descending; (f) trip-fall.
Sensors 18 00614 g002
Figure 3. Delsys Full Wireless Surface Electromyography Test System (Trigno™ Wireless EMG).
Figure 3. Delsys Full Wireless Surface Electromyography Test System (Trigno™ Wireless EMG).
Sensors 18 00614 g003
Figure 4. The SEN and SPE of WGA-GCCA with trial times in two examples. (a) One example result. (b) Another example result.
Figure 4. The SEN and SPE of WGA-GCCA with trial times in two examples. (a) One example result. (b) Another example result.
Sensors 18 00614 g004
Figure 5. Three-dimensional projection figure of gastrocnemius after WGA-GCCA.
Figure 5. Three-dimensional projection figure of gastrocnemius after WGA-GCCA.
Sensors 18 00614 g005
Figure 6. DBI with various numbers of clusters of CCA, GCCA, GA-GCCA, and WGA-GCCA.
Figure 6. DBI with various numbers of clusters of CCA, GCCA, GA-GCCA, and WGA-GCCA.
Sensors 18 00614 g006
Figure 7. Dimension of feature sets after GA-GCCA fusion compared with GCCA. Un (n = x, y, z, o) Denotes the feature samples; x, y, z, o presents the four channels of data inputs.
Figure 7. Dimension of feature sets after GA-GCCA fusion compared with GCCA. Un (n = x, y, z, o) Denotes the feature samples; x, y, z, o presents the four channels of data inputs.
Sensors 18 00614 g007
Figure 8. Increasing rate of recognition as the input increased from n to n + 1 (n = 1, 2, 3, 4, 5).
Figure 8. Increasing rate of recognition as the input increased from n to n + 1 (n = 1, 2, 3, 4, 5).
Sensors 18 00614 g008
Table 1. Feature extractions in the initial feature set.
Table 1. Feature extractions in the initial feature set.
Extraction TypeDimension of Single InputsDomain
WAMP1Time domain
FE1Entropy domain
PE1Entropy domain
ARCU4Time domain
EWT5Time–frequency domain
Table 2. SEN (sensitivity) and SPE (specificity) of different fusion methods for the eight ADLs (%).
Table 2. SEN (sensitivity) and SPE (specificity) of different fusion methods for the eight ADLs (%).
St–SqSq–StSt–SiSi–StS–AS–DWFall
CCAType ISEN67.2270.6467.2267.2267.2267.2267.2270.22
SPE72.5069.5069.5069.5069.5069.5069.5069.50
Type IISEN54.0067.2264.3264.3264.3264.3264.3267.22
SPE67.2287.5054.0054.0054.0054.0054.0064.32
GCCAType ISEN88.4388.4388.4388.4388.4388.4388.4388.43
SPE92.1192.1192.1192.1192.1192.1192.1192.11
Type IISEN88.2588.2588.2588.2594.5994.5994.5994.59
SPE87.5087.5087.5093.3393.3393.3393.3367.22
GA-GCCAType ISEN95.9195.9195.9194.5994.5994.5994.5997.22
SPE87.5087.5094.5998.5989.7493.3397.2298.50
Type IISEN90.9190.9191.3591.3591.3591.3591.3595.91
SPE87.5087.5087.5090.9187.5087.5089.7491.35
WGA-GCCAType ISEN97.5096.6098.5010098.50100100100
SPE98.5995.9197.5998.5095.9197.22100100
Type IISEN95.5095.9190.9197.5090.91100100100
SPE97.2290.9194.5998.5990.9195.9198.50100
Table 3. Sensitivity (SEN), specificity (SPE), and calculation time (time) of the eight ADLs (%).
Table 3. Sensitivity (SEN), specificity (SPE), and calculation time (time) of the eight ADLs (%).
St–SqSq–StSt–SiSi–StS–AS–DWFall
WGA-GCCASEN (%)97.5096.6098.5010098.50100100100
SPE (%)98.5995.9197.5998.5095.9197.22100100
Time (s)0.50910.52900.51230.48500.52640.50040.51330. 4505
PCA-GCCASEN (%)78.7586.2590.8891.2592.3584.3590.8882.56
SPE (%)80.0292.3286.2586.7888.7581.2587.580.00
Time (s)0.13610.13960.13690.13800.14310.12450.12270.1311
SVD-GCCASEN (%)75.5073.750.680286.2586.2583.7587.2572.34
SPE (%)78.2976.680.600082.3681.7579.6282.7576.25
Time (s)0.08340.08790.08800.08810.08340.09030.08710.0991
Table 4. Confusion matrix of ADLs for WGA-GCCA (%).
Table 4. Confusion matrix of ADLs for WGA-GCCA (%).
St-SqSq-StSt-SiSi-StS-AS-DWFall
St–Sq97.5 ± 2.51.5 ± 2.0000001.0 ± 0.5
Sq–St2.1 ± 1.396.6 ± 3.31.3 ± 1.000000
St–Si0098.5 ± 1.51.5 ± 1.50000
Si–St000100 ± 00000
S–A000098.5 ± 1.51.5 ± 1.500
S–D00000100 ± 000
W000000100 ± 00
Fall0000000100
Table 5. Accuracy when different numbers of inputs are used in the SVM classifier.
Table 5. Accuracy when different numbers of inputs are used in the SVM classifier.
OneTwoThreeFourFiveSix
Non-Fusion0.62800.55770.52290.52140.51490.5464
CCA0.50.49960.50.50.50.5
GCCA0.76610.79170.80240.84290.85340.8754
GA-GCCA0.78450.81860.83570.87380.89290.9095
WGA-GCCA0.78450.84560.86550.90950.93920.9719

Share and Cite

MDPI and ACS Style

Xi, X.; Tang, M.; Luo, Z. Feature-Level Fusion of Surface Electromyography for Activity Monitoring. Sensors 2018, 18, 614. https://doi.org/10.3390/s18020614

AMA Style

Xi X, Tang M, Luo Z. Feature-Level Fusion of Surface Electromyography for Activity Monitoring. Sensors. 2018; 18(2):614. https://doi.org/10.3390/s18020614

Chicago/Turabian Style

Xi, Xugang, Minyan Tang, and Zhizeng Luo. 2018. "Feature-Level Fusion of Surface Electromyography for Activity Monitoring" Sensors 18, no. 2: 614. https://doi.org/10.3390/s18020614

APA Style

Xi, X., Tang, M., & Luo, Z. (2018). Feature-Level Fusion of Surface Electromyography for Activity Monitoring. Sensors, 18(2), 614. https://doi.org/10.3390/s18020614

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop