[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Next Article in Journal
Simulation Study of the Localization of a Near-Surface Crack Using an Air-Coupled Ultrasonic Sensor Array
Next Article in Special Issue
Feed-Forward Neural Network Prediction of the Mechanical Properties of Sandcrete Materials
Previous Article in Journal
Imaging of the Finger Vein and Blood Flow for Anti-Spoofing Authentication Using a Laser and a MEMS Scanner
Previous Article in Special Issue
Zero-Sum Matrix Game with Payoffs of Dempster-Shafer Belief Structures and Its Applications on Sensors
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Weighted Belief Entropy-Based Uncertainty Measure for Multi-Sensor Data Fusion

School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710072, China
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(4), 928; https://doi.org/10.3390/s17040928
Submission received: 9 March 2017 / Revised: 18 April 2017 / Accepted: 20 April 2017 / Published: 22 April 2017
(This article belongs to the Special Issue Soft Sensors and Intelligent Algorithms for Data Fusion)

Abstract

:
In real applications, how to measure the uncertain degree of sensor reports before applying sensor data fusion is a big challenge. In this paper, in the frame of Dempster–Shafer evidence theory, a weighted belief entropy based on Deng entropy is proposed to quantify the uncertainty of uncertain information. The weight of the proposed belief entropy is based on the relative scale of a proposition with regard to the frame of discernment (FOD). Compared with some other uncertainty measures in Dempster–Shafer framework, the new measure focuses on the uncertain information represented by not only the mass function, but also the scale of the FOD, which means less information loss in information processing. After that, a new multi-sensor data fusion approach based on the weighted belief entropy is proposed. The rationality and superiority of the new multi-sensor data fusion method is verified according to an experiment on artificial data and an application on fault diagnosis of a motor rotor.

1. Introduction

In the age of artificial intelligence, sensors play quite an important role for environment sensing and information acquisition. At the same time, sensors may be affected by the complicated application environment. Thus, multi-sensor modeling and sensor data fusion are important issues in many real applications [1,2,3,4,5,6,7]. Driven by real applications, many methods have been proposed for multi-sensor modeling and sensor data fusion [8], including neural network models [1,9], belief function theory [10,11], Dempster–Shafer evidence theory [12,13,14], fuzzy set theory [15], Z-Numbers [16], and so on [17]. Furthermore, accompanied by multi-sensor data fusion, how to measure the uncertain degree or the reliability of sensor reports with heterogeneous sources is still an open issue. This paper focuses on multi-sensor data fusion by firstly proposing a new uncertainty measure and then designing a new uncertainty measure-based sensor data fusion approach.
Dempster–Shafer evidence theory [18,19] is effective in uncertain information modeling and processing, and it has been widely used in many fields, such as multiple attribute decision making [20,21,22], risk analysis [23,24,25,26,27,28], pattern recognition [29,30,31,32,33,34], fault diagnosis [11,12,13], controller design [35,36] and so on [37,38,39]. Although Dempster–Shafer evidence theory is an effective method for information processing, the classical Dempster’s rule of combination can’t be used directly for conflict sensor data fusion, especially when there exists highly conflicting data, which may lead to counterintuitive results [40,41]. One way to handle the conflict information in real applications, such as sensor data fusion, is to quantify the uncertainty before applying data fusion [11,13,42]. However, how to measure the uncertainty of uncertain information in the framework of Dempster–Shafer evidence theory is still an open issue [43,44,45].
Shannon entropy is an admitted way for measuring information volume [46], which is a typical way for uncertainty measure in the probabilistic framework. Although Shannon entropy has been generalized to many fields, for example, as a generalization of Shannon entropy, network entropy is an effective measurement for measuring the complexity of networks [47,48,49,50], and Shannon entropy can’t be used directly among mass functions in the framework of Dempster–Shafer evidence theory because a mass function is a generalized probability assigned on the power set of the frame of discernment (FOD). To address this issue, many uncertainty measures in Dempster–Shafer framework are proposed, such as Hohle’s confusion measure [51], Yager’s dissonance measure [52], the weighted Hartley entropy [53], Klir and Ramer’s discord measure [54], Klir and Parviz’s strife measure [55] and George and Pal’s conflict measure [56] and so on [43,44]. However, the existed methods may not be that effective in some cases [57]. Recently, another uncertainty measure named Deng entropy is proposed [57]. Although Deng entropy had been successfully applied in some real applications [11,12,13,14,16], Deng entropy didn’t take into consideration of the scale of FOD, which means a loss of available and valuable information in information processing.
In order to overcome this shortage of Deng entropy, a weighted belief entropy based on Deng entropy is proposed in this paper. The weighted belief entropy takes advantage of the relative scale of a proposition with respect to the FOD. In other words, the cardinality of the proposition and the number of element in FOD are used to define the weight factor in the proposed uncertain measure. After that, based on the proposed measure, a new sensor data fusion approach is proposed. In the proposed method, the weighted belief entropy is used to preprocess the conflict data by measuring the uncertain degree of each body of evidence (BOE). Finally, the conflict data can be fused by Dempster’s rule of combination.The effectiveness of the weighted belief entropy is verified with the numerical example in [57]. In addition, the new sensor data fusion method is applied on fault diagnosis of a motor rotor to show the capacity of the new method in real application.
The rest of this paper is organized as follows. In Section 2, the preliminaries on Dempster–Shafer evidence theory, Shannon entropy, Deng entropy and some uncertainty measures in Dempster–Shafer framework are briefly introduced. In Section 3, the weighted belief entropy is proposed. In Section 4, a new sensor data fusion approach based on the weighted belief entropy is proposed. In Section 5, a numerical example for the new method is presented. In Section 6, the proposed sensor data fusion method is used for fault diagnosis of a motor rotor. The conclusions are given in Section 7.

2. Preliminaries

Some preliminaries are briefly introduced in this section, including Dempster–Shafer evidence theory [18,19], Shannon entropy [46], Deng entropy [57] and some other typical uncertainty measures in Dempster–Shafer framework [51,52,53,54,55,56].

2.1. Dempster–Shafer Evidence Theory

Let Ω = θ 1 , θ 2 , , θ i , , θ N be a finite nonempty set of mutually exclusive and exhaustive events, Ω is called the frame of discernment (FOD). The power set of Ω , denoted as 2 Ω , is composed of 2 N elements denoted as follows:
2 Ω = , θ 1 , θ 2 , , θ N , θ 1 , θ 2 , , θ 1 , θ 2 , , θ i , , Ω .
A mass function m is defined as a mapping from the power set 2 Ω to the interval [0,1], which satisfies the following conditions [18,19]:
m = 0 , A Ω m A = 1 .
If m A > 0 , then A is called a focal element, the mass function m A represents how strongly the evidence supports the proposition A.
A body of evidence (BOE), also known as a basic probability assignment (BPA) or basic belief assignment (BBA), is represented by the focal sets and their associated mass value:
, m = A , m A : A 2 Ω , m A > 0 ,
where is a subset of the power set 2 Ω , and each A has an associated nonzero mass value m A .
A BPA m can also be represented by its associate belief function B e l and plausibility function P l respectively, defined as follows:
B e l A = ϕ B A m B      a n d      P l A = B A ϕ m B .
In Dempster–Shafer evidence theory, two independent mass functions, denoted as m 1 and m 2 , can be combined with Dempster’s rule of combination defined as [18,19]:
m ( A ) = m 1 m 2 A = 1 1 - k B C = A m 1 ( B ) m 2 ( C ) ,
where k is a normalization constant representing the degree of conflict between m 1 and m 2 , k is defined as [18,19]:
k = B C = m 1 ( B ) m 2 ( C ) .

2.2. Shannon Entropy

As an uncertainty measure of information volume in a system or process, Shannon entropy plays a central role in information theory. Shannon entropy indicates that the information volume of each piece of information is directly connected to its uncertain degree.
Shannon entropy, as the information entropy, is defined as follows [46]:
H = - i = 1 N p i log b p i ,
where N is the number of basic states, p i is the probability of state i, and p i satisfies i = 1 N p i = 1 . If the unit of information is bits, then b = 2 .

2.3. Deng Entropy

Deng entropy is a generalization of Shannon entropy in Dempster–Shafer framework. If the information is modelled in the framework of a probability theory, Deng entropy can be degenerated to Shannon entropy. Deng entropy, denoted as E d , is defined as follows [57]:
E d m = - A X m A log 2 m A 2 | A | - 1 ,
where A denotes the cardinality of the proposition A, and X is the FOD. If and only if the mass value is assigned to single elements, Deng entropy can be degenerated to Shannon entropy, in this case, the form of Deng entropy is as follows:
E d m = - A X m A log 2 m A 2 | A | - 1 = - A X m A log 2 m A .
For more details about Deng entropy, please refer to [57].

2.4. Uncertainty Measures in Dempster–Shafer Framework

In this section, some other typical uncertainty measures in the framework of Dempster–Shafer evidence theory are briefly introduced. Assume that X is the FOD, A and B are focal elements of the mass function, and A denotes the cardinality of A. Then, the definitions of different uncertainty measures are shown as follows.

2.4.1. Hohle’s Confusion Measure

Hohle’s confusion measure, denoted as C H , is defined as follows [51]:
C H m = - A X m A log 2 B e l A .

2.4.2. Yager’s Dissonance Measure

Yager’s dissonance measure, denoted as E Y , is defined as follows [52]:
E Y m = - A X m A log 2 P l A .

2.4.3. Dubois and Prade’s Weighted Hartley Entropy

Dubois and Prade’s weighted Hartley entropy, denoted as E D P , is defined as follows [53]:
E D P m = A X m A log 2 A .

2.4.4. Klir and Ramer’s Discord Measure

Klir and Ramer’s discord measure, denoted as D K R , is defined as follows [54]:
D K R m = - A X m A log 2 B X m B A B B .

2.4.5. Klir and Parviz’s Strife Measure

Klir and Parviz’s strife measure, denoted as S K P , is defined as follows [55]:
S K P m = - A X m A log 2 B X m B A B A .

2.4.6. George and Pal’s Conflict Measure

The total conflict measure proposed by George and Pal, denoted as T C G P , is defined as follows [56]:
T C G P m = A X m A B X m B 1 - A B A B .

3. The Proposed Uncertainty Measurement

In this section, a weighted belief entropy based on Deng entropy is proposed. In the framework of Dempster–Shafer evidence theory, the uncertain information is represented not only by mass functions, the FOD is also a source of uncertainty, for example, the number of elements in a FOD can be changed even if the mass value of each proposition keeps still. However, the existed belief entropy, such as Dubois and Prade’s weighted Hartley entropy and Deng entropy, only takes into consideration of mass functions, the cardinality of the proposition and the scale of FOD are ignored. This may lead to information loss in information processing.

3.1. Weighted Belief Entropy

By addressing more available information in the evidence, includes the scale of FOD, denoted as X , and the relative scale of a focal element with respect to the FOD, denoted as ( A / X ) . The new belief entropy named the weighted belief entropy is proposed as follows:
E W d m = - A X A m A X log 2 m A 2 A - 1 ,
where X is the FOD, A is the focal element of the mass function, A denotes the cardinality of the proposition A and X is the number of elements in FOD.
Compared with Deng entropy, the weighted belief entropy addresses more uncertain information in BOE, which can contribute to a more accurate information processing procedure in real applications. In the next subsection, a numerical example is used to show the effectiveness of the new measure, as well as making a comparison with some other typical uncertainty measures in Dempster–Shafer framework.

3.2. Numerical Example

In order to test the capacity and superiority of the weighted belief entropy, recall the example in [57].
Consider the mass function m 6 = 0 . 05 , m 3 , 4 , 5 = 0 . 05 , m T = 0 . 8 and m X = 0 . 1 in a FOD X = 1 , 2 , . . . , 14 , 15 with fifteen elements denoted as Element 1, ..., and Element 15. T represents a variable subset with its number of element changes from Element 1 to Element 14, as is shown in Table 1.
Deng entropy E d in Equation (8) and the weighted belief entropy E W d in Equation (16) are calculated with a changed proposition, and the results are shown in Table 1. According to Table 1, the values of weighted belief entropy are all smaller than that of Deng entropy. This is reasonable because more information in the BOE is taken into consideration with the weighted belief entropy, which means the weighted belief entropy has less information loss than Deng entropy. By reducing the uncertain degree, the new measure can be more accurate than Deng entropy for uncertainty measure in information processing.
Figure 1 shows the comparison results of different uncertainty measures in Dempster–Shafer framework. The uncertain degree measured by Hohle’s confusion measure never changes with the variation of the element number in proposition T, thus it cannot measure the variance of uncertainty in this case. Similar to the confusion measure, Yager’s dissonance measure has a limited capacity of uncertainty measure in this case. The uncertain degree measured by Klir and Ramer’s discord measure, Klir and Parviz’s strife measure and George and Pal’s conflict measure all decreases with the increase of the element number in proposition T. Thus, the confusion measure, dissonance measure, discord measure, strife measure and conflict measure can’t effectively measure the increase of uncertain degree in BOE in this case. With Dubois and Prade’s weighted Hartley entropy, Deng entropy and the weighted belief entropy, the uncertain degree increases significantly with the increase of the element number in proposition T. However, the weighted Hartley entropy and Deng entropy have significant information loss compared with the weighted belief entropy because the uncertain information modelled as the scale of FOD ( X ) hasn’t been addressed in Equation (8) and Equation (12). Above all, the weighted belief entropy is more reasonable than the other uncertain measures in this case.

4. The Weighted Belief Entropy-Based Sensor Data Fusion Approach

In order to fuse conflict sensor data properly in real applications, in this section, a multi-sensor data fusion approach is proposed based on the new measure. In the proposed method, the uncertain degree of evidence is measured by the new weighted belief entropy. Five steps are included in the proposed multi-sensor data fusion method, as is shown in Figure 2.
The details of the five steps in Figure 2 are presented as follows.
Step 1
Uncertain data modeling with BPA.
In real applications, the information or data can be any style, so the first step of information processing in the frame of the Dempster–Shafer evidence theory mainly focuses on modeling uncertain information with BPAs in BOE.
Step 2
Uncertainty measure of BPA with weighted belief entropy.
The uncertain degree of information modeled by BPAs in the 1st step needs to be measured with a proper uncertainty measure before further processing. In the proposed method, the weighted belief entropy is used to measure the uncertain degree of each BOE.
For the ith BOE ( i = 1 , 2 , , n ), its corresponding uncertain degree with the weighted belief entropy E W d is calculated as follows:
E W d m i = - A X A m i A X log 2 m i A 2 A - 1 .
Step 3
Calculate the weight of each BOE.
Based on the value of weighted belief entropy, the weight of each BOE can be calculated. Generally, the weight of each BOE has a positive correlation with the uncertainty measure of each BPA [12].
For the ith BOE ( i = 1 , 2 , , n ), its weight based on the uncertain degree measured by the weighted belief entropy is calculated as follows:
w i = E W d m i i = 1 n E W d m i .
Step 4
Calculate the weighted mass functions.
The weighted mass function of each proposition is calculated for the final data fusion.
For each proposition A in the BOE, the weighted mass function can be calculated as follows:
m w A = i = 1 n w i m i A .
Step 5
Data fusion with Dempster’s rule of combination.
In the proposed method, the conflict among different evidence is transformed and measured by the weighted belief entropy, and now data fusion can be completed with Dempster’s rule of combination.
For each proposition A in the BOE, the combination result can be obtained by calculating Dempster’s rule of combination with ( n - 1 ) times:
m A = ( ( ( ( m w m w ) 1 m w ) 2 . . . m w ) ( n - 2 ) m w ) ( n - 1 ) A , n 2 .

5. Experiment with Artificial Data

In order to verify the rationality and effectiveness of the proposed multi-sensor data fusion method, an experiment is performed in this section. The experiment in [58] is recalled for the convenience of making a comparison with some other methods.
Considering a target recognition problem, three potential targets are denoted as A, B and C, respectively. The evidence reported by five sensors is modeled as BPAs, as is shown in Table 2. Intuitively, as is described in [58], the report from the 2nd sensor is contrary to the other four sensors and A will be the recognized target with the highest belief.
Execute the method in Figure 2 of Section 4. The result of the 1st step is adopted from [58], and the BPAs are presented in Table 2.
For the 2nd step, with Equation (17), the weighted belief entropy of each sensor report is calculated as follows:
E W d m 1 = - A X A m 1 A X log 2 m 1 A 2 A - 1 = 0 . 5221 ,
E W d m 2 = - A X A m 2 A X log 2 m 2 A 2 A - 1 = 0 . 1563 ,
E W d m 3 = - A X A m 3 A X log 2 m 3 A 2 A - 1 = 0 . 9647 ,
E W d m 4 = - A X A m 4 A X log 2 m 4 A 2 A - 1 = 0 . 9921 ,
E W d m 5 = - A X A m 5 A X log 2 m 5 A 2 A - 1 = 0 . 9225 .
For the 3rd step, the weight of each evidence (BOE) can be calculated with Equation (18), the calculation results are as follows:
w 1 = E W d m 1 i = 1 5 E W d m i = 0 . 1468 ,
w 2 = E W d m 2 i = 1 5 E W d m i = 0 . 0439 ,
w 3 = E W d m 3 i = 1 5 E W d m i = 0 . 2712 ,
w 4 = E W d m 4 i = 1 5 E W d m i = 0 . 2789 ,
w 5 = E W d m 5 i = 1 5 E W d m i = 0 . 2593 .
For the 4th step, with Equation (19), the weighted mass function of each proposition in Table 2 is calculated as follows:
m w A = i = 1 5 w i m i A = 0 . 5264 ,
m w B = i = 1 5 w i m i B = 0 . 1549 ,
m w C = i = 1 5 w i m i C = 0 . 0484 ,
m w A , C = i = 1 5 w i m i A , C = 0 . 2703 .
Finally, for the 5th step, with Dempster’s rule of combination and Equation (20), each of the new weighted mass function is fused four times. The fusion results are shown as follows:
m A = ( ( ( ( m w m w ) 1 m w ) 2 m w ) 3 m w ) 4 A = 0 . 9895 ,
m B = ( ( ( ( m w m w ) 1 m w ) 2 m w ) 3 m w ) 4 B = 0 . 0003 ,
m C = ( ( ( ( m w m w ) 1 m w ) 2 m w ) 3 m w ) 4 C = 0 . 0057 ,
m A , C = ( ( ( ( m w m w ) 1 m w ) 2 m w ) 3 m w ) 4 A , C = 0 . 0045 .
With the proposed method, it can be concluded that target A is the recognized target. The results of this experiment with different methods are shown in Table 3. Although the experiment results with the methods in [11,58,59] all get a high belief on target A, the proposed method has the highest belief (98.95%) on the recognized target A. In addition, in [11], the method for evidence modification is based on evidence distance and Deng entropy simultaneously, which is not convincing, because both evidence distance and Deng entropy are based on mass functions of BOE, thus there exists a coupling relationship among those two indices in [11]. Compared with the methods in [11,58,59], the weighted belief entropy in the new method contributes to a stronger capacity in conflict data fusion by addressing more available uncertain information in BOE.

6. Application in Fault Diagnosis

In this section, the proposed method is applied to an experiment of fault diagnosis for a motor rotor. The practical data in [16] is adopted for the convenience of making a comparative study with some other methods.

6.1. Problem Description

According to [16], suppose there are three types of fault in a motor rotor, denoted as F 1 = { R o t o r u n b a l a n c e } , F 2 = { R o t o r m i s a l i g n m e n t } and F 3 = { P e d e s t a l l o o s e n e s s } , respectively. Three vibration acceleration sensors are placed in different installation positions to collect the vibration signal. The acceleration vibration frequency amplitudes at the frequencies of F r e q 1 , F r e q 2 and F r e q 3 are taken as the fault feature variables. The results of sensor reports modelled as BOEs are presented in Table 4, where m s 1 · , m s 2 · and m s 3 · denote the BOEs reported from these three vibration acceleration sensors.

6.2. Data Fusion Based on the New Method

Execute the method presented in Section 4 to solve the fault diagnosis problem mentioned above.
Step 1 Uncertain data modeling with BPA.
In this paper, BPAs of sensor reports are directly adopted from [16], as is shown in Table 4. In real applications, how to model uncertain information with BPAs is an open issue [60,61], which is not the scope of this paper. For more information about generating BPAs of Table 4, please refer to [16].
Step 2 Uncertainty measure of BPA with weighted belief entropy.
In the proposed method, the uncertainty of sensor reports is measured based on the weighted belief entropy. With Equation (17), the weighted belief entropy of each BOE under the vibration acceleration frequency of F r e q 1 is calculated as follows:
E W d m s 1 = - A X A m s 1 A X log 2 m s 1 A 2 A - 1 = 0 . 5657 ,
E W d m s 2 = - A X A m s 2 A X log 2 m s 2 A 2 A - 1 = 0 . 7096 ,
E W d m s 3 = - A X A m s 3 A X log 2 m s 3 A 2 A - 1 = 0 . 7206 .
Similarly, the weighted belief entropy of sensor reports under F r e q 2 and F r e q 3 can be calculated, and the results are shown in Table 5.
Step 3 Calculate the weight of each BOE.
With Equation (18), for the vibration acceleration frequency of F r e q 1 , the weight of each BOE for evidence modification is calculated as follows:
w S 1 = E W d m s 1 i = 1 3 E W d m s i = 0 . 5657 0 . 5657 + 0 . 7096 + 0 . 7206 = 0 . 2834 ,
w S 2 = E W d m s 2 i = 1 3 E W d m s i = 0 . 7096 0 . 5657 + 0 . 7096 + 0 . 7206 = 0 . 3555 ,
w S 3 = E W d m s 3 i = 1 3 E W d m s i = 0 . 7206 0 . 5657 + 0 . 7096 + 0 . 7206 = 0 . 3610 .
The weight of different sensor reports under F r e q 2 and F r e q 3 is shown in Table 6.
Step 4 Calculate the weighted mass functions.
With Equation (19), the modified mass function for each judgement on fault types with respect to F r e q 1 can be calculated as follows:
  • m w F 2 = i = 1 3 w s i m i F 2 = 0 . 2834 × 0 . 8176 + 0 . 3555 × 0 . 5658 + 0 . 3610 × 0 . 2403 = 0 . 5196 ,
  • m w F 3 = i = 1 3 w s i m i F 3 = 0 . 2834 × 0 . 0003 + 0 . 3555 × 0 . 0009 + 0 . 3610 × 0 . 0004 = 0 . 0006 ,
  • m w F 1 , F 2 = i = 1 3 w s i m i F 1 , F 2 = 0 . 2834 × 0 . 1553 + 0 . 3555 × 0 . 0646 + 0 . 3610 × 0 . 0141 = 0 . 0721 ,
  • m w F 1 , F 2 , F 3 = i = 1 3 w s i m i F 1 , F 2 , F 3 = 0 . 2834 × 0 . 0268 + 0 . 3555 × 0 . 3687 + 0 . 3610 × 0 . 7452 = 0 . 4077 .
The modified mass function for F r e q 2 and F r e q 3 can also be calculated with Equation (19), and the results are shown in Table 7.
Step 5 Data fusion with Dempster’s rule of combination.
With Equation (20), for the vibration acceleration frequency of F r e q 1 , the modified mass function will be fused with Dempster’s rule of combination two times, shown as follows:
m F 2 = m w m w 1 m w 2 F 2 = 0 . 8891 ,
m F 3 = m w m w 1 m w 2 F 3 = 0 . 0003 ,
m F 1 , F 2 = m w m w 1 m w 2 F 1 , F 2 = 0 . 0427 ,
m F 1 , F 2 , F 3 = m w m w 1 m w 2 F 1 , F 2 , F 3 = 0 . 0679 .
The fusion results for F r e q 2 and F r e q 3 are shown in Table 8.

6.3. Discussion

The result of fault diagnosis, according to Table 8, is that F 2 is the fault type. The conflict of sensor reports in the problem, e.g., under F r e q 2 , the belief on F 2 is 0.8176, 0.5658 and 0.2403, respectively, is overcome with the new method. According to Table 9, the fusion result is consistent with the method in [16]. In addition, the fusion result with the proposed method has a higher support degree on the decision that F 2 is the diagnosis result in comparison with the method in [16].
Three reasons contribute to the effectiveness and superiority of the new multi-sensor data fusion method. Firstly, the new method is based on the new uncertainty measure, the new measure can address more uncertain information in the Dempster–Shafer evidence theory framework, which contributes to a more accurate experiment result in comparison with [16]. Secondly, the sensor data is preprocessed properly with the new uncertainty measure in the proposed sensor data fusion method, which is very important in combining conflict evidence. Finally, the merits of Dempster’s rule, such as satisfying the rule of commutativity and associativity, guarantee the rationality of the fusion result.

7. Conclusions

In this paper, in the Dempster–Shafer evidence theory framework, the weighted belief entropy is proposed based on Deng entropy. The new measure takes advantage of information included in, not only the mass function, but also the scale of the FOD. By addressing more information in a BOE, which means less information loss in information processing, the weighted belief entropy can quantify the uncertainty of evidence effectively. The numerical example shows that this new measure can quantify the uncertainty of evidence more accurately, which is helpful for information processing.
Based on the weighted belief entropy, a multi-sensor data fusion approach is proposed in this paper. A numerical example and an application on fault diagnosis are presented to verify the rationality and effectiveness of the new sensor data fusion method. Both the numerical example and the application indicate that the new measure contributes to a more accurate sensor data fusion method by addressing more uncertain information in the Dempster–Shafer evidence theory framework (BOE).
Further study of this work will be focused on extending the new measure and the proposed multi-sensor data fusion approach to solve more problems in industrial applications.

Acknowledgments

The authors greatly appreciate the editor’s encouragement and the two anonymous reviewers’ constructive comments to improve this paper. The work is partially supported by the National Natural Science Foundation of China (Grant No. 61671384), the Natural Science Basic Research Plan in Shaanxi Province of China (Grant No. 2016JM6018), the Aviation Science Foundation (Grant No. 20165553036), the Fund of Shanghai Aerospace Science and Technology (Grant No. SAST2016083) and the Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University (Grant No. CX201705).

Author Contributions

Y.T. and D.Z. designed and performed the research. Y.T. wrote the manuscript. Y.T. and S.X. performed the computation. Y.T. and Z.H. analyzed the data. Z.H. contributed analysis tools. All authors discussed the results and commented on the manuscript.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses or interpretation of data; in the writing of the manuscript; nor in the decision to publish the results.

References

  1. Alexandridis, A. Evolving RBF neural networks for adaptive soft-sensor design. Int. J. Neural Syst. 2013, 23, 1350029. [Google Scholar] [CrossRef] [PubMed]
  2. Marinkovic, Z.; Atanaskovic, A.; Xibilia, M.G.; Pace, C.; Latino, M.; Donato, N. A neural network approach for safety monitoring applications. In Proceedings of the 2016 IEEE Sensors Applications Symposium (SAS), Catania, Italy, 20–22 April 2016; pp. 297–301. [Google Scholar]
  3. Graziani, S.; Pagano, F.; Xibilia, M.G. Soft sensor for a propylene splitter with seasonal variations. In Proceedings of the 2010 IEEE Instrumentation Measurement Technology Conference (I2MTC), Austin, TX, USA, 3–6 May 2010; pp. 273–278. [Google Scholar]
  4. Caponetto, R.; Dongola, G.; Gallo, A.; Xibilia, M.G. FPGA Implementation of a soft sensor for the estimation of the freezing point of kerosene. In Proceedings of the ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, San Diego, CA, USA, 30 August–2 September 2009; pp. 151–158. [Google Scholar]
  5. Geng, H.; Liang, Y.; Yang, F.; Xu, L.; Pan, Q. Model-reduced fault detection for multi-rate sensor fusion with unknown inputs. Inf. Fusion 2016, 33, 1–14. [Google Scholar] [CrossRef]
  6. Reiche, J.; Verbesselt, J.; Hoekman, D.; Herold, M. Fusing Landsat and SAR time series to detect deforestation in the tropics. Remote Sens. Environ. 2015, 156, 276–293. [Google Scholar] [CrossRef]
  7. Ma, J.; Zhao, J.; Ma, Y.; Tian, J. Non-rigid visible and infrared face registration via regularized Gaussian fields criterion. Pattern Recognit. 2015, 48, 772–784. [Google Scholar] [CrossRef]
  8. Jiang, D.; Zhuang, D.; Huang, Y.; Fu, J. Advances in multi-sensor data fusion: Algorithms and applications. Sensors 2009, 9, 7771–7784. [Google Scholar]
  9. Fortuna, L.; Graziani, S.; Xibilia, M.G. Comparison of soft-sensor design methods for industrial plants using small data sets. IEEE Trans. Instrum. Meas. 2009, 58, 2444–2451. [Google Scholar] [CrossRef]
  10. Frikha, A.; Moalla, H. Analytic hierarchy process for multi-sensor data fusion based on belief function theory. Eur. J. Oper. Res. 2015, 241, 133–147. [Google Scholar] [CrossRef]
  11. Yuan, K.; Xiao, F.; Fei, L.; Kang, B.; Deng, Y. Conflict management based on belief function entropy in sensor fusion. SpringerPlus 2016, 5, 638. [Google Scholar] [CrossRef] [PubMed]
  12. Jiang, W.; Wei, B.; Xie, C.; Zhou, D. An evidential sensor fusion method in fault diagnosis. Adv. Mech. Eng. 2016, 8, 1–7. [Google Scholar] [CrossRef]
  13. Yuan, K.; Xiao, F.; Fei, L.; Kang, B.; Deng, Y. Modeling sensor reliability in fault diagnosis based on evidence Theory. Sensors 2016, 16, 113. [Google Scholar] [CrossRef] [PubMed]
  14. Jiang, W.; Wei, B.; Qin, X.; Zhan, J.; Tang, Y. Sensor data fusion based on a new conflict measure. Math. Probl. Eng. 2016, 2016, 5769061. [Google Scholar] [CrossRef]
  15. Chen, S.; Deng, Y.; Wu, J. Fuzzy sensor fusion based on evidence theory and its application. Appl. Artif. Intell. 2013, 27, 235–248. [Google Scholar] [CrossRef]
  16. Jiang, W.; Xie, C.; Zhuang, M.; Shou, Y.; Tang, Y. Sensor data fusion with z-numbers and its application in fault diagnosis. Sensors 2016, 16, 1509. [Google Scholar] [CrossRef] [PubMed]
  17. Gao, C.; Yan, C.; Adamatzky, A.; Deng, Y. A bio-inspired algorithm for route selection in wireless sensor networks. IEEE Commun. Lett. 2014, 18, 2019–2022. [Google Scholar] [CrossRef]
  18. Dempster, A.P. Upper and lower probabilities induced by a multi-valued mapping. Ann. Math. Stat. 1967, 38, 325–339. [Google Scholar] [CrossRef]
  19. Shafer, G. A Mathematical Theory of Evidence; Princeton University Press: Princeton, NJ, USA, 1976. [Google Scholar]
  20. Chin, K.S.; Fu, C.; Wang, Y. A method of determining attribute weights in evidential reasoning approach based on incompatibility among attributes. Comput. Ind. Eng. 2015, 87, 150–162. [Google Scholar] [CrossRef]
  21. Du, W.S.; Hu, B.Q. Attribute reduction in ordered decision tables via evidence theory. Inf. Sci. 2016, 364, 91–110. [Google Scholar] [CrossRef]
  22. Fu, C.; Wang, Y. An interval difference based evidential reasoning approach with unknown attribute weights and utilities of assessment grades. Comput. Ind. Eng. 2015, 81, 109–117. [Google Scholar] [CrossRef]
  23. Wang, Y.M.; Elhag, T.M.S. A comparison of neural network, evidential reasoning and multiple regression analysis in modelling bridge risks. Expert Syst. Appl. 2007, 32, 336–348. [Google Scholar] [CrossRef]
  24. Su, X.; Deng, Y.; Mahadevan, S.; Bao, Q. An improved method for risk evaluation in failure modes and effects analysis of aircraft engine rotor blades. Eng. Fail. Anal. 2012, 26, 164–174. [Google Scholar] [CrossRef]
  25. Fu, C.; Yang, J.B.; Yang, S.L. A group evidential reasoning approach based on expert reliability. Eur. J. Oper. Res. 2015, 246, 886–893. [Google Scholar] [CrossRef]
  26. Zhang, X.; Mahadevan, S.; Deng, X. Reliability analysis with linguistic data: An evidential network approach. Reliab. Eng. Syst. Saf. 2017, 162, 111–121. [Google Scholar] [CrossRef]
  27. Jiang, W.; Xie, C.; Wei, B.; Zhou, D. A modified method for risk evaluation in failure modes and effects analysis of aircraft turbine rotor blades. Adv. Mech. Eng. 2016, 8, 1–16. [Google Scholar] [CrossRef]
  28. Su, X.; Mahadevan, S.; Xu, P.; Deng, Y. Dependence assessment in human reliability analysis using evidence theory and AHP. Risk Anal. 2015, 35, 1296–1316. [Google Scholar] [CrossRef] [PubMed]
  29. Denoeux, T. A k-nearest neighbor classification rule based on Dempster–Shafer theory. IEEE Trans. Syst. Man Cybern. 1995, 25, 804–813. [Google Scholar] [CrossRef]
  30. Liu, Z.G.; Pan, Q.; Dezert, J. A new belief-based K-nearest neighbor classification method. Pattern Recognit. 2013, 46, 834–844. [Google Scholar] [CrossRef]
  31. Ma, J.; Liu, W.; Miller, P.; Zhou, H. An evidential fusion approach for gender profiling. Inf. Sci. 2015, 333, 10–20. [Google Scholar] [CrossRef]
  32. Liu, Z.G.; Pan, Q.; Dezert, J.; Mercier, G. Credal classification rule for uncertain data based on belief functions. Pattern Recognit. 2014, 47, 2532–2541. [Google Scholar] [CrossRef]
  33. Han, D.; Liu, W.; Dezert, J.; Yang, Y. A novel approach to pre-extracting support vectors based on the theory of belief functions. Knowl.-Based Syst. 2016, 110, 210–223. [Google Scholar] [CrossRef]
  34. Liu, Z.G.; Pan, Q.; Dezert, J.; Martin, A. Adaptive imputation of missing values for incomplete pattern classification. Pattern Recognit. 2016, 52, 85–95. [Google Scholar] [CrossRef]
  35. Yager, R.R.; Filev, D.P. Including probabilistic uncertainty in fuzzy logic controller modeling using Dempster–Shafer theory. IEEE Trans. Syst. Man Cybern. 1995, 25, 1221–1230. [Google Scholar] [CrossRef]
  36. Tang, Y.; Zhou, D.; Jiang, W. A new fuzzy-evidential controller for stabilization of the planar inverted pendulum system. PLoS ONE 2016, 11, e0160416. [Google Scholar] [CrossRef] [PubMed]
  37. Wang, Y.M.; Yang, J.B.; Xu, D.L.; Chin, K.S. Consumer preference prediction by using a hybrid evidential reasoning and belief rule-based methodology. Expert Syst. Appl. 2009, 36, 8421–8430. [Google Scholar] [CrossRef]
  38. Ma, J.; Liu, W.; Benferhat, S. A belief revision framework for revising epistemic states with partial epistemic states. Int. J. Approx. Reason. 2015, 59, 20–40. [Google Scholar] [CrossRef]
  39. Zhou, K.; Martin, A.; Pan, Q.; Liu, Z.G. Median evidential c-means algorithm and its application to community detection. Knowl.-Based Syst. 2015, 74, 69–88. [Google Scholar] [CrossRef]
  40. Zadeh, L.A. A simple view of the Dempster–Shafer theory of evidence and its implication for the rule of combination. AI Mag. 1986, 7, 85–90. [Google Scholar]
  41. Deng, Y. Generalized evidence theory. Appl. Intell. 2015, 43, 530–543. [Google Scholar] [CrossRef]
  42. Fan, X.; Zuo, M.J. Fault diagnosis of machines based on D-S evidence theory. Part 1: D–S evidence theory and its improvement. Pattern Recognit. Lett. 2006, 27, 366–376. [Google Scholar] [CrossRef]
  43. Yang, Y.; Han, D. A new distance-based total uncertainty measure in the theory of belief functions. Knowl.-Based Syst. 2016, 94, 114–123. [Google Scholar] [CrossRef]
  44. Song, Y.; Wang, X.; Lei, L.; Yue, S. Uncertainty measure for interval-valued belief structures. Measurement 2015, 80, 241–250. [Google Scholar] [CrossRef]
  45. Song, Y.; Wang, X.; Zhang, H. A distance measure between intuitionistic fuzzy belief functions. Knowl.-Based Syst. 2015, 86, 288–298. [Google Scholar] [CrossRef]
  46. Shannon, C.E. A mathematical theory of communication. ACM SIGMOBILE Mob. Comput. Commun. Rev. 2001, 5, 3–55. [Google Scholar] [CrossRef]
  47. Chen, Z.; Dehmer, M.; Shi, Y. A note on distance-based graph entropies. Entropy 2014, 16, 5416–5427. [Google Scholar] [CrossRef]
  48. Cao, S.; Dehmer, M.; Shi, Y. Extremality of degree-based graph entropies. Inf. Sci. 2014, 278, 22–33. [Google Scholar] [CrossRef]
  49. Chen, Z.; Dehmer, M.; Emmert-Streib, F.; Shi, Y. Entropy bounds for dendrimers. Appl. Math. Comput. 2014, 242, 462–472. [Google Scholar] [CrossRef]
  50. Cao, S.; Dehmer, M. Degree-based entropies of networks revisited. Appl. Math. Comput. 2015, 261, 141–147. [Google Scholar] [CrossRef]
  51. Hohle, U. Entropy with respect to plausibility measures. In Proceedings of the Proceedings of the 12th IEEE International Symposium on Multiple-Valued Logic, Paris, France, 25–26 May 1982; pp. 167–169. [Google Scholar]
  52. Yager, R.R. Entropy and specificity in a mathematical theory of evidence. Int. J. Gen. Syst. 1983, 9, 249–260. [Google Scholar] [CrossRef]
  53. Dubois, D.; Prade, H. A note on measures of specificity for fuzzy sets. Int. J. Gen. Syst. 1985, 10, 279–283. [Google Scholar] [CrossRef]
  54. Klir, G.J.; Ramer, A. Uncertainty in Dempster–Shafer theory: A critical re-examination. Int. J. Gen. Syst. 1991, 18, 155–166. [Google Scholar] [CrossRef]
  55. Klir, G.J.; Parviz, B. A note on the measure of discord. In Proceedings of the Eighth International Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, 17–19 July 1992; pp. 138–141. [Google Scholar]
  56. George, T.; Pal, N.R. Quantification of conflict in Dempster-Shafer framework: A new approach. Int. J. Gen. Syst. 1996, 24, 407–423. [Google Scholar] [CrossRef]
  57. Deng, Y. Deng entropy. Chaos Solitons Fractals 2016, 91, 549–553. [Google Scholar] [CrossRef]
  58. Deng, Y.; Shi, W.; Zhu, Z.; Liu, Q. Combining belief functions based on distance of evidence. Decis. Support Syst. 2004, 38, 489–493. [Google Scholar]
  59. Zhang, Z.; Liu, T.; Chen, D.; Zhang, W. Novel algorithm for identifying and fusing conflicting data in wireless sensor networks. Sensors 2014, 14, 9562–9581. [Google Scholar] [CrossRef] [PubMed]
  60. Deng, X.; Liu, Q.; Deng, Y.; Mahadevan, S. An improved method to construct basic probability assignment based on the confusion matrix for classification problem. Inf. Sci. 2016, 340, 250–261. [Google Scholar] [CrossRef]
  61. Jiang, W.; Zhan, J.; Zhou, D.; Li, X. A method to determine generalized basic probability assignment in the open world. Math. Probl. Eng. 2016, 2016, 373142. [Google Scholar] [CrossRef]
Figure 1. Comparison between the weighted belief entropy and other uncertainty measures.
Figure 1. Comparison between the weighted belief entropy and other uncertainty measures.
Sensors 17 00928 g001
Figure 2. The flow chart of sensor data fusion based on the weighted belief entropy.
Figure 2. The flow chart of sensor data fusion based on the weighted belief entropy.
Sensors 17 00928 g002
Table 1. Comparison between the weighted belief entropy and Deng entropy with a variable proposition T.
Table 1. Comparison between the weighted belief entropy and Deng entropy with a variable proposition T.
CasesDeng EntropyWeighted Belief Entropy
T = 1 2.66232.5180
T = 1 , 2 3.93033.7090
T = 1 , 2 , 3 4.90824.6100
T = 1 , . . . , 4 5.78785.4127
T = 1 , . . . , 5 6.62566.1736
T = 1 , . . . , 6 7.44416.9151
T = 1 , . . . , 7 8.25327.6473
T = 1 , . . . , 8 9.05788.3749
T = 1 , . . . , 9 9.86009.1002
T = 1 , . . . , 10 10.66129.8244
T = 1 , . . . , 11 11.461710.5480
T = 1 , . . . , 12 12.262011.2714
T = 1 , . . . , 13 13.062211.9946
T = 1 , . . . , 14 13.862212.7177
Table 2. Basic probability assignment (BPA) of artificial data.
Table 2. Basic probability assignment (BPA) of artificial data.
BPA m ( A ) m ( B ) m ( C ) m ( A , C )
1st Sensor report: m 1 · 0.410.290.30
2nd Sensor report: m 2 · 00.90.10
3rd Sensor report: m 3 · 0.580.0700.35
4th Sensor report: m 4 · 0.550.100.35
5th Sensor report: m 5 · 0.60.100.3
Table 3. Experimental results with different methods.
Table 3. Experimental results with different methods.
Methods m ( A ) m ( B ) m ( C ) m ( A , C )
Deng et al.’s method [58]0.98200.00390.01070.0034
Zhang et al.’s method [59]0.98200.00330.01150.0032
Yuan et al.’s method [11]0.98860.00020.00720.0039
The proposed method0.98950.00030.00570.0045
Table 4. Data for fault diagnosis modelled as BPAs [16].
Table 4. Data for fault diagnosis modelled as BPAs [16].
Freq1 Freq2 Freq3
{ F 2 } { F 3 } { F 1 , F 2 } { F 1 , F 2 , F 3 } { F 2 } { F 1 , F 2 , F 3 } { F 1 } { F 2 } { F 1 , F 2 } { F 1 , F 2 , F 3 }
m s 1 · 0.81760.00030.15530.0268 0.62290.3771 0.36660.45630.11850.0586
m s 2 · 0.56580.00090.06460.3687 0.76600.2341 0.27930.41510.26520.0404
m s 3 · 0.24030.00040.01410.7452 0.85980.1402 0.28970.43310.24700.0302
Table 5. Weighted belief entropy of sensor reports under different frequencies.
Table 5. Weighted belief entropy of sensor reports under different frequencies.
E W d · Freq 1 Freq 2 Freq 3
E W d m s 1 0.56570.45960.7983
E W d m s 2 0.70960.32771.0257
E W d m s 3 0.72060.22070.9875
Table 6. Weighted belief entropy of sensor reports under different frequencies.
Table 6. Weighted belief entropy of sensor reports under different frequencies.
w S i Freq 1 Freq 2 Freq 3
w S 1 0.28340.45600.2839
w S 2 0.35550.32510.3648
w S 3 0.36100.21890.3513
Table 7. Modified mass function.
Table 7. Modified mass function.
Freq 1 Freq 2 Freq 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 1 , F 2 , F 3 } { F 2 } { F 1 , F 2 , F 3 } { F 1 } { F 2 } { F 1 , F 2 } { F 1 , F 2 , F 3 }
m w · 0.51960.00060.07210.4077 0.72120.2788 0.30770.43310.21720.0420
Table 8. Sensor data fusion results for fault diagnosis.
Table 8. Sensor data fusion results for fault diagnosis.
Freq 1 Freq 2 Freq 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 1 , F 2 , F 3 } { F 2 } { F 1 , F 2 , F 3 } { F 1 } { F 2 } { F 1 , F 2 } { F 1 , F 2 , F 3 }
Fusion result0.88910.00030.04270.0679 0.97840.0216 0.33180.63320.03490.0001
Table 9. Comparison of results obtained using proposed method and Jiang et al. method.
Table 9. Comparison of results obtained using proposed method and Jiang et al. method.
Method Freq 1 Freq 2 Freq 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 1 , F 2 , F 3 } { F 2 } { F 1 , F 2 , F 3 } { F 1 } { F 2 } { F 1 , F 2 } { F 1 , F 2 , F 3 }
Jiang et al.’s method [16]0.88610.00020.05820.0555 0.96210.0371 0.33840.59040.06510.0061
Proposed method0.88910.00030.04270.0679 0.97840.0216 0.33180.63320.03490.0001

Share and Cite

MDPI and ACS Style

Tang, Y.; Zhou, D.; Xu, S.; He, Z. A Weighted Belief Entropy-Based Uncertainty Measure for Multi-Sensor Data Fusion. Sensors 2017, 17, 928. https://doi.org/10.3390/s17040928

AMA Style

Tang Y, Zhou D, Xu S, He Z. A Weighted Belief Entropy-Based Uncertainty Measure for Multi-Sensor Data Fusion. Sensors. 2017; 17(4):928. https://doi.org/10.3390/s17040928

Chicago/Turabian Style

Tang, Yongchuan, Deyun Zhou, Shuai Xu, and Zichang He. 2017. "A Weighted Belief Entropy-Based Uncertainty Measure for Multi-Sensor Data Fusion" Sensors 17, no. 4: 928. https://doi.org/10.3390/s17040928

APA Style

Tang, Y., Zhou, D., Xu, S., & He, Z. (2017). A Weighted Belief Entropy-Based Uncertainty Measure for Multi-Sensor Data Fusion. Sensors, 17(4), 928. https://doi.org/10.3390/s17040928

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop