[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Next Article in Journal
Cryogenic Cooling in Wireless Communications
Next Article in Special Issue
On Shock Propagation through Double-Bend Ducts by Entropy-Generation-Based Artificial Viscosity Method
Previous Article in Journal
A New Physically Meaningful Threshold of Sample Entropy for Detecting Cardiovascular Diseases
Previous Article in Special Issue
Maximum Entropy Methods for Loss Data Analysis: Aggregation and Disaggregation Problems
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Canonical Divergence for Flat α-Connections: Classical and Quantum

1
Max Planck Institute for Mathematics in the Sciences, Inselstrasse 22, 04103 Leipzig, Germany
2
Santa Fe Institute, 1399 Hyde Park Rd, Santa Fe, NM 87501, USA
3
Faculty of Mathematics and Computer Science, University of Leipzig, PF 100920, 04009 Leipzig, Germany
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(9), 831; https://doi.org/10.3390/e21090831
Submission received: 25 July 2019 / Revised: 23 August 2019 / Accepted: 23 August 2019 / Published: 25 August 2019
(This article belongs to the Special Issue The Ubiquity of Entropy)

Abstract

:
A recent canonical divergence, which is introduced on a smooth manifold M endowed with a general dualistic structure ( g , , * ) , is considered for flat α -connections. In the classical setting, we compute such a canonical divergence on the manifold of positive measures and prove that it coincides with the classical α -divergence. In the quantum framework, the recent canonical divergence is evaluated for the quantum α -connections on the manifold of all positive definite Hermitian operators. In this case as well, we obtain that the recent canonical divergence is the quantum α -divergence.

1. Introduction

Methods of Information Geometry (IG) [1] are ubiquitous in physical sciences and encompass both classical and quantum systems [2]. The natural object of study in IG is a quadruple ( M , g , , * ) given by a smooth manifold M , a Riemannian metric g , and a pair of affine connections on M , which are dual with respect to g ,
X g Y , Z = g X Y , Z + g Y , X * Z ,
for all sections X , Y , Z T ( M ) . The quadruple ( M , g , , * ) is called a statistical manifold whenever the dual connections are both torsion-free [3]. Actually, the notion of the statistical manifold, introduced by Lauritzen [4], is usually referred to the triple ( M , g , T ) , where T ( X , Y , Z ) = g X * Y X Y , Z is a three-symmetric tensor. However, when and * are both torsion-free connections, the structures ( M , g , , * ) and ( M , g , T ) are equivalent [3]. When M is a manifold of probability distributions, g g F is the Fisher metric, and ( e ) and * ( m ) are the exponential and mixture connections [5], IG has been successfully applied to many fields, such as statistical inference, control systems theory, and neural networks (see [6] and the references therein for a comprehensive literature on applications of IG).
The geometric structure of a statistical manifold is encoded by a smooth function D : M × M R such that:
D ( p , q ) 0 , and D ( p , q ) = 0 iff p = q ,
for all p , q M [7]. The dualistic structure ( g , , * ) of M is then recovered in the following way:
g i j ( p ) = i j D ( ξ p , ξ q ) p = q = i j D ( ξ p , ξ q ) p = q
Γ i j k ( p ) = i j k D ( ξ p , ξ q ) p = q , Γ i j k * ( p ) = i j k D ( ξ p , ξ q ) p = q .
Here,
i = ξ p i and i = ξ q i
and { ξ p : = ( ξ p 1 , , ξ p n ) } and { ξ q : = ( ξ q 1 , , ξ q n ) } are local coordinate systems of p and q , respectively. Moreover, Γ i j k = g i j , k , Γ i j k * = g i * j , k are the symbols of the dual connections and * , respectively. The function D is called a divergence or contrast function of the statistical manifold ( M , g , , * ) [8].
The function D is called a flat divergence if the dualistic structure ( g , , * ) introduced on a smooth manifold M by Equations (3) and (4) is flat, namely the curvature tensors R ( ) and R * ( * ) are zero. In this particular case, an attempt to connect IG with physics was established in [9]. There, the connection between IG and integrable dynamical systems was bridged by a divergence, which is canonical in some sense. More precisely, for q M , the gradient flows ξ ˙ = grad ξ D ( ξ q , · ) and ξ ˙ = grad ξ D ( · , ξ q ) converge to the point q along the * -geodesic and the -geodesic, respectively. In this context, when M is the manifold of Gaussian distributions with mean μ and variance σ 2 , the Kullback-Leibler (KL) divergence induces a dualistic structure given by the Fisher metric and the ( e ) , ( m ) connections. In this case, the dynamics of the above-mentioned gradient flows, given now in terms of the KL divergence, turns out to be the Uhlenbeck-Ornstein process μ = μ 0 + v ( t + τ ) , σ 2 = 2 D ( t + τ ) characterized by the drift coefficient v and diffusion coefficient D [9]. Further connections between IG and dynamical systems can be found in [10], where certain gradient flows on Gaussian and multinomial distributions are characterized as completely integrable Hamiltonian systems.
The Kullback-Leibler divergence has been effectively employed to quantify the complexity of a system described by a probability distribution p in terms of its deviation from an exponential family of probability distributions [11]. The quantum version of the KL divergence, namely the quantum relative entropy, induces on the manifold of quantum states a dually flat structure given by a quantum version of the Fisher metric tensor and two flat connections, also called the mixture and the exponential connections, which are dual in the sense of Equation (1) [12]. Moreover, the quantum relative entropy has been used to quantify the many-party correlations of a composite quantum state ρ as the deviation of it from a Gibbs family of quantum states [13]. The utility of the quantum relative entropy as a measure of the complexity for quantum states was shown in [14], where algorithms for its evaluation were studied. Furthermore, in that context, the many-party correlations were related to the entanglement of quantum systems as defined in [15].
A generalization of the flat structures induced by the Kullback-Leibler divergence on the finite classical systems and by the quantum relative entropy on the finite quantum states is provided by the classical α -divergence and the quantum α -divergence, respectively. Both generate a one-parameter family of connections, the α -connections, which are dual with respect to the Fisher metric in the classical case [1], whereas in the quantum case, they are dual with respect to the Wigner-Yanase-Dyson metric [16].
From a physical viewpoint, it is worth remarking that the Boltzmann-Gibbs distribution in statistical physics is an exponential family such that an invariant flat structure is given to the underlying manifold in terms of the ( e ) -connection [6]. Tsallis generalized the concept of the Boltzmann-Gibbs distribution by introducing a generalized entropy, called the q -entropy, for studying various phenomena not included in the conventional Boltzmann-Gibbs framework [17,18]. Actually, the α -geometry, which is induced by the α -divergence, covers the geometry of q -entropy physics [19]. Therefore, the α -divergence can be understood as a generalization of the classical KL divergence also from a physical standpoint. In the quantum case, the geometry of q -entropy physics has been successfully employed for carrying out a criterion that detects the critical frontier, which has separable states on one side and quantum entangled ones on the other [20].
The purpose of the present article is to consider a recent canonical divergence, introduced by Ay and Amari in [21], as a tool for unifying classical and quantum information geometry. In particular, we aim to prove that this canonical divergence is the classical α -divergence when computed on the space of positive measures, as well as the quantum α -divergence if evaluated on the manifold of positive definite Hermitian operators.

2. Canonical Divergence and the Inverse Problem in Information Geometry

The inverse problem within information geometry concerns the search for a divergence function D , which recovers a given dual structure ( g , , * ) of a smooth manifold M according to Equations (3) and (4). The solution to this problem was provided by Matumoto, who showed that such a divergence always exists for any statistical manifold [22]. Nonetheless, this solution is not unique, and infinitely many divergences can be defined on M , which gives the same dualistic structure. For this reason, seeking a divergence that can be considered as the most natural is of utmost importance. To this end, Amari and Nagaoka defined a Bregman-type divergence on dually flat manifolds [1]. This one has relevant properties such as the generalized Pythagorean theorem and the geodesic projection theorem, and it is commonly assessed as the natural solution of the inverse problem in information geometry for dually flat manifolds. This is exactly why the Amari and Nagaoka divergence is referred to as the canonical divergence of dually flat statistical manifolds. However, the need for a general canonical divergence, which applies to any dualistic structure, is a very crucial issue, as pointed out in [23]. According to the theory developed in [3], a divergence function D of a statistical manifold ( M , g , , * ) is called canonical if:
  • D generates the dualistic structure ( g , , * ) based on Equations (3) and (4);
  • D is one half of the squared Riemannian distance, i.e., D ( p , q ) = 1 2 d ( p , q ) 2 , when the statistical manifold is self-dual, namely when = * coincides with the Levi–Civita connection of g ;
  • D is the canonical divergence of the Bregman type when ( M , g , , * ) is dually flat.
Ay and Amari recently defined a divergence for a general dualistic structure in terms of geodesic integration of the inverse exponential map [21]. It turns out that such a divergence satisfies all the above-mentioned requirements. Therefore, it can be viewed as a canonical divergence for a general dualistic structure. For p , q M , consider the -geodesic γ ˜ ( t ) ( 0 t 1 ) connecting q with p , the recent canonical divergence introduced in [21] is then defined by:
D ( p , q ) : = 0 1 X t ( p ) , γ ˜ ˙ ( t ) γ ˜ ( t ) d t , X t ( p ) : = exp γ ˜ ( t ) 1 ( p ) .
The -exponential map, exp : T M M , is defined by exp ( X ) = γ X ( 1 ) whenever the -geodesic γ X ( t ) , satisfying γ ˙ X ( 0 ) = X , exists on an interval of t containing [ 0 , 1 ] . Therefore, if γ : [ 0 , 1 ] M is the -geodesic such that γ ( 0 ) = p and γ ( 1 ) = q , the inverse at p of the exponential map is given by exp p 1 ( q ) : = γ ˙ ( 0 ) . According to this definition, for every t [ 0 , 1 ] , we can consider the -geodesic γ t ( s ) such that γ t ( 0 ) = p and γ t ( 1 ) = γ ( t ) and then define the -velocity vector at p by X p ( γ ( t ) ) : = exp p 1 ( γ ( t ) ) = γ ˙ t ( 0 ) . In this way, the vector field X t ( p ) of Equation (5) turns out to be given by X t ( p ) = P γ ( t ) X p ( γ ( t ) ) = t γ ˙ ( t ) . Here, P : T p M T γ ( t ) M is the -parallel transport from p to γ ( t ) . In light of all this, the divergence D ( p , q ) assumes the following useful expression:
D ( p , q ) = 0 1 t γ ˙ ( t ) 2 d t .
Analogously, the dual function of D ( p , q ) is defined as the * -geodesic integration of the inverse of the * -exponential map [21]. Therefore, we have for the dual divergence D * a similar expression as Equation (6) for the canonical divergence D :
D * ( p , q ) = 0 1 t γ ˙ * ( t ) 2 d t ,
where γ * ( t ) ( 0 t 1 ) is the * -geodesic connecting p with q .
The canonical divergence given by Equation (6) has been recently proposed as a tool for unifying classical and quantum information geometry [24]. In particular, it has been considered on the simplex of probability measures:
S : = p = i p i δ i R n | p i > 0 for all i , and i p i = 1 ,
as well as on the manifold of quantum finite states,
S : = ρ : H C | ρ = ρ > 0 , Tr ρ = 1 ,
where H denotes a finite-dimensional Hilbert space and ρ is any Hermitian operator on H . The natural dualistic structure on the simplex S is given, in classical information geometry, in terms of the Fisher metric g F and two flat connections, the mixture ( m ) and the exponential ( e ) ones, which are dual with respect to g F in the sense of Equation (1) [5]. Very remarkably, the Fisher metric is the only monotone Riemannian metric (up to a positive factor) on the class of finite probability simplices [25]. The quantum version of a monotone Riemannian metric on the manifold of quantum finite states S is given in terms of the notion of stochastic mapping [26]. More precisely, let A be the set of all Hermitian operators on the Hilbert space H ; a linear mapping T : A A is said to be stochastic if T ( S ) S and T is completely positive [27]. Furthermore, a family { , ρ | ρ S } of inner products on A is said to be monotone if A , A ρ T ( A ) , T ( A ) T ( ρ ) for any arbitrary stochastic map T and for every ρ S [26]. Due to Petz, there are infinitely many monotone inner products on H . Therefore, the quantum analogue of the Fisher metric is not unique [28]. However, when the flat connections are required to be torsion-free, a natural dualistic structure on the manifold of quantum states S is the one induced by the Bogoliubov-Kubo-Mori (BKM) inner product [12]. Furthermore, it turns out that the only monotone metrics that make the mixture connection ( m ) and the exponential connection ( e ) dual are the scalar multiples of the BKM metric [29]. When the canonical divergence (6) is computed on the simplex S , it is shown to be the Kullback-Leibler divergence,
D ( p , q ) = i = 1 n p i log p i q i , p , q S ,
which proves that D ( p , q ) recovers the natural dualistic structure on S given by the Fisher metric g F and the dually flat connections ( m ) and ( e ) [24]. Analogously, when D is considered on the manifold of quantum states S , it has been proven that:
D ( ρ , σ ) = Tr ρ log ρ log σ , ρ , σ S ,
where Tr denotes the trace operator on the finite-dimensional Hilbert space of density matrices [24]. The function on the right-hand side of Equation (11) is called the quantum relative entropy, and it recovers the dual structure of S given by the metric induced by the BKM inner product and the flat connections ( m ) and ( e ) [1].
In this article, we aim to investigate the canonical divergence (6) on the manifold of positive measures, as well as on the space of positive definite Hermitian operators for the more general α -connections. In the classical information geometry, the one-parameter family of the α -connections is defined on the manifold of positive measures by the linear combination of the mixture and exponential connections [6],
α = 1 α 2 ( m ) + 1 + α 2 ( e ) .
It turns out that α and α are dual with respect to the Fisher metric g F in the sense of Equation (1). In quantum information geometry, α -connections appeared also in terms of the Amari α -embeddings [30]. While in the classical information geometry, the two definitions coincide, this is no longer true in quantum information geometry [31]. In the present paper, we consider the definition of the quantum α -connections by means of the Amari α -embedding, which excludes that they can be obtained by the convex mixture of ( m ) and ( e ) connections. The natural inner product that makes the quantum α -connections dual in the sense of Equation (1) is the Wigner-Yanase-Dyson (WYD) metric, which appeared for the first time in the context of quantum information geometry in the work of Hasegawa [32]. Actually, it turns out that this is the only monotone metric (up to a scalar multiple) that makes the quantum α and α dual [16].

3. Classical Flat Alpha-Divergence

We represent measures on the set { 1 , , n } as elements of R n . In this representation, the Dirac measures δ i , i = 1 , , n form the canonical basis of R n . The n -dimensional cone of positive measures on the set { 1 , , n } is then defined by:
M + : = R + n = p = i = 1 n p i δ i R n | p i > 0 for all i .
The very natural Riemannian metric on M + is the Fisher metric [6], which is defined by:
g p F ( X , Y ) = i = 1 n 1 p i X i Y i ,
for all p M + and X , Y T p M + . Here, T p M + denotes the tangent space to M + at p . Given the mixture and the exponential connections, we can define the α -connection on M + by using Equation (12). Recalling that T p M + R n , we can write any X T p M + with respect to the canonical basis of R n . Hence, the ( m ) -connection on M + reads as follows:
X ( m ) Y p = i = 1 n Y i X ( p ) δ i ,
for all vector fields X = ( X 1 , , X n ) and Y = ( Y 1 , , Y n ) on M + . Here, / X denotes the derivative in the direction X T p M + . On the contrary, the ( e ) -connection is given by:
X ( e ) Y p = i = 1 n Y i X ( p ) 1 p i X i Y i δ i .
Therefore, by applying Equation (12), we can describe the α -connection for the manifold M + as follows,
X α Y p = 1 α 2 X ( m ) Y p + 1 + α 2 X ( e ) Y p = X ( m ) Y p + 1 + α 2 X ( e ) Y p X ( m ) Y p = i = 1 n Y i X ( p ) 1 + α 2 X i Y i p i δ i ,
for all vector fields X , Y on M + . It turns out that the dualistic structure ( g F , α , α ) is dually flat, i.e., the Riemannian curvature tensors of α and α are zero [6]. Furthermore, very naturally, such an α -flat dualistic structure is induced on M + by the α -divergence D ( α ) , which is commonly assessed as the canonical solution of the inverse problem for recovering the dually flat α -structure ( g F , α , α ) on M + [6]. Given p , q M + , the α -divergence between p and q is given by:
D ( α ) ( p , q ) = i = 1 n 2 1 α q i + 2 1 + α p i 4 1 α 2 q i 1 + α 2 p i 1 α 2 .
The flat α -divergence (18) has been deeply studied, and its features have been widely discussed in the literature (see [3,6] for more details). In particular, we point out that D ( α ) is a continuous function of the parameter α , and the limit α 1 gives the well-known Kullback-Leibler divergence on the manifold of positive measures,
lim α 1 D ( α ) ( p , q ) = i = 1 n q i p i p i log q i p i , p , q M + ,
whereas the limit α + 1 gives:
lim α + 1 D ( α ) ( p , q ) = i = 1 n p i q i q i log p i q i , p , q M + .
Let us observe that, if we restrict (19) to the simplex of probability distributions, namely when i = 1 n p i = i = 1 n q i = 1 , then we obtain the function (10). At this point, it is worth mentioning the close connection between the α -divergence (18) and the Tsallis relative entropy, or q -divergence, on the manifold of positive measures. The q -divergence on M + is defined by (see [33] for more details):
D q ( p , q ) = 1 1 q i = 1 n q p i + ( 1 q ) q i p i q q i 1 q , p , q M + .
By setting α = 1 2 q , we can easily verify that the flat α -divergence (18) and the Tsallis q -divergence (20) coincide up to a scaling factor. Further, the limit q 1 , that is α 1 , recovers the Kullback-Leibler divergence,
lim q 1 D q ( p , q ) = lim α 1 1 α 2 D ( α ) ( p , q ) = i = 1 n q i p i p i log q i p i , p , q M + .
In this section, we aim to compute the canonical divergence (6) on M + for the α -connections given by (17). In order to achieve this result, we need to consider the geodesic with respect to the α -connection. Let p , q M + , a curve γ : [ 0 , 1 ] M + from p to q is an α -geodesic iff γ ˙ α γ ˙ = 0 and γ ( 0 ) = p , γ ( 1 ) = q . From Equation (17), we then obtain the following geodesic equations:
γ ¨ i 1 + α 2 γ ˙ i 2 γ i = 0 , i = 1 , , n , γ ( 0 ) = p , γ ( 1 ) = q ,
where γ ( t ) = ( γ 1 ( t ) , , γ n ( t ) ) . Hence, the solution of (21) is the α -geodesic from p to q , and it is given by:
γ ( α ) ( t ) = ( 1 t ) p 1 α 2 + t q 1 α 2 2 1 α , t [ 0 , 1 ] .
At this point, we can apply Equation (6) to compute the canonical divergence D ( p , q ) on the manifold M + of positive measures. From Equation (14), we obtain:
γ ˙ ( α ) ( t ) γ ( α ) ( t ) 2 = g γ ( α ) ( t ) F γ ˙ ( α ) ( t ) , γ ˙ ( α ) ( t ) = i = 1 n γ ˙ i ( α ) 2 γ i ( α ) = i = 1 n 4 ( 1 α ) 2 ( 1 t ) p 1 α 2 + t q 1 α 2 2 1 + α 1 α ( 1 t ) p 1 α 2 + t q 1 α 2 2 1 α q 1 α 2 p 1 α 2 2 = i = 1 n 4 ( 1 α ) 2 ( 1 t ) p 1 α 2 + t q 1 α 2 2 α 1 α q 1 α 2 p 1 α 2 2 .
Now, we can compute the integral in (6) by performing an integration by parts:
D ( p , q ) = i = 1 n 0 1 t 4 ( 1 α ) 2 ( 1 t ) p i 1 α 2 + t q i 1 α 2 2 α 1 α q i 1 α 2 p i 1 α 2 q i 1 α 2 p i 1 α 2 d t = i = 1 n { t 4 ( 1 α ) 2 1 α 1 + α ( 1 t ) p i 1 α 2 + t q i 1 α 2 1 + α 1 α 0 1 q i 1 α 2 p i 1 α 2 0 1 4 ( 1 α ) 2 1 α 1 + α ( 1 t ) p i 1 α 2 + t q i 1 α 2 1 + α 1 α q i 1 α 2 p i 1 α 2 d t } = i = 1 n 4 1 α 2 q i 1 + α 2 q i 1 α 2 p i 1 α 2 0 1 ( 1 t ) p i 1 α 2 + t q i 1 α 2 1 + α 1 α q i 1 α 2 p 1 α 2 d t = i = 1 n 4 1 α 2 q i p i 1 α 2 q i 1 + α 2 4 1 α 2 1 α 2 ( 1 t ) p i 1 α 2 + t q i 1 α 2 2 1 α 0 1 = i = 1 n 4 1 α 2 q i 4 1 α 2 p i 1 α 2 q i 1 + α 2 2 1 + α q i + 2 1 + α p i .
This proves that:
D ( p , q ) = i = 1 n 2 1 α q i + 2 1 + α p i 4 1 α 2 q i 1 + α 2 p i 1 α 2 ,
that is the canonical divergence (6) coincides with the α -divergence (18) on the manifold M + of positive measures.

4. Quantum Flat Alpha-Divergence

The goal of this section is to compute the canonical divergence of Equation (6) on the manifold of positive definite Hermitian operators endowed with the quantum α -connections. In the classical case, the definition of the α -connection α can be equivalently given by Equation (12) or by means of the well-known Amari α -embedding [6]. In the quantum setting, by exploiting the linear structure of the manifold, we can introduce the quantum mixture connection ( m ) on the space of positive definite Hermitian operators. On the other hand, the quantum exponential connection ( e ) is introduced by relying on the linear structure of logarithms of the manifold. Both connections, ( m ) and ( e ) , are flat. Furthermore, they turn out to be dual in the sense of Equation (1) with respect to the metric induced by the BKM inner product [12]. Actually, this metric is (up to a scalar multiple) the only one that makes ( m ) and ( e ) dual on the manifold of positive definite Hermitian operators. A generalization of these two natural connections is provided by the quantum α -connections, which, on the manifold under consideration, are flat ones, as well. In our approach, these α -connections are introduced in terms of the Amari α -embeddings, and then, they cannot be obtained by the convex combination of the mixture and the exponential connections as in the classical setting [16]. It turns out that for α [ 3 , 3 ] , the connections α and α are torsion-free and dual with respect to the WYD metric [34]. However, the target spaces of our approach are L r , with r = 2 1 α , and then, we restrict our discussion to the range α ( 1 , 1 ) .
Recall that in order to compute the canonical divergence (6), we need to get the α -geodesic γ α between any two positive Hermitian operators ρ 1 and ρ 2 . To do this, we shall describe the α -connections in terms of the α -parallel transport, which is introduced very naturally on the manifold of positive Hermitian operators. Given B ( H ) , the algebra of linear operators on an N -dimensional complex Hilbert space H , the subspace of Hermitian operators is an N 2 -dimensional real vector space defined by:
A : = { ρ B ( H ) | ρ = ρ } ,
where ρ = ρ ¯ t and t , here, denotes the transpose matrix. Therefore, the manifold of all positive definite Hermitian operators, or more simply, quantum operators, is given by:
M + : = { ρ A | ρ > 0 } .
The α -embedding:
l α : M + A , l α ( ρ ) : = 2 1 α ρ 1 α 2 ,
maps the manifold of quantum operators into the vector space A for all α ( 1 , 1 ) [1]. Furthermore, for ρ M + , we have that T ρ M + = T ρ A = A . Hence, the α -embedding supplies a useful representation of the tangent bundle of M + . In fact, by considering the subspace of A given by:
A ( α ) : = A A | Tr ρ 1 α 2 A = 0 , ρ M + ,
we can then define the isomorphism:
l α * ( ρ ) : T ρ M + A ( α ) , l α * ( ρ ) ( X ) : = l α γ ( 0 ) ,
where γ : ( ε , ε ) M + is a curve such that γ ( 0 ) = X . This isomorphism provides the α -representation of the tangent space T ρ M + [16]. In particular, if ξ 1 , , ξ n is a coordinate system for M + , then the α -representation of the basis ξ 1 , , ξ n of T ρ M + is l α ξ 1 , , l α ξ n , where n = N 2 . Finally, for any vector field X T ( M + ) , we have that its α -representation is defined by:
( X ) ( α ) ( ρ ) : = l α * ( ρ ) X ρ .
From Equation (26), we may observe that the l α ( ρ ) M + for all ρ M + . Now, since T ρ M + = A , we can simply define the α -parallel transport on M + by:
Π ρ 1 , ρ 2 ( α ) : T ρ 1 M + T ρ 2 M + , Π ρ 1 , ρ 2 ( α ) ( X ) : = ( l α ) * ( ρ 2 ) 1 ( l α ) * ( ρ 1 ) ( X ) , , ρ 1 , ρ 2 M + .
Therefore, we find that the α -representation of the covariant derivative α associated with Π ( α ) is:
i α j ( α ) = 2 l α ( ρ ) ξ i ξ j ,
where { ξ 1 , , ξ n } is an arbitrary coordinate system for M + and n = N 2 is the topological dimension of the tangent space T ρ M + = A . In order to show that M + is α -flat, consider a basis { A 1 , , A n } of A . Then, there exist real numbers { θ 1 , , θ n } such that we can write ρ 1 α 2 A as follows:
2 1 α ρ 1 α 2 = θ 1 A 1 + + θ n A n ,
for every ρ M + . We can see from Equation (31) that:
i α θ j ( α ) = 2 l α ( ρ ) θ i θ j = A j θ i = 0 .
This proves that { θ 1 , , θ n } is a α -affine coordinate system for M + , and then, M + is α -flat [16]. As a consequence, for any couple of points ρ 1 , ρ 2 M + , we can write the α -geodesic from ρ 1 to ρ 2 in these α -affine coordinates as follows:
γ α ( t ) = 2 1 α t ρ 2 1 α 2 + ( 1 t ) ρ 1 1 α 2 .
In order to perform the computation of the integral (6), we need to calculate the norm γ ˙ α ( t ) γ α ( t ) 2 . To do this, we have to specify a suitable metric on the tangent space T M + . As discussed above, we select the metric induced by the WYD inner product because this metric is the only one (up to a scalar multiple) that makes the quantum flat α -connections dual in the sense of Equation (1) [29]. For any X , Y vector fields on M + , this metric turns out to be defined by:
g ρ α X , Y = Tr X ( α ) Y ( α ) , X , Y T ρ M + ,
where X ( α ) denotes the α -representation of the tangent vector X , and it is given by Equation (29) [35]. It is worth noticing that the limit lim α ± 1 g α gives the metric induced by the BKM inner product on the manifold of density operators [12].
In order to write the WYD metric with respect to the α -affine coordinate system { θ 1 , , θ n } , we may observe that:
l α ( ρ ) θ i = A i ,
where A i is a vector of the basis { A 1 , , A n } A . This implies that, with this coordinate system, the ( α ) -representation X ( α ) of a vector field X T ( M + ) is the vector field X itself. In addition, we also have that:
l α = 1 + α 2 ρ 1 + α 2 = 2 1 + α 1 α 2 1 + α 1 α l α 1 + α 1 α .
Therefore, in the α -affine coordinate system { θ 1 , , θ n } , the components of the metric tensor (33) are given by:
g i j α ( θ ) = Tr l α θ i l α θ j = 2 1 α 1 α 2 1 + α 1 α Tr l α θ i l α 2 α 1 α l α θ j .
The quantum dually flat structure ( g α , α , α ) for the manifold of positive definite Hermitian operators (or quantum operators) so far described can be also obtained through Equations (3) and (4) when the following divergence is considered,
D ( α ) ( ρ 1 , ρ 2 ) : = 4 1 α 2 Tr 1 α 2 ρ 1 + 1 + α 2 ρ 2 ρ 1 1 α 2 ρ 2 1 + α 2 , ρ 1 , ρ 2 M +
This function is called the quantum α -divergence, and it has been introduced on M + as the generalization of the α -divergence (18) of the positive measures [36]. Carrying on this line of reasoning, we can introduce a q -divergence on the manifold of positive Hermitian operators, as well. In analogy with the classical case, we can set α = 1 2 q in the argument of the trace Tr in Equation (36), and then, we can write the following expression,
D q ( ρ 1 , ρ 2 ) : = 1 1 q Tr q ρ 1 + ( 1 q ) ρ 2 ρ 1 q ρ 2 1 q , ρ 1 , ρ 2 M + ,
which corresponds to the quantum α -divergence up to the same scalar factor as in the classical case. It is worth noting that this function is different from the extensions of the Tsallis relative entropy to the positive operators in the literature. For example, in [37], the quantum q -divergence was introduced in the following way,
D ˜ q ( ρ 1 , ρ 2 ) : = Tr [ ρ 1 ] Tr ρ 1 q ρ 2 1 q 1 q , ρ 1 , ρ 2 M + ,
for all q [ 0 , 1 ) . However, both functions, D q and D ˜ q , reduce to the Tsallis relative entropy when restricted to the manifold S of density operators,
D q ( ρ 1 , ρ 2 ) : = 1 Tr ρ 1 q ρ 2 1 q 1 q , ρ 1 , ρ 2 S .
Analogously, we can restrict the quantum α -divergence (36) to the set of density operators, and since Tr ρ 1 = Tr ρ 2 = 1 , we can easily verify that (36) becomes:
D ( α ) ( ρ 1 , ρ 2 ) = 4 1 α 2 1 Tr ρ 1 1 α 2 ρ 2 1 + α 2 , ρ 1 , ρ 2 S .
Again, we can see that, on the manifold of density operators, the quantum α -divergence coincides (up to a scalar factor) with the Tsallis relative entropy when we set α = 1 2 q . The quantum α -divergence (39) was introduced and studied by Hasegawa in [32], and it turns out to be a continuous function of the parameter α . In particular, we have that:
lim α 1 D ( α ) ( ρ 1 , ρ 2 ) = Tr ρ 1 log ρ 1 log ρ 2 ,
that is the quantum relative entropy D ( ρ 1 , ρ 2 ) as previously given in Equation (11). Furthermore, the limit α + 1 gives lim α + 1 D ( α ) ( ρ 1 , ρ 2 ) = D ( ρ 2 , ρ 1 ) .
At this point, we have in our hands all the ingredients necessary to compute the canonical divergence defined in (6) between ρ 1 and ρ 2 on the manifold M + of positive definite Hermitian operators,
D ( ρ 1 , ρ 2 ) : = 0 1 t γ ˙ α ( t ) γ α ( t ) 2 d t ,
where γ α ( t ) is the α -geodesic from ρ 1 to ρ 2 . In the α -affine coordinates { θ 1 , , θ N } , this reads as in Equation (32). Here, the norm · 2 is induced by the WYD metric given in Equation (33). Hence, in this case, the canonical divergence (40) can be written as:
D ( ρ 1 , ρ 2 ) = 0 1 t Tr ( γ ˙ α ( t ) ) ( α ) ( γ ˙ α ( t ) ) ( α ) d t ,
where ( γ ˙ α ( t ) ) ( α ) and ( γ ˙ α ( t ) ) ( α ) denote the ( α ) and the ( α ) representations of γ ˙ ( t ) . In order to compute the α representations of γ ˙ ( t ) , we consider Equation (29) together with Equations (34) and (35). This yields:
( γ ˙ α ( t ) ) ( α ) = γ ˙ α ( t ) ( γ ˙ α ( t ) ) ( α ) = 2 1 α 1 α 2 1 + α 1 α 1 + α 1 α γ α ( t ) 2 α 1 α γ ˙ α ( t ) = 1 α 2 2 α 1 α γ α ( t ) 2 α 1 α γ ˙ α ( t ) .
We can plug these expressions in Equation (41). Hence, by performing an integration by parts, we get:
D ( ρ 1 , ρ 2 ) = 1 α 2 2 α 1 α 0 1 t Tr γ ˙ α ( t ) γ α ( t ) 2 α 1 α γ ˙ α ( t ) d t = 1 α 2 2 α 1 α Tr 0 1 t γ ˙ α ( t ) γ α ( t ) 2 α 1 α γ ˙ α ( t ) d t = 1 α 2 2 α 1 α Tr t γ ˙ α ( t ) 1 α α + 1 γ α ( t ) 1 + α 1 α 0 1 1 α α + 1 0 1 γ ˙ α ( t ) γ α ( t ) 1 + α 1 α d t = 1 α 2 2 α 1 α Tr t γ ˙ α ( t ) 1 α 1 + α γ α ( t ) 1 + α 1 α 0 1 1 α 1 + α 1 α 2 γ α ( t ) 2 1 α 0 1 .
At this point, we can use Equation (32) to obtain:
D ( ρ 1 , ρ 2 ) = 1 α 2 2 α 1 α Tr ( 2 1 α ρ 2 1 α 2 ρ 1 1 α 2 1 α 1 + α 2 1 α 1 + α 1 α ρ 2 1 α 2 1 + α 1 α 1 α 1 + α 1 α 2 2 1 α 2 1 α ρ 2 1 α 2 2 1 α ρ 1 1 α 2 2 1 α ) = 4 1 α 2 Tr ρ 2 1 α 2 ρ 1 1 α 2 ρ 2 1 + α 2 1 α 1 + α 2 1 α Tr ρ 2 ρ 1 = 4 1 α 2 Tr ρ 2 2 1 + α Tr ρ 2 + 2 1 + α Tr ρ 1 4 1 α 2 Tr ρ 1 1 α 2 ρ 2 1 + α 2 = 2 1 + α Tr ρ 1 + 2 1 α Tr ρ 2 4 1 α 2 Tr ρ 1 1 α 2 ρ 2 1 + α 2 .
Finally, we can conclude that:
D ( ρ 1 , ρ 2 ) = 4 1 α 2 Tr 1 α 2 ρ 1 + 1 + α 2 ρ 2 ρ 1 1 α 2 ρ 2 1 + α 2 , ρ 1 , ρ 2 M + ,
which corresponds to the α -canonical divergence on the manifold of positive definite matrices.

5. Conclusions

The present article is a follow-up of the recently published paper [24]. In the latter one, the authors showed that the canonical divergence defined in Equation (6) provides a powerful tool for unifying classical and quantum information geometry. In particular, such a divergence was proven to coincide with the Kullback-Leibler divergence on the simplex of probability distributions and with the quantum relative entropy on the manifold of quantum states. The effectiveness of the Kullback-Leibler divergence was ascribed in the context of complex systems for quantifying how much a probability measure deviates from the non-interacting states that are modeled by exponential families of probabilities [11]. On the other hand, the quantum relative entropy turned out to be relevant for providing a measure of the many-party correlations of a quantum state from a Gibbs family [13], which in turn was related to the entanglement of quantum systems as defined in [15].
The α -divergence (18) is a generalization of the relative entropy (10). Moreover, the flat α -geometry induced by the α -divergence on the manifold of positive measures constitutes a generalization of the dually flat structure given by the Fisher metric and the mixture and exponential connections. Very remarkably, the α -geometry covers the geometry of q -entropy physics [19]. This bridges a very nice connection between the α -geometry and the generalized statistical mechanics established by Tsallis [17,18]. On the quantum side, the α -divergence (36) was introduced as the generalization of the α -divergence (18) of the positive measures [36]. The quantum α -geometry of the manifold of positive definite matrices is flat, as well, and turns out to be a generalization of the quantum geometry given by the quantum Fisher metric and the quantum mixture and exponential connections induced on the manifold of quantum states by the BKM inner product [16]. In the quantum setting as well, the connection between the α -geometry and the q -entropy physics by Tsallis provides a physical interpretation of the α -divergence. Indeed, a conditional form of the q -entropy was employed for the exact calculation, on some systems, of the separable-entangled separatrix [17].
In this article, we computed the canonical divergence (6) for flat α -connections on the manifold of positive measures, as well as on the manifold of positive definite Hermitian operators. Therefore, we proved that the divergence introduced by Ay and Amari in [21] reduces to the classical α -divergence (18) and to the quantum α -divergence (36). Actually, the equivalence between the canonical divergence (6) and the classical α -divergence was primarily shown in [21]. There, the derivation of D ( α ) was grounded on the idea of a squared distance function associated to the α -connections through the vector field X t ( p ) given in Equation (5). However, the α -divergence D ( α ) does not share all the properties of a squared distance function, unless α = 0 . For this reason, in the present paper, we obtained the equivalence between D and D ( α ) in a different way, by considering the α -divergence as a function of a more general structure.
The present paper is conceived within a project that aims to characterize a general canonical divergence for a given dualistic structure ( g , , * ) of a smooth manifold M . This project started with the work by Ay and Amari [21] and later developed in [3], where the concept of the “canonical divergence” was clearly depicted. A considerable effort towards the definition of a general canonical divergence was put forward in [38], where a divergence function was introduced through an extensive investigation of the geodesic geometry of the dualistic structure ( g , , * ) . Actually, this latter divergence turns out to coincide with the divergence (6) when the dualistic structure ( g , , * ) is flat. Further work around this topic was presented in [39], where the very recent divergence was compared with other divergence functions present in the literature. It is commonly accepted that the α -divergence on the simplex is obtained by restricting (18) to the set of normalized positive measures (see [1,6] for more details). Then, the α -divergence of probability distributions in the simplex reads as follows,
D ( α ) ( p , q ) = i = 1 n 1 4 1 α 2 p i 1 α 2 q i 1 + α 2 .
One can easily verify that for α = 0 , this divergence is closely related to the Hellinger distance, which is the distance in the ambient space M + [3]. However, when α = 0 , the α -connection is the Levi–Civita connection of the Fisher metric. Therefore, in this case, the canonical divergence has to be one half the square of the Fisher distance, as discussed in Section 2, which is different from D ( 0 ) [3]. It would be interesting to evaluate the very recent divergence introduced in [38] on the simplex of probability distributions, which is not α -flat, and to compare it with the α -divergence (43).
On the quantum side, an intriguing work within the above-mentioned project is to consider that very recent divergence function, introduced in [38], on the manifold of pure quantum states, where a dually flat structure does not exist [23]. This will constitute the object of study of a forthcoming investigation.

Author Contributions

The authors have equally contributed to the manuscript. They all have read and approved its final version.

Funding

This research received no external funding.

Acknowledgments

The authors are very grateful to S.-I.Amari for useful discussions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Amari, S.I.; Nagaoka, H. Methods of Information Geometry; Oxford University Press: Oxford, UK, 2000. [Google Scholar]
  2. Felice, D.; Cafaro, C.; Mancini, S. Information Geometric Methods for Complexity. Chaos 2018, 28, 032101. [Google Scholar] [CrossRef] [PubMed]
  3. Ay, N.; Jost, J.; Van Le, H.; Schwachhöfer, L. Information Geometry, 1st ed.; Springer International Publishing: Cham, Switzerland, 2017. [Google Scholar]
  4. Lauritzen, S.L. Chapter 4: Statistical Manifolds; Differential Geometry in Statistical Inference; Institute of Mathematical Statistics: Hayward, CA, USA, 1987; pp. 163–216. [Google Scholar]
  5. Amari, S.-I. Differential Geometry of Curved Exponential Families-Curvatures and Information Loss. Ann. Statist. 1982, 10, 357–387. [Google Scholar] [CrossRef]
  6. Amari, S.-I. Information Geometry and Its Applications; Springer: Tokyo, Japan, 2016. [Google Scholar]
  7. Eguchi, S. A differential geometric approach to statistical inference on the basis of contrast functions. Hiroshima Math. J. 1985, 15, 341–391. [Google Scholar] [CrossRef]
  8. Eguchi, S. Geometry of Minimum Contrast. Hiroshima Math. J. 1992, 22, 631–647. [Google Scholar] [CrossRef]
  9. Fujiwara, A.; Amari, S.-I. Gradient systems in view of information geometry. Physica D 1995, 80, 317–327. [Google Scholar] [CrossRef]
  10. Nakamura, Y. Completely integrable gradient systems on the manifolds of Gaussian and multinomial distributions. Jpn. J. Ind. Appl. Math. 1993, 10, 179. [Google Scholar] [CrossRef]
  11. Ay, N. Information geometry on complexity and stochastic interaction. Entropy 2015, 17, 2432–2458. [Google Scholar] [CrossRef]
  12. Nagaoka, H. Differential Geometrical Aspects of Quantum State Estimation and Relative Entropy. In Quantum Communications and Measurement; Belavkin, V.P., Hirota, O., Hudson, R.L., Eds.; Springer: Boston, MA, USA, 1995. [Google Scholar]
  13. Weis, S.; Knauf, A.; Ay, N.; Zhao, M.J. Maximizing the divergence from a hierarchical model of quantum states. Open Syst. Inf. Dyn. 2015, 22, 1550006. [Google Scholar] [CrossRef]
  14. Niekamp, S.; Galla, T.; Kleinmann, M.; Gühne, O. Computing complexity measures for quantum states based on exponential families. J. Phys. A Math. Theor. 2013, 46, 125301. [Google Scholar] [CrossRef]
  15. Vedral, V.; Plenio, M.B.; Rippin, M.A.; Knight, P.L. Quantifying entanglement. Phys. Rev. Lett. 1997, 78, 2275–2279. [Google Scholar] [CrossRef]
  16. Grasselli, M.H. Duality, monotonicity and the Wigner-Yanase-Dyson metrics. Infin. Dimens. Anal. Quantum Probab. Relat. Top. 2004, 7, 215–232. [Google Scholar] [CrossRef]
  17. Tsallis, C. Introduction to Nonextensive Statistical Mechanics; Springer: New York, NY, USA, 2009. [Google Scholar]
  18. Tsallis, C. Beyond Boltzmann-Gibbs–Shannon in Physics and Elsewhere. Entropy 2019, 21, 696. [Google Scholar] [CrossRef]
  19. Ohara, A. Geometry of distributions associated with Tsallis statistics and properties of relative entropy minimization. Phys. Lett. A 2007, 370, 184–193. [Google Scholar] [CrossRef]
  20. Abe, S.; Rajagopal, A.K. Nonadditive conditional entropy and its significance for local realism. Physica A 2001, 249, 157. [Google Scholar] [CrossRef]
  21. Ay, N.; Amari, S.-I. A Novel Approach to Canonical Divergences within Information Geometry. Entropy 2015, 7, 8111–8129. [Google Scholar] [CrossRef]
  22. Matumoto, T. Any statistical manifold has a contrast function—on the C3-functions taking the minimum at the diagonal of the product manifold. Hiroshima Math. J. 1993, 23, 327–337. [Google Scholar] [CrossRef]
  23. Ay, N.; Tuschmann, W. Duality versus dual flatness in quantum information geometry. J. Math. Phys. 2003, 44, 1512–1518. [Google Scholar] [CrossRef] [Green Version]
  24. Felice, D.; Mancini, S.; Ay, N. Canonical divergence for measuring classical and quantum complexity. Entropy 2019, 21, 435. [Google Scholar] [CrossRef]
  25. Čencov, N.N. Statistical Decision Rules and Optimal Inference; American Mathematical Society: Providence, RI, USA, 1982. [Google Scholar]
  26. Petz, D.; Sudàr, C. Geometries of Quantum States. J. Math. Phys. 1996, 37, 2662. [Google Scholar] [CrossRef]
  27. Holevo, A.S. Probabilistic and Statistical Aspects of Quantum Theory; North-Holland: Amsterdam, The Netherlands, 1982. [Google Scholar]
  28. Petz, D. Monotone metrics on matrix spaces. Linear Algebra Appl. 1996, 244, 81–96. [Google Scholar] [CrossRef] [Green Version]
  29. Grasselli, M.R.; Streater, R.F. On the uniqueness of the Chentsov metric in quantum information geometry. Inn. Dimens. Anal. Quantum Probab. Relat. Top. 2001, 4, 173–182. [Google Scholar] [CrossRef]
  30. Hasegawa, H. Exponential and mixture families in quantum statistics: dual structure and unbiased parameter estimation. Rep. Math. Phys. 1997, 39, 49–68. [Google Scholar] [CrossRef]
  31. Jenčovà, A. Geometry of quantum states: dual connections and divergence functions. Rep. Math. Phys. 2001, 47, 121–138. [Google Scholar] [CrossRef]
  32. Hasegawa, H. α-divergence of the noncommutative information geometry. Rep. Math. Phys. 1993, 33, 87–93. [Google Scholar] [CrossRef]
  33. Martins, A.F.T.; Smith, N.A.; Xing, E.P.; Aguiar, P.M.Q.; Figueiredo, M.A.T. Nonextensive Information Theoretic Kernels on Measures. J. Mach. Learn. Res. 2009, 10, 935–975. [Google Scholar]
  34. Jenčovà, A. Flat connections and Wigner-Yanase-Dyson metrics. Rep. Math. Phys. 2003, 52, 331–351. [Google Scholar] [CrossRef] [Green Version]
  35. Jenčovà, A. Quantum information geometry and standard purification. J. Math. Phys. 2002, 43, 2187. [Google Scholar] [CrossRef]
  36. Amari, S.-I.; Cichocki, A. Information geometry of divergence functions. Bull. Pol. Acad. Sci. Tech. Sci. 2010, 58, 183–195. [Google Scholar] [CrossRef] [Green Version]
  37. Furuichi, S.; Yanagi, K.; Kuriyama, K. Fundamental properties of Tsallis relative entropy. J. Math. Phys. 2004, 45, 4868–4877. [Google Scholar] [CrossRef] [Green Version]
  38. Felice, D.; Ay, N. Towards a canonical divergence within Information Geometry. arXiv 2018, arXiv:1806.11363. [Google Scholar]
  39. Felice, D.; Ay, N. Divergence functions in Information Geometry. arXiv 2019, arXiv:1903.02379. [Google Scholar]

Share and Cite

MDPI and ACS Style

Felice, D.; Ay, N. Canonical Divergence for Flat α-Connections: Classical and Quantum. Entropy 2019, 21, 831. https://doi.org/10.3390/e21090831

AMA Style

Felice D, Ay N. Canonical Divergence for Flat α-Connections: Classical and Quantum. Entropy. 2019; 21(9):831. https://doi.org/10.3390/e21090831

Chicago/Turabian Style

Felice, Domenico, and Nihat Ay. 2019. "Canonical Divergence for Flat α-Connections: Classical and Quantum" Entropy 21, no. 9: 831. https://doi.org/10.3390/e21090831

APA Style

Felice, D., & Ay, N. (2019). Canonical Divergence for Flat α-Connections: Classical and Quantum. Entropy, 21(9), 831. https://doi.org/10.3390/e21090831

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop