[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/62212.62234acmconferencesArticle/Chapter ViewAbstractPublication PagesstocConference Proceedingsconference-collections
Article
Free access

Conductance and the rapid mixing property for Markov chains: the approximation of permanent resolved

Published: 01 January 1988 Publication History

Abstract

The permanent of an n x n matrix A with 0-1 entries aij is defined by per (A) = Σ/σ Π/n-1/i=ο aiσ(i), where the sum is over all permutations σ of [n] = {0, …, n - 1}. Evaluating per (A) is equivalent to counting perfect matchings (1-factors) in the bipartite graph G = (V1, V2, E), where V1 = V2 = [n] and (i,j) ∈ E iff aij = 1. The permanent function arises naturally in a number of fields, including algebra, combinatorial enumeration and the physical sciences, and has been an object of study by mathematicians for many years (see [14] for background). Despite considerable effort, and in contrast with the syntactically very similar determinant, no efficient procedure for computing this function is known.
Convincing evidence for the inherent intractability of the permanent was provided in the late 1970s by Valiant [19], who demonstrated that it is complete for the class #P of enumeration problems and thus as hard as counting any NP structures. Interest has therefore recently turned to finding computationally feasible approximation algorithms (see, e.g., [11], [17]). The notion of approximation we shall use in this paper is as follows: let ƒ be a function from input strings to natural numbers. A fully-polynomial randomised approximation scheme (fpras) for ƒ is a probabilistic algorithm which, when presented with a string x and a real number ε > 0, runs in time polynomial in |x| and 1/ε and outputs a number which with high probability estimates ƒ(x) to within a factor of (1 + ε).
A promising approach to finding a fpras for the permanent was recently proposed by Broder [7], and involves reducing the problem of counting perfect matchings in a graph to that of generating them randomly from an almost uniform distribution. The latter problem is then amenable to the following dynamic stochastic technique: construct a Markov chain whose states correspond to perfect and 'near-perfect' matchings, and which converges to a stationary distribution which is uniform over the states. Transitions in the chain correspond to simple local perturbations of the structures. Then, provided convergence is fast enough, we can generate matchings by simulating the chain for a small number of steps and outputting the structure corresponding to the final state.
When applying this technique, one is faced with the task of proving that a given Markov chain is rapidly mixing, i.e., that after a short period of evolution the distribution of the final state is essentially independent of the initial state. 'Short' here means bounded by a polynomial in the input size; since the state space itself may be exponentially large, the chain must typically be close to stationarity after visiting only a small fraction of the space.
Recent work on the rate of convergence of Markov chains has focussed on stochastic concepts such as coupling [1] and stopping times [3]. While these methods are intuitively appealing and yield tight bounds for simple chains, the analysis involved becomes extremely complicated for more interesting processes which lack a high degree of symmetry. Using a complex coupling argument, Broder [7] claims that the perfect matchings chain above is rapidly mixing provided the bipartite graph is dense, i.e., has minimum vertex degree at least n/2. This immediately yields a fpras for the dense permanent. However, the coupling proof is hard to penetrate; more seriously, as has been observed by Mihail [13], it contains a fundamental error which is not easily correctable.
In this paper, we propose an alternative technique for analysing the rate of convergence of Markov chains based on a structural property of the underlying weighted graph. Under fairly general conditions, a finite ergodic Markov chain is rapidly mixing iff the conductance of its underlying graph is not too small. This characterisation is related to recent work by Alon [4] and Alon and Milman [5] on eigenvalues and expander graphs.
While similar characterisations of rapid mixing have been noted before (see, e.g., [2]), independent estimates of the conductance have proved elusive for non-trivial chains. Using a novel method of analysis, we are able to derive a lower bound on the conductance of Broder's perfect matchings chain under the same density assumption, thus verifying that it is indeed rapidly mixing. The existence of a fpras for the dense permanent is therefore established.
Reductions from approximate counting to almost uniform generation similar to that mentioned above for perfect matchings also hold for the large class of combinatorial structures which are self-reducible [10]. Consequently, the Markov chain approach is potentially a powerful general tool for obtaining approximation algorithms for hard combinatorial enumeration problems. Moreover, our proof technique for rapid mixing also seems to generalise to other interesting chains. We substantiate this claim by considering an example from the field of statistical physics, namely the monomer-dimer problem (see, e.g., [8]). Here a physical system is modelled by a set of combinatorial structures, or configurations, each of which has an associated weight. Most interesting properties of the model can be computed from the partition function, which is just the sum of the weights of the configurations. By means of a reduction to the associated generation problem, in which configurations are selected with probabilities proportional to their weights, we are able to show the existence of a fpras for the monomer-dimer partition function under quite general conditions. Significantly, in such applications the generation problem is often of interest in its own right.
Our final result concerns notions of approximate counting and their robustness. We show that, for all self-reducible NP structures, randomised approximate counting to within a factor of (1 + nβ), where n is the input size, is possible in polynomial time either for all β ∈ R or for no β ∈ R. We are therefore justified in calling such a counting problem approximable iff there exists a polynomial time randomised procedure which with high probability estimates the number of structures within ratio (1 + nβ) for some arbitrary β ∈ R. The connection with the earlier part of the paper is our use of a Markov chain simulation to reduce almost uniform generation to approximate counting within any factor of the above form: once again, the proof that the chain is rapidly mixing follows from the conductance characterisation.

References

[1]
Aldous, D. Random walks on finite groups and rapidly mixing Markov chains. ${rninaire de Probabilit~s XVII, 1981/82, Springer Lecture Notes in Mathematics 986, pp. 243-297
[2]
Aldous, D. On the Maxkov chain simulation method for uniform combinatorial distributions and simulated annealing. Probability iN Eng. a~d I~t/. $ci. 1 (1987), pp. 33-46
[3]
Aldous, D. and Dia~onls, P. Shuffling cards and stopping times. American Mathematical MontMy 98 (1986), pp. 333-348
[4]
Alon, N. Eigenvalues and expanders. Cornbinatorica 6 (2) (1986), pp. 83-96
[5]
Alon, N. and Milman, V.D. A l, isoperimetric inequalities for graphs and superconcentrators. J. Combinatorial Theory Series B 38 (1985), pp. 73-88
[6]
Binder, K. Monte Carlo investigations of phase transitions and critical phenomena. In Phase Transitions and Critical Phenomena ~ol. 5B (C. Domb and M.S. Green eds.), Academic Press, 1976, pp. 1-105
[7]
Broder, A.Z. How hard is it to marry at random? (On the approximation of the permanent). Proceedings of the 18th ACM Sympo- 8ium on Theory of Computing, 1986, pp. 50-58
[8]
Heilmann, O.J. and Lieb, E.H. Theory of monomer-dimer systems. Comm. Math. Phys. zs (1972), pp. 190-232
[9]
Jerrum, M.R. 2-dimensional monomer-dimer systems are computationally intractable. J. Statistical Physics 48 (1987), pp. 121-134
[10]
Jerrum, M.R., Valiant, L.G. and Vazirani, V.V. Random generation of combinatorial structures from a uniform distribution. Theoretical Computer Science 43 (1986), pp. 169-188
[11]
Karp, R.M. and Luby, M. Monte-Cark, algorithms for enumeration and reliability problems. Proceediags of' the ~4th IEEE $~,nposlum o~ Foundations of Computer Science, 1983, pp. 56-64
[12]
Kirkpatrick, S., Gellat~, C.D. and Vecchi, M.P. Optimisation by simulated anneMing. Science 220 (May 198$), pp. 671-680
[13]
Mihail, M. The approxJ{mation of the permanent is still open. Prep rint, Aiken Computation LaBoratory, Harwr~l University, 1987
[14]
Minc, H. Permaneats (Addison-Wesley, 1.978)
[15]
Sinclair, A.J. PhD Thesis, University of ~inburgh (in preparation)
[16]
Sinclair, A.J. and $errum, M.R. Approximate counting, uniform generation and rapidly mixing Markov chains. Internal Report CSR- 241-87, Department of Computer Science, University of Edinburgh, October 1987. (Submitted to Information aad ~ompuiatioa)
[17]
Stockmeyer, L. The complexity of approximate counting. Proceedings of the 15th AOM $3tmposium on Theor~t of Computing, 1983, pp. 118-126
[18]
Ullman, J.D. Oomputational Aspects of VLM (Computer Science Presa, 1984)
[19]
Valiant, L.G. The comphxity of computing the permanent. Theoretical Computer Science 8 (1979), pp. 189-201

Cited By

View all
  • (2024)Speeding up random walk mixing by starting from a uniform vertexElectronic Journal of Probability10.1214/24-EJP109129:noneOnline publication date: 1-Jan-2024
  • (2024)Sampling from convex sets with a cold start using multiscale decompositionsProbability Theory and Related Fields10.1007/s00440-024-01341-wOnline publication date: 13-Dec-2024
  • (2023)Identifying Significantly Perturbed Subnetworks in Cancer Using Multiple Protein–Protein Interaction NetworksCancers10.3390/cancers1516409015:16(4090)Online publication date: 14-Aug-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
STOC '88: Proceedings of the twentieth annual ACM symposium on Theory of computing
January 1988
553 pages
ISBN:0897912640
DOI:10.1145/62212
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 1988

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

STOC88
Sponsor:
STOC88: 1988 Symposium on the Theory of Computing
May 2 - 4, 1988
Illinois, Chicago, USA

Acceptance Rates

STOC '88 Paper Acceptance Rate 53 of 192 submissions, 28%;
Overall Acceptance Rate 1,469 of 4,586 submissions, 32%

Upcoming Conference

STOC '25
57th Annual ACM Symposium on Theory of Computing (STOC 2025)
June 23 - 27, 2025
Prague , Czech Republic

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)169
  • Downloads (Last 6 weeks)24
Reflects downloads up to 21 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Speeding up random walk mixing by starting from a uniform vertexElectronic Journal of Probability10.1214/24-EJP109129:noneOnline publication date: 1-Jan-2024
  • (2024)Sampling from convex sets with a cold start using multiscale decompositionsProbability Theory and Related Fields10.1007/s00440-024-01341-wOnline publication date: 13-Dec-2024
  • (2023)Identifying Significantly Perturbed Subnetworks in Cancer Using Multiple Protein–Protein Interaction NetworksCancers10.3390/cancers1516409015:16(4090)Online publication date: 14-Aug-2023
  • (2023)“Intelligent Heuristics Are the Future of Computing”ACM Transactions on Intelligent Systems and Technology10.1145/362770814:6(1-39)Online publication date: 14-Nov-2023
  • (2023)Truncated Log-concave Sampling for Convex Bodies with Reflective Hamiltonian Monte CarloACM Transactions on Mathematical Software10.1145/358950549:2(1-25)Online publication date: 15-Jun-2023
  • (2023)Sampling from Convex Sets with a Cold Start using Multiscale DecompositionsProceedings of the 55th Annual ACM Symposium on Theory of Computing10.1145/3564246.3585172(117-130)Online publication date: 2-Jun-2023
  • (2022)Mean isoperimetry with control on outliers: Exact and approximation algorithmsTheoretical Computer Science10.1016/j.tcs.2022.05.022923(348-365)Online publication date: Jun-2022
  • (2022)Leader Election in Well-Connected GraphsAlgorithmica10.1007/s00453-022-01068-x85:4(1029-1066)Online publication date: 24-Nov-2022
  • (2022)Sharp Poincaré and log-Sobolev inequalities for the switch chain on regular bipartite graphsProbability Theory and Related Fields10.1007/s00440-022-01172-7185:1-2(89-184)Online publication date: 24-Nov-2022
  • (2021)Fast Connectivity Minimization on Large-Scale NetworksACM Transactions on Knowledge Discovery from Data10.1145/344234215:3(1-25)Online publication date: 3-May-2021
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media