[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/2884435.2884470acmconferencesArticle/Chapter ViewAbstractPublication PagessodaConference Proceedingsconference-collections
research-article

Bounds for random constraint satisfaction problems via spatial coupling

Published: 10 January 2016 Publication History

Abstract

We report on a novel technique called spatial coupling and its application in the analysis of random constraint satisfaction problems (CSP). Spatial coupling was invented as an engineering construction in the area of error correcting codes where it has resulted in efficient capacity-achieving codes for a wide range of channels. However, this technique is not limited to problems in communications, and can be applied in the much broader context of graphical models. We describe here a general methodology for applying spatial coupling to random constraint satisfaction problems and obtain lower bounds for their (rough) satisfiability threshold. The main idea is to construct a distribution of geometrically structured random K-SAT instances - namely the spatially coupled ensemble - which has the same (rough) satisfiability threshold, and is at the same time algorithmically easier to solve. Then by running well-known algorithms on the spatially coupled ensemble we obtain a lower bound on the (rough) satisfiability threshold of the original ensemble. The method is versatile because one can choose the CSP, there is a certain amount of freedom in the construction of the spatially coupled ensemble, and also in the choice of the algorithm. In this work we focus on random K-SAT but we have also checked that the method is successful for Coloring, NAE-SAT and XOR-SAT. We choose Unit Clause propagation for the algorithm which is analyzed over the spatially coupled instances. For K = 3, for instance, our lower bound is equal to 3.67 which is better than the current bounds in the literature. Similarly, for graph 3-colorability we get a bound of 2.22 which is also better than the current bounds in the literature.

References

[1]
D. Achlioptas, "Lower bounds for random 3-SAT via differential equations," Theoretical Computer Science 265, pp. 159--185, (2001).
[2]
D. Achlioptas, A. Coja-Oghlan, "Algorithmic barriers from phase transitions", Proceedings 49th Annual Symposium on Foundations of Computer Science, pp. 793--802 (2008).
[3]
D. Achlioptas, M. Molloy, "The analysis of a list-coloring algorithm on a random graph," Proceedings 38th Annual Symposium on Foundations of Computer Science, pp. 204--212 (1997).
[4]
D. Achlioptas, C. Moore, "All graphs with average degree 4 are 3-colorable," Journal of Computer and System Sciences 67, pp. 441--471, (2003).
[5]
D. Achlioptas and C. Moore, "Random K-SAT: Two moments suffice to cross a sharp threshold," SIAM J. Comput., 36(3), pp. 740762, (2006).
[6]
D. Achlioptas, A. Naor, "The two possible values of the chromatic number of a random graph," Annals of Mathematics 162, pp. 1335--1351, (2005).
[7]
D. Achlioptas and Y. Peres, "The threshold for random K-SAT is 2K log 2--O(K)," J. Amer. Math. Soc., 17(4), pp. 947973, (2004).
[8]
D. Achlioptas, F. Ricci-Tersenghi, "On the solution space geometry of random constraint satisfaction problems," in Proceedings of 38th ACM Symp. on Theory of Computing pp. 130--139 (2006).
[9]
A. Amit, N. Linial, J. Matoušek, E. Rozenman, Random Lifts of Graphs, SODA '01, p. 883--894
[10]
M. Bayati, D. Gamarnik, and P. Tetali, "Combinatorial approach to the interpolation method and scaling limits in sparse random graphs", in Proceedings ACM Symp. on Theory of Computing, pp. 105--114, (2010).
[11]
A. Z. Broder, A. M. Frieze, E. Upfal, "On the satisfiability and maximum satisfiability of random 3-CNF formulas," SODA 93, pp. 322--330 (1993).
[12]
M. Chao, J. Franco, "Probabilistic analysis of two heuristic for the 3-satisfiability problem," SIAM J. Comput., 15, pp. 1106--1118, (1986).
[13]
A. Coja-Oghlan, K. Panagiotou, "Going after the K-SAT threshold", in Proceedings of the forty-fifth annual ACM symposium on Theory of computing pp. 705--714 (2013).
[14]
A. Coja-Oghlan, D. Vilenchik, "Chasing the k-colorability threshold," in Proceedings 54th Annual Symposium on Foundations of Computer Science, pp. 380--389, (2013).
[15]
J. Ding, A. Sly, N. Sun, "Proof of the satisfiability conjecture for large k", arXiv:1411.0650 {math.PR}.
[16]
D. Donoho, A. Javanmard, and A. Montanari, "Information-theoretically optimal compressed sensing via spatial coupling and approximate message passing," IEEE Transactions on Information Theory, vol 59, issue 11, pp. 7434 -- 7464 (2013).
[17]
O. Dubois and J. Mandler, "The 3-XORSAT Threshold", in Proc. of 43rd Annual Symposium on Foundations of Computer Science pp. 769--778, (2002)
[18]
O. Dubois, Y. Boufkhad, and J. Mandler, "Typical random 3-SAT formulae and the satisfiability threshold", Electronic Colloquium on Computational Complexity (ECCC), 10(007), (2003).
[19]
A. J. Felstrom, K. S. Zigangirov, "Time-varying periodic convolutional codes with low density parity check matrix", IEEE Transactions on Information Theory, 45, issue 5, pp. 2181--2190 (1999).
[20]
H. Flanders, Differential forms with applications to the physical sciences, New York: Dover Publications, (1989).
[21]
S. Franz, M. Leone, "Replica bounds for optimization problems and diluted spin systems", Journal of Statistical Physics, vol 111 pp. 535--564 (2003).
[22]
D. Gamarnik, "Linear phase transition in random linear constraint satisfaction problems", Probability Theory and Related Fields, vol 129 (3), pp. 410440 (2004).
[23]
D. Gamarnik, M. Sudan, "Limits of local algorithms over sparse random graphs", Proceeding ITCS 2014 Proceedings of the 5th conference on Innovations in theoretical computer science, pp. 369--376 (2014)
[24]
F. Guerra, F. Toninelli, "The thermodynamic limit inmean field spin glass models", Communications in Mathematical Physics, vol 230, pp. 71--79 (2002)
[25]
M. T. Hajiaghayi and G. B. Sorkin, "The satisfiability threshold of random 3-SAT is at least 3.52", volume RC22942 of IBM Research Report, (2003).
[26]
S. H. Hassani, N. Macris, R. Urbanke, "Coupled graphical models and their threshold", Information Theory Workshop (ITW), Dublin, (2010); also in lanl.arxiv.org no 1105.0785{cs.IT}
[27]
S. H. Hassani, N. Macris, R. Urbanke, "Threshold saturation in spatially coupled constraint satisfaction problems", Journal of Statistical Physics, Vol 150, issue 5, pp. 807--850 (2013).
[28]
S. H. Hassani, N. Macris, R. Urbanke, "Chains of mean field models", Journal of Statistical Mechanics: Theory and Experiments, P02011, (2012).
[29]
S. H. Hassani, N. Macris, R. L. Urbanke, "The space of solutions of coupled XORSAT formulae", in Proceedings of IEEE International Symposium Information Theory, pp. 2453--2457, (2013).
[30]
A. C. Kaporis, L. M. Kirousis, and E. G. Lalas, "The probabilistic analysis of a greedy satisfiability algorithm", Random Structures and Algorithms, 28(4), pp. 444480, (2006).
[31]
F. Krzakala, M. Mézard, F. Sausset, Y. Sun, and L. Zdeborova, "Statistical physics-based reconstruction in compressed sensing," Physical Review X 2, 021005 (2012) {online} Available: arXiv:1109.4424 {cs.IT}.
[32]
S. Kudekar and H. D. Pfister, "The effect of spatial coupling on compressive sensing," in Proc. of the Allerton Conf. on Communications, Control, and Computing, Monticello, IL, USA, (2010).
[33]
S. Kudekar, T. Richardson, R. Urbanke, "Spatially coupled ensembles universally achieve capacity under belief propagation", IEEE Transactions on Information Theory, vol 59, issue12, pp. 7761--7813 (2013).
[34]
S. Kudekar, T. Richardson, R. Urbanke, "Threshold saturation via spatial coupling: why convolutional LDPC ensembles perform so well over the BEC", IEEE Transactions on Information Theory, vol 57, issue 2, pp.803--834, (2011).
[35]
A. Kumar, A. J. Young, N. Macris, H. D. Pfister, "Threshold saturation for spatially coupled LDPC and LDGM codes on BMS channels", IEEE Transactions on Information Theory vol 60, No 12, pp. 7389--7415 (2014)
[36]
M. Mézard, A. Montanari, Information, Physics, and Computation, Oxford University press (2009)
[37]
M. Mitzenmacher and E. Upfal, Probability and Computing: Randomized Algorithms and Probabilistic Analysis, Cambridge University Press, New York (NY), 2005 (Section 1.3, page 9).
[38]
N. C. Wormald, "Differential equations for random processes and random graphs", Annals of Applied Probability vol 5, 1217--1235 (1995).
[39]
A. Yedla, Y. Jian, P. S. Nguyen and H. D. Pfister, "A simple proof of threshold saturation for coupled scalar recursions," in proc. ISTC, Gothenburg, Sweden (2011).

Cited By

View all
  • (2017)Information-theoretic thresholds from the cavity methodProceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing10.1145/3055399.3055420(146-157)Online publication date: 19-Jun-2017
  1. Bounds for random constraint satisfaction problems via spatial coupling

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SODA '16: Proceedings of the twenty-seventh annual ACM-SIAM symposium on Discrete algorithms
      January 2016
      2114 pages
      ISBN:9781611974331

      Sponsors

      Publisher

      Society for Industrial and Applied Mathematics

      United States

      Publication History

      Published: 10 January 2016

      Check for updates

      Qualifiers

      • Research-article

      Conference

      SODA '16
      Sponsor:
      SODA '16: Symposium on Discrete Algorithms
      January 10 - 12, 2016
      Virginia, Arlington

      Acceptance Rates

      Overall Acceptance Rate 411 of 1,322 submissions, 31%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 09 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2017)Information-theoretic thresholds from the cavity methodProceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing10.1145/3055399.3055420(146-157)Online publication date: 19-Jun-2017

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media