Abstract
We propose a new algorithm to solve the unbalanced and partial \(L_1\)-Monge–Kantorovich problems. The proposed method is a first-order primal-dual method that is scalable and parallel. The method’s iterations are conceptually simple, computationally cheap, and easy to parallelize. We provide several numerical examples solved on a CUDA GPU, which demonstrate the method’s practical effectiveness.
Similar content being viewed by others
References
Barrett, J., Prigozhin, L.: Partial \(L^1\) Monge–Kantorovich problem: variational formulation and numerical approximation. Interfaces Free Bound. 11(2), 201–238 (2009)
Benamou, J.-D., Brenier, Y.: A computational fluid mechanics solution to the Monge–Kantorovich mass transfer problem. Numer. Math. 84(3), 375–393 (2000)
Benamou, J.-D., Carlier, G., Hatchi, R.: A numerical solution to Monge’s problem with a Finsler distance as cost. M2AN (2016)
Caffarelli, L., McCann, R.: Free boundaries in optimal transport and Monge–Ampere obstacle problems. Ann. Math. 171, 673–730 (2010)
Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)
Chizat, L., Peyre, G., Schmitzer, B., Vialard, F.-X.: Unbalanced optimal transport: geometry and Kantorovich formulation (2015). arXiv:1508.05216
Chizat, L., Schmitzer, B., Peyre, G., Vialard, F.-X.: An interpolating distance between optimal transport and Fischer-Rao. Found. Comput. Math. https://doi.org/10.1007/s10208-016-9331-y (2016)
Evans, L., Gangbo, W.: Differential equations methods for the Monge–Kantorovich mass transfer problem. Memoirs of AMS, no 653, vol. 137, (1999)
Figalli, A.: The optimal partial transport problem. Arch. Ration. Mech. Anal. 195(2), 533560 (2010)
Hanin, L.G.: Kantorovich–Rubinstein norm and its application in the theory of Lipschitz spaces. Proc. Am. Math. Soc. 115(2), 345–352 (1992)
He, B., Yuan, X.: Convergence analysis of primal-dual algorithms for a saddle-point problem: from contraction perspective. SIAM J. Imaging Sci. 5(1), 119–149 (2012)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
Li, W.: A study of stochastic differential equations and Fokker–Planck equations with applications. Ph.D. thesis
Li, W., Ryu, E.K., Osher, S., Yin, W., Gangbo, W.: A parallel method for earth movers distance. J. Sci. Comput. https://doi.org/10.1007/s10915-017-0529-1 (2017)
Ling, H., Okada, K.: An efficient earth movers distance algorithm for robust histogram comparison. PAMI 29, 840–853 (2007)
Luitjens, J.: Faster parallel reductions on Kepler. https://devblogs.nvidia.com/parallelforall/faster-parallel-reductions-kepler/. Accessed 15 July 2017
Métivier, L., Brossier, R., Mérigot, Q., Oudet, E., Virieux, J.: Measuring the misfit between seismograms using an optimal transport distance: application to full waveform inversion. Geophys. J. Int. 205(1), 345–377 (2016)
Piccoli, B., Rossi, F.: On properties of the generalized Wasserstein distance. Arch. Ration. Mech. Anal. 222(3), 1339–1365 (2016)
Piccoli, B., Rossi, F.: Generalized Wasserstein distance and its application to transport equations with source. Arch. Ration. Mech. Anal. 211(1), 335–358 (2014)
Pratelli, A.: Equivalence between some definitions for the optimal mass transport problem and for the transport density on manifolds. Ann. Mat. Pura Appl. 184(2), 215–238 (2005)
Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: International Conference on Computer Vision, IEEE, pp. 1762–1769 (2011)
Rockafellar, R.T.: Conjugate Duality and Optimization. Society for Industrial and Applied Mathematics, Philadelphia (1974)
Rubner, Y., Tomasi, C., Guibas, L.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)
Ryu, E.K., Boyd, S.: Primer on monotone operator methods. Appl. Comput. Math. 15(1), 3–43 (2016)
Villani, C.: Topics in Optimal Transportation, vol. 58. American Mathematical Society, Providence (2003)
Yin, W., Osher, S., Goldfarb, D., Darbon, J.: Bregman iterative algorithms for \(\ell _1\)-minimization with applications to compressed sensing. SIAM J. Imaging Sci. 1(1), 143–168 (2008)
Acknowledgements
We would like to thank Professor Wilfrid Gangbo for many fruitful and inspirational discussions on the related topics. The Titan Xp used for this research was donated by the NVIDIA Corporation.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is partially supported by ONR Grants N000141410683, N000141210838 and DOE Grant DE-SC00183838.
Rights and permissions
About this article
Cite this article
Ryu, E.K., Li, W., Yin, P. et al. Unbalanced and Partial \(L_1\) Monge–Kantorovich Problem: A Scalable Parallel First-Order Method. J Sci Comput 75, 1596–1613 (2018). https://doi.org/10.1007/s10915-017-0600-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10915-017-0600-y