[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Computing Feasible Points of Bilevel Problems with a Penalty Alternating Direction Method

Published: 01 January 2021 Publication History

Abstract

Bilevel problems are highly challenging optimization problems that appear in many applications of energy market design, critical infrastructure defense, transportation, pricing, and so on. Often these bilevel models are equipped with integer decisions, which makes the problems even harder to solve. Typically, in such a setting in mathematical optimization, one develops primal heuristics in order to obtain feasible points of good quality quickly or to enhance the search process of exact global methods. However, there are comparably few heuristics for bilevel problems. In this paper, we develop such a primal heuristic for bilevel problems with a mixed-integer linear or quadratic upper level and a linear or quadratic lower level. The heuristic is based on a penalty alternating direction method, which allows for a theoretical analysis. We derive a convergence theory stating that the method converges to a stationary point of an equivalent single-level reformulation of the bilevel problem and extensively test the method on a test set of more than 2,800 instances—which is one of the largest computational test sets ever used in bilevel programming. The study illustrates the very good performance of the proposed method in terms of both running times and solution quality. This renders the method a suitable subroutine in global bilevel solvers as well as a reasonable standalone approach.Summary of Contribution: Bilevel optimization problems form a very important class of optimization problems in the field of operations research, which is mainly due to their capability of modeling hierarchical decision processes. However, real-world bilevel problems are usually very hard to solve—especially in the case in which additional mixed-integer aspects are included in the modeling. Hence, the development of fast and reliable primal heuristics for this class of problems is very important. This paper presents such a method.

References

[1]
Ambrosius M, Grimm V, Kleinert T, Liers F, Schmidt M, Zöttl G (2018) Endogenous price zones and investment incentives in electricity markets: An application of multilevel optimization with graph partitioning. Preprint, submitted November 18, http://www.optimization-online.org/DB_HTML/2018/10/6868.html.
[2]
Anandalingam G, White D (1990) A solution method for the linear static Stackelberg problem using penalty functions. IEEE Trans. Automat. Control 35(10):1170–1173.
[3]
Angelo JS, Barbosa HJC (2015) A study on the use of heuristics to solve a bilevel programming problem. Internat. Trans. Oper. Res. 22(5):861–882.
[4]
Baggio A, Carvalho M, Lodi A, Tramontani A (2016) Multilevel approaches for the critical node problem. Technical report, Ecole Polytechnique de Montréal, Montréal.
[5]
Bard JF (1991) Some properties of the bilevel programming problem. J. Optim. Theory Appl. 68(2):371–378.
[6]
Bard JF (2013) Practical Bilevel Optimization: Algorithms and Applications (Springer Science & Business Media, Dordrecht).
[7]
Bard JF, Moore JT (1990) A branch and bound algorithm for the bilevel programming problem. SIAM J. Sci. Statist. Comput. 11(2):281–292.
[8]
Berthold T (2014) Heuristic algorithms in global MINLP solvers. PhD thesis, Technische Universität Berlin, Berlin.
[9]
Bixby RE, Ceria S, McZeal CM, Savelsbergh MWP (1998) An updated mixed integer programming library: Miplib 3.0. Technical report, Rice University, Houston, TX.
[10]
Boyd S, Vandenberghe L (2004) Convex Optimization (Cambridge University Press, Cambridge, UK).
[11]
Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations Trends Machine Learn. 3(1):1–122.
[12]
Brotcorne L, Labbé M, Marcotte P, Savard G (2001) A bilevel model for toll optimization on a multicommodity transportation network. Transportation Sci. 35(4):345–358.
[13]
Brown G, Carlyle M, Salmerón J, Wood K (2006) Defending critical infrastructure. Interfaces 36(6):530–544.
[14]
Campelo M, Dantas S, Scheimberg S (2000) A note on a penalty function approach for solving bilevel linear programs. J. Global Optim. 16(3):245–255.
[15]
Caprara A, Carvalho M, Lodi A, Woeginger GJ (2016) Bilevel knapsack with interdiction constraints. INFORMS J. Comput. 28(2):319–333.
[16]
Casas-Ramírez MS, Camacho-Vallejo JF (2017) Solving the p-median bilevel problem with order through a hybrid heuristic. Appl. Soft Comput. 60:73–86.
[17]
Chu PC, Beasley JE (1998) A genetic algorithm for the multidimensional knapsack problem. J. Heuristics 4(1):63–86.
[18]
Chvátal V (1983) Linear Programming (W. H. Freeman, New York).
[19]
Daxhelet O, Smeers Y (2007) The EU regulation on cross-border trade of electricity: A two-stage equilibrium model. Eur. J. Oper. Res. 181(3):1396–1412.
[20]
Dempe S (1987) A simple algorithm for the linear bilevel programming problem. Optimization 18(3):373–385.
[21]
Dempe S (2002) Foundations of Bilevel Programming (Springer, New York).
[22]
Dempe S (2018) Bilevel Optimization: Theory, Algorithms and Applications (TU Bergakademie Freiberg, Freiberg).
[23]
Dempe S, Dutta J (2012) Is bilevel programming a special case of a mathematical program with complementarity constraints? Math. Program. 131(1):37–48.
[24]
Dempe S, Kalashnikov V, Pérez-Valdés GA, Kalashnykova N (2015) Bilevel Programming Problems (Springer, Berlin, Heidelberg).
[25]
DeNegre S (2011) Interdiction and discrete bilevel linear programming. PhD thesis, Lehigh University, Bethlehem, PA.
[26]
Dolan ED, Moré JJ (2002) Benchmarking optimization software with performance profiles. Math. Program. 91(2):201–213.
[27]
Dussault JP, Marcotte P, Roch S, Savard G (2006) A smoothing heuristic for a bilevel pricing problem. Eur. J. Oper. Res. 174(3):1396–1413.
[28]
Fischetti M, Monaci M, Sinnl M (2018) A dynamic reformulation heuristic for generalized interdiction problems. Eur. J. Oper. Res. 267(1):40–51.
[29]
Fischetti M, Ljubić I, Monaci M, Sinnl M (2016) Intersection cuts for bilevel optimization. Louveaux Q, Skutella M, eds. Internat. Conf. Integer Programming Combinatorial Optim., Lecture Notes in Computer Science, vol. 9682 (Springer, Cham, Switzerland), 77–88.
[30]
Fischetti M, Ljubić I, Monaci M, Sinnl M (2017) A new general-purpose algorithm for mixed-integer bilevel linear programs. Oper. Res. 65(6):1615–1637.
[31]
Fischetti M, Ljubić I, Monaci M, Sinnl M (2019a) Bilevel integer programming and interdiction problems. Accessed November 12, 2019, https://msinnl.github.io/pages/bilevel.html.
[32]
Fischetti M, Ljubić I, Monaci M, Sinnl M (2019b) Interdiction games and monotonicity, with application to knapsack problems. INFORMS J. Comput. 31(2):390–410.
[33]
Fortuny-Amat J, McCarl B (1981) A representation and economic interpretation of a two-level programming problem. J. Oper. Res. Soc. 32(9):783–792.
[34]
Gabriel SA, Conejo AJ, Fuller JD, Hobbs BF, Ruiz C (2012) Complementarity Modeling in Energy Markets (Springer Science & Business Media, New York).
[35]
Geißler B, Morsi A, Schewe L, Schmidt M (2015) Solving power-constrained gas transportation problems using an MIP-based alternating direction method. Comput. Chem. Engrg. 82:303–317.
[36]
Geißler B, Morsi A, Schewe L, Schmidt M (2017) Penalty alternating direction methods for mixed-integer optimization: A new view on feasibility pumps. SIAM J. Optim. 27(3):1611–1636.
[37]
Geißler B, Morsi A, Schewe L, Schmidt M (2018) Solving highly detailed gas transport MINLPs: Block separability and penalty alternating direction methods. INFORMS J. Comput. 30(2):309–323.
[38]
Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66(3):373–407.
[39]
Grimm V, Schewe L, Schmidt M, Zöttl G (2019a) A multilevel model of the European entry-exit gas market. Math. Methods Oper. Res. 89(2):223–255.
[40]
Grimm V, Grübel J, Schewe L, Schmidt M, Zöttl G (2019b) Nonconvex equilibrium models for gas market analysis: Failure of standard techniques and alternative modeling approaches. Eur. J. Oper. Res. 273(3):1097–1108.
[41]
Grimm V, Kleinert T, Liers F, Schmidt M, Zöttl G (2019c) Optimal price zones of electricity markets: A mixed-integer multilevel model and global solution approaches. Optim. Methods Software 34(2):406–436.
[42]
Grimm V, Martin A, Schmidt M, Weibelzahl M, Zöttl G (2016) Transmission and generation investment in electricity markets: The effects of market splitting and network fee regimes. Eur. J. Oper. Res. 254(2):493–509.
[43]
Hansen P, Jaumard B, Savard G (1992) New branch-and-bound rules for linear bilevel programming. SIAM J. Sci. Statist. Comput. 13(5):1194–1217.
[44]
Heitkötter J, Khuri S, Baeck JHT (1995) Sac94 suite: Collection of multiple knapsack problems. Accessed November 12, 2019, http://www.cs.cmu.edu/Groups/AI/areas/genetic/ga/test/sac/0.html.
[45]
He X, Li C, Huang T, Li C, Huang J (2014) A recurrent neural network for solving bilevel linear programming problem. IEEE Trans. Neural Network Learn. Systems 25(4):824–830.
[46]
Hu X, Ralph D (2007) Using EPECs to model bilevel games in restructured electricity markets with locational prices. Oper. Res. 55(5):809–827.
[47]
Jeroslow RG (1985) The polynomial hierarchy and a simple model for competitive analysis. Math. Program. 32(2):146–164.
[48]
Kalashnykova NI, Kalashnikov VV, Maldonado RCH (2012) Bilevel toll optimization problems: A heuristic algorithm based upon sensitivity analysis. Watada J, Watanabe T, Phillips-Wren G, Howlett RJ, Jain LC, eds. Proc. 4th Internat. Conf. Intelligent Decision Tech., Smart Innovation, Systems and Technologies, vol. 15 (Springer, Berlin, Heidelberg) 135–143.
[49]
Kleinert T, Schmidt M (2019) Global optimization of multilevel electricity market models including network design and graph partitioning. Discrete Optim. 33:43–69.
[50]
Kleinert T, Labbé M, Plein F, Schmidt M (2020) There’s no free lunch: On the hardness of choosing a correct big-M in bilevel optimization. Oper. Res. Forthcoming.
[51]
Koch T, Achterberg T, Andersen E, Bastert O, Berthold T, Bixby RE, Danna E, et al. (2011) MIPLIB 2010. Math. Program. Comput. 3(2):103–163.
[52]
Labbé M, Violin A (2013) Bilevel programming and price setting problems. 4OR 11(1):1–30.
[53]
Li H, Zhang L (2013) A differential evolution with two mutation strategies for linear bilevel programming problems. 2013 9th Internat. Conf. Comput. Intelligence Security (IEEE, Piscataway, NJ), 55–60.
[54]
Li H, Zhang L (2015) Solving linear bilevel programming problems using a binary differential evolution. 2015 11th Internat. Conf. Comput. Intelligence Security (IEEE, Piscataway, NJ), 38–42.
[55]
Lodi A, Ralphs TK, Woeginger GJ (2014) Bilevel programming and the separation problem. Math. Program. 146(1−2):437–458.
[56]
MIPLIB2017 (2018) Miplib 2017. Accessed November 12, 2019, http://miplib.zib.de/.
[57]
Moore JT, Bard JF (1990) The mixed integer linear bilevel programming problem. Oper. Res. 38(5):911–921.
[58]
Pan K, Yang Y, Liu J (2012) A new approach for solving linear bilevel programming using differential evolution. 2012 6th Internat. Conf. Genetic Evolutionary Comput. (IEEE, Piscataway, NJ), 453–456.
[59]
Pineda S, Bylling H, Morales JM (2018) Efficiently solving linear bilevel programming problems using off-the-shelf optimization software. Optim. Engrg. 19(1):187–211.
[60]
Pineda S, Morales JM (2019) Solving linear bilevel problems using big-Ms: Not all that glitters is gold. IEEE Trans. Power Syst. 34(3):2469–2471.
[61]
Rajesh J, Gupta K, Kusumakar HS, Jayaraman VK, Kulkarni BD (2003) A tabu search based approach for solving a class of bilevel programming problems in chemical engineering. J. Heuristics 9(4):307–319.
[62]
Ralphs T (2019) Cor@l: Bilevel optimization problem library. Accessed November 12, 2019, http://coral.ise.lehigh.edu/data-sets/bilevel-instances/.
[63]
Regionales Rechenzentrum Erlangen (2019) Woody compute-cluster. Accessed November 12, 2019, https://www.anleitungen.rrze.fau.de/hpc/woody-cluster/.
[64]
Scaparra MP, Church RL (2008) A bilevel mixed-integer program for critical infrastructure protection planning. Comput. Oper. Res. 35(6):1905–1923.
[65]
Schewe L, Schmidt M, Weninger D (2019) A decomposition heuristic for mixed-integer supply chain problems. Preprint, submitted March 12, http://www.optimization-online.org/DB_HTML/2019/03/7120.html.
[66]
Still G (2002) Linear bilevel problems: Genericity results and an efficient method for computing local minima. Math. Methods Oper. Res. 55(3):383–400.
[67]
Talbi EG (2013) Metaheuristics for Bi-Level Optimization (Springer, Berlin, Heidelberg).
[68]
Tang Y, Richard JPP, Smith JC (2015) A class of algorithms for mixed-integer bilevel min–max optimization. J. Global Optim. 66(2):225–262.
[69]
Vanderbei RJ (2014) Linear Programming (Springer, New York).
[70]
Vicente L, Savard G, Júdice J (1994) Descent approaches for quadratic bilevel programming. J. Optim. Theory Appl. 81(2):379–399.
[71]
von Stackelberg H (1934) Marktform und Gleichgewicht (Springer, Berlin).
[72]
von Stackelberg H (1952) Theory of the Market Economy (Oxford University Press, Oxford, UK).
[73]
Wen UP, Hsu ST (1991) Linear bi-level programming problems – A review. J. Oper. Res. Soc. 42(2):125–133.
[74]
Wendell RE, Hurter AP Jr (1976) Minimization of a non-separable objective function subject to disjoint constraints. Oper. Res. 24(4):643–657.
[75]
Xu P, Wang L (2014) An exact algorithm for the bilevel mixed integer linear programming problem under three simplifying assumptions. Comput. Oper. Res. 41:309–318.
[76]
Xu P, Wang L (2019) BMILP library. Accessed November 12, 2019, http://lzwang.public.iastate.edu/bmilplib.html.

Cited By

View all
  • (2024)Solving Bilevel Programs Based on Lower-Level Mond-Weir DualityINFORMS Journal on Computing10.1287/ijoc.2023.010836:5(1225-1241)Online publication date: 1-Sep-2024
  • (2024)Alternating Direction Method and Deep Learning for Discrete Control with StorageCombinatorial Optimization10.1007/978-3-031-60924-4_7(85-96)Online publication date: 22-May-2024
  • (2023)Extended mean-conditional value-at-risk portfolio optimization with PADM and conditional scenario reduction techniqueComputational Statistics10.1007/s00180-022-01263-y38:2(1023-1040)Online publication date: 1-Jun-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image INFORMS Journal on Computing
INFORMS Journal on Computing  Volume 33, Issue 1
Winter 2021
419 pages
ISSN:1526-5528
DOI:10.1287/ijoc.2021.33.issue-1
Issue’s Table of Contents

Publisher

INFORMS

Linthicum, MD, United States

Publication History

Published: 01 January 2021
Accepted: 10 November 2019
Received: 03 June 2019

Author Tags

  1. bilevel optimization
  2. mixed-integer bilevel optimization
  3. stationary points
  4. penalty methods
  5. alternating direction methods

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Solving Bilevel Programs Based on Lower-Level Mond-Weir DualityINFORMS Journal on Computing10.1287/ijoc.2023.010836:5(1225-1241)Online publication date: 1-Sep-2024
  • (2024)Alternating Direction Method and Deep Learning for Discrete Control with StorageCombinatorial Optimization10.1007/978-3-031-60924-4_7(85-96)Online publication date: 22-May-2024
  • (2023)Extended mean-conditional value-at-risk portfolio optimization with PADM and conditional scenario reduction techniqueComputational Statistics10.1007/s00180-022-01263-y38:2(1023-1040)Online publication date: 1-Jun-2023

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media