[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3632775.3661952acmotherconferencesArticle/Chapter ViewAbstractPublication Pagese-energyConference Proceedingsconference-collections
research-article
Open access

Decision-Focused Retraining of Forecast Models for Optimization Problems in Smart Energy Systems

Published: 31 May 2024 Publication History

Abstract

In order to enable the energy transition, a higher share of renewable energy sources is required in the electricity grid. However, the volatile nature of these renewable sources can lead to stability issues. Therefore, countermeasures must be integrated into modern electricity grids to maintain stability. However, many countermeasures rely on optimization problems on multiple grid levels to be successfully integrated. Furthermore, these optimization problems often require forecasts that are tailored to deliver value for the considered optimization problem. Nevertheless, existing applications of decision-focused learning to provide this value scale poorly for energy system optimization problems. Therefore, we propose a novel method called Decision-Focused Retraining that combines prediction-focused learning and decision-focused learning. In this method, an existing forecasting model is retrained to generate forecasts delivering increased value for the optimization problem. First, a prediction-focused learning approach with a suitable base loss is used to pre-train the forecasting model. Afterward, the model is fine-tuned by combining a global instance-independent surrogate NN with the prediction-focused base loss to optimize the forecasting model. We evaluate our approach on an exemplary optimization problem, the dispatchable feeder optimization problem, considering over 199 buildings, which leads to an improvement of at least 7.29%.

References

[1]
Abien Fred Agarap. 2018. Deep learning using rectified linear units (ReLU). arXiv preprint arXiv:1803.08375 (2018).
[2]
Brandon Amos and J Zico Kolter. 2017. OptNet: Differentiable optimization as a layer in neural networks. In International Conference on Machine Learning. PMLR, 136–145.
[3]
Riccardo Remo Appino, Jorge Ángel González Ordiano, Ralf Mikut, Timm Faulwasser, and Veit Hagenmeyer. 2018. On the use of probabilistic forecasts in scheduling of renewable energy sources coupled to storages. Applied Energy 210 (Jan. 2018), 1207–1218. https://doi.org/10.1016/j.apenergy.2017.08.133
[4]
Dishank Bansal, Ricky Chen, Mustafa Mukadam, and Brandon Amos. 2023. TaskMet: Task-Driven Metric Learning for Model Learning. (Dec. 2023).
[5]
Raymond H. Byrne, Tu A. Nguyen, David A. Copp, Babu R. Chalamala, and Imre Gyuk. 2018. Energy Management and Optimization Methods for Grid Energy Storage Systems. IEEE Access 6 (2018), 13231–13260. https://doi.org/10.1109/ACCESS.2017.2741578
[6]
Tsai-Hsuan Chung, Vahid Rostami, Hamsa Bastani, and Osbert Bastani. 2022. Decision-Aware Learning for Optimizing Health Supply Chains. Extended Abstract presented at Machine Learning for Health (ML4H) Symposium (Nov. 2022).
[7]
Mathieu David, John Boland, Luigi Cirocco, Philippe Lauret, and Cyril Voyant. 2021. Value of deterministic day-ahead forecasts of PV generation in PV+ Storage operation for the Australian electricity market. Solar Energy 224 (2021), 672–684.
[8]
Priya Donti, Brandon Amos, and J Zico Kolter. 2017. Task-based end-to-end model learning in stochastic optimization. Advances in Neural Information Processing Systems 30 (2017).
[9]
Adam N Elmachtoub and Paul Grigas. 2022. Smart “predict, then optimize”. Management Science 68, 1 (2022), 9–26.
[10]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[11]
Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter. 2017. Self-normalizing neural networks. Advances in Neural Information Processing Systems 30 (2017).
[12]
Lingkai Kong, Jiaming Cui, Yuchen Zhuang, Rui Feng, B Aditya Prakash, and Chao Zhang. 2022. End-to-end stochastic optimization with energy-based model. Advances in Neural Information Processing Systems 35 (2022), 11341–11354.
[13]
Lingkai Kong, Wenhao Mu, Jiaming Cui, Yuchen Zhuang, B Aditya Prakash, Bo Dai, and Chao Zhang. 2023. DF2: Distribution-Free Decision-Focused Learning. arXiv preprint arXiv:2308.05889 (2023).
[14]
Jayanta Mandi, James Kotary, Senne Berden, Maxime Mulamba, Victor Bucarey, Tias Guns, and Ferdinando Fioretto. 2023. Decision-focused learning: Foundations, state of the art, benchmark and future opportunities. arXiv preprint arXiv:2307.13565 (2023).
[15]
Maxime Mulamba, Jayanta Mandi, Michelangelo Diligenti, Michele Lombardi, Victor Bucarey, and Tias Guns. 2020. Contrastive losses and solution caching for predict-and-optimize. arXiv preprint arXiv:2011.05354 (2020).
[16]
Dominik Putz, Michael Gumhalter, and Hans Auer. 2023. The true value of a forecast: Assessing the impact of accuracy on local energy communities. Sustainable Energy, Grids and Networks 33 (March 2023), 100983. https://doi.org/10.1016/j.segan.2022.100983
[17]
Elizabeth L. Ratnam, Steven R. Weller, Christopher M. Kellett, and Alan T. Murray. 2017. Residential load and rooftop PV generation: an Australian distribution network dataset. International Journal of Sustainable Energy 36, 8 (Sept. 2017), 787–806. https://doi.org/10.1080/14786451.2015.1100196
[18]
Riccardo Remo Appino, Jorge Angel Gonzalez Ordiano, Ralf Mikut, Veit Hagenmeyer, and Timm Faulwasser. 2018. Storage Scheduling with Stochastic Uncertainties: Feasibility and Cost of Imbalances. In 2018 Power Systems Computation Conference (PSCC). IEEE, Dublin, Ireland, 1–7. https://doi.org/10.23919/PSCC.2018.8442529
[19]
Linwei Sang, Yinliang Xu, Huan Long, Qinran Hu, and Hongbin Sun. 2022. Electricity Price Prediction for Energy Storage System Arbitrage: A Decision-Focused Approach. IEEE Transactions on Smart Grid 13, 4 (July 2022), 2822–2832. https://doi.org/10.1109/TSG.2022.3166791
[20]
Sanket Shah, Andrew Perrault, Bryan Wilder, and Milind Tambe. 2023. Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimize. arXiv preprint arXiv:2305.16830 (2023).
[21]
Sanket Shah, Kai Wang, Bryan Wilder, Andrew Perrault, and Milind Tambe. 2022. Decision-focused learning without decision-making: Learning locally optimized decision losses. Advances in Neural Information Processing Systems 35 (2022), 1320–1332.
[22]
Md. Nahid Haque Shazon, Nahid-Al-Masood, and Atik Jawad. 2022. Frequency control challenges and potential countermeasures in future low-inertia power systems: A review. Energy Reports 8 (Nov. 2022), 6191–6219. https://doi.org/10.1016/j.egyr.2022.04.063
[23]
Helmut Simonis, Barry O’Sullivan, Deepak Mehta, Barry Hurley, and Milan De Cauwer. 2014. Energy-Cost Aware Scheduling/Forecasting Competition.
[24]
Fabrizio Sossan, Emil Namor, Rachid Cherkaoui, and Mario Paolone. 2016. Achieving the Dispatchability of Distribution Feeders Through Prosumers Data Driven Forecasting and Model Predictive Control of Electrochemical Storage. IEEE Transactions on Sustainable Energy 7, 4 (Oct. 2016), 1762–1777. https://doi.org/10.1109/TSTE.2016.2600103
[25]
Gokul Sidarth Thirunavukkarasu, Mehdi Seyedmahmoudian, Elmira Jamei, Ben Horan, Saad Mekhilef, and Alex Stojcevski. 2022. Role of optimization techniques in microgrid energy management systems—A review. Energy Strategy Reviews 43 (Sept. 2022), 100899. https://doi.org/10.1016/j.esr.2022.100899
[26]
Dorina Werling, Maximilian Beichter, Benedikt Heidrich, Kaleb Phipps, Ralf Mikut, and Veit Hagenmeyer. 2023. The Impact of Forecast Characteristics on the Forecast Value for the Dispatchable Feeder. In Companion Proceedings of the 14th ACM International Conference on Future Energy Systems. ACM, Orlando FL USA, 59–71. https://doi.org/10.1145/3599733.3600251
[27]
Dorina Werling, Maximilian Beichter, Benedikt Heidrich, Kaleb Phipps, Ralf Mikut, and Veit Hagenmeyer. 2024. Automating Value-Oriented Forecast Model Selection by Meta-learning: Application on a Dispatchable Feeder. In Energy Informatics, Bo Nørregaard Jørgensen, Luiz Carlos Pereira Da Silva, and Zheng Ma (Eds.). Vol. 14467. Springer Nature Switzerland, Cham, 95–116. https://doi.org/10.1007/978-3-031-48649-4_6 Series Title: Lecture Notes in Computer Science.
[28]
Frank Wilcoxon. 1945. Individual Comparisons by Ranking Methods. Biometrics Bulletin 1, 6 (1945), 80–83. https://doi.org/10.2307/3001968 Publisher: [International Biometric Society, Wiley].
[29]
Jialun Zhang, Yi Wang, and Gabriela Hug. 2022. Cost-oriented load forecasting. Electric Power Systems Research 205 (April 2022), 107723. https://doi.org/10.1016/j.epsr.2021.107723
[30]
Yufan Zhang, Mengshuo Jia, Honglin Wen, and Yuanyuan Shi. 2023. Value-oriented renewable energy forecasting for coordinated energy dispatch problems at two stages. arXiv preprint arXiv:2309.00803 (2023).
[31]
Yufan Zhang, Honglin Wen, Yuexin Bian, and Yuanyuan Shi. 2023. Deriving Loss Function for Value-oriented Renewable Energy Forecasting. arXiv preprint arXiv:2310.00571 (2023).
[32]
Arman Zharmagambetov, Brandon Amos, Aaron Ferber, Taoan Huang, Bistra Dilkina, and Yuandong Tian. 2023. Landscape surrogate: Learning decision losses for mathematical optimization under partial information. arXiv preprint arXiv:2307.08964 (2023).

Index Terms

  1. Decision-Focused Retraining of Forecast Models for Optimization Problems in Smart Energy Systems

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      e-Energy '24: Proceedings of the 15th ACM International Conference on Future and Sustainable Energy Systems
      June 2024
      704 pages
      ISBN:9798400704802
      DOI:10.1145/3632775
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 31 May 2024

      Check for updates

      Author Tags

      1. Decision-focused learning
      2. applied optimization
      3. energy systems
      4. forecasting
      5. predict then optimize

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      e-Energy '24

      Acceptance Rates

      Overall Acceptance Rate 160 of 446 submissions, 36%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 438
        Total Downloads
      • Downloads (Last 12 months)438
      • Downloads (Last 6 weeks)70
      Reflects downloads up to 07 Jan 2025

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media