Abstract
In this study, a dynamic power management method based on reinforcement learning is proposed to improve the energy utilization for energy harvesting wireless sensor networks. Simulations of the proposed method on wireless sensor nodes powered by solar power are performed. Experimental results demonstrate that the proposed method outperforms the other power management method in achieving longer sustainable operations for energy harvesting wireless sensor network.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004)
Benini, L., Bogliolo, A., Micheli, G.D.: A Survey of Design Techniques for System-level Dynamic Power Management. IEEE Transactions on VLSI Systems 8(3), 299–316 (2000)
Benini, L., Bogliolo, A., Paleologo, G.A., Micheli, G.D.: Policy Optimization for Dynamic Power Management. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 18(6), 813–833 (1999)
Chung, E.Y., Benini, L., Bogliolo, A., Lu, Y.H., Micheli, G.D.: Dynamic Power Management for Non-stationary Service Requests. IEEE Transactions on Computers 51(11), 1345–1361 (2002)
Hwang, C.H., Wu, C.H.: A Predictive System Shutdown Method for Energy Saving of Event-driven Computation. In: Proc. of IEEE/ACM International Conference on Computer-Aided Design, pp. 28–32 (1997)
Jeong, K.S., Lee, W.Y., Kim, C.S.: Energy Management Strategies of a Fuel Cell/Battery Hybrid System Using Fuzzy Logics. Journal of Power Sources 145, 319–326 (2005)
Kansal, A., Hsu, J., Srivastava, M., Raghunathan, V.: Harvesting Aware Power Management for Sensor Networks. In: Proc. of ACM/IEEE Design Automation Conference, pp. 651–656 (2006)
Kansal, A., Hsu, J., Zahedi, S., Srivastava, M.B.: Power Management in Energy Harvesting Sensor Networks. ACM Transactions on Embedded Computing Systems 6(4), Article 32 (2007)
Li, D., Chou, P.H.: Maximizing Efficiency of Solar-powered Systems by Load Matching. In: Proc. of ISPLED, pp. 162–167 (2004)
Moser, C., Thiele, L., Brunelli, D., Benini, L.: Adaptive Power Management in Energy Harvesting Systems. In: Proc. of Design, Automation & Test in Europe Conference & Exhibition, pp. 1–6 (2007)
Pao, J.W.: The Evaluation of Operation Performance of a Photovoltaic System. Master thesis, Department of Electrical Engineering, National Chung Yuan University, Taiwan (2002)
Qui, Q., Pedram, M.: Dynamic Power Management Based on Continuous-time Markov Decision Process. In: Proc. of Design Automation Conference, pp. 555–561 (1999)
Raghunathan, V., Chou, P.H.: Design and Power Management of Energy Harvesting Embedded Systems. In: Proc. of ISLPED, pp. 369–374 (2006)
Raghunathan, V., Kansal, A., Hsu, J., Friedman, J., Srivastava, M.: Design considerations for solar energy harvesting wireless embedded systems. In: Proc. of Information Processing in Sensor Networks, pp. 457–462 (2005)
Zhuo, J., Chakrabarti, C., Lee, K., Chang, N.: Dynamic Power Management with Hybrid Power Sources. In: Proc. of Design Automation Conference, pp. 871–876 (2007)
Honsberg, C., Bowden, S.: Photovoltaics CDROM, http://www.udel.edu/Igert/pvcdrom/index.html
Square One WIKI - Solar Position: Calculator, http://squ1.org/wiki/Solar_Position_Calculator
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chaoming Hsu, R., Liu, CT., Lee, WM. (2009). Reinforcement Learning-Based Dynamic Power Management for Energy Harvesting Wireless Sensor Network. In: Chien, BC., Hong, TP., Chen, SM., Ali, M. (eds) Next-Generation Applied Intelligence. IEA/AIE 2009. Lecture Notes in Computer Science(), vol 5579. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02568-6_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-02568-6_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02567-9
Online ISBN: 978-3-642-02568-6
eBook Packages: Computer ScienceComputer Science (R0)