Esrafilian-Najafabadi et al., 2022 - Google Patents
Towards self-learning control of HVAC systems with the consideration of dynamic occupancy patterns: Application of model-free deep reinforcement learningEsrafilian-Najafabadi et al., 2022
- Document ID
- 9634086307199078638
- Author
- Esrafilian-Najafabadi M
- Haghighat F
- Publication year
- Publication venue
- Building and Environment
External Links
Snippet
This study proposes a self-learning control system that aims to learn occupancy profiles, building energy consumption patterns, and lag-time of the heating, ventilation, and air- conditioning (HVAC) systems. The control system learns by interacting with the environment …
- 230000002787 reinforcement 0 title abstract description 28
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/0265—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
- G05B13/027—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using neural networks only
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation, e.g. linear programming, "travelling salesman problem" or "cutting stock problem"
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
- G06N99/005—Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management, e.g. organising, planning, scheduling or allocating time, human or machine resources; Enterprise planning; Organisational models
- G06Q10/063—Operations research or analysis
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/04—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Taheri et al. | Learning-based CO2 concentration prediction: Application to indoor air quality control using demand-controlled ventilation | |
Brandi et al. | Deep reinforcement learning to optimise indoor temperature control and heating energy consumption in buildings | |
Deng et al. | Towards optimal HVAC control in non-stationary building environments combining active change detection and deep reinforcement learning | |
Zhuang et al. | Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning | |
Merabet et al. | Intelligent building control systems for thermal comfort and energy-efficiency: A systematic review of artificial intelligence-assisted techniques | |
Ahn et al. | Application of deep Q-networks for model-free optimal control balancing between different HVAC systems | |
Zou et al. | Towards optimal control of air handling units using deep reinforcement learning and recurrent neural network | |
Yao et al. | State of the art review on model predictive control (MPC) in Heating Ventilation and Air-conditioning (HVAC) field | |
Reynolds et al. | A zone-level, building energy optimisation combining an artificial neural network, a genetic algorithm, and model predictive control | |
Vázquez-Canteli et al. | Fusing TensorFlow with building energy simulation for intelligent energy management in smart cities | |
Afram et al. | Artificial neural network (ANN) based model predictive control (MPC) and optimization of HVAC systems: A state of the art review and case study of a residential HVAC system | |
Gupta et al. | Energy-efficient heating control for smart buildings with deep reinforcement learning | |
Esrafilian-Najafabadi et al. | Towards self-learning control of HVAC systems with the consideration of dynamic occupancy patterns: Application of model-free deep reinforcement learning | |
Zhang et al. | Practical implementation and evaluation of deep reinforcement learning control for a radiant heating system | |
Lee et al. | Model predictive control of building energy systems with thermal energy storage in response to occupancy variations and time-variant electricity prices | |
Ascione et al. | Simulation-based model predictive control by the multi-objective optimization of building energy performance and thermal comfort | |
Kusiak et al. | Minimization of energy consumption in HVAC systems with data-driven models and an interior-point method | |
Esrafilian-Najafabadi et al. | Impact of occupancy prediction models on building HVAC control system performance: Application of machine learning techniques | |
Deb et al. | A machine learning-based framework for cost-optimal building retrofit | |
Zhou et al. | A comprehensive review of the applications of machine learning for HVAC | |
Erfani et al. | Design and construction of a non-linear model predictive controller for building's cooling system | |
Qin et al. | Energy-efficient heating control for nearly zero energy residential buildings with deep reinforcement learning | |
Bellagarda et al. | Effectiveness of neural networks and transfer learning for indoor air-temperature forecasting | |
Nguyen et al. | Modelling building HVAC control strategies using a deep reinforcement learning approach | |
Shin et al. | Development of an HVAC system control method using weather forecasting data with deep reinforcement learning algorithms |