Carvalho et al., 2020 - Google Patents
Autolr: An evolutionary approach to learning rate policiesCarvalho et al., 2020
View PDF- Document ID
- 16680481779754466631
- Author
- Carvalho P
- Lourenço N
- Assunção F
- Machado P
- Publication year
- Publication venue
- Proceedings of the 2020 genetic and evolutionary computation conference
External Links
Snippet
The choice of a proper learning rate is paramount for good Artificial Neural Network training and performance. In the past, one had to rely on experience and trial-and-error to find an adequate learning rate. Presently, a plethora of state of the art automatic methods exist that …
- 238000000034 method 0 abstract description 24
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/12—Computer systems based on biological models using genetic models
- G06N3/126—Genetic algorithms, i.e. information processing using digital simulations of the genetic system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/02—Knowledge representation
- G06N5/022—Knowledge engineering, knowledge acquisition
- G06N5/025—Extracting rules from data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
- G06N99/005—Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/08—Learning methods
- G06N3/086—Learning methods using evolutionary programming, e.g. genetic algorithms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/04—Architectures, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/04—Inference methods or devices
- G06N5/043—Distributed expert systems, blackboards
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computer systems based on specific mathematical models
- G06N7/005—Probabilistic networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for programme control, e.g. control unit
- G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/18—Digital computers in general; Data processing equipment in general in which a programme is changed according to experience gained by the computer itself during a complete run; Learning machines
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Huang et al. | Nostalgic adam: Weighting more of the past gradients when designing the adaptive learning rate | |
AU2009298151B2 (en) | Systems and methods for automatic creation of agent-based systems | |
Liu et al. | Evolutionary design of artificial neural networks with different nodes | |
Carvalho et al. | Autolr: An evolutionary approach to learning rate policies | |
Burgueño et al. | An LSTM-based neural network architecture for model transformations | |
Anwar et al. | A hybrid-adaptive neuro-fuzzy inference system for multi-objective regression test suites optimization | |
Pecori et al. | Incremental learning of fuzzy decision trees for streaming data classification | |
Custode et al. | A co-evolutionary approach to interpretable reinforcement learning in environments with continuous action spaces | |
Yuan et al. | A novel genetic algorithm with hierarchical evaluation strategy for hyperparameter optimisation of graph neural networks | |
Selvarajah et al. | Identifying a team of experts in social networks using a cultural algorithm | |
de Albuquerque et al. | Solving assembly line balancing problems with fish school search algorithm | |
Teji et al. | Predicting missing links in gene regulatory networks using network embeddings: A qualitative assessment of selective embedding techniques | |
Kusumoto et al. | Automated theorem proving in intuitionistic propositional logic by deep reinforcement learning | |
Dou et al. | Comparison of semantic-based local search methods for multiobjective genetic programming | |
Lentzas et al. | Hyperparameter tuning using quantum genetic algorithms | |
Sun et al. | Large-scale artificial neural network: Mapreduce-based deep learning | |
Quiroz-Ramírez et al. | Partially-connected artificial neural networks developed by grammatical evolution for pattern recognition problems | |
Isazadeh et al. | ECA rule learning in dynamic environments | |
Carvalho et al. | Evolving learning rate optimizers for deep neural networks | |
Carvalho et al. | Evolving adaptive neural network optimizers for image classification | |
Londt et al. | Evolving character-level convolutional neural networks for text classification | |
Chandra et al. | A memetic framework for cooperative coevolution of recurrent neural networks | |
Carvalho | Evolving Learning Rate Schedulers | |
Escovedo et al. | Neuroevolutionary models based on quantum-inspired evolutionary algorithms | |
Sokół et al. | Application of the Hierarchic Memetic Strategy HMS in Neuroevolution |