[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

Carvalho et al., 2020 - Google Patents

Autolr: An evolutionary approach to learning rate policies

Carvalho et al., 2020

View PDF
Document ID
16680481779754466631
Author
Carvalho P
Lourenço N
Assunção F
Machado P
Publication year
Publication venue
Proceedings of the 2020 genetic and evolutionary computation conference

External Links

Snippet

The choice of a proper learning rate is paramount for good Artificial Neural Network training and performance. In the past, one had to rely on experience and trial-and-error to find an adequate learning rate. Presently, a plethora of state of the art automatic methods exist that …
Continue reading at dl.acm.org (PDF) (other versions)

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computer systems based on biological models
    • G06N3/12Computer systems based on biological models using genetic models
    • G06N3/126Genetic algorithms, i.e. information processing using digital simulations of the genetic system
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computer systems utilising knowledge based models
    • G06N5/02Knowledge representation
    • G06N5/022Knowledge engineering, knowledge acquisition
    • G06N5/025Extracting rules from data
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N99/00Subject matter not provided for in other groups of this subclass
    • G06N99/005Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computer systems based on biological models
    • G06N3/02Computer systems based on biological models using neural network models
    • G06N3/08Learning methods
    • G06N3/086Learning methods using evolutionary programming, e.g. genetic algorithms
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computer systems based on biological models
    • G06N3/02Computer systems based on biological models using neural network models
    • G06N3/04Architectures, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computer systems based on biological models
    • G06N3/02Computer systems based on biological models using neural network models
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computer systems utilising knowledge based models
    • G06N5/04Inference methods or devices
    • G06N5/043Distributed expert systems, blackboards
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00Computer systems based on specific mathematical models
    • G06N7/005Probabilistic networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for programme control, e.g. control unit
    • G06F9/06Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/18Digital computers in general; Data processing equipment in general in which a programme is changed according to experience gained by the computer itself during a complete run; Learning machines

Similar Documents

Publication Publication Date Title
Huang et al. Nostalgic adam: Weighting more of the past gradients when designing the adaptive learning rate
AU2009298151B2 (en) Systems and methods for automatic creation of agent-based systems
Liu et al. Evolutionary design of artificial neural networks with different nodes
Carvalho et al. Autolr: An evolutionary approach to learning rate policies
Burgueño et al. An LSTM-based neural network architecture for model transformations
Anwar et al. A hybrid-adaptive neuro-fuzzy inference system for multi-objective regression test suites optimization
Pecori et al. Incremental learning of fuzzy decision trees for streaming data classification
Custode et al. A co-evolutionary approach to interpretable reinforcement learning in environments with continuous action spaces
Yuan et al. A novel genetic algorithm with hierarchical evaluation strategy for hyperparameter optimisation of graph neural networks
Selvarajah et al. Identifying a team of experts in social networks using a cultural algorithm
de Albuquerque et al. Solving assembly line balancing problems with fish school search algorithm
Teji et al. Predicting missing links in gene regulatory networks using network embeddings: A qualitative assessment of selective embedding techniques
Kusumoto et al. Automated theorem proving in intuitionistic propositional logic by deep reinforcement learning
Dou et al. Comparison of semantic-based local search methods for multiobjective genetic programming
Lentzas et al. Hyperparameter tuning using quantum genetic algorithms
Sun et al. Large-scale artificial neural network: Mapreduce-based deep learning
Quiroz-Ramírez et al. Partially-connected artificial neural networks developed by grammatical evolution for pattern recognition problems
Isazadeh et al. ECA rule learning in dynamic environments
Carvalho et al. Evolving learning rate optimizers for deep neural networks
Carvalho et al. Evolving adaptive neural network optimizers for image classification
Londt et al. Evolving character-level convolutional neural networks for text classification
Chandra et al. A memetic framework for cooperative coevolution of recurrent neural networks
Carvalho Evolving Learning Rate Schedulers
Escovedo et al. Neuroevolutionary models based on quantum-inspired evolutionary algorithms
Sokół et al. Application of the Hierarchic Memetic Strategy HMS in Neuroevolution