Dundar et al., 1995 - Google Patents
The effects of quantization on multilayer neural networksDundar et al., 1995
- Document ID
- 4102131778330617994
- Author
- Dundar G
- Rose K
- Publication year
- Publication venue
- IEEE Transactions on Neural Networks
External Links
Snippet
The effect of weight quantization in multilayer neural networks is discussed. A method is derived by which one can predict the performance degradation at the output given the properties of the network and number of bits of quantization. Predictions from this method …
- 230000001537 neural 0 title abstract description 29
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
- G06N3/0635—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means using analogue means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/08—Learning methods
- G06N3/082—Learning methods modifying the architecture, e.g. adding or deleting nodes or connections, pruning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/04—Architectures, e.g. interconnection topology
- G06N3/0472—Architectures, e.g. interconnection topology using probabilistic elements, e.g. p-rams, stochastic processors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
- G06K9/62—Methods or arrangements for recognition using electronic means
- G06K9/6267—Classification techniques
- G06K9/6268—Classification techniques relating to the classification paradigm, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Dundar et al. | The effects of quantization on multilayer neural networks | |
Chiueh et al. | Recurrent correlation associative memories | |
Kung et al. | A unified systolic architecture for artificial neural networks | |
Specht | Probabilistic neural networks for classification, mapping, or associative memory | |
WO2000016212A1 (en) | Method and apparatus for neural networking using semantic attractor architecture | |
US20220383126A1 (en) | Low-Rank Adaptation of Neural Network Models | |
RoyChowdhury et al. | Dynamic tunneling technique for efficient training of multilayer perceptrons | |
US5167008A (en) | Digital circuitry for approximating sigmoidal response in a neural network layer | |
JP3019145B2 (en) | Neural networks realizing deterministic fuzzy finite automata | |
Fair et al. | Sparse coding using the locally competitive algorithm on the TrueNorth neurosynaptic system | |
Sum et al. | A limitation of gradient descent learning | |
Boybat et al. | Improved deep neural network hardware-accelerators based on non-volatile-memory: The local gains technique | |
US5115492A (en) | Digital correlators incorporating analog neural network structures operated on a bit-sliced basis | |
Hamilton et al. | Pulse stream VLSI circuits and systems: The EPSILON neural network chipset | |
Zhao et al. | Learning in stochastic bit stream neural networks | |
Temenos et al. | A stochastic computing sigma-delta adder architecture for efficient neural network design | |
US6490571B1 (en) | Method and apparatus for neural networking using semantic attractor architecture | |
EP0469885B1 (en) | System for performing weighted summations | |
Müller et al. | Randomized unregulated step descent for limited precision synaptic elements | |
JP2000276459A (en) | Method, device, and system for random number generation using conversion function based on learning | |
Sorheim | A combined network architecture using ART2 and back propagation for adaptive estimation of dynamical processes | |
MORIE et al. | Analog VLSI implementation of adaptive algorithms by an extended Hebbian synapse circuit | |
Vollmer et al. | Experimental study on the precision requirements of RBF, RPROP and BPTT training | |
Mirhassani et al. | Robust low-sensitivity adaline neuron based on continuous valued number system | |
JPH06187472A (en) | Analog neural network |