[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Elementary function generators for neural-network emulators

Published: 01 November 2000 Publication History

Abstract

Piecewise first- and second-order approximations are employed to design commonly used elementary function generators for neural-network emulators. Three novel schemes are proposed for the first-order approximations. The first scheme requires one multiplication, one addition, and a 28-byte lookup table. The second scheme requires one addition, a 14-byte lookup table, and no multiplication. The third scheme needs a 16-byte lookup table, no multiplication, and no addition. A second-order approximation approach provides better function precision; it requires more hardware and involves the computation of one multiplication and two additions and access to a 28-byte lookup table. We consider bit serial implementations of the schemes to reduce the hardware cost. The maximum delay for the four schemes ranges from 24- to 32-bit serial machine cycles; the second-order approximation approach has the largest delay. The proposed approach can be applied to compute other elementary function with proper considerations.

Cited By

View all
  • (2020)A Twofold Lookup Table Architecture for Efficient Approximation of Activation FunctionsIEEE Transactions on Very Large Scale Integration (VLSI) Systems10.1109/TVLSI.2020.301539128:12(2540-2550)Online publication date: 25-Nov-2020
  • (2020)Approximation of Transcendental Functions With Guaranteed Algorithmic QoS by Multilayer Pareto OptimizationIEEE Transactions on Very Large Scale Integration (VLSI) Systems10.1109/TVLSI.2020.301200828:12(2495-2508)Online publication date: 25-Nov-2020
  • (2019)Design Space Exploration of Neural Network Activation Function CircuitsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2018.287119838:10(1974-1978)Online publication date: 1-Oct-2019
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Neural Networks
IEEE Transactions on Neural Networks  Volume 11, Issue 6
November 2000
331 pages

Publisher

IEEE Press

Publication History

Published: 01 November 2000

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2020)A Twofold Lookup Table Architecture for Efficient Approximation of Activation FunctionsIEEE Transactions on Very Large Scale Integration (VLSI) Systems10.1109/TVLSI.2020.301539128:12(2540-2550)Online publication date: 25-Nov-2020
  • (2020)Approximation of Transcendental Functions With Guaranteed Algorithmic QoS by Multilayer Pareto OptimizationIEEE Transactions on Very Large Scale Integration (VLSI) Systems10.1109/TVLSI.2020.301200828:12(2495-2508)Online publication date: 25-Nov-2020
  • (2019)Design Space Exploration of Neural Network Activation Function CircuitsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2018.287119838:10(1974-1978)Online publication date: 1-Oct-2019
  • (2008)Low-error, High-speed Approximation of the Sigmoid Function for Large FPGA ImplementationsJournal of Signal Processing Systems10.1007/s11265-007-0140-z52:2(137-151)Online publication date: 1-Aug-2008
  • (2007)Hardware/software codesign for embedded implementation of neural networksProceedings of the 3rd international conference on Reconfigurable computing: architectures, tools and applications10.5555/1764631.1764650(167-178)Online publication date: 27-Mar-2007
  • (2006)An efficient hardware architecture for a neural network activation function generatorProceedings of the Third international conference on Advances in Neural Networks - Volume Part III10.1007/11760191_192(1319-1327)Online publication date: 28-May-2006

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media