[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2934583.2934624acmconferencesArticle/Chapter ViewAbstractPublication PagesislpedConference Proceedingsconference-collections
research-article

A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing

Published: 08 August 2016 Publication History

Abstract

The mathematical properties of high-dimensional (HD) spaces show remarkable agreement with behaviors controlled by the brain. Computing with HD vectors, referred to as "hypervectors," is a brain-inspired alternative to computing with numbers. Hypervectors are high-dimensional, holographic, and (pseudo)random with independent and identically distributed (i.i.d.) components. They provide for energy-efficient computing while tolerating hardware variation typical of nanoscale fabrics. We describe a hardware architecture for a hypervector-based classifier and demonstrate it with language identification from letter trigrams. The HD classifier is 96.7% accurate, 1.2% lower than a conventional machine learning method, operating with half the energy. Moreover, the HD classifier is able to tolerate 8.8-fold probability of failure of memory cells while maintaining 94% accuracy. This robust behavior with erroneous memory cells can significantly improve energy efficiency.

References

[1]
S. Borkar, et. al. Parameter variations and impact on circuits and microarchitecture. In Proc. of the Design Automation Conference, pages 338--342, June 2003.
[2]
T.-T. Liu and J.M. Rabaey. A 0.25 V 460 nW asynchronous neural signal processor with inherent leakage suppression. Solid-State Circuits, IEEE Journal of, 48(4):897--906, 2013.
[3]
D. Kuzum, et. al. Low-energy robust neuromorphic computation using synaptic devices. Electron Devices, IEEE Transactions on, 59(12):3489--3494, Dec 2012.
[4]
Beinuo Zhang, Zhewei Jiang, Qi Wang, Jae sun Seo, and Mingoo Seok. A neuromorphic neural spike clustering processor for deep-brain sensing and stimulation systems. In Proc. of the International Symposium on Low Power Electronics and Design, 2015.
[5]
Pentti Kanerva, Jan Kristoferson, and Anders Holst. Random indexing of text samples for latent semantic analysis. In Proc. of the Conference of the Cognitive Science Society, 2000.
[6]
Magnus Sahlgren. An introduction to random indexing. In Methods and Applications of Semantic Indexing Workshop at the 7th International Conference on Terminology and Knowledge Engineering, TKE 2005, 2005.
[7]
Pentti Kanerva. Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors. Cognitive Computation, 1(2):139--159, 2009.
[8]
Pentti Kanerva. Computing with 10,000-bitwords. In Proc. 52nd Annual Allerton Conference on Communication, Control, and Computing, 2014.
[9]
Aditya Joshi, Johan Halseth, and Pentti Kanerva. Language geometry using random indexing. In Quantum Interaction 2016 Conference Proceedings, in press.
[10]
Fateme Rasti Najafabadi, Abbas Rahimi, Pentti Kanerva, and Jan M. Rabaey. Hyperdimensional computing for text classification. Design, Automation Test in Europe Conference Exhibition (DATE), University Booth, March 2016.
[11]
T.K. Landauer and S.T. Dumais. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2):211--240, 1997.
[12]
Pentti Kanerva. Sparse Distributed Memory. MIT Press, Cambridge, MA, USA, 1988.
[13]
Ross W. Gayler. Multiplicative binding, representation operators & analogy. Advances in analogy research, 1998.
[14]
Uwe Quasthoff, Matthias Richter, and Christian Biemann. Corpus portal for search in monolingual corpora. In Proc. of the International Conference on Language Resources and Evaluation, 2006.
[15]
Philipp Koehn. Europarl: A parallel corpus for statistical machine translation. http://www.statmt.org/europarl/, 2005.

Cited By

View all
  • (2024)Optimized Early Prediction of Business Processes with Hyperdimensional ComputingInformation10.3390/info1508049015:8(490)Online publication date: 16-Aug-2024
  • (2024)Efficient Design of a Hyperdimensional Processing Unit for Multi-Layer Cognition2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546810(1-6)Online publication date: 25-Mar-2024
  • (2024)MultimodalHD: Federated Learning Over Heterogeneous Sensor Modalities using Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546794(1-6)Online publication date: 25-Mar-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
ISLPED '16: Proceedings of the 2016 International Symposium on Low Power Electronics and Design
August 2016
392 pages
ISBN:9781450341851
DOI:10.1145/2934583
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 August 2016

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • SONIC SRC STARnet

Conference

ISLPED '16
Sponsor:
ISLPED '16: International Symposium on Low Power Electronics and Design
August 8 - 10, 2016
CA, San Francisco Airport, USA

Acceptance Rates

ISLPED '16 Paper Acceptance Rate 60 of 190 submissions, 32%;
Overall Acceptance Rate 398 of 1,159 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)284
  • Downloads (Last 6 weeks)38
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Optimized Early Prediction of Business Processes with Hyperdimensional ComputingInformation10.3390/info1508049015:8(490)Online publication date: 16-Aug-2024
  • (2024)Efficient Design of a Hyperdimensional Processing Unit for Multi-Layer Cognition2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546810(1-6)Online publication date: 25-Mar-2024
  • (2024)MultimodalHD: Federated Learning Over Heterogeneous Sensor Modalities using Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546794(1-6)Online publication date: 25-Mar-2024
  • (2024)CafeHD: A Charge-Domain FeFET-Based Compute-in-Memory Hyperdimensional Encoder with Hypervector Merging2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546635(1-6)Online publication date: 25-Mar-2024
  • (2024)DropHD: Technology/Algorithm Co-Design for Reliable Energy-Efficient NVM-Based Hyper-Dimensional Computing Under Voltage Scaling2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546626(1-6)Online publication date: 25-Mar-2024
  • (2024)uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546545(1-6)Online publication date: 25-Mar-2024
  • (2024)OTFGEncoder - HDC: Hardware-efficient Encoding Techniques for Hyperdimensional Computing2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546523(1-2)Online publication date: 25-Mar-2024
  • (2024)Hyperdimensional computing: A fast, robust, and interpretable paradigm for biological dataPLOS Computational Biology10.1371/journal.pcbi.101242620:9(e1012426)Online publication date: 24-Sep-2024
  • (2024)High-efficiency and high-security emerging computing chips: development, challenges, and prospectsSCIENTIA SINICA Informationis10.1360/SSI-2023-031654:1(34)Online publication date: 3-Jan-2024
  • (2024)Hyperdimensional computing: a framework for stochastic computation and symbolic AIJournal of Big Data10.1186/s40537-024-01010-811:1Online publication date: 24-Oct-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media