More Web Proxy on the site http://driver.im/

research-article

base2: An IR for Binary Numeral Types

Authors:

Karl F. A. Friebel,

Jeronimo CastrillonAuthors Info & Claims

HEART '23: Proceedings of the 13th International Symposium on Highly Efficient Accelerators and Reconfigurable Technologies

Pages 19 - 26

https://doi.org/10.1145/3597031.3597048

Published: 19 July 2023 Publication History

Abstract

Custom data types and arbitrary-precision arithmetic are often key for efficient hardware designs on Field Programmable Gate Array (FPGA) platforms. Current end-to-end flows incorporating quantization are not only domain-specific, but also tightly integrated and not repurposable. Abstractions for arbitrary-precision arithmetic are generally vendor-specific, and results are hardly portable across platforms. In this work, we present a new Intermediate Representation (IR), base2, to address the programmability issues of custom data types in reconfigurable hardware. We contextualize our proposal in the greater LLVM (llvm) ecosystem, where we show how existing abstractions can be simplified and unified. We implement base2 in Multi-Level Intermediate Representation (MLIR), which allows it to be used in a variety of existing and future target-agnostic front-ends. We demonstrate the power of our model by applying it to sample kernels and evaluating the accuracy of the result. For these samples, we achieve interoperability with an existing end-to-end High-Level Synthesis (HLS) flow.

References

[1]

2022. TOSA 0.50.0 Specification. https://www.mlplatform.org/tosa/tosa_spec.html

[2]

2023. Brevitas. Xilinx. https://github.com/Xilinx/brevitas

[3]

2023. "CIRCT" / Circuit IR Compilers and Tools. LLVM. https://github.com/llvm/circt

[4]

2023. GNU libc: Errors in Math Functions. https://www.gnu.org/software/libc/manual/2.37/html_node/Errors-in-Math-Functions.html

[5]

Quentin Ducasse, Pascal Cotret, Loïc Lagadec, and Robert Stewart. 2021. Benchmarking Quantized Neural Networks on FPGAs with FINN. https://doi.org/10.48550/arXiv.2102.01341 arxiv:arXiv:2102.01341

[6]

Fabrizio Ferrandi, Vito Giovanni Castellana, Serena Curzel, Pietro Fezzardi, Michele Fiorito, Marco Lattuada, Marco Minutoli, Christian Pilato, and Antonino Tumeo. 2021. Invited: Bambu: an Open-Source Research Framework for the High-Level Synthesis of Complex Applications. In ACM/IEEE Design Automation Conference (DAC). https://doi.org/10.1109/DAC18074.2021.9586110

Digital Library

[7]

Laurent Fousse, Guillaume Hanrot, Vincent Lefèvre, Patrick Pélissier, and Paul Zimmermann. 2007. MPFR: A Multiple-Precision Binary Floating-Point Library with Correct Rounding. ACM Trans. Math. Softw. 33, 2 (jun 2007), 13–es. https://doi.org/10.1145/1236463.1236468

Digital Library

[8]

John L. Gustafson and Isaac T. Yonemoto. 2017. Beating Floating Point at Its Own Game: Posit Arithmetic. Supercomputing Frontiers and Innovations 4, 2 (April 2017), 71–86. https://doi.org/10.14529/jsfi170206

Digital Library

[9]

IEEE Std 754-2019 2019. IEEE Standard for Floating-Point Arithmetic (Revision of IEEE 754-2008). Standard. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/IEEESTD.2019.8766229

[10]

ISO JTC1/SC22/WG21 P0907R4 2018. Signed Integers are Two’s Complement. Published Proposal. International Organization for Standardization. https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2018/p0907r4.html

[11]

Chris Lattner, Mehdi Amini, Uday Bondhugula, Albert Cohen, Andy Davis, Jacques Pienaar, River Riddle, Tatiana Shpeisman, Nicolas Vasilache, and Oleksandr Zinenko. 2020. MLIR: A compiler infrastructure for the end of Moore’s law. arXiv preprint arXiv:2002.11054 (2020).

[12]

Paulius Micikevicius, Dusan Stosic, Neil Burgess, Marius Cornea, Pradeep Dubey, Richard Grisenthwaite, Sangwon Ha, Alexander Heinecke, Patrick Judd, John Kamalu, Naveen Mellempudi, Stuart Oberman, Mohammad Shoeybi, Michael Siu, and Hao Wu. 2022. FP8 Formats for Deep Learning. https://doi.org/10.48550/ARXIV.2209.05433

[13]

Eli Mlawer. 2014. RRTMGP: A High-Performance Broadband Radiation Code for the Next Decade. Technical Report. ATMOSPHERIC AND ENVIRONMENTAL RESEARCH INC LEXINGTON MA.

[14]

Eli J Mlawer, Steven J Taubman, Patrick D Brown, Michael J Iacono, and Shepard A Clough. 1997. Radiative transfer for inhomogeneous atmospheres: RRTM, a validated correlated-k model for the longwave. Journal of Geophysical Research: Atmospheres 102, D14 (1997), 16663–16682.

[15]

Luciano Musa. 2008. FPGAS in high energy physics experiments at CERN. In 2008 International Conference on Field Programmable Logic and Applications. 2–2. https://doi.org/10.1109/FPL.2008.4629896

[16]

Tan Nguyen, Samuel Williams, Marco Siracusa, Colin MacLean, Douglas Doerfler, and Nicholas J. Wright. 2020. The Performance and Energy Efficiency Potential of FPGAs in Scientific Computing. In IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS). 8–19. https://doi.org/10.1109/PMBS51919.2020.00007

[17]

Christian Pilato, Stanislav Bohm, Fabien Brocheton, Jeronimo Castrillon, Riccardo Cevasco, Vojtech Cima, Radim Cmar, Dionysios Diamantopoulos, Fabrizio Ferrandi, Jan Martinovic, Gianluca Palermo, Michele Paolino, Antonio Parodi, Lorenzo Pittaluga, Daniel Raho, Francesco Regazzoni, Katerina Slaninova, and Christoph Hagleitner. 2021. EVEREST: A design environment for extreme-scale big data analytics on heterogeneous platforms. In IEEE/EDAA Design, Automation & Test in Europe Conference (DATE). https://doi.org/10.23919/DATE51398.2021.9473940

[18]

UC Berkeley Architecture Research. 2023. Berkeley SoftFloat Release 3e. https://github.com/ucb-bar/berkeley-softfloat-3

[19]

Norman A. Rink, Immo Huismann, Adilla Susungi, Jeronimo Castrillon, Jörg Stiller, Jochen Fröhlich, and Claude Tadonki. 2018. CFDlang: High-level Code Generation for High-order Methods in Fluid Dynamics. In Proceedings of the 3rd International Workshop on Real World Domain Specific Languages (RWDSL 2018) (Vienna, Austria) (RWDSL2018). ACM, New York, NY, USA, Article 5, 10 pages. https://doi.org/10.1145/3183895.3183900

Digital Library

[20]

William C Skamarock, Joseph B Klemp, Jimy Dudhia, David O Gill, Zhiquan Liu, Judith Berner, Wei Wang, Jordan G Powers, Michael G Duda, Dale M Barker, 2019. A description of the advanced research WRF model version 4. National Center for Atmospheric Research: Boulder, CO, USA 145, 145 (2019), 550.

[21]

Stephanie Soldavini, Karl Friebel, Mattia Tibaldi, Gerald Hempel, Jeronimo Castrillon, and Christian Pilato. 2023. Automatic Creation of High-Bandwidth Memory Architectures from Domain-Specific Languages: The Case of Computational Fluid Dynamics. ACM Trans. Reconfigurable Technol. Syst. 16, 2, Article 21 (mar 2023), 34 pages. https://doi.org/10.1145/3563553

Digital Library

[22]

Yaman Umuroglu, Nicholas J. Fraser, Giulio Gambardella, Michaela Blott, Philip Leong, Magnus Jahre, and Kees Vissers. 2017. FINN: A Framework for Fast, Scalable Binarized Neural Network Inference. In Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. 65–74. https://doi.org/10.1145/3020078.3021744 arxiv:1612.07119 [cs]

Digital Library

Cited By

Bakas N(2024)Taylor Polynomials in a High Arithmetic Precision as Universal ApproximatorsComputation10.3390/computation1203005312:3(53)Online publication date: 7-Mar-2024
https://doi.org/10.3390/computation12030053
Pilato CBanik SBeránek JBrocheton FCastrillon JCevasco RCmar RCurzel SFerrandi FFriebel KGalizia AGrasso MSilva PMartinovic JPalermo GPaolino MParodi AParodi APintus FPolig RPoulet DRegazzoni FRinglein BRocco RSlaninova KSlooff TSoldavini SSuchert FTibaldi MWeiss BHagleitner C(2024)A System Development Kit for Big Data Applications on FPGA-based Clusters: The EVEREST Approach2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546518(1-6)Online publication date: 25-Mar-2024
https://doi.org/10.23919/DATE58400.2024.10546518

Index Terms

base2: An IR for Binary Numeral Types
1. Software and its engineering
  1. Software notations and tools
    1. General programming languages

Index terms have been assigned to the content through auto-classification.

Recommendations

Binary synthesis

Recent high-level synthesis approaches and C-based hardware description languages attempt to improve the hardware design process by allowing developers to capture desired hardware functionality in a well-known high-level source language. However, these ...
Memory-Aware Functional IR for Higher-Level Synthesis of Accelerators
Specialized accelerators deliver orders of a magnitude of higher performance than general-purpose processors. The ever-changing nature of modern workloads is pushing the adoption of Field Programmable Gate Arrays (FPGAs) as the substrate of choice. ...
Qualified types for MLF
Proceedings of the tenth ACM SIGPLAN international conference on Functional programming

MLF is a type system that extends a functional language with impredicative rank-n polymorphism. Type inference remains possible and only in some clearly defined situations, a local type annotation is required. Qualified types are a general concept that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

HEART '23: Proceedings of the 13th International Symposium on Highly Efficient Accelerators and Reconfigurable Technologies

June 2023

127 pages

ISBN:9798400700439

DOI:10.1145/3597031

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Horizon 2020

Conference

HEART 2023

HEART 2023: The International Symposium on Highly Efficient Accelerators and Reconfigurable Technologies 2023

June 14 - 16, 2023

Kusatsu, Japan

Acceptance Rates

Overall Acceptance Rate 22 of 50 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
83
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)5

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bakas N(2024)Taylor Polynomials in a High Arithmetic Precision as Universal ApproximatorsComputation10.3390/computation1203005312:3(53)Online publication date: 7-Mar-2024
https://doi.org/10.3390/computation12030053
Pilato CBanik SBeránek JBrocheton FCastrillon JCevasco RCmar RCurzel SFerrandi FFriebel KGalizia AGrasso MSilva PMartinovic JPalermo GPaolino MParodi AParodi APintus FPolig RPoulet DRegazzoni FRinglein BRocco RSlaninova KSlooff TSoldavini SSuchert FTibaldi MWeiss BHagleitner C(2024)A System Development Kit for Big Data Applications on FPGA-based Clusters: The EVEREST Approach2024 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE58400.2024.10546518(1-6)Online publication date: 25-Mar-2024
https://doi.org/10.23919/DATE58400.2024.10546518

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents