[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article
Free access

Toward a dataflow/von Neumann hybrid architecture

Published: 17 May 1988 Publication History

Abstract

Dataflow architectures offer the ability to trade program level parallelism in order to overcome machine level latency. Dataflow further offers a uniform synchronization paradigm, representing one end of a spectrum wherein the unit of scheduling is a single instruction. At the opposite extreme are the von Neumann architectures which schedule on a task, or process, basis.
This paper examines the spectrum by proposing a new architecture which is a hybrid of dataflow and von Neumann organizations. The analysis attempts to discover those features of the dataflow architecture, lacking in a von Neumann machine, which are essential for tolerating latency and synchronization costs. These features are captured in the concept of a parallel machine language which can be grafted on top of an otherwise traditional von Neumann base. In such an architecture, the units of scheduling, called scheduling quanta, are bound at compile time rather than at instruction set design time. The parallel machine language supports this notion via a large synchronization name space.
A prototypical architecture is described, and results of simulation studies are presented. A comparison is made between the MIT Tagged-Token Dataflow machine and the subject machine which presents a model for understanding the cost of synchronization in a parallel environment.

References

[1]
Anderson, D. W., F. J. Sparacio, and R. M. Tomasulo. "The IBM System/360 Model 91: Machine Philosophy and Instruction-Handling". IBM Journal 11 (January 1967). 8-24.
[2]
Arvind, S. A. Brobst, and G. K. Maa. Evaluation of the MIT Taggcd- Token Dataflow Architecture. Computation Structures Group Memo 281, MIT, Laboratory for Computer Science, Cambridge, MA 02139, December, 1987.
[3]
Arvind and R. A. Iannucci. A Critique of Multiprocessing von Neumann Style. Proceedings of the lOti Annual International Symposium on Computer Architecture, June, 1983.
[4]
Arvind and R. A. lannucci. Two FundamentaI Issues in Multiprocessing. Proceedings of DFVLR - Conference 1987 on Parallel Processing in Science and Engineering, Bonn-Bad Godesberg, June, 1987.
[5]
Arvind, G. K. Maa, and D. E. Culler. Parallelism in Dataflow Programs. Computation Structures Group Memo 279, MIT, Laboratory for Computer Science, Cambridge, MA 02139. December, 1987.
[6]
Bit, L. A Process-Oriented Model for Efficient Execution of Dataflow Programs. Proc. of the 7ti International Conference on Distributed Computing, Berlin, West Germany, September, 1987.
[7]
Bouknight, W. J., S. A. Denenberg, D. E. Mcintyre, J. M. Randall, A. H. Sameh, and D. L. Slotnick. "The ILLIAC IV System". Proceedings of the IEEE 60,4 (April 1972).
[8]
Buehrer. R. and K. Ekanadham. "Incorporating Data Flow Ideas into von Neumann Processors for Parallel Execution". IEEE Transactions on Computers C-36,12 (December 1987), 15151522.
[9]
Cox, G. W., W. M. Corwin, K. K. Lai, and F. J. Pollack. "Interprocess Communication and Processor Dispatching on the Intel 432". ACM Transactions on Computer Systems 1, 1 (February 1983), 45-66.
[10]
Culler, D. E. Resource Management for the Tagged-Token Dataflow Architecture - SM. Thesis. Technical Report 332, MIT, Laboratory for Computer Science, Cambridge, MA 02139, January, 1985.
[11]
CuIler, D. E. and Arvind. Resource Requirements of Dataflow Programs. Proceedings of the 15" Annual International Symposium on Computer Architecture, IEEE Computer Society, Honolulu, Hawaii, June, 1988.
[12]
Deminet, J. "Experience with Multiprocessor Algorithms". IEEE Transactions on Computers C-31.4 (April 1982). 278-288.
[13]
Ekanadham, K. Multi-Tasking on a Dataflow-like Architecture. Tech. Rept. RC 12307, IBM T. J. Watson Research Laboratory, Yorktown Heights, NY, November, 1986.
[14]
Ekanadham, K., Arvind, and D. E. Culler. The Price of Parallelism. Computation Structures Group Memo 278, MIT, Laboratory for Computer Science, Cambridge, MA 02139, November, 1987.
[15]
Fisher, J. A. Very Long Instruction Word Architectures and the ELI-512. Proc. of the IO*, International Symposium on Computer Architecture, IEEE Computer Society, June, 1983.
[16]
Halstead, R. H., Jr. "MultiLisp: A Language for Concurrent Symbolic Computation". ACM Transactions on Programming Languages and Systems 7.4 (October 1985). 501-538.
[17]
Halstead, R. H., Jr., and T. Fujita. MASA: A Multithreaded Processor Architecture for Parallel Symbolic Computing. Proceedings of the 15" Annual International Symposium on Computer Architecture, IEEE Computer Society, Honolulu, Hawaii, June, 1988.
[18]
Heller, S. K. An I-Structure Memory Controller (ISMC). MIT Department of Electrical Engineering and Computer Science, Cambridge, MA 02139, JUNE, 1983.
[19]
Heller, S. K. and Arvind. Design of a Memory Controller for the MIT Tagged-Token Dataflow Machine. Computation Structures Group Memo 230, MIT. Laboratory for Computer Science, Cambridge, MA 02139, October, 1983. Proceedings of lEEE ICCD '83 Port Chester, NY.
[20]
Hennessey. I. L. "VLSI Processor Architecture". IEEE Transacfions on Computers C-33,12 (December 1984), 1221-1246.
[21]
Iannucci, R. A. ADataf7ow I von Neuamnn Hybrid Architecture. Ph.Th., MIT Department of Electrical Engineering and Computer Science, May 1988.
[22]
Jordan, H. F. Performance Measurement on HEP - A Pipelined MIMD Computer. Proceedings of the 10th Annual International Symposium On Computer Architecture, Stockholm, Sweden, June, 1983, pp. 207-212.
[23]
Kuck, D., E. Davidson, D. Lawrie, and A. Sameh. "Parallel Supercomputing Today and the Cedar Approach". Science Magazine 231 (February 1986), 967-974.
[24]
Papadopoulos, G. M. Implementation of a General Purpose Dataflow Multiprocessor. Ph.D. Th., MIT Department of Electrical Engineering and Computer Science, May 1988.
[25]
Patterson, D. A. "Reduced Instruction Set Computers", Communications of the ACM 28,l (January 1985), 8-21.
[26]
Radin, G. The 801 Minicomputer. Proceedings of the Symposium on Architectural Support for Programming Languages and Operating Systems, ACM, March, 1982. Same as Computer Architecture News 10,2 and SIGPLAN Notices 17,4.
[27]
Rau, B., D. Glaeser, and E. Greenwalt Architectural Support for the Efficient Generation of Code for Horizontal Architectures. Proceedings the Symposium on Architectural Support for Programming Languages and Operating Systems, March, 1982. Same as Computer Architecture News 10,2 and SIGPLAN Notices 17.4.
[28]
Russell, R. M. "The CRAY-1 Computer System". Communications of the ACM 21.1 (January 1978), 63-72.
[29]
Sarkar, V., and J. Hennessy. Partitioning Parallel Programs for Macro Dataflow. Proceedings of the ACM Conference on Lisp and Functional Programming, ACM, August, 1986. pp. 202-211.
[30]
Smith, B. J. A Pipelined, Shared Resource MIMD Computer. Proceedings of the 1978 International Conference on Parallel Processing, 1978, pp. 6-8.
[31]
Tomasulo, R. M. "An Efficient Algorithm for Exploiting Multiple Arithmetic Units". IBM Journal 11 (January 1967). 25-33.
[32]
Traub, K. R. A Compiler for the MIT Tagged-Token Dataflow Architecture - SM. Thesis. TcchnicaI Report 370, MIT, Laboratory for Computer Science, Cambridge, MA 02139, August, 1986.
[33]
Traub, K. R. Sequential Implementation of Lenient Programming Languages. Ph.D. Th., MIT Department of Electrical Engineering and Computer Science, May 1988.

Cited By

View all
  • (2024)Synaptic Plasticity Modulation of Neuromorphic Transistors through Phosphorus Concentration in Phosphosilicate Glass Electrolyte GateNanomaterials10.3390/nano1402020314:2(203)Online publication date: 16-Jan-2024
  • (2024)Enhancement of the Synaptic Performance of Phosphorus-Enriched, Electric Double-Layer, Thin-Film TransistorsElectronics10.3390/electronics1304073713:4(737)Online publication date: 11-Feb-2024
  • (2024)Compliance-Free and Forming-Free Digital and Analog Resistive Switching in a Perovskite-Based Artificial Synaptic Device: Mimicking Classical Pavlovian LearningACS Applied Electronic Materials10.1021/acsaelm.4c003616:5(3676-3687)Online publication date: 30-Apr-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGARCH Computer Architecture News
ACM SIGARCH Computer Architecture News  Volume 16, Issue 2
Special Issue: Proceedings of the 15th annual international symposium on Computer Architecture
May 1988
431 pages
ISSN:0163-5964
DOI:10.1145/633625
Issue’s Table of Contents
  • cover image ACM Conferences
    ISCA '88: Proceedings of the 15th Annual International Symposium on Computer architecture
    June 1988
    461 pages
    ISBN:0818608617

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 May 1988
Published in SIGARCH Volume 16, Issue 2

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)297
  • Downloads (Last 6 weeks)33
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Synaptic Plasticity Modulation of Neuromorphic Transistors through Phosphorus Concentration in Phosphosilicate Glass Electrolyte GateNanomaterials10.3390/nano1402020314:2(203)Online publication date: 16-Jan-2024
  • (2024)Enhancement of the Synaptic Performance of Phosphorus-Enriched, Electric Double-Layer, Thin-Film TransistorsElectronics10.3390/electronics1304073713:4(737)Online publication date: 11-Feb-2024
  • (2024)Compliance-Free and Forming-Free Digital and Analog Resistive Switching in a Perovskite-Based Artificial Synaptic Device: Mimicking Classical Pavlovian LearningACS Applied Electronic Materials10.1021/acsaelm.4c003616:5(3676-3687)Online publication date: 30-Apr-2024
  • (2023)Epitaxial growth of NbN thin films for electrodes using atomic layer depositionApplied Surface Science10.1016/j.apsusc.2023.157824636(157824)Online publication date: Nov-2023
  • (2023)An Overview of Computation-in-Memory (CIM) ArchitecturesDesign and Applications of Emerging Computer Systems10.1007/978-3-031-42478-6_2(31-65)Online publication date: 17-Aug-2023
  • (2022) Toward Advanced High‐ k and Electrode Thin Films for DRAM Capacitors via Atomic Layer Deposition Advanced Materials Technologies10.1002/admt.202200878Online publication date: 26-Oct-2022
  • (2020)A Software MTD Technique of Multipath Execution Protection2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE)10.1109/ICISCAE51034.2020.9236800(489-496)Online publication date: 27-Sep-2020
  • (2020)Highly Transparent Solid-State Artificial Synapse based on Oxide MemristorApplied Surface Science10.1016/j.apsusc.2020.147738(147738)Online publication date: Sep-2020
  • (2017)Parallel Turing Machine, a ProposalJournal of Computer Science and Technology10.1007/s11390-017-1721-332:2(269-285)Online publication date: 13-Mar-2017
  • (2016)Advances in High Performance Computing and Related IssuesMathematical Problems in Engineering10.1155/2016/26323062016(1-3)Online publication date: 2016
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media