[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
The Complexity of Parallel ComputationsAugust 1979
1979 Technical Report
Publisher:
  • Cornell University
  • PO Box 250, 124 Roberts Place Ithaca, NY
  • United States
Published:01 August 1979
Reflects downloads up to 05 Jan 2025Bibliometrics
Skip Abstract Section
Abstract

Recent advances in microelectronics have brought closer to feasibility the construction of computers containing thousands (or more) of processing elements. This thesis addresses the question of effective utilization of such processing power. We study the computational complexity of synchronous paarallel computations using a model of computation based on random access machines operating in parallel and sharing a common memory, the P-RAM. Two main areas within the field of parallel computational complexity are investigated. First, we explore the power of the P-RAM model viewed as an abstract computing device. Later, we study techniques for developing efficient algorithms for parallel computers. We are able to give concise characterizations of the power of deterministic and nondeterministic P-RAMS in terms of the more widely known space and time complexity classes for multi-tape Turing machines. Roughly speaking, time-bounded deterministic P-RAMS are equivalent in power to (can accept the same sets as) space-bounded Turing machines, where the time and space bounds differ by at most a polynomial. In the context of comparing models of computation, we consider such polynomial differences in resources to be insignificant. Adding the feature of nondeterminism to the time-bounded P-RAM changes its power to that of a nondeterministic Turing machine with an exponentially higher running time. The later sections of the thesis examine algorithm design techniques for parallel computers. We first develop efficient procedures for some common operations on linked lists and arrays. Given this background, we introduce three techniques that permit the design of parallel algorithms that are efficient in terms of both their time and processor requirements. We illustrate the use of these techniques by presenting time and processor efficient algorithms for three problems, in each case improving upon the best previously known parallel resource bounds. We show how to compute minimum string edit distances, using the technique of pairwise function composition. We describe an algorithm for the off-line MIN that organizes its computation in the form of a complete binary tree. Finally, we present an algorithm for undirected graph connectivity that relies on redundancy in its representation of the input graph.

Cited By

  1. ACM
    Bloemen V, Laarman A and van de Pol J (2016). Multi-core on-the-fly SCC decomposition, ACM SIGPLAN Notices, 51:8, (1-12), Online publication date: 9-Nov-2016.
  2. ACM
    Bloemen V, Laarman A and van de Pol J Multi-core on-the-fly SCC decomposition Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, (1-12)
  3. Yan D, Cheng J, Xing K, Lu Y, Ng W and Bu Y (2014). Pregel algorithms for graph connectivity problems with performance guarantees, Proceedings of the VLDB Endowment, 7:14, (1821-1832), Online publication date: 1-Oct-2014.
  4. Han Y and He X More efficient parallel integer sorting Proceedings of the 6th international Frontiers in Algorithmics, and Proceedings of the 8th international conference on Algorithmic Aspects in Information and Management, (279-290)
  5. Blelloch G and Maggs B Parallel algorithms Algorithms and theory of computation handbook, (25-25)
  6. Nishimura S and Ohori A (2019). Parallel functional programming on recursively defined data via data-parallel recursion, Journal of Functional Programming, 9:4, (427-462), Online publication date: 1-Jul-1999.
  7. Han Y and Shen X Parallel integer sorting is more efficient than parallel comparison sorting on exclusive write PRAMs Proceedings of the tenth annual ACM-SIAM symposium on Discrete algorithms, (419-428)
  8. Reid-Miller M (2019). List Ranking and List Scan on the CRAYC90, Journal of Computer and System Sciences, 53:3, (344-356), Online publication date: 1-Dec-1996.
  9. ACM
    Gupta R, Smolka S and Bhaskar S (1994). On randomization in sequential and distributed algorithms, ACM Computing Surveys (CSUR), 26:1, (7-86), Online publication date: 1-Mar-1994.
  10. Blelloch G (2019). Scans as Primitive Parallel Operations, IEEE Transactions on Computers, 38:11, (1526-1538), Online publication date: 1-Nov-1989.
  11. ACM
    Philips C Parallel graph contraction Proceedings of the first annual ACM symposium on Parallel algorithms and architectures, (148-157)
  12. ACM
    Cole R and Zajicek O The APRAM: incorporating asynchrony into the PRAM model Proceedings of the first annual ACM symposium on Parallel algorithms and architectures, (169-178)
  13. ACM
    Han Y Matching partition a linked list and its optimization Proceedings of the first annual ACM symposium on Parallel algorithms and architectures, (246-253)
  14. ACM
    Han Y An optimal linked list prefix algorithms on a local memory computer Proceedings of the 17th conference on ACM Annual Computer Science Conference, (278-286)
  15. ACM
    Cole R and Vishkin U Deterministic coin tossing and accelerating cascades: micro and macro techniques for designing parallel algorithms Proceedings of the eighteenth annual ACM symposium on Theory of computing, (206-219)
  16. ACM
    Vishkin U Randomized speed-ups in parallel computation Proceedings of the sixteenth annual ACM symposium on Theory of computing, (230-239)
Contributors
  • IBM Research - Almaden
Please enable JavaScript to view thecomments powered by Disqus.

Recommendations