Active Messages: A Mechanism for Integrated Communication and Computation

 

In Proceedings of the 19th International Symposium on Computer Architecture (ISCA)

Thorsten von Eicken, David E. Culler, Seth Copen Goldstein, and Klaus Erik Schauser

pages 430–440, Gold Coast, Australia

May 1990

Abstract


download pdf


@inproceedings{voneicken-isca92,
  author = {von~Eicken, Thorsten and Culler, David E. and Goldstein,
     Seth Copen and Schauser, Klaus Erik},
  title = {{Active Messages}: A Mechanism for Integrated Communication
     and Computation},
  month = {May},
  booktitle = {Proceedings of the 19th International Symposium on
     Computer Architecture (ISCA)},
  address = {Gold Coast, Australia},
  pages = {430--440},
  year = {1992},
  url = {http://www.cs.cmu.edu/~seth/papers/voneicken-isca92.pdf},
  abstract = {The design challenge for large-scale multiprocessors is
     (1) to minimize communication overhead, (2) allow communication
     to overlap computation, and (3) coordinate the two without
     sacrificing processor cost/performance. We show that existing
     message passing multiprocessors have unnecessarily high
     communication costs. Research prototypes of message driven
     machines demonstrate low communication overhead, but poor
     processor cost/performance. We introduce a simple communication
     mechanism, {\em Active Messages}, show that it is intrinsic to
     both architectures, allows cost effective use of the hardware,
     and offers tremendous flexibility. Implementations on nCUBE/2 and
     CM-5 are described and evaluated using a split-phase
     shared-memory extension to C, {\em Split-C}. We further show that
     active messages are sufficient to implement the dynamically
     scheduled languages for which message driven machines were
     designed. With this mechanism, latency tolerance becomes a
     programming/compiling concern. Hardware support for active
     messages is desirable and we outline a range of enhancements to
     mainstream processors.},
  keywords = {Active Messages, Parallel Computing},
}

Related Papers

Parallel Computing
Brain in a Bottle
Seth Copen Goldstein. In Wild and Crazy Ideas Session of ASPLOS, Oct 1990.
The Lazy Multithreaded Implementation Design Space
Seth Copen Goldstein and David E. Culler. In The Yale Multithreaded Workshop, Jun 1990.
Lazy Threads Compiler and Runtime Structures for Fine-Grained Parallel Programming
Seth Copen Goldstein. PhD Thesis, University of California--Berkeley, 1990.
Lazy threads: implementing a fast parallel call
Seth Copen Goldstein, Klaus Erik Schauser, and David E. Culler. Journal of Parallel and Distributed Computing, 37(1):5–20, 1990.
Enabling Primitives for Compiling Parallel Languages
Seth Copen Goldstein, David E. Culler, and Klaus Erik Schauser. In Third Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers, May 1990.
How Much Non-Strictness Do Lenient Programs Require?
Klaus Erik Schauser and Seth Copen Goldstein. In Conference on Functional Programming Languages and Computer Architecture, Jun 1990.
Introduction to Split-C
David E. Culler, Andrea Dusseau, Seth Copen Goldstein, Arvind Krishnamurthy, Steven Lumetta, Thorsten von Eicken, and Katherine Yelick. University of California--Berkeley Technical Report, Apr 1990.
NIFDY: A Low Overhead, High Throughput Network Interface
Timothy J Callahan and Seth Copen Goldstein. In Proceedings of the 22nd International Symposium on Computer Architecture, Jun 1990.
Separation Constraint Partitioning --- A New Algorithm for Partitioning non-Strict Programs Into Sequential Threads
Klaus Erik Schauser, David E. Culler, and Seth Copen Goldstein. In Proceedings of the Principles of Programming Languages, Jan 1990.
Lazy Threads, Stacklets, and Synchronizers: Enabling primitives for compiling parallel languages
Seth Copen Goldstein, David E. Culler, and Klaus Erik Schauser. University of California at Berkeley Technical Report, 1990.
Active Messages: A Communication Foundation for Parallel Programming Models
Seth Copen Goldstein. CM-5 Users Group, Feb 1990.
The Implementation of a Threaded Abstract Machine
Seth Copen Goldstein. Master's Thesis, University of California at Berkeley, May 1990. Also appeared as UC-Berkeley Technical Report UCB/CSD-94-818.
Parallel Programming in Split-C
David E. Culler, Andrea Dusseau, Seth Copen Goldstein, Arvind Krishnamurthy, Steven Lumetta, Thorsten von Eicken, and Katherine Yelick. In Proceedings of the Supercomputing '93 Conference, pages 262–273, Nov 1990.
Evaluation of Mechanisms for Fine-Grained Parallel Programs in the J-Machine and the CM-5
Ellen Spertus, Seth Copen Goldstein, Klaus Erik Schauser, Thorsten von Eicken, David E. Culler, and William J. Dally. In Proceedings of the 20th International Symposium on Computer Architecture (ISCA), May 1990.
TAM --- a compiler controlled threaded abstract machine
David E. Culler, Seth Copen Goldstein, Klaus Erik Schauser, and Thorsten von Eicken. Journal of Parallel and Distributed Computing, volume 18, pages 347–370, Jul 1990.
Studying Dynamic Program Behavior `In the Large'
Seth Copen Goldstein. In ID Workshop, Nov 1990.
Supporting Implicitly Parallel Languages
Seth Copen Goldstein. In 14th Annual Industrial Liaison Program Conference, Mar 1990.
Active Messages: A Mechanism for Integrated Communication and Computation
Thorsten von Eicken, David E. Culler, Seth Copen Goldstein, and Klaus Erik Schauser. In Proceedings of the 19th International Symposium on Computer Architecture (ISCA), pages 430–440, May 1990.
Empirical Study of a Dataflow Language on the CM-5
David E. Culler, Seth Copen Goldstein, Klaus Erik Schauser, and Thorsten von Eicken. In Proc. of the Dataflow Workshop, 19th Int'l Symposium on Computer Architecture, pages 187–210, May 1990.
Hardware-Assisted Replay of Multiprocessor Programs
David F. Bacon and Seth Copen Goldstein. In Proceedings of the ACM/ONR Workshop on Parallel and Distributed Debugging, May 1990.
Active Messages
Active Messages: A Communication Foundation for Parallel Programming Models
Seth Copen Goldstein. CM-5 Users Group, Feb 1990.
Parallel Programming in Split-C
David E. Culler, Andrea Dusseau, Seth Copen Goldstein, Arvind Krishnamurthy, Steven Lumetta, Thorsten von Eicken, and Katherine Yelick. In Proceedings of the Supercomputing '93 Conference, pages 262–273, Nov 1990.
Evaluation of Mechanisms for Fine-Grained Parallel Programs in the J-Machine and the CM-5
Ellen Spertus, Seth Copen Goldstein, Klaus Erik Schauser, Thorsten von Eicken, David E. Culler, and William J. Dally. In Proceedings of the 20th International Symposium on Computer Architecture (ISCA), May 1990.
TAM --- a compiler controlled threaded abstract machine
David E. Culler, Seth Copen Goldstein, Klaus Erik Schauser, and Thorsten von Eicken. Journal of Parallel and Distributed Computing, volume 18, pages 347–370, Jul 1990.
Active Messages: A Mechanism for Integrated Communication and Computation
Thorsten von Eicken, David E. Culler, Seth Copen Goldstein, and Klaus Erik Schauser. In Proceedings of the 19th International Symposium on Computer Architecture (ISCA), pages 430–440, May 1990.


Back to publications list