CSC/ECE 506 Fall 2007/wiki1 6 r8e: Difference between revisions

From Expertiza_Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
== Background ==
== Communication Architecture Background ==
Parallel computer architecture has come a long way since parallel computing first began.


=== Communication Architecture ===
== Three Parallel Programming Models ==
 
=== Three Parallel Programming Models ===
Many parallel programming models exist, however the most common are described below.
Many parallel programming models exist, however the most common are described below.


==== Shared Address Space ====
=== Shared Address Space ===
Shared address space programming can be understood best when related to a message or bulletin board.  Anyone can post a message on this board, and anyone can read what others have written.  The key to the shared address space model is the fact that all of the vital information is posted in shared locations that can be accessed by all.
Shared address space programming can be understood best when related to a message or bulletin board.  Anyone can post a message on this board, and anyone can read what others have written.  The key to the shared address space model is the fact that all of the vital information is posted in shared locations that can be accessed by all.


==== Message Passing ====
=== Message Passing ===
Message passing machines convey information in a way similar to that of a phone call or a letter.  There are very specific events that trigger the movement of information from a unique sender to a unique receiver.   
Message passing machines convey information in a way similar to that of a phone call or a letter.  There are very specific events that trigger the movement of information from a unique sender to a unique receiver.   


==== Data Parallel ====
=== Data Parallel ===
Data parallel programming is by far the most regulated of the three parallel programming models.  In this type of programming work is carried out on different elements of a data set by different operators.  Once all operations are finished information is exchanged among all, basically after the work is done a "global reorganization of data" is carried out.
Data parallel programming is by far the most regulated of the three parallel programming models.  In this type of programming work is carried out on different elements of a data set by different operators.  Once all operations are finished information is exchanged among all, basically after the work is done a "global reorganization of data" is carried out.

Revision as of 21:38, 5 September 2007

Communication Architecture Background

Three Parallel Programming Models

Many parallel programming models exist, however the most common are described below.

Shared Address Space

Shared address space programming can be understood best when related to a message or bulletin board. Anyone can post a message on this board, and anyone can read what others have written. The key to the shared address space model is the fact that all of the vital information is posted in shared locations that can be accessed by all.

Message Passing

Message passing machines convey information in a way similar to that of a phone call or a letter. There are very specific events that trigger the movement of information from a unique sender to a unique receiver.

Data Parallel

Data parallel programming is by far the most regulated of the three parallel programming models. In this type of programming work is carried out on different elements of a data set by different operators. Once all operations are finished information is exchanged among all, basically after the work is done a "global reorganization of data" is carried out.