CSC/ECE 506 Spring 2010/ch 2 maf

The Data Parallel Programming Model

Comparing the Data Parallel Model with the Shared Memory and Message Passing Models

Comparison between shared memory, message passing, and data parallel programming models (adapted from Solihin 2008).

Aspects	Shared Memory	Message Passing	Data Parallel
Communication	implicit (via loads/stores)	explicit messages	implicit
Synchronization	explicit	implicit (via messages)	implicit
Hardware support	typically required	none	required
Development effort	lower	higher	higher
Tuning effort	lower	higher