parallel programming paradigm

[Horatio B. Bogbindero]

i would just like to ask some question that have been bugging my mind:

-is the master-slave model for parallel programming the most frequently
used model?
-is SCALAPACK implemented as master-slave?
-is PETSc implemented as master-slave?
-does benchmark tests like LINPACK and HPL test for node-node or pairwise
bandwidth on all the nodes?

-was is the most commonly used non master-slave model being use by you?

thanks for your time. i am exploring the possibilities for different types
of parallel programming paradigms.

---------------------
willia...@ieee.org

"... all the modern inconveniences ..."
-- Mark Twain

_______________________________________________
Beowulf mailing list
Beo...@beowulf.org
http://www.beowulf.org/mailman/listinfo/beowulf

[Tony Skjellum]

See below.
-Tony

Anthony Skjellum, PhD, President (to...@mpi-softtech.com)
MPI Software Technology, Inc., Ste. 33, 101 S. Lafayette, Starkville, MS 39759
+1-(662)320-4300 x15; FAX: +1-(662)320-4301; http://www.mpi-softtech.com
"Best-of-breed Software for Beowulf and Easy-to-Own Commercial Clusters."

On Fri, 22 Sep 2000, Horatio B. Bogbindero wrote:

>
> i would just like to ask some question that have been bugging my mind:
>
> -is the master-slave model for parallel programming the most frequently
> used model?

It is hard to say, but these classes clearly exist
pure data parallel (like SCALAPACK, LINPACK, many parallel algorithms)
master slave model where slaves do DATA PARALLEL computations
master slave model where slaves do independent task parallel (or even
work in smaller groups on distinct tasks; each subgroup could be
data parallel for instance)
pure task parallel - lots of different stuff going on with lots of
heterogeneous communication

> -is SCALAPACK implemented as master-slave?

No, it is data parallel

> -is PETSc implemented as master-slave?

Most of the linear algebra in PETSc would be data parallel

> -does benchmark tests like LINPACK and HPL test for node-node or pairwise
> bandwidth on all the nodes?

LINPACK (and related HPL) test two things:
reductions of single real numbers
broadcasts of submatrices (single rows/columns and block row/columns)
They do not explicitly do node-to-node or pairwise, nor overlapping
of communication and computation

>
> -was is the most commonly used non master-slave model being use by you?

Data parallel is what most parallel libraries and many parallel programs
use: matrix-vector, matrix-matrix, LU, QR, data decomposition type
algorithms...