10 - Parallel 2

Question 1

Considerations of parallel program design

Answer 1

Partitioning
Communication
Synchronisation
Load Balancing

Question 2

Parallelisation: Task vs Data

What does each separate?

Answer 2

Task separates the processes
Data separates the data into batches instead

Question 3

PCAM: 1. Partitioning

Answer 3

Decompose problem into small parallel subtasks

Question 4

PCAM: 2. Communication

Answer 4

Determine required comms

Question 5

PCAM: 3. Agglomeration

Answer 5

Combine subtasks into larger tasks

Question 6

PCAM: 4. Mapping

Answer 6

Assign agglomerated tasks to processes/threads