Task / Data Parallelism

How to sort data in parallel...

Task Parallelism
All the data to all the processes
Need for separate codes
No data splitting
No need for central histogram server
Load balancing difficult

Data Parallelism
Split data to each process
Same code for all the processes
Need to split the data as it's received
Need for a central histogram server
"Automatic" load balancing 

Needs more investigation...