Explain data parallel programming, Computer Engineering

Assignment Help:

Q. Explain Data Parallel Programming?

In data parallel programming model major focus is on performing concurrent operations on a data set. The data set is characteristically organized in a common structure like an hypercube or array. Processors work together on the same data structure. But every task works on various partition of similar data structure. It is more restrictive since not all algorithms can be specified in data-parallel terms. For these reasons data parallelism, though significant isn't a universal parallel programming paradigm.

Programming with data parallel model is generally achieved by writing a program with the data parallel constructs. The constructs can be called to a compiler directives or else data parallel subroutine library. Data parallel languages offer facilities to indicate the data decomposition and mapping to the processors. The languages comprise data distribution statements that allow the programmer to control that data goes on what processor to minimize the amount of communication between processors. Directives signify how arrays are to be aligned and distributed over processors and therefore specify agglomeration and mapping. Communications operations aren't specified explicitly by programmer however are instead inferred by compiler from program. Data parallel languages are more appropriate for SIMD architecture although some languages for MIMD structure have also been designed. Data parallel approach is more effective for highly regular problems however isn't very effective for irregular problems.


Related Discussions:- Explain data parallel programming

Define various system, Define various system? Single job system: Only...

Define various system? Single job system: Only one program may be run at a time, and therefore only one person might be work on a machine at one time.  Multi job system:

Describe miscellaneous and privileged instructions, Q. Describe Miscellaneo...

Q. Describe Miscellaneous and Privileged Instructions? These instructions don't fit in any of above categories. I/O instructions: start I/O, stop I/O, and test I/O. Characteris

Gantt chart, The Gantt chart shows the several activities of each processor...

The Gantt chart shows the several activities of each processor with respect to progress in time in idle-overhead -busy modes with respect to each processor. Kiviat diagram:  Th

What is the function of a data element, What is the function of a data elem...

What is the function of a data element? A data element defines the role played by a domain in a technical context.  A data element having of semantic information.

Subtract two number by using 1's complement, Subtract the given number usin...

Subtract the given number using 1's complement 11011 - 11001 Ans. 11011 - 11001 = X - Y                             X =    11011  1's complement of Y =    00110

State the term- use a define function, State the term- Use a define functio...

State the term- Use a define function This is almost exactly the same approach as #define and -D compiler arg that C programs use. In your  Verilog  code,  use  a  'define  to

Give brief description about arithmetic processing unit, Give brief descrip...

Give brief description about arithmetic processing unit To execute the arithmetic operations there is a separate section known as arithmetic processing unit in CPU. The arithme

Excess 3 codes, Explain Excess 3 Codes Ans. Excess 3 Codes 1....

Explain Excess 3 Codes Ans. Excess 3 Codes 1. This is the other form of BCD code. All decimal digits are coded in 4 bit binary code. 2. The code for all decimal di

Enumerate the process of dynamic modelling:, Define the Process of dynamic ...

Define the Process of dynamic modelling: Analyse applicability of actions Recognize object states Create dynamic model diagram Express every state in terms o

Determine about the memory stack, Memory Stack Stack could exist as a s...

Memory Stack Stack could exist as a stand-alone unit or could be executed in a random-access memory attached to the CPU. The implementation of a stack in a CPU is done by assig

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd