Explain data parallel programming, Computer Engineering

Assignment Help:

Q. Explain Data Parallel Programming?

In data parallel programming model major focus is on performing concurrent operations on a data set. The data set is characteristically organized in a common structure like an hypercube or array. Processors work together on the same data structure. But every task works on various partition of similar data structure. It is more restrictive since not all algorithms can be specified in data-parallel terms. For these reasons data parallelism, though significant isn't a universal parallel programming paradigm.

Programming with data parallel model is generally achieved by writing a program with the data parallel constructs. The constructs can be called to a compiler directives or else data parallel subroutine library. Data parallel languages offer facilities to indicate the data decomposition and mapping to the processors. The languages comprise data distribution statements that allow the programmer to control that data goes on what processor to minimize the amount of communication between processors. Directives signify how arrays are to be aligned and distributed over processors and therefore specify agglomeration and mapping. Communications operations aren't specified explicitly by programmer however are instead inferred by compiler from program. Data parallel languages are more appropriate for SIMD architecture although some languages for MIMD structure have also been designed. Data parallel approach is more effective for highly regular problems however isn't very effective for irregular problems.


Related Discussions:- Explain data parallel programming

Rhythm, Rhythm Rhythm in art refers to the way that your eye moves thr...

Rhythm Rhythm in art refers to the way that your eye moves through a picture and can be thought of in a similar way to rhythm in music. Your eye will move through some picture

Application of Theory of computation in DBMS, Sir/Mam, I want to know the a...

Sir/Mam, I want to know the application of Theory of computation in DBMS

Write statement, Rounding off of values can be carried out using the write ...

Rounding off of values can be carried out using the write statement. Yes, Rounding off value can be out by using the write statement.

Write the truth table for a clocked J-K flip-flop, Write the truth table fo...

Write the truth table for a clocked J-K flip-flop that is triggered by the positive-going edge of the clock signal. Ans. Logic diagram of JK flip flop Truth T

Emergence of computer network, Which Technologies of this age had tended to...

Which Technologies of this age had tended to the emergence of computer network? Ans: The technologies are Communication technology and Computer technology with the support of V

Explain meaning of each field format of icmp header, Give the format of ICM...

Give the format of ICMP header and explain meaning of each field. The format of ICMP header is given below: Internetwork Control Message Protocol (ICMP) ICMP H

Smtp vs esmtp, what shortcomings of smtp are over come by esmtp?

what shortcomings of smtp are over come by esmtp?

List the steps needed to perform page replacement, List the steps needed to...

List the steps needed to perform page replacement. The steps required to perform page replacement are: 1. Find out which page is to be removed from the memory. 2. Perfor

What do you mean by best fit, What do you mean by best fit?  Best fit a...

What do you mean by best fit?  Best fit allocates the smallest hole that is big enough. The whole list has to be searched, unless it is sorted by size. This method makes the sm

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd