Explain data parallel programming, Computer Engineering

Assignment Help:

Q. Explain Data Parallel Programming?

In data parallel programming model major focus is on performing concurrent operations on a data set. The data set is characteristically organized in a common structure like an hypercube or array. Processors work together on the same data structure. But every task works on various partition of similar data structure. It is more restrictive since not all algorithms can be specified in data-parallel terms. For these reasons data parallelism, though significant isn't a universal parallel programming paradigm.

Programming with data parallel model is generally achieved by writing a program with the data parallel constructs. The constructs can be called to a compiler directives or else data parallel subroutine library. Data parallel languages offer facilities to indicate the data decomposition and mapping to the processors. The languages comprise data distribution statements that allow the programmer to control that data goes on what processor to minimize the amount of communication between processors. Directives signify how arrays are to be aligned and distributed over processors and therefore specify agglomeration and mapping. Communications operations aren't specified explicitly by programmer however are instead inferred by compiler from program. Data parallel languages are more appropriate for SIMD architecture although some languages for MIMD structure have also been designed. Data parallel approach is more effective for highly regular problems however isn't very effective for irregular problems.


Related Discussions:- Explain data parallel programming

Optimal number of disks , John Lindsay sells disks that have 25 software pa...

John Lindsay sells disks that have 25 software packages that show a variety of financial functions, including net present value, internal rate of return, and other financial progra

Qwerty - keyboard layout, Q. QWERTY - Keyboard Layout ? A keyboard layo...

Q. QWERTY - Keyboard Layout ? A keyboard layout is arrangement of keys across the keyboard. There is one keyboard layout which anybody who has worked on a standard keyboard or

Higher order predicate logic, Higher Order Predicate Logic : In the v...

Higher Order Predicate Logic : In the very first order predicate logic, we are only allowed to quantify over objects. If we are considered to allow ourselves to quantify over

What are the page headers for secondary lists, What are the page headers fo...

What are the page headers for secondary lists? On secondary lists, the system does not show a standard page header and it does not trigger the event. TOP-OF-PAGE.  To make page

What is a c++ class, Class is a user-defined data type in C++. It can be fo...

Class is a user-defined data type in C++. It can be formed to solve a particular kind of problem. After creation the user require not know the specifics of the working of a class.

What are called stalls, What are called stalls? An alternative represen...

What are called stalls? An alternative representation of the operation of a pipeline in the case of a cache miss gives the function performed by every pipeline stage in each cl

Stencil duplicating, Stencil Duplicating Equipment Required Stenci...

Stencil Duplicating Equipment Required Stencil Duplicator Thermal copier (optional) Electronic stencil cutter Materials Stencil COPY paper Ink Clean

What is asynchronous transmission, What is asynchronous transmission An...

What is asynchronous transmission An asynchronous transmission technique used in many interactive terminals employ special bits. With this method each character consists of thr

Meaning of all variable, A project having of a set of jobs and a set of pre...

A project having of a set of jobs and a set of precedences, where precedence (i; j) show that job j cannot begin before job i is completed. Let c i be the duration of job i. We wi

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd