Explain data parallel programming, Computer Engineering

Assignment Help:

Q. Explain Data Parallel Programming?

In data parallel programming model major focus is on performing concurrent operations on a data set. The data set is characteristically organized in a common structure like an hypercube or array. Processors work together on the same data structure. But every task works on various partition of similar data structure. It is more restrictive since not all algorithms can be specified in data-parallel terms. For these reasons data parallelism, though significant isn't a universal parallel programming paradigm.

Programming with data parallel model is generally achieved by writing a program with the data parallel constructs. The constructs can be called to a compiler directives or else data parallel subroutine library. Data parallel languages offer facilities to indicate the data decomposition and mapping to the processors. The languages comprise data distribution statements that allow the programmer to control that data goes on what processor to minimize the amount of communication between processors. Directives signify how arrays are to be aligned and distributed over processors and therefore specify agglomeration and mapping. Communications operations aren't specified explicitly by programmer however are instead inferred by compiler from program. Data parallel languages are more appropriate for SIMD architecture although some languages for MIMD structure have also been designed. Data parallel approach is more effective for highly regular problems however isn't very effective for irregular problems.


Related Discussions:- Explain data parallel programming

Determine the operations from functions, Operations from Functions As ...

Operations from Functions As we know, function is actually operations on object. These   functions could be simple and summarized on object model. Organise functions into oper

Which is the slowest sorting procedure, The slowest sorting procedure is   ...

The slowest sorting procedure is    Bubble Sort is the slowest sorting process.

General concepts of links and association, General Concepts of links and as...

General Concepts of links and association A link is a conceptual or physical connection among objects for instance. Mathematically, you can define a link as a tuple which is a

What is library, What is library? A library is a collection of classes ...

What is library? A library is a collection of classes that are useful in most of the contexts. Classes must have accurate and thorough explanations to help users.

What are the functions of passes used in two-pass assembler, What are the f...

What are the functions of passes used in two-pass assembler? In an assembly language program, two pass translations can handle forward references early. The subsequent task

Adding momentum - sigmoid units, Adding Momentum - Sigmoid units: Howe...

Adding Momentum - Sigmoid units: However imagine a ball rolling down a hill as it does so then it gains momentum in which its speed increases and it becomes more difficult to

Naïve bayes algorithm for text classification, Assignment 3: Naïve Bayes al...

Assignment 3: Naïve Bayes algorithm for text classification. First part: In this assignment, we will redo the task of classifying documents (assignment 2) using the same R

What are the differences between struts and units, What are the differences...

What are the differences between struts and units?  A warm up question. Units are static objects that exist from the start of the simulation right up to its end, whereas struts

Online Library management system, Please help me to do mini Project about t...

Please help me to do mini Project about this by creating simple front and back end by using html and css and any programming language like python,php to connect those front end and

Define device interface, Define device interface. The buffer registers ...

Define device interface. The buffer registers DATAIN and DATAOUT and the status flags SIN and SOUT are part of circuitry commonly called as a device interface.

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd