Explain data parallel programming, Computer Engineering

Assignment Help:

Q. Explain Data Parallel Programming?

In data parallel programming model major focus is on performing concurrent operations on a data set. The data set is characteristically organized in a common structure like an hypercube or array. Processors work together on the same data structure. But every task works on various partition of similar data structure. It is more restrictive since not all algorithms can be specified in data-parallel terms. For these reasons data parallelism, though significant isn't a universal parallel programming paradigm.

Programming with data parallel model is generally achieved by writing a program with the data parallel constructs. The constructs can be called to a compiler directives or else data parallel subroutine library. Data parallel languages offer facilities to indicate the data decomposition and mapping to the processors. The languages comprise data distribution statements that allow the programmer to control that data goes on what processor to minimize the amount of communication between processors. Directives signify how arrays are to be aligned and distributed over processors and therefore specify agglomeration and mapping. Communications operations aren't specified explicitly by programmer however are instead inferred by compiler from program. Data parallel languages are more appropriate for SIMD architecture although some languages for MIMD structure have also been designed. Data parallel approach is more effective for highly regular problems however isn't very effective for irregular problems.


Related Discussions:- Explain data parallel programming

Processor, what is the difference between i5 and i7 processor?

what is the difference between i5 and i7 processor?

Animation for project, Final Animation This is the final piece of work ...

Final Animation This is the final piece of work that should stand on its own as a piece of Art or Design. This is your personal response to the idea of Transformation - The pro

What is concurrent control, What is concurrent control? Control resides...

What is concurrent control? Control resides concurrently in various independent objects, every a separate task. A task can wait for input but other task continues implementatio

Shared memory and distributed memory, Shared Memory Refers to the memor...

Shared Memory Refers to the memory part of a computer system in which the memory can processed directly by any of the processors in the system. Distributed Memory Refer

Avoiding local minima, Avoiding Local Minima: However the error rate o...

Avoiding Local Minima: However the error rate of multi-layered networks over a training set could be calculated as the number of mis-classified examples. So always keep in rem

What is pipelining, What is pipelining? It is a method of decomposing a...

What is pipelining? It is a method of decomposing a sequential process into sub-operations, with each sub-process being implemented in a special dedicated segment that operates

Explain technical reasons which made microsoft withdraw, Explain technical ...

Explain technical reasons which made Microsoft withdraw its support for VBA in Mac? Ans) The reasons which made Microsoft drop its carry to VBA are as follows, Microsoft visual

Explain types of assembly programs, Q. Explain types of assembly programs? ...

Q. Explain types of assembly programs? Assembly language programs can be written in two manners: COM Program: Having all segments as part of one segment EXE Program: that hav

Binary equivalent of the decimal number 368 , What is the binary equivalent...

What is the binary equivalent of the decimal number 368 ? Ans. 101110000 is the Binary equivalent of the Decimal number 368. From Decimal number to Binary number conversioni

Find resolution & volts of a 2-digit BCD D/A converter, A 2-digit BCD D/A c...

A 2-digit BCD D/A converter is a weighted resistor type with E R = 1 Volt, with R = 1M? , R f = 10K? . Find resolution in Percent and Volts. Ans. Resolution = 1/2 2 = 0.25 vo

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd