What are the detailed characteristics of the data

Reference no: EM132212155

Assignment -

MAIN OBJECTIVE OF THE ASSESSMENT - In this assessment, you are required to demonstrate the appropriate practical skills and abilities to implement solutions using modern large-scale data storage and processing infrastructures, and to critically reflect on the concepts, theory and use of high performance computational infrastructures.

A written report including the theory behind and the development of the individual project needs to be submitted.

The coursework will be marked for 4 main criteria:

1. Demonstrating an understanding of the relevant theory underpinning distributed file systems & data analysis.

2. Identifying a real data analytics problem with strong motivation for using distributed processing methods.

3. Implementing and applying a working solution using distributed analytical techniques.

4. Critically evaluating the results of the implementation on the data with a discussion of how the approach is different from standard non-distributed methods (e.g. relational databased, serial data-mining).

Question -

What are the detailed characteristics of the data (use summary statistics to explain)?

What algorithms exist for solving such a problem - distributed or not?

How can MapReduce be used to solve the problem?

What are the details of your implementation - annotated code and description of experiments?

Documentation of the execution of the code, e.g. time efficiency.

Documentation of the results, e.g. charts, graphs, sample outputs.

What do the results tell you about the use of MapReduce compared to other techniques?

Discussion of the results: Were they a success?

If not why not? If they were, how could they be improved?

What would you have done differently with hindsight?

What other approaches / algorithms / implementations could be explored beyond MapReduce?

Attachment:- Assignment Files.rar

Reference no: EM132212155

Questions Cloud

Apply ethical theory covered within the unit reading : Apply an ethical theory covered within the unit reading or in previous units to justify your course of action for resolving the issue.

Research the growth opportunities in the industry : Research the growth opportunities in the industry, competitive strategies that were employed, typical customers, and other relevant information related.

Display every third number starting from 1 : Write Python code that opens a file called numbers.txt for writing. Use a loop to write the numbers from 1 through 30 to the file, and close the file.

Calculate the amount of money a person would earn : Design a program that calculates the amount of money a person would earn over a period of time if his or her salary is one peeny the first day.

What are the detailed characteristics of the data : What are the detailed characteristics of the data (use summary statistics to explain)? How can MapReduce be used to solve the problem

Write a python 3 program-containing 2 functions : Create a FUNCTION called createMenu that creates a STRING which will produce the following output when printed by the main program.

Define mechanisms were in-place to protect against intrusion : Search "scholar.google.com" for a company, school, or person that has been the target of a network or system intrusion? What information was targeted?

Evaluate the expression and print the result : For this assignment you will read a file expression.txt and create an expression tree. Evaluate the expression and print the result.

Implement euclids extended algorithm : Write PYTHON code which implements Euclid's Extended Algorithm. A sample run of the program would look.

Reviews

len2212155

1/10/2019 1:47:29 AM

I attracted file “who_suicide_statistics.csv”. I need you to use MAP REDUCE in HADOOP to play with dataset that I attracted by finding number of suicide in male and female, suicide age’s group, suicide in each year top 10 suicide country, comparison between suicide rate and population in each country and year [top5] and also answer the question above.

Write a Review

Required(*) Message

User Account

All Pages