Description of any other ecosystem or additional tools

Assignment Help Other Engineering

Reference no: EM131305492

Project Proposal -

Objectives: To get more familiar with the Hadoop Ecosystem (Spark specifically) and Scala Programming.

Resources: Files of tweets about election

Project Topic: The election of 2016 seems to be a very controversial one. The topics about both camps just keeps increasing. Both camps were trying their best to gain as many votes as possible. As for voters, they have expressed their opinion online as well. The purpose of this project is to find the hash tags about the election of 2016 and find what's the hottest trending across the specific period.

Feedback from instructor: xxx,

This is an OK start, but you will need to go far beyond just looking at hashtags in tweets, since that is comparable to a homework assignment, and the project should be 10 times as big.

The tweets are in: hadoopfs -ls /ss/json/*

Final Paper Requirements

10-15 page paper (+ code)
Due on last day of class, hardcopy
Should cover
data source
data description and schema
data pre-processing required (parsing, filtering, etc.)
any bad data issues
your Spark algorithm
description of any other ecosystem or additional tools
output description
how did you verify that your output is correct?
performance/scale characteristics
what would you have done differently if you did this again?
conclusions.

Reference no: EM131305492

Questions Cloud

Primary market for a bond and the secondary market : What is the difference between the primary market for a bond and the secondary market?- Briefly explain why yields to maturity and bond prices move in opposite directions.

What is the difference between an investor and a trader : What is the difference between an investor and a trader?- What is financial arbitrage?- If a coupon bond has a face value of $1,000, I don't understand why anyone who owns the bond would sell it for less than $1,000.

Describe the structure of the confederation : Describe the structure of the Confederation, and what powers May held anti what powers were with held from them. Explain the weaknesses of the Confederation (notice the word explain, tlo not simply list Me weakness, explain them). Analyze Thomas Jef..

What is the probability that there is at least one sphere : A dilute suspension contains ten spheres per liter. A sample (one tenth of that solution) is removed.

Description of any other ecosystem or additional tools : Project Topic: The election of 2016 seems to be a very controversial one. The topics about both camps just keeps increasing. Both camps were trying their best to gain as many votes as possible

What was the bonds current yield : A maturity date of October 22, 2012:- What was the bond's current yield?- Why is the bond's yield to maturity less than its coupon rate?

Why didnt company continue to issue bonds with lower coupon : Why would Ford issue bonds with coupons of $74 and then a little more than a year later issue bonds with coupons of $98?

Why would christians in the west be moved to embark : Read Robert the Monk's account of Pope Urban II's call to crusade found on the Internet History Sourcebooks Project site. Why would Christians in the West be moved to embark on a dangerous journey to fight in the Holy Land after hearing Pope Urban..

What did the article mean by banks having a problem : What did the article mean by banks having a problem with "bad assets"?- Why is "ample lending" by banks necessary to "restart the wheels of commerce"?

Reviews

len1305492

12/8/2016 6:24:51 AM

Final Paper Requirements - Total 10-15 page paper (+ code). Data description and schema. Description of any other ecosystem or additional tools. How did you verify that your output is correct? What would you have done differently if you did this again?

Write a Review

Required(*) Message

User Account

All Pages