Reference no: EM132015910
Spark Programming Assignment
This is Hadoop SPARK assignment. Please read carefully Assignment 3 SPARK text file. We use Oracle VM Hortonworks Sandbox 2.4 to simulate hadoop.
Download the input files from Resources section of the course page and upload to your VM.
Copy the files to /user/lab/ in the HDFS.
If you decide to use the file on your local system instead of HDFS, please state this in your submit file.
1. ODD/EVEN NUMBER
(Hint: Note that you are reading the file as text and need to convert the numbers to int())
Input: number_list.txt (a list of 1000 integers)
Output: Count the number of odd numbers and even numbers in the file
2. Top 10 and bottom 10 words
(Hint: Search and try takeOrdered() method)
Input: shakespeare.txt
Output: 10 words with the highest count and 10 words with lowest count
3. Group and Count
Input: fulltext_txt
Output: Count the number of tweets for each user_id and save the results in a text file.
Attachment:- Assignment.rar
|
Contemporary issue facing the us army
: A contemporary issue facing the U.S Army in one of three categories: Leadership, Operations, or Management, using your personal experience
|
|
Find the effective dividend tax rate for a buy investor
: The current tax rates are set to expire in 2008 unless Congress extends them. The tax rates shown are for financial assets held for one year.
|
|
Why did tolkien choose bilbo a hobbit as a hero
: Why did Tolkien choose Bilbo- a hobbit as a hero? What is the purpose, the greater implication? What lesson did Tolkien wanted to teach to the humanity?
|
|
What remedies should anna be able to obtain against bob
: 1. What remedies should Anna be able to obtain against Bob (explain your reasoning)? 2. What difference would it make to your answer to question
|
|
Spark programming assignment
: Spark Programming Assignment - Download the input files from Resources section of the course page and upload to your VM
|
|
What will be the price of this luxury watch in australia
: Suppose, the price of a luxury watch in the US is currently $450. The same watch is priced at A$610 in Australia, and €430 in Germany.
|
|
What is the maximum potential profit of your strategy
: If, at expiration, the price of a share of IBM stock is $102, what would be your profit? What is the lowest stock price at which you can break even?
|
|
How can the options be used to create a bull spread
: How can the options be used to create (a) a bull spread and (b) a bear spread? Construct a table that shows the profit and payoff for both spreads.
|
|
Trace the short-run and long-run effect on the exchange rate
: Suppose there is a reduction in aggregate real money demand, that is, a negative shift of the aggregate real money demand function.
|