Analyze the yelp 2016 challenge dataset

Reference no: EM131030607

I need urgent help in my Big Data Assignment. It needs another .tgz file to pull the data. I will share the file with you as soon as you contact me. It is in Big Data- Hadoop. Can u get it done in Hadoop/ R/ apache spark??

You must use Hadoop technologies to analyze the Yelp 2016 challenge dataset: https://www.yelp.com/dataset_challenge.

You can use Hadoop, R/ Apache Spark.

Specifically, you must provide the answers (and code) to the following questions:

Summarize the number of reviews by US city, by business category.

Rank the cities by # of stars for each category, by city.

What is the average rank (stars) for businesses within 800 ft of Times Square, by type? For this problem, assume Times Square is at lat: 40° 45' 32.0256'' N, lon: 73° 59' 6.4680'' W, and 800 ft. to be a square 10 seconds in each direction.

Rank reviewers by number of reviews. For the top 10 reviewers, show their average number of stars, by category.

For the top 10 and bottom 10 food business in Times Square (in terms of stars), summarize rating by hour of day.

Changes :Since the Yelp academic dataset does not include NY, we need to amend the coordinates:

Center: Carnegie Mellon University, Pitsburgh, PA
Latitude: 40-26'28'' N, Longitude: 079-56'34'' W

Decimal Degrees: Latitude: 40.4411801, Longitude: -79.9428294

The bounding box for the midterm is ~5 miles, which we will loosely define as 5 minutes. So the bounding box is a square box, 10 minutes each side (of longitude and latitude), with CMU at the center.

provide suitable statistical analysis of your results with R.

provide visualizations for results (distributions, graphs, maps, in R).

Reference no: EM131030607

Questions Cloud

Identified physician compliance risk area coding and billing : Identified Physician Compliance Risk Area - Coding and Billing: Which risk areas are you most concerned about? Why? What can be done to minimize it?

Determine the electric energy supplied in kwh : The pressure inside the cylinder is held constant at 300 kPa during the process, and a heat loss of 60 kJ occurs.

How might that affect the validity of your ratio analysis : If the firm had a pronounced seasonal sales pattern, or if it grew rapidly during the year, how might that affect the validity of your ratio analysis?

Explain the circumstances of the crime : Explain the circumstances of the crime. Describe the investigative process. Describe the circumstances of the arrest. Describe the process beginning with arraignment through sentencing.

Analyze the yelp 2016 challenge dataset : You must use Hadoop technologies to analyze the Yelp 2016 challenge dataset - Summarize the number of reviews by US city, by business category.

Determine the final temperature of the air : Determine the final temperature of the air. Neglect the energy stored in the paddle wheel.

Determine the amount of heat loss : A piston-cylinder device contains 25 ft3 of nitrogen at 40 psia and 700°F. Nitrogen is now allowed to cool at constant pressure until the temperature drops to 200°F. Using specific heats at the average temperature, determine the amount of heat los..

Program accepts a path to a directory : CSC 352, Unix Systems, Spring 2016, Run the file command and egrep for the pattern - This program accepts a path to a DIRECTORY as its first and command line argument, followed by one or more string PATTERNs

Identify all the possible variables and parameters : Describe the structure of the formula you would like to propose for management and identify all the possible variables and parameters which may play a role in such a formula.

User Account

All Pages