Reference no: EM133079886
Apache Spark API
Description
Use Apache Spark to find the answer for the following questions. If you prefer to use less data for convenience, you can pick any 2 or 3 files from the dataset.
1. Show a sample of 10 records from dataset.
2. Read the data with data types.
3. Make a new column monthstr, Which has months in form of eq., 02, 03, 12 .
4. Find the # of flights each airline made.
5. Find the mean departure delay per origination airport.
6. What is the average departure delay from each airport?
7. Find the on-time (ArrTime - CRSArrTime c= 0) performance for each unique carrier.
8. Define a UDF and make a new column using this UDF.
9. How well does weather predict plane delays? Apply a machine learning model to answer this question.
|
Which justification for punishment do you favor
: Which justification for punishment do you favor: retribution, deterrence, incapacitation, rehabilitation, reintegration, or a combination? Explain why.
|
|
Calculate the threshold wage w that leaves a credit
: Consider the dual market model based on Ghatak and Jiang (2002) with the following modification: The entrepreneurial technology requires one entrepreneur and tw
|
|
How the individual supply of labor curve demonstrates
: Illustrate and examine how the individual supply of labor curve demonstrates the way an individual divides his/her time between work and leisure.
|
|
Compute the price and usage variances for materials
: At the start of the year Bella had the following standard cost sheet for one of its makeup products: Compute the price and usage variances for materials
|
|
Apache Spark API Assignment
: Apache Spark API Assignment and solution- Find the mean departure delay per origination airport and What is the average departure delay from each airport
|
|
Relationship between police and community
: Explain the strengths and weaknesses of each strategy, as well as how it impacts the relationship between the police and the community.
|
|
What can mary do with the disallowed loss
: Mary is a 50% shareholder in an S corporation, which suffered a $100,000 loss for the tax year ending December 31, 2002. What can Mary do
|
|
Differences between reid-kinesic and peace methods
: Fundamental differences between Reid, Kinesic, and Peace methods of interviewing and interrogating a suspect that are used as part of a criminal investigation
|
|
What amount is the gross lease receivable account balance
: Dani recorded the lease as a direct financing lease. What amount is the gross lease receivable account balance at the inception of the lease
|