Develop a mapreduce algorithm to merge a nosql dataset

Assignment Help Computer Engineering

Reference no: EM133369662

Imagine that you need to develop a MapReduce algorithm to merge a NoSQL dataset and SQL dataset.

Business Case

A bike-sharing system is given, and every second of a state of all bike stations is represented in a NoSQL document of the following structure:

{

Time: XXXXXX,

Stations: [

{id: XX, num_bikes_available: XX, num_spots_available: XX},

{id: XX, num_bikes_available: XX, num_spots_available: XX}

]

}

The dataset of all rides (time is given in seconds) is provided as a SQL table, with the following fields: pick_up_time, drop_off_time, user_id, start_station_id, end_station_id.

Directions

Write pseudocode to describe an efficient MapReduce algorithm (mapper and reducer) that allow merging those datasets to provide a relational dataset with all initial data from a rides dataset along with the number of bikes available at pick up the station when the bike was taken, and the number of parking spots available at the drop off location when the bike was returned.

Reference no: EM133369662

Questions Cloud

Provide an overview on what it systems they will need : provide an overview on what IT systems they will need to support their widget and the company's operation. These systems should be linked and they will need

What are the main risk factors that can contribute : Why do people get physiologically and psychologically addicted to drugs? What are the main risk factors that can contribute to someone's risk for drug abuse

Review the winning submissions : Which do you think is best? Do you think any of them adequately address the underlying issues as to why patients do not read and/or comprehend the current NPPs?

What are the pros and cons of hics, in your opinion : discuss what you found most important from the article and why? Do HICs fit into performance improvement, why or why not? What are the pros and cons of HICs

Develop a mapreduce algorithm to merge a nosql dataset : Develop a MapReduce algorithm to merge a NoSQL dataset and SQL dataset and pick up the station when the bike was taken, and the number of parking spots

What is the purpose of the good samaritan laws : What is the purpose of the good Samaritan laws? What are the 3 basic steps to follow in an emergency? Make sure you list them in the proper order

Can billy enforce this contract : He sees Billy at the party and offers him, "1 million dollars" for his espresso maker. Can Billy enforce this contract?

Identify one to two distinguishing attributes : Identify one to two distinguishing i'de?ning attributes of the entity (that this entity type often has yet other entity types are not very likely to have)

Describe how the power of incumbency works : Describe how the power of incumbency works. Also, explain the advantages that incumbents have that can aid their reelection.

User Account

All Pages