Analyse the structure of the existing data

Reference no: EM132114366

Assignment

Scenario

You have been hired as a consultant by a Victorian-based car rental firm who want you to design and develop a data warehouse to integrate information which is currently held in several separate databases and spreadsheets. They have provided you with several samples of data which can be used as basis for designing and implementing a suitable conformed dimensional design and ETL process.

The following data files are available via Moodle:
- Details of the firm's three franchises
- The firm's current inventory of cars
- The records of the firm's customer loyalty program
- For each franchise, the records of all transactions over roughly a 2-month period. Three different types of transactions have been recorded - the initial booking, the pick-up of a car, and the return of the car. Different attributes have been kept for each type of transaction. The datasets are reasonably clean, but some issues may remain.

Requirements
There are four separate components required for your submission.
- Dimensional Design
Analyse the structure of the existing data, and design suitable dimension and fact tables to store this data in a conformed dimensional structure. Document your design using any suitable drawing tool such as Visio draw.io then export it as a PDF or PNG file for submission and marking.
- Database Schema
Implement the design from the previous stage as a database schema defined by a SQL file which can be imported into XAMPP.
- ETL Process
Use the Pentaho Community Edition software used in Lab 4 to implement an ETL system which can load the data from the various files provided by the firm, perform appropriate transformations, and load it into your database. Your solution should be robust to any issues arising in the source data, such as inconsistencies, missing values, or duplicate entries.
- Report
Create and submit a brief report documenting your ETL system. In particular explain any decisions which you had to make regarding treatment of data issues. If you have been unable to complete any aspects of the ETL system, or if some parts do not function correctly, document these limitations.

Learning Outcomes Assessed
The following course learning outcomes are assessed by completing this assessment:
K2. Describe data management, storage, processing needs for big data analytics.
S2. Use data loading and formatting tools.
A1. Perform appropriate data collection and processing techniques.
A2. Demonstrate the use of tools to collect, store, process and use data for big data analytics.

Reference no: EM132114366

Questions Cloud

How does sense-perception work : Aristotle discusses six faculties or powers [dynamics] of the psyche. List and define them, in ascending order of rarity. {If you only find five faculties).

Determine who is carol gilligan : Who is Carol Gilligan and what does her research say about possible gender differences in moral reasoning? The response must be typed.

Describe briefly what the researchers did and found : Specify the three or four central or most important arguments made or pieces of evidence offered in the article/chapter to support the thesis.

Environmentalist vs environmental : Is there merit in the claims by the environmental justice advocates that pollution by “major polluters” will increase under cap-and-trade?

Analyse the structure of the existing data : ITECH2302 Big Data Management - Analyse the structure of the existing data, and design suitable dimension and fact tables to store this data in a conformed

What is the sarbanes-oxley act : What are some examples of major ethical breaches in the recent past that have led to increased scrutiny in the field of financial reporting and analysis?

Feel separates twitter from the other social media platforms : What do you feel separates Twitter from the other social media platforms? and why is this important?

Identify which clusters represent technology developers : Within your paper, identify which clusters represent technology developers and which clusters represent technology users.

Social media changed the relationship with the customer : How has social media changed the relationship with the customer?

Reviews

len2114366

9/16/2018 11:05:06 PM

Create a zip file containing all of the required submission documents, and submit via the Assignment 1 submission link on Moodle. Your submission should contain: • Your dimensional design as a PDF or PNG file. • Your database schema as a SQL file. • Your Pentaho Spoon ETL system (all of your .ktr and .kjb files) • The report as a PDF or Word document.

Write a Review

Required(*) Message

User Account

All Pages