Reference no: EM132906666

Assessment Task: Data mining in action

Scenario

This assignment is a practical data analytics project that follows on from the data exploration you did in Assignment 2. You will be acting as a data scientist at a consultant company and you need to make a prediction on a dataset. The dataset can be found below.

You need to build classifiers using the techniques covered in the lectures to predict the class attribute. At the very minimum, you need to produce a classifier for each method we have covered. However, if you explore the problem very thoroughly (as you should do in the industry), preprocessing the data, looking at different methods, choosing their best parameters settings and identifying the best classifier in a principled and explainable way, then you should be able to get a better mark. If you choose to use KNIME and you show 'expert' use (i.e. exploring multiple classifiers, with different settings, choosing the best in a principled way and being able to explain why you built the model the way you did), this will attract a better mark. If you choose to use R or Python to build, optimise and test different models, this will also attract better marks.

You need to write a short report describing how you solved the problem and the results you found. See below for requirements.

You also need to attend a short oral defence of your classifier of around 5 minutes where you show the classifier (e.g. using the KNIME workflow or Python/R code) and answer some questions about it. Details about oral defences will be given by email and in class.

Assessment

Assessment is real-time. This means that as soon as you submit the file, Kaggle will assess the performance of your classifier and provide you with the result. You can submit multiple times, but Kaggle has a limit for the number of times you can do this per day.

Do not use the measure of performance reported by Kaggle as a measure of your test error in the final competition and optimise to it. This is because Kaggle has two measures: a public measure, which it reports to you, and a private measure, which it keeps hidden. Instead, develop several models and estimate the test error yourself before submitting to Kaggle. Remember that your estimate of test error is just that: an estimate. The actual private measure will probably be a little bit different.

Case Study Portfolio

Task

As the team of IT Operations Managers at Under Milkwood, you must prepare an audit of UM's current situation from an ITOM perspective.

During the Tutorial sessions you have been asked to complete a number of separate tasks. Each week, you have added insight and interpretation and updated previous components of your Under Milkwood Portfolio to ensure consistency between all sections. Most of the work should be already done. The job now is to consolidate all results into a consistent and comprehensive portfolio, completing the initial case study briefing.

Structure
Your portfolio should have the following sections:
- Management Summary
- Table of Contents
- Introduction

Background
Objectives/purpose
Scope of the portfolio
• Fundamentals

These have been created early on in the semester and need to be refined and enriched throughout. The complete and consistent versions are needed here.

Organisation chart
- It should reflect all accountability areas within both Business and IT areas. Your chart will drive other components of the portfolio. Identify strategic and tactical accountabilities

Production baseline
Your production baseline should be highly defined as it forms the foundation for what Operations
Management is accountable. Hence baseline definition needs to be consistent with your org chart.

Competency matrix
You should have all existing skills within your group documented in the competency matrix. By end of semester all required skills, consistent with your baseline, should also be documented. You are to do a skills gap analysis and present a plan for closing the skills gap.

SLAs

Brief description of the role of SLAs for Under Milkwood

You must provide a full SLA template that is appropriate to your interpretation of the case study. You must fully populate 2 SLAs, using your template, to govern highly defined components of your baseline i.e. your baseline definition needs to contain all the required components to allow you to document the who, what, how, cost and time. Ensure the metrics are consistent with the baseline and the benchmarks you have
defined.

IRB setup

IRB members and their operational charter is required. It must be consistent with your org chart.

Management areas
Based on the above fundamentals, follow the flow of the tutorials, to present your findings in a coherent manner. These include,
Define what a legacy system is and define which areas of your baseline are legacy. Obviously you'll need enough definition in the baseline to justify this.

Using your baseline, define, identify and justify at least 2 potential hotspots.

Again, using your baseline and, with reference to your org chart, define a vendor engagement model i.e. engagement, assessment, selection, implementation and ongoing management.

Develop a help desk / problem management plan including required data content, metrics and reporting.

Explicitly state the functions and benefits.

Develop network management, configuration management, capacity planning and capacity management plans.

Must be consistent with your org chart and baseline definition

Define acceptance criteria, and storage management, requirements, accountability and skills. This needs to be consistent with your org chart, baseline and competency matrix.

Define a redundancy plan referencing baseline and also non-functional requirements defined within the baseline

Define members of the Change Review Board CRB and their charter. Ensure it is consistent with your org chart.

Define a change review process.

With reference to your portfolio develop an asset management register

Develop a disaster management plan. Must be consistent with all components of the portfolio. Be aware that architectural dependencies drive the plan, as such, these must be defined in the baseline.

With reference to your baseline define the tasks and skills required for security and facilities management
• Summary
• References, Appendices (if applicable)

Case Study Introduction

Overview
The purpose of this continuing Case Study is for you to understand the complexities of IT Operations Management and be given the chance to work on a practical example. As the Case Study is understood, the requirements of the IT Operations will be exposed. Then these requirements will form a common basis for discussion, exploration and understanding. The Case Study will form the basis of a number of tutorials. During each tutorial, in groups, you will do ongoing development of the company's IT Operations environmen. This will also be submitted as a portfolio at the end of the semester (see Assessment Task 3). This will be part of your class mark assessment. There will be pre-work required that must be completed prior to attendance of the tutorials.

The objectives of this Case Study are:

1. to give you an understanding of the complexities of IT Operations
2. to give you and the tutors a common basis or classroom discussion and exercises
3. to place an IT operation department in an organisational perspective
4. to allow creativity in creating the organisation sub-hierarchies

All tutorials (unless otherwise indicated) are based on the Case Study. As you go through the tutorials, the structure and operations of Under Milkwood will become clearer.

In the choice of a gaming company as a Case Study where its business is developing and running games, students should realise that IT Operations does not refer to the gaming part of the company. Just like if the company made and sold wooden furniture, the construction of the furniture would be OUTSIDE the scope of IT Operations for that company.

You should create a folder for Under Milkwood, which will be added to each week. You should update this folder with summary lists produced in the class.

The material in the folder will be used in subsequent tuts, please bring it to all tutorials. You will have to take notes through the tutorial group work, basically copying for yourself what the group does.

Introduction
Under Milkwood Pty Ltd is a large computer gaming company with approximately 100 computer games either on the market or being maintained. It also supports 30 online games. Under Milkwood currently has 15 games under development directly, as well as 10 it has outsourced. The company employs approximately 400 people. Nancy Thomas is the current CEO.

Products
The company writes games compatible with all major platforms. The games range from action games for pre-teens to First Person Shooters and a range of Real Time Strategy games. Ten of the games online are persistent role playing games and Under Milkwood hosts a "BattleNet" type service. Games are sold directly, through distributors and over the Internet. Under Milkwood also provides a Website for upgrades, patches etc. for their customers. Under Milkwood tries to stay close to its customer base, one of the reasons for its success.

Divisions
Below is a non-exhaustive list of some of the core business divisions of Under Milkwood for a first overview. Some sections are missing at this stage.
- Administration (inc Finance, Purchasing, HR, etc)
- Marketing
- Sales (Direct and Indirect, Web Sales)
- IT Operations
Production
Company Website

Attachment:- Case Study.rar