Reference no: EM132898656
COSC 2670 Practical Data Science with Python - RMIT University
Introduction
In this assignment, you are given a specific data science problem and a related research paper. You are required to present critical analysis about how to deploy the techniques in the related research paper to tackle the given data science problem, and then implement it.
The "Practical Data Science" Canvas contains further announcements and a discus- sion board for this assignment. Please be sure to check these on a regular basis - it is your responsibility to stay informed with regards to any announcements or changes.
Where to Develop Your Code
You are encouraged to develop and test your code in two environments: Jupyter Note- book on Lab PCs and Anaconda 3 that you installed on your own computer.
General Requirements
This section contains information about the general requirements that your assignment must meet. Please read all requirements carefully before you start.
- You must include a plain text file called "readme.txt" with your submission. This file should include your name and student ID, and instructions for how to execute your submitted script files. This is important as automation is part of the 6th step of data science process, and will be assessed strictly.
- Please ensure that your submission follows the file naming rules specified in the tasks below. File names are case sensitive, i.e. if it is specified that the file name is gryphon, then that is exactly the file name you should submit; Gryphon, GRYPHON, griffin, and anything else but gryphon will be rejected.
Overview
It is well-known that missing values are one of the biggest challenges in data science projects.
You might know that k nearest neighbour based Collaborative Filtering is also called "memory-based" Collaborative Filtering. Luckily, data scientists and researchers have been working hard to solve the missing value problem in k-neighbourhood-based Collab- orative Filtering, and have got solutions there.
In this assignment, you are required to tackle the missing value problem in Collab- orative Filtering by predicting them. Specifically, an existing solution about how to predict the missing values in Collaborative Filtering is provided, which is a report named "Effective Missing Data Prediction for Collaborative Filtering". Please read this report carefully, then complete the following tasks.
Tasks
Task 1: Implementation
In this task, you are required to implement the solution in the provided report so as to predict the missing values in Collaborative Filtering.
Note, you are required to implement your own implementation, and please do not use any other libraries that are related to Recommender Systems or Collaborative Filtering. If you use any of these libraries, your implementation part will be invalid.
We provide Python framework code (named assignment3 framework.ipynb) to help you get started, and this will also automate the correctness marking. The framework also includes the training data and the test data.
Please only put your own code in the provided cell in the framework as shown in Figure1, Please DO NOT CHANGE anything else in the rest cells of the framework, otherwise they might cause errors during the automatic marking.
Please provide detailed comments to explain your implementation. To what level of details should you provide in your solution? Please take the comments in the ipynb files in Week 10 (knn based cf updated.zip) as examples for the level of detailed comments you are expected to put for your solution.
Task 2: Presentation
• The presentation should
- Explain how the solution in the provided report predicts the missing values in the Collaborative Filtering by using your own language clearly and completely.
- Explain why the solution in the provided report can tackle the missing value problem in Collaborative Filtering clearly and completely.
- Explain how you implement the solution clearly and completely.
• The presentation should be no more than 10 minutes.
• Your presentation slides should be:
- Microsoft PowerPoint slides (with audio inserted for each slide by using: Insert
- > Audio - > Record Audio).
- or you can create your own presentation slides (e.g. PDF version) and please submit your own recording (in the format of mp4 or avi) of your presentation as well.
Attachment:- Practical Data Science with Python.rar
Attachment:- Guideline.rar