Reference no: EM132097128

Theme: Installing Docker

Most users set up Docker's repositories and install from them, for ease of installation and upgrade tasks. This is the recommended approach.

1.1.1 Install using the repository
1. Update the apt package index:

2. Install packages to allow apt to use a repository over HTTPS:

3. Add Docker's official GPG key:

4. Verify that you now have the key with the fingerprint 9DC8 5822 9FC7DD38 854A E2D8 8D81 803C 0EBF CD88, by searching for the last 8 characters of the fingerprint.

5. Use the following command to set up the stable repository. You always need the stable repository, even if you want to install builds from the edge or test repositories as well. To add the edge or test repository, add the word edge or test (or both) after the word stable in the commands below.

amd64:

1.1.2 Install Docker CE
1. Update the apt package index.

2. Install the latest version of Docker CE, or go to the next step to install a specific version. Any existing installation of Docker is replaced.

Got multiple Docker repositories?
If you have multiple Docker repositories enabled, installing or updating without specifying a version in the apt-get install or apt-get update command will always install the highest possible version, which may not be appropriate for your stability needs.
3. On production systems, you should install a specific version of Docker CE instead of always using the latest. This output is truncated. List the available versions.

The contents of the list depend upon which repositories are enabled. Choose a specific version to install. The second column is the version string. The third column is the repository name, which indicates which repository the package is from and by extension its stability level. To install a specific version, append the version string to the package name and separate them by an equals sign (=):

The Docker daemon starts automatically.
4. Verify that Docker CE is installed correctly by running the hello-world image.

This command downloads a test image and runs it in a container. When the container runs, it prints an informational message and exits.

Docker CE is installed and running. You need to use sudo to run Docker commands. Continue to Linux postinstall to allow non-privileged users to run Docker commands and for other optional configuration steps.

2 Jupyter Notebook Python, Scala, R, Spark, Mesos Stack

2.1 What it Gives You
- Jupyter Notebook 5.2.x
- Conda Python 3.x environment
- Conda R 3.3.x environment
- Scala 2.11.x
- pyspark, pandas, matplotlib, scipy, seaborn, scikit-learn pre-installed for Python
- ggplot2, rcurl preinstalled for R
- Spark 2.2.0 with Hadoop 2.7 for use in local mode or to connect to a cluster of Spark workers
- Mesos client 1.2 binary that can communicate with a Mesos master
- spylon-kernel
- Unprivileged user jovyan (uid=1000, configurable, see options) in group users (gid=100) with ownership over /home/jovyan and /opt/conda
- tini as the container entrypoint and start-notebook.sh as the default command
- A start-singleuser.sh script useful for running a single-user instance of the Notebook server, as required by JupyterHub
- A start.sh script useful for running alternative commands in the container (e.g. ipython, jupyter kernelgateway, jupyter lab)
- Options for a self-signed HTTPS certificate and passwordless sudo

3 Installing jupyter/all-spark-notebook

Both commands above start up the jupyter/all-spark-notebook container however use the second command as this creates a directory from which Docker can read files. That is, it creates the /home/spark directory on Docker and points to the local directory /home/grant/GrantPrivate/USC/spark

In the Jupyter front end GUI go to the top left and click on ‘New' this will then drop down a select box. Select ‘Python 3'

Theme:Install Docker for Windows

Docker for Windows is a Docker Community Edition (CE) app. The Docker for Windows install package includes everything you need to run Docker on a Windows system. This topic describes pre-install considerations, and how to download and install Docker for Windows.

Already have Docker for Windows? If you already have Docker for Windows installed, and are ready to get started, skip to Get started with Docker for Windows for a quick tour of the command line, settings, and tools.

Looking for Release Notes?Get release notes for all versions here.
1.1 Download Docker for Windows
If you have not already done so, install Docker for Windows. You can download installers from the Stable or Edge channel.Both Stable and Edge installers come with experimental features in Docker Engine enabled by default. Experimental mode can be toggled on and off in preferences.
Stable channel
Stable is the best channel to use if you want a reliable platform to work with. Stable releases track the Docker platform stable releases.On this channel, you can select whether to send usage statistics and other data.Stable releases happen once per quarter.

• Legacy (.msi) installers are available for Edge and Stable channels.
• Docker for Windows is designed to configure Docker development environments on Windows 10 and on Windows Server 2016. You can develop both Docker Linux containers and Docker Windows containers with Docker for Windows. To run Docker Windows containers in production, see instructions for installing Docker EE on Windows Server 2016. To run Docker Linux containers in production, see instructions for installing Docker on Linux.
Docker for Windows requires 64bit Windows 10 Pro with Hyper-V available. See What to know before you install for a full list of prerequisites.
You can switch between Edge and Stable versions, but you can only have one app installed at a time. Also, you need to save images and export containers you want to keep before uninstalling the current version before installing another. For more about this, see the FAQs about Stable and Edge channels.
•
1.2 What to know before you install
If your system does not meet the requirements to run Docker for Windows, you can install Docker Toolbox, which uses Oracle Virtual Box instead of Hyper-V.
• README FIRST for Docker Toolbox and Docker Machine users: Docker for Windows requires Microsoft Hyper-V to run. The Docker for Windows installer enables Hyper-V for you, if needed, and restart your machine. After Hyper-V is enabled, VirtualBox no longer works, but any VirtualBox VM images remain. VirtualBox VMs created with docker-machine (including the default one typically created during Toolbox install) no longer start. These VMs cannot be used side-by-side with Docker for Windows. However, you can still use docker-machine to manage remote VMs.
• Virtualization must be enabled. Typically, virtualization is enabled by default. This is different from having Hyper-V enabled. For more detail see Virtualization must be enabled in Troubleshooting.
• The current version of Docker for Windows runs on 64bit Windows 10 Pro, Enterprise and Education (1607 Anniversary Update, Build 14393 or later).
• Containers and images created with Docker for Windows are shared between all user accounts on machines where it is installed. This is because all Windows accounts use the same VM to build and run containers.
• Nested virtualization scenarios, such as running Docker for Windows on a VMWare or Parallels instance, might work, but come with no guarantees. For more information, see Running Docker for Windows in nested virtualization scenarios
• What the Docker for Windows install includes: The installation provides Docker Engine, Docker CLI client, Docker Compose, Docker Machine, and Kitematic.
1.2.1 About Windows containers and Windows Server 2016
Looking for information on using Windows containers?
• Switch between Windows and Linux containers containers toggle in Docker for Windows and points you to the tutorial mentioned above.
• Getting Started with Windows Containers (Lab) provides a tutorial on how to set up and run Windows containers on Windows 10 or with Windows Server 2016. It shows you how to use a MusicStore application with Windows containers.
• Setup - Windows Server 2016 (Lab) specifically describes environment setup.
• Docker Container Platform for Windows Server 2016 articles and blog posts on the Docker website
1.3 Install Docker for Windows
Double-click Docker for Windows Installer.exe to run the installer.

If you haven't already downloaded the installer (Docker for Windows Installer.exe), you can get it from download.docker.com. It typically downloads to your Downloads folder, or you can run it from the recent downloads bar at the bottom of your web browser.

Follow the install wizard to accept the license, authorize the installer, and proceed with the install.

You are asked to authorize Docker.app with your system password during the install process. Privileged access is needed to install networking components, links to the Docker apps, and manage the Hyper-V VMs.

Attachment:- Lab-InstallingDocker.zip