Hortonworks Sandbox HDP 3.0 on Ubuntu 18.04 using Docker

I have experience of installing “Hortonworks Sandbox HDP 3.0” on Ubuntu 18.04 using Docker. Also I have learned one thing about this installation.

There are a couple of prerequisites and also a capable hardware is required. Resources are required at least 16 GB of RAM and quad core processor.

For an installation I used original tutorials [3] and hit a wall couple of times. Finally, I sorted out my issue. Using these steps below I launched Sandbox HDP server.

Prerequisites

I made a simple step-by-step guide on how to install Docker on Ubuntu [1]. Also, make sure you have an unarchived binary package on your Ubuntu.

sudo docker ps #If there is no docker package please install [1]
sudo apt install unzip -y

Download and unzip

Script I downloaded from “Cloudera” website [2]

wget https://archive.cloudera.com/hwx-sandbox/hdp/hdp-3.0.1/HDP_3.0.1_docker-deploy-scripts_18120587fc7fb.zip
# Unzip
unzip HDP_3.0.1_docker-deploy-scripts_18120587fc7fb.zip

Installation

It will take around 20 minutes. You might want to run it in screen mode:

screen -dmS hdp bash -c 'sudo bash docker-deploy-hdp30.sh'

Back to the process command below:

screen -r

But the simple command below is fine.

sudo bash docker-deploy-hdp30.sh

After installation give a ten minutes to load up an all modules. In a browser window type sandbox server address with port in my case it was.

http://192.168.0.10:1080

Possible issues:

The POSIX shell that you are using does not recognize ‘==’ for string equality and hence the ‘hostname’ variable is not set. This is resulting in a null string being passed to the ‘network-alias’ option in docker run command and hence the issue.

hdp: unexpected operator

This might happening if you run with sh (original tutorials are with sh [3]). So on Ubuntu 18.04 you have to use bash instead of sh.

If you need virtualbox instance you can download from here:

wget https://archive.cloudera.com/hwx-sandbox/hdp/hdp-3.0.1/HDP_3.0.1_virtualbox_181205.ova

Reference:

#1 https://medium.com/@tomas_savenas/apt-get-install-docker-on-linux-server-614863a24d6a
#2 https://archive.cloudera.com/hwx-sandbox/hdp/hdp-3.0.1/HDP_3.0.1_docker-deploy-scripts_18120587fc7fb.zip
#3 https://www.cloudera.com/tutorials/sandbox-deployment-and-install-guide/3.html