View on GitHub


Use IPython Notebook to analyze data


MultiDBs INotebook Project is a sub-project for MultiDBs project. It aims to utilize iPython(Jupyter) notebook to do data analysis on MultiDBs datasets.

IPython Notebook is a is a web-based interactive computational environment where you can combine code execution, text, mathematics, plots and rich media into a single document.In Jupyter,data imported from MultiDBs database can be analyzed and viewed in different ways using python by implement Ipython Notebook. Each document for each user can be saved to our server. By login into the system, users can check their notebooks.

Jupyter roles as a excellent data visualization platform for data in MultiDBs. Matplotlib, a python 2D plotting library which produces publication quality figures in a variety of hardcopy formats and interactive environments across platforms,is included in Jupyter. You can generate plots, histograms, power spectra, bar charts, errorcharts, scatterplots, etc, with just a few lines of code, because matplotlib tries to make easy things easy and hard things possible.

The Jupyter does an impressive job of hiding its power behind a simple user interface.With the concise interface and design, users can easily handle the software without any help.We no longer have to squint or click around in search of the feature we’re trying to access: The button is right there in that simple interface for us to tap.Its emphasis on performance and a its intriguing minimalistic user interface will attract a lot of well-deserved attention.

Just enjoy Jupyter!

Install iPython

Installing IPython is the first step we should take. Here is simple introduction of several ways to install IPython. For more information, please visit Install IPython to get simplified installation instructions that should work for most of the users.

Install Server and Configuration Alert

Note:All the following configuration is based on AWS(Ubuntu 14.04.1 LTS). There may be some configuration errors on other kinds of server system. You can always send emails to for technical support

There are two servers in our system: Java server for portal website and ipython server to deal with actual notebook staffs.

Before starting up the server, users need to make sure that the port 8888 is open to public, and is not binding to other process. It is reserved for jupyter server.

The first part of installation is to install mysql server, with password root for user root, it should automatically set “root” as password of “root” mysql user. If it fails, you should try to replace the password with your own.

echo mysql-server mysql-server/root_password password root | sudo debconf-set-selections

echo mysql-server mysql-server/root_password_again password root | sudo debconf-set-selections

The second part of installation is install java server. System will download server from git, make some configuration, and start server. In “Jupyter Notebook for multi-user”, we install jupyter server which is a multi-user version of ipython.

In this part, the server will use a default port 7654. If you want to change it to another port, please refer to file and change the port in the first line

The last part is to modify some ipython build-in files to implement some customize functionalities. You can change the defalut ipython path to your own one if your ipythn is not installed in the default directory

# Copy jupyter server configuration file from git
# Replace the IPython directory with your own one
cp opt/project/MultiDBs-INotebook-IPython-Extention/js/main.js /usr/local/lib/python3.4/dist-packages/IPython/html/static/notebook/js/main.js

cp opt/project/MultiDBs-INotebook-IPython-Extention/css/overiride.css /usr/local/lib/python3.4/dist-packages/IPython/html/static/notebook/css/overiride.css

After setting all the configuration in the, just start up the server in a clean machine, run in the project directory.

sudo ./

How to use

  1. Register a new account
  2. Open the Rigister page. Input your user name, email address and password.

  3. Log in
  4. Open the Log in page. Input the user name and password in step 1. Or use the defualt account (username: student, password: infsci27115).

  5. Open your server
  6. When you enter the Jupyterhub page, click the green My Server button. The page will jump to your home page that lists all your files.

  7. Create new documents
  8. Click the New button on the right part of the page and select a file type. For this project, you should create Python 3.

  9. Connect to a database
  10. Select a database in the pull-down menu to connect. Then click the cloud button next to the database menu. The first cell will display the database information.

  11. Use data from database
  12. Now, you can start to use the data to do analysis. For example, if you want to get the data of two columns "mpg" and "horsepower" from database "car". you can execute a SQL statement select horsepower, mpg from 25.carsin notebook cell. Than you will get the data from the databse. The data is displayed in the form of JSON object.

    You can uniform the data to discard schema and to convert data type using Python. The following code gives an example of data pre-processing and scatter plot.

    %matplotlib inline
    import matplotlib.pyplot as plt
    for i in range(len(data)):
    for i in range(len(data)):
    x = dataset1
    y = dataset2



Thanks for all the advice and help from Evgeny Karataev, the instructor of INFSCI2711.

Team Members