Skip to main content

Registering Jupyter Notebook Models in Dojo

To register a Jupyter notebook based model in Dojo we recommend installing Papermill to run the model. Papermill allows the ability to run a notebook as an executable as well as tag and expose parameters, which might be needed depending on how model parameters are defined.

If the parameters of the model are set in the notebook and modified manually for each run then you will need to expose those parameters by tagging a cell in the notebook. See next section.

If the notebook reads in parameters from another file there is no need to tag anything in the notebook. Instead you will define those parameters using Dojo’s Built-in "dojo" command (specifically dojo config …) to tag the parameters. Dojo will handle updating that file before the notebook runs allowing that parameter to be exposed.

Preparing your Notebook​

Note: this process is slightly different for Jupyter Notebooks, JupyterLab 2.0-2.2.x, and JupyterLab V3 and up. Follow the directions created by Papermill here -(adding parameters) for whatever case you have.

There are three simple steps to tag parameters that are defined in the notebook:

  • First move all the parameters to one cell at the top of your notebook.
  • Set their values to default values for a default run.
  • Tag the cell as “parameters” in whatever method Papermill recommends.
Parameter Tag in Jupyter Notebook

Parameter Tag in Jupyter Notebook

Papermill In Dojo​

Now that you have tagged your parameters cell lets run and register the model in Dojo. Like any model you will fill out model information and select your base image from the drop down menu.

Papermill is pre-installed in Dojo's Ubuntu Analytics base image. You should choose this as your base image for your containerization environment. Otherwise, you'll need to follow Papermill's installation instructions yourself.

If your notebook is called test.pynb you'd use something like the following command:

  papermill test.ipynb -p temp .5 -

This will run test.ipynb. The -p is a flag that allows you to pass in a value for the parameter you set in your tagged cell. In dojo you would mark this as your Directive and select .5 as the value for a parameter.

After editing the directive and setting the parameter .5 to “temperature” it looked like this:

papermill test.ipynb -p temp {{temperature}} -

Now you can save and publish the model and it should work with dojo with exposed parameters.