Manage packages as a Watson Studio Local user
Watson Studio Local users can add additional packages to a base image (for example, custom, external, or third-party libraries and packages), which can then be reused by other users.
Watson Studio Local includes many preinstalled libraries. Before you install a library, check the list of preinstalled libraries. Run the appropriate command from a notebook cell:
!pip list --isolated
If the library that you want is not listed, or you want to use a Scala library in a notebook, use the steps in the following sections to install it. The format for library packages depends on the programming language.
To install a Python library
- Use the Python
conda installcommand to install Python libraries to your notebook. For example, the following command installs the
prettyplotliblibrary into a pod's conda, for instance, /opt/conda/lib/python2.7/site-packages, and then removes the package once the pod is terminated:
!conda install prettyplotlib
- Use the Python import command to import the library components. For example, run the following
command in a code
import prettyplotlib as ppl
- To use custom functions defined in Python scripts
You can import a python script to the Scripts section of your project, and then import the functions like any other Python module. The following example imports all functions in a file named
sys.path.insert(0, '../scripts/') from dsxl_support_functions import *
where ../scripts is the location where you imported your Python scripts. The imported functions can be called like any regular functions defined in modules.
To install an R package
- Use the R install.packages() function to install new R packages. For example, run the following
command in a code cell to install the ggplot2 package for plotting
The imported package can be used by all R notebooks running in the Spark service.
- Use the R library() function to load the installed package. For example, run the following
command in a code cell:
You can now call plotting functions from the ggplot2 package in your notebook.
To add a Scala library
Libraries for Scala notebooks are typically packaged as Java™ archive (JAR) files.
- To cache a library temporarily
- The libraries for a Scala notebook are not installed to the Spark service. Instead they are cached when they are downloaded and are only available for the time that the notebook runs.
- To use a single library without dependencies, from a public web server:
- Locate the publicly available URL to the library that you want to install. If you create a custom library, you can post it to any publicly available repository, such as GitHub.
- Download the library you want to use in your notebook by running the following command in a code
- To use a library with dependencies, from a public Maven repository:
- Add and import a library with all its dependencies by running the following command. You need
the groupId, artifactId, and version of the dependency. For
%AddDeps org.apache.spark spark-streaming-kafka_2.10 1.1.0 --transitive
- Add and import a library with all its dependencies by running the following command. You need the groupId, artifactId, and version of the dependency. For example: