What's new in Data Science Experience Local
Check out what's new for DSX Local!
What's new in Version 1.2.1 (August 2018)
- DSX Local now supports an add-on for Cognos Dashboards Embedded. Learn more
- DSX Local now supports an add-on for Watson Explorer oneWEX. Learn
- DSX Local now supports a Beta add-on for Spark Canvas using either the DSX Local Spark engine or
a remote Livy to the Spark engine running on a Hadoop cluster. Learn
- From the new Launch Terminal icon ( ), you can open either a Python 2.7 or Python
3.5 Jupyter terminal.
- A DSX Local user can now install a library or package in the root conda environment so that it
can be shared with other users, and does not get lost when the Jupyter environment restarts. After
installing the library or package from a Jupyter notebook or terminal, for example,
conda install -y arrow, the user can go to their project Environments panel and click the Save icon () for the running Jupyter environment to save it into a new custom image on the cluster (without having to download or update the entire image). The custom image then appears in the new My Images panel. Any DSX Local user can select this new image by clicking Edit settings next to the corresponding environment. From the admin console, the DSX administrator can see, manage, or validate the images created by DSX Local users in the Image management panel. Learn more
- A DSX administrator can now push custom images to a Hadoop cluster for remote jobs.
- When you pull changes and DSX Local detects a Git merge conflict, you can now resolve it in one
of two ways:
- Automatic resolution
- Rerun the Git pull but automatically drop either the remote or local changes in a merge conflict.
- Manual resolution
- Resolve the changes manually in either a web terminal or by using your own local merge conflict tool. You can then stage the changed files back to DSX Local.
- From the Git Actions icon ( ) in the project action bar, Commit and Push
are now separate. If you cannot resolve a merge conflict, you can now revert an old commit from the
Commit history. Learn more
- To create library projects, you now add them from the new Libraries page
in the DSX Local client. A library owner can now restrict access to it, and grant
Viewer privilege to specific DSX Local users. Otherwise, the library defaults
openaccess. Learn more
- You can now click a Test Connection button for a data source to verify that DSX Local can connect to it successfully.
- While adding a remote data set, you can now browse a schema for most table types. You can also select SQL Query as the object type instead.
- You can now preview remote data sets for all supported JDBC data sources and custom JDBC data sources by clicking the Preview option.
- You can now create data sources and remote data sets to access Microsoft SQL Server. Learn more
- You can now create data sources and remote data sets to access Hyperledger Composer (for building Blockchain applications). Note that the remote data sets can only be added after the data source has been created (rather than during). Learn more
- Data Refinery automatically opens when you click a data set that supports it (previously you had
to select Refine). Additional features:
- You can now refine data on a remote JDBC or HDFS data set.
- You can now run Data Refinery jobs on a local data set or a remote HDFS data set.
- You can now open an information panel by clicking the View info pane button.
- The project page now provides a navigation menu. You can also search, filter, and sort projects.
- When you search in a project, you can save the web browser URL as a bookmark.
- You can now create a model group of up to 10 model versions that can be deployed to production
at the same time using the same scoring endpoint. Over time, the model versions can be evaluated
against each other to assess the best ones to keep on your production environment. Learn more
Model management and deployment
- DSX Local now requires Deployment Admin permissions to create a project release. The DSX administrator can assign the Deployment Admin permissions to a user. Learn more
- A Deployment Admin can assign Admin permissions to a member of a project
release. The Admin can perform the following tasks:
- Modify, delete, or launch the project release.
- Add and administer the members of a project release and assign them permissions.
- Create, delete, or update asset deployments.
- A Deployment Admin can assign Developer permissions to a member of a project release. A developer can see the project release and use its existing deployments. For instance, a developer can test the API in a web service and run jobs. A developer can also preview and download the assets of existing deployments.
- A Deployment Admin can assign Viewer permissions to a member of a project release. A viewer can only see the project release and view its deployments, dashboard, and metrics. A viewer cannot test the API or run jobs.
- DSX Local now supports Beta remote deployments for web services and script jobs. The Admin of a
project release can export the entire release as a TAR.GZ file. Then the release can be uncompressed
on a remote node, and its deployments can be started and administered using the new
dsxrcommand line utility. Note that the docker images inside of the project release must be transferred to the remote location manually. Learn more
- In the new Workers tab of a project release, a Deployment Admin can now select and configure workers, including custom images. The Deployment Admin can then select the updated worker when they deploy a job.
- In the new SSHD service panel in the Admin Console, a DSX administrator
can enable SSHD so that users (using a public/public SSH key pair) can ssh directly to the DSX Local
cluster through a secure port. This is useful for securely uploading directories or large files to
the DSX Local cluster without timing out. Learn more
- An administrator on a DSX Local cluster can now define a .condarc file to
enforce a common conda policy and configuration across the organization. In the new Conda
Management panel in the Admin Console, a DSX administrator can add or remove custom
channels that DSX Local users can pull packages from. Learn
- The uninstallation script can now be run as a sudo user. The script also provides a new
--keep-dockeroption to preserve the existing docker installation. Learn more