Jupyter Enterprise Gateway

Jupyter Enterprise Gateway is a web server (built directly on Jupyter Kernel Gateway) that enables the ability to launch kernels on remote servers throughout the enterprise. This enables better resource management since the web server is no longer the single location for kernel activity, which in Big Data environments, can result in large processes. By distributing these resources across the enterprise, some of which can be managed by resource management applications (e.g., Yarn), the number of active kernels can be dramatically increased.

User Documentation

• Getting started
  • Installing Enterprise Gateway
  • Enabling Distributed Kernel support
  • Installing support for Scala (Apache Toree kernel)
  • Installing support for Python (IPython kernel)
  • Installing support for R (IRkernel)
  • Installing support for R (IRkernel)
• Use Cases
• Features
• System Architecture
  • Enterprise Gateway Process Proxy Extensions
  • Remote Mapping Kernel Manager
  • Remote Kernel Manager
  • Process Proxy
  • Launchers
  • Extending Enterprise Gateway

Configuration

• Configuration options
  • Supported environment variables:
• Troubleshooting
  • I’m trying to launch a (Python/Scala/R) kernel in Yarn Cluster Mode but it failed with a “Kernel error” and State: ‘FAILED’.
  • I’m trying to launch a (Python/Scala/R) kernel in Yarn Client Mode but it failed with a “Kernel error” and an AuthenticationException:

Contributor Documentation

• Contributing to Jupyter Enterprise Gateway
• Development Workflow
  • Prerequisites
  • Clone the repo
  • Make
  • Build a conda environment
  • Build the wheel file
  • Build the kernelspec tar file
  • Run the Enterprise Gateway server
  • Build the docs
  • Run the unit tests
• Project Roadmap

About Jupyter Enterprise Gateway

• Summary of changes

Questions? Suggestions?

• Jupyter mailing list
• Jupyter website
• Stack Overflow - Jupyter
• Stack Overflow - Jupyter-notebook

Indices and tables

• Index
• Module Index
• Search Page