Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents

...

Installation

SCU - BRB Cluster

To connect to the SCU - BRB cluster, you must be connected to the WCM VPN service

Configure Local SSH Config File

Configure your ~/.ssh/config file on your local workstation to properly connect to the internal node that will run your Jupyter Notebook:

Replace MY_CWID, with your CWID:

Code Block
Host scu-node*
        user MY_CWID
        ProxyCommand ssh -W %h:%p scu-login02
        
Host scu-login02
        Hostname scu-login02.med.cornell.edu
        user MY_CWID
        ServerAliveInterval 60
        TCPKeepAlive yes

Reserve session on node

Jupyter-notebook can be installed from within a node. To reserve an interactive session on a node, the following commands can be run:

...

More slurm information can be found here:

Perform jupyter-notebook installation

Code Block
[rma3001@scu-node001 ~]$ conda create -n jupyter-notebook
[rma3001@scu-node001 ~]$ conda activate jupyter-notebook
[rma3001@scu-node001 ~]$ conda install -c anaconda jupyter

...

Connecting to Jupyter Notebook

Prerequisite

Configure Local SSH Config File

Configure your ~/.ssh/config file on your local workstation to properly connect to the internal node that will run your Jupyter Notebook:

...

Code Block
Host scu-node*
        user MY_CWID
        ProxyCommand ssh -W %h:%p scu-login02
        
Host scu-login02
        Hostname scu-login02.med.cornell.edu
        user MY_CWID
        ServerAliveInterval 60
        TCPKeepAlive yes

Info

For seamless access to the cluster and Jupyter Notebooks, ensure your SSH Keys are configured

Run Jupyter Notebook

BRB
Jupyter notebook can be started through the following command:

...

Keep track of the http://127.0.0.1:port/?token link. This will be needed once the SSH connection is established.

For Curie (Greenberg) change --port=8959

From another terminal

ssh -o ProxyCommand="ssh -W %h:%p userid@aphrodite.med.cornell.edu" -L localhost:8959:node159.panda.pbtech:8959userid@node159.panda.pbtech

SCU - Cluster Connection

From within a different terminal, edit the ~/.ssh/config file on your local workstation to include the following, replace MY_CWID, with your CWID:

...

On your local machine’s browser, enter the token link that was outputted when Jupyter notebook was run, beginning with http://127.0.0.1:port/?token=…

...

Contact

Contact scu@med.cornell.edu if you have any questions or if any issues are encountered.

...