...
Login to the AI cluster
AI cluster is accessiUse SSH to log in to the clusteraccessible via terminal SSH sessions. You need to be connecting from the WCM network, or have VPN installed and enabled. Replace <cwid> with your credentials.
| Code Block |
|---|
ssh <cwid>@ai-login01.med.cornell.edu
# or
ssh <cwid>@ai-login02.med.cornell.edu |
Once logged on:
| Code Block |
|---|
Last login: Fri Jan 3 11:35:53 2025 from 157.000.00.00 <cwid>@ai-login01:~$ <cwid>@ai-login01:~$ pwd /home/<cwid> <cwid>@ai-login01:~$ |
Home directories have limited space. It is only used for small files. All data should be stored within your designated scratch space.
...
Storage
AI cluster has the following storage systems configured:
Name | Mount point | Use | Is backed up? | Comment |
|---|---|---|---|---|
Home |
| home filesystem. Used to keep small files, configs, codes, scripts, etc | no | have limited space. It is only used for small files |
Midtier |
| each lab has an allocation under intended for data that is actively being used or processed, research datasets | no | |
AI GPFS |
| tbd | no | limited Parallel file system for data intensive workloads. Limited access, granted on special requests. |
Common File Management
| Code Block |
|---|
# List all files and directories in the scratch directory ls /midtier/labname/scratch/ # Navigate to a specific subdirectory cd /midtier/labname/scratch/cwid # Copy a file from the current directory to another directory cp data.txt /midtier/labname/scratch/cwid/ # Move the copied file to a different directory mv /midtier/labname/scratch/cwid/data.txt /midtier/labname/scratch/backup/ # Create a new directory mkdir /midtier/labname/scratch/cwid/new_project/ |