Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Home directories have limited space. It is only used for small files. All data should be stored within your designated scratch space.

...

Storage

AI clusterrAll lab's central HPC scratch storage is mounted under /midtier/<lab>/scratch/

Code Block
cwid@ai-login01:~# cd /midtier/labname/scratch/cwid

...

cluster has the following storage systems configured:

Name

Mount point

Use

Is backed up?

Comment

Home

/home

home filesystem. Used to keep small files, configs, codes, scripts, etc

no

Midtier

/midtier/<labname>

each lab has an allocation under/midtier/<labname>/scratch/<cwid>

intended for data that is actively being used or processed

...

, research datasets

no

AI GPFS

/bhii

tbd

no

limited access, granted on special requests

Common File Management

Code Block
# List all files and directories in the scratch directory
ls /midtier/labname/scratch/

# Navigate to a specific subdirectory
cd /midtier/labname/scratch/cwid

# Copy a file from the current directory to another directory
cp data.txt /midtier/labname/scratch/cwid/

# Move the copied file to a different directory
mv /midtier/labname/scratch/cwid/data.txt /midtier/labname/scratch/backup/

# Create a new directory
mkdir /midtier/labname/scratch/cwid/new_project/