Data Transfer using rsync

Take a look at: CAC Virtual Workshop for Data Transfer: rsync

i.e. to copy from your campus laptop to your home directory on the BRB cluster:

If you are not on campus, connect to the Weill VPN.

2. We recommend one uses screen program to conduct the copy in the background:

open terminal window and type:

screen

* At the prompt 'press space' or 'return to end': press space (you remain in screen)
* To exit screen at any time, type: exit

Detach from the screen session: press CTRL + A, then D
Resume your screen session: screen -r

Note: screen has many options to explore. The above should get you started.

3. rsync -av laptopFromDir/ loginid@scu-login01.med.cornell.edu:~/loginToDir/

Note: Be careful with or without the slashes using rsync. The above states "copy everything found under laptopFromDir to my home directory in a new directory called loginToDir that I previously created.

rsync is a powerful tool with many useful options. Here’s a quick list of examples:

-a: Archive mode, preserving symbolic links, devices, attributes, permissions, and ownership.
```
rsync -a /path/to/source/ /path/to/destination/
```
-v: Verbose mode, providing detailed information during the transfer.
```
rsync -v /path/to/source/ /path/to/destination/
```

-r: Recursively syncs folders.

rsync -r /path/to/source/ /path/to/destination/

-nv: Performs a verbose dry run, showing what the command would do without actually making any changes.
```
rsync -nv /path/to/source/ /path/to/destination/
```
-z: Compresses the data during transfer to save bandwidth.
```
rsync -az /path/to/source/ /path/to/destination/
```
-P: Combines --partial and --progress, keeping partially transferred files and showing progress during transfer.
```
rsync -P /path/to/source/ /path/to/destination/
```
--delete: Deletes files in the destination that are not present in the source, ensuring the destination is an exact mirror of the source.
```
rsync -av --delete /path/to/source/ /path/to/destination/
```

-t: Preserves modification times of files.

rsync -t /path/to/source/ /path/to/destination/

--exclude: Excludes files matching specified patterns from the transfer.
```
rsync -av --exclude='*.tmp' /path/to/source/ /path/to/destination/
```

--include: Overrides exclusions for specific patterns.

rsync -av --exclude='*.tmp' --include='important.tmp' /path/to/source/ /path/to/destination/