Data Transfer Between HPC & MCIT

Lab directories which are mounted by PI's desktop PC's are stored in MCIT storage, which is not directly accessible from the phoenix HPC. The only location which can mount both HPC and MCIT storage locations is hpc-vm0. To transfer data between these two, the following steps must be taken:

• contact HPC admins to get an account on hpc-vm0

• make sure the public ssh key from the system you wish to log in from is included in the ~/.ssh/authorized_keys file for your account on hpc-vm0. Thus, if you want to log in from phoenix, you need to have your phoenix public ssh key in the authorized_keys file on hpc-vm0. The same goes for desktop login.

• log from the terminal using ssh:

$ ssh ${USER}@hpc-vm0.med.nyu.edu -A

• mount the desired MCIT storage location

$ mount mnt/research.nyumc.org/research/smith-research-lab/

Now, the mnt directory at the location where you ran the command will contain the path to the MCIT storage

To copy files, you should use rsync like this:

rsync --dry-run -vhrtP source_dir target_dir

Where source_dir is the path to the directory you want to copy, and target_dir is the location to copy it to. Run it first with the --dry-run option to make sure it looks correct, then run it again without --dry-run to start the actual copying. Might be a good idea to run this from within screen.

MCIT Location Paths

Note that the path to a location on MCIT storage can be written different ways, depending on the protocol being used to access it. The following are equivalent:

• smb://research.nyumc.org/research/smith-research-lab: The Windows & Mac desktop shared directory path

• \\research.nyumc.org\research\smith-research-lab: Windows domain path (??)

• mnt/research.nyumc.org/research/smith-research-lab/: Linux mount path

MCIT Drive Mapping

If you are on a domain PC your R: drive will map to \\research-cifs.nyumc.org\research instead of your specific lab. If you are not on a domain PC you have the option to map to whichever you prefer. Paths for PC:

\\research-cifs.nyumc.org\Research
\\research-cifs.nyumc.org\Research\[LabName]

Paths for Mac:

• smb://research-cifs.nyumc.org/Research

• smb://research-cifs.nyumc.org/Research/[LabName] Map a drive on a PC:

1. On the Start menu, Click Computer.
2. Click Map Network Drive.
3. In the Folder box, type the path to the server (see above)
4. Click Connect Using Different Credentials, and then click Finish.
5. In the User name box, type ‘nyumc\kerberosID’
6. In the Password box, type your password for the domain. Mount a drive on a Mac:​
7. From the Mac OS X Finder, hit Command+K to bring up the ‘Connect to Server’ or also from Finder, click on ‘Go’ and click on ‘Connect to Server’ from the dropdown.
8. Enter the path to the network drive you want to map to (see above)
9. Press the ‘+’ button to add it to your list of favorite servers
10. Enter your nyumc\Kerberos ID and password. Finally click “OK” to mount the network drive.
11. The drive will now appear on your desktop and in the Finder window sidebar and you can access the network share like any other folder at this point, so long as it’s maintained on the same network.