Filesystems available to user on Katabatic
Different file systems are available for different purposes.
/u/$username – users home files with quota. Used for un-reproducible data (like source code). Is stored on drizzle using DMF.
/scratch/$username – short term storage for fast data access. A local scratch file system for temporary working space - you can create files in /scratch/$username but should not leave anything in here once you're finished working with it. Currently this file system is around 13T in size.
What is DMF?
DMF is a hierarchical file storage system and allows you to over allocate disk space by transparently moving files to tape when not used. There may be slight delays between requesting a file and actually using it.
Current there exist DMF client tools such as dmls, dmget, dmput, etc to display the status of your files.
Secure Copy (scp)
Secure copy is part of the ssh package and allows you to securely copy files from one machine to another. It is very similar to the 'cp' command, encrypts transferred data and allows you to recursively send all the files in a directory.
The first argument is the file to copy and the second is the location to copy the file to. You can copy from one local location to another remote location, or even transfer files from one remote location to another. Use the '-r' argument to copy all files in a directory.
Eg: scp mylocalfile.txt username@remotehost:/some/path
eg: scp massdata.csv nsonneve@katabatic.sf.utas.edu.au:~/massstorage
eg: scp bob@katabatic.sf.utas.edu.au:/short/bob/blah.txt ~
eg: scp user@remote1:/test.txt user@remote2:~
There is a Windows utility called WinSCP that allows you to do the same graphically. Available from here. Also available is a GUI app for Mac OSX, Fugu. Please use SCP protocol setting in both.
FTP and Windows File Shares (SMB)are not available.
