/afs (CS home directory)
Home folder mounted over the network (AFS). The data in the folder is backed up to tape daily. Quotas are imposed. This is a good place to keep your important data.
<csid>@madmax:~$ pwd /afs/cs.stanford.edu/u/<csid> <csid>@madmax:~$
/lfs (local server storage)
Each server has a local storage mounted under /lfs. This is the fastest storage that you can get on a given server. Have in mind that these mounts are not backed up
/lfs file systems are useful for keeping local copies of datasets you are currently working on and for the temporary results.
Example of lfs on madmax1 server
user@madmax:~$ df -h Filesystem Size Used Avail Use% Mounted on /dev/sdb1 13T 11T 1006G 92% /lfs/madmax/0 user@madmax:/lfs/madmax/0$ pwd /lfs/madmax/0
Before putting any data on /lfs mount create a directory with your CSID on the mount. (Replace <csid> with your CSID)
<csid>@madmax:/dfs$ cd /lfs/madmax/0/ <csid>@madmax:/lfs/madmax/0$ mkdir <csid>
/dfs (remote storage server)
Filesystems mounted under /dfs are network filesystems. They are useful if you want to copy data from one server to others but they may slow down your programs because all the data needs to be read and written over the network. So unless your programs run on multiple servers and require access to the same data, you are better of using /lfs.
Example of dfs on madmax1 server
user@madmax:/dfs$ df -h ilnfs1:/pool0/scratch0 50T 42T 8.1T 84% /dfs/scratch0 ilnfs1:/pool1/scratch1 56T 53T 4.0T 94% /dfs/scratch1 ilnfs4:/ilnfs2/vol1 56T 42T 15T 75% /dfs/scratch2
Before putting any data on /dfs mount create a directory with your CSID on the mount. (Replace <csid> with your CSID)
<csid>@madmax:/dfs$ cd /dfs/scratch0/ <csid>@madmax:/dfs/scratch0$ mkdir <csid>
We are using AutoFS to mount dfs network storages. If you don't see /dfs/scratchX mounts on the systems just “cd” inside each mount.
<csid>@madmax:/dfs$ cd /dfs/scratch0/ <csid>@madmax:/dfs$ cd /dfs/scratch1/ <csid>@madmax:/dfs$ cd /dfs/scratch2/
Personal /dfs/user/<csid> (remote storage server - SNAP group)
Students can get a personal folder on the network storage server that is mounted under /dfs/user/<csid>. There is a quota for each folder that can be increased if needed.
You can see how much space you use and have left by running:
csid@turing1:~$ df -h ilnfs5:/pool0/user/<csid> 5.0T 299G 4.8T 6% /dfs/user/<csid>
We are using AutoFS to mount dfs network storages. If you don't see your folder /dfs/user/<csid> on the systems just “cd” inside your folder
<csid>@madmax:/dfs$ cd /dfs/user/<csid>