Home folder mounted over the network (AFS). The data in the folder is backed up to tape daily. Quotas are imposed. This is a good place to keep your important data.

<csid>@madmax:~$ pwd
/afs/cs.stanford.edu/u/<csid>
<csid>@madmax:~$ 

Each server has a local storage mounted under /lfs. This is the fastest storage that you can get on a given server. Have in mind that these mounts are not backed up

/lfs file systems are useful for keeping local copies of datasets you are currently working on and for the temporary results.

Example of lfs on madmax1 server

user@madmax:~$ df -h
Filesystem              Size  Used Avail Use% Mounted on
/dev/sdb1                13T   11T 1006G  92% /lfs/madmax/0

user@madmax:/lfs/madmax/0$ pwd
/lfs/madmax/0

Before putting any data on /lfs mount create a directory with your CSID on the mount. (Replace <csid> with your CSID)

<csid>@madmax:/dfs$ cd /lfs/madmax/0/
<csid>@madmax:/lfs/madmax/0$ mkdir <csid>

Filesystems mounted under /dfs are network filesystems. They are useful if you want to copy data from one server to others but they may slow down your programs because all the data needs to be read and written over the network. So unless your programs run on multiple servers and require access tot he same data, you are better of using /lfs.

Example of dfs on madmax1 server

user@madmax:/dfs$ df -h
ilnfs1:/pool0/scratch0   50T   42T  8.1T  84% /dfs/scratch0
ilnfs1:/pool1/scratch1   56T   53T  4.0T  94% /dfs/scratch1
ilnfs4:/ilnfs2/vol1      56T   42T   15T  75% /dfs/scratch2

Before putting any data on /dfs mount create a directory with your CSID on the mount. (Replace <csid> with your CSID)

<csid>@madmax:/dfs$ cd /dfs/scratch0/
<csid>@madmax:/dfs/scratch0$ mkdir <csid>

We are using AutoFS to mount dfs network storages. If you don't see /dfs/scratchX mounts on the systems just “cd” inside each mount.

<csid>@madmax:/dfs$ cd /dfs/scratch0/
<csid>@madmax:/dfs$ cd /dfs/scratch1/
<csid>@madmax:/dfs$ cd /dfs/scratch2/

  • hints/storefiles.txt
  • Last modified: 2019/01/09 16:53
  • by admin