File systems available

The users have at there disposal two types of filesystem:
- A common NFS filesystem for homes and the exper-sw where users can include there own software. Each individual group at LIP as there own software area (exper-sw) but access it's restricted. Each user should ask there group leader if he it's allowed to install there own software there.
- A lustre filesystem for the

= Import Information =

The home file-system is not shared between the submission hosts and the execution hosts. As a result, it is the user responsibility to transfer data and applications to/from the execution machines.
The /exper-sw area (NFS) it's shared between the submission hosts and the execution hosts.
All of the lustre file system volumes are shared between the submission hosts and the execution hosts.

Directories and filesystems

The fermi machines provide a wide set of filesystems so that users can access their data and applications.
The available filesystems in login machines are:

# df -h
Filesystem              Size  Used Avail Use% Mounted on
nfs01:/exports/exper-sw 2.8T  2.0T 767G  73% /exper-sw                  ---> NFS fs for local software
se16:/ams             200G   33M   200G   1% /home/ams                  ---> NFS fs LIP homes and data
se16:/comp            600G  6.8G   594G   2% /home/comp                 ---> NFS fs LIP homes and data
se16:/cosmo           600G  8.8G   591G   2% /home/cosmo                ---> NFS fs LIP homes and data
se16:/feno            200G   33M   200G   1% /home/feno                 ---> NFS fs LIP homes and data
se16:/nucria          600G   33M   600G   1% /home/nucria               ---> NFS fs LIP homes and data
se16:/pet             200G   33M   200G   1% /home/pet                  ---> NFS fs LIP homes and data
se16:/sno             200G  8.2G   192G   5% /home/sno                  ---> NFS fs LIP homes and data
se16:/t3atlas         200G  151G   49G   76% /home/t3atlas              ---> NFS fs LIP homes and data
se16:/t3cms           200G   29G   172G  15% /home/t3cms                ---> NFS fs LIP homes and data
se17:/x               4.6T  4.4T   165G  97% /x                         ---> NFS fs LIP ATLAS users
mdt02@tcp:/t3atlas     61T   24T   34T   42% /gstore/t3atlas            ---> Lustre FS  Tier-3 LIP ATLAS users 
mdt02@tcp:/T3CMS       81T   11T   66T   15% /gstore/t3cms              ---> Lustre FS  Tier-3 LIP CMS   users
mdt03@tcp:/calo        72T   62T   6.6T  91% /lstore/calo               ---> Lustre FS for ATLAS users
mdt02@tcp:/cmslocal   6.4T  5.6T   541G  92% /lstore/cms                ---> Lustre FS for CMS   users
mdt03@tcp:/comp        41T  9.0T   30T   24% /lstore/comp               ---> Lustre FS for COMP  users
mdt03@tcp:/sno         10T  6.4T   3.2T  67% /lstore/sno                ---> Lustre FS for SNOW  users
se27:/ams              11T  5.9T   4.2T  59% /z/ams                     ---> NFS    FS for AMS   users
se27:/comp             11T  3.8T   6.3T  38% /z/comp                    ---> NFS    FS for COMP  users
se16:/csys            200G   33M   200G   1% /home/csys                 ---> Lustre FS for AUGER users
mdt04@tcp:/auger       36T   22T   12T   65% /lstore/auger              ---> Lustre FS for AUGER users
mdt04@tcp:/hpclip     6.4T  546M   6.0T   1% /lstore/hpclip             ---> Lustre FS for HPC   users
mdt04@tcp:/lattes     5.9T   86G   5.5T   2% /lstore/lattes             ---> Lustre FS for LATTS users
mdt04@tcp:/pet        461G  115G   323G  27% /lstore/pet                ---> Lustre FS for PET   users
cvmfs2                 20G   17G   3.3G  84% /cvmfs/cms.cern.ch         ---> CVMFS  FS for CMS   users
cvmfs2                 20G  6.1G   14G   32% /cvmfs/atlas.cern.ch       ---> CVFMS  FS for ATLAS users

Important Disclaimer

Manipulating huge sets of small files generates performance degradation issues in /lustre due to the lock management. Therefore, you should not
- Compile anything under /lustre
- Store and access databases under /lustre

Access data via '''/lustre'''

SCOPE: Store and access big/huge data files.
/lustre is a shared filesystem (present in the execution hosts and in the submission hosts) dedicated for the storage of big/huge files. The following directories are accessible for the local LIP groups:
1. /lustre/lip.pt/data/calo
2. /lustre/lip.pt/data/cosmo
3. /lustre/lip.pt/data/pet
4. /lustre/lip.pt/data/sno
Groups involved in WLCG transfer data using grid technologies to the following locations
1. ATLAS: /lustre/lip.pt/data/atlas/atlaslocalgroupdisk (calo group has read access to this filesystem)

Important Disclaimer

Manipulating huge sets of small files generates performance degradation issues in /lustre due to the lock management. Therefore, you should not
- Compile anything under /lustre
- Store and access databases under /lustre

-  ⇤ ← Revision 1 as of 2016-12-07 14:45:30 → 
  Size: 2524
  Editor: jpina
  Comment:
+   ← Revision 17 as of 2016-12-07 17:24:54 → ⇥
  Size: 5206
  Editor: jpina
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-== Directories and filesystems ==
 * The ui6 machines provide a wide set of filesystems so that users can access their data and applications.
+## page was renamed from Computing/LIP_Lisbon_Farm/Data_Management
## page was renamed from Computing/LIP_Farm/Data_Management
<<TableOfContents()>>
-Line 4:
+Line 5:
- * The available filesystems in LIP-Lisbon login machines are:
+= File systems available =

 * The users have at there disposal two types of filesystem:
  * A common NFS filesystem for homes and the exper-sw where users can include there own software. Each individual group at LIP as there own software area (exper-sw) but access it's restricted. Each user should ask there group leader if he it's allowed to install there own software there. 
  * A lustre filesystem for the

= Import Information = 

 * The '''home file-system is not shared''' between the submission hosts and the execution hosts. As a result, it is the user responsibility to transfer data and applications to/from the execution machines.
 * The /exper-sw area (NFS) it's shared between the submission hosts and the execution hosts.
 * All of the lustre file system volumes are shared between the submission hosts and the execution hosts.
 

= Directories and filesystems =
 * The fermi machines provide a wide set of filesystems so that users can access their data and applications.

 * The available filesystems in login machines are:
-Line 9:
+Line 26:
-mdt02@tcp:/atlas         12T  8.4T  2.7T  76% /lustre/atlas   ---> Lustre FS for ATLAS Tier-2 and Tier-3 grid activities
mdt02@tcp:/auger         28T   24T  2.9T  90% /lustre/auger   ---> Lustre FS for AUGER local users
mdt02@tcp:/calor         72T   37T   32T  54% /lustre/calo    ---> Lustre FS for CALO local users
mdt02@tcp:/pem          186G  118G   60G  67% /lustre/pet     ---> Lustre FS for PET local users
mdt02@tcp:/sno           10T  1.1T  8.5T  12% /lustre/sno     ---> Lustre FS for SNO local users
st011:/exports/soft      20G   12G  7.3G  61% /soft           ---> NFS fs for local software
st011:/exports/lip-tmp  2.0T  126G  1.9T   7% /hometmp        ---> NFS fs for temporary / scratch storage
st011:/exports/home      20G   12G  7.3G  61% /v/home         ---> NFS fs LIP homes and data
st002:/exports/home      22G  6.2G   14G  31% /u/home         ---> NFS fs LIP homes and data
st002:/exports/data      22G  6.2G   14G  31% /u/data         ---> NFS fs LIP homes and data
st002:/exports/x         12T  9.7T  2.2T  82% /x              ---> NFS fs LIP homes and data
st012:/exports           20G  3.8G   15G  20% /z              ---> NFS fs LIP homes and data
+nfs01:/exports/exper-sw 2.8T  2.0T 767G  73% /exper-sw                  ---> NFS fs for local software
se16:/ams             200G   33M   200G   1% /home/ams                  ---> NFS fs LIP homes and data
se16:/comp            600G  6.8G   594G   2% /home/comp                 ---> NFS fs LIP homes and data
se16:/cosmo           600G  8.8G   591G   2% /home/cosmo                ---> NFS fs LIP homes and data
se16:/feno            200G   33M   200G   1% /home/feno                 ---> NFS fs LIP homes and data
se16:/nucria          600G   33M   600G   1% /home/nucria               ---> NFS fs LIP homes and data
se16:/pet             200G   33M   200G   1% /home/pet                  ---> NFS fs LIP homes and data
se16:/sno             200G  8.2G   192G   5% /home/sno                  ---> NFS fs LIP homes and data
se16:/t3atlas         200G  151G   49G   76% /home/t3atlas              ---> NFS fs LIP homes and data
se16:/t3cms           200G   29G   172G  15% /home/t3cms                ---> NFS fs LIP homes and data
se17:/x               4.6T  4.4T   165G  97% /x                         ---> NFS fs LIP ATLAS users
mdt02@tcp:/t3atlas     61T   24T   34T   42% /gstore/t3atlas            ---> Lustre FS  Tier-3 LIP ATLAS users 
mdt02@tcp:/T3CMS       81T   11T   66T   15% /gstore/t3cms              ---> Lustre FS  Tier-3 LIP CMS   users
mdt03@tcp:/calo        72T   62T   6.6T  91% /lstore/calo               ---> Lustre FS for ATLAS users
mdt02@tcp:/cmslocal   6.4T  5.6T   541G  92% /lstore/cms                ---> Lustre FS for CMS   users
mdt03@tcp:/comp        41T  9.0T   30T   24% /lstore/comp               ---> Lustre FS for COMP  users
mdt03@tcp:/sno         10T  6.4T   3.2T  67% /lstore/sno                ---> Lustre FS for SNOW  users
se27:/ams              11T  5.9T   4.2T  59% /z/ams                     ---> NFS    FS for AMS   users
se27:/comp             11T  3.8T   6.3T  38% /z/comp                    ---> NFS    FS for COMP  users
se16:/csys            200G   33M   200G   1% /home/csys                 ---> Lustre FS for AUGER users
mdt04@tcp:/auger       36T   22T   12T   65% /lstore/auger              ---> Lustre FS for AUGER users
mdt04@tcp:/hpclip     6.4T  546M   6.0T   1% /lstore/hpclip             ---> Lustre FS for HPC   users
mdt04@tcp:/lattes     5.9T   86G   5.5T   2% /lstore/lattes             ---> Lustre FS for LATTS users
mdt04@tcp:/pet        461G  115G   323G  27% /lstore/pet                ---> Lustre FS for PET   users
cvmfs2                 20G   17G   3.3G  84% /cvmfs/cms.cern.ch         ---> CVMFS  FS for CMS   users
cvmfs2                 20G  6.1G   14G   32% /cvmfs/atlas.cern.ch       ---> CVFMS  FS for ATLAS users
-Line 22:
+Line 53:
- * The available filesystems in LIP-Coimbra login machines are:
-Line 24:
+Line 54:
-{{{
$ df -h
Filesystem                        Size  Used Avail Use% Mounted on
lustre@tcp:/gstore                101T   71T   25T  75% /gstore                     ---> Lustre fs dedicated for atlas tier2 grid activities
llustre@tcp:/lstore-1              34T  9.4T   23T  30% /lstore/atlaslocalgroupdisk ---> Lustre fs dedicated for atlas tier3 grid users
llustre@tcp:/lstore-2              43T   38T  2.9T  93% /lstore/atlas               ---> Lustre fs dedicated for atlas local users
llustre@tcp:/lstore-3              18T   12T  5.5T  68% /lstore/lip                 ---> Lustre fs dedicated for lip local users
192.168.2.44:/software            3.9T  882G  3.0T  23% /software                   ---> NFS fs for local software
192.168.2.30:/exports/home-atlas   13T   12T  1.5T  89% /home/local/atlas           ---> NFS fs for ATLAS local homes
192.168.2.30:/exports/home-lip     13T   12T  1.4T  90% /home/local/lip             ---> NFS fs for LIP local homes
}}}
+= Important Disclaimer =
 * Manipulating huge sets of small files generates performance degradation issues in /lustre due to the lock management. Therefore, you should not
  * Compile anything under '''/lustre'''
  * Store and access databases under '''/lustre'''

== Access data via '''/lustre''' ==
 * '''SCOPE: Store and access big/huge data files.'''

 * '''/lustre''' is a shared filesystem (present in the execution hosts and in the submission hosts) dedicated for the '''storage of big/huge files'''. The following directories are accessible for the local LIP groups:
  1. /lustre/lip.pt/data/calo
  1. /lustre/lip.pt/data/cosmo
  1. /lustre/lip.pt/data/pet
  1. /lustre/lip.pt/data/sno

 * Groups involved in WLCG transfer data using grid technologies to the following locations
  1. '''ATLAS''': /lustre/lip.pt/data/atlas/atlaslocalgroupdisk (calo group has read access to this filesystem)

=== Important Disclaimer ===
 * Manipulating huge sets of small files generates performance degradation issues in /lustre due to the lock management. Therefore, you should not
  * Compile anything under '''/lustre'''
  * Store and access databases under '''/lustre'''

Diff for "Computing/LIP_Lisbon_Farm/3_Data_Management"

LIP Users Wiki

Management

LIP Computing

Projectos

Actividades LIP

HELP

File systems available

Directories and filesystems

Important Disclaimer

Access data via '''/lustre'''

Important Disclaimer