The data from Malargue data resides in LUSTRE system with the ownership Auger
top dir for data is: /lustre/auger/cosmo/auger/Data/MARTA/
Dirs inside:
GianniNavarra : Data from the Gianni Navarra tank
- RAW :The RAW data grouped by RUN. Inside each Run the .txt from MARTA and a dir with Tank data
- donotuse_RAW_MARTA
- donotuse_RAW_TANK
- Preproc : to contain the preprocessed data
- log_GN_lustre :to log the procedures done...
TierradelFuego : Data from the Tierra del Fuego tank
- RAW : The RAW data. the txt from MARTA data are directly in this dir
- temp_transf : temporary directory to transfer data into
MARTA DATA
The data in Malargue reside in the acquisition PC in the directory /root/RAW_GN_MARTA/
to copy enter the raspberry acquisition PC and then:
(notice -t to preserve timestamps and -z to use compression) rsync -zrvt /root/RAW_GN_MARTA/R*.txt auger@lnlip01.lip.pt:/lustre/auger/cosmo/auger/Data/MARTA/temp_transf
CHECK if the files are in LUSTRE and copy to the final folder Go to lustre! and copy the interesting files to its final place (Raw_...) and delete the temporary data
CAREFULLY check and delete the text raw files
find /root/RAW_GN_MARTA -iname 'R*.txt'
find /root/RAW_GN_MARTA -iname 'R*.txt' -exec rm {} \;
TANK DATA
The data from the tank resides in the mini-vaio in the e-crlab account. It is in: /home/e-crlab/data
to sync enter the vaio and: rsync -zrvt /home/e-crlab/data auger@lnlip01.lip.pt:/lustre/auger/cosmo/auger/Data/MARTA/temp_transf
CHECK if the files are in LUSTRE and copy to the final folder
Go to lustre! and copy the interesting files to its final place (RAW/RXXXX/...) and delete the temporary data
CAREFULLY check and delete the text raw files
find ~e-crlab/data -iname 'R*.txt'
find ~e-crlab/data -iname 'R*.txt' -exec rm {} \;