Research data storage

DCSR NAS

DCSR NAS

General information

How to access the DCSR NAS

If you don't have a DCSR NAS (Network Attached Storage) storage yet and you would like one, the PI (Principal Investigator) of your project needs to fill up a request application form on the following web interface:

https://conference.unil.ch/research-resource-requests/

Once the DCSR has accepted the request and the access has been granted to you by your PI, you will be able to access your DCSR NAS storage by one of the following method:

Access from a laptop

laptop <-> NAS instructions

Access from the cluster

If you have access to the compute clusters of the DCSR, the data stored on the NAS is directly accessible under /nas. See:

cluster <-> NAS instructions

 

In case you have asked for the "sensitive data" special option for your storage, please follow the specific instructions to access RECHERCHE-S on the following page:

How to manage sensitive data on UNIL NAS

General structure of the NAS

The general structure of the directories on the DCSR NAS (Network Attached Storage) is:

nasdcsr.unil.ch/RECHERCHE/FAC/<your_faculty>/<your_department>/<your_PI>/<your_project>

On mac

smb://nasdcsr.unil.ch/RECHERCHE/FAC/<your_faculty>/<your_department>/<your_PI>/<your_project>

On Windows

\\nasdcsr.unil.ch\RECHERCHE\FAC\<your_faculty>\<your_department>\<your_PI>\<your_project>

 

In case you have asked for the "personal data" special option for your storage, please use RECHERCHE-P with:

nasdcsr.unil.ch/RECHERCHE-P/FAC/<your_faculty>/<your_department>/<your_PI>/<your_project>

On mac

smb://nasdcsr.unil.ch/RECHERCHE-P/FAC/<your_faculty>/<your_department>/<your_PI>/<your_project>

On Windows

\\nasdcsr.unil.ch\RECHERCHE-P\FAC\<your_faculty>\<your_department>\<your_PI>\<your_project>

 

In case you have asked for the "sensitive data" special option for your storage, please follow the specific instructions to access RECHERCHE-S on the following page:

How to manage sensitive data on UNIL NAS

What are the /D1c, /D2c, and /LTS subdirectories?

In your project directory you will see at least a D2c and a LTS directory, with the following meanings/purposes:

<your_project>/D2c

D2c means "data 2 copies". This directory has an off-site backup. This is where you can put your research data during the life time of your project. Please note that in case you are using the HPC cluster and perform computations on this data, your are advised to copy this data to a fast storage (i.e. /scratch or /work) to speed up computations (see this page).

<your_project>/LTS

LTS means "Long Term Storage". This data will be kept for a very long time on the UNIL storage (a decade, on tapes). This is where you should put the part of your data that needs to be archived e.g. at the end of your project. When you reach this point, you will then be asked to make a description of your data ("meta-data"). See "Long-term storage of research data" section here: https://www.unil.ch/openscience/en/home/menuinst/open-research-data/gerer-les-donnees-de-recherche-research-data-management/stockage--securite.html

Users who explicitly asked for it will also have a D1c directory:

<your_project>/D1c

D1c means "data 1 copy". This data has no backup (and may be lost). This is where you can put e.g. some reference data that you downloaded from an external source, and that can easily be recovered again from the same external source, in case the data get lost in /D1c.

Long term storage at DCSR and other data repositories

 

DCSR NAS

Recovering files from the DCSR NAS

Introduction

If you have deleted or corrupted a file you can recover it from the daily snapshots that are performed on the DCSR NAS

From the Curnagl login node

 

ssh username@curnagl.dcsr.unil.ch
cd /nas/FAC/<your_faculty>/<your_department>/<your_PI>/<your_project>/D2c
cd .snapshot
ls
daily_1month_CAMPUS_REC_2021-12-06_12:00 daily_1month_CAMPUS_REC_2021-12-31_12:00 daily_3month_CAMPUS_REC_2021-10-27_18:00 daily_3month_CAMPUS_REC_2021-11-21_18:00 daily_3month_CAMPUS_REC_2021-12-16_18:00
daily_1month_CAMPUS_REC_2021-12-07_12:00 daily_1month_CAMPUS_REC_2022-01-01_12:00 daily_3month_CAMPUS_REC_2021-10-28_18:00 daily_3month_CAMPUS_REC_2021-11-22_18:00 daily_3month_CAMPUS_REC_2021-12-17_18:00
daily_1month_CAMPUS_REC_2021-12-08_12:00 daily_1month_CAMPUS_REC_2022-01-02_12:00 daily_3month_CAMPUS_REC_2021-10-29_18:00 daily_3month_CAMPUS_REC_2021-11-23_18:00 daily_3month_CAMPUS_REC_2021-12-18_18:00
daily_1month_CAMPUS_REC_2021-12-09_12:00 daily_1month_CAMPUS_REC_2022-01-03_12:00 daily_3month_CAMPUS_REC_2021-10-30_18:00 daily_3month_CAMPUS_REC_2021-11-24_18:00 daily_3month_CAMPUS_REC_2021-12-19_18:00
daily_1month_CAMPUS_REC_2021-12-10_12:00 daily_1month_CAMPUS_REC_2022-01-04_12:00 daily_3month_CAMPUS_REC_2021-10-31_18:00 daily_3month_CAMPUS_REC_2021-11-25_18:00 daily_3month_CAMPUS_REC_2021-12-20_18:00
daily_1month_CAMPUS_REC_2021-12-11_12:00 daily_3month_CAMPUS_REC_2021-10-07_18:00 daily_3month_CAMPUS_REC_2021-11-01_18:00 daily_3month_CAMPUS_REC_2021-11-26_18:00 daily_3month_CAMPUS_REC_2021-12-21_18:00
daily_1month_CAMPUS_REC_2021-12-12_12:00 daily_3month_CAMPUS_REC_2021-10-08_18:00 daily_3month_CAMPUS_REC_2021-11-02_18:00 daily_3month_CAMPUS_REC_2021-11-27_18:00 daily_3month_CAMPUS_REC_2021-12-22_18:00
daily_1month_CAMPUS_REC_2021-12-13_12:00 daily_3month_CAMPUS_REC_2021-10-09_18:00 daily_3month_CAMPUS_REC_2021-11-03_18:00 daily_3month_CAMPUS_REC_2021-11-28_18:00 daily_3month_CAMPUS_REC_2021-12-23_18:00
daily_1month_CAMPUS_REC_2021-12-14_12:00 daily_3month_CAMPUS_REC_2021-10-10_18:00 daily_3month_CAMPUS_REC_2021-11-04_18:00 daily_3month_CAMPUS_REC_2021-11-29_18:00 daily_3month_CAMPUS_REC_2021-12-24_18:00
daily_1month_CAMPUS_REC_2021-12-15_12:00 daily_3month_CAMPUS_REC_2021-10-11_18:00 daily_3month_CAMPUS_REC_2021-11-05_18:00 daily_3month_CAMPUS_REC_2021-11-30_18:00 daily_3month_CAMPUS_REC_2021-12-25_18:00
daily_1month_CAMPUS_REC_2021-12-16_12:00 daily_3month_CAMPUS_REC_2021-10-12_18:00 daily_3month_CAMPUS_REC_2021-11-06_18:00 daily_3month_CAMPUS_REC_2021-12-01_18:00 daily_3month_CAMPUS_REC_2021-12-26_18:00
daily_1month_CAMPUS_REC_2021-12-17_12:00 daily_3month_CAMPUS_REC_2021-10-13_18:00 daily_3month_CAMPUS_REC_2021-11-07_18:00 daily_3month_CAMPUS_REC_2021-12-02_18:00 daily_3month_CAMPUS_REC_2021-12-27_18:00
daily_1month_CAMPUS_REC_2021-12-18_12:00 daily_3month_CAMPUS_REC_2021-10-14_18:00 daily_3month_CAMPUS_REC_2021-11-08_18:00 daily_3month_CAMPUS_REC_2021-12-03_18:00 daily_3month_CAMPUS_REC_2021-12-28_18:00
daily_1month_CAMPUS_REC_2021-12-19_12:00 daily_3month_CAMPUS_REC_2021-10-15_18:00 daily_3month_CAMPUS_REC_2021-11-09_18:00 daily_3month_CAMPUS_REC_2021-12-04_18:00 daily_3month_CAMPUS_REC_2021-12-29_18:00
daily_1month_CAMPUS_REC_2021-12-20_12:00 daily_3month_CAMPUS_REC_2021-10-16_18:00 daily_3month_CAMPUS_REC_2021-11-10_18:00 daily_3month_CAMPUS_REC_2021-12-05_18:00 daily_3month_CAMPUS_REC_2021-12-30_18:00
daily_1month_CAMPUS_REC_2021-12-21_12:00 daily_3month_CAMPUS_REC_2021-10-17_18:00 daily_3month_CAMPUS_REC_2021-11-11_18:00 daily_3month_CAMPUS_REC_2021-12-06_18:00 daily_3month_CAMPUS_REC_2021-12-31_18:00
daily_1month_CAMPUS_REC_2021-12-22_12:00 daily_3month_CAMPUS_REC_2021-10-18_18:00 daily_3month_CAMPUS_REC_2021-11-12_18:00 daily_3month_CAMPUS_REC_2021-12-07_18:00 daily_3month_CAMPUS_REC_2022-01-01_18:00
daily_1month_CAMPUS_REC_2021-12-23_12:00 daily_3month_CAMPUS_REC_2021-10-19_18:00 daily_3month_CAMPUS_REC_2021-11-13_18:00 daily_3month_CAMPUS_REC_2021-12-08_18:00 daily_3month_CAMPUS_REC_2022-01-02_18:00
daily_1month_CAMPUS_REC_2021-12-24_12:00 daily_3month_CAMPUS_REC_2021-10-20_18:00 daily_3month_CAMPUS_REC_2021-11-14_18:00 daily_3month_CAMPUS_REC_2021-12-09_18:00 daily_3month_CAMPUS_REC_2022-01-03_18:00
daily_1month_CAMPUS_REC_2021-12-25_12:00 daily_3month_CAMPUS_REC_2021-10-21_18:00 daily_3month_CAMPUS_REC_2021-11-15_18:00 daily_3month_CAMPUS_REC_2021-12-10_18:00 daily_3month_CAMPUS_REC_2022-01-04_18:00
daily_1month_CAMPUS_REC_2021-12-26_12:00 daily_3month_CAMPUS_REC_2021-10-22_18:00 daily_3month_CAMPUS_REC_2021-11-16_18:00 daily_3month_CAMPUS_REC_2021-12-11_18:00 SIQ-743c22b777679f9ed3c08b5b9ac6bceb-restore-latest
daily_1month_CAMPUS_REC_2021-12-27_12:00 daily_3month_CAMPUS_REC_2021-10-23_18:00 daily_3month_CAMPUS_REC_2021-11-17_18:00 daily_3month_CAMPUS_REC_2021-12-12_18:00 SIQ-7b67c2c289b36a2d86a688ade445aa31-latest
daily_1month_CAMPUS_REC_2021-12-28_12:00 daily_3month_CAMPUS_REC_2021-10-24_18:00 daily_3month_CAMPUS_REC_2021-11-18_18:00 daily_3month_CAMPUS_REC_2021-12-13_18:00
daily_1month_CAMPUS_REC_2021-12-29_12:00 daily_3month_CAMPUS_REC_2021-10-25_18:00 daily_3month_CAMPUS_REC_2021-11-19_18:00 daily_3month_CAMPUS_REC_2021-12-14_18:00
daily_1month_CAMPUS_REC_2021-12-30_12:00 daily_3month_CAMPUS_REC_2021-10-26_18:00 daily_3month_CAMPUS_REC_2021-11-20_18:00 daily_3month_CAMPUS_REC_2021-12-15_18:00

Navigate to the date of the last known existence of the file and copy it to a directory of your choice

From Windows

Mount the project directory as described in https://wiki.unil.ch/ci/books/research-data-storage/page/dcsr-nas

Navigate to the project directory and right click

Screenshot 2022-01-05 at 11.37.37.png

Select Properties-> Previous Versions

Screenshot 2022-01-05 at 11.46.19.png

You can then select the snapshot date and copy the missing files or directories.

From MAC

Install the free version of  FE file explorer from the Apple App store

Screenshot 2022-01-05 at 11.50.05.png

Create an new connexion as described below

Screenshot 2022-01-05 at 11.09.48.png

Then navigate through the snapshots to the directory you want to restore

 

 

 

 

 

DCSR NAS

Data management

This page presents the way to move data between your laptop (or a virtual machine/lab server) and the NAS.

Accessing DCSR NAS from home or UNIL network

 

Note: If you work from home, you first need to connect to UNIL's VPN using Pulse Secure (see VPN instructions).

From Windows

Step 1: right click on Network in File explorer and choose "Map network drive…"

image-1591798613766.png

Step 2: enter the address of the Samba server and click to finish

Ie9map01.PNG

Step 3: enter your Unil credentials and clikc "OK"

map02.PNG

Step 4: click on "This PC" and then on the new network drive

map03.PNG

 

From Linux

It is possible to use a GUI but there are as much solutions as desktop managers. So here is a way to mount the NAS using command line interface. Don't forget to adapt the username= field in the sudo mount command!

# First install the packages
# Debian/Ubuntu version
$ sudo apt install samba cifs-utils
# Fedora/RedHat version
$ sudo dnf install cifs-utils

# In the following, ~/nas is chosen as a mountpoint, but it could be elsewhere
$ mkdir ~/nasdcsr
$ sudo mount -t cifs -o username=unil_username,domain=ad,rw,iocharset=utf8,dir_mode=0700,file_mode=0700,uid=$(id -u) //nasdcsr.unil.ch/RECHERCHE ~/nasdcsr

# Perform the reauired operations
$ cd ~/nasdcsr
…

# When finished, don't forget to umount it
$ sudo umount ~/nasdcsr

 

From MacOS

Step 1: open the Finder, in Go menu, select "Connect to Server"