Résultats de recherche

Introduction This tutorial will guide you how to run intel profiling tools in AMD processors, we explore also the type of code we can profile. Advisor Project setup First of all, we prepare an executable to run the tests. You can use any code to run these ...

Introduction As you probably noticed, execution time for jobs in DCSR clusters is limited to 3 days. For those jobs that take more than 3 days and cannot be optimized or divided up into smaller jobs, DCSR's clusters provide a Checkpoint mechanism. This mechani...

In order to use Dask in Curnagl you have to use the following packages: dask dask-jobqueue Note: please make sure to use version 2022.11.0 or later. Previous versions have some bugs on worker-nodes that make them very slow when using several threads. Dask ...

If you see the following error when compiling a code on the cluster: fatal error: XXXX.h: No such file or directory That means that the software you are trying to compile needs  a specific header file provided by a third party library. In order to use a thi...

Introduction This page shows performance of Llama and mistral models on Curnagl hardware. We have measured the token throughput which should help you to have an idea of what is possible using Curnagl resources. Training time and inference time for different ta...

Data in the S3 DCSR should be transfert to another file system as soon as possible. There is no backup for S3 data. This documentation describes the transfert using Curnagl cluster and the rclone command. Introduction What is S3? Amazon S3 (Simple Storage Serv...

This tutorial shows, how to run LLM on UNIL clusters Simple test set up For this simple test, we are going to use transformers library from hugging face. So you should type the following commands to setup a proper python environment: module load python python ...