Cluster

From IIHE Wiki
Revision as of 12:01, 13 February 2014 by Admin (talk | contribs)
Jump to navigationJump to search

IIHE local cluster

Overview

The cluster is composed by 4 machine types :

  • User Interfaces (UI)

This is the cluster front-end, to use the cluster, you need to log into those machines

Servers : ui01, ui02

  • Computing Element (CE)

This server is the core of the batch system : it run submitted jobs on worker nodes

Servers : ce

  • Worker Nodes (WN)

This is the power of the cluster : they run jobs and send the status back to the CE

Servers : slave*

  • Storage Elements

This is the memory of the cluster : they contains data, software, ...

Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)

How to connect

To connect to the cluster, you must use your IIHE credentials (same as for wifi)

ssh username@icecube.iihe.ac.be

TIP : icecube.iihe.ac.be points automatically to available UI's


After a successful login, you'll see this message :

==========================================
Welcome on the IIHE ULB-VUB cluster

Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================

username@uiXX:~$

Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster


Directory Structure

Here is a description of most useful directories

/user/username

Your home folder

/data

Main data repository

/software

The custom software area

/software/src


/software/icecube

Icecube specific tools :

/software/icecube/i3_ports
/software/icecube/offline-software
/software/icecube/icerec
/software/icecube/isimulation


/ice3

Batch System

Queues

The cluster is decomposed in queues


any lowmem standard highmem gpu
Description




CPU's




Walltime default/limit




Memory default/limit





Job submission

To submit a job, you just have to use the following command :

qsub myjob.sh

OPTIONS

-q queueName : choose the queue (default: any)

-N jobName : name of the job

-I : pass in interactive mode

-m : mail options

-l : resources options

Useful links

Ganglia Monitoring : Servers status

JobMonArch : Running jobs overview