Cluster: Difference between revisions

From IIHE Wiki
Jump to navigationJump to search
No edit summary
Line 8: Line 8:


This is the cluster front-end, to use the cluster, you need to log into those machines<br>
This is the cluster front-end, to use the cluster, you need to log into those machines<br>
Servers : ui01, ui02<br>


*Computing Element (CE)<br>  
*Computing Element (CE)<br>  


This server is the core of the batch system&nbsp;: it run submitted jobs on worker nodes<br>
This server is the core of the batch system&nbsp;: it run submitted jobs on worker nodes<br>
Servers : ce<br>


*Worker Nodes (WN)<br>  
*Worker Nodes (WN)<br>  


This is the power of the cluster&nbsp;: they run jobs and send the status back to the CE<br>
This is the power of the cluster&nbsp;: they run jobs and send the status back to the CE<br>
Servers : slave*<br>


*Storage Elements<br>  
*Storage Elements<br>  


This is the memory of the cluster&nbsp;: they contains data, software, ...<br>
This is the memory of the cluster&nbsp;: they contains data, software, ...<br>
Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)


== How to connect<br> ==
== How to connect<br> ==

Revision as of 10:33, 13 February 2014

IIHE local cluster

Overview

The cluster is composed by 4 machine types :

  • User Interfaces (UI)

This is the cluster front-end, to use the cluster, you need to log into those machines

Servers : ui01, ui02

  • Computing Element (CE)

This server is the core of the batch system : it run submitted jobs on worker nodes

Servers : ce

  • Worker Nodes (WN)

This is the power of the cluster : they run jobs and send the status back to the CE

Servers : slave*

  • Storage Elements

This is the memory of the cluster : they contains data, software, ...

Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)

How to connect

To connect to the cluster, you must use your IIHE credentials (same as for wifi)

ssh username@icecube.iihe.ac.be

TIP : icecube.iihe.ac.be points automatically to available UI's


After a successful login, you'll see this message :

==========================================
Welcome on the IIHE ULB-VUB cluster

Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================

username@uiXX:~$

Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster



Batch System

Queues

The cluster is decomposed in queues

any lowmem standard highmem gpu
Description
CPU's
Walltime default/limit
Memory default/limit


Job submission

To submit a job, you just have to use the following command :

qsub job.sh

OPTIONS

-q queuename : choose the queue (default: any)

-N "JobName" : name of the job

-m : mail options

-l : resources options

Useful links

Ganglia Monitoring : Servers status

JobMonArch : Running jobs overview