Cluster: Difference between revisions

Revision as of 12:01, 13 February 2014

IIHE local cluster

Overview

The cluster is composed by 4 machine types :

User Interfaces (UI)

This is the cluster front-end, to use the cluster, you need to log into those machines

Servers : ui01, ui02

Computing Element (CE)

This server is the core of the batch system : it run submitted jobs on worker nodes

Servers : ce

Worker Nodes (WN)

This is the power of the cluster : they run jobs and send the status back to the CE

Servers : slave*

Storage Elements

This is the memory of the cluster : they contains data, software, ...

Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)

How to connect

To connect to the cluster, you must use your IIHE credentials (same as for wifi)

ssh username@icecube.iihe.ac.be

TIP : icecube.iihe.ac.be points automatically to available UI's

After a successful login, you'll see this message :

==========================================
Welcome on the IIHE ULB-VUB cluster

Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================

username@uiXX:~$

Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster

Directory Structure

Here is a description of most useful directories

/user/username

Your home folder

/data

Main data repository

/software

The custom software area

/software/src

/software/icecube

Icecube specific tools :

/software/icecube/i3_ports

/software/icecube/offline-software

/software/icecube/icerec

/software/icecube/isimulation

/ice3

Batch System

Queues

The cluster is decomposed in queues

	any	lowmem	standard	highmem	gpu
Description
CPU's
Walltime default/limit
Memory default/limit

Job submission

To submit a job, you just have to use the following command :

qsub myjob.sh

OPTIONS

-q queueName : choose the queue (default: any)

-N jobName : name of the job

-I : pass in interactive mode

-m : mail options

-l : resources options

Useful links

Ganglia Monitoring : Servers status

JobMonArch : Running jobs overview

@@ Line 9: / Line 9: @@
 This is the cluster front-end, to use the cluster, you need to log into those machines<br>
-Servers : ui01, ui02<br>
+Servers&nbsp;: ui01, ui02<br>
 *Computing Element (CE)<br>
@@ Line 15: / Line 15: @@
 This server is the core of the batch system&nbsp;: it run submitted jobs on worker nodes<br>
-Servers : ce<br>
+Servers&nbsp;: ce<br>
 *Worker Nodes (WN)<br>
@@ Line 21: / Line 21: @@
 This is the power of the cluster&nbsp;: they run jobs and send the status back to the CE<br>
-Servers : slave*<br>
+Servers&nbsp;: slave*<br>
 *Storage Elements<br>
@@ Line 27: / Line 27: @@
 This is the memory of the cluster&nbsp;: they contains data, software, ...<br>
-Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)
+Servers&nbsp;: datang (/data, /software), lxserv (/user), x4500 (/ice3)
 == How to connect<br> ==
@@ Line 34: / Line 34: @@
 <pre>ssh username@icecube.iihe.ac.be
 </pre>
-TIP : icecube.iihe.ac.be points automatically to available UI's
+TIP&nbsp;: icecube.iihe.ac.be points automatically to available UI's
+<br>
 After a successful login, you'll see this message&nbsp;:<br>
@@ Line 51: / Line 51: @@
 <br>
+== Directory Structure<br> ==
+Here is a description of most useful directories<br>
+=== /user/username<br> ===
+Your home folder<br>
+=== /data<br> ===
+Main data repository<br>
+=== /software<br> ===
+The custom software area<br>
+==== /software/src<br> ====
+<br>
+==== /software/icecube<br> ====
+Icecube specific tools :<br>
+===== /software/icecube/i3_ports<br> =====
+===== /software/icecube/offline-software<br> =====
+===== /software/icecube/icerec<br> =====
+===== /software/icecube/isimulation<br> =====
 <br>
+=== /ice3<br> ===
 == Batch System ==
@@ Line 62: / Line 98: @@
 {| width="580" cellspacing="1" cellpadding="1" border="1"
 |-
-! scope="col" |
+! scope="col" | <br>
 ! scope="col" | any
 ! scope="col" | lowmem
@@ Line 70: / Line 106: @@
 |-
 ! scope="row" | Description
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
 |-
 ! scope="row" | CPU's
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
 |-
 ! scope="row" | Walltime default/limit
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
 |-
 ! scope="row" | Memory default/limit
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
-|
+| <br>
 |}
@@ Line 109: / Line 145: @@
 -q queueName&nbsp;: choose the queue (default: any)
--N jobName : name of the job
+-N jobName&nbsp;: name of the job
--I : pass in interactive mode
+-I&nbsp;: pass in interactive mode
 -m&nbsp;: mail options