Cluster: Difference between revisions

From IIHE Wiki
Jump to navigationJump to search
No edit summary
No edit summary
Line 102: Line 102:
=== Job submission ===
=== Job submission ===


To submit a job, you just have to use the following command :
To submit a job, you just have to use the following command :
<pre>qsub myjob.sh
</pre>
OPTIONS


qsub job.sh
-q queueName&nbsp;: choose the queue (default: any)
 
OPTIONS


-q queuename : choose the queue (default: any)
-N jobName : name of the job


-N "JobName" : name of the job
-I : pass in interactive mode


-m : mail options
-m&nbsp;: mail options


-l : resources options
-l&nbsp;: resources options


== Useful links ==
== Useful links ==

Revision as of 10:37, 13 February 2014

IIHE local cluster

Overview

The cluster is composed by 4 machine types :

  • User Interfaces (UI)

This is the cluster front-end, to use the cluster, you need to log into those machines

Servers : ui01, ui02

  • Computing Element (CE)

This server is the core of the batch system : it run submitted jobs on worker nodes

Servers : ce

  • Worker Nodes (WN)

This is the power of the cluster : they run jobs and send the status back to the CE

Servers : slave*

  • Storage Elements

This is the memory of the cluster : they contains data, software, ...

Servers : datang (/data, /software), lxserv (/user), x4500 (/ice3)

How to connect

To connect to the cluster, you must use your IIHE credentials (same as for wifi)

ssh username@icecube.iihe.ac.be

TIP : icecube.iihe.ac.be points automatically to available UI's


After a successful login, you'll see this message :

==========================================
Welcome on the IIHE ULB-VUB cluster

Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================

username@uiXX:~$

Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster



Batch System

Queues

The cluster is decomposed in queues

any lowmem standard highmem gpu
Description
CPU's
Walltime default/limit
Memory default/limit


Job submission

To submit a job, you just have to use the following command :

qsub myjob.sh

OPTIONS

-q queueName : choose the queue (default: any)

-N jobName : name of the job

-I : pass in interactive mode

-m : mail options

-l : resources options

Useful links

Ganglia Monitoring : Servers status

JobMonArch : Running jobs overview