Cluster: Difference between revisions

From IIHE Wiki
Jump to navigationJump to search
No edit summary
No edit summary
Line 3: Line 3:
== Overview ==
== Overview ==


The cluster is composed by 4 machine types :<br>
The cluster is composed by 4 machine types&nbsp;:<br>


*User Interfaces (UI)<br>
*User Interfaces (UI)<br>  


This is the cluster front-end, to use the cluster, you need to log into those machines<br>
This is the cluster front-end, to use the cluster, you need to log into those machines<br>


*Computing Element (CE)<br>
*Computing Element (CE)<br>  


This server is the core of the batch system : it run submitted jobs on worker nodes<br>
This server is the core of the batch system&nbsp;: it run submitted jobs on worker nodes<br>


*Worker Nodes (WN)<br>
*Worker Nodes (WN)<br>  


This is the power of the cluster : they run jobs and send the status back to the CE<br>
This is the power of the cluster&nbsp;: they run jobs and send the status back to the CE<br>


*Storage Elements<br>
*Storage Elements<br>  


This is the memory of the cluster : they contains data, software, ...<br>
This is the memory of the cluster&nbsp;: they contains data, software, ...<br>


<br>
== How to connect<br> ==


To connect to the cluster, you must use your IIHE credentials (same as for wifi)<br>
To connect to the cluster, you must use your IIHE credentials (same as for wifi)<br>
<pre>ssh username@icecube.iihe.ac.be
<pre>ssh username@icecube.iihe.ac.be
</pre>
</pre>  
After a successful login, you'll see this message :<br>
After a successful login, you'll see this message&nbsp;:<br>
<pre>==========================================
Welcome on the IIHE ULB-VUB cluster


==========================================<br>Welcome on the IIHE ULB-VUB cluster
Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================
 
</pre>  
Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster<br>


Cluster status http://ganglia.iihe.ac.be<br>IT Help support-iihe@ulb.ac.be<br>==========================================<br><br>


Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster<br>


<br>
<br>
Line 42: Line 47:
The cluster is decomposed in queues
The cluster is decomposed in queues


{| width="580" height="108" cellspacing="1" cellpadding="1" border="1"
{| width="580" cellspacing="1" cellpadding="1" border="1"
|-
|-
! scope="col" |  
! scope="col" |  
Line 80: Line 85:
|}
|}


<br>


=== Job submission ===


=== Job submission ===
To submit a job, you just have to use the following command :
 
qsub job.sh
 
OPTIONS
 
-q queuename : choose the queue (default: any)
 
-N "JobName" : name of the job


-m : mail options


-l : resources options


== Useful links ==
== Useful links ==

Revision as of 10:28, 13 February 2014

IIHE local cluster

Overview

The cluster is composed by 4 machine types :

  • User Interfaces (UI)

This is the cluster front-end, to use the cluster, you need to log into those machines

  • Computing Element (CE)

This server is the core of the batch system : it run submitted jobs on worker nodes

  • Worker Nodes (WN)

This is the power of the cluster : they run jobs and send the status back to the CE

  • Storage Elements

This is the memory of the cluster : they contains data, software, ...

How to connect

To connect to the cluster, you must use your IIHE credentials (same as for wifi)

ssh username@icecube.iihe.ac.be

After a successful login, you'll see this message :

==========================================
Welcome on the IIHE ULB-VUB cluster

Cluster status http://ganglia.iihe.ac.be
IT Help support-iihe@ulb.ac.be
==========================================

Your default current working directory is your home folder (/user/username), this one is shared amoung the whole cluster



Batch System

Queues

The cluster is decomposed in queues

any lowmem standard highmem gpu
Description
CPU's
Walltime default/limit
Memory default/limit


Job submission

To submit a job, you just have to use the following command :

qsub job.sh

OPTIONS

-q queuename : choose the queue (default: any)

-N "JobName" : name of the job

-m : mail options

-l : resources options

Useful links

Ganglia Monitoring : Servers status

JobMonArch : Running jobs overview