GPUcluster

From APEWiki
Jump to navigationJump to search

Node type

Most nodes run CentOS 5.x, with openmpi-1.4.

On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:
openmpi-1.4-gcc-x86_64

On COS 6.X, simply add the line below to your .bashrc:
module load openmpi-x86_64

Node list

The current node list with their characteristics
Host name MTHBRD CPU #cores Freq RAM #GPU GPU model CUDA vers. NVIDIA driver vers. APEnet card Op. Sys. IPMI address Quartus II versions installed: BIOS Version IB board North Bridge Rev.
agape0 X8DTG-D X5570 4 2.93 GHz 24576 MB 1 M2070 4.2 319.21 3links CentOS 5.8 10.0.0.200 11.0 (no SP), 11.1 (SP1), 12.0 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape1 X8DTG-D X5570 4 2.93 GHz 49152 MB 1 C1060 5.0 310.19 CentOS 6.3 10.0.0.201 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 13.0 (SP1) 2.1 (15/09/2011) NO
agape2 X8DTG-D X5650 6 2.67 GHz 32768 MB 1 M2050 5.5RC 319.21 6links (nuova - 001) CentOS 5.9 10.0.0.202 11.0 (no SP), 11.1 (SP1), 12.0 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
agape3 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links (nuova - 00?) CentOS 5.9 10.0.0.203 11.0 (no SP), 11.1 (SP2), 12.0 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape4 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links CentOS 5.9 10.0.0.204 11.0 (no SP), 11.1 (SP2), 12.0 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape5 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.205 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape6 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.206 10.0 (SP1), 11.0 (no SP), 11.1 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape7 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 M2070 4.2 304.60 6links CentOS 5.9 10.0.0.207 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape8 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 C1060 5.5 319.37 3links CentOS 6.4 10.0.0.208 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
apeiron1 X8DAH+ X5650 6 2.67 GHz 24576 MB 1 C2050 4.2 304.60 6links (nuova - 002) CentOS 5.9 No IPMI 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (01/06/2010) NO
apeiron2 X8DTG-QF X5650 6 2.67 GHz 20480 MB 1 C2050 4.2 304.60 6links CentOS 5.9 10.0.0.199 11.0 (no SP), 12.1 (no SP) 2.0c (30/12/2011) NO

Node topology (X+Y Torus)

            ||                ||                ||                ||
            \/                \/                \/                \/ 
       +----------+      +----------+      +----------+      +----------+     
       |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 1 0   |      |  1 1 0   |      |  2 1 0   |      |  3 1 0   | 
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||    
            ||                ||                ||                ||     
            \/                \/                \/                \/    
       +----------+      +----------+      +----------+      +----------+  
       | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 0 0   |      |  1 0 0   |      |  2 0 0   |      |  3 0 0   |
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||