Difference between revisions of "GPUcluster"

From APEWiki
Jump to navigationJump to search
Line 220: Line 220:
 
== Node topology (X+Y Torus) ==
 
== Node topology (X+Y Torus) ==
  
             ||                ||
+
             ||                ||                ||                ||
             \/                \/
+
             \/                \/                \/                \/  
         +----------+      +----------+
+
         +----------+      +----------+     +----------+      +----------+   
         | apeiron1 |      |  agape3  |
+
         | agape2  |      |  agape3 |      |  agape4  |      |  agape5 |
     ==> |          | <==> |          | <==
+
     ==> |          | <==> |          | <==> |          | <==> |          |
         |  0 0 0  |      |  1 0 0  |
+
         |  0 1 0   |      |  1 1 0  |      |  2 1 0   |      |  3 1 0  |  
         +----------+      +----------+
+
         +----------+      +----------+      +----------+      +----------+
             /\                /\
+
             /\                /\               /\                /\   
             ||                ||
+
             ||                ||               ||                ||   
             ||                ||
+
             ||                ||               ||                ||   
             \/                \/
+
             \/                \/               \/                \/   
         +----------+      +----------+
+
         +----------+      +----------+     +----------+      +----------+ 
         |  agape7 |      |  agape2 |
+
         | apeiron1 |      | apeiron2 |      agape6 |      |  agape7 |
     ==> |          | <==> |          | <==
+
     ==> |          | <==> |          | <==> |          | <==> |          |
         |  0 1 0  |      |  1 1 0  |
+
         |  0 0 0  |      |  1 0 0  |      |  2 0 0  |      |  3 0 0  |
         +----------+      +----------+
+
         +----------+      +----------+      +----------+      +----------+
             /\                /\
+
             /\                /\               /\                /\   
             ||                ||
+
             ||                ||                ||                ||
  
 
== Node topology (Z loop) ==
 
== Node topology (Z loop) ==

Revision as of 13:31, 25 October 2012

Node type

Most nodes run CentOS 5.x, with openmpi-1.4.

On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:
openmpi-1.4-gcc-x86_64

On COS 6.X, simply add the line below to your .bashrc:
module load openmpi-x86_64

Node list

The current node list with their characteristics
Host name Motherboard Processor #cores Freq RAM #GPU GPU model CUDA vers. NVIDIA driver vers. APEnet card Operating System IPMI address Quartus II versions installed: BIOS Version IB board
agape0 X8DTG-D X5570 4 2.93 GHz 24576 MB 1 C1060 4.2 295.41 3links Centos 5.8 10.0.0.200 11.0 (no SP), 11.1 (SP1), 12.0 (SP2) 2.1a (28/10/2011) YES
agape1 X8DTG-D X5570 4 2.93 GHz 49152 MB 1 C1060 5.0RC 304.33 Centos 6.3 10.0.0.201 11.1 (SP2), 12.0 (no SP) 2.1 (15/09/2011) NO
agape2 X8DTG-D X5650 6 2.67 GHz 32768 MB 1 M2050 4.2 304.51 6links (nuova - 001) Centos 5.8 10.0.0.202 11.0 (no SP), 11.1 (SP1), 12.0 (no SP) 2.1a (28/10/2011) YES
agape3 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.51 6links (nuova - 00?) Centos 5.8 10.0.0.203 11.0 (no SP), 11.1 (SP2), 12.0 (no SP) 2.0 (03/09/2010) YES
agape4 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 295.41 Centos 5.8 10.0.0.204 11.0 (no SP), 11.1 (SP2), 12.0 (SP2) 2.0 (03/09/2010) YES
agape5 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 5.0RC 304.60 3links Centos 5.8 10.0.0.205 11.0 (no SP), 11.1 (SP2) 2.0 (03/09/2010) YES
agape6 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 5.0RC 304.60 3links Centos 5.8 10.0.0.206 10.0 (SP1), 11.0 (no SP), 11.1 (no SP) 2.0 (03/09/2010) YES
agape7 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 M2070 4.2 304.51 6links Centos 5.8 10.0.0.207 11.0 (no SP), 11.1 (SP2) 2.1a (28/10/2011) YES
agape8 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 M2070 5.0RC 304.33 Fedora 17 10.0.0.208 11.1 (SP2), 12.0 (SP2) 2.1a (28/10/2011) YES
apeiron1 X8DAH+ X5650 6 2.67 GHz 24576 MB 1 C2050 4.1 304.51 6links (nuova - 002) Centos 5.8 No IPMI 11.0 (no SP), 11.1 (SP2) 2.0 (01/06/2010) NO
apeiron2 X8DTG-QF X5650 6 2.67 GHz 20480 MB 1 C2050 4.1 285.05.33 6links Centos 5.8 10.0.0.199 11.0 (no SP) 2.0a (03/09/2010) NO

Node topology (X+Y Torus)

            ||                ||                ||                ||
            \/                \/                \/                \/ 
       +----------+      +----------+      +----------+      +----------+     
       |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
   ==> |          | <==> |          | <==> |          | <==> |          | 
       |  0 1 0   |      |  1 1 0   |      |  2 1 0   |      |  3 1 0   | 
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||    
            ||                ||                ||                ||     
            \/                \/                \/                \/    
       +----------+      +----------+      +----------+      +----------+  
       | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          |
       |  0 0 0   |      |  1 0 0   |      |  2 0 0   |      |  3 0 0   |
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||

Node topology (Z loop)

       +----------+      +----------+      +----------+      +----------+
       | apeiron1 |      |  agape2  |      |  agape3  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
   |   |  0 0 0   |      |  0 0 1   |      |  0 0 2   |      |  0 0 3   |   |
   |   +----------+      +----------+      +----------+      +----------+   |
   |                                                                        |
   --------------------------------------------------------------------------