Difference between revisions of "GPUcluster"

From APEWiki
Jump to: navigation, search
m (→‎Node list)
m (→‎Node list)
 
(45 intermediate revisions by 2 users not shown)
Line 13: Line 13:
 
|+ The current node list with their characteristics
 
|+ The current node list with their characteristics
 
!Host name
 
!Host name
−
!Motherboard
+
!MTHBRD
−
!Processor
+
!CPU
 
!#cores
 
!#cores
 
!Freq
 
!Freq
Line 23: Line 23:
 
!NVIDIA driver vers.
 
!NVIDIA driver vers.
 
!APEnet card
 
!APEnet card
−
!Operating System
+
!Op. Sys.
 
!IPMI address
 
!IPMI address
 
!Quartus II versions installed:
 
!Quartus II versions installed:
 
!BIOS Version
 
!BIOS Version
 +
!IB board
 +
!North Bridge Rev.
 
|-
 
|-
 
! scope="col" |agape0
 
! scope="col" |agape0
Line 35: Line 37:
 
|24576 MB
 
|24576 MB
 
|1
 
|1
−
|C1060
+
|M2070
 
|4.2
 
|4.2
−
|295.41
+
|319.21
 
|3links
 
|3links
−
|Centos 5.8
+
|CentOS 5.8
 
|10.0.0.200
 
|10.0.0.200
−
|11.0 (no SP), 11.1 (SP1), 12.0 (no SP)
+
|11.0 (no SP), 11.1 (SP1), 12.0 (SP2), 12.1 (no SP)
 
|2.1a (28/10/2011)
 
|2.1a (28/10/2011)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape1
 
! scope="col" |agape1
Line 52: Line 55:
 
|1
 
|1
 
|C1060
 
|C1060
−
|5.0RC
+
|5.0
−
|304.33
+
|310.19
 
|
 
|
−
|Centos 6.3
+
|CentOS 6.3
 
|10.0.0.201
 
|10.0.0.201
−
|11.1 (SP2), 12.0 (no SP)
+
|11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 13.0 (SP1)
 
|2.1 (15/09/2011)
 
|2.1 (15/09/2011)
 +
! scope="col" |NO
 
|-
 
|-
 
! scope="col" |agape2
 
! scope="col" |agape2
Line 68: Line 72:
 
|1
 
|1
 
|M2050
 
|M2050
−
|4.2
+
|5.5
−
|295.41
+
|319.37
 
|6links (nuova - 001)
 
|6links (nuova - 001)
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.202
 
|10.0.0.202
−
|11.0 (no SP), 11.1 (SP1), 12.0 (no SP)
+
|11.0 (no SP), 11.1 (SP1), 12.0 (no SP), 12.1 (no SP)
 
|2.1a (28/10/2011)
 
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
!C2
 
|-
 
|-
 
! scope="col" |agape3
 
! scope="col" |agape3
Line 85: Line 91:
 
|M2050  
 
|M2050  
 
|4.2
 
|4.2
−
|295.41
+
|304.60
 
|6links (nuova - 00?)
 
|6links (nuova - 00?)
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.203
 
|10.0.0.203
−
|11.0 (no SP), 11.1 (SP2), 12.0 (no SP)
+
|11.0 (no SP), 11.1 (SP2), 12.0 (no SP), 12.1 (no SP)
 
|2.0 (03/09/2010)
 
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape4
 
! scope="col" |agape4
Line 101: Line 108:
 
|M2050
 
|M2050
 
|4.2
 
|4.2
−
|295.41
+
|304.60
−
|
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.204
 
|10.0.0.204
−
|11.0 (no SP), 11.1 (SP2), 12.0 (SP2)
+
|11.0 (no SP), 11.1 (SP2), 12.0 (SP2), 12.1 (no SP)
 
|2.0 (03/09/2010)
 
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape5
 
! scope="col" |agape5
Line 116: Line 124:
 
|2
 
|2
 
|S2050
 
|S2050
−
|4.1
+
|4.2
−
|304.43
+
|304.60
−
|3links
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.205
 
|10.0.0.205
−
|11.0 (no SP), 11.1 (SP2)
+
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 
|2.0 (03/09/2010)
 
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape6
 
! scope="col" |agape6
Line 132: Line 141:
 
|2
 
|2
 
|S2050
 
|S2050
−
|4.1
+
|4.2
−
|304.43
+
|304.60
−
|3links
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.206
 
|10.0.0.206
−
|10.0 (SP1), 11.0 (no SP), 11.1 (no SP)
+
|10.0 (SP1), 11.0 (no SP), 11.1 (no SP), 12.1 (no SP)
 
|2.0 (03/09/2010)
 
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape7
 
! scope="col" |agape7
Line 148: Line 158:
 
|1
 
|1
 
|M2070
 
|M2070
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
 
|6links
 
|6links
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.207
 
|10.0.0.207
−
|11.0 (no SP), 11.1 (SP2)
+
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 
|2.1a (28/10/2011)
 
|2.1a (28/10/2011)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape8
 
! scope="col" |agape8
Line 163: Line 174:
 
|10240 MB
 
|10240 MB
 
|1
 
|1
−
|M2070
+
|C1060
−
|5.0RC
+
|5.5
−
|304.33
+
|319.37
−
|
+
|3links
−
|Fedora 17
+
|CentOS 6.4
 
|10.0.0.208
 
|10.0.0.208
−
|11.1 (SP2)
+
|11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 12.1 (no SP)
 
|2.1a (28/10/2011)
 
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
!C2
 
|-
 
|-
 
! scope="col" |apeiron1
 
! scope="col" |apeiron1
Line 180: Line 193:
 
|1
 
|1
 
|C2050
 
|C2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
 
|6links (nuova - 002)
 
|6links (nuova - 002)
−
|Centos 5.8
+
|CentOS 5.9
 
|No IPMI
 
|No IPMI
−
|11.0 (no SP), 11.1 (SP2)
+
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 
|2.0 (01/06/2010)
 
|2.0 (01/06/2010)
 +
! scope="col" |NO
 
|-
 
|-
 
! scope="col" |apeiron2
 
! scope="col" |apeiron2
Line 196: Line 210:
 
|1
 
|1
 
|C2050
 
|C2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
 
|6links
 
|6links
−
|Centos 5.8
+
|CentOS 5.9
 
|10.0.0.199
 
|10.0.0.199
−
|11.0 (no SP)
+
|11.0 (no SP), 12.1 (no SP)
−
|2.0a (03/09/2010)
+
|2.0c (30/12/2011)
 +
! scope="col" |NO
 
|-
 
|-
 
|}
 
|}
Line 208: Line 223:
 
== Node topology (X+Y Torus) ==
 
== Node topology (X+Y Torus) ==
  
−
             ||                ||
+
             ||                ||                ||                ||
−
             \/                \/
+
             \/                \/                \/                \/  
−
         +----------+      +----------+
+
         +----------+      +----------+      +----------+      +----------+    
−
        | apeiron1 |     |  agape3  |
+
        | agape2  |     | agape3  |      |  agape4 |      |  agape5 |
−
    ==> |          | <==> |          | <==
+
     ==> |          | <==> |          | <==> |          | <==> |          | <==
−
        |  0 0 0  |      |  1 0 0  |
+
         |  0 1 0  |      |  1 1 0  |      | 2 1 0  |     | 3 1 0  |  
−
        +----------+      +----------+
 
−
            /\                /\
 
−
            ||               ||
 
−
            ||               ||
 
−
            \/                \/
 
−
        +----------+     +----------+
 
−
        |  agape7 |      |  agape2 |
 
−
     ==> |          | <==> |          | <==
 
−
         |  0 1 0  |      |  1 1 0  |
 
−
        +----------+     +----------+
 
−
            /\                /\
 
−
            ||               ||
 
−
 
 
−
== Node topology (Z loop) ==
 
−
 
 
 
         +----------+      +----------+      +----------+      +----------+
 
         +----------+      +----------+      +----------+      +----------+
−
         | apeiron1 |      | agape2  |      |  agape3 |      |  agape7  |
+
            /\                /\                /\                /\   
 +
            ||                ||                ||                ||   
 +
            ||                ||                ||                ||   
 +
            \/                \/                \/                \/   
 +
        +----------+      +----------+      +----------+      +----------+ 
 +
         | apeiron1 |      | apeiron2 |      |  agape6 |      |  agape7  |
 
     ==> |          | <==> |          | <==> |          | <==> |          | <==
 
     ==> |          | <==> |          | <==> |          | <==> |          | <==
−
    |  |  0 0 0  |      |  0 0 1   |      |  0 0 2   |      |  0 0 3  |   |
+
        |  0 0 0  |      |  1 0 0  |      |  2 0 0  |      |  3 0 0  |
−
    |  +----------+      +----------+      +----------+      +----------+   |
+
        +----------+      +----------+      +----------+      +----------+
−
    |                                                                       |
+
            /\                /\                /\                /\   
−
    --------------------------------------------------------------------------
+
            ||                ||                ||               ||

Latest revision as of 09:24, 2 August 2013

Node type

Most nodes run CentOS 5.x, with openmpi-1.4.

On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:
openmpi-1.4-gcc-x86_64

On COS 6.X, simply add the line below to your .bashrc:
module load openmpi-x86_64

Node list

The current node list with their characteristics
Host name MTHBRD CPU #cores Freq RAM #GPU GPU model CUDA vers. NVIDIA driver vers. APEnet card Op. Sys. IPMI address Quartus II versions installed: BIOS Version IB board North Bridge Rev.
agape0 X8DTG-D X5570 4 2.93 GHz 24576 MB 1 M2070 4.2 319.21 3links CentOS 5.8 10.0.0.200 11.0 (no SP), 11.1 (SP1), 12.0 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape1 X8DTG-D X5570 4 2.93 GHz 49152 MB 1 C1060 5.0 310.19 CentOS 6.3 10.0.0.201 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 13.0 (SP1) 2.1 (15/09/2011) NO
agape2 X8DTG-D X5650 6 2.67 GHz 32768 MB 1 M2050 5.5 319.37 6links (nuova - 001) CentOS 5.9 10.0.0.202 11.0 (no SP), 11.1 (SP1), 12.0 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
agape3 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links (nuova - 00?) CentOS 5.9 10.0.0.203 11.0 (no SP), 11.1 (SP2), 12.0 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape4 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links CentOS 5.9 10.0.0.204 11.0 (no SP), 11.1 (SP2), 12.0 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape5 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.205 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape6 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.206 10.0 (SP1), 11.0 (no SP), 11.1 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape7 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 M2070 4.2 304.60 6links CentOS 5.9 10.0.0.207 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape8 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 C1060 5.5 319.37 3links CentOS 6.4 10.0.0.208 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
apeiron1 X8DAH+ X5650 6 2.67 GHz 24576 MB 1 C2050 4.2 304.60 6links (nuova - 002) CentOS 5.9 No IPMI 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (01/06/2010) NO
apeiron2 X8DTG-QF X5650 6 2.67 GHz 20480 MB 1 C2050 4.2 304.60 6links CentOS 5.9 10.0.0.199 11.0 (no SP), 12.1 (no SP) 2.0c (30/12/2011) NO

Node topology (X+Y Torus)

            ||                ||                ||                ||
            \/                \/                \/                \/ 
       +----------+      +----------+      +----------+      +----------+     
       |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 1 0   |      |  1 1 0   |      |  2 1 0   |      |  3 1 0   | 
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||    
            ||                ||                ||                ||     
            \/                \/                \/                \/    
       +----------+      +----------+      +----------+      +----------+  
       | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 0 0   |      |  1 0 0   |      |  2 0 0   |      |  3 0 0   |
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||
Retrieved from "https://apegate.roma1.infn.it/mediawiki/index.php?title=GPUcluster&oldid=3524"