Difference between revisions of "GPUcluster"

From APEWiki
Jump to navigationJump to search
 
(85 intermediate revisions by 3 users not shown)
Line 3: Line 3:
 
Most nodes run CentOS 5.x, with openmpi-1.4.
 
Most nodes run CentOS 5.x, with openmpi-1.4.
  
−
To properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:<br>
+
On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:<br>
 
openmpi-1.4-gcc-x86_64
 
openmpi-1.4-gcc-x86_64
 +
 +
On COS 6.X, simply add the line below to your .bashrc: <br>
 +
module load openmpi-x86_64
  
 
== Node list ==
 
== Node list ==
Line 10: Line 13:
 
|+ The current node list with their characteristics
 
|+ The current node list with their characteristics
 
!Host name
 
!Host name
−
!Motherboard
+
!MTHBRD
−
!Processor
+
!CPU
 
!#cores
 
!#cores
 
!Freq
 
!Freq
Line 20: Line 23:
 
!NVIDIA driver vers.
 
!NVIDIA driver vers.
 
!APEnet card
 
!APEnet card
−
!Operating System
+
!Op. Sys.
 +
!IPMI address
 +
!Quartus II versions installed:
 +
!BIOS Version
 +
!IB board
 +
!North Bridge Rev.
 +
|-
 +
! scope="col" |agape0
 +
|X8DTG-D
 +
|X5570
 +
|4
 +
|2.93 GHz
 +
|24576 MB
 +
|1
 +
|M2070
 +
|4.2
 +
|319.21
 +
|3links
 +
|CentOS 5.8
 +
|10.0.0.200
 +
|11.0 (no SP), 11.1 (SP1), 12.0 (SP2), 12.1 (no SP)
 +
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
|-
 +
! scope="col" |agape1
 +
|X8DTG-D
 +
|X5570
 +
|4
 +
|2.93 GHz
 +
|49152 MB
 +
|1
 +
|C1060
 +
|5.0
 +
|310.19
 +
|
 +
|CentOS 6.3
 +
|10.0.0.201
 +
|11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 13.0 (SP1)
 +
|2.1 (15/09/2011)
 +
! scope="col" |NO
 
|-
 
|-
 
! scope="col" |agape2
 
! scope="col" |agape2
Line 30: Line 72:
 
|1
 
|1
 
|M2050
 
|M2050
−
|4.1
+
|5.5
−
|285.05.33
+
|319.37
−
|3links
+
|6links (nuova - 001)
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.202
 +
|11.0 (no SP), 11.1 (SP1), 12.0 (no SP), 12.1 (no SP)
 +
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
!C2
 
|-
 
|-
 
! scope="col" |agape3
 
! scope="col" |agape3
Line 43: Line 90:
 
|1
 
|1
 
|M2050  
 
|M2050  
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
−
|  
+
|6links (nuova - 00?)
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.203
 +
|11.0 (no SP), 11.1 (SP2), 12.0 (no SP), 12.1 (no SP)
 +
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape4
 
! scope="col" |agape4
Line 57: Line 108:
 
|M2050
 
|M2050
 
|4.2
 
|4.2
−
|295.41
+
|304.60
−
|  
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.204
 +
|11.0 (no SP), 11.1 (SP2), 12.0 (SP2), 12.1 (no SP)
 +
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape5
 
! scope="col" |agape5
Line 69: Line 124:
 
|2
 
|2
 
|S2050
 
|S2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
−
|3links
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.205
 +
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 +
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape6
 
! scope="col" |agape6
Line 82: Line 141:
 
|2
 
|2
 
|S2050
 
|S2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
−
|3links
+
|6links
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.206
 +
|10.0 (SP1), 11.0 (no SP), 11.1 (no SP), 12.1 (no SP)
 +
|2.0 (03/09/2010)
 +
! scope="col" |YES
 
|-
 
|-
 
! scope="col" |agape7
 
! scope="col" |agape7
Line 94: Line 157:
 
|10240 MB
 
|10240 MB
 
|1
 
|1
−
|S2070
+
|M2070
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
 
|6links
 
|6links
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.207
 +
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 +
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
|-
 +
! scope="col" |agape8
 +
|X8DTG-D
 +
|X5660
 +
|6
 +
|2.80 GHz
 +
|10240 MB
 +
|1
 +
|C1060
 +
|5.5
 +
|319.37
 +
|3links
 +
|CentOS 6.4
 +
|10.0.0.208
 +
|11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 12.1 (no SP)
 +
|2.1a (28/10/2011)
 +
! scope="col" |YES
 +
!C2
 
|-
 
|-
 
! scope="col" |apeiron1
 
! scope="col" |apeiron1
Line 105: Line 190:
 
|6
 
|6
 
|2.67 GHz
 
|2.67 GHz
−
|12280 MB
+
|24576 MB
 
|1
 
|1
 
|C2050
 
|C2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
−
|6links
+
|6links (nuova - 002)
−
|Centos 5.8
+
|CentOS 5.9
 +
|No IPMI
 +
|11.0 (no SP), 11.1 (SP2), 12.1 (no SP)
 +
|2.0 (01/06/2010)
 +
! scope="col" |NO
 
|-
 
|-
 
! scope="col" |apeiron2
 
! scope="col" |apeiron2
Line 118: Line 207:
 
|6
 
|6
 
|2.67 GHz
 
|2.67 GHz
−
|12280 MB
+
|20480 MB
 
|1
 
|1
 
|C2050
 
|C2050
−
|4.1
+
|4.2
−
|285.05.33
+
|304.60
 
|6links
 
|6links
−
|Centos 5.8
+
|CentOS 5.9
 +
|10.0.0.199
 +
|11.0 (no SP), 12.1 (no SP)
 +
|2.0c (30/12/2011)
 +
! scope="col" |NO
 +
|-
 
|}
 
|}
 +
 +
== Node topology (X+Y Torus) ==
 +
 +
            ||                ||                ||                ||
 +
            \/                \/                \/                \/
 +
        +----------+      +----------+      +----------+      +----------+   
 +
        |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
 +
    ==> |          | <==> |          | <==> |          | <==> |          | <==
 +
        |  0 1 0  |      |  1 1 0  |      |  2 1 0  |      |  3 1 0  |
 +
        +----------+      +----------+      +----------+      +----------+
 +
            /\                /\                /\                /\   
 +
            ||                ||                ||                ||   
 +
            ||                ||                ||                ||   
 +
            \/                \/                \/                \/   
 +
        +----------+      +----------+      +----------+      +----------+ 
 +
        | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
 +
    ==> |          | <==> |          | <==> |          | <==> |          | <==
 +
        |  0 0 0  |      |  1 0 0  |      |  2 0 0  |      |  3 0 0  |
 +
        +----------+      +----------+      +----------+      +----------+
 +
            /\                /\                /\                /\   
 +
            ||                ||                ||                ||

Latest revision as of 09:24, 2 August 2013

Node type

Most nodes run CentOS 5.x, with openmpi-1.4.

On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:
openmpi-1.4-gcc-x86_64

On COS 6.X, simply add the line below to your .bashrc:
module load openmpi-x86_64

Node list

The current node list with their characteristics
Host name MTHBRD CPU #cores Freq RAM #GPU GPU model CUDA vers. NVIDIA driver vers. APEnet card Op. Sys. IPMI address Quartus II versions installed: BIOS Version IB board North Bridge Rev.
agape0 X8DTG-D X5570 4 2.93 GHz 24576 MB 1 M2070 4.2 319.21 3links CentOS 5.8 10.0.0.200 11.0 (no SP), 11.1 (SP1), 12.0 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape1 X8DTG-D X5570 4 2.93 GHz 49152 MB 1 C1060 5.0 310.19 CentOS 6.3 10.0.0.201 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 13.0 (SP1) 2.1 (15/09/2011) NO
agape2 X8DTG-D X5650 6 2.67 GHz 32768 MB 1 M2050 5.5 319.37 6links (nuova - 001) CentOS 5.9 10.0.0.202 11.0 (no SP), 11.1 (SP1), 12.0 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
agape3 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links (nuova - 00?) CentOS 5.9 10.0.0.203 11.0 (no SP), 11.1 (SP2), 12.0 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape4 X8DTG-D E5620 4 2.40 GHz 12280 MB 1 M2050 4.2 304.60 6links CentOS 5.9 10.0.0.204 11.0 (no SP), 11.1 (SP2), 12.0 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape5 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.205 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (03/09/2010) YES
agape6 X8DTG-D E5620 4 2.40 GHz 12280 MB 2 S2050 4.2 304.60 6links CentOS 5.9 10.0.0.206 10.0 (SP1), 11.0 (no SP), 11.1 (no SP), 12.1 (no SP) 2.0 (03/09/2010) YES
agape7 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 M2070 4.2 304.60 6links CentOS 5.9 10.0.0.207 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.1a (28/10/2011) YES
agape8 X8DTG-D X5660 6 2.80 GHz 10240 MB 1 C1060 5.5 319.37 3links CentOS 6.4 10.0.0.208 11.1 (SP2), 12.0 (SP2), 12.1 (no SP), 12.1 (no SP) 2.1a (28/10/2011) YES C2
apeiron1 X8DAH+ X5650 6 2.67 GHz 24576 MB 1 C2050 4.2 304.60 6links (nuova - 002) CentOS 5.9 No IPMI 11.0 (no SP), 11.1 (SP2), 12.1 (no SP) 2.0 (01/06/2010) NO
apeiron2 X8DTG-QF X5650 6 2.67 GHz 20480 MB 1 C2050 4.2 304.60 6links CentOS 5.9 10.0.0.199 11.0 (no SP), 12.1 (no SP) 2.0c (30/12/2011) NO

Node topology (X+Y Torus)

            ||                ||                ||                ||
            \/                \/                \/                \/ 
       +----------+      +----------+      +----------+      +----------+     
       |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 1 0   |      |  1 1 0   |      |  2 1 0   |      |  3 1 0   | 
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||    
            ||                ||                ||                ||     
            \/                \/                \/                \/    
       +----------+      +----------+      +----------+      +----------+  
       | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 0 0   |      |  1 0 0   |      |  2 0 0   |      |  3 0 0   |
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||
Retrieved from "https://apegate.roma1.infn.it/mediawiki/index.php?title=GPUcluster&oldid=3524"