GPUcluster

APE intra-net services

The APE intranet machines with their services

Host	Servers
sankio.ape (VIRTUAL inside agape1.ape)	WWW/HTTP for APE MediaWiki (http://apegate.roma1.infn.it), SMTP
ra.ape	external SSH (this is the landing place when doing 'ssh apegate.roma1.infn.it')
apotto.ape	NFS, authentication (YP/NIS), IMAP, DHCP, NTP
helios.ape	MacroVision license server, inside '/opt/altera_license' - procedure is 1) start 'patcha_mac.sh, then 2) start 'starta_licenze.sh'
agape1.ape	8x clones of the 'ModelSim + Quartus' license server + VirtualSankio (see sankio.ape)
agape8.ape	8x clones of the 'ModelSim + Quartus' license server

Node type

Most nodes run CentOS 5.x, with openmpi-1.4.

On COS 5.x, to properly get a functional MPI environment, it is sufficient to create a file named ~/.mpi-selector with the content:
openmpi-1.4-gcc-x86_64

On COS 6.X, simply add the line below to your .bashrc:
module load openmpi-x86_64

Node list

The current node list with their characteristics

Host name	Motherboard	Processor	#cores	Freq	RAM	#GPU	GPU model	CUDA vers.	NVIDIA driver vers.	APEnet card	Operating System	IPMI address	Quartus II versions installed:	BIOS Version	IB board
agape0	X8DTG-D	X5570	4	2.93 GHz	24576 MB	1	M2070	4.2	310.19	3links	Centos 5.8	10.0.0.200	11.0 (no SP), 11.1 (SP1), 12.0 (SP2)	2.1a (28/10/2011)	YES
agape1	X8DTG-D	X5570	4	2.93 GHz	49152 MB	1	C1060	5.0	310.19		Centos 6.3	10.0.0.201	11.1 (SP2), 12.0 (SP2), 12.1 (no SP)	2.1 (15/09/2011)	NO
agape2	X8DTG-D	X5650	6	2.67 GHz	32768 MB	1	M2050	4.2	304.60	6links (nuova - 001)	Centos 5.8	10.0.0.202	11.0 (no SP), 11.1 (SP1), 12.0 (no SP)	2.1a (28/10/2011)	YES
agape3	X8DTG-D	E5620	4	2.40 GHz	12280 MB	1	M2050	4.2	304.60	6links (nuova - 00?)	Centos 5.8	10.0.0.203	11.0 (no SP), 11.1 (SP2), 12.0 (no SP)	2.0 (03/09/2010)	YES
agape4	X8DTG-D	E5620	4	2.40 GHz	12280 MB	1	M2050	4.2	304.60		Centos 5.8	10.0.0.204	11.0 (no SP), 11.1 (SP2), 12.0 (SP2)	2.0 (03/09/2010)	YES
agape5	X8DTG-D	E5620	4	2.40 GHz	12280 MB	2	S2050	4.2	304.60	3links	Centos 5.8	10.0.0.205	11.0 (no SP), 11.1 (SP2)	2.0 (03/09/2010)	YES
agape6	X8DTG-D	E5620	4	2.40 GHz	12280 MB	2	S2050	4.2	304.60	3links	Centos 5.8	10.0.0.206	10.0 (SP1), 11.0 (no SP), 11.1 (no SP)	2.0 (03/09/2010)	YES
agape7	X8DTG-D	X5660	6	2.80 GHz	10240 MB	1	M2070	4.2	304.60	6links	Centos 5.8	10.0.0.207	11.0 (no SP), 11.1 (SP2)	2.1a (28/10/2011)	YES
agape8	X8DTG-D	X5660	6	2.80 GHz	10240 MB	1	C1060	5.0	304.33	3links	Fedora 17	10.0.0.208	11.1 (SP2), 12.0 (SP2), 12.1 (no SP)	2.1a (28/10/2011)	YES
apeiron1	X8DAH+	X5650	6	2.67 GHz	24576 MB	1	C2050	4.2	304.60	6links (nuova - 002)	Centos 5.8	No IPMI	11.0 (no SP), 11.1 (SP2)	2.0 (01/06/2010)	NO
apeiron2	X8DTG-QF	X5650	6	2.67 GHz	20480 MB	1	C2050	4.2	304.60	6links	Centos 5.8	10.0.0.199	11.0 (no SP)	2.0a (03/09/2010)	NO

Node topology (X+Y Torus)

            ||                ||                ||                ||
            \/                \/                \/                \/ 
       +----------+      +----------+      +----------+      +----------+     
       |  agape2  |      |  agape3  |      |  agape4  |      |  agape5  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 1 0   |      |  1 1 0   |      |  2 1 0   |      |  3 1 0   | 
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||    
            ||                ||                ||                ||     
            \/                \/                \/                \/    
       +----------+      +----------+      +----------+      +----------+  
       | apeiron1 |      | apeiron2 |      |  agape6  |      |  agape7  |
   ==> |          | <==> |          | <==> |          | <==> |          | <==
       |  0 0 0   |      |  1 0 0   |      |  2 0 0   |      |  3 0 0   |
       +----------+      +----------+      +----------+      +----------+
            /\                /\                /\                /\    
            ||                ||                ||                ||