The Australian National University TSG Banner

TSG DCS FEIT CECS ANU


News

cute piccy of tetrahedron with marching penguins

The Project

This project aims to build a 192 processor Beowulf cluster running the Linux Open Source Software (OSS) operating system. The name of the resulting machine is bunyip. The project is sponsored by:

Bunyip is based on commodity dual-CPU Intel-based PCs, multiple 100Mbps Ethernet links and a novel arrangement of Ethernet switches.

Applications

The main applications of bunyip are in support of a number of research projects:

Overall Specification

Cluster

CPUs192 x Intel Pentium III/550
RAM36,864 MBytes, or 36 GBytes (9 x 2^32 bytes)
Disk1,313 x 10^9 bytes (1.3 TBytes)
Bi-sectional Bandwidth15.2 Gbps
Single Precision Flops158.4 GFlops

Overview of Cluster Topology

The cluster of 96 dual-CPU machines is divided into four groups of 24 machines (nodes) each. Each node has three 100Mbps full-duplex ethernet cards. A 48-port switch connects all nodes in one group with all nodes in another (for a total of 6 switches). The topology is effectively a tetrahedron with a group of 24 nodes at each vertex and a switch on each side.

The theorem used to prove the number of switches required for the number of nodes in the network is found in The CRC Handbook of Combinatorial Designs, edited by Charles J Colbourn and Jeffrey H Dinitz, 1996 edition, as Theorem #8.21.

nice piccy of bunyip topology

The bi-sectional bandwidth of this configuration is measured through the middle of four switches, each with a backplane capacity of 3.8Gbps for a total of 15.2Gbps. The worst case bandwidth between any two nodes is 3.8/48 Gbps or 79Mbps.The best case bandwidth is between nodes within the same group and is 300Mbps each way or 600Mbps total.

A detailed description of the hardware configuration of bunyip.

Management Group

Some useful Links.