Grail and CIERA Clusters
CIERA has exclusive access to two high-performance computer clusters. These two clusters are used not only for running simulations and doing analysis for research, but serve as a training ground for students in HPC computing and computational research. In total, the two clusters provide access to 2,644 compute cores.
The NSF-funded Grail cluster is available for use by CIERA researchers doing work related to gravitational waves. This computer cluster provides 37 compute nodes for general-purpose high-performance computation, as well as 2 special-purpose nodes with Graphics Processing Units (GPUs) appropriate to scientific computing which allow accelerated parallel computations. Nodes have dual 14-core CPUs (Intel(R) Xeon(R) Gold 6132 (Skylake) CPU @ 2.60GHz), for a total of 28 cores per node. The standard compute nodes and GPU nodes have 192 GB of RAM per node. The nodes are interconnected with InfiniBand FDR. Grail’s two additional GPU nodes contain dual NVIDIA Tesla V100 cards; each card has two NVIDIA V100-PCIE-16GB GPUs with 16GB of RAM per GPU. Grail includes 70 TB of high-speed disk storage directly connected to the cluster in a RAID configuration.
The CIERA Cluster is available for use by any CIERA researcher for astronomy-related research. It includes two types of standard compute nodes: 9 CPU nodes have dual 14-core CPUs (Intel(R) Xeon(R) Gold 6132 (Skylake) CPU @ 2.60GHz), for a total of 28 cores per node, and 23 CPU nodes have dual 26-core CPUs (Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz), for a total of 52 cores per node. Both types have 192 GB RAM per node. The CIERA Cluster also includes 2 specialty nodes: a high-memory node with 52 cores and 1 TB RAM, as well as an NVIDIA 40GB Tesla A100 GPU node. The nodes are interconnected with InfiniBand FDR. The CIERA Cluster contains 86 TB of high-speed disk storage directly connected to the cluster in a RAID configuration.
The Northwestern’s Research Computing group houses and maintains the Grail and CIERA clusters alongside its Quest High-Performance computer. Their group has excellent space, cooling, and power (with UPS support) to support the system. Additional HPC resources, including high-memory nodes, are available through Quest.
- A dedicated Computational Specialist is on staff to assist CIERA researchers. The Computational Specialist offers trainings and tutorials, walk-in consultations, and expert guidance for HPC code development and optimization, and more.
- CIERA researchers looking for details on how to access and use the Grail and CIERA clusters should refer to the CIERA internal Wiki page (Northwestern NetID required).
- Video tutorials from Northwestern IT Computational Research Services are available on YouTube (visit playlist).
Funding for the Grail computer cluster was provided by the National Science Foundation’s Major Research Instrumentation (MRI) program, grant PHY-1126812.