Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel7

Technical Details

System Component

Configuration

Compute Nodes

CPU Type

AMD EPYC 7352

Sockets

2

Cores/socket

24

Clock speed

2.3 GHz

Memory

256 GB RAM

Local Storage

512GB Micron 1300 SSD (/scratch)

Memory Bandwidth

409.6 GB/s

System

Total Compute Nodes

44

Total Compute Cores

2,112

Total Memory

11.6 TB

Total Storage

342 TB

Interconnect

Mellanox Infiniband EDR

Link bandwidth

100 Gb/s

MPI Latency

1.64 µs

Systems Software Environment

Software

Description

Operating System

CentOS Linux 7.9

Cluster Management

Scyld Clusterware 11.0

Compilers

AOCC, GCC, Clang, Go

Parallel Frameworks

Open MPI, MVAPICH2, Sandia OpenSHMEM

System Access

To use the Lotus cluster, you must first request an account on the system. Rhodes College faculty, students, and staff may send an email to helpdesk@rhodes.edu requesting should submit a request using the following form for gaining access to the cluster. :

Rhodes HPC Cluster Access Request Form

Non-Rhodes users must have a guest researcher account that is sponsored by a Rhodes faculty or staff member.

...

Other useful module commands are listed below:

Command

Description

module list

List the modules that are currently loaded

module avail

List the modules that are available to be loaded

module display <module name>

Show the environment variables modified by the <module_name> module

module load <module name>

Load the module <module_name> into the environment

module unload <module name>

Remove the module <module_name> from the environment

module swap <mod1> <mod2>

Replace <mod1> with <mod2> in the environment

Job Charging and Queue Limits

...

To compile a program with the GNU toolchain use the following commands:

Serial

MPI

OpenMP

MPI+OpenMP

Fortran

gfortran

mpif90

gfortran -fopenmp

mpif90 -fopenmp

C

gcc

mpicc

gcc -fopenmp

mpicc -fopenmp

C++

g++

mpicxx

g++ -fopenmp

mpicxx -fopenmp

To compile your programs with AVX extensions, compile with the -march=core-avx2 compiler flag. You will probably want to use this in conjunction with normal optimization flags (i.e. -O3)

...

To compile a program with the AMD toolchain use the following commands:

Serial

MPI

OpenMP

MPI+OpenMP

Fortran

flang

mpif90

flang -mp

mpif90 -mp

C

clang

mpicc

clang -mp

mpicc -mp

C++

clang++

mpicxx

clang++ -mp

mpicxx -mp

Running Jobs on Lotus

Running programs on the cluster is done by interacting with the job scheduling system. Lotus uses the SLURM job scheduler for managing both batch jobs and interactive runs. You should not run computationally intensive tasks on the login nodes – use the compute nodes.

...