Skip to content

Releases: EESSI/test-suite

v0.9.0 (23 December 2025)

23 Dec 10:28
f1d8a95

Choose a tag to compare

This is a minor release of the EESSI test-suite

New tests:

  • OpenFoam: added a large test case, that can run on larger scales (#281)
  • ESPResSo: added a lattice-Boltzman (LB) test case, updated P3M and LJ test cases for ESPResSo 5.0 release (#300).
    New test cases also test waLBerla integration in ESPResSo.
  • LPC3D: test case simulates NMR spectra and diffusion of a liquid within a disorder porous carbon, based on a
    mesoscopic model (#306).
  • lmbpy-pssrt: test case for a fork of lbmpy that adds population-based methods (#308).
  • waLBerla: test case for a stand-alone waLBerla installation. Runs a slightly modified version of one of
    waLBerla's lbm tutorials (#309).
  • LAMMPS: added tests to test integrated LAMMPS + OBMD (open-boundary molecular dynamics) and
    LAMMPS + ALL (A Load balancing Library), and LAMMPS + ALL + OBMD functionality (#303).

v0.8.1 (6 November 2025)

06 Nov 13:36
a2ab832

Choose a tag to compare

This is a bug fix release of the EESSI test-suite

Bug fixes:

  • Adding __init__.py to fix the docs. (#293)
  • Add possibility for tests to use predownloaded data, and otherwise mark themselves as requiring an online node. Also: implemented this for TensorFlow (#275)
  • Add Mare Nostrum ReFrame config (#277)

Other changes:

  • Changes in Snellius config specifying the exact number of nodes and not leaving it up for interpretation by SLURM.
    (#292)
  • Added CI check for being able to autogenerate the docs (#295)

v0.8.0 (05 November 2025)

05 Nov 15:20
19cca4f

Choose a tag to compare

This is a minor release of the EESSI test-suite

New tests:

  • BLAS (gemm, hemm, herk, trmm, trsm) (#268)
  • OpenFOAM CI (small scale, 1-128 MPI tasks) (#278)
  • numpy (Dot product, SVD, Cholesky decomposition, Inversion, Eigen decomposition) (#276)

Bug fixes:

  • Skip tests that require internet on offline machines. (#279)
  • Fix output of full module path. (#274)

Enhancements:

  • Print list of supported scales for each test class with non-standard scales or a filtered set. (#285)
  • Set compact thread-binding for numpy test. (#286)
  • Added a launcher variable for test classes rather than using a separate function in each test to use a non-standard
    launcher. (#286)
  • BLAS test uses the launcher variable. (#288)

Other changes:

  • Changes in VSC config. (#282)
  • Fixing a typo. (#283)

Full Changelog: v0.7.1...v0.8.0

v0.7.1 (30 June 2025)

30 Jun 08:35
01bb11f

Choose a tag to compare

This is a bug fix release of the EESSI test-suite

Bug fixes:

  • Make sure automatic API docs generation also generates docs for OpenFOAM (#271)

Other changes:

  • Update CI workflow to use ReFrame 4.8.1 by default, and use new argument passing functionality to pass the SLURM account (#270)

v0.7.0 (18 June 2025)

18 Jun 11:57
201ae32

Choose a tag to compare

This is a minor release of the EESSI test-suite

New tests:

Bug fixes:

  • Fixes syntax issue in docstring that blocks automatic API doc generation #(265)
  • Update VSC Tier-1 Hortense configuration file and CI script to fix problems (#250, #266)

Other changes:

  • Set SLURM_EXPORT_ENV=ALL in prepare_cmds of example config (#262)

v0.6.0 (19 March 2025)

19 Mar 22:09
616e3e3

Choose a tag to compare

This is a minor release of the EESSI test-suite.

WARNING: this release contains a breaking change (#258) for the format of the required ReFrame configuration file. Essentially, this requires making the following substitutions in the ReFrame configuration file.

  • FEATURES[CPU] => FEATURES.CPU
  • FEATURES[GPU] => FEATURES.GPU
  • 'mem_per_node' => EXTRAS.MEM_PER_NODE
  • DEVICE_TYPES[CPU] => DEVICE_TYPES.CPU
  • DEVICE_TYPES[GPU] => DEVICE_TYPES.GPU
  • GPU_VENDOR: GPU_VENDORS[NVIDIA] => EXTRAS.GPU_VENDOR: GPU_VENDORS.NVIDIA
  • FEATURES[ALWAYS_REQUEST_GPUS] => FEATURES.ALWAYS_REQUEST_GPUS

See the updated documentation for more details.

Updates:

  • Use NamedTuples to define constants instead of constants indexing a dictionary of constants #258

v0.5.2 (13 March 2025)

17 Mar 09:25
4051031

Choose a tag to compare

This is a bug fix release of the EESSI test-suite

Bug fix:

  • Add exact_memory attribute to tests that are not inheriting from EESSI_Mixin to avoid '' object has no attribute 'exact_memory' failure #245, fixes #252

Other updates:

  • Prefix mixin method names to avoid accidental overrides #246
  • Use CI constant (instead of 'CI' as string) #247
  • Ported ESPResSo to EESSI_Mixin #248
  • Simplify executable_opts with new variable user_executable_opts #249
  • Update example_settings.py config file #254

v0.5.1 (30 January 2025)

04 Feb 21:09
f6c0540

Choose a tag to compare

This is a bug fix release of the EESSI test-suite

Other updates:

  • Update to release workflow instructions (#232)
  • Document how to use a different version of the config files when using CI/run_reframe.sh (#235)
  • Bump the use of the default ReFrame version for period tests that use CI/run_reframe.sh to ReFrame 4.7.3 (#236)
  • Make CI/run_reframe.sh use the latest release of the test suite as default version (#237)

EESSI test suite v0.5.0

23 Jan 14:24
13f2fed

Choose a tag to compare

v0.5.0 (23 January 2025)

This is a minor release of the EESSI test-suite

New tests:

  • MetalWalls (#164) (N.B. requires ReFrame >=4.7.0)

New features:

  • Created eessi_mixin class for tests to inherit from. This class makes it easier to create portable tests, and also keeps the structure of those tests more uniform. (#177)
  • Automatic versioning with setuptools_scm (#185)
  • Ported tests to use the eessi_mixin class: CP2K (#193), MPI4py (#203), QuantumESPRESSO (#212), PyTorch (#213), TensorFlow (#221), OSU (#222)
  • Improved support for doing periodic test suite runs on a local software stack using CI/run_reframe.sh (#200)
  • Support for setting the exact required memory (#214)
  • For periodic tests using CI/run_reframe.sh, allow using a different version of the test-suite repository for the ReFrame config files (#226)

Bug fixes:

  • Fixed failing mktemp command in CI/run_reframe.sh when EESSI_CI_TEMPROOT isn't set (#227)
  • Make tests that don't use eessi_mixin always request GPUs if this is specified in the test.

Other updates:

  • Update lammps hook name to be more descriptive (#177)
  • Add empty init files to allow auto-generating API docs (#192)
  • Updates to ReFrame configs (#195, #198, #199, #202, #215, #216, #223, #225)
  • Log if the CI tag gets set (#204)
  • Reduce the amount of data that gets copied during ReFrame staging (#205, #220)
  • Log CVMFS_REPO_NAME, CVMFS_SOFTWARE_SUBDIR, MODULEPATH and EESSI test-suite version (#206)
  • Clarify error messages from EESSI mixin that warn test developers if certain variables aren't set on time in the child class (#208)
  • For periodic tests using CI/run_reframe.sh, avoid cloning the full history (#218)
  • Update release instructions (#230)

EESSI test suite v0.4.0

26 Sep 15:38
e944a49

Choose a tag to compare

Release date: 26 September 2024

This is a minor release of the EESSI test-suite

New tests:

Bug fixes:

  • Find and report duplicate modules (#167)
  • Specify memory as an extra resource in all ReFrame configs (#180)
  • Make req_memory_per_node hook print a warning if memory resource is not configured in ReFrame config (#182)
  • No longer test import of eessi.testsuite.utils directly in CI, as it fails (by design) for the ReFrame 4.6.2 version deployed in EESSI (#183)

Other updates:

  • mpi4py reduction test for tutorial (#149, #172), to accompany documentation on writing portable tests for the EESSI test suite
  • Various updates to Snellius ReFrame config (#165, #168, #187, #188)
  • Make the use of EESSI optional in common_eessi_init, to better support testing of local software stacks (#166)
  • Remove hard-coded SLURM account from karolina and hortense configs in favour of using the $SBATCH_ACCOUNT environment variable (#171)
  • Add ReFrame config and CI config for EESSI Azure build cluster (#173, #176, #186)
  • Add hook for measuring memory usage in a job (#174)
  • Bump default ReFrame version used in CI config to 4.6.2 (#175)
  • Use ReFrame warning's to print warnings, amking them easier to spot (#178)
  • Limit runtime of ReFrame command in in CI config (#179)
  • Add release notes and bump versions (#189)