Testsuite Status

Failing test suites

Currently the following testsuites fail

Thorn	Test suite	Details	Maintainer	Date checked	Results
AHFinderDirect	Kerr-definition-expansion-product	2 files compared, 2 differ, 2 differ significantly	peter		Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
	Kerr-modification-radius2	2 files missing, 0 files compared, 0 differ	peter		AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled.
	Kerr-selection-areal-radius-definition-expansion-product	2 files compared, 2 differ, 2 differ significantly	peter		Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
QuasiLocalMeasures	qlm-bl	189 files missing, 1 files compared, 1 differ, 1 differ significantly			requires AHFinderDirect::run_at_CCTK_POSTSTEP = no AHFinderDirect::run_at_CCTK_ANALYSIS = yes in parameter file so that AHFinderDirect::find_horizons is called (and produces output) only once during INIT all .count.asc files for grid-scalars should be removed since they count the elements on all processors so that the output is processor dependend initial data in admbase::metric.average.asc already differs between current runs and testsuite files in iteration 0 (16 in TS vs. 625500150020001 in test). So the current result (625500150020001) seems wrong/poisoned. This would point towards Exact being the root cause.
	qlm-ks	190 files compared, 122 differ, 12 differ significantly
	qlm-ks-boosted	190 files compared, 165 differ, 165 differ significantly
	qlm-ks-shifted	190 files compared, 165 differ, 165 differ significantly
	qlm-ks-tilted	190 files compared, 138 differ, 15 differ significantly
	qlm-minkowski	190 files compared, 86 differ, 8 differ significantly

Unrunnable test suites

These test suites are currently not run with the einsteintoolkit.th thornlist since they lack thorns

Thorn	Test suite	Missing thorns	Maintainer	Results
AHFinderDirect	checkpoint	BSSN_MOL
AHFinderDirect	checkpoint2	BSSN_MOL
AHFinderDirect	recover	BSSN_MOL
AHFinderDirect	recover2	BSSN_MOL
Carpet	outer-buffers	WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetEvolutionMask	CarpetEvolutionMask_test	BSSN_MOL
CarpetEvolutionMask	CarpetEvolutionMask_test_off	BSSN_MOL
CarpetIOHDF5	CarpetWaveToyNewRecover_test_1proc	IDSCALARWAVEC WAVETOYC
CarpetIOHDF5	CarpetWaveToyRecover_test_1proc	IDSCALARWAVEC WAVETOYC
CarpetIOHDF5	CarpetWaveToyRecover_test_4proc	IDSCALARWAVEC WAVETOYC
CarpetIOHDF5	input_initial_data	WAVETOYMOL
CarpetInterp	waveinterp-1p	WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetInterp	waveinterp-2p	WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetRegrid	test_BSSN_MoL_Carpet	BSSN_MOL
CarpetRegrid	test_BSSN_MoL_Carpet_keep	BSSN_MOL
CarpetRegrid2	test_BSSN_MoL_Carpet	BSSN_MOL
Cartoon2D	schw-0050	BSSN_MOL
Cartoon2D	test_cartoon_2	BSSN_MOL
Cartoon2D	test_cartoon_3	BSSN_MOL
Dissipation	test_ah	BSSN_MOL
Dissipation	test_ob	BSSN_MOL
DistortedBHIVP	test_dbh	FLEXIO
DistortedBHIVP	xeon_test_dbh	EINSTEIN
Exact	KS-tilted	BSSN_MOL
Exact	de_Sitter	ADM_BSSN
GRHydro	GRHydro_test_tov_ppm	BSSN_MOL
GRHydro	GRHydro_test_tov_ppm_eosg	BSSN_MOL
GRHydro	GRHydro_test_tov_ppm_no_trp	BSSN_MOL
IDBrillData	test_brilldata_1	BAM_ELLIPTIC
IDBrillData	test_brilldata_2	BAM_ELLIPTIC
IOHDF5	test_recover	WAVETOYC IDSCALARWAVEC
LegoExcision	test_legoexcision	ADM_BSSN
RotatingSymmetry180	Kerr	BSSN_MOL
RotatingSymmetry180	Kerr-rotating-180	BSSN_MOL
RotatingSymmetry180	Kerr-rotating-180-staggered	BSSN_MOL
RotatingSymmetry180	Kerr-staggered	BSSN_MOL
RotatingSymmetry90	Kerr-rotating-90	BSSN_MOL
RotatingSymmetry90	Kerr-rotating-90-staggered	BSSN_MOL
TwoPunctures	bam	BAM_ELLIPTIC
TwoPunctures	idpuncture	IDPUNCTURE TATJACOBI TATMG TATPETSC

Partial fixes

Adding all possible thorns to the executable (see [1]) one can make all but the following tests run:

• GaugeWave-type0.01-rho1 in BSSN_MoL

Missing: IDLINEARWAVES NOISE NORMS

• de_Sitter in Exact

Missing: ADM_BSSN

• bam in TwoPunctures

Missing: BAM_ELLIPTIC

• idpuncture in TwoPunctures

Missing: IDPUNCTURE TATELLIPTIC TATJACOBI TATMG TATPETSC

• test_legoexcision in LegoExcision

Missing: ADM_BSSN

• outer-buffers in Carpet

Missing: INTERPTOARRAY

• waveinterp-1p in CarpetInterp

Missing: INTERPTOARRAY

• waveinterp-2p in CarpetInterp

Missing: INTERPTOARRAY