Difference between revisions of "Testsuite Status"

From Einstein Toolkit Documentation
Jump to: navigation, search
(add link to Roland's original email with test results)
(→‎Failing test suites)
 
(15 intermediate revisions by 6 users not shown)
Line 8: Line 8:
 
! Details
 
! Details
 
! Maintainer
 
! Maintainer
 +
! Date checked
 
! Results
 
! Results
 
|-
 
|-
−
| ADM
+
|rowspan="3"| AHFinderDirect
−
| test_ADM_2
 
−
| 32 files compared, 32 differ, 32 differ significantly
 
−
|
 
−
|
 
−
|-
 
−
| AHFinderDirect
 
 
| Kerr-definition-expansion-product
 
| Kerr-definition-expansion-product
 
| 2 files compared, 2 differ, 2 differ significantly
 
| 2 files compared, 2 differ, 2 differ significantly
 +
| peter
 
|  
 
|  
−
|  
+
| Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
 
|-
 
|-
−
| AHFinderDirect
 
 
| Kerr-modification-radius2
 
| Kerr-modification-radius2
 
| 2 files missing, 0 files compared, 0 differ
 
| 2 files missing, 0 files compared, 0 differ
 +
| peter
 
|  
 
|  
−
|  
+
| AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled.
 
|-
 
|-
−
| AHFinderDirect
 
 
| Kerr-selection-areal-radius-definition-expansion-product
 
| Kerr-selection-areal-radius-definition-expansion-product
 
| 2 files compared, 2 differ, 2 differ significantly
 
| 2 files compared, 2 differ, 2 differ significantly
 +
| peter
 
|  
 
|  
−
|  
+
| Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
 
|-
 
|-
−
| DistortedBHIVP
+
|rowspan="6"| QuasiLocalMeasures
−
| E2xeon_test_dbh
 
−
| 100 files compared, 96 differ, 95 differ significantly
 
−
|
 
−
|
 
−
|-
 
−
| Exact
 
−
| Schwarzschild_EF
 
−
| 112 files compared, 105 differ, 105 differ significantly
 
−
|
 
−
|
 
−
|-
 
−
| Hydro_InitExcision
 
−
| halfsphere_pugh_eno
 
−
| 75 files compared, 66 differ, 62 differ significantly
 
−
| knarf
 
−
| known to fail
 
−
|-
 
−
| Hydro_InitExcision
 
−
| halfsphere_pugh_ppm
 
−
| 75 files compared, 57 differ, 2 differ significantly
 
−
| knarf
 
−
| works for me
 
−
|-
 
−
| Hydro_InitExcision
 
−
| sphere_pugh_eno
 
−
| 75 files compared, 67 differ, 67 differ significantly
 
−
| knarf
 
−
| known to fail
 
−
|-
 
−
| Hydro_InitExcision
 
−
| x_flip_pugh_ppm
 
−
| 72 files compared, 27 differ, 1 differ significantly
 
−
| knarf
 
−
| works for me
 
−
|-
 
−
| Hydro_InitExcision
 
−
| x_pugh_ppm
 
−
| 72 files compared, 36 differ, 1 differ significantly
 
−
| knarf
 
−
| works for me
 
−
|-
 
−
| IDAxiBrillBH
 
−
| test_axibrill
 
−
| 96 files missing, 0 files compared, 0 differ
 
−
| eschnett?
 
−
| unclear code (intentional abort)
 
−
|-
 
−
| IDAxiBrillBH
 
−
| test_axibrill_nostagger
 
−
| 96 files missing, 0 files compared, 0 differ
 
−
| eschnett?
 
−
| unclear code (intentional abort)
 
−
|-
 
−
| IDAxiOddBrillBH
 
−
| E2xeon_test_axioddbh
 
−
| 88 files compared, 88 differ, 88 differ significantly
 
−
|
 
−
|
 
−
|-
 
−
| IDConstraintViolate
 
−
| ConstraintViolate
 
−
| 24 files compared, 24 differ, 24 differ significantly
 
−
|
 
−
|
 
−
|-
 
−
| QuasiLocalMeasures
 
 
| qlm-bl
 
| qlm-bl
 
| 189 files missing, 1 files compared, 1 differ, 1 differ significantly
 
| 189 files missing, 1 files compared, 1 differ, 1 differ significantly
 
|  
 
|  
 
|  
 
|  
 +
|
 +
* requires
 +
  AHFinderDirect::run_at_CCTK_POSTSTEP = no
 +
  AHFinderDirect::run_at_CCTK_ANALYSIS = yes
 +
in parameter file so that AHFinderDirect::find_horizons is called (and produces output) only once during INIT
 +
* all .count.asc files for grid-scalars should be removed since they count the elements on all processors so that the output is processor dependend
 +
* initial data in admbase::metric.average.asc already differs between current runs and testsuite files in iteration 0 (16 in TS vs. 625500150020001 in test). So the current result (625500150020001) seems wrong/poisoned. This would point towards Exact being the root cause.
 
|-
 
|-
−
| QuasiLocalMeasures
 
 
| qlm-ks
 
| qlm-ks
 
| 190 files compared, 122 differ, 12 differ significantly
 
| 190 files compared, 122 differ, 12 differ significantly
 +
|
 
|  
 
|  
 
|  
 
|  
 
|-
 
|-
−
| QuasiLocalMeasures
 
 
| qlm-ks-boosted
 
| qlm-ks-boosted
 
| 190 files compared, 165 differ, 165 differ significantly
 
| 190 files compared, 165 differ, 165 differ significantly
 +
|
 
|  
 
|  
 
|  
 
|  
 
|-
 
|-
−
| QuasiLocalMeasures
 
 
| qlm-ks-shifted
 
| qlm-ks-shifted
 
| 190 files compared, 165 differ, 165 differ significantly
 
| 190 files compared, 165 differ, 165 differ significantly
 +
|
 
|  
 
|  
 
|  
 
|  
 
|-
 
|-
−
| QuasiLocalMeasures
 
 
| qlm-ks-tilted
 
| qlm-ks-tilted
 
| 190 files compared, 138 differ, 15 differ significantly
 
| 190 files compared, 138 differ, 15 differ significantly
 +
|
 
|  
 
|  
 
|  
 
|  
 
|-
 
|-
−
| QuasiLocalMeasures
 
 
| qlm-minkowski
 
| qlm-minkowski
 
| 190 files compared, 86 differ, 8 differ significantly
 
| 190 files compared, 86 differ, 8 differ significantly
 
|  
 
|  
−
|
 
−
|-
 
−
| RotatingDBHIVP
 
−
| E2xeon_test_rdbh
 
−
| 144 files compared, 144 differ, 144 differ significantly
 
 
|  
 
|  
 
|  
 
|  
Line 320: Line 251:
 
| GRHydro_test_tov_ppm_no_trp
 
| GRHydro_test_tov_ppm_no_trp
 
| BSSN_MOL
 
| BSSN_MOL
−
|
 
−
|
 
−
|-
 
−
| IDAxiOddBrillBH
 
−
| test_axioddbh
 
−
| FLEXIO
 
−
|
 
−
|
 
−
|-
 
−
| IDAxiOddBrillBH
 
−
| xeon_test_axioddbh
 
−
| EINSTEIN
 
 
|
 
|
 
|
 
|
Line 356: Line 275:
 
| test_legoexcision
 
| test_legoexcision
 
| ADM_BSSN
 
| ADM_BSSN
−
|
 
−
|
 
−
|-
 
−
| RotatingDBHIVP
 
−
| test_rdbh
 
−
| FLEXIO
 
−
|
 
−
|
 
−
|-
 
−
| RotatingDBHIVP
 
−
| xeon_test_rdbh
 
−
| EINSTEIN
 
 
|
 
|
 
|
 
|

Latest revision as of 23:20, 8 June 2010

Failing test suites

Currently the following testsuites fail

Thorn Test suite Details Maintainer Date checked Results
AHFinderDirect Kerr-definition-expansion-product 2 files compared, 2 differ, 2 differ significantly peter Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
Kerr-modification-radius2 2 files missing, 0 files compared, 0 differ peter AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled.
Kerr-selection-areal-radius-definition-expansion-product 2 files compared, 2 differ, 2 differ significantly peter Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs.
QuasiLocalMeasures qlm-bl 189 files missing, 1 files compared, 1 differ, 1 differ significantly
  • requires
 AHFinderDirect::run_at_CCTK_POSTSTEP = no
 AHFinderDirect::run_at_CCTK_ANALYSIS = yes

in parameter file so that AHFinderDirect::find_horizons is called (and produces output) only once during INIT

  • all .count.asc files for grid-scalars should be removed since they count the elements on all processors so that the output is processor dependend
  • initial data in admbase::metric.average.asc already differs between current runs and testsuite files in iteration 0 (16 in TS vs. 625500150020001 in test). So the current result (625500150020001) seems wrong/poisoned. This would point towards Exact being the root cause.
qlm-ks 190 files compared, 122 differ, 12 differ significantly
qlm-ks-boosted 190 files compared, 165 differ, 165 differ significantly
qlm-ks-shifted 190 files compared, 165 differ, 165 differ significantly
qlm-ks-tilted 190 files compared, 138 differ, 15 differ significantly
qlm-minkowski 190 files compared, 86 differ, 8 differ significantly

Unrunnable test suites

These test suites are currently not run with the einsteintoolkit.th thornlist since they lack thorns

Thorn Test suite Missing thorns Maintainer Results
AHFinderDirect checkpoint BSSN_MOL
AHFinderDirect checkpoint2 BSSN_MOL
AHFinderDirect recover BSSN_MOL
AHFinderDirect recover2 BSSN_MOL
Carpet outer-buffers WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetEvolutionMask CarpetEvolutionMask_test BSSN_MOL
CarpetEvolutionMask CarpetEvolutionMask_test_off BSSN_MOL
CarpetIOHDF5 CarpetWaveToyNewRecover_test_1proc IDSCALARWAVEC WAVETOYC
CarpetIOHDF5 CarpetWaveToyRecover_test_1proc IDSCALARWAVEC WAVETOYC
CarpetIOHDF5 CarpetWaveToyRecover_test_4proc IDSCALARWAVEC WAVETOYC
CarpetIOHDF5 input_initial_data WAVETOYMOL
CarpetInterp waveinterp-1p WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetInterp waveinterp-2p WAVEMOL IDWAVEMOL INTERPTOARRAY
CarpetRegrid test_BSSN_MoL_Carpet BSSN_MOL
CarpetRegrid test_BSSN_MoL_Carpet_keep BSSN_MOL
CarpetRegrid2 test_BSSN_MoL_Carpet BSSN_MOL
Cartoon2D schw-0050 BSSN_MOL
Cartoon2D test_cartoon_2 BSSN_MOL
Cartoon2D test_cartoon_3 BSSN_MOL
Dissipation test_ah BSSN_MOL
Dissipation test_ob BSSN_MOL
DistortedBHIVP test_dbh FLEXIO
DistortedBHIVP xeon_test_dbh EINSTEIN
Exact KS-tilted BSSN_MOL
Exact de_Sitter ADM_BSSN
GRHydro GRHydro_test_tov_ppm BSSN_MOL
GRHydro GRHydro_test_tov_ppm_eosg BSSN_MOL
GRHydro GRHydro_test_tov_ppm_no_trp BSSN_MOL
IDBrillData test_brilldata_1 BAM_ELLIPTIC
IDBrillData test_brilldata_2 BAM_ELLIPTIC
IOHDF5 test_recover WAVETOYC IDSCALARWAVEC
LegoExcision test_legoexcision ADM_BSSN
RotatingSymmetry180 Kerr BSSN_MOL
RotatingSymmetry180 Kerr-rotating-180 BSSN_MOL
RotatingSymmetry180 Kerr-rotating-180-staggered BSSN_MOL
RotatingSymmetry180 Kerr-staggered BSSN_MOL
RotatingSymmetry90 Kerr-rotating-90 BSSN_MOL
RotatingSymmetry90 Kerr-rotating-90-staggered BSSN_MOL
TwoPunctures bam BAM_ELLIPTIC
TwoPunctures idpuncture IDPUNCTURE TATJACOBI TATMG TATPETSC

Partial fixes

Adding all possible thorns to the executable (see [1]) one can make all but the following tests run:

  • GaugeWave-type0.01-rho1 in BSSN_MoL

Missing: IDLINEARWAVES NOISE NORMS

  • de_Sitter in Exact

Missing: ADM_BSSN

  • bam in TwoPunctures

Missing: BAM_ELLIPTIC

  • idpuncture in TwoPunctures

Missing: IDPUNCTURE TATELLIPTIC TATJACOBI TATMG TATPETSC

  • test_legoexcision in LegoExcision

Missing: ADM_BSSN

  • outer-buffers in Carpet

Missing: INTERPTOARRAY

  • waveinterp-1p in CarpetInterp

Missing: INTERPTOARRAY

  • waveinterp-2p in CarpetInterp

Missing: INTERPTOARRAY

Retrieved from "https://docs.einsteintoolkit.org/et-docs/index.php?title=Testsuite_Status&oldid=1607"