Difference between revisions of "Testsuite Status"
(→Failing test suites) |
(→Failing test suites) |
||
| (One intermediate revision by the same user not shown) | |||
| Line 11: | Line 11: | ||
! Results | ! Results | ||
|- | |- | ||
| − | | | + | |rowspan="3"| AHFinderDirect |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | | AHFinderDirect | ||
| Kerr-definition-expansion-product | | Kerr-definition-expansion-product | ||
| 2 files compared, 2 differ, 2 differ significantly | | 2 files compared, 2 differ, 2 differ significantly | ||
| Line 25: | Line 18: | ||
| Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | | Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | ||
|- | |- | ||
| − | |||
| Kerr-modification-radius2 | | Kerr-modification-radius2 | ||
| 2 files missing, 0 files compared, 0 differ | | 2 files missing, 0 files compared, 0 differ | ||
| Line 32: | Line 24: | ||
| AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled. | | AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled. | ||
|- | |- | ||
| − | |||
| Kerr-selection-areal-radius-definition-expansion-product | | Kerr-selection-areal-radius-definition-expansion-product | ||
| 2 files compared, 2 differ, 2 differ significantly | | 2 files compared, 2 differ, 2 differ significantly | ||
| Line 39: | Line 30: | ||
| Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | | Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | ||
|- | |- | ||
| − | | QuasiLocalMeasures | + | |rowspan="6"| QuasiLocalMeasures |
| qlm-bl | | qlm-bl | ||
| 189 files missing, 1 files compared, 1 differ, 1 differ significantly | | 189 files missing, 1 files compared, 1 differ, 1 differ significantly | ||
| Line 52: | Line 43: | ||
* initial data in admbase::metric.average.asc already differs between current runs and testsuite files in iteration 0 (16 in TS vs. 625500150020001 in test). So the current result (625500150020001) seems wrong/poisoned. This would point towards Exact being the root cause. | * initial data in admbase::metric.average.asc already differs between current runs and testsuite files in iteration 0 (16 in TS vs. 625500150020001 in test). So the current result (625500150020001) seems wrong/poisoned. This would point towards Exact being the root cause. | ||
|- | |- | ||
| − | |||
| qlm-ks | | qlm-ks | ||
| 190 files compared, 122 differ, 12 differ significantly | | 190 files compared, 122 differ, 12 differ significantly | ||
| Line 59: | Line 49: | ||
| | | | ||
|- | |- | ||
| − | |||
| qlm-ks-boosted | | qlm-ks-boosted | ||
| 190 files compared, 165 differ, 165 differ significantly | | 190 files compared, 165 differ, 165 differ significantly | ||
| Line 66: | Line 55: | ||
| | | | ||
|- | |- | ||
| − | |||
| qlm-ks-shifted | | qlm-ks-shifted | ||
| 190 files compared, 165 differ, 165 differ significantly | | 190 files compared, 165 differ, 165 differ significantly | ||
| Line 73: | Line 61: | ||
| | | | ||
|- | |- | ||
| − | |||
| qlm-ks-tilted | | qlm-ks-tilted | ||
| 190 files compared, 138 differ, 15 differ significantly | | 190 files compared, 138 differ, 15 differ significantly | ||
| Line 80: | Line 67: | ||
| | | | ||
|- | |- | ||
| − | |||
| qlm-minkowski | | qlm-minkowski | ||
| 190 files compared, 86 differ, 8 differ significantly | | 190 files compared, 86 differ, 8 differ significantly | ||
Latest revision as of 23:20, 8 June 2010
Failing test suites
Currently the following testsuites fail
| Thorn | Test suite | Details | Maintainer | Date checked | Results |
|---|---|---|---|---|---|
| AHFinderDirect | Kerr-definition-expansion-product | 2 files compared, 2 differ, 2 differ significantly | peter | Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | |
| Kerr-modification-radius2 | 2 files missing, 0 files compared, 0 differ | peter | AHFinderDirect doesn't converge => no output files. Wasn't able to find an earlier version that passed. Temporarily disabled. | ||
| Kerr-selection-areal-radius-definition-expansion-product | 2 files compared, 2 differ, 2 differ significantly | peter | Found the bugfix after which the test started to fail. Test output regenerated. Now works on 1 proc but fails on 2 procs. | ||
| QuasiLocalMeasures | qlm-bl | 189 files missing, 1 files compared, 1 differ, 1 differ significantly |
AHFinderDirect::run_at_CCTK_POSTSTEP = no AHFinderDirect::run_at_CCTK_ANALYSIS = yes in parameter file so that AHFinderDirect::find_horizons is called (and produces output) only once during INIT
| ||
| qlm-ks | 190 files compared, 122 differ, 12 differ significantly | ||||
| qlm-ks-boosted | 190 files compared, 165 differ, 165 differ significantly | ||||
| qlm-ks-shifted | 190 files compared, 165 differ, 165 differ significantly | ||||
| qlm-ks-tilted | 190 files compared, 138 differ, 15 differ significantly | ||||
| qlm-minkowski | 190 files compared, 86 differ, 8 differ significantly |
Unrunnable test suites
These test suites are currently not run with the einsteintoolkit.th thornlist since they lack thorns
| Thorn | Test suite | Missing thorns | Maintainer | Results |
|---|---|---|---|---|
| AHFinderDirect | checkpoint | BSSN_MOL | ||
| AHFinderDirect | checkpoint2 | BSSN_MOL | ||
| AHFinderDirect | recover | BSSN_MOL | ||
| AHFinderDirect | recover2 | BSSN_MOL | ||
| Carpet | outer-buffers | WAVEMOL IDWAVEMOL INTERPTOARRAY | ||
| CarpetEvolutionMask | CarpetEvolutionMask_test | BSSN_MOL | ||
| CarpetEvolutionMask | CarpetEvolutionMask_test_off | BSSN_MOL | ||
| CarpetIOHDF5 | CarpetWaveToyNewRecover_test_1proc | IDSCALARWAVEC WAVETOYC | ||
| CarpetIOHDF5 | CarpetWaveToyRecover_test_1proc | IDSCALARWAVEC WAVETOYC | ||
| CarpetIOHDF5 | CarpetWaveToyRecover_test_4proc | IDSCALARWAVEC WAVETOYC | ||
| CarpetIOHDF5 | input_initial_data | WAVETOYMOL | ||
| CarpetInterp | waveinterp-1p | WAVEMOL IDWAVEMOL INTERPTOARRAY | ||
| CarpetInterp | waveinterp-2p | WAVEMOL IDWAVEMOL INTERPTOARRAY | ||
| CarpetRegrid | test_BSSN_MoL_Carpet | BSSN_MOL | ||
| CarpetRegrid | test_BSSN_MoL_Carpet_keep | BSSN_MOL | ||
| CarpetRegrid2 | test_BSSN_MoL_Carpet | BSSN_MOL | ||
| Cartoon2D | schw-0050 | BSSN_MOL | ||
| Cartoon2D | test_cartoon_2 | BSSN_MOL | ||
| Cartoon2D | test_cartoon_3 | BSSN_MOL | ||
| Dissipation | test_ah | BSSN_MOL | ||
| Dissipation | test_ob | BSSN_MOL | ||
| DistortedBHIVP | test_dbh | FLEXIO | ||
| DistortedBHIVP | xeon_test_dbh | EINSTEIN | ||
| Exact | KS-tilted | BSSN_MOL | ||
| Exact | de_Sitter | ADM_BSSN | ||
| GRHydro | GRHydro_test_tov_ppm | BSSN_MOL | ||
| GRHydro | GRHydro_test_tov_ppm_eosg | BSSN_MOL | ||
| GRHydro | GRHydro_test_tov_ppm_no_trp | BSSN_MOL | ||
| IDBrillData | test_brilldata_1 | BAM_ELLIPTIC | ||
| IDBrillData | test_brilldata_2 | BAM_ELLIPTIC | ||
| IOHDF5 | test_recover | WAVETOYC IDSCALARWAVEC | ||
| LegoExcision | test_legoexcision | ADM_BSSN | ||
| RotatingSymmetry180 | Kerr | BSSN_MOL | ||
| RotatingSymmetry180 | Kerr-rotating-180 | BSSN_MOL | ||
| RotatingSymmetry180 | Kerr-rotating-180-staggered | BSSN_MOL | ||
| RotatingSymmetry180 | Kerr-staggered | BSSN_MOL | ||
| RotatingSymmetry90 | Kerr-rotating-90 | BSSN_MOL | ||
| RotatingSymmetry90 | Kerr-rotating-90-staggered | BSSN_MOL | ||
| TwoPunctures | bam | BAM_ELLIPTIC | ||
| TwoPunctures | idpuncture | IDPUNCTURE TATJACOBI TATMG TATPETSC |
Partial fixes
Adding all possible thorns to the executable (see [1]) one can make all but the following tests run:
- GaugeWave-type0.01-rho1 in BSSN_MoL
Missing: IDLINEARWAVES NOISE NORMS
- de_Sitter in Exact
Missing: ADM_BSSN
- bam in TwoPunctures
Missing: BAM_ELLIPTIC
- idpuncture in TwoPunctures
Missing: IDPUNCTURE TATELLIPTIC TATJACOBI TATMG TATPETSC
- test_legoexcision in LegoExcision
Missing: ADM_BSSN
- outer-buffers in Carpet
Missing: INTERPTOARRAY
- waveinterp-1p in CarpetInterp
Missing: INTERPTOARRAY
- waveinterp-2p in CarpetInterp
Missing: INTERPTOARRAY
