Scoring method 2.1 · 16 October 2026
How results are judged
A result passes when it is accurate: every check within its limit. Whether its error shrinks as the grid gets finer is judged separately, with the rate's uncertainty, and a result that passes and converges is verified. Until 16 October 2026 one verdict folded both together. This page shows all 238 results both ways. Read the method.
What changed
Pass means accurate
Passes: every check within its limit. Converges: the error falls as the grid gets finer, at the rate a correct method should; shown with every result, and needed for the verified label. Method 1 failed a model 1 mm from the exact answer that converges slowly, just like one a metre out.
How close, not only which side
Each check says how much of its limit it used: 4 % of it, or 1.4× over it. A near miss and a gross failure stop looking alike.
The rate with its uncertainty
The convergence rate is fitted through every grid, with a 90 % range. It converges only if the whole range clears the minimum and does not if the whole range is below it; otherwise the grids cannot settle it. Method 1 took the average of the two finest pairs of grids, and that single number decided.
A solver's own precision
A program that stores levels to 0.3 mm cannot show its error falling below that. When the finest grid is within 3× a solver's declared precision, the rate is reported but not judged. Errors at rounding level on every grid fail outright: such results are a copy of the exact answer.
What moved
140passed under method 1
171pass now
126of them verified
67fail now (98 before)
26failed under method 1 only on the convergence rate
| Method 1 | → Passes | → Fails |
|---|---|---|
| Passes (140) | 140 | 0 |
| Fails (98) | 31 | 67 |
Of the passes with a grid study, 38 converge, 15 do not, 30 cannot be settled by their grids and 2 are at the solver's own precision. The other changes are on A1F-010, whose front limit went from 2.5 m to 9.8 m with this method (test version 3). 14 of the 39 results whose rate is unsettled are on tests run on three grids, where the fitted rate has one degree of freedom and its range is wide. Moving every grid study to five grids, the next step, would settle most of them.
Convergence rate, with its range
Dot: the rate fitted through every grid. Bar: its 90 % range. Shaded: at or above the minimum the test needs (line). Green: the whole range clears it; orange: the whole range is below it; grey: the range straddles it. Rates are clipped to the −1 to 2.5 window.
A1P-020 Joukowsky instant valve closure · needed 0.4
Demo 1D · suite example
0.49 [0.48, 0.50] Converges
TSNet · water hammer · MOC
1.89 [0.36, 3.41] Not settled
A1P-030 Advection–dispersion tracer (Ogata–Banks) · needed 1.6
Demo 1D · suite example
1.54 [1.31, 1.78] Not settled
EPANET 2.2 · US EPA
-0.00 [-0.01, 0.00] Does not
A1F-001 MacDonald M1 subcritical backwater · needed 0.8
Demo 1D · suite example
1.99 [1.98, 2.00] Converges
HEC-RAS 7.0 · 1D · 2D SWE-ELM
-0.35 [-0.76, 0.05] At its precision
TELEMAC-2D · openTELEMAC 9.1
1.01 [0.99, 1.03] Converges
ANUGA · 4.0.1
1.01 [0.99, 1.03] Converges
LISFLOOD-FP · 8.3 · FV1
0.99 [0.97, 1.01] Converges
LISFLOOD-FP · 8.3 · DG2
1.07 [0.98, 1.17] Converges
LISFLOOD-FP · 8.3 · ACC
0.36 [-0.34, 1.07] Not settled
EPA SWMM 5.2.4 · dynamic wave
1.84 [1.60, 2.08] Converges
OpenSWMM 6 · dynamic wave
1.84 [1.60, 2.08] Converges
OpenSWMM 6 · finite volume
0.79 [0.73, 0.85] Not settled
Hydra · urban drainage
0.81 [0.64, 0.97] Not settled
SWMM 5.1.15 · previous release
1.84 [1.60, 2.08] Converges
Basilisk · Saint-Venant
1.00 [0.98, 1.02] Converges
Landlab · OverlandFlow
0.37 [-0.34, 1.07] Not settled
HEC-RAS 6.6 · previous release
-0.35 [-0.76, 0.05] At its precision
A1F-010 Ritter dry-bed dam break · needed 0.8
Demo 1D · suite example
0.94 [0.94, 0.95] Converges
HEC-RAS 7.0 · 1D · 2D SWE-ELM
0.08 [0.05, 0.11] Does not
HEC-RAS 7.0 · 2D · SWE-EM
-0.02 [-0.11, 0.06] Does not
TELEMAC-2D · openTELEMAC 9.1
0.69 [0.64, 0.73] Does not
ANUGA · 4.0.1
0.90 [0.89, 0.91] Converges
GeoClaw · Clawpack 5.9
0.70 [0.51, 0.89] Not settled
LISFLOOD-FP · 8.3 · FV1
0.70 [0.66, 0.73] Does not
LISFLOOD-FP · 8.3 · DG2
0.55 [0.53, 0.56] Does not
LISFLOOD-FP · 8.3 · ACC
0.05 [0.02, 0.07] Does not
EPA SWMM 5.2.4 · dynamic wave
-0.25 [-0.82, 0.32] Does not
OpenSWMM 6 · dynamic wave
-0.25 [-0.82, 0.32] Does not
OpenSWMM 6 · finite volume
0.66 [0.54, 0.77] Does not
Hydra · urban drainage
0.01 [-0.22, 0.24] Does not
HydroNet · finite volume
-0.00 [-0.00, -0.00] Does not
HydroNet · FVM-PINN
0.13 [0.00, 0.25] Does not
SWMM 5.1.15 · previous release
-0.25 [-0.82, 0.32] Does not
Basilisk · Saint-Venant
1.03 [1.00, 1.06] Converges
Landlab · OverlandFlow
0.03 [0.03, 0.04] Does not
HEC-RAS 6.6 · previous release
0.08 [0.05, 0.11] Does not
HEC-RAS 6.6 · previous release · 2D SWE-EM
-0.02 [-0.11, 0.06] Does not
A1F-011 Stoker wet-bed dam break · needed 0.8
Demo 1D · suite example
0.96 [0.79, 1.13] Not settled
HEC-RAS 7.0 · 1D · 2D SWE-ELM
0.17 [0.07, 0.27] Does not
HEC-RAS 7.0 · 2D · SWE-EM
-0.19 [-0.30, -0.07] Does not
TELEMAC-2D · openTELEMAC 9.1
0.75 [0.72, 0.78] Does not
ANUGA · 4.0.1
0.72 [0.03, 1.42] Not settled
GeoClaw · Clawpack 5.9
0.83 [0.49, 1.17] Not settled
LISFLOOD-FP · 8.3 · FV1
0.78 [0.77, 0.80] Not settled
LISFLOOD-FP · 8.3 · DG2
0.78 [0.76, 0.79] Does not
LISFLOOD-FP · 8.3 · ACC
0.06 [-0.02, 0.14] Does not
EPA SWMM 5.2.4 · dynamic wave
-0.25 [-2.00, 1.49] Not settled
OpenSWMM 6 · dynamic wave
-0.25 [-2.00, 1.49] Not settled
OpenSWMM 6 · finite volume
0.87 [0.79, 0.95] Not settled
Hydra · urban drainage
-0.25 [-0.52, 0.01] Does not
HydroNet · finite volume
0.70 [0.68, 0.72] Does not
HydroNet · FVM-PINN
-0.12 [-0.23, -0.00] Does not
SWMM 5.1.15 · previous release
-0.25 [-2.00, 1.49] Not settled
Basilisk · Saint-Venant
0.98 [0.94, 1.03] Converges
Landlab · OverlandFlow
0.02 [-0.01, 0.04] Does not
HEC-RAS 6.6 · previous release
0.17 [0.07, 0.27] Does not
HEC-RAS 6.6 · previous release · 2D SWE-EM
-0.19 [-0.30, -0.07] Does not
A1F-020 Bélanger hydraulic jump · needed 0.8
Demo 1D · suite example
1.00 [1.00, 1.00] Converges
TELEMAC-2D · openTELEMAC 9.1
0.95 [0.86, 1.04] Converges
ANUGA · 4.0.1
-0.02 [-0.57, 0.54] Does not
EPA SWMM 5.2.4 · dynamic wave
0.13 [-0.17, 0.43] Does not
OpenSWMM 6 · dynamic wave
0.11 [-0.06, 0.28] Does not
OpenSWMM 6 · finite volume
-0.01 [-0.02, -0.00] Does not
Hydra · urban drainage
0.25 [-0.13, 0.63] Does not
SWMM 5.1.15 · previous release
0.13 [-0.17, 0.43] Does not
Basilisk · Saint-Venant
1.00 [1.00, 1.00] Converges
A1F-040 Subcritical flow over a bump (SWASHES) · needed 0.8
TELEMAC-2D · openTELEMAC 9.1
0.97 [0.94, 1.01] Converges
ANUGA · 4.0.1
0.94 [0.69, 1.19] Not settled
LISFLOOD-FP · 8.3 · FV1
1.00 [0.99, 1.00] Converges
LISFLOOD-FP · 8.3 · DG2
1.00 [0.99, 1.00] Converges
LISFLOOD-FP · 8.3 · ACC
-0.13 [-0.27, 0.01] Does not
EPA SWMM 5.2.4 · dynamic wave
-3.74 [-14.50, 7.01] Not settled
OpenSWMM 6 · dynamic wave
-3.88 [-14.16, 6.41] Not settled
OpenSWMM 6 · finite volume
0.99 [0.99, 1.00] Converges
Hydra · urban drainage
-0.20 [-0.28, -0.12] Does not
SWMM 5.1.15 · previous release
-3.74 [-14.50, 7.01] Not settled
Basilisk · Saint-Venant
2.15 [1.94, 2.36] Converges
Landlab · OverlandFlow
0.00 [0.00, 0.00] Does not
A1F-041 Transcritical flow over a bump, no shock (SWASHES) · needed 0.8
TELEMAC-2D · openTELEMAC 9.1
0.94 [0.93, 0.94] Converges
ANUGA · 4.0.1
0.91 [0.69, 1.14] Not settled
LISFLOOD-FP · 8.3 · FV1
0.95 [0.94, 0.95] Converges
LISFLOOD-FP · 8.3 · DG2
0.93 [0.91, 0.95] Converges
LISFLOOD-FP · 8.3 · ACC
-0.12 [-0.32, 0.08] Does not
EPA SWMM 5.2.4 · dynamic wave
-0.17 [-2.73, 2.40] Not settled
OpenSWMM 6 · dynamic wave
-0.27 [-1.78, 1.23] Not settled
OpenSWMM 6 · finite volume
1.04 [0.88, 1.21] Converges
Hydra · urban drainage
0.04 [-0.70, 0.77] Does not
SWMM 5.1.15 · previous release
-0.17 [-2.73, 2.40] Not settled
Basilisk · Saint-Venant
2.02 [2.00, 2.04] Converges
Landlab · OverlandFlow
0.04 [-0.11, 0.20] Does not
A1F-042 Transcritical flow over a bump with a hydraulic jump (SWASHES) · needed 0.8
TELEMAC-2D · openTELEMAC 9.1
0.98 [0.74, 1.21] Not settled
ANUGA · 4.0.1
0.98 [-1.17, 3.12] Not settled
LISFLOOD-FP · 8.3 · FV1
0.90 [0.61, 1.20] Not settled
LISFLOOD-FP · 8.3 · DG2
0.86 [0.47, 1.24] Not settled
LISFLOOD-FP · 8.3 · ACC
0.04 [-0.55, 0.62] Does not
EPA SWMM 5.2.4 · dynamic wave
-0.56 [-1.58, 0.46] Does not
OpenSWMM 6 · dynamic wave
-0.38 [-0.82, 0.06] Does not
OpenSWMM 6 · finite volume
0.89 [0.52, 1.25] Not settled
Hydra · urban drainage
-0.33 [-1.03, 0.38] Does not
SWMM 5.1.15 · previous release
-0.56 [-1.58, 0.46] Does not
Basilisk · Saint-Venant
1.06 [0.71, 1.41] Not settled
Landlab · OverlandFlow
0.01 [-0.02, 0.04] Does not
A2A-001 Thacker parabolic bowl · needed 0.8
Demo 2D · suite example
0.90 [0.86, 0.94] Converges
TELEMAC-2D · openTELEMAC 9.1
0.88 [0.84, 0.91] Converges
ANUGA · 4.0.1
1.29 [1.16, 1.43] Converges
GeoClaw · Clawpack 5.9
1.24 [0.86, 1.62] Converges
LISFLOOD-FP · 8.3 · FV1
0.79 [0.69, 0.88] Not settled
LISFLOOD-FP · 8.3 · DG2
0.93 [0.30, 1.57] Not settled
LISFLOOD-FP · 8.3 · ACC
0.53 [0.16, 0.90] Not settled
Basilisk · Saint-Venant
1.48 [1.31, 1.64] Converges
Landlab · OverlandFlow
-0.05 [-0.82, 0.71] Does not
A2A-010 MacDonald 2D manufactured channel · needed 0.8
Demo 2D · suite example
1.03 [1.02, 1.03] Converges
HEC-RAS 7.0 · 1D · 2D SWE-ELM
0.81 [0.12, 1.50] Not settled
HEC-RAS 7.0 · 2D · SWE-EM
1.02 [0.44, 1.60] Not settled
TELEMAC-2D · openTELEMAC 9.1
0.97 [0.93, 1.01] Converges
ANUGA · 4.0.1
1.05 [0.94, 1.16] Converges
LISFLOOD-FP · 8.3 · FV1
0.98 [0.96, 1.00] Converges
LISFLOOD-FP · 8.3 · DG2
1.24 [0.96, 1.51] Converges
LISFLOOD-FP · 8.3 · ACC
0.54 [-0.24, 1.32] Not settled
Basilisk · Saint-Venant
1.01 [0.98, 1.03] Converges
Landlab · OverlandFlow
0.54 [-0.19, 1.27] Not settled
HEC-RAS 6.6 · previous release
0.81 [0.11, 1.50] Not settled
HEC-RAS 6.6 · previous release · 2D SWE-EM
1.02 [0.43, 1.60] Not settled
A2A-020 Oblique hydraulic jump · needed 0.8
Demo 2D · suite example
0.86 [0.77, 0.95] Not settled
TELEMAC-2D · openTELEMAC 9.1
0.90 [0.83, 0.97] Converges
ANUGA · 4.0.1
0.94 [0.93, 0.95] Converges
Basilisk · Saint-Venant
0.96 [0.94, 0.98] Converges
Results whose verdict changed (31)
| Test | Model | Method 1 | Now | Why |
|---|---|---|---|---|
| A1P-030 | EPANET 2.2 · US EPA | Fails | Passes | accurate, but does not converge at the expected rate (order -0.00, 90 % interval -0.01 to 0.00, all below 1.6) |
| A1F-001 | HEC-RAS 7.0 · 1D · 2D SWE-ELM | Fails | Passes | accurate, at the solver's own precision (finest-grid error 0.0001 is within 3× the solver's precision (HEC-RAS 1D stores cross-section elevations to 0.001 ft (0.3 mm), even in SI projects (docs/hecras.md))) |
| A1F-001 | LISFLOOD-FP · 8.3 · ACC | Fails | Passes | accurate; these grids cannot settle the rate (order 0.36, 90 % interval -0.34 to 1.07 includes 0.8) |
| A1F-001 | OpenSWMM 6 · finite volume | Fails | Passes | accurate; these grids cannot settle the rate (order 0.79, 90 % interval 0.73 to 0.85 includes 0.8) |
| A1F-001 | Landlab · OverlandFlow | Fails | Passes | accurate; these grids cannot settle the rate (order 0.37, 90 % interval -0.34 to 1.07 includes 0.8) |
| A1F-001 | HEC-RAS 6.6 · previous release | Fails | Passes | accurate, at the solver's own precision (finest-grid error 0.0001 is within 3× the solver's precision (HEC-RAS 1D stores cross-section elevations to 0.001 ft (0.3 mm), even in SI projects (docs/hecras.md))) |
| A1F-010 | TELEMAC-2D · openTELEMAC 9.1 | Fails | Passes | within the new 9.8 m front limit (test version 3); accurate, but does not converge at the expected rate (order 0.69, 90 % interval 0.64 to 0.73, all below 0.8) |
| A1F-010 | GeoClaw · Clawpack 5.9 | Fails | Passes | within the new 9.8 m front limit (test version 3); accurate; these grids cannot settle the rate (order 0.70, 90 % interval 0.51 to 0.89 includes 0.8) |
| A1F-010 | LISFLOOD-FP · 8.3 · FV1 | Fails | Passes | within the new 9.8 m front limit (test version 3); accurate, but does not converge at the expected rate (order 0.70, 90 % interval 0.66 to 0.73, all below 0.8) |
| A1F-010 | LISFLOOD-FP · 8.3 · DG2 | Fails | Passes | within the new 9.8 m front limit (test version 3); accurate, but does not converge at the expected rate (order 0.55, 90 % interval 0.53 to 0.56, all below 0.8) |
| A1F-010 | OpenSWMM 6 · finite volume | Fails | Passes | within the new 9.8 m front limit (test version 3); accurate, but does not converge at the expected rate (order 0.66, 90 % interval 0.54 to 0.77, all below 0.8) |
| A1F-011 | HEC-RAS 7.0 · 1D · 2D SWE-ELM | Fails | Passes | accurate, but does not converge at the expected rate (order 0.17, 90 % interval 0.07 to 0.27, all below 0.8) |
| A1F-011 | HEC-RAS 7.0 · 2D · SWE-EM | Fails | Passes | accurate, but does not converge at the expected rate (order -0.19, 90 % interval -0.30 to -0.07, all below 0.8) |
| A1F-011 | TELEMAC-2D · openTELEMAC 9.1 | Fails | Passes | accurate, but does not converge at the expected rate (order 0.75, 90 % interval 0.72 to 0.78, all below 0.8) |
| A1F-011 | LISFLOOD-FP · 8.3 · FV1 | Fails | Passes | accurate; these grids cannot settle the rate (order 0.78, 90 % interval 0.77 to 0.80 includes 0.8) |
| A1F-011 | LISFLOOD-FP · 8.3 · DG2 | Fails | Passes | accurate, but does not converge at the expected rate (order 0.78, 90 % interval 0.76 to 0.79, all below 0.8) |
| A1F-011 | LISFLOOD-FP · 8.3 · ACC | Fails | Passes | accurate, but does not converge at the expected rate (order 0.06, 90 % interval -0.02 to 0.14, all below 0.8) |
| A1F-011 | Hydra · urban drainage | Fails | Passes | accurate, but does not converge at the expected rate (order -0.25, 90 % interval -0.52 to 0.01, all below 0.8) |
| A1F-011 | HydroNet · finite volume | Fails | Passes | accurate, but does not converge at the expected rate (order 0.70, 90 % interval 0.68 to 0.72, all below 0.8) |
| A1F-011 | Landlab · OverlandFlow | Fails | Passes | accurate, but does not converge at the expected rate (order 0.02, 90 % interval -0.01 to 0.04, all below 0.8) |
| A1F-011 | HEC-RAS 6.6 · previous release | Fails | Passes | accurate, but does not converge at the expected rate (order 0.17, 90 % interval 0.07 to 0.27, all below 0.8) |
| A1F-011 | HEC-RAS 6.6 · previous release · 2D SWE-EM | Fails | Passes | accurate, but does not converge at the expected rate (order -0.19, 90 % interval -0.30 to -0.07, all below 0.8) |
| A2A-001 | LISFLOOD-FP · 8.3 · FV1 | Fails | Passes | accurate; these grids cannot settle the rate (order 0.79, 90 % interval 0.69 to 0.88 includes 0.8) |
| A2A-001 | LISFLOOD-FP · 8.3 · DG2 | Fails | Passes | accurate; these grids cannot settle the rate (order 0.93, 90 % interval 0.30 to 1.57 includes 0.8) |
| A2A-001 | LISFLOOD-FP · 8.3 · ACC | Fails | Passes | accurate; these grids cannot settle the rate (order 0.53, 90 % interval 0.16 to 0.90 includes 0.8) |
| A2A-010 | HEC-RAS 7.0 · 1D · 2D SWE-ELM | Fails | Passes | accurate; these grids cannot settle the rate (order 0.81, 90 % interval 0.12 to 1.50 includes 0.8) |
| A2A-010 | HEC-RAS 7.0 · 2D · SWE-EM | Fails | Passes | accurate; these grids cannot settle the rate (order 1.02, 90 % interval 0.44 to 1.60 includes 0.8) |
| A2A-010 | LISFLOOD-FP · 8.3 · ACC | Fails | Passes | accurate; these grids cannot settle the rate (order 0.54, 90 % interval -0.24 to 1.32 includes 0.8) |
| A2A-010 | Landlab · OverlandFlow | Fails | Passes | accurate; these grids cannot settle the rate (order 0.54, 90 % interval -0.19 to 1.27 includes 0.8) |
| A2A-010 | HEC-RAS 6.6 · previous release | Fails | Passes | accurate; these grids cannot settle the rate (order 0.81, 90 % interval 0.11 to 1.50 includes 0.8) |
| A2A-010 | HEC-RAS 6.6 · previous release · 2D SWE-EM | Fails | Passes | accurate; these grids cannot settle the rate (order 1.02, 90 % interval 0.43 to 1.60 includes 0.8) |
Close to the line (22)
Results whose worst gating check used between half and twice its limit: method 1 gave these a confident ✓ or ✗ either way; the share of the limit now shows how close they came.
| Test | Model | Worst check, share of its limit | Now |
|---|---|---|---|
| A1F-010 | LISFLOOD-FP · 8.3 · FV1 | 0.51× | Passes |
| A1F-020 | Basilisk · Saint-Venant | 0.52× | Passes |
| A1F-010 | LISFLOOD-FP · 8.3 · DG2 | 0.56× | Passes |
| A12-010 | OpenSWMM 6 · coupled 1D/2D | 0.56× | Passes |
| A1F-010 | TELEMAC-2D · openTELEMAC 9.1 | 0.59× | Passes |
| A1P-001 | EPANET 2.2 · US EPA | 0.60× | Passes |
| A1F-020 | Demo 1D · suite example | 0.61× | Passes |
| A12-011 | SWMM + ANUGA · coupled 1D/2D | 0.62× | Passes |
| A2C-EA1 | HEC-RAS 7.0 · 2D · SWE-EM | 0.63× | Passes |
| A2C-EA1 | HEC-RAS 6.6 · previous release · 2D SWE-EM | 0.63× | Passes |
| A2C-EA1 | HEC-RAS 7.0 · 1D · 2D SWE-ELM | 0.63× | Passes |
| A2C-EA1 | HEC-RAS 6.6 · previous release | 0.63× | Passes |
| A1P-001 | Hydra · water distribution | 0.65× | Passes |
| A1F-001 | Landlab · OverlandFlow | 0.65× | Passes |
| A1F-001 | LISFLOOD-FP · 8.3 · ACC | 0.65× | Passes |
| A1P-030 | EPANET 2.2 · US EPA | 0.94× | Passes |
| A12-010 | SWMM + ANUGA · coupled 1D/2D | 1.13× | Fails |
| A2A-020 | ANUGA · 4.0.1 | 1.27× | Fails |
| A2A-020 | Basilisk · Saint-Venant | 1.30× | Fails |
| A1D-001 | OpenSWMM 6 · finite volume | 1.40× | Fails |
| A2A-020 | TELEMAC-2D · openTELEMAC 9.1 | 1.49× | Fails |
| A12-010 | HEC-RAS 7.0 · pipe networks · 1D/2D | 1.96× | Fails |