Home / Benchmarking / Fire: burn probability
Ranks where fire occurs well above chance across four decades - but an annually-updated FSim product beats it on every overlapping year.
a WA against the published Moran burn probability, cell by cell across California.
b Year by year against Moran and Pyrologix on the same test, so the three are scored identically.
c Forty years: the share of burned area falling in the top 20% of predicted burn probability. Above chance (0.20) in nearly every year.
d What that score means - the cumulative capture curve, showing how much fire is caught as more of the landscape is included.
e Two never-disturbed cohorts from 1995: all such pixels and only those with no fire within 10 km. The isolated set rises as fuel accumulates; the other falls because neighbouring fire removes fuel.
Strengths and weaknesses on each axis, as measured. Weaknesses are stated at the same level of detail as strengths.
| Axis | Strengths | Weaknesses |
|---|---|---|
| External skill | A clear relationship between predicted burn probability and subsequent fire, with cap20 of 0.52 [d]. BP ranks where fire occurs well above chance in the recent, fully independent years (0.582 across five, all above the 0.20 floor), and holds across the 40-year record with only modest degradation back to the 1980s [c] - likely driven by consistently lower burn occurrence, since fewer fires make prediction noisier. | — |
| Internal coherence | Undisturbed-cohort BP rises systematically for pixels with no fire within a 10 km buffer, reflecting fuel build-up [e]. Landsat transitions are clean. Pixels with nearby fire show no such rise, then an abrupt decrease coincident with the large statewide increase in burning - BP is tracking neighbourhood fire, as it should. | — |
| Cross-dataset consistency | General agreement with Moran and Pyrologix on relative BP within identical cells [a]; the two maps agree cell by cell (Spearman 0.61 against Moran). Scores against subsequent burn occurrence are broadly consistent with both in most years [b]. | Moran's annually-updated FSim BP beats WA on all four overlapping years, with an especially large gap in the high-fire year 2020 (-0.100). Panel a is rank-only: WA is not calibrated to absolute BP the way Moran and Pyrologix are, so comparisons of level or slope are not possible. |
WA burn probability is a conditional climatology, not a forecast. References: Moran et al. 2025 annual burn probability (OSF z6gnt, 2020-2023); Pyrologix; observed burned area from MTBS and FRAP perimeters.