Articles | Volume 12, issue 3
https://doi.org/10.5194/esurf-12-765-2024
https://doi.org/10.5194/esurf-12-765-2024
Research article
 | 
17 May 2024
Research article |  | 17 May 2024

Evaluating the accuracy of binary classifiers for geomorphic applications

Matthew William Rossi

Related subject area

Cross-cutting themes: Digital Landscapes: Insights into geomorphological processes from high-resolution topography and quantitative interrogation of topographic data
Massive sediment pulses triggered by a multi-stage 130 000 m3 alpine cliff fall (Hochvogel, DE–AT)
Natalie Barbosa, Johannes Leinauer, Juilson Jubanski, Michael Dietze, Ulrich Münzer, Florian Siegert, and Michael Krautblatter
Earth Surf. Dynam., 12, 249–269, https://doi.org/10.5194/esurf-12-249-2024,https://doi.org/10.5194/esurf-12-249-2024, 2024
Short summary
Geomorphic indicators of continental-scale landscape transience in the Hengduan Mountains, SE Tibet, China
Katrina D. Gelwick, Sean D. Willett, and Rong Yang
EGUsphere, https://doi.org/10.5194/egusphere-2023-2303,https://doi.org/10.5194/egusphere-2023-2303, 2023
Short summary
Multi-sensor monitoring and data integration reveal cyclical destabilization of the Äußeres Hochebenkar rock glacier
Lea Hartl, Thomas Zieher, Magnus Bremer, Martin Stocker-Waldhuber, Vivien Zahs, Bernhard Höfle, Christoph Klug, and Alessandro Cicoira
Earth Surf. Dynam., 11, 117–147, https://doi.org/10.5194/esurf-11-117-2023,https://doi.org/10.5194/esurf-11-117-2023, 2023
Short summary
Size, shape and orientation matter: fast and semi-automatic measurement of grain geometries from 3D point clouds
Philippe Steer, Laure Guerit, Dimitri Lague, Alain Crave, and Aurélie Gourdon
Earth Surf. Dynam., 10, 1211–1232, https://doi.org/10.5194/esurf-10-1211-2022,https://doi.org/10.5194/esurf-10-1211-2022, 2022
Short summary
Rockfall trajectory reconstruction: a flexible method utilizing video footage and high-resolution terrain models
François Noël, Michel Jaboyedoff, Andrin Caviezel, Clément Hibert, Franck Bourrier, and Jean-Philippe Malet
Earth Surf. Dynam., 10, 1141–1164, https://doi.org/10.5194/esurf-10-1141-2022,https://doi.org/10.5194/esurf-10-1141-2022, 2022
Short summary

Cited articles

2010 Channel Islands Lidar Collection: United States Geological Survey, OpenTopography [data set], https://doi.org/10.5069/G95D8PS7, 2012. 
Ågren, A. M., Larson, J., Paul, S. S., Laudon, H., and Lidberg, W.: Use of multiple LIDAR-derived digital terrain indices and machine learning for high-resolution national-scale soil moisture mapping of the Swedish forest landscape, Geoderma, 404, 115280, https://doi.org/10.1016/J.GEODERMA.2021.115280, 2021. 
Anderson, S. P., Qinghua, G., and Parrish, E. G.: Snow-on and snow-off Lidar point cloud data and digital elevation models for study of topography, snow, ecosystems and environmental change at Boulder Creek Critical Zone Observatory, Colorado, National Center for Airborne Laser Mapping, OpenTopography [data set], https://doi.org/10.5069/G93R0QR0, 2012. 
Baldi, P., Brunak, S., Chauvin, Y., Andersen, C. A. F., and Nielsen, H.: Assessing the accuracy of prediction algorithms for classification: an overview, Bioinformatics, 16, 412–424, https://doi.org/10.1093/BIOINFORMATICS/16.5.412, 2000. 
Barnhart, K. R., Tucker, G. E., Doty, S. G., Glade, R. C., Shobe, C. M., Rossi, M. W., and Hill, M. C.: Projections of landscape evolution on a 10 000 year timescale with assessment and partitioning of uncertainty sources, J. Geophys. Res.-Earth, 125, e2020JF005795, https://doi.org/10.1029/2020JF005795, 2020. 
Download
Short summary
Accurately identifying the presence and absence of landforms is important to inferring processes and testing numerical models of landscape evolution. Using synthetic scenarios, I show that the Matthews correlation coefficient (MCC) should be favored over the F1 score when comparing accuracy across scenes where landform abundances vary. Despite the resilience of MCC to imbalanced data, strong sensitivity to the size and shape of features can still occur when truth and model data are misaligned.