Investigation of cross-entropy-based streamflow forecasting through an efficient interpretable automated search process

K. L. Chong, Y. F. Huang, C. H. Koo, Mohsen Sherif, Ali Najah Ahmed, Ahmed El-Shafie

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)

Abstract

Streamflow forecasting has always been important in water resources management, particularly the peak flow, which often determines the seriousness of the impending flood. However, the highly imbalanced flow distribution often hinders the machine learning algorithm's performance. In this paper, streamflow forecasting was approached through the formulation of two distinct machine learning problems: categorical streamflow forecast and regression streamflow forecast. Due to the distinctive characteristics of these two adopted forms, selecting the correct algorithm for the machine learning problem along with their hyperparameter tuning process is critical to the realization of the desired results. For the distinct streamflow formulated scenarios, three neural network algorithms and their hyperparameter tuning strategy were investigated. The comparative empirical studies had revealed that formulated categorical-based streamflow forecast is a better choice than a regression-based streamflow forecast, regardless of the algorithms used; for instance, the f1-score of 0.7 (categorical based) is obtained compared to the 0.53 (regression based) for the LSTM in scenario 1 (binary). Furthermore, forest-based algorithms were investigated and shown to be superior at forecasting high streamflow fluctuations in situations featuring low-dimensional streamflow input. Besides, encoding the streamflow time series as images (input) for forecasting purposes would require a thorough analysis as there is a discrepancy in the results, revealing that not all approaches are suitable for streamflow image transformation. The functional ANOVA analysis provided evidence to substantiate the Bayesian optimization results, implying that the hyperparameters were effectively optimized.

Original languageEnglish
Article number6
JournalApplied Water Science
Volume13
Issue number1
DOIs
Publication statusPublished - Jan 2023

Keywords

  • Deep learning algorithms
  • Hyperparameter optimization
  • Machine learning algorithms
  • Streamflow forecasting

ASJC Scopus subject areas

  • Water Science and Technology

Fingerprint

Dive into the research topics of 'Investigation of cross-entropy-based streamflow forecasting through an efficient interpretable automated search process'. Together they form a unique fingerprint.

Cite this