BUG: memory error on bootstraps with hourly data
This is the error message
File "/home/l.leufen/mlair/mlair/run_modules/post_processing.py", line 80, in __init__
self._run()
File "/home/l.leufen/mlair/mlair/run_modules/post_processing.py", line 96, in _run
self.bootstrap_postprocessing(create_new_bootstraps)
File "/home/l.leufen/mlair/mlair/run_modules/post_processing.py", line 120, in bootstrap_postprocessing
self.create_bootstrap_forecast()
File "/home/l.leufen/mlair/mlair/run_modules/post_processing.py", line 147, in create_bootstrap_forecast
for boot in bootstraps:
File "/home/l.leufen/mlair/mlair/data_handler/bootstraps.py", line 47, in __next__
_X[index] = shuffled_data.combine_first(_X[index]).reindex_like(_X[index])
MemoryError: Unable to allocate 1.58 GiB for an array with shape (15713, 25, 1, 9, 3, 20) and data type float64
Bootstraps are implemented as xarray without the usage of dask. Maybe this could be the solution.