(Too) big data
Data stored locally can grow up to 1.5 GB per file (station).
-
check if storing of total data is required or not (it could be, that this data are not used - only the subsets.) -
Think about another storing strategy to replace .pickle
e.g. by xarrays dataset storage
Edited by Ghost User