From a quick look of the code and running the line below locally, it seems that this drop=True is expensive causing the memory to blow up. Maybe there's a way not to use the drop directly but maybe do a similar drop operation later in the code when needed.
|
paramData = paramData.where((paramData[Yparam] > 0) & (paramData[Yparam] < 2000), drop=True) |