Out-of-memory issues when running in standalone mode #28
Description
The out-of-memory issue appear when running in sparkle. To fix this we need to tune the spark-submit options to effectively run. Better documentation and methods needs to be develop to triage this issue.
0000017 | T.0x00007fb0465fa700 | 2019-09-17, 01:51:17.101628 [warning] - (/home/ghosdebd/sparkle/alps/src/globalheap/thread_slab_heap.cc,
47) Out of memory
E0917 01:51:17.101655 37233 MapShuffleStoreWithByteArrayKeys.cc:251] allocate index chunk returns global null pointer for size: 19012 gen
eration id: 284
F0917 01:51:17.101683 37233 MapShuffleStoreWithByteArrayKeys.cc:264] Check failed: indChunkOffset != nullptr allocate index chunk returns
null with generation id: 284
*** Check failure stack trace: ***