The ShuffleStatus serialization is implemented in synchronized block, which scale badly when number of executors increases. The detail description from the reporter is:

11 3 3 5 May. 14, 2024, 1:50 AM


Launch on Chameleon

Launching this artifact will open it within Chameleon’s shared Jupyter experiment environment, which is accessible to all Chameleon users with an active allocation.

Download Archive

Download an archive containing the files of this artifact.

Download with git

Clone the git repository for this artifact, and checkout the version's commit

git clone
# cd into the created directory
git checkout c8d3f08dfff90b48cf92b17611deacf07702dbc1

Submit feedback through GitHub issues

Version Stats

6 3 3