bzip2 seems great at ramping up with number of cores. With 8 cores freely available for the task, it's a serious contender. It scales almost linear, which is impressive. Though it's true both ways, which means with less cores it has to run slower, and single thread performance is what it is.

zstd gives us the possibility to pay some compression ratio to gain some speed with less cores available, which just happens to fits our needs.

(also, if I do remember correctly, bzip2 is great at text, but worse at binary data, so ranking could actually depend on test set).

Click to expand...