Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support bzip3 #337

Open
kspalaiologos opened this issue Oct 31, 2022 · 0 comments
Open

Add support bzip3 #337

kspalaiologos opened this issue Oct 31, 2022 · 0 comments

Comments

@kspalaiologos
Copy link

bzip3 is a spiritual successor to bzip2; generally features better compression ratio. It's packaged for all major Linux distributions (Debian, Void, Gentoo, Arch, Alpine, Gentoo, NixOS, etc..) so compatibility/support should be rather wide.

Two rather notable differences from other compressors are the fact that bzip3 can utilise multithreading while compressing (using a fixed amount of jobs) and doesn't support the concept of levels (a block size needs to be passed to the compressor instead).

I recommend block sizes of 8M, 16M, 32M, 64M, 128M, 256M, 511M to map to levels 1-7. As the memory usage tends to be around 6*N (where N is the block size), caution is required to not exhaust the operating system's memory (level 7 will consume around 3GB of memory per compression thread).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant