File Compression for Modern Computing

Many standard Linux tools have been around so long that second-generation tools are being developed to meet modern needs. For instance, Neovim is an update of the Vim text editor, and apt is a rearrangement of the basic tools for apt-get, the Debian package manager. Similarly, Zstandard (zstd) [1] is a revision of compression tools like tar and gzip, except with higher degrees of compression at a faster rate. Additionally, zstd includes several unique tools for enhanced performance, such as advanced compression features, compression levels and strategies, and dictionaries.

zstd was written by Facebook employee Yann Collet and released in August 2016. Briefly, it is a lossless compression algorithm based loosely on the earlier LZ77 algorithm [2]. The command's syntax is deliberately similar to that of gzip, down to variations on the basic command that are the equivalent of popular options. For example, zstdmt is the same as zstd -T0 (use the same number of threads as detected cores), whereas unzstd is the same as zstd -d (decompress), and zstdcat is the same as zstd -dcf (decompress, force write to standard output, and overwrite without prompt).

The Basics

Getting started with zstd is as simple as typing:

[...]

Use Express-Checkout link below to read the full article (PDF).

Buy this article as PDF

Express-Checkout as PDF
Price $2.95
(incl. VAT)

Buy Linux Magazine

SINGLE ISSUES
 
SUBSCRIPTIONS
 
TABLET & SMARTPHONE APPS
Get it on Google Play

US / Canada

Get it on Google Play

UK / Australia

Related content

  • Zip It

    Like other modern replacement commands, zstd offers significantly faster file compression than the standard archiving tools.

  • BorgBackup

    In Star Trek, the Borg adds individuals to its collective consciousness, an apt metaphor for any backup application that stores individual files in an archive. BorgBackup creates folder repositories for multiple archives, making it an especially befitting description of assimilation.

  • Command Line: gzip, bzip2, tar

    A short command is all it takes to pack your data or extract it from an archive.

  • Optimizing the Kernel

    We explore some optimizations designed to deliver a smoother experience for desktop users.

  • Swapping with zRAM

    ZRAM is a faster RAM disk than other swap sources, and it’s easier on SSD drives.

comments powered by Disqus
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

Learn More

News