Improving Linux package management
Hooks and Triggers
Fedora is also slow because its unpacked package list alone is 60MB, while Alpine's list is a lean 734KB. Fedora offers over 20,000 packages, which is three times more packages than the very small Alpine, but the difference is still striking.
However, Stapelberg thinks even the best results in the test are too slow. He sees another reason for this in the frequently used hooks and triggers that the package manager executes during installation, which trigger the aforementioned maintainer scripts, create daemon user accounts (such as an FTP or WWW account), or create cache files.
One of the most commonly used triggers, the man package trigger ensures that a man page for the package is included on the system with each package installation. In his blog, Stapelberg explains why all this should not happen during installation and how it prevents parallel installation of packages [8].
In Stapelberg's opinion, these interruptions of the actual installation should preferably take place when the app is first launched. If an application does not start between installation and the first or even further updates, the adjustments would only be executed once instead of several times, for example.
Image Instead of Archive
In Stapelberg's opinion, a package manager should only do what is absolutely necessary to anchor a package in the system so that it is ready for use (i.e., start the program or load a kernel module). Unpacking during installation is not necessary if packages are available as filesystem images that the distribution mounts at startup, as is the case with AppImage or Snap.
According to Stapelberg, no package manager in a Linux distribution currently uses this scenario, although it could still increase the speed to above the level achieved by Alpine's apk, the fastest package manager in his test series. Images are currently only used by the Haiku operating system project.
In Stapelberg's experimental distribution distri, he seeks to experiment with reducing the complexity of package management. He concludes that distributions like Fedora or Debian could also run faster given less complexity. That doesn't mean it's technically easy to implement, but it would be feasible.
For example, distri uses read-only SquashFS images as the package format instead of the usual TAR archives (Figure 2). In addition to increased speed, this has the advantage that applications cannot be modified, which protects them from accidental or malicious modifications.
Distri organizes all files provided by a package under the /ro/
mount point, each in its own directory. The usual data exchange between software packages, which takes place via the specified directories of the Filesystem Hierarchy Standard (FHS) in conventional distributions, is handled by the system via exchange directories, which are provided by FUSE.
For example, the exchange directory /ro/share/
provides the union of the share/
subdirectory of all packages in the package store. The global exchange directories map the FHS with sufficient accuracy to allow third-party software, such as Google Chrome or Spotify, to work. Using /ro/
also prevents conflicts when installing multiple versions of a package.
Distri also streamlines package building. Unlike conventional distributions' builders, the distri package builder does not install packages in the build environment. Instead, the system provides a filtered view of the package store in /ro/
in the build environment. Even with large dependency trees, setting up a build environment this way takes a fraction of a second.
Distri's website provides information about the various ways to use the distribution [9]. There is no installer yet, but the maintainer has future plans for one. Distri can be started from a USB stick or in a Docker or LXD container, as well as in a virtual machine with VirtualBox or Qemu. Since it is in IMG
format [10] and not an ISO
, you first need to convert it to a Virtual Disk Image (VDI) for VirtualBox (Figure 3).
First, you unpack the image. Since the developers have packaged it with the relatively new Zstandard (Zstd) compression algorithm, you will probably need to install zstd up front. On Debian, you can do this with:
apt install zstd
On Fedora, use:
dnf install zstd
Then extract the file using the call:
$ unzstd ~/Downloads/distri-disk.img.zst
In the process, the compressed file loses the .zst
attachment and grows to 8GB. An attempt to start distri on an 8GB USB stick failed as expected; you need a stick with at least 16GB capacity. After starting distri, a login prompt opens where you can enter the password, which is peace for root (Figure 4).

You are greeted by a very simple Z shell prompt that lets you explore the system. At first, I thought the cd
command had failed, because the prompt does not show the new location after the change – but pwd
will help here. Entering cd /ro/
takes you to the directory with all installed packages; switching to /ro/share/
takes you to the exchange directory (Figure 5).

For common distri commands, and their equivalents in Debian, see distri's documentation [11]. This is also where you can learn more about Distri's package format and how to create your own packages. The distri update
command (Figure 6) replaces
apt update && apt full-upgrade

and upgrades the entire distribution at an impressive pace. With a 1Gbps connection, the system downloads and installs around 275MB of data in less than four seconds.
Package installations are also completed in the blink of an eye (Figure 7). In the case of the Nano editor
distri install nano-amd64-4.9.5-2

it took just over a millisecond. You need to specify the package version because multiple versions can be installed in parallel. Available packages can be found in the distri repository [12].
Conclusions
Because distri is an experiment in package management, it is likely to interest only a limited user base. If you want to dig deeper, you should read all of Stapelberg's blog posts on the topic [13] and watch his keynote at the Arch Developer Conference 2020 [14]. While there is no official support for distri, Stapelberg will answer questions on the mailing list [15] and in the #distri chat room on the legacy.irc-robustirc IRC server. However, you may have to be patient.
Infos
- distri: https://distr1.org
- Stapelberg's critique of Debian: https://michael.stapelberg.ch/posts/2019-03-10-debian-winding-down/
- Lintian: https://en.wikipedia.org/wiki/Lintian
- Package manager comparison: https://michael.stapelberg.ch/posts/2019-08-17-linux-package-managers-are-slow/
- Maintainer scripts: https://www.debian.org/doc/debian-policy/ch-maintainerscripts.html
- Debian flowcharts: https://www.debian.org/doc/debian-policy/ap-flowcharts.html
- Fedora scriptlets: https://docs.fedoraproject.org/en-US/packaging-guidelines/Scriptlets/
- Hooks and Triggers: https://michael.stapelberg.ch/posts/2019-07-20-hooks-and-triggers/
- Using distri: https://distr1.org/getting-started/
- distri download: https://repo.distr1.org/distri/supersilverhaze/img/
- distri documentation: https://repo.distr1.org/distri/jackherer/docs/rosetta-stone.html
- distri repository: https://repo.distr1.org/distri/supersilverhaze/pkg/
- Michael Stapelberg's blog: https://michael.stapelberg.ch/posts/tags/distri/
- Stapelberg's keynote at Arch Developer Conference 2020: https://media.ccc.de/v/arch-conf-online-2020-6387-distri-researching-fast-linux-package-management
- distri mailing list: https://www.freelists.org/list/distri
« Previous 1 2
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Direct Download
Read full article as PDF:
Price $2.95
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Find SysAdmin Jobs
News
-
Kubuntu Focus Announces XE Gen 2 Linux Laptop
Another Kubuntu-based laptop has arrived to be your next ultra-portable powerhouse with a Linux heart.
-
MNT Seeks Financial Backing for New Seven-Inch Linux Laptop
MNT Pocket Reform is a tiny laptop that is modular, upgradable, recyclable, reusable, and ships with Debian Linux.
-
Ubuntu Flatpak Remix Adds Flatpak Support Preinstalled
If you're looking for a version of Ubuntu that includes Flatpak support out of the box, there's one clear option.
-
Gnome 44 Release Candidate Now Available
The Gnome 44 release candidate has officially arrived and adds a few changes into the mix.
-
Flathub Vying to Become the Standard Linux App Store
If the Flathub team has any say in the matter, their product will become the default tool for installing Linux apps in 2023.
-
Debian 12 to Ship with KDE Plasma 5.27
The Debian development team has shifted to the latest version of KDE for their testing branch.
-
Planet Computers Launches ARM-based Linux Desktop PCs
The firm that originally released a line of mobile keyboards has taken a different direction and has developed a new line of out-of-the-box mini Linux desktop computers.
-
Ubuntu No Longer Shipping with Flatpak
In a move that probably won’t come as a shock to many, Ubuntu and all of its official spins will no longer ship with Flatpak installed.
-
openSUSE Leap 15.5 Beta Now Available
The final version of the Leap 15 series of openSUSE is available for beta testing and offers only new software versions.
-
Linux Kernel 6.2 Released with New Hardware Support
Find out what's new in the most recent release from Linus Torvalds and the Linux kernel team.