Purifying your scanned PDF files
New View
Having trouble reading that scanned PDF? You can add a little more contrast with some help from ImageMagick.
Gone are the days when you needed to go to the library for a book. Now you can download the book electronically, load it on your e-reader or tablet, and start enjoying it. But all electronic books are not equal. Particularly infuriating are electronic books that are actually scanned images of old print books. Scanned images of old books, which typically come in PDF format, are difficult to read on a black-and-white E Ink screen, where fading text and yellowing pages appear as blurs, blotches, and dark-gray backgrounds.
Luckily, you can clear up that blurry scanned image with a few tricks from ImageMagick. This article describes a method you can use to spruce up a scanned electronic book. Note: If you obtained the book from a lender or through another vendor, be sure the license supports this type of file manipulation.
Getting Started
I needed a copy of a sociology book, A Place on the Corner, by Elijah Anderson; the only place I could find it in electronic format was The Internet Archive. They had a scanned copy, so I loaded it on my Sony DPT-RP1/B e-reader, but the text was difficult to read (Figure 1). Dark spots appeared on the page, and the text was just a bit darker than the background, with poor contrast (Figure 2).
Hoping to find a better view, I installed the pdfimages
package on my Ubuntu 18.04 system:
sudo apt install pdfimages
pdfimages
is used to extract images from PDF files and save them as Portable Pixmap (PPM), Portable Bitmap (PBM), or another format. Since the scanned pages in the book are image files, all you need to do is drop the PDF into an empty folder and enter the following command:
pdfimages A_place_on_the_corner.pdf
This command will generate a large amount of PPM and PBM image files (Figures 3 and 4). The PPM files contain all the shadows and imperfections of the scanned pages, and the PBM files are a negative, clean, white-on-black version. Now all you need to do is reverse the colors in the PBM negatives. You don't need the PPM files, so you can remove them:
rm *.ppm
To maintain quality, convert all remaining PBM files into PNG format using mogrify
, which is part of the ImageMagick package. (See also the "More Memory?" box for using ImageMagick with large files.) First be sure to install ImageMagick:
sudo apt install imagemagick
More Memory?
On some Linux systems, you'll receive an error message when you use the ImageMagick command-line tools with large files. This message is due to a memory limitation that you can address by editing the /etc/ImageMagick-6/policy.xml
file so that the memory
and disk
values get more power. Everything should work fine with the policy.xml
settings that have resource values modified as shown in Listing 1.
Listing 1
policy.xml Settings
01 <policy domain="resource" name="memory" value="2256MiB"/> 02 <policy domain="resource" name="map" value="512MiB"/> 03 <policy domain="resource" name="width" value="16KP"/> 04 <policy domain="resource" name="height" value="16KP"/> 05 <policy domain="resource" name="area" value="128MB"/> 06 <policy domain="resource" name="disk" value="20GiB"/>
mogrify
is used to manipulate graphic files: rotate, crop, flip, blur, and join. You can also use mogrify
to convert from one format to another. Search for all PBM files in the folder and use mogrify
to convert them to PNG format automatically:
find -name '*.pbm' -print0 | xargs -0 -r mogrify -format png
Now that the pages of the book are in PNG format, you don't need the PBM files anymore, so you can delete them:
rm *.pbm
convert
is another command-line interface tool shipped with ImageMagick that does about the same thing as mogrify
, but it is also able to invert the colors of an image file. The PNG files are currently in negative, so you can convert them to look like regular book pages using the -negate
attribute of convert
. Output the results as JPG files to keep the file sizes low:
ls -1 *.png | xargs -n 1 bash -c 'convert "$0" -negate "${0%.png}.jpg"'
You can now delete the PNG files and inspect the remaining JPG images. Should you feel they need more contrast, you can use the -level
argument of the convert
command to bulk-modify the contrast of your files:
ls -1 *.jpg | xargs -n 1 bash -c 'convert "$0" -level 60 "${0%.jpg}.jpg"'
Replace 60
with a value ranging from 1
to 100
, with a higher value for more contrast, or reduce the value for less contrast. The next step is to insert the now-cleaned and easily-readable scanned pages into a PDF file. Should you wish to keep the resulting PDF as small as possible, you can batch-resize the JPG files beforehand to 50 percent of their actual size using mogrify
:
ls -1 *.jpg | xargs -n 1 bash -c 'mogrify "$0" -resize 50 %"${0%.jpg}.jpg"'
All the files were extracted from the scanned PDF book and numbered in order, and the file names haven't changed through all the conversion steps, so the entire book is ready to insert, page by page, back into a PDF. You can easily add the converted pages back in with:
convert *.jpg a_place_on_the_corner-purified.pdf
The result is a PDF file that has crisp black text on a white background, and the difference is noticeable (Figure 5). You can load it on your e-reader or tablet and read it without eye strain.
Conclusion
Using this PDF purifying method, you can get rid of pinkish or yellow backgrounds from scanned documents. Figure 6 shows a comparison of the purified text with the original version of the book. This method will also help you remove other artifacts of the scanning process, such as the faint text lines that appear from the text on the other side of the scanned page, as well as dirty fingerprint marks, light coffee stains, or pencil marks.
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Thousands of Linux Servers Infected with Stealth Malware Since 2021
Perfctl is capable of remaining undetected, which makes it dangerous and hard to mitigate.
-
Halcyon Creates Anti-Ransomware Protection for Linux
As more Linux systems are targeted by ransomware, Halcyon is stepping up its protection.
-
Valve and Arch Linux Announce Collaboration
Valve and Arch have come together for two projects that will have a serious impact on the Linux distribution.
-
Hacker Successfully Runs Linux on a CPU from the Early ‘70s
From the office of "Look what I can do," Dmitry Grinberg was able to get Linux running on a processor that was created in 1971.
-
OSI and LPI Form Strategic Alliance
With a goal of strengthening Linux and open source communities, this new alliance aims to nurture the growth of more highly skilled professionals.
-
Fedora 41 Beta Available with Some Interesting Additions
If you're a Fedora fan, you'll be excited to hear the beta version of the latest release is now available for testing and includes plenty of updates.
-
AlmaLinux Unveils New Hardware Certification Process
The AlmaLinux Hardware Certification Program run by the Certification Special Interest Group (SIG) aims to ensure seamless compatibility between AlmaLinux and a wide range of hardware configurations.
-
Wind River Introduces eLxr Pro Linux Solution
eLxr Pro offers an end-to-end Linux solution backed by expert commercial support.
-
Juno Tab 3 Launches with Ubuntu 24.04
Anyone looking for a full-blown Linux tablet need look no further. Juno has released the Tab 3.
-
New KDE Slimbook Plasma Available for Preorder
Powered by an AMD Ryzen CPU, the latest KDE Slimbook laptop is powerful enough for local AI tasks.