Indexing and searching text with Lucene
Smart Search
Even state-of-the-art computers need to use clever methods to process ever-increasing amounts of document data. The open source Lucene framework uses inverted indexing for fast searches of document collections.
Nowadays, almost any commercially available hard drive can store more text than a whole library. In the digital world, a traditional system such as a card catalog or a knowledgeable librarian is no longer adequate to help find the right shelf. Even software equivalents such as find or zgrep are not always fast enough to track a particular piece of information amongst giga- or terabytes of data.
The science that deals with this type of search problem is called information retrieval. Computer scientists have developed sophisticated methods for tracking down files that users don’t even know exist. The free Java library Lucene implements some of these methods. Doug Cutting published an early version of Lucene in 1999. Two years later, the project, which carries the middle name of Cutting’s wife, came under the auspices of the Apache Foundation when it joined the Apache Jakarta Project. Lucene has been available in Version 4.0 since October 2012. The index file structures are backward compatible, so the transition from 3.6 to 4.0 does not cause any problems. Over the years, Lucene has become one of the most widely used solutions for indexing and searching text. (See the box titled “Lucene In All Its Facets.”)
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
US / Canada
UK / Australia
Direct Download
Read full article as PDF:
Price $2.95
News
-
Native GPU Driver for Apple Silicon Is Nearly Here
Full-blown Linux on the Apple M1 and M2 chips is almost a reality.
-
Linux Kernel 6.0 Officially Released
Although it will be some time before most Linux distributions ship with the latest kernel, the next major release is now available.
-
ExTiX 22.9 Released with Support for Installing Android Apps
The developers of the ExTiX Linux Distribution have released a new version that includes added support to make installing and using Android apps on the desktop a breeze.
-
System76 Skips Pop!_OS 22.10 to Focus on COSMIC Desktop
In a move that is sure to raise some eyebrows, System76 has chosen to concentrate on COSMIC Desktop instead of staying in step with Ubuntu releases.
-
New Look for System76 Thelio
System76 has given their already stellar Thelio desktop computer a redesign by way of the chassis accent panel.
-
Ubuntu Software Store Rumored to Replace Gnome Software
An alternative to GNOME Software has been written, using Flutter, and it’s making enough noise that Canonical is rumored to be considering using it as the default.
-
A New Arch-Based Linux Distribution Has Arrived
Crystal Linux is a new distribution with the goal of bringing the power of Arch Linux to the masses.
-
Fedora 37 Beta Available
The Fedora development team announced the beta for version 37 of the open-source operating system would be released on time on September 13, 2022.
-
Salix 15.0 Offers Updates and a Modernized Look
Salix is a Slackware-based Linux distribution with a new look and a goal of being fast, user-friendly, and highly stable.
-
Ubuntu 20.04.5 LTS Release Now Available
The latest point release of the Ubuntu 20.04 LTS distribution is now available and sports kernel 5.15.