Testing the Raspberry Pi AI HAT+ 2
Leave Your AI HAT On
© Lead Image © lightwise, 123RF.com
Chatbots are all the rage. A new AI HAT+ 2 for the Raspberry Pi 5 lets you run large language models.
Artificial intelligence (AI) assistants can be used in many areas of daily life and claim to make our workdays easier by handling routine tasks on their own. Of course, commercial AI assistants usually run in the cloud with fees attached for professional use. On top of this, data privacy is often sadly neglected.
Instead an online service, you can use an AI language model that runs on your local infrastructure and does not require cloud access. That approach has a downside: The models often require serious compute power of the kind that only outrageously expensive graphics cards or specialized high-performance processors designed for AI applications can provide. While conventional PCs can run chatbots and minor, application-specific language models, they often fail to achieve satisfactory speeds. In many cases, use is very limited.
AI on the Pi
While earlier Raspberry Pi models were not powerful enough, the Pi 5 finally has the hardware capabilities that you need to run more complex AI language models at a good speed. The RAM and interface limitations found in the older versions of the British microcomputer have now been eliminated. Armed with 8GB RAM and the long-awaited PCIe interface, the single-board computer is up to more demanding AI tasks.
[...]
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Digital Autonomy
• The Answer Was Already on the Shelf
• Changing the Chip Industry: How Public Investment Has Grown Open Silicon
• United Nations Open Source Portal Goes Live
• EU Open Source Strategy Plays Key Role in Tech Sovereignty Package
• France Says “Au Revoir” to Microsoft
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Dutch Government Turns to Open Source for Digital Sovereignty
Following in the footsteps of European countries, the Netherlands is looking to increase its sovereign digital infrastructure with open source software.
-
Linux May Soon Work on Snapdragon X2-Based PCs
If you're thinking about buying a Snapdragon X2-based desktop or laptop, Linux may soon be an option.
-
KDE for People Initiative Calls for AI Ban in Plasma
A new community of KDE wants the project to adopt a strict no-AI policy for KDE Plasma.
-
KDE Sets Ambitious Goals for 2026 and Beyond
KDE Connect reveals the goals for the Linux desktop darling, with one of those goals long overdue.
-
It’s Time to Test Fedora 45 Beta
Fedora 45 beta has been released with updated Gnome, KDE Plasma, and kernel.
-
Ubuntu Stonking Stingray Gets Even Rustier
Ubuntu 26.10 has completed its migration to the Rust-based coreutils.
-
AI Fixes Linux Bottlenecks Using “Hideous” Code
A Linux developer used AI to fix bottlenecks that caused problems when building the kernel. The resulting AI-generated code needed a lot of work.
-
Advanced Video Coding Still Under Patent
Brazilian patent BRPI0109962B1 has expired, which means that DivX and Xvid are no longer problematic for Linux, but it doesn’t mean that video is all of a sudden fully unleashed.
-
2,000 Vulnerabilities per Linux Release
Thanks to AI bug hunters, the Linux kernel is seeing record numbers of vulnerabilities, and it's overwhelming developers.
-
Linux Exempt from California’s Age Verification Law
So long as Linux is distributed under the GPL, MIT, BSD, and Apache licenses, the OS is exempt from being required to verify the age of its users in California.