How to Deploy Lightweight Language Models on Embedded Linux with LiteLLM

Linux.com
3 months 1 week ago

This article was contributed by Vedrana Vidulin, Head of Responsible AI Unit at Intellias (LinkedIn). As AI becomes central to smart devices, embedded systems, and edge computing, the ability to run language models locally — without relying on the cloud — is essential. Whether it’s for reducing latency, improving data privacy, or enabling offline functionality, local AI […]

The post How to Deploy Lightweight Language Models on Embedded Linux with LiteLLM appeared first on Linux.com.

Linux.com Editorial Staff

Breaking Barriers: How Pop!_OS 24.04 Revolutionizes Hybrid Graphics for Linux Users

Linux Journal
3 months 1 week ago
by George Whittaker

In the realm of Linux desktop distributions, few names stand out as prominently as Pop!_OS, the custom-built operating system from System76. Known for its user-centric design, seamless hardware integration, and a progressive attitude toward Linux usability, Pop!_OS has earned a special place in the hearts of developers, engineers, gamers, and power users alike.

With the release of Pop!_OS 24.04, System76 boldly pushes the limits of what Linux desktops can do—particularly in the domain of hybrid graphics. This version introduces a host of under-the-hood improvements and user-facing enhancements aimed at solving a long-standing pain point for Linux laptop users: managing systems that have both integrated and dedicated GPUs.

This article dives into what makes Pop!_OS 24.04 a game-changer, focusing especially on its sophisticated, yet user-friendly approach to hybrid graphics.

A Leap Forward: What’s New in Pop!_OS 24.04

Pop!_OS 24.04 is based on Ubuntu 24.04 LTS, meaning it inherits long-term support, stability, and updated software packages. But Pop!_OS never simply repackages Ubuntu; it transforms it. Here are some of the standout features introduced in this release:

  • COSMIC Desktop Enhancements: System76’s in-house desktop environment has matured, delivering better window management, smoother animations, and more customization options. COSMIC is designed from the ground up using Rust, and this release brings faster performance and reduced resource consumption.

  • Kernel and Driver Upgrades: Linux kernel 6.8+ ensures better hardware compatibility and performance, especially for newer CPUs and GPUs. The latest NVIDIA and Mesa drivers are pre-integrated and optimized.

  • Refined Installer and Recovery: The Pop!_OS installer now includes better detection for hybrid graphics setups and offers system recovery options right from the boot menu.

However, the crown jewel of 24.04 is undoubtedly its radical improvements in hybrid graphics support.

Understanding Hybrid Graphics and Why It Matters

Most modern laptops come with two GPUs:

  1. Integrated GPU (iGPU) – Built into the CPU (e.g., Intel Iris Xe, AMD Radeon Graphics), offering energy-efficient graphics rendering.

  2. Discrete GPU (dGPU) – A powerful standalone GPU (e.g., NVIDIA RTX, AMD Radeon), ideal for gaming, 3D modeling, and heavy computation.

This setup, known as hybrid graphics, allows users to conserve battery power when performance isn’t needed and tap into powerful hardware when it is.

Go to Full Article
George Whittaker

[Testing Updates] 2025-06-05 - Kernels, VirtualBox, Bluez, PipeWire, Qt6, Mesa, Thunderbird

Manjaro Linux
3 months 1 week ago

Hello community, here we have another set of package updates.

Current Promotions
  • Find out all about our current Gaming Laptop the Hero with Manjaro pre-installed from Spain!
  • Protect your personal data, keep yourself safe with Surfshark VPN: See current promotion
Recent News Valkey to replace Redis in the [extra] Repository (click for more details) Previous News Finding information easier about Manjaro (click for more details) Notable Package Updates Additional Info Python 3.13 info (click for more details) Info about AUR packages (click for more details)

Get our latest daily developer images now from Github: Plasma, GNOME, XFCE. You can get the latest stable releases of Manjaro from CDN77.

Our current supported kernels
  • linux54 5.4.295
  • linux510 5.10.237
  • linux515 5.15.185
  • linux61 6.1.141
  • linux66 6.6.93
  • linux612 6.12.32
  • linux614 6.14.10
  • linux615 6.15.1
  • linux61-rt 6.1.134_rt51
  • linux66-rt 6.6.87_rt54
  • linux612-rt 6.12.28_rt10
  • linux613-rt 6.13_rt5
  • linux614-rt 6.14.0_rt3
  • linux615-rt 6.15.0_rt2

Package Changes (Thu Jun 5 09:10:59 CEST 2025)

  • testing core x86_64: 26 new and 24 removed package(s)
  • testing extra x86_64: 697 new and 746 removed package(s)
  • testing multilib x86_64: 19 new and 19 removed package(s)

A list of all package changes can be found here.

Click to view the poll.

Check if your mirror has already synced:

10 posts - 9 participants

Read full topic

philm

Open Source AI is Transforming the Economy—Here’s What the Data Shows

Linux Foundation
3 months 2 weeks ago

As we approach the midpoint of 2025, the potential of AI to transform businesses, economies, and industries is not only widely anticipated and nearly universal but also well documented. In a commissioned project by Meta, LF Research set out to capture existing evidence on this topic, with the specific aim of understanding how open source is playing a role in this transformation. 

Frank Nagle

Ubuntu 25.04 “Plucky Puffin”: A Bold Leap Forward with GNOME 48 and HDR Brilliance

Linux Journal
3 months 2 weeks ago
by George Whittaker

Ubuntu has long stood as a bastion of accessibility, polish, and power in the Linux ecosystem. With the arrival of Ubuntu 25.04, codenamed “Plucky Puffin”, Canonical has once again demonstrated its commitment to delivering a modern, forward-thinking operating system. This release isn’t just a routine update — it’s a confident stride into a future where Linux desktops are visually stunning, developer-friendly, and brimming with potential.

From the sleek new GNOME 48 desktop environment to the long-awaited HDR (High Dynamic Range) support, Ubuntu 25.04 introduces meaningful innovations for casual users, creative professionals, and hardcore enthusiasts alike. Let’s explore this release in depth.

The Spirit of “Plucky Puffin”

Ubuntu releases are known for their quirky animal-themed codenames, but “Plucky Puffin” feels particularly fitting. The word plucky denotes courage and determination — a nod to the OS’s bold push into new visual territories and its refined user experience. The puffin, a resilient seabird, suggests adaptability and elegance — both apt descriptors for Ubuntu’s trajectory in 2025.

Canonical has positioned Ubuntu 25.04 as a springboard for technological maturity ahead of the next long-term support (LTS) release. While it’s a standard, short-term release with 9 months of support, it packs significant under-the-hood improvements and user-facing features that elevate it beyond expectations.

GNOME 48: The Best Desktop Yet

One of the crown jewels of Ubuntu 25.04 is GNOME 48, the latest iteration of the popular desktop environment. GNOME 48 continues to refine the modern, minimalist ethos that has become its signature — but this time, with more responsiveness, better gesture support, and improved multitasking.

Visual Enhancements and Layout Tweaks

  • The Activities Overview is smoother and now integrates multitouch gestures on laptops and touchscreens. Swipe-based workspace switching feels intuitive and immediate.

  • New settings panels have been reorganized for clarity, especially in areas like display, accessibility, and power management.

  • The Files (Nautilus) app has received subtle UI updates and performance boosts, with quicker load times and enhanced file indexing.

Performance and Accessibility

  • GNOME 48 is noticeably lighter on RAM, thanks to backend improvements in Mutter (the window manager) and GTK 4 refinements.

  • Accessibility tools like screen readers and magnifiers now offer smoother integration for users with visual or physical impairments.

Go to Full Article
George Whittaker

[Testing Update] 2025-06-01 - Kernels, Firefox, Thunderbird, NVIDIA, Mesa, PipeWire

Manjaro Linux
3 months 2 weeks ago

Hello community, here we have another set of package updates.

Current Promotions
  • Find out all about our current Gaming Laptop the Hero with Manjaro pre-installed from Spain!
  • Protect your personal data, keep yourself safe with Surfshark VPN: See current promotion
Recent News Valkey to replace Redis in the [extra] Repository (click for more details) Previous News Finding information easier about Manjaro (click for more details) Notable Package Updates Additional Info Python 3.13 info (click for more details) Info about AUR packages (click for more details)

Get our latest daily developer images now from Github: Plasma, GNOME, XFCE. You can get the latest stable releases of Manjaro from CDN77.

Our current supported kernels
  • linux54 5.4.294
  • linux510 5.10.237
  • linux515 5.15.184
  • linux61 6.1.140
  • linux66 6.6.92
  • linux612 6.12.31
  • linux614 6.14.9
  • linux615 6.15.0
  • linux61-rt 6.1.134_rt51
  • linux66-rt 6.6.87_rt54
  • linux612-rt 6.12.28_rt10
  • linux613-rt 6.13_rt5
  • linux614-rt 6.14.0_rt3

Package Changes (Sun Jun 1 17:35:51 CEST 2025)

  • testing core x86_64: 53 new and 53 removed package(s)
  • testing extra x86_64: 2508 new and 2656 removed package(s)
  • testing multilib x86_64: 35 new and 36 removed package(s)

A list of all package changes can be found here.

Click to view the poll.

Check if your mirror has already synced:

25 posts - 16 participants

Read full topic

philm

[Unstable Update] June 2025

Manjaro Linux
3 months 2 weeks ago

Welcome to the new monthly unstable branch thread.

Recent News Kernel 6.14 is now EOL (click for more details) Transition to the new WoW64 wine and wine-staging (click for more details) linux-firmware changes (click for more details) Notable Package Changes Known Issues 2025-06-22 - linux-firmware-amdgpu-20250613.12fe085f may create an unbootable system for RDNA4 GPUs or graphical glitches with RDNA3 GPUs (click for more details) 2025-06-01 - avahi-discover python script (click for more details) Chrome/Chromium-based browsers and GNOME 48 - Global Shortcuts (click for more details) python-gobject 3.52 breaks multiple apps (libpeas related) (click for more details) Possible breaking changes to pacman-mirrors (click for more details) Plasma 6.4.0 will need manual intervention if you are on X11 (click for more details) Additional Info Info about AUR packages (click for more details)

Get our latest daily developer images now from Github: Plasma, GNOME, XFCE. You can get the latest stable releases of Manjaro from CDN77.

Check if your mirror has already synced:

97 posts - 31 participants

Read full topic

Yochanan