540: Uncensored AI on Linux

Jupiter Broadcasting — Sun, 10 Dec 2023 20:30:00 -0800

We test two popular methods to run local language models on your Linux box. Then, we push the limits to see which language models will toe the line and which won't.

308: The One About GPU Passthrough

Jupiter Broadcasting — Tue, 02 Jul 2019 13:00:00 -0700

Our crew walks you through their PCI Passthrough setups that let them run Windows, macOS, and distro-hop all from one Linux machine.

Forget multiple partitions, dual booting, and Hackintoshes; you can do it all with Linux and KVM.

Near-native VM performance doesn't have to be painful. You only need a few prerequisites and a little help.

Special Guest: Alex Kretzschmar.

Support LINUX Unplugged

Links:

Windows VirtIO Drivers — 64-bit versions of Windows Vista and newer require the drivers to be digitally signed.
Alex's arch-vfio-ovmf scripts — Arch Linux installation and VFIO setup scripts
Looking Glass - Quickstart Guide — These guides are designed to help you get Looking Glass up and running on an already configured QEMU KVM Virtual Machine that has a VGA PCI Passthrough device.
duncanthrax/scream — Scream is a virtual device driver for Windows that provides a discrete sound device. Audio played through this device is published on your local network as a PCM multicast stream.
ACS patch COPR — Fedora kernels with add-acs-overrides patch from Arch AUR
ACS Override Kernel Builds — This page contains links to the latest kernel builds with the ACS override patch applied for PCI devices.
natalie-/fedora-acs-override — Using the ACS override patch for Fedora
VFIO tips and tricks: IOMMU Groups, inside and out — Sometimes VFIO users are befuddled that they aren't able to separate devices between host and guest or multiple guests due to IOMMU grouping and revert to using legacy KVM device assignment, or as is the case with may VFIO-VGA users, apply the PCIe ACS override patch to avoid the problem. Let's take a moment to look at what this is really doing.
"Error 43: Driver failed to load" on Nvidia GPUs passed to Windows VMs — Since version 337.88, Nvidia drivers on Windows check if an hypervisor is running and fail if it detects one, which results in an Error 43 in the Windows device manager. Starting with QEMU 2.5.0 and libvirt 1.3.3, the vendor_id for the hypervisor can be spoofed, which is enough to fool the Nvidia drivers into loading anyway.
Mac OS Adds Early Support for VirtIO, Qemu - The Passthrough POST — In a new development uncovered by Qemu developer Gerd Hoffmann, Apple has apparently added early support for VirtIO and framebuffer graphics in a later Mac OS Mojave release.
New and Improved Mac OS Tutorial, Part 1 (The Basics) - The Passthrough POST — Due to certain recent developments, It’s become clear to us that it’s necessary to update and improve our OSX VM guide. A lot’s changed since we wrote it, and rolling in those changes will make the process much more user friendly and accessible to newer VFIO users.
Mac OS VM Guide Part 2 (GPU Passthrough and Tweaks) - The Passthrough POST — We’ve made every attempt to make this as straightforward as possible, but there’s a lot more ground to cover here than in the first part of the guide
UGREEN USB 3.0 Sharing Switch Selector 4 Port 2 Computers Peripheral Switcher Adapter Hub for PC, Printer, Scanner, Mouse, Keyboard with One Button Swapping — This USB Switch 4 Port device allows up to 2 users to share 4 USB 3.0 peripheral devices, such as printer,scanner,mouse,keyboard or usb disk etc without the need to constantly swap cables or set up complicated network sharing software. It's a great for use at home if you have multiple PCs or Macs.
How to setup VFIO GPU passthrough using OVMF and KVM on Arch Linux — This article will detail the steps required to passthrough your GPU to a guest VM which will in our case be a Windows 10 VM used for gaming. Yes, this is the exact same technology made popular by Linus on his LinusTechTips YouTube channel in the seven gamers, one CPU video.
Chris' HDMI Monitor 1920x1080 16: 9 LCD Screen
Lenovo G0A10170UL Thunderbolt 3 Graphics Dock — Amplify your ultrabook’s graphics performance with the integrated NVIDIA GeForce GTX 1050 graphics card.
Mantiz Venus MZ-02 External Graphic Enclosure eGPU — Connects Full High Full Length 120" Width 2.5 PCIE Desktop Power GPU to computer WITH an Intel Certified Thunderbolt 3 port.
Synergy — Synergy is a software download that shares one mouse and one keyboard between multiple computers. Simply move your mouse between your computers effortlessly
barrier: Open-source KVM software — Barrier is KVM software forked from Symless's synergy 1.9 codebase. Synergy was a commercialized reimplementation of the original CosmoSynergy written by Chris Schoeneman.
foxlet/macOS-Simple-KVM — Documentation to set up a simple macOS VM in QEMU, accelerated by KVM.

LINUX Unplugged - Episodes Tagged with “Egpu Passthrough”

540: Uncensored AI on Linux

308: The One About GPU Passthrough