LINUX Unplugged

540: Uncensored AI on Linux

December 10th, 2023  |  1 hr 20 mins

32-bit challenge, ai executable code, bail out punishment, call for sessions, chat ui, chatgpt, command line, continue.dev, contribution, dedicated box, discord bots, discounts, docker image, egpu passthrough, freebsd desktop vm, gentoo, high accuracy, horror story, hyprland, it mixup, jupiter broadcasting, large language models, linux, linux podcast, linux unplugged, linuxfest 2024, linuxfest northwest, llamagpt, locally hosted language model chat web app, logseq, marker, nixified ai, obsidian, offline, ollama, ollama cli, ollama library, ollama manual install, ollama modelfiles, ollama webui, ollamahub, pdf to markdown, phoronix, power management, razer core x, refact.ai, rss feed parsing, scale trip, self-hosted, session buddy, spaceballs, speech note, state of large language models, tech horror story, telegram bots, texas linux fest 2024, thunderbolt 3, vscode ai plugin

We test two popular methods to run local language models on your Linux box. Then, we push the limits to see which language models will toe the line and which won't.