GGUF Loader Documentation

Welcome to the GGUF Loader documentation! This guide will help you get started with GGUF Loader 2.1.2 — a beginner-friendly, privacy-first desktop application for running large language models locally on Windows, Linux, and macOS.

📚 Documentation Index

Getting Started

• Installation Guide - Download and install GGUF Loader
• Quick Start Guide - Get up and running in minutes
• User Guide - Complete user manual

Addon Development

• Addon Development Guide - Create your own addons
• Addon API Reference - Complete API documentation
• Floating Chat Example - Learn from the built-in addon

Advanced Topics

• Package Structure - How the codebase is organized
• Configuration - Customize GGUF Loader settings
• Troubleshooting - Common issues and solutions

Developer Resources

• Contributing Guide - How to contribute to the project
• Architecture Overview - Technical architecture details

🎉 What’s New in Version 2.1.2

• 🐧 One-Click Linux Installer — A .tar.gz package with an installer (install.sh) that adds a desktop menu entry and uninstall support.
• 💬 Floating Chat Fixes — The floating chat button no longer disappears on macOS, can’t get stuck minimized, and stays clear of taskbars, docks, and menu bars.
• ⚙️ Automated Release Builds — GitHub Actions now attaches Windows and Linux installers to every release.
• 🤖 Agent Mode — Toggle tool-use chat where the AI can read, write, edit, and search files inside a workspace folder.
• 🎨 Midnight & Amber Theme — A polished dark/light theme system with ChatGPT-style chat bubbles.

❓ Need Help?

• Browse the FAQ section on the homepage
• Check the Troubleshooting Guide
• Open an issue on GitHub