LLM Runner AIO v1.9

Overview

LLM Runner AIO is a comprehensive, self-contained desktop application that bundles every tool you need to run local AI models on your own hardware: Open WebUI, llama.cpp, SearXNG, Pi Coding, Vane and optional Wan2GP video generation. No complex setup, no dependency hell — just download, run, and start using AI locally. 100% open source.

Most models ship with chat, vision and coding profiles (Ling-3.0-tiny, MiniCPM5-2B and Spark-X2.5-4B ship with a single profile). All presets can be added, edited, or removed directly from the GUI — no manual INI editing needed.

• llama.cpp runs the AI model inference engine at http://localhost:1234
• Open WebUI provides the chat interface at http://localhost:3000
• SearXNG enables local web search at http://localhost:8080
• Vane handles web search at http://localhost:3001
• Wan2GP (optional) serves AI image/video generation at http://localhost:7860

Note: Python 3.11 and Node.js must be installed on your system before running the app. The optional Wan2GP video service needs a few extra GB of disk space and the CUDA/driver version matching your GPU generation (exact requirements are shown in the setup confirmation window).

Credits

This project would not be possible without the incredible work of:

• • Georgi Gerganov — llama.cpp
• • Open WebUI Team — Open WebUI
• • SearXNG Contributors — SearXNG
• • All open-source contributors who make local AI accessible