LLM Runner AIO

Overview

LLM Runner AIO is a comprehensive, self-contained desktop application that bundles all the tools you need to run local AI models on your own hardware. No complex setup, no dependency hell — just download, run, and start chatting with AI locally.

┌─────────────────────────────────────────────┐
│           LLM Runner AIO Launcher           │
├─────────────────────────────────────────────┤
│  ┌──────────┐  ┌──────────┐                │
│  │ SearXNG  │  │ llama.cpp│                │
│  │ :8080    │  │ :8000    │                │
│  └──────────┘  └──────────┘                │
│  ┌──────────┐  ┌──────────┐                │
│  │OpenWebUI │  │  Vane    │                │
│  │ :3000    │  │ :3001    │                │
│  └──────────┘  └──────────┘                │
└─────────────────────────────────────────────┘

• llama.cpp runs the AI model inference engine
• Open WebUI provides the chat interface at http://localhost:3000
• SearXNG enables local web search at http://localhost:8080
• Vane handles browser automation at http://localhost:3001

Note: Python 3.11 and Node.js are bundled inside the executable. No separate installation needed!

Credits

This project would not be possible without the incredible work of:

• • Georgi Gerganov — llama.cpp
• • Open WebUI Team — Open WebUI
• • SearXNG Contributors — SearXNG
• • All open-source contributors who make local AI accessible