An all-in-one desktop AI companion and multi-agent platform integrating VRM avatars, computer control, multi-platform messaging bots, and browser automation.
Super Agent Party is an all-in-one desktop AI companion and multi-agent platform at v0.4.0, maintained by heshengtao under the AGPL-3.0 license.
The platform features a VRM desktop pet robot as its signature entry point, supporting custom 3D/2D avatars, voice interaction, conversation interruption, OBS transparent streaming, and bidirectional VMC protocol. Core capabilities span four areas:
Desktop & Browser Control — AI automatically operates computers via visual recognition plus mouse/keyboard toolchains, with a dedicated browser for agents using LLM vision-based reasoning.
Multi-Platform Messaging & Live Streaming — One-click deployment to IM platforms (QQ, WeChat, Feishu, DingTalk, Telegram, Discord, Slack) and streaming platforms (Bilibili, YouTube, Twitch, including 360° panoramic streaming).
Dialogue & Memory — Tavern character cards, multi-character group chat, long-term memory, per-character voice and avatar, narrator voice.
Tools & Extensibility — A native async toolset (web search, knowledge base, smart home, sandboxed code execution via e2b, ComfyUI image generation, Claude Code filesystem operations, etc.), custom tool interfaces (MCP, Skills, A2A, HTTP requests, arbitrary LLM endpoints), and 20+ built-in extensions (galgame, AI editor, RSS reader, Code Server IDE, etc.).
It exposes an OpenAI-compatible API, MCP endpoint, and desktop pet API for external agent integration. The architecture uses an Electron 39 desktop shell with a Python 3.12/FastAPI backend. The AI layer unifies multiple LLM providers (local Ollama, cloud OpenAI/Dify) via LangChain + LiteLLM; memory relies on mem0ai + FAISS + rank-bm25; voice integrates edge-tts, sherpa-onnx, pyttsx3, and elevenlabs. Supported platforms include Windows 10/11, macOS (Apple Silicon), Linux (AppImage/deb), and Docker deployment, with low hardware requirements (2-core CPU / 2GB RAM, all models can run on cloud).
Deployment Options
- Docker:
docker pull ailm32442/super-agent-party:latestthendocker run -d -p 3456:3456 -v ./super-agent-data:/app/data ailm32442/super-agent-party:latest - Docker Compose: clone repo then
docker-compose up -d, default credentials root/pass - Desktop: Windows portable/installer, macOS DMG (Apple Silicon), Linux AppImage/deb
- Source:
uv sync && npm install && npm run dev(requires Python >=3.12, <3.13)
Unconfirmed Items: No dedicated official website URL found; no project-specific HuggingFace page identified; Docker Hub page not directly verified; actual availability and limitations of IM platform integrations unknown; extension plugin development spec not captured in collected materials.