A comprehensive LLM agent framework based on ComfyUI that integrates MCP server, text-to-speech, OCR, image generation, and other AI capabilities. It supports integration with various LLM models and enables the construction of complex AI workflows.
One-Minute Overview#
ComfyUI LLM Party is a collection of nodes for building LLM workflows based on the ComfyUI frontend, allowing users to quickly and conveniently construct their own LLM workflows and easily integrate them with existing image workflows. It ranges from basic LLM multi-tool calls and role-setting to building exclusive AI assistants, from industry-specific vector RAG and GraphRAG for localized industry knowledge base management, from single agent pipelines to complex agent-agent radial and ring interaction modes, and from individual users' social app integration to streaming media workers' one-stop LLM+TTS+ComfyUI workflows.
Core Value: Simplifies complex AI workflow construction through a node-based approach, enabling flexible combination of various LLM models and application capabilities.
Quick Start#
Installation Difficulty: Medium - Requires basic ComfyUI environment with multiple installation options
# Install one-click via ComfyUI Manager
# Or clone to custom_nodes directory
git clone https://github.com/heshengtao/comfyui_LLM_party.git
# Install dependencies
pip install -r requirements.txt
Core Capabilities#
1. Multiple LLM Access Methods - Compatible with various AI models#
- Supports OpenAI format API calls (including 4o and o1 series)
- Supports local ollama deployment
- Supports GGUF format local models
- Supports VLM (Vision Language Models)
- Compatible with multiple API services (Azure, Grok, Gemini, etc.)
2. Agent Workflow System - Building complex AI interactions#
- Multi-agent pipeline construction
- Agent-agent radial interaction mode
- Agent-agent ring interaction mode
3. Multimodal Capability Integration - Text, speech, and image in one#
- Integrates GPT-SoVits and ChatTTS text-to-speech
- Supports GOT-OCR2.0 text recognition
- Integrates FLUX image generation nodes
- Supports image hosting services (sm.ms, imgbb.com)
4. Enterprise-level Integration - Adapting to various environments#
- Supports integration with social platforms like Feishu and Discord
- Supports industry-specific vector RAG and GraphRAG
- Local knowledge base management system