A proactive AI desktop companion platform featuring multimodal dialogue, a three-layer memory system, Agent-driven automation, Live2D/VRM/MMD multi-form avatars, and a Steam Workshop UGC ecosystem.
Project N.E.K.O. (Networked Emotional Knowledging Organism) is an open-source proactive AI companion platform that unifies desktop pet, intelligent assistant, and metaverse ecosystems into a single experience.
In terms of core capabilities, the project supports multimodal interaction—real-time voice dialogue via Realtime API, text and visual understanding through ChatCompletion, and built-in 5-second voice cloning. Its three-layer memory system is the most prominent differentiator: factual memory records objective information, reflective memory summarizes and distills conversations, and persona memory maintains long-term character consistency, all working together to deliver a "same her" experience across scenarios (desktop chat, in-game interaction, etc.).
The Agent module empowers the AI with proactive computer control capabilities, covering keyboard/mouse takeover, browser automation, and task execution engines, extended through OpenClaw and OpenFang adapters for cloud and headless execution. Combined with 24/7 environmental awareness (screen understanding, trending topic tracking, personal activity sensing), the AI can proactively initiate conversations rather than only responding passively.
On the presentation layer, it supports three mainstream model formats—Live2D, VRM, and MMD—with motion capture and full-screen tracking. The plugin system provides a complete SDK and server, with existing game companion plugins for Minecraft, Slay the Spire, and others. Steam Workshop enables UGC sharing of character cards, models, and voice packs.
Architecturally, it adopts a multi-server design (main server, memory server, and Agent server run independently), with Python 3.11 as the primary backend (51.6%) and a frontend combining React (chat) and Vue (plugin management). It supports 14+ AI providers, including free out-of-the-box models sponsored by StepFun. Deployment options cover Windows/macOS one-click packages, Linux Docker, and source builds. The Steam version is in Early Access (Free to Play).
Roadmap: v0.7 completed Agent enhancements; v0.8 (est. 2026-03) focuses on memory improvements; v0.9 (est. 2026-04) targets multi-platform adaptation and the N.E.K.O. Network launch; v1.0 (est. 2026-06) aims at proprietary LLM and agent systems. Published by 喵可智能, led by developer Hongzhi Wen.