Project information incomplete; verified data preserved for future enrichment. Automated scraping failed to retrieve page content; manual verification required.

Model & Inference Framework大语言模型Python

VIEW DETAILS →

A Rust-based cross-platform CLI tool that right-sizes LLM models to your system's RAM, CPU, and GPU by detecting specs and recommending optimal models and quantization strategies. Covers 206 models from 57 providers.

Model & Inference Framework大语言模型Rust

VIEW DETAILS →

An open-source framework for large language model evaluations from the UK AI Safety Institute, featuring a modular Datasets/Solvers/Scorers architecture, multi-model/tool support, sandboxed execution, and 100+ pre-built benchmarks.

Model & Inference FrameworkSDKAI Agents

VIEW DETAILS →

On-device full-stack AI SDK for Flutter with LLM, Vision, Speech, Image Gen, and RAG; features compute budget contracts and adaptive QoS with zero cloud dependency.

大语言模型MultimodalSDK

VIEW DETAILS →

An open-source AI monitoring and governance engine providing LLM hallucination detection, PII identification, prompt injection defense, and traditional ML model evaluation, featuring real-time guardrails and OpenInference support.

Model & Inference FrameworkMachine Learning大语言模型

VIEW DETAILS →

Smart AI model cascading library using speculative execution to dynamically select optimal models, achieving 40-85% cost savings and 2-10x latency reduction.

SDK大语言模型AI Agents

VIEW DETAILS →

A plug-and-play multi-object tracking (MOT) Python library offering modular implementations of classic algorithms like SORT and ByteTrack. Features a detector-agnostic design compatible with any object detection model (YOLO, DETR, etc.), supporting video files, cameras, RTSP streams, and more. Provides unified CLI tools and Python API with built-in evaluation metrics (CLEAR, HOTA, Identity).

MultimodalDeep LearningSDK

VIEW DETAILS →

An end-to-side omnimodal LLM by Tsinghua THUNLP supporting vision, speech, and full-duplex multimodal live streaming, optimized for mobile deployment with performance rivaling Gemini 2.5 Flash.

大语言模型MultimodalTransformers

VIEW DETAILS →

Fully automatic censorship removal tool for language models using directional ablation with TPE parameter optimization to remove safety alignment while minimizing refusal behaviors and preserving original model capabilities. Supports dense, multimodal, and MoE architectures.

Multimodal大语言模型Transformers

VIEW DETAILS →

Fast and accurate automatic speech recognition (ASR) optimized for edge devices. Features streaming support, voice intent recognition, and speaker identification with significantly lower latency than Whisper (107ms on Mac with Medium model). Provides unified API across iOS, Android, Linux, Windows, and macOS, ideal for robotics, smart home, and IoT applications.

MultimodalSDKPyTorch

VIEW DETAILS →