Runs one-command evaluation of vision-language models across 80+ multimodal benchmarks, handling data download, inference, and metric scoring in a single pass. Supports 220+ LMMs; adding a new model means writing one generate_inner() function.
Builds realtime voice AI agents that run as server-side participants in WebRTC rooms — mix STT, LLM, and TTS providers or use one realtime model. Adds semantic turn detection, SIP telephony, multi-agent handoffs, and an LLM-judge test harness.
Automates uploading and scheduled publishing of videos to major Chinese and international social platforms (Douyin, Bilibili, Xiaohongshu, Kuaishou, WeChat Video Channel, TikTok, etc.). Offers a CLI, platform-specific uploader modules, headless/browser automation and agent-skill integration for scripted cross-posting workflows.
Provides a diffusion-model studio for image, video, audio-video, editing, LoRA, and full training workflows so many model families share one inference and training framework.
Estimates and tracks 6D poses of novel objects without per-object fine-tuning — supports both model-based (CAD) and model-free (few reference images) setups. Trained on large-scale synthetic data with a transformer-based architecture and contrastive learning; CVPR 2024 highlight with demos and pretrained weights.
Triton kernels and PyTorch layers for linear-attention, state-space, and sparse-attention token mixers (GLA, RWKV, Mamba2, GSA) as drop-in replacements for multihead attention. Runs on NVIDIA, AMD, and Intel GPUs with Hugging Face support.
Traces how Transformer LLMs route information from input to output, attributing each block's effect to individual attention heads and feed-forward neurons. Click any edge to see what a head promotes or suppresses in vocabulary space.
Builds real-time voice and multimodal AI agents as composable streaming pipelines. Vendor-neutral: swap among 20+ STT, 20+ LLM and 30+ TTS providers over WebRTC or WebSockets, and compose multi-agent systems with handoff and parallel workers.
Claude-Mem is a persistent memory compression system built for Claude Code. It automatically captures tool usage observations during coding sessions, generates semantic summaries using Claude's agent-sdk, and injects relevant context into future sessions to maintain continuity of project knowledge.
Generates interactive codebase wikis from GitHub, GitLab, or Bitbucket repositories by analyzing structure, writing documentation, and creating diagrams for navigation.
Organizes reusable AI prompts as Markdown 'Patterns' you run from the CLI — summarize a video, extract claims, rate content. Switch among 20+ providers (OpenAI, Claude, Gemini, Ollama) and reach them via CLI, web UI, or REST API.
AI Hedge Fund is a proof-of-concept for an AI-powered hedge fund. It employs multiple AI agents modeled after renowned investors to analyze stocks, perform valuations, sentiment analysis, and generate trading signals. Designed for educational purposes only, it supports CLI and web interfaces, requiring API keys for LLMs and financial data.