Bundles ASR, voice activity detection, punctuation, and speaker diarization into one pipeline, with pretrained models like Paraformer and SenseVoice. SenseVoice runs ~17x realtime on CPU; also ships streaming ASR and an OpenAI-compatible API.
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
Provides reusable computer-vision utilities for dataset loading/conversion, visualization/annotation of detections and segmentation, and connectors to popular detection frameworks—aimed at quick prototyping, dataset work, and visualization.
Reproduces GPT-2 (124M) from scratch on OpenWebText in ~4 days on an 8xA100 node, with the whole stack kept to two ~300-line files: train.py for the loop and model.py for the architecture. A char-level Shakespeare run finishes in ~3 minutes on one GPU.
Runs an agentic RAG loop over scientific papers: searches literature, gathers and re-ranks evidence chunks, then answers with in-text citations. Adds metadata-aware embeddings, retraction checks, and contradiction detection across full PDFs.
Reimplements OpenAI's Whisper speech-to-text on the CTranslate2 inference engine, running up to 4x faster at the same accuracy while using less memory. Adds a batched pipeline, 8-bit quantization, VAD filtering, and word-level timestamps.
Maps your existing C#, Python, or Java functions into a form AI models can invoke, then translates model requests into real function calls and feeds results back. Model-agnostic middleware: swap in newer models without rewriting your app.
Framework for building multi-agent systems where LLM agents take roles and converse to complete tasks via inception prompting, with no human in the loop after the initial brief. Used to auto-generate instruction data and run large-scale agent simulations.
Runs large language models entirely in C/C++ with no external dependencies, using 1.5-to-8-bit integer quantization and CPU+GPU hybrid inference to fit models larger than available VRAM. Backs Ollama, LM Studio, and most local-inference tooling.
Ensures LLM outputs match precise, schema-defined structures by enforcing Python types, Pydantic models, JSON schemas or grammars at generation time. Provider-agnostic integrations (OpenAI, transformers, vLLM, Ollama, etc.) and function-call style mapping reduce brittle post-processing and make structured generation reliable for production pipelines.
Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
Translates plain-English questions into pandas/SQL code over CSV, Parquet, and SQL databases, returning tables and charts. Combines LLMs with RAG and a semantic layer so non-coders query data; a Docker sandbox isolates generated code.