A public dataset of one million real-world conversations with 25 LLMs, including conversation text, model name, detected language tags, and OpenAI moderation outputs — useful for studying prompt distributions, safety/moderation, and training/evaluating instruction-following models.
Generates expressive multilingual speech from text, with sub-word control over prosody and emotion via inline tags like [whisper] or [angry]. Handles multi-speaker, multi-turn dialogue; the weights ship under a research-only license.
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).
Benchmark for evaluating general AI assistants with 466 short, real-world questions that require tool use, multimodality and reasoning; provides a public dev set and a withheld test set used for leaderboard evaluation.
Provides a 200k-example filtered conversational dataset derived from UltraChat for supervised fine‑tuning and generation‑ranking of chat models. Stored in parquet with four splits and used as part of Zephyr‑7B‑β training data.
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
Provides a self-hosted inference engine that serves all models an agent needs—embeddings, retrieval/reranking, document-to-markdown OCR, structured extraction, content-safety scoring, and LLM generation—through an OpenAI-compatible API. Bundles a 100+ model catalog, SDKs, and production deployment tooling.
Multilingual automatic speech recognition and speech-translation model that transcribes and translates audio. Trained on a mix of weakly labeled and pseudo-labeled data (1M + 4M hours), uses 128 Mel bins and adds a Cantonese token, and supports timestamps and long-form chunking for offline ASR and translation.
Performs speaker diarization (who spoke when) with pyannote-audio: combines voice-activity detection, speaker-change and overlapped-speech detection to produce time-stamped speaker segments; compatible with Hugging Face Endpoints and ASR pipelines.
Collection of runnable model implementations — LLaMA, Mistral, Stable Diffusion, Whisper, CLIP, plus LoRA fine-tuning — ported to the MLX array framework so they run natively on Apple silicon's unified memory rather than CUDA.
A selective State Space Model architecture and PyTorch implementation for linear-time sequence modeling. Hardware-aware, designed for information-dense tasks (e.g. language modeling), with pretrained weights on Hugging Face; requires CUDA-enabled PyTorch.
Runs one-command evaluation of vision-language models across 80+ multimodal benchmarks, handling data download, inference, and metric scoring in a single pass. Supports 220+ LMMs; adding a new model means writing one generate_inner() function.