Physics-aware simulated sensor dataset for training and evaluating autonomous-vehicle perception and control models. Includes multimodal sensor streams with physical-scene annotations intended for tasks that require grounding in real-world dynamics.
Turns commodity WiFi Channel State Information into spatial sensing: 17-keypoint pose estimation, presence detection, and contactless breathing/heart-rate monitoring through walls, with no camera. Runs on a mesh of ESP32-S3 nodes (~$9 each).
Reimplements the vLLM inference engine from scratch in ~1,200 lines of readable Python, matching its offline throughput on small models. Prefix caching, tensor parallelism, torch.compile, and CUDA graphs are all kept legible.
Provides a unified Python interface to collect data, train visual/dynamics world models, and evaluate them with model-predictive control across many standardized environments. Includes reference baselines, planning solvers, dataset converters, and LanceDB-backed formats for reproducible experiments. Best suited for researchers benchmarking world-model algorithms.
Forecasts financial candlesticks (OHLCV K-lines) with a decoder-only transformer pre-trained on 12B+ records from 45 exchanges. A tokenizer turns market data into discrete tokens, enabling price/volatility forecasting and synthetic K-line generation.
Model-compression toolkit for large LLMs/VLMs that integrates quantization (FP8/INT4/etc.), speculative decoding, token pruning and deployment hooks—designed for end-to-end performance on single/multi-GPU inference workflows and research-to-prod model optimization.
Runs named-entity recognition, text classification, structured-JSON parsing and relation extraction from one 205M-parameter encoder in a single CPU forward pass, using schemas with per-field regex validators. A larger 1B model is available via API.
An agentic framework that analyzes, plans, and executes multi-step video understanding and editing workflows using multimodal LLM-driven agents—features intent decomposition, graph-based workflow orchestration, and automated shot planning for long-form video tasks.
Detects, segments, and tracks every instance of an open-vocabulary concept in images and video from a text phrase or visual exemplar, not just one object per prompt. An 848M-param model reaching ~75-80% of human accuracy across 270K concepts.
A 20B-parameter MMDiT diffusion model that generates and edits images with accurate embedded text, including dense Chinese and English typography. Handles complex multi-line layouts and identity-preserving edits while keeping text legible.
Self-supervised vision foundation model producing dense, patch-level features that transfer to classification, segmentation, depth, and detection with a frozen backbone. Spans ViT-S (21M) to ViT-7B (6.7B params), plus ConvNeXt and satellite variants.
Framework for building multi-modal AI agents that watch, listen, and reason over live video, pairing vision models (YOLO, Roboflow, Moondream) with LLMs like Gemini and OpenAI. Agents join calls in ~500ms and keep audio/video latency under 30ms.