AI Video2024
Generates short videos from text, images, or videos and ships a full training/inference pipeline with checkpoints and demos. Key features include multi-stage training (VAE / 3D-VAE), rectified-flow training, video compression modules, and support for 2s–16s clips at up to 720p. Best for researchers and engineers who can provide substantial GPU resources.
AI API2024
Provides local inference, fine-tuning, and a server/CLI for vision–language and omni (image/audio/video) models via MLX. Supports multi-image chat, audio/video inputs, activation quantization (CUDA), TurboQuant KV cache, and LoRA/QLoRA fine-tuning for on-device workflows.
AI API2024
Ingests documents, images, audio, video and web pages and converts them into structured, LLM-friendly markdown and parsed data. Runs locally (fits on a T4 GPU), supports ~20 file types, offers OCR, transcription, table extraction and a Gradio UI; deployable via Docker/Skypilot. Licensed under GPL-3.0; some model weights carry cc-by-nc-sa restrictions for commercial use.
AI Dataset2024
Provides point-accurate annotations of interactive parts in high-resolution indoor laser-scan point clouds, plus affordance labels, motion axes and natural-language task descriptions; includes aligned iPad RGB-D video slices with 2D projections for multimodal research.
AI Model2024
High-resolution image and video generation codebase and models that run with far lower compute and memory than typical diffusion systems. Uses linear-attention DiT variants, aggressive latent compression, and inference-scaling to support text-to-image (up to 4K), fast one/few-step generation, and efficient video pipelines.
AI Video2024
Reference architectures and microservices for building GPU-accelerated vision agents that enable natural-language video search, long-video summarization, visual Q&A, and alert verification. Integrates NVIDIA NIM models, embeddings, VLMs/LLMs, and agent workflows for deployable video-analytics stacks.
AI Video2024
VideoCaptioner is an AI-powered video subtitling assistant that combines ASR (local or cloud) with LLM-based subtitle segmentation, correction and translation. It supports offline GPU transcription, concurrent chunk transcription, VAD, speaker-aware processing, batch subtitling and one-click subtitle-to-video synthesis, with both GUI and CLI options.
AI Video2024
Generates video from text or images via a DiT-based latent diffusion model: text-to-video, image-to-video, frame extension, and multi-keyframe conditioning in one model. A distilled 2B variant runs near real-time on one H100; 13B for higher quality.
Embodied AI2024
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.
AI Video2025
Retrieval-augmented generation framework for videos spanning hundreds of hours, runnable on a single RTX 3090. Builds multi-modal knowledge graphs over visual and audio content so you can query and chat across many long videos at once.
Explains how modern LLMs are trained, tokenized, post-trained, and used, from internet-scale pretraining to RLHF and tool use. The value is a coherent mental model, not a quick product tutorial.
