Automates video editing driven by LLM agents: reads word-level transcripts to propose and execute cuts, remove filler words, auto grade color, burn subtitles, and generate animation overlays. Self-evaluates every cut before showing a preview; aimed at talking-heads, tutorials and interviews.
An HDR LoRA fine-tune for Lightricks' LTX-2.3 (22B) that enables image‑conditioned any‑to‑any image-to-video and text-to-video generation. Designed for HDR-aware synthesis workflows; requires the LTX-2.3 base model and a LoRA-capable runtime.
Performs task-aware generative video restoration and editing in latent video space — restoration, super-resolution, watermark and subtitle removal — adapting LTX‑2.3 with IC‑Edit/IC‑LoRA adapters to prioritize temporal consistency and occlusion-aware reconstruction.
Enables Claude to “watch” videos by extracting timestamped frames plus captions/transcripts and feeding them to Claude for grounded Q&A. Key features: native captions first, Whisper fallback, frame deduplication, and multiple detail modes (transcript/efficient/balanced/token-burner). Useful for summarizing, debugging, and extracting moments.
Cross-platform native video editor with hardware-accelerated processing and frame-accurate multi-track timeline; core editor is open-source and free while optional Pro AI features (natural-language editing, auto-captions, smart reframing) are paid.
Large-scale synthetic video dataset of 236,937 1080p clips (≈5,841 hours) of digital humans with per-frame metric depth and camera parameters — built as a controllable supplement for world-model pretraining, camera-motion generalization, and geometry-aware physical-AI research.
Image-to-video (I2V) diffusion model merge tuned for prompt-conditioned motion and evolution. Uses layer-scaled weight merges (not straight averaging) with BF16 and FP8 checkpoint options; prompt engineering is required for predictable motion and audio. Avoid large distilled Loras for best results.
Generates uncensored videos from text and images using an LTX 2.3–based diffusion model with native t2v and i2v support; ships with a prompt enhancer and developer-focused gguf/bf16 dev releases for local experimentation.
Open egocentric multimodal dataset for embodied AI and robot learning captured on commodity iPhone Pro: ~200 hours and ~10M RGB frames with LiDAR depth, ARKit 6‑DoF poses, IMU, two‑hand MANO mocap, room meshes, and hierarchical action captions.
Provides tick-aligned Counter-Strike 2 player POV video clips with per-tick inputs and world-state sidecars — near-lossless 1280×720@32fps video, per-player stereo audio, and parquet indexes for event/kill/round filtering; suited for RL, video classification and clip mining.
Converts video inputs into text outputs — supports captioning, temporal grounding, and video-text-to-text queries using a Qwen-3.5-2B finetuned multimodal backbone. Suited for prototyping video understanding and caption-generation pipelines.
Delivers image and video generation, editing, and understanding inside a single 3B-parameter multimodal model trained from scratch with a multi-task recipe. Notable for strong unified benchmarks at 3B scale; inference requires large GPU memory (≈40GB+ VRAM).