A large multi-config collection of query–document pairs assembled to reproduce and extend the mGTE/LateOn data recipe for pre-training text embedding models. Data come in source-specific configs and include per-row drop/duplicate flags and guidance for using cleaned subsets for training.
Isolates any single sound from a complex audio mixture using a text description, a visual cue from a video frame, or a time span, returning both the isolated target and the residual. Released in small, base, and large sizes plus visual-prompt variants.
Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
Generates explorable, 3D-consistent virtual worlds from a single image or short video. Includes official implementations of Lyra‑1 (feed‑forward 3D/4D scene generation via video-diffusion self-distillation) and Lyra‑2 (long-horizon, explorable generative 3D worlds). Best for research and creative prototyping; requires substantial GPU compute.
Compares standard human psychometric questionnaires (PVQ, BFI) with generation‑based profiling to test whether questionnaires predict real LLM responses. Finds big divergences: questionnaires exploit lexical cues and elicit alignment‑consistent answers, mischaracterizing LLM behavior on everyday queries.
Automatically removes safety alignment from transformer LLMs via directional ablation, with Optuna's TPE optimizer tuning the parameters — no retraining or model-internals expertise needed; hit 3/100 refusals at 0.16 KL on Gemma-3-12b.
Argues a single web-scale generative video model handles vision tasks zero-shot the way LLMs handle language. Probes Veo 3 on segmentation, edge detection, image editing, physical and affordance reasoning, and puzzles like maze solving and symmetry.
Provides a DiT-based audio–video foundation model plus an official Python inference and LoRA trainer. Ships multiple production-ready pipelines (text/image/audio→video), checkpoints, and performance optimizations (FP8, distilled pipelines) for high-fidelity synchronized audio–video generation.
Provides a conditional memory module that performs O(1) N‑gram lookups and fuses static embeddings into transformer hidden states — enables offloading large embedding tables to host memory with minimal inference overhead.
A 26M-parameter LLM distilled for reliable function-call generation on tiny devices, with open weights, local finetuning tooling, and a web playground for on-device testing. Pretrained at scale then post-trained on a single-shot function-call dataset for tool integration.
Paired brain MRI scans and radiology text annotations for multimodal vision–language research. Provides image-level labels and image–text pairs suited for VQA, classification, and image-to-text tasks; CC BY-NC-SA 4.0 and ~10K–100K samples — research/non-commercial use.
Generate text, images, video, audio and action/robot trajectories from combined text, image, video, audio and action inputs. A Mixture-of-Transformers omnimodal foundation model (Cosmos3‑Nano, 16B params) focused on Physical AI (robotics, AV, simulation) and optimized for NVIDIA GPU runtimes.