AI Model2024
Generates high-quality, editable 3D assets from text or images and decodes to radiance fields, 3D Gaussians, or textured meshes. Ships pretrained models up to 2B parameters, a 500K asset dataset and training code; best used with image conditioning and a ≥16GB NVIDIA GPU.
Embodied AI2024
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.
Provides end-to-end PyTorch scripts to download/prepare data, implement a transformer from scratch, train LLMs (13M→billion-scale) and generate text. Emphasizes educational clarity and single‑GPU experiments; useful for researchers or hobbyists, but large-scale training still requires substantial compute and engineering.
AI Audio2025
Generates full songs from lyrics and style prompts by first writing an editable melody-and-chord score and then rendering vocals and accompaniment. Unifies symbolic planning and audio synthesis in one pipeline, enabling readable score inspection, zero‑shot covers, and agent-driven editing.
AI Audio2025
A toolkit and open-weights system for real-time streaming music generation — offers two model sizes (230M / 2.4B), a Python inference library (JAX/MLX), and a C++ engine optimized for Apple Silicon for embedding into DAWs and apps; real-time streaming requires M‑series chips.
AI Model2025
Turns clinical text into structured, de-identified clinical signals—entity extraction and PII de-identification—that run entirely on local hardware. Provides 1,000+ specialized medical NER models, multilingual support, Apple MLX acceleration, and Apache‑2.0 licensing.
AI Agent2025
Automates multi-step web tasks by perceiving webpages as pixels and issuing low-level mouse, keyboard and scroll actions. A 7B-parameter multimodal agent trained on 145K synthetic trajectories (FaraGen), designed for on-device deployment and efficient task completion (~16 steps/task).
AI Model2025
Performs open-vocabulary promptable segmentation and tracking on images and videos, returning instance masks and unique IDs from short noun-phrase or exemplar prompts. Trained on a 4M-concept, 52M-mask dataset; uses a presence head and a decoupled detector–tracker design, with near real-time inference for multi-object video.
AI Model2025
Converts images (and other conditions) into high-fidelity, fully textured 3D assets using a 4B-parameter generative model and a field‑free sparse voxel format (O‑Voxel). Handles arbitrary topology, PBR materials, and near real-time mesh/voxel conversions; requires Linux and an NVIDIA GPU with >=24GB memory.
AI Video2026
Provides a DiT-based audio–video foundation model plus an official Python inference and LoRA trainer. Ships multiple production-ready pipelines (text/image/audio→video), checkpoints, and performance optimizations (FP8, distilled pipelines) for high-fidelity synchronized audio–video generation.
AI Audio2026
Generates controllable multilingual speech from text with nine predefined timbres and custom-voice control; supports voice design, quick voice cloning and low-latency streaming (first audio packet after a single character), suitable for real-time TTS and voice-design workflows.
AI Model2026
Generates anime-style and other non-photorealistic illustrations from text prompts. A 2B-parameter diffusion base preview trained on millions of anime images (and ~800k non-anime art) and released under a non-commercial license; best used in ComfyUI around ~1MP resolution.