AIAny
AI Model2024
Icon for item

Structured 3D Latents for Scalable and Versatile 3D Generation

Generates high-quality, editable 3D assets from text or images and decodes to radiance fields, 3D Gaussians, or textured meshes. Ships pretrained models up to 2B parameters, a 500K asset dataset and training code; best used with image conditioning and a ≥16GB NVIDIA GPU.

Introduction

Most 3D generation work trades flexibility for output format or scale: models that produce photorealistic radiance fields often can't export textured meshes, and mesh-focused pipelines rarely scale to billions of parameters. TRELLIS flips that trade-off by using a unified Structured LATent (SLat) representation so a single model family can decode to multiple 3D formats while scaling to very large model sizes and datasets.

What Sets It Apart
  • Unified latent representation: SLat lets the same latent decode into radiance fields, 3D Gaussians, or meshes, which simplifies pipelines that need multiple downstream formats (rendering, game engines, or further geometry processing). This means fewer conversion steps and more consistent geometry/appearance across outputs.
  • Large-scale pretraining and dataset: the project provides pretrained checkpoints (up to ~2B parameters) trained on TRELLIS-500K — a curated 500K-object collection aggregated from Objaverse, ABO, 3D‑FUTURE and others — improving variety and fidelity compared to smaller, single-source training sets.
  • Practical workflows and editing: supports image- and multi-image-conditioning for faithful reconstructions, plus asset-variant generation and local 3D editing. The repo includes pipelines and example scripts to export GLB/PLY and render videos from different representations, enabling both research and practical content creation.
Who it's for — and trade-offs

Great fit if you need high-fidelity, multi-format 3D assets for visualization, game prototyping, or research into large 3D generative models. The project is geared toward researchers and practitioners with access to modern GPUs (developers should expect a requirement of ≥16GB GPU memory; training used NVIDIA A100-class hardware) and familiarity with Linux and CUDA toolchains. Look elsewhere if you need a lightweight, on-device 3D generator or a Windows-first, zero-dependency workflow: TRELLIS is large, dependency-heavy (CUDA/C++ submodules) and optimized for server/GPU environments. Also note text-conditioned variants exist, but image-conditioned workflows typically produce more detailed and creative outputs due to dataset constraints.

Where it fits

TRELLIS occupies the space between single-format specialized 3D generators and monolithic multi-step toolchains: it aims to be a research-grade, end-to-end collection of models, data, and training code for scalable 3D asset generation and conversion, useful for teams building content pipelines or benchmarking large 3D generative models.

Information

  • Websitegithub.com
  • AuthorsMicrosoft
  • Published date2024/12/02

Categories

More Items

Hugging Face
AI Model2026

Provides GGUF-quantized Inkling multimodal model weights for local image/audio-to-text and conversational inference. Includes quantization variants (example: 1-bit UD-IQ1_S), Apache-2.0 license, and compatibility with Unsloth Studio, vLLM and common inference stacks.

Hugging Face
AI Video2026

Generates a new camera viewpoint from a reference video: an IC‑LoRA adapter for LTX‑Video 2.3 that re‑renders the same scene from a requested discrete camera angle while preserving subject and content. Trained on synthetic multi‑view data, proof‑of‑concept with limited viewpoint range and best for small, chained angle shifts.

Hugging Face
AI Model2026

Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.