AIAny
AI Train2024
GitHub

TimesFM

Pretrained foundation model for zero-shot point and quantile forecasting on unseen time series, no per-dataset training. Decoder-only, trained on 100B real-world time-points; v2.5 (200M params) handles up to 16k context and 1k-step horizons.

Introduction

Forecasting was the corner of ML that the foundation-model wave seemed to skip: teams still hand-fit a bespoke ARIMA or Prophet model per series. TimesFM's bet is that a single decoder-only transformer, pretrained once on 100B real-world time-points, can forecast a series it has never seen — zero-shot, no fitting — and still rival models trained directly on that data. It treats forecasting like language modeling: time is tokenized into patches and the future is decoded autoregressively.

Key Capabilities
  • Zero-shot across domains — one checkpoint forecasts retail demand, web traffic, or sensor data with no retraining; the ICML 2024 paper reports it matching or beating supervised baselines on many benchmarks.
  • Point and quantile in one pass — v2.5 emits continuous quantile forecasts (up to the 90th percentile), so you get calibrated uncertainty bands rather than a single mean line.
  • Long context, long horizon — v2.5 (200M params) handles up to 16k input timepoints and 1k-step horizons; the earlier v2.0 (500M params) capped context at 2048.
  • Covariates via XReg — added Oct 2025, it folds in external regressors (holidays, prices, promotions) instead of forcing a strictly univariate view.
Who It's For

Great fit if you need decent forecasts across many series without building and maintaining a per-series training pipeline, or want a strong zero-shot baseline before committing to custom models. Because it already ships inside BigQuery ML, Google Sheets, and Vertex Model Garden — with open PyTorch and Flax weights on Hugging Face — adoption can be a managed-service call rather than an MLOps project. Look elsewhere if your series carries rich known structure a tuned classical or gradient-boosted model exploits better, if you need genuine multivariate joint forecasting, or if you want a model you fully fine-tune and control rather than a general-purpose zero-shot forecaster.

Information

  • Websitegithub.com
  • AuthorsGoogle Research
  • Published date2024/04/29

Categories

More Items

Converts real repositories into verifiable, sandboxed training environments with black-box tests to train coding agents on long-horizon program reproduction. Provides Program-Env for automated environment construction and Program-Agent for a role-isolated development workflow, yielding 1,648 C/C++/Go/Rust tasks and improving benchmark performance.

Hugging Face
AI Video2026

Enables native joint video-and-audio generation and training up to 2K using a dynamic block-sparse attention scheme that cuts attention cost while preserving audio–visual coupling; provides preview checkpoints, training and inference code. High-resolution training requires large multi-GPU (80GB) clusters and CUDA ≥ 12.4.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.