AIAny
AI Train2024
Icon for item

TimesFM

Pretrained foundation model for zero-shot point and quantile forecasting on unseen time series, no per-dataset training. Decoder-only, trained on 100B real-world time-points; v2.5 (200M params) handles up to 16k context and 1k-step horizons.

Introduction

Forecasting was the corner of ML that the foundation-model wave seemed to skip: teams still hand-fit a bespoke ARIMA or Prophet model per series. TimesFM's bet is that a single decoder-only transformer, pretrained once on 100B real-world time-points, can forecast a series it has never seen — zero-shot, no fitting — and still rival models trained directly on that data. It treats forecasting like language modeling: time is tokenized into patches and the future is decoded autoregressively.

Key Capabilities
  • Zero-shot across domains — one checkpoint forecasts retail demand, web traffic, or sensor data with no retraining; the ICML 2024 paper reports it matching or beating supervised baselines on many benchmarks.
  • Point and quantile in one pass — v2.5 emits continuous quantile forecasts (up to the 90th percentile), so you get calibrated uncertainty bands rather than a single mean line.
  • Long context, long horizon — v2.5 (200M params) handles up to 16k input timepoints and 1k-step horizons; the earlier v2.0 (500M params) capped context at 2048.
  • Covariates via XReg — added Oct 2025, it folds in external regressors (holidays, prices, promotions) instead of forcing a strictly univariate view.
Who It's For

Great fit if you need decent forecasts across many series without building and maintaining a per-series training pipeline, or want a strong zero-shot baseline before committing to custom models. Because it already ships inside BigQuery ML, Google Sheets, and Vertex Model Garden — with open PyTorch and Flax weights on Hugging Face — adoption can be a managed-service call rather than an MLOps project. Look elsewhere if your series carries rich known structure a tuned classical or gradient-boosted model exploits better, if you need genuine multivariate joint forecasting, or if you want a model you fully fine-tune and control rather than a general-purpose zero-shot forecaster.

Information

  • Websitegithub.com
  • AuthorsGoogle Research
  • Published date2024/04/29

Categories

More Items

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub
AI Train2026

Provides a one-command CLI to fine-tune and post-train LLMs, with layer streaming that lets an 8B model be fine-tuned on a 4 GB laptop GPU. Auto-configures quantization, LoRA adapters, batching and evaluation gates, and supports export and serving workflows.

GitHub
AI Train2025

A PyTorch DTensor-native SPMD library for training and fine-tuning LLMs, VLMs, diffusion and retrieval models. Integrates with Hugging Face for day-0 model support, provides YAML-driven recipes, DTensor/FSDP2 parallelism and NVIDIA-optimized kernels (Transformer Engine, DeepEP, FlexAttn).