AIAny
MLOps2019
Icon for item

MLRun

Turns plain Python functions into versioned, serverless ML jobs that run unchanged locally or on Kubernetes, with built-in tracking and deployment. Its feature store derives both offline (batch) and online (real-time) serving from one definition.

Introduction

Most teams hit the same wall: the notebook code that trains a model looks nothing like the production service that serves it, so every project pays a rewrite tax twice. MLRun's bet is to erase that gap by making the function the unit of work — you write ordinary Python with local semantics, and the framework versions it, containerizes it, and runs it as a batch job, a real-time Nuclio function, or a serving graph without changing the code.

What Sets It Apart
  • One function, many runtimes — the same code targets local execution, Kubernetes jobs, Dask, Spark, or real-time serving, so prototyping and production share a single artifact instead of two codebases.
  • A feature store that solves online/offline skew — one computation-graph definition automatically yields both the batch feature set for training and the low-latency feature vector for inference, killing the classic train/serve mismatch.
  • Orchestration without the Kubernetes boilerplate — it wraps Kubeflow Pipelines and friends, auto-tracking data, lineage, parameters, and metrics, so you get reproducible DAGs without hand-writing manifests.
Great Fit / Look Elsewhere

Great fit if you run ML or generative-AI workloads on Kubernetes and want one tool spanning data prep, training, serving, and monitoring rather than stitching MLflow, a feature store, and a serving stack together. Look elsewhere if you only need lightweight experiment tracking (MLflow is simpler), avoid Kubernetes entirely, or prefer a managed SaaS — MLRun assumes you operate your own cluster.

Information

  • Websitewww.mlrun.org
  • OrganizationsIguazio (McKinsey QuantumBlack)
  • AuthorsIguazio / QuantumBlack
  • Published date2019/01/01

Categories

More Items

MLOps2026

Provides a programming model and distributed runtime that preserves parent–child lineage and ordered variable-cardinality expansions for 1→M→1 dataflow pipelines, enabling completion-driven cross-input GPU batching and ordered gathers for foundation-model data preparation. Demonstrates multi-GPU scaling speedups and lower end-to-end time versus Ray Data and Daft.

GitHub
AI Infra2026

Provides an end-to-end platform to evaluate, observe, protect, and optimize LLM and AI agent deployments. Integrates OpenTelemetry tracing, 50+ evaluation metrics, agent simulations, an OpenAI‑compatible gateway, and guardrails; self‑hostable under Apache 2.0.

GitHub
AI Train2026

Provides a one-command CLI to fine-tune and post-train LLMs, with layer streaming that lets an 8B model be fine-tuned on a 4 GB laptop GPU. Auto-configures quantization, LoRA adapters, batching and evaluation gates, and supports export and serving workflows.