AIAny
AI Infra2017
Icon for item

ONNX

Defines a portable model format and operator set for moving trained machine learning models across frameworks, runtimes, and hardware targets without locking the model to one toolchain.

Introduction

Model portability is not just saving weights; another runtime must preserve enough graph semantics to execute the model correctly. ONNX gives the AI stack a shared contract between training frameworks, deployment runtimes, and hardware vendors.

What Sets It Apart

It specifies an extensible computation graph, built-in operators, and standard data types, with a strong focus on inference. That makes it a practical baseline for model export, compatibility tests, and hardware-specific optimization paths.

Who Should Use It

Great fit if you move models between training frameworks, inference runtimes, and accelerator toolchains. Look elsewhere if your workflow relies on dynamic framework behavior that cannot be captured cleanly.

Information

  • Websitegithub.com
  • OrganizationsLinux Foundation AI & Data, Meta, Microsoft
  • AuthorsONNX Project Contributors, Meta (Facebook), Microsoft
  • Published date2017/09/29

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.