AIAny
AI Infra2026
Icon for item

OpenTelemetry GenAI Semantic Conventions

Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.

Introduction

Generative AI systems introduce new observability needs — context propagation across prompts, model-level metrics, prompt-source attribution, and provider-specific behavior — yet existing telemetry schemas were not designed for those semantics. Standardizing GenAI telemetry lets operators compare providers, detect prompt-level regressions, and instrument end-to-end pipelines without bespoke conventions per model or vendor.

What Sets It Apart
  • Focused on GenAI semantics: defines spans, metrics, and events tailored to prompt/response flows, model context (MCP), and multi-provider scenarios so instrumentation can capture prompt inputs, transformations, and model outputs consistently.
  • Machine- and human-friendly artifacts: core definitions live as YAML model files (for tooling and codegen) while Markdown docs provide readable guidance, enabling both automatic validation and direct developer consumption.
  • Reference implementations and compliance matrix: includes language-specific reference pieces and a compliance matrix to show per-language/signal support, reducing integration ambiguity for operators and SDK authors.
Who It's For and Trade-offs

Great fit if you maintain or instrument GenAI services, build SDKs/agents that call multiple providers, or operate observability stacks that must surface prompt- and model-level diagnostics. It lowers integration cost by providing a shared schema and reference tooling. Look elsewhere if you need application-level business metrics only (this focuses on telemetry semantics, not higher-level analytics) or if you require turnkey APM features; this project defines conventions and references rather than providing a hosted observability product.

Where It Fits

Best used as the canonical schema layer between GenAI clients/agents and existing OpenTelemetry pipelines (collectors, exporters, APMs). It complements provider SDKs by offering a neutral mapping for attributes and events, making cross-provider comparisons and incident investigations more feasible.

Information

  • Websitegithub.com
  • OrganizationsOpenTelemetry
  • Published date2026/05/05

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.