AIAny
AI Infra2023
Icon for item

Langfuse

Tracks, evaluates, and debugs LLM applications with traces, prompt management, datasets, playgrounds, and observability that can run in cloud or self-hosted setups.

Introduction

LLM applications fail in ways normal logs do not explain: prompts, retrieval context, tool calls, outputs, and feedback interact. Langfuse treats those pieces as one engineering system.

What Sets It Apart

It combines observability, prompt management, evaluations, datasets, and a playground. OpenTelemetry and ecosystem integrations help connect LangChain, OpenAI SDK, LiteLLM, and custom stacks to shared debugging and improvement loops.

Who Should Use It

Great fit if a team is moving from prototype to maintained AI product and needs visibility over time. Look elsewhere if you only need ad hoc local debugging.

Information

  • Websitegithub.com
  • OrganizationsLangfuse
  • AuthorsLangfuse (company)
  • Published date2023/05/18

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.