AI Infra2010
Distributed search and analytics engine and vector database built on Lucene that enables near-real-time full-text and vector search, indexing, and analytics over large datasets. Provides vector embeddings support, REST APIs, RAG-friendly features, and deployment options including Elastic Cloud and Docker.
AI Infra2010
The N-dimensional array (ndarray) underpinning Python's scientific stack — pandas, scikit-learn, and SciPy build directly on it. Vectorized math, broadcasting, and a C/Fortran bridge move numeric work out of Python loops into compiled code.
AI Image2012
Provides a comprehensive set of computer-vision algorithms and image/video processing utilities with multi-language bindings (C++, Python, Java), contrib modules, and community docs/forums — suitable for prototyping, production pipelines, and real-time applications.
AI Infra2013
Provides a browser-based interface to query, analyze, visualize, and manage data stored in Elasticsearch. Offers dashboards, interactive visualizations, search/discover, geospatial maps, alerting, and built-in ML/AI features such as natural-language search and an assistant. Suited for observability, security analytics, and operational monitoring on Elasticsearch clusters.
MLOps2014
Apache Software Foundation, Maxime Beauchemin (originated at Airbnb)Apache Software Foundation, Airbnb
Programmatically author, schedule, and monitor data workflows as Python-defined DAGs; the scheduler handles dependencies, retries, and backfills. Pluggable executors (Local, Celery, Kubernetes) and a broad provider ecosystem for AWS, GCP, and databases.
AI Infra2015
Builds and deploys machine learning models across research, production, web, mobile, and edge environments. Its ecosystem spans Keras, TFX, LiteRT, TensorFlow.js, datasets, model hubs, and visualization tools.
AI Infra2016
Meta (Facebook AI Research), PyTorch Foundation (Linux Foundation)PyTorch Foundation (Linux Foundation)
Lets researchers and engineers build neural networks as regular Python programs, with GPU-backed tensors, autograd, distributed training, and production paths through TorchScript and related tooling.
AI Infra2016
Unified Node.js library for web crawling and browser automation that fetches pages and files via headless browsers or raw HTTP. Provides persistent queues, proxy rotation, session management, storage, and human-like fingerprints to build scalable data pipelines (e.g., RAG/LLM datasets).
AI Infra2016
Provides a NumPy/SciPy-compatible GPU array library for Python, enabling existing NumPy/SciPy numerical code to run on NVIDIA CUDA and AMD ROCm with minimal changes. Exposes low-level CUDA features (RawKernels, Streams) and offers prebuilt binaries for multiple CUDA/ROCm versions.
MLOps2017
Tracks every ML run — hyperparameters, metrics, checkpoints, dataset versions — into one dashboard you share as a live report, with Sweeps for tuning and a model registry. Weave extends it to LLM apps: tracing, evals, and production monitoring.
AI Infra2017
Manages polyglot monorepos by caching unchanged outputs and running only affected tasks. Built with Rust and extensible in TypeScript; includes integrated CI features (remote caching, task distribution) and AI-native tooling such as a CLI optimized for autonomous agents and self-healing CI.