Unified Node.js library for web crawling and browser automation that fetches pages and files via headless browsers or raw HTTP. Provides persistent queues, proxy rotation, session management, storage, and human-like fingerprints to build scalable data pipelines (e.g., RAG/LLM datasets).
Converts trained PyTorch, TensorFlow, and ONNX models into GPU-tuned inference engines via layer fusion, kernel auto-tuning, and reduced precision. Cuts latency, raises throughput on NVIDIA GPUs from Turing (INT8), with FP8 on Ada+ and FP4 on Blackwell+.
Provides a NumPy/SciPy-compatible GPU array library for Python, enabling existing NumPy/SciPy numerical code to run on NVIDIA CUDA and AMD ROCm with minimal changes. Exposes low-level CUDA features (RawKernels, Streams) and offers prebuilt binaries for multiple CUDA/ROCm versions.
Trains gradient-boosted decision trees with native categorical-feature handling, GPU acceleration, and production-ready prediction APIs. A strong fit for tabular ML when preprocessing categories into numeric features would add noise or leakage.
Sequence modeling toolkit for training custom models for translation, summarization, and language modeling. Reference implementation behind RoBERTa, BART, mBART, XLM-R, and wav2vec 2.0, with multi-GPU and mixed-precision training.
Provides reusable PyTorch modules and utilities to build, train and scale Graph Neural Networks — includes many implemented GNN layers, benchmark datasets, minibatch/sampling loaders, and support for large-scale, heterogeneous, temporal and point-cloud graphs.
Brings classic computer vision into PyTorch as differentiable, GPU-accelerated tensor operators — filters, geometric transforms, feature matching, camera calibration — so each step lives inside autograd and trains end-to-end with neural networks.
Provides composable function transformations for Python+NumPy—automatic differentiation, JIT compilation, and vectorization—while using XLA to run and scale numerical programs on GPUs/TPUs for ML and scientific computing.
Provides unified model definitions and a single API for pretrained text, vision, audio, and multimodal models for both training and inference. Emphasizes cross-framework compatibility (PyTorch/TF/JAX), pipeline-based inference, and direct access to 1M+ Hub checkpoints.
Turns model definitions into a shared layer across training and inference stacks, covering text, vision, audio, video, and multimodal models. Pipelines, Trainer, and generation APIs make pretrained models usable without locking teams to one framework.
Differentiable programming framework for quantum computers: build variational circuits, compute their gradients alongside PyTorch, TensorFlow, or JAX, and run identical code on simulators or real hardware via IBM, AWS Braket, and Google plugins.
Turns NumPy-style Python into differentiable, compiled, vectorized programs for CPU, GPU, and TPU. Its leverage is composable transformations: grad, jit, vmap, and sharding combine instead of living in separate APIs.