Discover the Best AI Resources
Curated essentials, no noise — just what matters
A continuously-updated, categorized self-hosting guide that catalogs tools, deployment notes and resources for containers, networking, home automation and running LLMs/chatbots locally; provided as a long, structured README with links and quick setup tips.
Deploys PyTorch models directly on phones, microcontrollers, and embedded hardware via ahead-of-time compilation to a ~50KB C++ runtime. Delegates subgraphs to 12+ backends (XNNPACK, CoreML, Qualcomm, ARM Ethos-U) with torchao quantization.
Graduate-level textbook unifying classical statistics and modern deep learning under one probabilistic framework. Builds from probability, information theory, and optimization up to neural nets, with runnable Python/JAX figure code and exercise solutions.
A 57-subject multiple-choice benchmark for measuring broad language understanding in LLMs; provides per-subject configs and test/dev/auxiliary_train splits for few-/zero-shot evaluation, widely used for model comparison and academic reporting.
Pretrained uncased English BERT base model for masked language modeling and next-sentence prediction. ~110M parameters, pretrained on BookCorpus and English Wikipedia; commonly fine-tuned for classification, token labeling, and question answering.
Curated English Wikipedia text prepared for language-model training and evaluation, provided in WikiText-2 and WikiText-103 variants. Preserves original case, punctuation and numbers; offers raw and tokenized splits for long-range language modeling under a CC BY‑SA license.
Provides 115M public GitHub source files (≈873GB of code, ~1TB uncompressed) with per-file metadata (repo, path, language, license). Supports streaming, language/license filtering and full download for training and evaluating code LLMs and code generation models.
Provides cleaned, per-language snapshots of Wikipedia articles (id, url, title, text) packaged as Hugging Face dataset configs (Parquet). Covers 300+ language configs and dated dumps — useful for language modeling, multilingual NLP, retrieval, and RAG pipelines.
Contains 73 images used in Hugging Face library documentation, packaged in Parquet and imagefolder formats for examples, demos, and small-scale image experiments; distributed under CC BY‑NC‑SA 4.0.
Encodes sentences and short paragraphs into 384-dimensional semantic vectors for retrieval, clustering, and similarity tasks. Fine-tuned from MiniLM-L6-H384 on ~1.17B sentence pairs with a contrastive objective; defaults to 256 word-piece truncation.
Autoregressive transformer that generates English text from a prompt and can be fine-tuned for downstream NLP tasks. This is the 124M-parameter GPT-2 checkpoint (causal LM, byte-level BPE, 1024-token context) hosted on Hugging Face.
A compact pretrained bidirectional Transformer distilled from BERT base for masked language modeling and downstream NLP fine-tuning. Trained via knowledge distillation on BookCorpus and English Wikipedia, it reduces size/latency (≈67M params) while preserving BERT-like representations.