Chatbot2019
Consolidates customer conversations from website chat, email, social and messaging channels into a single support inbox with self-hosting and Docker/one-click deployment options. Includes an optional AI agent (Captain) for automated replies, multilingual translation, and integrations.
AI API2020
Provides a self-hosted machine translation HTTP API that runs offline using the open-source Argos Translate engine; offers Docker-based deployment and a simple HTTP interface for integration. Suited for privacy-conscious or offline translation deployments.
A 12-week, 24-lesson beginner-friendly AI curriculum with executable Jupyter notebooks, quizzes and labs that teach neural networks, computer vision, NLP, generative models and ethics using PyTorch and TensorFlow examples.
AI Dataset2022
Provides 115M public GitHub source files (≈873GB of code, ~1TB uncompressed) with per-file metadata (repo, path, language, license). Supports streaming, language/license filtering and full download for training and evaluating code LLMs and code generation models.
AI Dataset2022
Provides cleaned, per-language snapshots of Wikipedia articles (id, url, title, text) packaged as Hugging Face dataset configs (Parquet). Covers 300+ language configs and dated dumps — useful for language modeling, multilingual NLP, retrieval, and RAG pipelines.
AI Audio2022
Multilingual sequence-to-sequence speech model and toolkit for speech recognition, speech-to-text translation, and language identification. Offers several model sizes (tiny → large/turbo) for different speed/accuracy trade-offs and ships with a CLI and Python API for offline transcription workflows.
AI Dataset2023
Contains tech-blog posts scraped from Habr (primarily Russian, some English) in Parquet format with ~100K–1M records. Suited for multilingual text-generation and language-model fine-tuning; license is not specified, so verify before redistribution.
AI Model2023
Multilingual automatic speech recognition and speech-translation model that transcribes and translates audio. Trained on a mix of weakly labeled and pseudo-labeled data (1M + 4M hours), uses 128 Mel bins and adds a Cantonese token, and supports timestamps and long-form chunking for offline ASR and translation.
AI Model2024
Performs document OCR, layout analysis, reading-order detection and table recognition across 90+ languages using a ~650M-parameter vision–language model; offers per-page and per-block modes and supports GPU (vllm) and CPU/Apple Silicon backends.
AI Dataset2024
Provides a multilingual, deduplicated corpus of public source code in Parquet for large-scale model training and evaluation. Includes license metadata, language splits, and streaming-friendly packaging for use with Hugging Face Datasets — suited to training code-focused foundation models but requires careful license/provenance review.
AI Dataset2024
Provides 300k annotated multilingual text examples for identifying and masking personally identifiable information (PII) across multiple domains and languages (EN, FR, DE, IT, ES, NL). Intended for training and evaluating token-level PII detection and masking models; includes a DOI for citation.
AI Dataset2024
Hisami Suzuki, Satoru Katsumata +4LLM-jp (Center for Large Language Model Research and Development, National Institute of Informatics), National Institute of Informatics
Provides manually curated Japanese instruction pairs (questions and safe reference answers) for improving LLM output safety, covering broad harm categories and regionally sensitive cases. Includes English meta-tags and standard splits for benchmarking and fine-tuning.