AI Dataset2024
Provides pre-parsed Parquet snapshots of English and French Wikipedia articles with structured fields (sections, infoboxes, tables, references, images) and credibility signals — optimized for large-scale analysis, retrieval-augmented generation, and model development.
AI Audio2024
Provides low‑latency on‑device speech-to-text, intent recognition, and text-to-speech for building real‑time voice agents and interfaces. Streaming-optimized models, incremental caching, multilingual TTS/ASR and cross-platform bindings (Python, iOS, Android, Linux, Raspberry Pi) target live voice use cases where sub-200ms responsiveness matters.
AI Audio2025
Zero-shot, single‑reference voice cloning TTS with multilingual support (ZH/EN/JA/ES/AR), fine-grained emotion and duration control, and pronunciation hooks (Pinyin/CMU/Kana); ships model weights, Web UI and production deployment recipes for local or server use.
AI Audio2025
Provides real-time, local audio recording and transcription on macOS using Whisper and Parakeet engines, with global hotkeys and hold-to-record behavior. Includes model download, microphone selection, drag-and-drop file transcription, multilingual auto-detection and Asian-language autocorrect; Apple Silicon only.
AI Dataset2025
Provides professionally translated parallel corpora and a multilingual lexicon across 100+ low-resource languages for training and evaluating multilingual MT and NLP models. Includes SmolDoc, SmolSent, GATITOS, and factuality annotations; licensed CC-BY-4.0.
AI Dataset2025
High-quality, efficiently verified and filtered web corpus for LLM pretraining — supplies ~1 trillion English tokens and ~120 billion Chinese tokens with English/Chinese Parquet splits. Designed for large-scale pretraining experiments and data-filtering research.
AI Client2025
Turns web reading into an in-context language-learning experience by injecting context-aware translations, explanations, subtitle translation, and TTS directly into the browser. Supports selection translation, batch requests and configurable AI providers to balance cost and quality.
AI Dataset2025
Provides MS MARCO queries, passages and answers translated into 14 Indic languages while keeping the original English content and per-example translation metadata. Includes train/validation splits, passage selection flags, and translation model parameters for multilingual IR, QA and RAG research.
AI Audio2025
Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
AI Dataset2025
Yuhang Dai, Ziyu Zhang +14Audio, Speech and Language Processing Group (ASLP@NPU), Northwestern Polytechnical University, Beijing AISHELL Technology Co., Ltd. +3
Provides a 10,000-hour Sichuanese (Chuan-Yu) speech corpus with rich annotations (timestamps, speaker age/gender/emotion, SNR, DNSMOS) and unified metadata for ASR and TTS research; includes metadata.jsonl, evaluation benchmarks, and an LLM-assisted transcription pipeline.
AI Dataset2025
Provides a reproducible, deduplicated corpus of text extracted from PDFs for LLM pretraining—about 3 trillion tokens from ~475 million documents in 1733 language-script pairs. Includes OCR and text extraction pipelines, per-page language IDs, MinHash deduplication, and is released under ODC‑By 1.0.