Processed, multilingual news corpus of 1.357B articles extracted from Common Crawl CC‑News with per-article WARC provenance. Includes trafilatura-extracted bodies, language labels (GlotLID & CommonLingua), IPTC topic tags, monthly Parquet shards and a companion FM-index for sub-10ms substring queries; bulk text access is gated for academic research.
Provides L3 refined synthetic training data by converting high-quality web corpora into Q&A pairs and multi-style rewrites; supplies 400B+ English and 200B+ Chinese tokens for late-stage LLM pretraining and decay-phase training.
Provides 1.06M web interaction trajectories (state, action, next_state) represented primarily as A11y trees for training browser world models and web agents. Covers diverse real‑web domains, English/Chinese pages, and long contexts (up to 30K tokens); residual PII and dynamic content may limit reproducibility.
Converts scene intent into production-ready Seedance 2.0 prompts, reference-role mappings, and IP-safe rewrites for multimodal (text/image/audio/video) video generation. Ships as a modular agent-skill OS with multilingual examples, troubleshooting tools, and pro filmmaker handoff artifacts.
An instruction‑tuned Gemma 4 E4B multimodal model on Hugging Face that accepts text, images and audio and generates text; notable for 128K long context support, built-in thinking mode, and an on‑device‑friendly E4B architecture under an Apache‑2.0 license.
Measures multiline text layout and block height without triggering browser reflow: it measures text segments once via Canvas+Intl.Segmenter and caches widths, then computes line breaks with pure arithmetic. Useful for streaming AI text, virtualization, and custom per-line rendering.
Multi-agent workbench for long- and short-form fiction, scriptwriting, interactive narrative games and multilingual translation. Offers Studio/CLI/TUI tools that plan, draft, audit and revise chapters while maintaining structured story state, branching forecasts, cover generation and multi-model routing. Suited for authors and teams automating long-horizon narrative workflows.
Provides 3,000+ hours (≈611K utterances) of transcribed 16 kHz multi-dialect Arabic speech across 13 dialects for ASR and spoken-dialect identification. Transcripts preserve dialectal orthography (partial diacritics); the train split is ~337 GB in parquet, so streaming is recommended.
Converts text to natural-sounding speech across 600+ languages in a zero-shot way, with short-reference voice cloning and fine-grained voice-design controls; uses a diffusion language-model-style architecture to balance quality and very low inference latency.
A dense 128B multimodal model with a 256k context window, configurable reasoning effort, and native function-calling for agentic workflows. Supports text+image input, multilingual output, and is released on Hugging Face under a Modified MIT license with revenue-based exceptions.
An 8B-parameter, instruction-tuned long-context LLM optimized for instruction following, tool-calling, and multilingual dialogue — supports 131072-token context and common NLP tasks such as summarization, QA, code, and RAG.
A 30B-parameter, instruction-tuned language model built for long-context text generation, conversational agents, and tool-calling. It combines supervised fine-tuning and RL alignment, supports 131,072-token context, and is optimized for tasks like summarization, code, and RAG.