AIAny
Icon for item

Go-Code-Large

Provides 316,427 Go source-code samples in JSONL focused on concurrency and backend idioms, enabling fine-tuning and evaluation of code models for completion, summarization, and static-analysis tasks.

Introduction

Go's concurrency model and backend-focused idioms are underrepresented in many broad code corpora, causing models to struggle with goroutine/channel patterns and idiomatic system code. This dataset supplies a large, language-specific corpus—316,427 Go samples in JSONL—designed to improve model behavior on concurrency, systems programming, and backend engineering tasks.

Key Capabilities
  • Focused coverage of concurrency primitives: abundant examples of goroutines, channels, select statements, mutexes, and context-based cancellation so models learn typical usage and anti-patterns.
  • Systems and backend patterns: many samples show HTTP servers, middleware, dependency-injection patterns, worker pools, and efficient I/O, which helps models generate realistic backend code and documentation.
  • Engineering-ready format: JSONL layout and a size (100K–1M samples) that is easy to integrate into ML pipelines for pretraining, fine-tuning, or evaluation at scale.
  • Code intelligence use-cases: suitable for code completion, code-to-text/summarization, bug and vulnerability spotting (race conditions, nil checks), clone detection, and complexity estimation.
Who it's for and tradeoffs

Great fit if you need a large, Go-specific training or evaluation corpus to improve model handling of concurrency and backend idioms, or for research into static analysis and code-quality tools. Look elsewhere if you require fully labeled datasets (e.g., unit tests, vulnerability labels, or provenance metadata) or multi-language corpora—this collection emphasizes raw source snippets over extensive annotations. Also verify license and provenance for your intended downstream use (package-level licensing and dataset curation details may affect commercial use).

Information

Categories

More Items

Hugging Face

A collection of ready-to-run Hugging Face Jobs OCR scripts that add a markdown column (or structured JSON) to image datasets, with model switching, layout detection, server-mode serving, and per-model options for table/form extraction.

Hugging Face

Provides 115M public GitHub source files (≈873GB of code, ~1TB uncompressed) with per-file metadata (repo, path, language, license). Supports streaming, language/license filtering and full download for training and evaluating code LLMs and code generation models.

Hugging Face

Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.