AIAny
Icon for item

Thinking with Visual Primitives

Provides the dataset and accompanying technical report for a DeepSeek project that interleaves spatial markers (points and boxes) into multimodal LLM reasoning. Includes a public subset of data and benchmarks under an MIT license; model weights are not included.

Introduction

Why this matters — modern multimodal LLMs often fail on dense spatial and structural reasoning because natural language alone can't unambiguously reference complex layouts. This release bundles the technical report and a public subset of data used to test a "point-to-reason" paradigm where minimal visual primitives (points and bounding boxes) are interleaved into the model's reasoning trajectory to reduce the Reference Gap.

What Sets It Apart
  • Point-as-thought: Visual primitives are treated as atomic reasoning tokens, so the model can anchor abstract language to precise coordinates rather than relying solely on verbal descriptions — this reduces ambiguous references in tasks like counting, topological navigation, and spatial relation inference.
  • Token efficiency engineering: The work describes compressing visual token caches (KV compression per 4 tokens) so experiments target lower image-token budgets without discarding spatial fidelity — meaning experiments can scale with less compute for image-heavy reasoning.
  • Benchmarks and transparency: The dataset card accompanies a technical report (released 2026-04-30) and a curated public subset used for in-house benchmarks, which helps reproduce key evaluation trends even though full model weights remain private.
Who it's for

Great fit if you are a researcher engineering multimodal reasoning pipelines or building evaluation suites that require precise spatial grounding (e.g., counting, maze/topology tasks, grounded QA). The public subset is useful for benchmarking and method prototyping.

Look elsewhere if your goal is an off-the-shelf foundation model or ready-to-run weights: the release focuses on data, methodology, and a technical report; full model weights and some internal benchmarks are planned but not included in the public release.

Where it fits

This dataset and report sit between purely linguistic reasoning corpora and full vision-model weight releases: it's most valuable when paired with an adaptable multimodal LLM or used to design token-level grounding strategies for spatial reasoning.

Information

  • Websitehuggingface.co
  • AuthorsNodeLinker, DeepSeek AI
  • Published date2026/04/30

Categories

More Items

Hugging Face

A collection of ready-to-run Hugging Face Jobs OCR scripts that add a markdown column (or structured JSON) to image datasets, with model switching, layout detection, server-mode serving, and per-model options for table/form extraction.

Hugging Face

Provides 115M public GitHub source files (≈873GB of code, ~1TB uncompressed) with per-file metadata (repo, path, language, license). Supports streaming, language/license filtering and full download for training and evaluating code LLMs and code generation models.

Hugging Face

Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.