AIAny
AI API2025
GitHub

GLiNER2

Runs named-entity recognition, text classification, structured-JSON parsing and relation extraction from one 205M-parameter encoder in a single CPU forward pass, using schemas with per-field regex validators. A larger 1B model is available via API.

Introduction

Most teams reach for a large LLM the moment they need structured extraction, then pay per token for every document that flows through. GLiNER2 makes the opposite bet: a 205M-parameter encoder that pulls entities, class labels, nested JSON, and relations out of text in one CPU forward pass, shaped by a schema you declare at call time rather than a prompt you keep tuning.

What Sets It Apart
  • Four extraction jobs, one pass: NER, single- and multi-label classification, structured JSON, and relation extraction share the same model and schema syntax, so you stop stitching together spaCy, regex, and an LLM.
  • CPU is the target, not a fallback: the 205M base (and a 340M large) run fast on standard hardware with optional fp16 and torch.compile, keeping data local and inference close to free.
  • Schemas, not prompts: fields carry types, descriptions, and regex validators, so outputs are constrained and checkable instead of hoping a generative model returns valid JSON.
  • A ceiling when you need it: a 1B GLiNER XL model is reachable through the Pioneer cloud API for harder cases without rewriting your code.
Great Fit If

Great fit if you run high-volume extraction where per-call LLM cost and latency add up, or where documents can't leave your machines — support tickets, resumes, logs, PII redaction. Look elsewhere if your task needs open-ended reasoning or generation: GLiNER2 extracts and classifies against schemas you define, it does not write summaries or answer free-form questions.

Information

  • Websitegithub.com
  • OrganizationsFastino
  • Authorsfastino-ai
  • Published date2025/07/07

Categories

More Items

GitHub
AI Infra2026

Provides a unified tool catalog and proxy for AI agents: one team token lets agents call thousands of third-party endpoints (and your team’s keys) with per-call pricing. Injects credentials server‑side so agents never hold provider secrets, and exposes CLI/skill recipes and OAuth tools for team-wide use.

GitHub
AI API2026

Captures an app's network traffic, extracts its authentication/session bundle, and auto-generates an editable Python client to call the app's API. Supports mitmproxy, cURL and HAR capture backends and provides Session helpers for replay and token refresh.

GitHub
AI API2025

Gateway that pools multiple AI subscription accounts and issues platform API keys while handling authentication, token-level billing, load balancing, rate limits, and per-user/account concurrency—enables shared subscriptions for Claude, OpenAI, Gemini and Grok.