AIAny
AI API2025
Icon for item

GLiNER2

Runs named-entity recognition, text classification, structured-JSON parsing and relation extraction from one 205M-parameter encoder in a single CPU forward pass, using schemas with per-field regex validators. A larger 1B model is available via API.

Introduction

Most teams reach for a large LLM the moment they need structured extraction, then pay per token for every document that flows through. GLiNER2 makes the opposite bet: a 205M-parameter encoder that pulls entities, class labels, nested JSON, and relations out of text in one CPU forward pass, shaped by a schema you declare at call time rather than a prompt you keep tuning.

What Sets It Apart
  • Four extraction jobs, one pass: NER, single- and multi-label classification, structured JSON, and relation extraction share the same model and schema syntax, so you stop stitching together spaCy, regex, and an LLM.
  • CPU is the target, not a fallback: the 205M base (and a 340M large) run fast on standard hardware with optional fp16 and torch.compile, keeping data local and inference close to free.
  • Schemas, not prompts: fields carry types, descriptions, and regex validators, so outputs are constrained and checkable instead of hoping a generative model returns valid JSON.
  • A ceiling when you need it: a 1B GLiNER XL model is reachable through the Pioneer cloud API for harder cases without rewriting your code.
Great Fit If

Great fit if you run high-volume extraction where per-call LLM cost and latency add up, or where documents can't leave your machines — support tickets, resumes, logs, PII redaction. Look elsewhere if your task needs open-ended reasoning or generation: GLiNER2 extracts and classifies against schemas you define, it does not write summaries or answer free-form questions.

Information

  • Websitegithub.com
  • OrganizationsFastino
  • Authorsfastino-ai
  • Published date2025/07/07

Categories

More Items

GitHub
AI API2025

Gateway that pools multiple AI subscription accounts and issues platform API keys while handling authentication, token-level billing, load balancing, rate limits, and per-user/account concurrency—enables shared subscriptions for Claude, OpenAI, Gemini and Grok.

GitHub
AI API2026

Exposes a ChatGPT account as an OpenAI-compatible local API and SDK set, enabling chat, streaming, and image-generation calls via a dev proxy or "Sign in with ChatGPT". Includes a CLI and TypeScript/React adapters; unofficial and uses user ChatGPT credentials.

GitHub
AI API2020

Provides a self-hosted machine translation HTTP API that runs offline using the open-source Argos Translate engine; offers Docker-based deployment and a simple HTTP interface for integration. Suited for privacy-conscious or offline translation deployments.