AIAny
AI API2025
Icon for item

GLiNER2

Runs named-entity recognition, text classification, structured-JSON parsing and relation extraction from one 205M-parameter encoder in a single CPU forward pass, using schemas with per-field regex validators. A larger 1B model is available via API.

Introduction

Most teams reach for a large LLM the moment they need structured extraction, then pay per token for every document that flows through. GLiNER2 makes the opposite bet: a 205M-parameter encoder that pulls entities, class labels, nested JSON, and relations out of text in one CPU forward pass, shaped by a schema you declare at call time rather than a prompt you keep tuning.

What Sets It Apart
  • Four extraction jobs, one pass: NER, single- and multi-label classification, structured JSON, and relation extraction share the same model and schema syntax, so you stop stitching together spaCy, regex, and an LLM.
  • CPU is the target, not a fallback: the 205M base (and a 340M large) run fast on standard hardware with optional fp16 and torch.compile, keeping data local and inference close to free.
  • Schemas, not prompts: fields carry types, descriptions, and regex validators, so outputs are constrained and checkable instead of hoping a generative model returns valid JSON.
  • A ceiling when you need it: a 1B GLiNER XL model is reachable through the Pioneer cloud API for harder cases without rewriting your code.
Great Fit If

Great fit if you run high-volume extraction where per-call LLM cost and latency add up, or where documents can't leave your machines — support tickets, resumes, logs, PII redaction. Look elsewhere if your task needs open-ended reasoning or generation: GLiNER2 extracts and classifies against schemas you define, it does not write summaries or answer free-form questions.

Information

  • Websitegithub.com
  • OrganizationsFastino
  • Authorsfastino-ai
  • Published date2025/07/07

Categories

More Items

GitHub

Runs a self-hosted meeting bot and transcription API that joins Google Meet, Teams and Zoom and streams speaker-attributed transcripts in real time. Compiles meetings into a git-backed Markdown workspace and runs sandboxed agents on your infrastructure; Apache-2.0 and air-gap capable.

GitHub
AI API2020

Typed Python client for the OpenAI REST API that offers synchronous and asynchronous clients, typed request/response models, streaming and Realtime support, webhook verification, and integrations for Azure and Amazon Bedrock—built for production integrations and automation.

GitHub

Exposes a self-hosted WhatsApp HTTP/REST API that runs a real WhatsApp Web instance so apps and AI agents can read/send messages, manage contacts, and automate flows. Offers three engine modes (WEBJS, NOWEB, GOWS), Docker images, and MCP support; relies on WhatsApp Web so blocking risk exists.