Generates complete UI, poster and infographic layouts from text prompts, rendering legible in-image text and producing native RGBA output with transparent backgrounds. Suited for text-rich visual design workflows and pairs with a companion model that decomposes designs into editable layers.
Performs speaker diarization (who spoke when) for live and recorded audio using an open-weight, 100M-parameter streaming-capable model that supports up to eight anonymous speaker channels, overlapping speech, chunked processing, and configurable latency for ASR integration.
Evaluates whether AI agents can autonomously carry out and honestly report follow-up scientific research by giving each agent a published paper plus a scientist-defined follow-up task and rubrics; measures integrity, completeness, and sufficiency across 15 open research tasks.
Benchmark for evaluating agents' ability to deliver working AI systems in realistic customer environments: 95 end-to-end delivery tasks with scripted stakeholders and production-like systems, scored by improvement to the customer's business metric and penalized for stakeholder contact.
Evaluates language models that generate 3D objects from text by comparing their outputs in human preference tests. Scores cover creativity, coherence, prompt alignment, and visual preference.