AI Model2023
Pretrained multilingual speech encoder for ASR and related speech tasks (300M parameters), trained with wav2vec2-style self-supervision on ~500k hours across 1,400+ languages. Designed for 16 kHz audio and typically fine-tuned for downstream ASR/translation/classification.
AI Model2023
Provides code and pretrained models for WeatherNext 2 and WeatherNext Cyclones — ML-based global, medium-range atmospheric forecasting models from Google DeepMind/Google Research. Includes Colab demos, pretrained weights, and guides for cloud access and inference.
AI Model2023
Multilingual automatic speech recognition and speech-translation model that transcribes and translates audio. Trained on a mix of weakly labeled and pseudo-labeled data (1M + 4M hours), uses 128 Mel bins and adds a Cantonese token, and supports timestamps and long-form chunking for offline ASR and translation.
AI Audio2023
Performs speaker diarization (who spoke when) with pyannote-audio: combines voice-activity detection, speaker-change and overlapped-speech detection to produce time-stamped speaker segments; compatible with Hugging Face Endpoints and ASR pipelines.
AI Model2023
Estimates and tracks 6D poses of novel objects without per-object fine-tuning — supports both model-based (CAD) and model-free (few reference images) setups. Trained on large-scale synthetic data with a transformer-based architecture and contrastive learning; CVPR 2024 highlight with demos and pretrained weights.
AI Model2024
Performs document OCR, layout analysis, reading-order detection and table recognition across 90+ languages using a ~650M-parameter vision–language model; offers per-page and per-block modes and supports GPU (vllm) and CPU/Apple Silicon backends.
AI Model2024
Pocket-sized multimodal LLM for efficient image- and video-understanding on mobile and edge devices, featuring mixed 4x/16x visual-token compression (MiniCPM‑V 4.6), compact 1.3B variants, and ready guides for iOS/Android/HarmonyOS deployment.
AI Model2024
Provides code, pretrained weights, and tooling for protein language models and structure prediction — including ESMC, ESMFold2, sparse autoencoders (SAEs), and the ESM Atlas. Includes model checkpoints, tutorials, Hugging Face & Biohub integration, and an MIT license.
AI Model2024
A research codebase and model family for vision–language models that experiments with data‑centric post‑training strategies and long‑context multimodal reasoning. Includes model reports, released research weights (non‑commercial), grounding tools (LocateAnything) and integrations for inference/optimization.
AI Model2024
An instruction-tuned 8B Llama 3.1 model for multilingual conversational text generation, built for assistant-style chat and long-context inputs (up to 128k tokens). Available for use via the Transformers pipeline and inference endpoints, with common optimizations like safetensors.
AI Model2024
Generates images from text prompts using a 12-billion-parameter rectified-flow transformer trained with guidance distillation for more efficient sampling. Distributed with diffusers/ComfyUI support and multiple conditioning/editing variants; weights released under a non-commercial license.
AI Model2024
High-resolution image and video generation codebase and models that run with far lower compute and memory than typical diffusion systems. Uses linear-attention DiT variants, aggressive latent compression, and inference-scaling to support text-to-image (up to 4K), fast one/few-step generation, and efficient video pipelines.