Provides a portable C++ inference runtime to deploy embodied AI models (vision–language–action and world–action) on heterogeneous robot hardware, enabling latency-first batch-1 closed-loop control. Key features include modular multi-rate layers, fused low-latency inference, and extensible head/IO plugins.
Proposes SkillOpt-Lite, a minimal pipeline for optimizing LLM agent skills by treating rollout traces as filesystem files and applying trajectory exploration, consensus mining, and independent validation; integrates as a one-line VSCode Copilot command and reports cross-benchmark improvements that let smaller models sometimes outperform larger ones.
Decides whether a user prompt should be executed locally on an edge small LLM or routed to a larger cloud model, emitting a deterministic pipe-separated decision string. A 51.7M micro-LLM fine-tuned with multi-task sequence generation to predict domain, complexity and code/math flags, optimized for ultra-low latency edge routing.
Deployment-optimized hybrid MoE LLM (75B total / 9.3B active) produced via Iterative Puzzle compression and Multi-Token Prediction to double server throughput and raise single-GPU concurrency; designed for multilingual reasoning, long-context generation, and high-volume agentic/chat deployments.
Self-hosted, multi-user, multi-agent AI assistant with a web dashboard, CLI, IM channel integrations, cron automation, RAG knowledge bases, and ACP IDE delegation. Runs as a single-process local-first service with pluggable workspace backends and plugin extensibility.
Provides low-bit quantized Hy3 (hy_v3) GGUF model weights and mixed-precision quantization recipes for running Hy3 on llama.cpp, with optional MTP self-speculative decoding and imatrix-based calibration for improved quality/speed trade-offs.
Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.
Provides intermediate pretraining checkpoints for the Aether-7B-5Attn base model to enable reproducible training-dynamics research. Includes three raw checkpoints (110k, 115k, 162k steps) packaged with model.safetensors, config, and tokenizer; uses a custom aether_v2_7way architecture requiring the aether_pkg loader.
A PyTorch-native training framework for agentic reinforcement learning research that keeps researcher-facing code compact and editable. Uses an asynchronous loop to train multimodal and mixture-of-experts policies while never training on tokens the agent didn't generate; matches Megatron-style stacks under a comparable protocol and ships recipes and containers on GitHub.
Performs full-parameter post-training of trillion-parameter MoE DeepSeek-V4 models on an Ascend NPU SuperPOD, using a hierarchical optimization of model parallelism, communication orchestration, and kernel execution to increase Model FLOPs Utilization. Also builds CPT/SFT pipelines with solver-verified synthetic data for Operations Research, reporting strong zero-shot Pass@1 results.
A 124B hybrid-linear Mixture-of-Experts language model optimized for instruction following, long-context reasoning and agentic workflows, activating ~5.1B parameters per token. Key features include a 256K native context (extendable to 1M), alternating KDA/MLA attention layers, and vLLM/SGLang inference support.
A pretrain-then-transfer method for streaming recommendation that decouples refreshable behavioral knowledge from task-specific geometry to enable continual model refresh without downstream interference; introduces Behavioral Multi-Token Prediction and Anchored Calibration Residual and shows 4–12% offline gains plus live Shopee A/B lifts.