Elixir-native autonomous agent framework that models state changes as pure cmd/2 operations and describes side effects with typed directives; integrates with OTP supervision and optional LLM plugins for AI-driven agents.
Simulates a trading firm using LLM agents in specialized roles — fundamentals, sentiment, news and technical analysts feed bull/bear researcher debates, then a trader and risk team decide. Works across US, global and crypto markets and 10+ LLM providers.
Bundles a dataset, an interaction harness, and rubric-based reward functions into one RL environment for training and evaluating LLMs — also usable as an eval, synthetic-data pipeline, or agent harness for any OpenAI-compatible endpoint.
Runs stateful AI agents as Cloudflare Durable Objects — each keeps its own storage and lifecycle, hibernating when idle and waking on demand. Adds WebSocket state sync, type-safe RPC, resumable LLM streaming, MCP roles, and durable workflows.
Hands-on studio to design, test and deploy declaratively configured multi-agent systems built on the Neuro SAN framework. Ships ready examples, an Agent Network Designer UI (nsflow), CLI tooling, and integrations with major LLMs and external tools for rapid prototyping.
High-performance CUDA tensor-core GEMM kernel library for LLM workloads: supports FP8/FP4/BF16, fused Mega MoE and MQA scoring, and runtime JIT-compiled kernels. Targets NVIDIA SM90/SM100 and PyTorch—for teams working on low-level GPU kernel optimization.
Provides high-throughput, low-latency GPU communication kernels for Mixture-of-Experts (MoE) and expert-parallel workloads, with NVLink↔RDMA-aware forwarding, FP8/BF16 support, and low-latency RDMA hooks for inference decoding.
Keeps codebases, PDFs, Slack, and docs continuously indexed for RAG and knowledge graphs by recomputing only what changed, not the whole dataset. You declare target state in Python; a Rust engine maintains it with per-row lineage back to the source.
Framework-agnostic library for connecting and optimizing teams of AI agents built in LangChain, LlamaIndex, CrewAI, Semantic Kernel, or Google ADK. Profiles them down to individual tokens, traces execution, and runs built-in evaluation.
Runs and fine-tunes LLMs locally on Apple silicon via the MLX framework, pulling thousands of Hugging Face models with one command. Adds 4- and 8-bit quantization, LoRA and full fine-tuning, prompt caching, and distributed inference across Macs.