Developer Builds Open-Source AI Proxy Gateway With Sub-15ms Failover for LLM Outages
A developer has built Selixes, an open-source edge proxy gateway designed to prevent AI agent crashes caused by LLM provider outages, rate limits, and latency spikes. The tool sits between an…
Read the full articleYou might also wanna read
NGINX for AI API Serving: Configuration and Best Practices
Configure NGINX for AI applications. Learn reverse proxy patterns, load balancing, SSL termination, and performance optimization for LLM inf
LiteLLM Seeks First Reliability Engineer for AI Gateway Infrastructure
TLDR LiteLLM is an open-source AI gateway (36K+ GitHub stars) that routes hundreds of millions of LLM API calls daily for companies like NAS
ycombinator.com·4mo ago
FreeLLMAPI: OpenAI-Compatible Proxy Aggregating Free-Tier AI Provider Keys for Personal Experimentation
OpenAI-compatible proxy that aggregates free-tier keys from ~14 AI providers with automatic failover. For personal experimentation only. - t
Product Hunt·2mo ago
LLM Gateway: Unified API for Accessing Multiple AI Models
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Product Hunt·1y ago
AI Gateway - Automatically retry on upstream provider failures on AI Gateway
AI Gateway now supports automatic retries at the gateway level. When an upstream provider returns an error, your gateway retries the request
ArchGW: Intelligent Edge and Service Proxy for Agents
Hey HN!
news.ycombinator.com·1y ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.