Rubberduck: A Local LLM Caching Proxy Server for Testing and Development
By
naren87
9mo ago· 4 min readenCode
95/100
Golden Brown
Bagelometer↗
Hot, fresh, and worth queueing round the block for.
Score95Typehow-toSentimentpositive
Summary
Rubberduck is a local LLM caching reverse proxy server that emulates major LLM providers, offering features like caching, failure simulation, rate limiting, and detailed logging. It is designed for testing and development of LLM-powered applications, with a user-friendly web interface and robust security measures.
Key quotes
· 3 pulledRubberduck provides caching, failure simulation, rate limiting, per-user proxy instances, and detailed logging for testing and development of LLM-powered applications.
A local LLM caching reverse proxy server designed to emulate major LLM providers with advanced testing capabilities.
Rubberduck offers a beautiful web interface, authentication, and security features for seamless integration.
LLM caching proxy server that emulates popular LLMs with the ability to simulate failures - Zipstack/rubberduck
You might also wanna read
ReliAPI: Specialized API Proxy for LLM Services with Cost-Saving Features
ReliAPI is a specialized API proxy service designed specifically for LLM APIs (OpenAI, Anthropic, Mistral) and HTTP APIs. It offers cost-sav
Product Hunt·5mo ago
LLMTest: Automated LLM Model Selection and Fallback Tool for Developers
LLMTest is a tool created by maker Tom to help developers and "vibe coders" automatically select the best LLM models for AI-powered features
Product Hunt·9d ago