LiteLLM Seeks Founding Backend Engineer to Scale Open-Source LLM Gateway Platform
By
detente18
The kind of bagel that ruins lesser bagels for you.
Summary
LiteLLM, an open-source LLM Gateway with 27K+ GitHub stars and backing from Y Combinator, is seeking a founding backend engineer to help scale their platform. The company provides a Python SDK and FastAPI server that standardizes API calls to 100+ LLM providers using OpenAI's format. The role involves transforming API requests, migrating systems for higher throughput, handling provider-specific quirks, and scaling infrastructure for enterprise features like monitoring and authentication.
Key quotes
· 4 pulledLiteLLM is an open-source LLM Gateway with 27K+ stars on GitHub and trusted by companies like NASA, Rocket Money, Samsara, Lemonade, and Adobe
LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs in the OpenAI format
Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics and need to give LLM access to a large number of people with SSO or JWT
Your main responsibility will be to make sure that LiteLLM unifies the format for calling LLM APIs in the OpenAI spec
You might also wanna read
RunLLM: AI Support Engineer for Resolving Complex Issues
RunLLM is an AI Support Engineer designed to resolve complex support issues by reading logs, code, and documentation, significantly reducing
Product Hunt·10mo ago
OpenLIT Launches Open-Source Observability Platform with Custom Dashboards for LLM Applications
OpenLIT is an open-source observability and analytics platform for LLM applications that has launched a new version featuring fully customiz
Product Hunt·9mo ago