What should happen when an AI provider hits a rate limit? How do you switch providers without breaking the developer’s workflow? These are the kinds of problems you’ll work on at Cheaper Inference.
We’re hiring a hands-on software engineer to help lead development of OmniRoute, our open-source AI gateway. OmniRoute gives developers one API endpoint for multiple AI providers and lets them route requests based on cost, availability, and performance. You’ll write code, help shape technical decisions, and own improvements from design through release.
OmniRoute website: https://www.omniroute.online/
GitHub: https://github.com/cheaper-inference/OmniRoute
What you’ll do
- Build and maintain AI provider integrations and improve request routing, automatic fallback, and streaming reliability.
- Lead features from design through release, weighing technical trade-offs and following up on user feedback.
- Investigate provider failures and regressions, then improve the tests, logging, and documentation that make them easier to catch and diagnose.
- Review pull requests, triage issues, and discuss technical decisions with English- and Portuguese-speaking contributors.
What you’ll bring
- At least 2 years of professional software engineering experience.
• Fluency in spoken Portuguese and English, with the ability to discuss designs, explain trade-offs, and troubleshoot in both languages.
- Experience building and debugging backend services or API integrations.
- The ability to take ownership of a feature, write maintainable code and tests, and communicate clearly in code reviews.
Experience with TypeScript and Node.js, open-source collaboration, or AI provider APIs is a plus.
How to apply
Send us your résumé and a short note about a feature or integration you owned. Tell us what you built, one technical trade-off you made, and what happened after it shipped. Links to public work are welcome.
Base salary
- CAD $105,000–$130,000 per year, depending on relevant experience.