Software Engineer - AI Gateway Team - Remote

Overview

As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more, empowering companies and developers around the world to govern every step of their AI & LLM based innovation.

In Short

• Responsible for building and maintaining API management software for AI and LLMs.
• Implement innovative features including proxying capabilities and load balancing.
• Troubleshoot bugs and optimize performance.
• Fill gaps between Kong and third-party deployment platforms.
• Collaborate with a remotely distributed team.

Requirements

• 3+ years of programming in server-side applications.
• Experience in building scalable and distributed applications.
• Technical expertise in Linux systems troubleshooting.
• Knowledge of distributed systems and Linux networking stack.
• Strong communication skills and ownership mindset.
• Familiarity with AI LLM concepts and applications development.
• Hands-on experience with Rust.

Benefits

• Opportunity to work on cutting-edge technology in AI.
• Collaborative and innovative work environment.
• Work with a diverse team of professionals.
• Flexible work arrangements.