Infrastructure Software Engineer - Remote

Overview

Join our dynamic team at Baseten, where we’re revolutionizing AI deployment with cutting-edge inference infrastructure. As an Infrastructure Software Engineer, you'll build and maintain components of our ML inference platform that powers production AI applications.

In Short

• Develop infrastructure components for our ML inference platform using Python and Go
• Implement and maintain Kubernetes deployments for model serving
• Contribute to our inference orchestration layer for model deployments
• Build and enhance monitoring systems for model performance metrics
• Implement efficient resource management solutions for ML workloads
• Support infrastructure automation to improve ML deployment workflows
• Work closely with team members to implement technical solutions
• Help balance performance optimization with system reliability
• Participate in technical discussions around infrastructure improvements
• Learn and apply infrastructure best practices

Requirements

• Bachelor's degree or higher in Computer Science or related field
• 1-3 years experience in software engineering or infrastructure
• Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
• Working knowledge of Kubernetes and containerization
• Basic understanding of machine learning concepts and model serving
• Familiarity with distributed systems concepts
• Experience with basic monitoring and logging tools
• Interest in ML/AI infrastructure and willingness to learn
• Strong collaboration and communication skills

Benefits

• Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums, remote-first culture).
• A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
• An inclusive and supportive work culture that fosters learning and growth.
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.