Member of Technical Staff - Model Serving - Remote

Overview

Join Cohere's mission to scale intelligence and serve humanity by building high-performance, scalable, and reliable machine learning systems. As a Member of Technical Staff, you will be part of the Model Serving team responsible for deploying and operating AI platforms that deliver large language models through easy-to-use API endpoints.

In Short

• Build and deploy optimized NLP models to production.
• Work in low latency, high throughput, and high availability environments.
• Interface with customers for customized deployments.
• 5+ years of engineering experience required.
• Experience with Kubernetes and GPU workloads.
• Familiarity with cloud platforms like GCP, Azure, and AWS.
• Strong collaboration and troubleshooting skills needed.
• Experience in Golang, C++, or similar languages.
• Adaptability to solve complex technical challenges.
• Commitment to diversity and inclusion in the workplace.

Requirements

• 5+ years of engineering experience running production infrastructure.
• Experience designing large, highly available distributed systems.
• Experience with Kubernetes dev and production coding.
• Experience in complex Linux-based computing environments.
• Excellent collaboration and troubleshooting skills.
• Familiarity with computational characteristics of accelerators.
• Strong understanding of distributed systems.
• Experience in resource and cost management.
• Grit and adaptability to solve evolving technical challenges.
• Experience in high-performance scalable server languages.

Benefits

• Open and inclusive culture and work environment.
• Work with a cutting-edge AI research team.
• Weekly lunch stipend and in-office snacks.
• Full health and dental benefits.
• 100% Parental Leave top-up for eligible employees.
• Personal enrichment benefits for various activities.
• Remote-flexible work options available.
• 6 weeks of vacation.