Principal Performance Engineer - Remote

Overview

Writer is seeking a highly skilled and motivated Principal Performance Engineer to lead the performance optimization of our cutting-edge Generative AI technology stack. This role is critical in ensuring the scalability, efficiency, and reliability of our Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) systems. You will be a key driver in identifying and resolving performance bottlenecks, optimizing resource utilization, and ensuring a seamless user experience. You will work closely with our AI research, software engineering, and infrastructure teams to deliver world-class AI solutions.

In Short

• Define and implement performance engineering strategies for Generative AI full stack.
• Lead performance testing, profiling, and analysis efforts.
• Establish and maintain performance benchmarks and SLAs.
• Analyze and improve LLM inference performance.
• Collaborate with AI researchers for LLM model optimization.
• Design and implement performance tests for RAG pipelines.
• Optimize hardware and software configurations for AI workloads.
• Communicate performance findings to stakeholders.
• Stay updated with developments in Generative AI.
• Provide mentorship to performance engineering team members.

Requirements

• Bachelor's degree in Computer Science or related field (Master's preferred).
• 10+ years of experience in performance engineering.
• 2+ years of experience with AI/ML technologies.
• Proven experience in performance testing and analysis.
• Deep understanding of NLP architectures.
• Experience with vector databases and cloud computing.
• Strong programming skills in Python.
• Experience with performance analysis tools.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.

Benefits

• Generous PTO and company holidays.
• Medical, dental, and vision coverage.
• Paid parental leave (12 weeks).
• Fertility and family planning support.
• Flexible spending account options.
• Health savings account with company contribution.
• Annual work-life stipends.
• Company-wide off-sites and team off-sites.
• Competitive compensation and stock options.