Principal Engineer, Team Lead - Data Platform - Remote

Overview

We are seeking a talented Principal Engineer to lead a team by building, improving, and maintaining robust large scale data processing and transformation pipelines. The team is responsible for building scalable pipelines to perform extraction of information from AV (autonomous vehicle) logs, transformation of data into different formats that can be consumed by downstream services, and for building interfaces to enable easy access to the data. We deal with data on the petabyte scale and provide critical functions to improve the development of a reliable AV. This is a hands-on role with people management responsibilities.

In Short

• Lead and provide mentorship to a team of engineers both technically and professionally
• Manage and drive team timelines, project commitments, and roadmap deliverables
• Work closely with users, leadership, and stakeholders to align and coordinate product design, project execution, and operational usage in setting and achieving objectives and key results.
• Design, build, and maintain scalable data processing and access with cloud ETL technology.
• Implement interfaces to enable self service data pipelines
• Write high quality, maintainable code to process terabytes of data
• Lead and champion high-level system design and quality code reviews/technical contributions.
• Ability to take a strong sense of ownership and responsibility for mentoring engineers

Requirements

• 5+ years of professional experience as a data engineer or data pipeline engineer
• BS or MS in Computer Science or related field
• Expertise with Python programming
• Expertise with AWS services and solutions (EKS, Lambda, ETL)
• Experience with distributed system design and development
• Experience leading projects from end to end, designing and delivering and production stages
• Strong written and oral communication skills
• Comfortable working in a fast-paced, continuous delivery environment

Benefits

• Medical, dental, and vision insurance
• 401k with a company match
• Health saving accounts
• Life insurance
• Pet insurance
• Bonus or company equity