Software Engineer - Engineering Data Infrastructure - Remote

Overview

In this role, you’ll be responsible for the software, databases, and pipelines by which we collect, combine, manage, and transform the engineering and synthetic data that is used at training- and run-time by Archie.

In Short

• Implement and run the software system for collecting, combining, transforming, and managing our engineering and synthetic data.
• Work with our data curator, data collection/creation team, industry experts, and AI team to design and implement critical capabilities.
• Create and integrate UI tools for our data collection team.
• Ensure high quality and traceability in our datasets.

Requirements

• Python programming and the structuring of complex modules.
• Data infrastructure configuration and management for complex and high-quality data.
• Experience with multiple types of data storage systems (e.g.: SQL, document, object).
• Experience with data processing orchestration platforms (e.g.: Dagster, Prefect).
• Use of AI/ML as part of automation for collecting, fusing, and assessing quality of complex data.
• Creating utility UIs for data collectors.
• Modern software development tools and practices (Git, CI/CD, etc.).
• Ability to thrive in a fast-paced, dynamic startup environment.

Benefits

• Work remotely from anywhere in the US or Canada.
• Opportunity to work with top minds in AI and engineering.
• Potential for relocation to the San Francisco office.