Software Engineer - Data Management Solutions - Remote

Overview

We are seeking a Software Engineer highly skilled in implementing and maintaining linux and cloud-based data management solutions at petabyte scale. In this role you will be responsible for working closely with engineers to drive the technical road map of AWS-native data ingestion, ETL, and storage solutions that power data driven analytics, simulation, and ML training across the enterprise.

In Short

• Create robust and resilient pipelines to process massive daily volumes of data created by vehicle fleets
• Scale Torc’s data lake through a distributed storage system, data crawling and discovery
• Promote and protect the integrity of data through validation, versioning, and data provenance
• Support the expansion of Torc’s data lake through acquisition of additional data sets from internal and external sources
• Govern data access throughout the data lake at table, column, and row levels
• Assist in architecture and development of cloud-based solutions for all aspects of software build, test and deploy processes.
• Collaborate with teams specializing in perception, planning, control, mapping and vehicle testing to develop solutions that support their development efforts.
• Support the implementation of emerging cloud-based capabilities that can extend our technology stack and improve our ability to build, deploy and test safety-critical software for self-driving vehicles.

Requirements

• BS/MS Degree in Computer Engineering, Computer Science, or related field
• Experience building and maintaining workloads in public cloud environments
• Knowledge of different database architectures, including but not limited to relational and NoSQL databases, data warehousing and clustered, distributed data stores
• Practical experience with Linux and general bash scripting
• Implementation of workflow patterns using directed acyclic graphs (Apache Airflow, AWS Step Functions)
• A strong commitment to test-driven development patterns, continuous integration and delivery, and infrastructure as code

Benefits

• Full coverage of monthly medical premiums for full-time employees
• Medical/dental/vision/ AD+D and Life Insurance
• 401K plan with employer matching
• Annual learning and development stipend
• Leadership development training
• Collaborative, energetic, and team-focused work environment
• Flexibility in schedule and generous paid vacation