Data Engineer - Remote

Overview

This role is responsible for building and maintaining the data infrastructure. They ensure data from various sources is efficiently collected, processed, and stored, taking ownership of smaller projects and collaborating with senior engineers on larger initiatives.

In Short

• Design, build, and maintain efficient data pipelines (ETL/ELT processes) using Apache Spark on AWS EMR.
• Build and optimize batch and near real-time data processing jobs on Spark.
• Write and refine complex SQL queries and use Python for data processing.
• Implement data quality measures to ensure data integrity.
• Develop and optimize data warehouse schemas and tables.
• Collaborate with data analysts and data scientists for data requirements.
• Document pipeline designs and data flows.
• Handle multiple tasks or projects simultaneously.

Requirements

• Bachelor’s or Master’s degree in a relevant field.
• At least 3 years of experience in a data engineering role.
• Strong SQL skills and experience with data modeling.
• Proficiency in Python for data processing.
• Familiarity with ETL tools and workflow orchestration frameworks.
• Experience implementing data quality checks.
• Good problem-solving abilities and strong communication skills.

Benefits

• Stock grant opportunities based on role and location.
• Additional perks and benefits based on employment status.
• Flexibility of remote work, including optional WeWork access.