Senior Data Engineer - Remote

Overview

As a Senior Data Engineer, you’ll design and maintain high-performance data pipelines, automate processes, and implement scalable data storage solutions using Databricks on Azure.

In Short

• Drive continuous improvement initiatives to enhance data processing capabilities across the organization.
• Design and implement efficient, high-performance data ingestion pipelines from diverse sources utilizing Databricks on Azure.
• Develop and maintain reliable data pipelines, automating manual processes to improve efficiency and scalability.
• Collaborate with the Data Engineering team to design and support robust processes for loading data into relational, dimensional, and NoSQL database systems.
• Implement best practices in data lake architecture to ensure scalable, standardized, and optimized data storage and processing solutions.
• Partner with cross-functional teams to identify, evaluate, and acquire new data sources that align with organizational objectives.
• Actively participate in agile development processes, contributing to sprint planning, refinement, and delivery of high-quality solutions.

Requirements

• 4+ years experience in a highly technical and hands-on data engineering, or data science role.
• Proficiency with Databricks and/or PySpark is a strong advantage.
• Hands-on experience in developing ETL processes.
• Familiarity with Data Lakehouse systems and/or migrating RDBMS to Lakehouse architectures.
• Strong organizational and time management skills to manage multiple projects with minimal supervision.
• Ability to build and refine processes from the ground up.
• Excellent problem-solving skills, with a keen ability to investigate beyond initial findings.
• Exceptional attention to detail, with a commitment to testing and validating results.
• Comfortable working with unstructured data and navigating ambiguous outcomes.

Benefits

• Generously subsidized company-sponsored Medical, Dental, and Vision insurance.
• Spending account options: HSA, FSA, and DCFSA.
• 401K with company match and immediate vesting.
• Flexible working environment.
• Generous Paid Time Off to include Vacation, Sick, and Paid Holidays.
• Paid maternity and paternity leave.
• Community giveback opportunities, including paid time off for philanthropic endeavors.