Sr. Data Engineer - Remote

Overview

Are you passionate about building scalable, high-performance data pipelines? We are looking for a talented Data Engineer to join our team and help us process, transform, and analyze healthcare claims data at scale. As a key member of our data engineering team, you will work on building robust ETL pipelines, optimizing data workflows, and enabling advanced analytics to support key business initiatives.

In Short

• Design, build, and maintain scalable data pipelines to process claims data efficiently using Spark (Scala/PySpark), AWS Glue, and Airflow.
• Work closely with analysts, backend engineers, and other stakeholders to ensure high data quality, reliability, and accessibility.
• Optimize and tune distributed data processing workflows for performance and cost efficiency.
• Develop and enforce best practices for data governance, schema evolution, and pipeline observability while understanding the nuances of security and compliance.
• Implement automated testing, monitoring, and alerting for data workflows to ensure operational excellence.
• Collaborate with stakeholders to define and implement data models that support analytics and business intelligence initiatives.

Requirements

• Experience in building and maintaining ETL pipelines.
• Proficiency in Apache Spark (Scala/PySpark) and AWS Glue.
• Knowledge of data orchestration tools like Apache Airflow.
• Strong understanding of data governance and best practices.
• Experience with AWS infrastructure.

Benefits

• Opportunity to work on impactful healthcare data projects.
• Collaborative team environment.
• Professional growth and development opportunities.