Staff Data Engineer - Data Engineering - Remote

Overview

As a key technical leader and team architect, you will drive the design, development, and optimization of scalable data ingestion pipelines within the Arine platform, ensuring efficient data management in healthcare.

In Short

• Lead system design reviews and offer recommendations.
• Architect scalable data ingestion pipelines.
• Develop reusable components for data pipelines.
• Create configuration-driven, containerized toolsets.
• Collaborate with cross-functional teams on data requirements.
• Implement strategies for large-scale healthcare datasets.
• Build monitoring and alerting systems for data processes.
• Apply software engineering best practices to data infrastructure.
• Refactor existing data processes for efficiency.
• Provide mentorship to junior engineers.

Requirements

• 10+ years of experience in data engineering.
• Expertise in Python programming.
• Experience with automated ETL processes using Python and SQL.
• Strong understanding of ETL/ELT frameworks.
• Experience with data validation and cleaning.
• Experience with API integration.
• Proficiency in handling various file types, especially healthcare standards.
• Experience with large data sets processing.
• Strong experience in AWS data architectures.
• Experience with containerization technologies like Docker and Kubernetes.

Benefits

• Dynamic role with growth opportunities.
• Collaboration with experienced professionals in healthcare.
• Contribution to a mission-driven company.
• Potential for significant impact on patient health outcomes.
• Flexible work arrangements with remote opportunities.