Data Engineer - Remote

Overview

The Data Engineer is central to building our future-state architecture by modernizing how public health data moves, transforms, and informs decision-making at scale. You will lead the design and implementation of next-generation pipelines, ensure data reliability and compliance, and guide integration teams through migration from legacy systems.

In Short

• Play a key role in shaping the future of our data interoperability platform.
• Design and operate secure, high-performance data pipelines for real-time and batch public health data flows.
• Architect and implement scalable solutions that move sensitive health data reliably and meet strict security and compliance standards.
• Build and optimize ETL/ELT pipelines using NiFi, Kafka, Python, and SQL.
• Collaborate with interoperability, product, and data science teams to migrate legacy pipelines to modern architectures.
• Fine-tune data lakes and ensure smooth data exchange across systems.
• Define monitoring and alerting strategies and create runbooks to support operational teams.
• Troubleshoot production issues to maintain stable and performant pipelines.
• Drive continuous improvement across the data ecosystem through collaboration, innovation, and strong execution.
• Contribute directly to building and delivering high-quality, scalable integrations that drive rapid product progress.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• A minimum of 3 years of experience implementing enterprise-grade data pipelines OR 7 years of equivalent professional experience implementing enterprise-grade data pipelines.
• Someone who thrives at the intersection of technical complexity and mission-driven impact.
• Proven ability to build robust, production-grade pipelines from the ground up and work confidently with distributed data systems.
• A curious, proactive problem solver who excels in fast-paced, agile environments.
• Hands-on expertise with NiFi, Kafka, Python, and SQL, including designing, operating, and optimizing ETL/ELT pipelines in the cloud.
• Experience using or integrating with OpenSearch/Elasticsearch.
• Familiarity with CI/CD and DevOps practices; able to partner with DevOps/SRE to integrate pipelines into existing tooling (not responsible for platform design).
• Practical experience using relational databases and existing schemas (implementing against established data models; extending under guidance).
• Strong understanding of data security and compliance requirements for sensitive data.

Benefits

• Excellent cross-functional collaborator with clear communication and strong technical documentation skills.
• A growth mindset with a passion for solving complex interoperability challenges elegantly and efficiently.
• Strong communication skills to translate complex engineering concepts into clear strategies for cross-functional partners.