Senior Data Engineer (DBT + Spark + Argo) - Remote

Overview

As a Senior Data Engineer, you will be at the core of a strategic data transformation initiative, converting legacy SQL logic into a modular, testable DBT architecture, while integrating Spark for performance and Argo for orchestration.

In Short

• Translate legacy T-SQL logic into modular, scalable DBT models powered by Spark SQL.
• Build reusable and performant data transformation pipelines.
• Develop testing frameworks to ensure data accuracy and integrity in DBT workflows.
• Design and orchestrate workflows using Argo Workflows and CI/CD pipelines with Argo CD.
• Manage mock data and reference datasets, ensuring version control and governance.
• Implement efficient storage/query strategies using Apache Hudi, Parquet, and Iceberg.
• Integrate ElasticSearch for analytics by building APIs and pipelines to support indexing and querying.
• Collaborate with DevOps teams to optimize S3 usage and ensure data security.
• Work in Agile squads and participate in planning, estimation, and sprint reviews.

Requirements

• Strong experience with DBT for data modeling, testing, and deployment.
• Hands-on proficiency in Spark SQL, including performance tuning.
• Solid programming skills in Python for automation and data manipulation.
• Familiarity with Jinja templating for building reusable DBT components.
• Practical experience with data lake formats: Apache Hudi, Parquet, Iceberg.
• Expertise in Argo Workflows and CI/CD integration with Argo CD.
• Deep understanding of AWS S3 data storage and cost optimization.
• Strong command of ElasticSearch for indexing structured/unstructured data.
• Knowledge of ICD-10, CPT, and other healthcare data standards.
• Ability to work cross-functionally in Agile environments.

Benefits

• Contractor agreement with payment in USD.
• 100% remote work.
• Argentinas public holidays.
• English classes.
• Referral program.
• Access to learning platforms.