Azure Data Factory Technical Lead - Remote

Overview

We are seeking a seasoned Azure Data Factory (ADF) Technical Lead with proven track to build scalable data integration solutions using ADF (migration or new implementation).

In Short

• Design and build Cloud code pipelines using Azure Data Factory.
• Develop and optimize ETL/ELT CI/CD workflows using ADF pipelines.
• Leverage PySpark, Kafka, Kinesis, and Python for data transformation tasks.
• Lead a team of junior engineers and developers.
• Performance tuning, monitoring, and troubleshooting of data pipelines.
• Minimum 6+ years of experience in data warehousing/engineering.
• At least 2 years in a Technical Lead role.
• Experience with Azure tool stack and ADF architecture.
• Knowledge of data privacy regulations.
• Experience with CI/CD pipelines for data solutions.

Requirements

• Bachelor’s degree in computer science, Information Systems, or related field.
• 5+ years of experience in building enterprise/data warehouse solutions.
• Proficiency in SQL for developing complex queries.
• Experience with structured and unstructured data.
• Hands-on experience with Microsoft Fabric.
• Experience with pipeline automation tools.
• Knowledge of data modeling.
• Azure certifications preferred.
• Experience with Databricks for data engineering workflows.
• Solid experience in Python, especially data manipulation libraries.

Benefits

• Medical, vision, and dental insurance.
• Life insurance.
• Short-term and long-term disability insurance.
• 401k.
• Flexible paid time off.
• At least 15 paid holidays per year.
• Paid sick and safe leave.
• Paid parental leave.