Lead Data Engineer - Remote

Overview

We are seeking a highly skilled Lead Data Engineer with strong expertise in PySpark, SQL, and Python, Azure Data Factory, Synapse, Databricks and Fabric, as well as a solid understanding of ETL and data warehousing end to end principles.

In Short

• Design and develop scalable data pipelines using PySpark.
• Write efficient SQL and Python code for data transformation.
• Collaborate with machine learning engineers and product managers.
• Implement and maintain ETL processes.
• Ensure data quality, integrity, and reliability.
• Participate in code reviews and performance tuning.
• Work independently to resolve data-related issues.
• Contribute to Azure-based data solutions.
• Support cloud migration initiatives and DevOps practices.
• Mentor junior team members as needed.

Requirements

• 8+ years of experience working with cross-functional teams.
• 3+ years of experience developing data pipelines using PySpark.
• Experience with Azure-native services.
• Strong programming skills in Python and SQL.
• Experience with ETL processes and data modeling.
• Self-driven and resourceful in fast-paced environments.
• Advanced written and spoken English is a must.
• Strong communication skills are required.

Benefits

• Be part of an innovative team shaping the future of technology.
• Work in a collaborative and inclusive environment.
• Opportunities for professional development and career growth.