Lead Data Engineer - Remote

Overview

The Lead Data Engineer will manage the end-to-end data pipelines, transforming and loading data into the company's data lake while migrating to a new Spark-based environment on AWS.

In Short

• Manage end-to-end data pipelines from operational systems.
• Transform and load data into the company data lake.
• Migrate from Hadoop to a Spark-based environment on AWS.
• 4+ years of experience as a Data Engineer.
• Proficient in SQL and Python.
• Experience with cloud-hosted data warehouses like Hive and Snowflake.
• Hands-on ETL/ELT process development experience.
• Familiarity with Hadoop framework and parallel computing.
• Strong analytical skills and attention to detail.
• Ability to work independently and lead projects.

Requirements

• 4+ years of hands-on experience as a Data Engineer.
• BA/BSc in a related field (CS, engineering, information systems).
• High proficiency in SQL & Python.
• Experience with cloud-hosted data warehouses (Hive, Snowflake).
• Hands-on ETL/ELT processes experience (Spark and SQL).
• Experience with Hadoop framework and parallel computing.
• Proven experience with data warehousing and best practices.

Benefits

• Opportunity to work with cutting-edge technologies.
• Collaborative team environment.
• Professional development opportunities.
• Flexible working hours.
• Potential for career advancement.