Lead Engineer - Data Engineering - Remote

Overview

We are seeking a Lead Engineer to join our Analytics Engineering team, focusing on post-ingestion data engineering. This position will be responsible for technically leading the construction, maintenance, and evolution of data pipelines that support the Data Quality team, ensuring scalability, reliability, and performance of processes.

In Short

• Lead the development of data engineering solutions as a technical reference for the team.
• Design and implement robust and scalable data pipelines in distributed environments.
• Ensure best practices in architecture, security, versioning, and data monitoring.
• Collaborate with multidisciplinary teams (Data Quality, Data Governance, Software Engineering).
• Drive the evolution of the data platform by proposing continuous improvements and innovations.
• Mentor junior data engineers and contribute to the technical growth of the team.

Requirements

• Advanced experience with Spark (preferably PySpark) for distributed processing.
• Proficiency in AWS, including services like S3, Glue, EMR, Lambda, IAM, and others.
• Solid knowledge of EKS (Kubernetes on AWS) for workload orchestration.
• Proficiency in Python, focusing on data engineering.
• Familiarity with Linux environments, shell scripting, and automation.
• Experience with versioning tools (Git), CI/CD, and observability (monitoring/logs).

Benefits

• Work in a globally recognized company that values diversity and inclusion.
• Access to continuous learning and development opportunities.
• Participate in a culture that emphasizes work/life balance and employee well-being.
• Be part of a team that drives innovation and success through a diverse workforce.