Lead Data Engineer - Remote

Overview

Everstream Analytics is a technology-driven company that is revolutionizing Supply Chain Risk Analytics. We’re looking for a talented and experienced Lead Data Engineer to join our team.

In Short

• Manage and grow a remote team of data engineers based in Europe.
• Collaborate with Platform and Data Architecture teams to deliver robust, scalable, and maintainable data pipelines.
• Lead and own data engineering projects, including data ingestion, transformation, and storage.
• Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.
• Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.
• Create efficient data models and optimize database queries for optimal performance.
• Work closely with data scientists, product managers, and engineers to understand data requirements and translate them into technical solutions.
• Mentor junior data engineers and share your expertise. Establish and promote best practices.

Requirements

• Deep understanding of Python, including data manipulation and analysis libraries like Pandas and NumPy or similar.
• Extensive experience in data engineering, including ETL, data warehousing, and data pipelines.
• Strong knowledge of AWS services, such as RDS, Lake Formation, Glue, Spark, etc.
• Experience with real-time data processing frameworks like Apache Kafka/MSK.
• Proficiency in SQL and NoSQL databases, including PostgreSQL, Opensearch, and Athena.
• Ability to design efficient and scalable data models.
• Strong analytical skills to identify and solve complex data problems.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.

Benefits

• Contribute to data-driven decision-making and product innovation.
• Work with a talented, passionate team from across the world.
• Opportunities to learn new technologies and skills.
• A competitive salary and benefits package.