Senior Data Engineer (Snowflake) - Remote

Overview

As a Senior Data Engineer at 3Pillar, you will play a crucial role in leveraging cutting-edge technologies to reshape data analytics and enable data-driven decision making for our clients.

In Short

• Lead design and implementation of scalable ETL/data pipelines using Python and Luigi.
• Ensure efficient data processing for high-volume data.
• Guide the team in adopting best practices for data pipeline development.
• Configure and maintain AWS infrastructure for scalability and security.
• Support data storage and retrieval workflows using S3 and SQL.
• Provide architectural guidance for cloud-native data solutions.
• Oversee legacy framework maintenance and propose modernization plans.
• Lead data migration initiatives to Snowflake.
• Document workflows and provide mentoring to team members.
• Foster a culture of continuous learning within the team.

Requirements

• 6 years of experience in data engineering, with at least 4 years in Snowflake projects.
• Proven expertise with Snowflake data warehousing.
• Strong programming skills in Python.
• Expertise in managing SQL databases.
• Familiarity with monitoring solutions for data pipelines.
• Experience with AWS Cloud and data engineering services.

Benefits

• Opportunity to work on exciting projects.
• Dynamic team environment.
• Mentorship and training opportunities.
• Access to cutting-edge technologies.
• Culture of continuous learning.