Principal Data Engineer - Remote

Overview

The Principal Data Engineer is responsible for the development and maintenance of data products, focusing on designing, building, and implementing data processing pipelines to enhance data flow and enable efficient data analysis.

In Short

• Design, build, and maintain data processing pipelines for ETL.
• Write complex SQL queries for analytics needs.
• Develop tools leveraging AI and machine learning for data transformation.
• Evaluate and recommend data infrastructure tools.
• Collaborate with various teams to translate business requirements into technical specifications.
• Work with structured and unstructured data from various sources.
• Ensure high standards for data governance and compliance.
• Architect and scale data platforms for real-time and batch processing.
• Champion security and automation in data workflows.
• Lead POCs for emerging technologies in the data stack.

Requirements

• Bachelor's or master's degree in computer science or related field.
• 6-8 years of experience in data engineering, especially in financial systems.
• Deep expertise in Python and SQL.
• Experience with distributed processing frameworks like Apache Spark.
• Hands-on experience with cloud-based data platforms (AWS or Azure).
• Familiarity with data orchestration tools (e.g., Airflow).
• Strong understanding of data security and compliance.
• Experience with structured and semi-structured data.
• Ability to assess complex problems using analytical techniques.
• Experience in democratizing data at scale is a plus.

Benefits

• Competitive salary and benefits package.
• Opportunities for professional development.
• Work in a collaborative and innovative environment.
• Flexible working arrangements.
• Access to cutting-edge technologies and tools.