Data Engineer with Spark and Airflow - Remote

Overview

The Data Engineer will be responsible for optimizing data management strategies and enhancing operations in the financial sector by creating and maintaining data transformation pipelines.

In Short

• Drive data efficiency by creating and maintaining optimal data transformation pipelines.
• Handle large, complex financial data sets to meet business requirements.
• Identify and implement process improvements for data delivery and infrastructure.
• Build scalable data infrastructure for optimal data extraction and loading.
• Utilize analytics tools to provide actionable insights into business performance.
• Collaborate with cross-functional teams to support data infrastructure needs.

Requirements

• 3+ years of experience in a similar role, preferably within Agile teams.
• Strong analytical skills with structured and unstructured data.
• Proficient in SQL and relational databases.
• Experience in building and optimizing Big Data pipelines.
• Knowledge of Apache Spark and object-oriented programming in Java; Python is a plus.
• Experience with ETL processes and tools like Apache Airflow.
• Proven experience in data analysis and root cause analysis.

Benefits

• Premium medical package for employees and their children.
• Dental coverage and eyeglasses reimbursement.
• Individual therapy sessions and self-development webinars.
• Flexible working schedule and increased days off.
• Birthday, holiday, and loyalty gifts for major milestones.