Senior Big Data Engineer with Databricks - Remote

Overview

The Senior Big Data Engineer will work closely with cross-functional teams to deliver high-quality solutions in various domains including Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

In Short

• Work on data migration including ingestion, transformation, storage, and access control.
• Design and implement scalable data pipelines using Azure Databricks.
• Develop reusable frameworks for data ingestion.
• Ensure data quality and integrity throughout the data pipeline.
• Work with event-based/streaming technologies.
• Support the team in resolving technical challenges during migration.
• Stay updated with advancements in cloud computing and data engineering.

Requirements

• 6+ years of IT experience.
• 4+ years of experience with Azure Databricks.
• Experience in Data Modeling and Source System Analysis.
• Familiarity with PySpark.
• Mastery of SQL.
• Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW.
• Experience with Python for data engineering.
• Ability to conduct data profiling and mapping.
• Experience with data visualization tools.
• Excellent communication skills.

Benefits

• Dynamic and non-hierarchical work culture.
• Opportunity to work with a global team.
• Engagement in diverse projects across various domains.
• Professional growth and development opportunities.