Senior Data Engineer / Architect - Remote

Overview

The Senior Data Engineer / Architect will design, develop, and maintain scalable data solutions in the cloud, utilizing various technologies to optimize data processing and analytics.

In Short

• Design and maintain scalable data solutions in the cloud.
• Gather and analyze data requirements from stakeholders.
• Build and optimize data pipelines using Spark and Databricks.
• Ensure data quality and integrity throughout the data lifecycle.
• Collaborate with teams to implement data models and storage solutions.
• Optimize data processing performance by tuning Spark jobs.
• Provide guidance to junior engineers and developers.
• Stay updated with trends in cloud computing and data engineering.
• Contribute to the improvement of data engineering processes.

Requirements

• 8+ years of experience in data engineering.
• Strong knowledge of Azure DataBricks and Azure Data Factory.
• Experience with Kafka and Eventhub.
• Proficiency in Pyspark, Python, SQL, and Spark.
• Ability to design and implement data architectures.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Immediate joiners preferred.

Benefits

• Work remotely from anywhere.
• Opportunity for permanent or contract role.
• Engage with cutting-edge technologies.
• Collaborate with a talented team.
• Flexible working hours.