Nagarro is seeking a Big Data Engineer with experience in Databricks to develop and implement data solutions that enhance data movement and integrity across platforms.
In Short
Develop a technical plan for data migration.
Design scalable data pipelines using Azure Databricks.
Ensure data quality and integrity throughout pipelines.
Provide technical guidance to team members.
Stay updated on cloud computing and data engineering advancements.
Work with event-based and streaming technologies.
Implement data validation and cleansing mechanisms.
Develop reusable frameworks for data ingestion.
Conduct data profiling and mapping for technical design.
Experience with data visualization tools is a plus.
Requirements
4 to 8 years of experience in Data Engineering.
Experience with Azure Databricks.
Expertise in Data Modeling and Source System Analysis.
Proficiency with PySpark and SQL.
Knowledge of Azure components like Azure Data Factory and Azure SQL.