Senior Data Engineer - AWS - Remote

Overview

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python and DataOps tools and technologies. Knowledge of SAP HANA & Snowflake is a plus. This role is critical for designing, developing, and maintaining our client’s data pipeline architecture, ensuring the efficient and reliable flow of data across the organization.

In Short

• Design, develop, and maintain data pipelines using AWS Glue and Apache Airflow.
• Integrate various data sources including SAP HANA, Kafka, and SQL databases.
• Optimize data pipelines for performance and reliability.
• Implement data transformation processes for analytical purposes.
• Utilize SQL and Python for ETL tasks.
• Ensure data quality and integrity through testing and validation.
• Collaborate with data scientists and analysts to meet data requirements.
• Monitor data pipeline performance and implement improvements.
• Maintain documentation of data pipelines and processes.
• Stay updated with industry trends in data engineering.

Requirements

• Extensive experience with AWS Glue.
• Proficient in Apache Airflow.
• Strong knowledge of Kafka.
• Advanced SQL skills.
• Proficiency in Python.
• Experience with SAP HANA.
• Familiarity with DataOps tools.
• Knowledge of Snowflake is a plus.
• Experience with AWS data services like Redshift and S3.
• Strong analytical and problem-solving skills.

Benefits

• Hybrid work mode with a remote-friendly workplace.
• Health and family insurance.
• 40+ leaves per year including maternity and paternity leaves.
• Wellness, meditation, and counseling sessions.