Senior Big Data Engineer - Oozie and Pig (GCP) - Remote

Overview

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python.

In Short

• Design and develop scalable batch processing systems using Hadoop, Oozie, Pig, Hive, MapReduce, and HBase.
• Write clean, efficient, and production-ready code focusing on data structures and algorithmic problem-solving.
• Manage and optimize complex data workflows within the Apache Hadoop ecosystem.
• Leverage Google Cloud Platform (GCP) tools to build scalable big data solutions.
• Implement DevOps and automation best practices including CI/CD pipelines.
• Collaborate with cross-functional teams to ensure data pipeline reliability.

Requirements

• Bachelor's degree in Computer Science, software engineering or related field.
• Experience with managed cloud services and cloud-based batch processing systems.
• Proficiency in Oozie, Airflow, Map Reduce, Java.
• Strong programming skills with Java, Python, Pig, and SQL.
• Expertise in public cloud services, particularly in GCP.
• Familiarity with BigTable and Redis.
• Experience in Infrastructure and Applied DevOps principles.
• Proven experience in engineering batch processing systems at scale.

Benefits

• Fully remote work environment.
• Opportunity to work with cutting-edge technologies.
• Collaborative and innovative team culture.
• Professional development opportunities.
• Competitive salary and benefits package.