Senior Data Engineer – Real-Time & Distributed Systems (GCP) - Remote

Overview

A Senior Data Engineer responsible for designing, building, and optimizing scalable data pipelines for both batch and real-time processing, collaborating with data scientists and application teams.

In Short

• Design and optimize scalable data pipelines.
• Develop event-driven architectures for high-throughput systems.
• Ensure data reliability and low-latency processing.
• Collaborate with teams for analytics and AI use cases.
• Implement performance tuning and cost optimization best practices.
• Proficiency in Python for data processing.
• Experience with big data pipelines in production.
• Hands-on with workflow orchestration tools.
• Experience in batch and streaming data processing.
• Knowledge of distributed systems and NoSQL databases.

Requirements

• Advanced proficiency in Python.
• Experience with Apache Spark and Apache Beam.
• Strong understanding of distributed systems architecture.
• Experience managing globally distributed datasets.
• Hands-on experience with NoSQL databases.

Benefits

• Opportunity to work with leading technology companies.
• Access to advanced machine learning and AI technologies.
• Work in a global team with diverse expertise.
• Contribute to high-impact projects across industries.