Senior/Lead Data Engineer - Remote

Overview

The company is an Australian-based data-driven trading business looking for a Senior/Lead Data Engineer to expand their team in the Philippines.

In Short

• Design and run a multi-cluster Apache Kafka backbone.
• Build stateful pipelines in Apache Flink for data processing.
• Persist processed streams into fast analytical stores.
• Create batch back-fill tooling for historical re-processing.
• Manage object storage and define retention policies.
• Implement observability and CI/CD processes.
• Work closely with the founder on various aspects of the project.
• Help onboard new engineers as the team grows.

Requirements

• Experience with Apache Kafka and Flink.
• Strong knowledge of data engineering principles.
• Familiarity with Redis and object storage solutions.
• Experience with Terraform and infrastructure-as-code.
• Understanding of observability tools like Prometheus and Grafana.
• Ability to work in a fast-paced, dynamic environment.
• Critical thinking and problem-solving skills.
• Experience in a leadership or mentoring role is a plus.

Benefits

• Opportunity to work with a dynamic team.
• Engagement in a growing business with significant impact.
• Collaboration with the founder on strategic decisions.
• Potential for career growth and development.