Data Engineer - Remote

Overview

We are looking for Data Engineers to join our Data Platform group. In this position, you will work in a small, dynamic team to build data infrastructure and manage the overall data pipeline.

In Short

• Design, develop, and maintain a generic ingestion framework for various data types.
• Implement and optimize ETL pipelines for data integrity and reliability.
• Ensure the ingestion framework is scalable and efficient.
• Continuously monitor and enhance the data ingestion process.
• Develop automated testing and monitoring tools.
• Provide documentation and support to team members.
• Implement large-scale near real-time streaming data processing pipelines.
• Build analytics tools for actionable insights.
• Perform POCs and evaluate different technologies.

Requirements

• Experience building and optimizing Big Data data pipelines.
• Strong proficiency in Elasticsearch.
• Strong analytic skills with unstructured datasets.
• Experience with cross-functional teams.
• Working knowledge of message queuing and stream processing.
• 4 to 6 years of experience in a Data Engineer role.
• Bachelors or Masters in Computer Science or related field.
• Experience with Hadoop, Spark, SQL systems.
• Hands-on experience with Java/Python, SQL, NoSQL.
• Experience with CI/CD pipelines and AWS services.

Benefits

• Flexible working arrangements.
• Opportunity to work in a dynamic team.
• Continuous education and training.
• Work with leading technology companies.
• Contribute to innovative projects.