Mid-Senior Data Developer - Remote

Overview

We are seeking a Mid-Senior Data Developer to join our team and contribute to challenging and innovative projects, leveraging advanced skills in data tools.

In Short

• Work in a Build&Run team closely with product managers.
• Handle one of the largest data sets in the industry on an AWS-hosted big data platform.
• Ensure timely and quality information delivery for investment tracking journeys.
• Identify business value opportunities from data.
• Implement build and run in the data and analytics product lifecycle.
• Contribute to data layer modeling considering Data Warehouse paradigms.
• Support knowledge creation and dissemination about pipelines and product standards.
• Optimize and improve performance of Shell Script and HiveQL scripts.
• Conduct detailed analyses to identify patterns for informed decision-making.
• Maintain and develop Shell Script.

Requirements

• Advanced knowledge of Spark/Hadoop.
• Advanced understanding of Big Data concepts.
• Advanced skills in AWS Glue, Lambda, Athena, etc.
• Advanced proficiency in PySpark.
• Advanced experience with ETL processes.
• Intermediate knowledge of SQL and NoSQL databases.
• Intermediate skills in Linux.
• Intermediate experience with Shell Script.
• Intermediate proficiency in Python.
• Intermediate skills in Excel for data processing.
• Intermediate knowledge of Batch and Streaming ingestion.
• Intermediate understanding of Infrastructure as Code (Terraform, Cloudformation).
• Intermediate experience with CI/CD pipelines.

Benefits

• Opportunity to work with a global team.
• Engage in innovative technology solutions.
• Contribute to meaningful projects in the financial sector.
• Professional growth and development opportunities.
• Collaborative work environment.