Data Engineer - Remote

Overview

We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Scala and AWS technologies. This role is crucial for ensuring the efficient processing and management of large data sets to support our business operations.

In Short

• Design and implement scalable data pipelines using Spark/Scala and AWS services.
• Assemble large, complex data sets that meet both functional and non-functional business requirements.
• Optimize data delivery and automate manual processes to improve operational efficiency.
• Build infrastructure for optimal extraction, transformation, and loading (ETL) of data from various sources.
• Develop analytical tools to provide actionable insights into key business performance metrics.
• Collaborate with stakeholders, including data scientists, analysts, and executive teams, to support data infrastructure needs.
• Ensure data reliability, efficiency, and quality through continuous improvement and maintenance of data systems.

Requirements

• Proficiency in Spark/Scala programming language is must.
• Domain experience of AML Transaction Monitoring is a must.
• Extensive experience with AWS services, including but not limited to S3, EC2, Lambda, Glue, and Redshift.
• Strong understanding of data architecture and data flow management.
• Experience with data modeling, mining, and production.
• Excellent problem-solving skills and ability to work independently and collaboratively.
• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• Experience on Databricks is preferred but not mandatory.

Benefits

• Competitive compensation and benefits.
• Challenging work environment.
• Opportunities for career growth.
• Diverse work environment.
• Innovative solutions delivery.