Data Engineering Specialist - Open Finance - Remote

Overview

We are looking for a dedicated and passionate technology professional to join our team responsible for processing features for machine learning that feed the company's main products and score models, working with petabyte-scale data.

In Short

• Work on the Open Finance project, building data movement pipelines in the cloud.
• Utilize proprietary NLP tools for data treatment.
• Translate code to Spark (Python and Scala).
• Build data pipelines and Airflow Dags.
• Optimize EMR resource usage per job.
• Code optimization and database validation.
• Implement unit test coverage.
• Participate in architecture committee meetings.

Requirements

• Proficiency in Python and Spark.
• Experience with Airflow and AWS.
• Familiarity with EMR and Kafka (desirable).
• Scala knowledge is a plus.

Benefits

• Work in a diverse and inclusive environment.
• Opportunities for career development.
• Recognition as a top employer in multiple countries.
• Support for work-life balance.