Data Engineering Specialist I - Remote

Overview

As a Data Engineering Specialist I at Serasa Experian, you will be part of a team responsible for processing features for machine learning, contributing to the company’s key products and scoring models.

In Short

• Join a leading Datatech company in Brazil.
• Work with petabyte-scale data processing.
• Utilize Spark on EMR orchestrated via Airflow.
• Translate code to Spark using Python and Scala.
• Build data pipelines and DAGs in Airflow.
• Optimize EMR resource usage per job.
• Conduct database validation.
• Ensure unit test coverage.
• Participate in architecture committee projects.
• Learn and adapt to new technologies and concepts.

Requirements

• Proficiency in Python.
• Experience with Spark.
• Familiarity with Airflow.
• Knowledge of AWS and EMR.
• Kafka experience is a plus.
• Scala knowledge is desirable.

Benefits

• Work in an innovative and inclusive environment.
• Opportunities for personal and professional growth.
• Recognition as a top employer in various countries.
• Support for work-life balance.
• Access to diverse teams and specialties.