Data Engineering Specialist I - Remote

Overview

The Data Engineering Specialist I will be part of a squad, actively participating in ceremonies, discussions, and decision-making processes while ensuring the quality and security of the delivered software.

In Short

• Work within a squad for collaborative development.
• Ensure software quality and security.
• Communicate design effectively to team members.
• Integrate systems with new or altered software components.
• Develop software to meet internal needs.
• Maintain existing solutions and propose improvements.
• Participate in technical discussions for high-quality data pipelines.
• Assist in the design and architecture of new data pipelines.
• Implement best technical practices with quality and security.
• Document software projects and reuse components.

Requirements

• Experience with Scala and Python programming languages.
• Experience in data pipeline architecture and big data (Kappa and Lambda).
• Experience with AWS Data Stack (e.g., Amazon Athena, EMR, Glue, S3, EC2, and Lake Formation).
• Experience with relational (e.g., Aurora, RDS, Redshift) and non-relational databases (e.g., ElasticCache, DocumentDB, Keyspaces).
• Experience in version control with Git.
• Experience with messaging queues (Kafka and SQS).
• Experience with automated testing.
• Experience with CI/CD (Jenkins).
• Familiarity with containerization (Docker, Kubernetes).
• Familiarity with monitoring tools (Grafana, Kibana, Graylog).
• Experience with Agile methodologies like Scrum and Kanban.
• Familiarity with Clean Code and S.O.L.I.D. development methodologies.
• Good written and verbal communication skills.

Benefits

• Diversity and inclusion initiatives.
• Professional development support.
• Empowerment groups for underrepresented communities.
• Collaborative work environment.
• Opportunities to innovate and contribute to market transformation.