Data Engineer with Machine Learning and Generative AI - Remote

Overview

We are looking for Data Engineers with ML skills for the team of our Fortune 50 client, building a new platform for the famous sports team in the US. The main objective of the project is to build a platform that enhances fan engagement, optimizes monetization, and delivers seamless stadium and remote experiences.

In Short

• Data Modeling, Migration & ETL Development
• Implement ETL processes and real-time data pipelines for efficient data handling and integration.
• Develop and maintain scalable, cloud-based data architecture using AWS services, including Glue, Lambda, S3, and Redshift.
• Design data models.
• Manage ML pipelines and maintain a model registry for version control and efficient model deployment.
• Transform raw structured and unstructured data into clean, well-modeled graph inputs.
• Implement CI/CD practices using CodePipeline and CodeBuild.
• Employ Docker for containerization and efficient resource management.

Requirements

• Strong SQL skills for ETL, data modeling, and performance tuning.
• Experience with ML models.
• Proficiency in Python for handling complex JSON structures.
• Production experience with deploying ML models.
• Extensive experience with AWS cloud services.
• Understanding of software engineering and testing practices in Agile.
• Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD.
• Excellent teamwork and communication skills.
• Proficiency in English, with strong written and verbal communication skills.
• Efficient data pipelines for real-time and batch processing.

Benefits

• Remote-first working environment.
• Long-term contract role (6+ months).
• Opportunity to work with a Fortune 50 client.
• Involvement in a project aimed at enhancing fan engagement.
• Work in a fast-paced, innovative environment.