Data Engineer - Remote

Overview

An exciting opportunity for a Data Engineer to join the Data Platform team at CV-Library, focusing on building and maintaining scalable data pipelines and collaborating with data scientists.

In Short

• Build and maintain scalable batch and streaming data pipelines.
• Develop ingestion flows for diverse datasets.
• Optimize data models in dbt.
• Support ingestion from Kafka and other streaming sources.
• Collaborate with Data Scientists for model operationalization.
• Build and maintain infrastructure using Terraform.
• Implement data quality checks and monitoring.
• Work with AWS services including Lambda and ECS/Fargate.
• Support Generative AI integration projects.
• Monitor cost efficiency and resource utilization.

Requirements

• Strong experience in Python and AWS services.
• Knowledge of data modeling and ETL processes.
• Experience with Redshift and data pipeline tools like Airflow.
• Familiarity with Terraform for infrastructure management.
• Understanding of data quality and governance practices.
• Experience with Kafka and streaming data sources.
• Ability to collaborate effectively with cross-functional teams.
• Strong problem-solving skills and attention to detail.
• Experience with Generative AI technologies is a plus.
• Excellent communication skills.

Benefits

• Remote working with occasional office visits.
• Opportunity to work with cutting-edge technologies.
• Collaborative and innovative work environment.
• Professional development opportunities.
• Flexible working hours.
• Health and wellness benefits.
• Competitive salary and compensation package.
• Access to training and resources for skill enhancement.
• Supportive team culture.
• Potential for growth within the company.