DataDevOps Engineer - Remote

Overview

We are seeking a passionate DataDevOps Engineer who loves optimizing pipelines, automating workflows, and scaling cloud-based data infrastructure.

In Short

• Design, build, and optimize data pipelines using Airflow, DBT, and Databricks.
• Monitor and improve pipeline performance to support real-time and batch processing.
• Manage and optimize AWS-based data infrastructure, including S3 and Lambda, as well as Snowflake.
• Implement best practices for cost-efficient, secure, and scalable data processing.
• Enable and optimize AWS SageMaker environments for ML teams.
• Collaborate with ML, Data Science, and Reporting teams to ensure seamless data accessibility.
• Implement data pipeline monitoring, alerting, and logging to detect failures and performance bottlenecks.
• Build automation to ensure data quality, lineage tracking, and schema evolution management.
• Participate in incident response, troubleshooting, and root cause analysis for data issues.
• Advocate for DataOps best practices, driving automation, reproducibility, and scalability.
• Document infrastructure, data workflows, and operational procedures.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
• 3+ years of experience in DevOps, DataOps, or similar.
• Proficiency in key technologies, including Airflow, Snowflake, and SageMaker.
• Certifications in AWS/Snowflake/other technologies a plus.
• Excellent communication and interpersonal skills.
• Ability to work in a fast-paced environment and manage multiple priorities effectively.

Benefits

• Opportunity to work with cutting-edge technologies.
• Collaborative team environment.
• Potential for career growth and development.
• Engagement with innovative projects.
• Flexible working arrangements.