Senior Data Platform Engineer - Remote

Overview

Solvd is an AI-first advisory and digital engineering firm on a mission to redefine how AI transforms business. We are looking for an experienced Senior Data Platform Engineer to join our growing team and help clients move from experimentation to real ROI through advanced data and platform engineering.

In Short

• Design and optimize data clusters for batch and streaming workloads.
• Build and expand ecosystems including Spark, Hadoop, and Kubernetes.
• Introduce and scale new data platform solutions.
• Collaborate with cross-functional teams to align platform capabilities with goals.
• Proven experience in scaling and tuning large deployments of Spark-on-Kubernetes.
• Knowledge of open-source S3 alternatives like Ceph and MinIO.
• In-depth understanding of Hadoop and the HDFS protocol.
• Skilled in designing and optimizing shuffle-heavy systems.
• Hands-on experience with lakehouse file formats such as Delta Lake.
• Strong communication skills and problem-solving abilities.

Requirements

• Experience with next-generation and multi-modal data formats.
• Background in building self-service stateful platforms.
• Familiarity with native or accelerated runtimes for Spark.

Benefits

• Opportunity to work with cutting-edge technologies.
• Collaborative and innovative work environment.
• Potential for career growth and development.
• Flexible work arrangements.
• Engagement with diverse stakeholders.