Staff Engineer - Data Platform and Lakehouse - Remote

Overview

This role provides a senior engineering opportunity to design and lead the implementation of a cloud-native data platform that powers advanced analytics, AI, and machine learning applications.

In Short

• Design, implement, and maintain scalable, secure, and maintainable data platforms on Databricks and cloud infrastructure (AWS).
• Provide architectural leadership and ensure consistency, resilience, and performance across distributed data processing systems.
• Develop reusable data pipelines, workflows, and ETL/ELT processes using Databricks Workflows, Airflow, or AWS Glue.
• Translate business objectives into technical platform capabilities in collaboration with product and cross-functional teams.
• Support AI/ML initiatives, including feature engineering, model deployment, and real-time data processing.
• Drive adoption of data governance standards, including access control, metadata management, lineage, and compliance.
• Establish CI/CD pipelines and DevOps automation for data infrastructure.
• Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring practices.

Requirements

• Experience in cloud-native architecture and data platform development.
• Proficiency in Databricks and AWS cloud services.
• Strong understanding of ETL/ELT processes and data pipeline construction.
• Experience with AI/ML technologies and initiatives.
• Knowledge of data governance practices and standards.
• Familiarity with CI/CD and DevOps principles.
• Ability to collaborate with cross-functional teams effectively.
• Strong problem-solving and analytical skills.

Benefits

• Competitive salary and benefits package.
• Opportunity to work on cutting-edge technology.
• Collaborative and innovative work environment.
• Professional development and growth opportunities.
• Flexible work arrangements.