Senior Data Engineer (Palantir Foundry platform) - Remote

Overview

The Senior Data Engineer will lead and execute large-scale data engineering projects using the Palantir Foundry platform, focusing on the development of robust and scalable ETL/ELT workflows.

In Short

• Lead data engineering projects using Palantir Foundry.
• Develop ETL/ELT workflows with Spark-based Transforms.
• Design and optimize Foundry Transforms using Apache Spark.
• Ingest and normalize large datasets from various sources.
• Define and manage business-friendly data models (Ontologies).
• Integrate data through APIs and connectors.
• Implement data quality checks and automated alerts.
• Monitor and tune pipeline performance.
• Automate deployment pipelines with CI/CD practices.
• Provide technical mentorship to junior engineers.

Requirements

• Experience with Palantir Foundry and data workflows.
• Strong knowledge of Apache Spark APIs.
• Proficient in Python and SQL.
• Familiarity with data integration tools.
• Experience with CI/CD practices.
• Knowledge of data architecture and performance optimization.
• Agile methodology experience.
• Strong documentation and version control skills.
• Ability to explain technical concepts to diverse stakeholders.
• Leadership and mentoring skills.

Benefits

• Professional development opportunities.
• Collaborative work environment.
• Career path and mentorship programs.
• Contribute to a dynamic and growing organization.
• Equal opportunity employer with a commitment to diversity.