Principal Data Engineer - Remote

Overview

SiteMinder is embarking on an ambitious transformation program, which involves the establishment of a data engineering function within the engineering team. Our key aim is to bring machine-learning based insights and recommendations into our products.

In Short

• Shape and drive the data engineering strategy to ensure scalable, real-time, and high-quality data pipelines.
• Collaborate with cross-functional teams and act as the technical lead for data platform-related matters.
• Work closely with the Engineering Team to explore and implement innovative solutions for core data challenges.
• Lead and guide a team of Data Engineers in designing and implementing data pipelines.
• Own and manage data platform assets, ensuring optimal performance and scalability.
• Support the company’s transformation program by enhancing data infrastructure and processes.
• Oversee the operation of the data warehouse platform and ensure its efficiency.

Requirements

• Extensive experience as a Data Engineer with Machine Learning exposure.
• Lead the development of ETL/ELT solutions, ensuring automation, scalability, and best practices.
• Hands-on experience building robust production data pipelines using the best industry practices, with experience of data preparation and resolution of data quality challenges and optimising multiple data transformation workflows.
• Champion best practices in unit testing, CI/CD, and data architecture.
• Cost oversight and optimisation strategies.
• Extensive experience in data platforms, e.g. Databricks.
• Experience in Streaming (Spark, Kafka or similar).
• Cloud & CI/CD Experience – Familiarity with CI/CD pipelines, cloud data platforms, and scalable architectures.
• Problem-Solving & Leadership – Strong analytical mindset, with a passion for mentoring and guiding teams.
• Python and/or Scala, relevant Python ML libraries and SQL proficiency.
• Testing and validation of Data Models and Data Pipelines.
• AWS experience across one or more of the following EC2, Kinesis, SQS, ElastiCache, Lambda and S3.
• Experience with Infrastructure as code including Terraform or CloudFormation.
• Deep knowledge on how to structure, develop and maintain relational databases such as MySQL and showcase your experience using data modeling techniques.
• Ability to work independently and also contribute to overall architecture and design.
• “Data wrangler” mindset: embraces complexity and ambiguity, overcomes challenges and obstacles in order to deliver a working solution.
• Decision-making: able to view a problem from multiple perspectives, select the best approach, and provide a concise rationale for the choice.
• Outcome-focused: able to balance the need for a robust, elegant technical solution with the need for a market-ready solution.
• Experience building, administering and scaling ML processing pipelines preferably in Databricks.

Benefits

• Competitive salary based on your experience.
• Equity packages for you to be a part of the SiteMinder journey.
• Flexibility to work fully remote or in a hybrid model (in-office & from home).
• Mental health and well-being initiatives.
• Generous parental (including secondary) leave policy.
• Paid birthday, study and volunteering leave every year.
• Sponsored social clubs, team events, and celebrations.
• Employee Resource Groups (ERG) to help you connect and get involved.
• Investment in your personal growth offering training for your advancement.