Senior Data Engineer - Remote

Overview

As a Senior Data Engineer, you will lead the design, development, and optimisation of scalable data systems and pipelines. You will play a pivotal part in building robust data infrastructure that empowers analytics, machine learning, and business intelligence across the organisation.

In Short

• Architect, develop, and maintain scalable data infrastructures including relational databases, data lakes, and cloud-based data warehouses (e.g., Redshift, BigQuery, Snowflake).
• Work with big data technologies (e.g., Hadoop, Spark), NoSQL databases (e.g., MongoDB, Cassandra), and cloud platforms (AWS, Azure, Google Cloud).
• Handle real-time streaming data using tools like Apache Kafka.
• Design real-time streaming systems that ingest, process, and analyse data continuously with minimal latency.
• Implement scalable, fault-tolerant streaming pipelines that maintain data integrity.
• Build and maintain scalable data architectures (e.g. data lakes/data warehouses).
• Collaborate with software engineers, product managers, platform engineers and support teams.
• Monitor, troubleshoot, and optimise the performance of data pipelines and systems.
• Work with AWS cloud platform to manage data infrastructure.
• Implement real-time data processing to support real-time analytics and decision-making.

Requirements

• Bachelor's degree in Computer Science, Data Engineering, Information Systems or a related field.
• 5-7 years experience in software engineering, with 3+ years in data engineering or similar role.
• Strong proficiency in SQL, including MySQL and PostgreSQL.
• Experience with data pipeline tools and frameworks (e.g., Apache Airflow, dbt, Luigi).
• Knowledge of cloud-native streaming tools like Amazon Kinesis.
• Familiarity with data storage and warehousing technologies (e.g., Snowflake, Redshift, BigQuery).
• Experience working with cloud platforms, ideally with AWS, using Docker and Kubernetes.
• Strong understanding of data modelling, normalisation, and performance optimisation.
• Knowledge of real-time data processing (Kafka, Spark Streaming, Flink).
• Familiarity with CI/CD pipelines and infrastructure as code (Terraform, CloudFormation).

Benefits

• Flexible working arrangements with equipment for home working.
• Highly competitive benefits package including private healthcare and rail discounts.
• Career development opportunities with focused training.
• Wellbeing seminars and membership to meditation apps.
• Opportunity to work for a tech company that is helping the environment.