Senior Data Engineer - Remote

Overview

We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data engineering team. The ideal candidate will have hands-on expertise in real-time data streaming platforms such as Flink, Spark, or similar technologies, as well as a strong background in ETL processes, cloud deployment, and CI/CD pipelines. A deep proficiency in Java, Python, and Node.js is required, along with advanced knowledge of SQL queries. As a Senior Data Engineer, you will be responsible for designing and implementing scalable, high-performance data systems to support complex data pipelines and analytics applications.

In Short

• Design, build, and maintain real-time data pipelines and streaming platforms using tools like Apache Flink, Apache Spark, or other similar technologies.
• Develop and optimize ETL (Extract, Transform, Load) workflows to process and analyze large volumes of data.
• Write clean, maintainable, and efficient code in Java, Python, and Node.js for data processing tasks.
• Collaborate with data scientists, analysts, and other engineers to develop robust, scalable data solutions.
• Leverage cloud technologies to deploy and manage data pipelines and solutions, ensuring high availability and fault tolerance.
• Build and maintain data infrastructure in cloud environments, particularly AWS (Amazon Web Services) or other cloud platforms.
• Implement and maintain CI/CD pipelines for efficient and automated deployment of data applications.
• Monitor and troubleshoot data pipelines and systems to ensure optimal performance and address any issues in real-time.
• Write and optimize SQL queries to interact with and validate data stored in relational and NoSQL databases.
• Develop and enforce best practices for data engineering, including code reviews, testing, and documentation.

Requirements

• 5+ years of experience in data engineering with a strong focus on real-time streaming platforms like Apache Flink, Apache Spark, or other similar tools.
• Solid experience with ETL tools and frameworks (e.g., Apache Nifi, Airflow, etc.) is a plus.
• Proven expertise in cloud deployment, particularly within AWS, but knowledge of other cloud platforms (Google Cloud, Azure) is beneficial.
• Strong programming skills in Java, Python, and Node.js.
• Proficient in SQL for data manipulation, validation, and optimization.
• In-depth understanding of real-time data streaming and related tools (e.g., Flink, Spark Streaming).
• Experience with data storage solutions such as Hadoop, Kafka, NoSQL, Snowflake databases (e.g., MongoDB, Cassandra), and relational databases.
• Solid understanding of CI/CD pipelines and experience with tools like Jenkins, GitLab CI, CircleCI, or similar.
• Familiarity with Docker and container orchestration tools (e.g., Kubernetes) is a plus.

Benefits

• Flexibility and a culture built on trust.
• Opportunities for growth and development.
• Supportive work environment that values diversity, equity, and inclusion.