Senior Data Engineer - Remote

Overview

The Senior Data Engineer at PulsePoint will be responsible for designing, building, and maintaining scalable data processing systems that support business initiatives while ensuring data quality and accessibility.

In Short

• Design and maintain distributed transactional data processing systems.
• Optimize jobs using Kafka, Hadoop, Presto, Spark, and Kubernetes.
• Monitor data quality across systems.
• Collaborate with analysts and data scientists to enhance data accessibility.
• Provide mentorship to junior team members.
• Work with a diverse technology team.
• Ingest and validate internal and third-party data.
• Create and monitor data flows using Python, Spark, Hive, SQL, and Presto.
• Evaluate tools for performance improvements.
• Ensure high availability and capacity planning for data systems.

Requirements

• 6+ years of data engineering experience.
• Fluency in Python and SQL.
• Strong experience with Spark.
• Experience with Hadoop and Hive.
• Proficiency in Linux.
• Understanding of RDBMS and query optimization.
• Knowledge of distributed production systems.
• Experience with cloud migration is a plus.
• Ability to work East Coast U.S. hours (9am-6pm EST).
• Notice period needs to be less than 2 months.

Benefits

• Opportunity for personal and professional growth.
• Work with cutting-edge technologies.
• Collaborative team environment.
• Flexible remote working options.
• Engagement in innovative projects.