Senior Data Engineer - Remote

Overview

We are seeking a Senior Data Engineer with specialized expertise in data streaming technologies to join our data team. This role focuses on building and maintaining high-performance data streaming architectures that enable real-time data processing and analytics. The ideal candidate will have deep experience with Apache Kafka, AWS Managed Streaming for Apache Kafka (MSK), Amazon Kinesis, and related streaming technologies in cloud environments.

In Short

• Design, build, and maintain scalable streaming data architectures using Kafka, MSK, and Kinesis.
• Develop real-time data pipelines that handle high-volume, high-velocity data streams.
• Implement event-driven architectures and microservices patterns for streaming data processing.
• Create and optimize data streaming topologies for complex event processing scenarios.
• Design fault-tolerant streaming systems with proper error handling and data recovery mechanisms.
• Configure, deploy, and manage Apache Kafka clusters and AWS MSK environments.
• Implement Kafka Connect pipelines for streaming data integration.
• Monitor and optimize Kafka cluster performance, throughput, and latency.
• Implement Kafka security configurations including SSL/TLS, SASL, and ACLs.
• Manage Kafka Schema Registry for data serialization and evolution.

Requirements

• 7+ years of experience in the data engineering field with significant streaming data specialization.
• Bachelor's degree in Computer Science, Engineering, or related STEM field.
• Extensive hands-on experience with Apache Kafka including cluster management, performance tuning, and ecosystem tools.
• Proven experience with AWS MSK and Amazon Kinesis services in production environments.
• Strong background in real-time data processing and stream analytics.
• Proficient in Python, Java, and Scala for streaming applications.
• Experience with data serialization formats (Avro, JSON, Protobuf) and schema evolution.
• Deep knowledge of AWS streaming and analytics services (MSK, Kinesis, Lambda, EMR, Glue).
• Expert knowledge of Agile methodologies and delivery practices.
• Experience with CI/CD pipelines for streaming data applications.

Benefits

• Medical, dental, and vision health insurances.
• Short term disability, long term disability and life insurances.
• 401k with Company match.
• Paid time off (PTO) (120 hours PTO that accrue over one year).
• Paid time off for major holidays (14 days per year).