Senior Data Engineer - Remote

Overview

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. You will collaborate with cross-functional teams to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization.

In Short

• Design, develop, and maintain robust ETL/ELT pipelines to process and transform large datasets efficiently.
• Optimize data architecture and storage solutions to support analytics, machine learning, and business intelligence.
• Work with cloud platforms (AWS) to implement scalable data solutions.
• Ensure data quality, integrity, and security across all data pipelines.
• Collaborate with data scientists, analysts, and software engineers to support data-driven initiatives.
• Monitor and troubleshoot data workflows to ensure system performance and reliability.
• Create APIs to provide analytical information to our clients.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a related field.
• Strong proficiency in SQL and database technologies with (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).
• Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, Dagster).
• Proficiency in programming languages such as Python and Scala.
• Hands-on experience with AWS cloud data services.
• Familiarity with big data processing frameworks like Apache Spark.
• Knowledge of data modeling, warehousing concepts, and distributed computing.
• Experience implementing CI/CD for data pipelines.
• Real-time data processing and streaming architectures (RisingWave, Kafka, Flink).
• Database performance tuning and query optimization.
• Strong problem-solving skills and the ability to work independently and collaboratively.
• ETL/ELT pipeline development and automation.
• Cloud computing and infrastructure management on AWS (nice to have).

Benefits

• Direct and Speedy: We give candid feedback, push each other to set higher goals and produce more impact by always thinking “how do we do this faster and better”.
• Embrace a Sports Team Mentality: We are all helpful and collaborative internally.
• Silicon Valley to the World: We offer remote-working options with coworking memberships and annual in-person offsite gatherings.
• Valued for Your Individuality: We cherish your quirks and think it makes us stronger.
• Constant Improvement: The Topsort team is made of action-driven, intelligent, and curious individuals.
• Employee Stock Option Plan: Incentives for joining an early-stage fast-growing startup.