Senior Data Specialist - Remote

Overview

The Senior Data Specialist will be responsible for managing and analyzing data using various tools and technologies, focusing on complex transformation pipelines and real-time data ingestion.

In Short

• Utilize ETL fundamentals and SQL for data manipulation.
• Work with BigQuery and Dataproc for data processing.
• Implement data warehousing solutions.
• Develop and manage data pipelines using Python and PySpark.
• Utilize Airflow for orchestration of data workflows.
• Handle real-time data ingestion with technologies like Kafka.
• Integrate APIs for data workflows.
• Deploy and scale applications using Kubernetes.
• Ensure data quality and validation processes are in place.
• Familiarity with logistics or healthcare domains is a plus.

Requirements

• 3+ years of experience with Python & PySpark.
• 2+ years of experience with Airflow or another orchestration tool.
• 3+ years of experience with Google Cloud Platform.
• 2+ years of experience with real-time data ingestion.
• 2+ years of experience with API integration.
• 1-2 years of experience with Kubernetes.
• 2+ years of experience with BigQuery SQL & PostgreSQL.
• 2+ years of experience with YAML/config-driven pipeline design.
• 2+ years of experience with schema transformation and data quality frameworks.
• Familiarity with CI/CD practices is a bonus.

Benefits

• Equal opportunity employer.
• Opportunities for professional growth and development.
• Dynamic work environment.
• Access to cutting-edge technologies.
• Collaborative team culture.