Data Engineer - Remote

Overview

We are looking for a Data Engineer for the Sweed product startup remote. At Sweed, we provide a comprehensive cannabis retail solution featuring robust POS functionality, detailed analytics, marketing tools, and efficient inventory management.

In Short

• Be part of Data platform team, work on Data platform (Dagster+Dbt+Airbyte+Clickhouse) stability, functionality and performance.
• Maintain and improve data pipelines to ensure that data is reliable, trustworthy, and not broken.
• Troubleshoot and resolve issues related to system and application performance.
• Add new sources to data lake, guarantee quality of data.
• Improve export of raw data to client’s s3.
• Implement fully-automated creation of documentation of exported data.
• Improve observability of data platform.
• Experience in setting up ingestion pipelines and integrating various data sources.
• Creating and optimizing data transformation models using dbt.
• Knowledge of one or more data pipeline orchestration frameworks.

Requirements

• Experience in setting up ingestion pipelines and integrating various data sources (Airbyte, Fivetran).
• Creating and optimizing data transformation models using dbt, working with macros, writing tests for data quality.
• Knowledge of one or more data pipeline orchestration frameworks, such as Dagster (preferred), Airflow, Kestra.
• Proficiency in SQL.
• Hands-on experience with ClickHouse: Designing and optimizing queries, storage structures, working with large data sets.
• Experience with Python.
• Terraform knowledge.
• Knowledge of DevOps practices: docker, k8s, helm charts.
• Upper-Intermediate English level.
• Proactive individuals who engage in feedback sessions.

Benefits

• Flexible working hours.
• Remote-first company.
• 20 working days of vacation per year.
• 3 sick leave days.
• Medical insurance after the probation period.
• Equipment reimbursement for essential items.