Freelance Data Engineer for Iceberg Support - Remote

Overview

dlt is an open-source library that automatically creates datasets out of messy, unstructured data sources. You can use the library to move data from about anywhere into most of well-known SQL and vector stores, data lakes, storage buckets, or local engines like DuckDB. It automates many cumbersome data engineering tasks and can be handled by anyone who knows Python.

In Short

• Freelance position for building Iceberg support in dlt.
• Expected duration: 3-4 weeks of full-time work.
• Follow-up projects may be available in the future.
• Add Iceberg support to existing dlt destinations (Snowflake, Bigquery, etc.).
• Implement support to read iceberg data directly from Python.
• Work on direct dlt support (writing data, catalog support, table maintenance) is optional.

Requirements

• Proficiency in Python.
• Experience with data engineering tasks.
• Familiarity with Iceberg and related technologies.
• Knowledge of SQL and data storage solutions.

Benefits

• Flexible working hours.
• Opportunity to work on open-source projects.
• Potential for ongoing collaboration.