Freelance Python Developer - Remote

Overview

dlt is an open-source library that automatically creates datasets out of messy, unstructured data sources. You can use the library to move data from about anywhere into most of well-known SQL and vector stores, data lakes, storage buckets, or local engines like DuckDB. It automates many cumbersome data engineering tasks and can be handled by anyone who knows Python.

We are looking for freelance help with building Iceberg support in dlt. We expect 3-4 weeks of full-time work and follow up projects in the future.

In Short

• Add Iceberg support to existing dlt destinations (Snowflake, BigQuery etc) with vendor supported mechanisms.
• Add support to read Iceberg data directly from Python via dlt supported interfaces (based on PyIceberg or DuckDB).
• Optionally to work on direct dlt support (writing data, catalog support, table maintenance).

Requirements

• Proficiency in Python.
• Experience with data engineering tasks.
• Familiarity with SQL and data storage solutions.
• Knowledge of Iceberg and its integration.
• Ability to work independently as a freelancer.

Benefits

• Flexible working hours.
• Opportunity for follow-up projects.
• Work on an innovative open-source project.