Data Engineer - Remote

Overview

As a Data Engineer at Kpler, you will help navigate complex markets by developing and implementing data ingestion and distribution pipelines, ensuring accurate data for clients in commodities, energy, and maritime sectors.

In Short

• Develop and implement core data ingestion and distribution pipelines.
• Optimize existing workflows for performance and efficiency.
• Ensure data integrity and accuracy across pipelines.
• Collaborate with other engineers on project requirements.
• Demonstrate strong analytical and debugging skills.
• Work with Python and data manipulation tools like Pandas.
• Familiarity with ETL processes and data integration.
• Knowledge of containerization tools like Docker and Kubernetes.
• Experience with SQL and Big Data technologies.
• Comfortable using Git and Agile methodologies.

Requirements

• Proficient in Python with experience in data manipulation.
• Understanding of ETL processes and data processing.
• Experience with Docker, Kubernetes, and Airflow.
• Familiarity with SQL and RDBMS.
• Experience with Git and Agile methodologies.
• Experience with AWS or other cloud providers is a plus.
• Proactive approach to learning and troubleshooting.
• Strong analytical and debugging skills.

Benefits

• Work with a team of over 600 experts from 35+ countries.
• Leverage cutting-edge innovation for impactful results.
• Experience unparalleled support on your journey to success.
• Opportunity to work in a dynamic market landscape.