Data Engineer (Python/Databricks) - Remote

Overview

Softermii is an outsourcing/outstaffing company focused on web and mobile application development, seeking a Data Engineer to develop and maintain scalable data pipelines using Databricks.

In Short

• Develop and maintain scalable data pipelines using Databricks (Apache Spark).
• Work with data scientists and analysts to provide reliable data sets.
• Optimize data workflows and orchestrate jobs for data transformation.
• Design data ingestion frameworks for various data sources.
• Ensure data quality and governance using Unity Catalog and Delta Live Tables.
• Collaborate with cross-functional teams for machine learning workflows.
• Apply data engineering best practices including versioning and testing.
• 3+ years of experience in data engineering or big data development.
• Proficiency in Python or Scala and SQL.
• Upper-Intermediate English level required.

Requirements

• 3+ years of experience in data engineering or big data development.
• Bachelor’s or Master’s degree in Computer Science or related field.
• Proficiency in Python (or Scala) and SQL for data processing.
• Hands-on experience with Apache Spark and Databricks Notebooks.
• Familiarity with Databricks Workflows and Delta Live Tables.
• Solid understanding of data lakehouse architecture.
• Experience integrating data from cloud sources like AWS S3.
• Knowledge of orchestration tools and CI/CD practices.
• Strong communication and collaboration skills.
• Upper-Intermediate English level.

Benefits

• Stable and highly-functioning processes with clear responsibilities.
• Independence to make impactful decisions.
• Team of like-minded experts creating interesting products.
• 50% reimbursement for professional development courses.
• Individual development plan with mentoring from seniors.
• Referral bonus system for recommending friends.
• 21 working days off per year.
• 5 sick leaves per year.
• Opportunities for volunteering and community support.
• Empathetic HR support for employee well-being.