Senior Databricks Engineer - Remote

Overview

We are seeking a highly skilled Sr. Databricks Engineer to design, develop and optimize scalable big data and analytics solutions.

In Short

• 10+ years of overall experience in data engineering or related fields.
• 4+ years of hands-on experience with Databricks and Apache Spark.
• Strong proficiency in PySpark SQL and performance tuning.
• Experience with ETL/ELT pipeline development and orchestration.
• Expertise in Delta Lake data modeling and optimization.
• Strong experience with cloud platforms such as Azure, AWS or GCP.
• Familiarity with Python or Scala for data engineering tasks.
• Experience with CI/CD pipelines and DevOps practices.
• Strong analytical problem-solving and communication skills.
• Ability to work independently in a remote setup.

Requirements

• Strong hands-on experience with Databricks, Apache Spark, and PySpark.
• Experience with Azure Data Factory, AWS Glue or similar orchestration tools.
• Expertise in SQL query optimization and large-scale data processing.
• Experience with data lakes, data warehouses, and modern analytics platforms.
• Knowledge of Git, Jenkins, Terraform or similar DevOps tools.
• Familiarity with Agile and Scrum methodologies.
• Databricks Certification (nice to have).
• Experience with Power BI, Tableau or other visualization tools (nice to have).
• Knowledge of streaming technologies such as Kafka or Spark Streaming (nice to have).
• Exposure to machine learning workflows and MLOps (nice to have).

Benefits

• Long-term contract opportunity.
• Remote work environment.
• Opportunity to work with cross-functional teams.
• Engagement in innovative big data solutions.
• Continuous learning and professional development.