We are seeking a skilled Azure Databricks Engineer to design, develop, and optimize large-scale data processing systems using Azure Databricks. The ideal candidate will have expertise in Apache Spark, data engineering pipelines, and Azure cloud technologies.

In Short

Design and implement data ingestion and transformation pipelines using Azure Databricks.
Develop ETL/ELT processes for various data types.
Optimize and tune Apache Spark jobs for performance.
Build scalable data lakehouse solutions using Delta Lake.
Integrate Databricks with Azure Synapse Analytics and Data Factory.
Implement security best practices in data processing.
Collaborate with data scientists to operationalize machine learning models.
Automate workflows with Databricks Jobs and CI/CD pipelines.
Monitor and troubleshoot performance issues in Databricks clusters.

Requirements

2+ years of experience with Azure Databricks and Apache Spark.
Strong programming skills in Python, Scala, and SQL.
Expertise in Azure Data Lake, Blob Storage, and Azure Data Factory.
Hands-on experience with CDC tools and frameworks.
Knowledge of Spark job performance tuning strategies.
Experience with CI/CD for Databricks.
Strong understanding of data security in cloud environments.
Excellent problem-solving skills.

Benefits

Unlimited vacation policy.
Significant 401k contributions.
Opportunities for personal development.
Competitive compensation.
A collaborative and supportive team environment.

Resultant

Resultant is a rapidly growing consulting firm that specializes in assisting public sector clients with their complex IT, data, and management challenges. The company is focused on driving business development and strategy, particularly within the Justice practice, while fostering strong executive-level client relationships. Resultant values collaboration with both internal teams and external stakeholders, and actively promotes its brand at industry events. The firm offers a dynamic work environment with benefits such as unlimited vacation, significant 401k contributions, and opportunities for personal development.

Share This Job!

Save This Job!

Jobs from Resultant:

Director of Google Workspace Sales

Google Workspace

Sales Strategy

Team Leadership

Client Service Network Engineer

Network Engineering

Routing

Switching

Vertical CTO - Solution Architect