The Databricks Platform Administrator will be responsible for deploying, configuring, and maintaining Azure Databricks workspaces, ensuring optimal performance and security.
In Short
Deploy, configure, and maintain Azure Databricks workspaces.
Manage clusters, pools, and jobs for optimal performance.
Handle Databricks Runtime upgrades and compatibility testing.
Implement Identity and Access Management (IAM) using Azure AD.
Set up Role-Based Access Control (RBAC) and network security.
Monitor cluster performance and optimize costs.
Integrate Databricks with various data sources.
Automate cluster management using Terraform.
Troubleshoot job failures and provide L2/L3 support.
Collaborate with Databricks support for bug fixes.
Requirements
Experience with Azure Databricks and related technologies.
Strong understanding of IAM and RBAC.
Familiarity with performance monitoring and optimization.
Experience with Terraform and CI/CD pipelines.
Ability to troubleshoot and resolve technical issues.