🌎
This job posting isn't available in all website languages

Databricks Setup with AWS

📁
Lead Software Engineer
📅
CREQ223111 Requisition #
Job Description :
We are looking for a Databricks Setup Specialist to lead the deployment and configuration of Databricks on AWS, focusing on PrivateLink integration and Unity Catalog administration. This role involves collaboration with AWS DevOps and Security teams to create a secure and compliant data platform.
Key Responsibilities:
Deploy Databricks workspaces on AWS with secure access via PrivateLink.
Integrate Databricks with VPCs, IAM roles, and security groups alongside AWS DevOps engineers.
Administer Unity Catalog, managing workspace binding, permissions, and audit logging.
Implement best practices for identity federation and role-based access controls (RBAC).
Troubleshoot configuration and connectivity issues to minimize downtime.
Document setup procedures and provide training for users and administrators.
Required Qualifications:
3+ years of experience with Databricks on AWS.
Expertise in AWS services like VPC, PrivateLink, IAM, and S3.
Experience with Unity Catalog in enterprise settings.
Familiarity with DevOps tools for infrastructure automation.
Understanding of data governance and compliance requirements.
Strong problem-solving and communication skills.
Preferred Qualifications:
Experience with multi-workspace Databricks environments.
Knowledge of Lakehouse architecture and data lineage tools.
Relevant Databricks and AWS certifications.

Job Description :
We are looking for a Databricks Setup Specialist to lead the deployment and configuration of Databricks on AWS, focusing on PrivateLink integration and Unity Catalog administration. This role involves collaboration with AWS DevOps and Security teams to create a secure and compliant data platform.
Key Responsibilities:
Deploy Databricks workspaces on AWS with secure access via PrivateLink.
Integrate Databricks with VPCs, IAM roles, and security groups alongside AWS DevOps engineers.
Administer Unity Catalog, managing workspace binding, permissions, and audit logging.
Implement best practices for identity federation and role-based access controls (RBAC).
Troubleshoot configuration and connectivity issues to minimize downtime.
Document setup procedures and provide training for users and administrators.
Required Qualifications:
3+ years of experience with Databricks on AWS.
Expertise in AWS services like VPC, PrivateLink, IAM, and S3.
Experience with Unity Catalog in enterprise settings.
Familiarity with DevOps tools for infrastructure automation.
Understanding of data governance and compliance requirements.
Strong problem-solving and communication skills.
Preferred Qualifications:
Experience with multi-workspace Databricks environments.
Knowledge of Lakehouse architecture and data lineage tools.
Relevant Databricks and AWS certifications.

Previous Job Searches

Similar Listings

Chennai, Tamil Nadu, India

📁 Lead Software Engineer

Requisition #: CREQ224664

Chennai, Tamil Nadu, India

📁 Lead Software Engineer

Requisition #: CREQ224154

Chennai, Tamil Nadu, India

📁 Lead Software Engineer

Requisition #: CREQ221117