Azure Databricks

Develop and maintain scalable data pipelines using Microsoft Fabric components.

Work with OneLake, Dataflows Gen2, and Lakehouse architectures.

Implement ETL/ELT processes for data ingestion, transformation, and loading.

Ensure data quality, integrity, and security across platforms.

Collaborate with cross-functional teams to gather requirements and deliver solutions.

Optimize performance of data workflows and troubleshoot issues.

Integrate data from diverse sources including cloud and on-prem systems.

Required Skills & Experience

Strong hands-on expertise with Microsoft Fabric tools and architecture.

Proficiency in SQL, Python, and Power BI.

Experience with Azure Data Services (e.g., Data Factory, Synapse Analytics).

Solid understanding of data modeling, data governance, and analytics.

Familiarity with CI/CD pipelines and DevOps practices.

Knowledge of Spark SQL, PySpark, and hybrid cloud deployments is a plus.