ResponsibilitiesOptimize data processing and transformation workflows for high performance analytics.Implement best practices for data governance, security, and compliance across Azure Data Lake and related technologies.Monitor, troubleshoot, and optimize the performance of data pipelines, ensuring high availability and reliability.Lead initiatives for the migration and integration of on premise data systems to Azure cloud based solutions.Drive the adoption of DevOps principles in data engineering to automate deployment and ensure continuous integration/continuous delivery CI CD practices.Required Skills and Qualifications:Bachelors degree in computer science, Information Technology, Data Science, or related field.5 plus years of experience in data engineering and visualization, with at least 3 years of hands-on experience working with Power BI, Azure Synapse Analytics, Azure Data Lake, Databricks and Azure Data Factory ADF.Proficient in Python, SQL for building data transformation and ETL pipelines.Strong knowledge of Power BI, including creating and publishing interactive dashboards, reports, and data models.Extensive knowledge of Azure Synapse Analytics for data warehousing, querying, and large-scale analytics.Strong knowledge of cloud data architecture and experience with building data lakes, data warehouses, and real-time data pipelines in Azure.Advanced experience with Databricks and Apache Spark for big data processing, transformation, and machine learning workflows.Solid understanding of data governance, data quality, and security best practices in cloud-based environments.Familiarity with DevOps practices and tools such as Azure DevOps, Git, and CI CD pipelines for data engineering workflows.Solid understanding of data modeling, ETL processes, and big data technologies.Strong problem-solving skills and the ability to troubleshoot complex data issues.Excellent communication skills, with the ability to present technical concepts to non-technical stakeholders.Power BIAzure SynapseADLSSQL Data databaseMicrosoft FabricAzure data servicesPipeline orchestrationPythonPySpark
Required Skills and Qualifications: Bachelors degree in computer science, Information Technology, Data Science, or related field. 5 plus years of experience in data engineering and visualization, with at least 3 years of hands-on experience working with Power BI, Azure Synapse Analytics, Azure Data Lake, Databricks and Azure Data Factory ADF. Proficient in Python, SQL for building data transformation and ETL pipelines. Strong knowledge of Power BI, including creating and publishing interactive dashboards, reports, and data models. Extensive knowledge of Azure Synapse Analytics for data warehousing, querying, and large-scale analytics. Strong knowledge of cloud data architecture and experience with building data lakes, data warehouses, and real-time data pipelines in Azure. Advanced experience with Databricks and Apache Spark for big data processing, transformation, and machine learning workflows. Solid understanding of data governance, data quality, and security best practices in cloud-based environments. Familiarity with DevOps practices and tools such as Azure DevOps, Git, and CI CD pipelines for data engineering workflows. Solid understanding of data modeling, ETL processes, and big data technologies. Strong problem-solving skills and the ability to troubleshoot complex data issues. Excellent communication skills, with the ability to present technical concepts to non-technical stakeholders.
Power BI Azure Synapse ADLS SQL Data database Microsoft Fabric Azure data services Pipeline orchestration Python PySpark
