Job Description:Design, develop, and maintain data pipelines and ETL processes using Databricks.Manage and optimize data solutions on cloud platforms such as Azure and AWS.Implement big data processing workflows using PySpark.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.Ensure data quality and integrity through rigorous testing and validation.Optimize and tune big data solutions for performance and scalability.Stay updated with the latest industry trends and technologies in big data and cloud computing.Requirements:Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.Proven experience as a Big Data Engineer or similar role.Strong proficiency in Databricks and cloud platforms (Azure/AWS).Expertise in PySpark and big data processing.Experience with data modeling, ETL processes, and data warehousing.Familiarity with cloud services and infrastructure.Excellent problem-solving skills and attention to detail.Strong communication and teamwork abilities.Preferred Qualifications:Experience with other big data technologies and frameworks.Knowledge of machine learning frameworks and libraries.Certification in cloud platforms or big data technologies.
As a Consultant at Virtusa, you will be responsible for providing expert advice and guidance to clients on various business and technology related matters. With a minimum of 5 years of work experience, you will be expected to have a strong understanding of the industry and be able to provide strategic solutions to clients. You will work from Virtusa's office and be part of a dynamic team, collaborating with other experts to deliver high quality services to clients. Your role will involve conducting research, analyzing data, and presenting your findings to clients. You will also be responsible for managing client relationships and ensuring that their needs are met. This is a challenging and rewarding role that will allow you to utilize your skills and expertise to help clients achieve their business goals.
