Design and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity.Develop automated test scripts using Python or R for data validation and reconciliation.Perform source-to-target data verification, transformation logic testing, and regression testing.Collaborate with data engineers and analysts to understand business requirements and data flows.Identify data anomalies and work with development teams to resolve issues.Maintain test documentation, including test cases, test results, and defect logs.Participate in performance testing and optimization of data pipelines. Required Skills & Qualifications:Strong experience in ETL testing across various data sources and targets.Proficiency in Python or R for scripting and automation.Solid understanding of SQL and relational databases.Familiarity with data warehousing concepts and tools (e.g., Power BI, QlikView, Informatica, Talend, SSIS).Experience with test management tools (e.g., JIRA, TestRail).Knowledge of data profiling, data quality frameworks, and validation techniques.Excellent analytical and communication skills.
With 5 years of experience in Python, PySpark, and SQL, you will have the necessary skills to handle a variety of tasks. You will also have hands-on experience with AWS services, including Glue, EMR, Lambda, S3, EC2, and Redshift. Your work mode will be based out of the Virtusa office, allowing you to collaborate with a team of experts. Your main skills should include Scala, Kafka, PySpark, and AWS Native Data Services, as these are mandatory for the role. Additionally, having knowledge in Big Data will be a nice to have skill that will set you apart from other candidates.
