Automation QA

3 to 6 years of experience in Testing. Preferably in Apache Spark.

validating huge amounts of data that is transformed.

The key idea is that Apache Spark workers run on multiple nodes and store the intermediate results in RAM.

Should be experienced in Apache Spark and test Spark jobs Written in Java

Must me experienced in Java, JUNITs, Selenium, Jenkins, Maven, TestNG.

Must have development experience and review code.
And proceed on validating code

Project migration validation from old version
Review custom code, dependencies and check for compatibility issues and resolve

Validate the identified dependent Jars for Spark Jobs has been taken care as part of the upgrade

Dev background is good to validate the developed code and proceed with testing