Design and develop scalable data applications using Python and Spark for batch and streaming data processing Build, orchestrate and optimize AWS Glue jobs to handle large scale ETL workflows across diverse data sources Collaborate with data engineers and analysts to implement business logic and data transformations efficiently implement robust error handling, logging and performance tuning for high-throughput data pipelines. Ensure code quality reusability and deployment readiness by following best practices and CI/CD standards. Tech Stack - Python, Spark, AWS Lambda, OAUTH, AppFlow, AWS Glue, S3,
Design and develop scalable data applications using Python and Spark for batch and streaming data processing Build, orchestrate and optimize AWS Glue jobs to handle large scale ETL workflows across diverse data sources Collaborate with data engineers and analysts to implement business logic and data transformations efficiently implement robust error handling, logging and performance tuning for high-throughput data pipelines. Ensure code quality reusability and deployment readiness by following best practices and CI/CD standards. Tech Stack - Python, Spark, AWS Lambda, OAUTH, AppFlow, AWS Glue, S3,
