Data Engineer

AWS  Data Engineer
SQL

JD
Design develop and maintain ETL processes using AWS Glue to extract transform and load data from various sources including S3 ORCParquetText files into AWS Redshift
Transform clean and preprocess data from various sources to load into Redshift and RDS
Python hands on working experience is mandatory
Optimize data pipelines for performance scalability and reliability
Implement data aggregation consolidation and enrichment
Create and manage Glue jobs workflows and crawlers
Design and implement data models and schemas in Amazon Redshift
Optimize Redshift performance through partitioning indexing and query optimization
Knowledge of big data technologies like Hadoop Spark or EMR
Skill
Familiarity with AWS services like S3 Lambda IAM CloudWatch and SNS
Experience with SQL Python and ETL tools
Strong handson experience with AWS Glue Amazon Redshift and AWS RDS                                
                                
Responsibility
Design develop and maintain ETL processes using AWS Glue to extract transform and load data from various sources including S3 ORCParquetText files into AWS Redshift
Transform clean and preprocess data from various sources to load into Redshift and RDS
Python hands on working experience is mandatory
Optimize data pipelines for performance scalability and reliability
Implement data aggregation consolidation and enrichment
Create and manage Glue jobs workflows and crawlers
Design and implement data models and schemas in Amazon Redshift
Optimize Redshift performance through partitioning indexing and query optimization
Knowledge of big data technologies like Hadoop Spark or EMR
Skill
Familiarity with AWS services like S3 Lambda IAM CloudWatch and SNS
Experience with SQL Python and ETL tools
Strong handson experience with AWS Glue Amazon Redshift and AWS RDS