Data Engineer

Job Title: Data Engineer (4+ Years Experience)
Location: Pan India
Job Type: Full-Time
Experience: 4+ Years
Notice Period: Immediate to 30 days preferred
Job Summary:
We are looking for a skilled and motivated Data Engineer with over 4+ years of experience in building and maintaining scalable data pipelines. The ideal candidate will have strong expertise in AWS Redshift and Python/PySpark, with exposure to AWS Glue, Lambda, and ETL tools being a plus. You will play a key role in designing robust data solutions to support analytical and operational needs across the organization.
Key Responsibilities:
Design, develop, and optimize large-scale ETL/ELT data pipelines using PySpark or Python.
Implement and manage data models and workflows in AWS Redshift.
Work closely with analysts, data scientists, and stakeholders to understand data requirements and deliver reliable solutions.
Perform data validation, cleansing, and transformation to ensure high data quality.
Build and maintain automation scripts and jobs using Lambda and Glue (if applicable).
Ingest, transform, and manage data from various sources into cloud-based data lakes (e.g., S3).
Participate in data architecture and platform design discussions.
Monitor pipeline performance, troubleshoot issues, and ensure data reliability.
Document data workflows, processes, and infrastructure components.
Required Skills:
4+ years of hands-on experience as a Data Engineer.
Strong proficiency in AWS Redshift including schema design, performance tuning, and SQL development.
Expertise in Python and PySpark for data manipulation and pipeline development.
Experience working with structured and semi-structured data (JSON, Parquet, etc.).
Deep knowledge of data warehouse design principles including star/snowflake schemas and dimensional modeling.
Good to Have:
Working knowledge of AWS Glue and building serverless ETL pipelines.
Experience with AWS Lambda for lightweight processing and orchestration.
Exposure to ETL tools like Informatica, Talend, or Apache Nifi.
Familiarity with workflow orchestrators (e.g., Airflow, Step Functions).
Knwledge of DevOps practices, version control (Git), and CI/CD pipelines.
Preferred Qualifications:
Bachelor degree in Computer Science, Engineering, or related field.
AWS certifications (e.g., AWS Certified Data Analytics, Developer Associate) are a plus.