Python Airflow
WorkMode : work from office
Work Location : Chennai / Hyderabad / Bangalore
Work Timing : 2 PM to 11 PM
Primary : Python Airflow

Years of Experience: 7-10 Years

Job Summary: We are seeking an experienced Data Engineer with 6-9 years of overall experience, including at least 3 years working with AWS Airflow, to join our offshore teams. In this role, you will be instrumental in building and maintaining data pipelines that drive business insights and decision-making. You will collaborate closely with stakeholders to ensure data reliability, scalability, and availability for analytics and applications, helping the organization unlock the full value of its data assets.

Responsibilities:

• Design, build, and maintain robust data pipelines to support analytics and business operations.
• Collaborate with business and technical teams to understand data requirements and deliver effective solutions.
• Ensure data quality, consistency, and availability across multiple systems and environments.
• Monitor, troubleshoot, and optimize data workflows to maintain high performance and reliability.
• Support data governance initiatives by implementing standards for data management and security.
• Participate in planning and execution of data migration, integration, and transformation projects.
• Document processes and workflows to enable reproducibility and knowledge sharing across teams.
• Provide ongoing support for production data systems, ensuring minimal downtime and quick resolution of issues.
• AWS Airflow (workflow orchestration, DAG design, scheduling, monitoring) - Advanced (3+ years hands-on)
• AWS Cloud Services (S3, Lambda, Glue, Redshift, IAM) - Advanced
• Data Engineering Fundamentals (ETL, data pipelines, batch/stream processing) - Expert
• SQL (query optimization, joins, transformations) - Advanced
• Python (data manipulation, scripting, automation) - Advanced
• Data Governance & Security

Preferred Skills:

• Communication & Collaboration
• Performance Optimization
• Documentation & Knowledge Sharing
• Problem Solving & Troubleshooting

Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field.