Snowflake AWS Developer
Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. Strong proficiency in AWS and Snowflake. Expertise in DBT and Python programming. Experience with data modeling, ETL processes, and data warehousing. Familiarity with cloud platforms and services. Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities.
Design and develop robust ETL pipelines using Python, PySpark, and GCP services.
Build and optimize data models and queries in BigQuery for analytics and reporting.
Ingest, transform, and load structured and semi-structured data from various sources.
Collaborate with data analysts, scientists, and business teams to understand data requirements.
Ensure data quality, integrity, and security across cloud-based data platforms.
Monitor and troubleshoot data workflows and performance issues.
Automate data validation and transformation processes using scripting and orchestration tools.
Required Skills & Qualifications:
Hands-on experience with Google Cloud Platform (GCP), especially BigQuery.
Strong programming skills in Python and/or PySpark.
Experience in designing and implementing ETL workflows and data pipelines.
Proficiency in SQL and data modeling for analytics.
Familiarity with GCP services such as Cloud Storage, Dataflow, Pub/Sub, and Composer.
Understanding of data governance, security, and compliance in cloud environments.
Experience with version control (Git) and agile development practices.