Senior Data Engineer
Data Sr. Developer
- Role Overview Lead the engineering efforts to build pipelines, CDC connections, and lakehouse foundations bridging the legacy estate to the cloud.
- Key Responsibilities
- Develop data pipelines using Databricks Live Tables, PySpark, and AWS Lambda/Kinesis for all data types.
- Implement CDC using AWS DMS to apply daily delta extracts from Oracle/DB2 to AWS Aurora/PostgreSQL.
- Build transformation frameworks for data validation, cleansing, and business logic within the Curated and Foundation layers.
- Expose data products through APIs and Event-driven streams for downstream microservices.
- Required Skills
- Advanced programming skills in Python/Scala (PySpark) and SQL.
- Hands-on experience with Databricks Workflows and Delta Lake architecture.
- Experience managing AWS DMS, Kafka, or similar event-driven/CDC streaming technologies.
- AI Augmentation/Vibe Coding knowledge required
Data Sr. Developer
- Role Overview Lead the engineering efforts to build pipelines, CDC connections, and lakehouse foundations bridging the legacy estate to the cloud.
- Key Responsibilities
- Develop data pipelines using Databricks Live Tables, PySpark, and AWS Lambda/Kinesis for all data types.
- Implement CDC using AWS DMS to apply daily delta extracts from Oracle/DB2 to AWS Aurora/PostgreSQL.
- Build transformation frameworks for data validation, cleansing, and business logic within the Curated and Foundation layers.
- Expose data products through APIs and Event-driven streams for downstream microservices.
- Required Skills
- Advanced programming skills in Python/Scala (PySpark) and SQL.
- Hands-on experience with Databricks Workflows and Delta Lake architecture.
- Experience managing AWS DMS, Kafka, or similar event-driven/CDC streaming technologies.
- AI Augmentation/Vibe Coding knowledge required