Platform Engineer
Platform Eng (Ingestion Jobs / Integration) – Offshore
A modern ingestion platform typically follows a decoupled, event-driven architecture to handle data coming from various sources (APIs, Webhooks, Databases, Third-party SaaS) and moving to various destinations (Data Lakes, Warehouses, Internal Microservices).
Key Focus Building and maintaining the framework that feeds the Databricks Lakehouse. This includes Kafka/Kinesis streams, Debezium for CDC, or batch integration tools (Airflow, Fivetran) to ensure raw data flows seamlessly from external systems into the Bronze layer.
Platform Eng (Ingestion Jobs / Integration) – Offshore
A modern ingestion platform typically follows a decoupled, event-driven architecture to handle data coming from various sources (APIs, Webhooks, Databases, Third-party SaaS) and moving to various destinations (Data Lakes, Warehouses, Internal Microservices).
Key Focus Building and maintaining the framework that feeds the Databricks Lakehouse. This includes Kafka/Kinesis streams, Debezium for CDC, or batch integration tools (Airflow, Fivetran) to ensure raw data flows seamlessly from external systems into the Bronze layer.