🌎
This job posting isn't available in all website languages

Platform Eng(Ingesion Jobs, Integration)

📁
Lead Software Engineer
📅
CREQ258976 Requisition #

Job Title: Integration Engineer (Offshore)

Role Overview

This is an offshore role responsible for building and operating the integration layer that connects an enterprise Agentic AI platform to messaging, external APIs, enterprise systems, and downstream data platforms — Kafka, API gateways, on-premises connectivity, and streaming into the lakehouse — ensuring reliable, secure, and observable data flow across non-production and production within a follow-the-sun delivery model.

Key Responsibilities

  • Build and operate Kafka / Confluent integrations, including consumers and producers, SASL/OAUTHBEARER authentication, and offset management.

  • Configure and maintain API gateway integrations across APIGEE and Azure API Management — proxies, policies, rate limiting, and runtime credential management.

  • Implement and operate Azure Service Bus messaging topologies, including topics, queues, sessions, and dead-letter queues.

  • Support integration with on-premises systems via enterprise API gateways using OAuth 2.0 token exchange.

  • Stream integrated data into downstream data platforms, including Databricks and Delta tables via Kafka or Azure Event Hubs.

  • Build integration error-handling, retry, and dead-letter replay patterns, and develop integration tests covering happy and unhappy paths.

  • Build and maintain Terraform Infrastructure-as-Code for integration and related platform services, and implement CI/CD using GitHub Actions.

  • Monitor integration health using Application Insights and Dynatrace, and troubleshoot connectivity, authentication, and throughput issues.

  • Maintain operational runbooks and provide follow-the-sun / on-call support.

Qualifications & Experience

  • 4+ years experience in integration engineering.

  • Hands-on experience with Kafka (Confluent) — consumer development, authentication, and offset management.

  • Experience with API gateways (APIGEE and/or Azure API Management), including policy authoring.

  • Experience with Azure Service Bus — topics, queues, sessions, and dead-letter handling.

  • Strong understanding of OAuth 2.0 / OpenID Connect and token-exchange flows.

  • Experience with REST API integration, Python development, and Terraform Infrastructure as Code.

  • Awareness of streaming into data platforms such as Databricks or Delta Lake.

  • Strong troubleshooting and analytical skills.

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline.

Preferred Skills

  • Experience with IBM DataPower and IBM App Connect Enterprise.

  • Experience with Spark Structured Streaming or Delta Lake ingestion.

  • Experience with Azure Managed Identity and MSAL for credential-free authentication.

  • Familiarity with Confluent Schema Registry and GitHub Actions CI/CD.

  • Familiarity with ITIL-based enterprise service management processes.

Job Title: Integration Engineer (Offshore)

Role Overview

This is an offshore role responsible for building and operating the integration layer that connects an enterprise Agentic AI platform to messaging, external APIs, enterprise systems, and downstream data platforms — Kafka, API gateways, on-premises connectivity, and streaming into the lakehouse — ensuring reliable, secure, and observable data flow across non-production and production within a follow-the-sun delivery model.

Key Responsibilities

  • Build and operate Kafka / Confluent integrations, including consumers and producers, SASL/OAUTHBEARER authentication, and offset management.

  • Configure and maintain API gateway integrations across APIGEE and Azure API Management — proxies, policies, rate limiting, and runtime credential management.

  • Implement and operate Azure Service Bus messaging topologies, including topics, queues, sessions, and dead-letter queues.

  • Support integration with on-premises systems via enterprise API gateways using OAuth 2.0 token exchange.

  • Stream integrated data into downstream data platforms, including Databricks and Delta tables via Kafka or Azure Event Hubs.

  • Build integration error-handling, retry, and dead-letter replay patterns, and develop integration tests covering happy and unhappy paths.

  • Build and maintain Terraform Infrastructure-as-Code for integration and related platform services, and implement CI/CD using GitHub Actions.

  • Monitor integration health using Application Insights and Dynatrace, and troubleshoot connectivity, authentication, and throughput issues.

  • Maintain operational runbooks and provide follow-the-sun / on-call support.

Qualifications & Experience

  • 4+ years experience in integration engineering.

  • Hands-on experience with Kafka (Confluent) — consumer development, authentication, and offset management.

  • Experience with API gateways (APIGEE and/or Azure API Management), including policy authoring.

  • Experience with Azure Service Bus — topics, queues, sessions, and dead-letter handling.

  • Strong understanding of OAuth 2.0 / OpenID Connect and token-exchange flows.

  • Experience with REST API integration, Python development, and Terraform Infrastructure as Code.

  • Awareness of streaming into data platforms such as Databricks or Delta Lake.

  • Strong troubleshooting and analytical skills.

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline.

Preferred Skills

  • Experience with IBM DataPower and IBM App Connect Enterprise.

  • Experience with Spark Structured Streaming or Delta Lake ingestion.

  • Experience with Azure Managed Identity and MSAL for credential-free authentication.

  • Familiarity with Confluent Schema Registry and GitHub Actions CI/CD.

  • Familiarity with ITIL-based enterprise service management processes.

Previous Job Searches

Similar Listings

Pune, Maharashtra, India

📁 Lead Software Engineer

Requisition #: CREQ260748

Pune, Maharashtra, India

📁 Lead Software Engineer

Requisition #: CREQ260911

Pune, Maharashtra, India

📁 Lead Software Engineer

Requisition #: CREQ247391