Java Kafka with AWS

Job Title: Senior Kafka Engineer AWS MSK & ECS Infrastructure
Role Overview
We are seeking a highly skilled Kafka Engineer to lead the setup, deployment, and monitoring of Kafka components on AWS. The ideal candidate will have hands-on experience with AWS MSK, ECS, GitLab CI/CD, and observability tools like Prometheus and Grafana.
Key Responsibilities
Kafka Infrastructure Setup
Design and implement AWS MSK setup using CloudFormation templates.
Automate deployment processes via GitLab pipelines.
Kafka Ecosystem Component Hosting on AWS ECS
Deploy and manage:
Kafka Connect
Kafka Proxy
Schema Registry
Cruise Control
AKHQ (Kafka GUI Tool)
Monitoring & Observability:
Integrate Prometheus and Grafana for MSK monitoring.
Design dashboards and alerting mechanisms.
Host monitoring stack on AWS ECS if required.
AWS ECS Setup:
Create ECS infrastructure using CloudFormation.
Automate ECS deployments via GitLab.
Required Skills:
Strong expertise in Kafka and its ecosystem.
Experience with AWS MSK and ECS.
Proficiency in CloudFormation and GitLab CI/CD.
Familiarity with Prometheus and Grafana.
Ability to troubleshoot and optimize Kafka performance.
Strong scripting and automation skills.
Preferred Qualifications:
AWS certifications (Solutions Architect, DevOps Engineer).
Experience in container orchestration and microservices architecture.
Knowledge of security best practices in cloud deployments.