DevOps Engineer (AI Platform)
DevOps Engineer (AI Platform)
This role would be more on the implementation side focusing on implementing and operating the platform. They will handle LLM model onboarding configs, manage deployments using Helm/ArgoCD. They will also help maintain CI/CD pipelines
Key skills to look for:
Basic to High level understanding LLM integration
LLM Fundamentals:LLM API familiarity (understanding tokens, TPM/RPM limits,
context windows, model versioning
Programming Python: (for Gateway configurations, hooks, and custom callbacks)
Working knowledge of Kubernetes
Helm and ArgoCD / GitOps experience
Docker and CI/CD pipelines
AWS / cloud deployment exposure
YAML-based configuration management