Senior Site Reliability Engineer (HPC/Cloud)
Key Responsibilities:
Respond to and resolve operational incidents, identify root causes for critical issues, and implement strategies to prevent recurrence and improve platform resiliency.
Proactively create and manage monitoring, logging, and alerting systems to ensure high availability, performance, and visibility across all services.
Take a Site Reliability Engineering approach to our services, improving the deployment, monitoring and incident response end-to-end.
Solve complex technical problems, with SCP applications, infrastructure and end user’s use of the services.
Administer platform tools like Ansible, Vault, Consul, Prometheus, and Grafana to support core functions like configuration management, secrets management, monitoring, and observability.
Mentor and coach junior engineers in the team, fostering a collaborative and high-performing culture.
Drive automation for deployment and management processes using GitOps workflows as well as CI/CD pipelines.
Essential Knowledge, Skills, and Experience:
Experienced administering, maintaining and troubleshooting a Linux environment
Competent in automation and bash scripting
Highly customer focused; able to explain IT technical concepts in a manner which non-IT experts can understand
Hands-on experience working in a DevOps team and using agile methodologies
Plus some of the following areas of expertise:
Hands-on knowledge of a range of scientific and HPC applications such as simulation software, bioinformatics tools or 3D data visualization packages
Experience administering and optimizing SLURM
Experience deploying and administering OpenStack
Experience with configuration automation and infrastructure as code (e.g. Ansible, Hashicorp Terraform, AWS CloudFormation, Amazon Cloud Developer Kit)
Experience deploying infrastructure and code to public cloud, especially AWS
Experience with software distribution frameworks such as Easybuild or Spack
Familiarity with container runtimes such as Docker, Singularity or enroot
Experience with frameworks for regression tests and benchmarks for HPC applications, like Reframe HPC