Skip to main content

Senior Site Reliability Automation Engineer

L5

ags american gaming systemsKansas City, MOtoday
Job Overview: Our Interactive division delivers online games to players worldwide. Many development and QA teams support that business: platform services teams and multiple game studios, each often running several projects in parallel. We are modernizing how all of them build, deploy, and run software, and we need the workloads that result to be reliable, observable, and recoverable. You will join the central Cloud & DevOps Platform team as a Senior Site Reliability Engineer. The team owns the standards, architecture, implementation, and ongoing improvement of our CI/CD, infrastructure, and Infrastructure as Code (IaC), and the centralized foundation that promotes software to stage and production environments across the globe. Those environments span AWS, other providers, and bare metal. Your focus is the reliability of the workloads running on that foundation and effective response when something goes wrong. Our current infrastructure is largely static virtual machines monitored with Zabbix, and that monitoring will remain in place for some time. We are moving to a dynamic, container-based architecture, and we need to build out a Prometheus and Grafana solution to support it. You will work with both: keeping Zabbix-based monitoring effective for the existing estate while helping build the new observability stack. This is an individual contributor role.
Reliability of Running Workloads: Keep production and stage workloads healthy across a multi-account, multi-region AWS environment and across third-party hosted and bare-metal environments. Operate and troubleshoot Kubernetes workloads on EKS and on provider-hosted and bare-metal clusters managed centrally with Rancher. Operate AWS-only supporting workloads (automation, observability, internal tooling) running on ECS with Fargate. Support VM-based servers at third-party hosting providers that are reachable over SSH only, as they evolve toward container clusters. Define and track service level indicators and objectives (SLIs/SLOs) and error budgets for key services, working with the teams that own them. Perform capacity planning, performance analysis, and resilience reviews, including failure-mode and disaster recovery considerations for multi-region designs.
Incident Response and On-Call: Participate in an on-call rotation and respond to production incidents, working from detection through mitigation and recovery. Diagnose problems across the stack: application, container, node, network, cloud service, and CI/CD or infrastructure change. Write blameless post-incident reviews and drive the resulting corrective actions to completion. Build and maintain runbooks, and use them to cut time to resolution. Follow and help refine standard steps for security-related incidents, in coordination with the security function.
Observability: Build, maintain, and tune monitoring for the existing static VM estate in Zabbix, including creating monitors, triggers, and alerts and working with Zabbix data and configuration. Help build out a Prometheus and Grafana solution to monitor the new dynamic, container-based architecture, alongside AWS CloudWatch. Build and tune dashboards, alerting, and logging across both the existing and new environments. Design alerts around symptoms and SLOs rather than noise, and continuously reduce alert fatigue. Provide the visibility that dev and QA teams need to understand the health of their own workloads.
Automation and Toil Reduction:
  • Automate routine operational tasks and common issue resolution with Python, Bash, and similar scripting.
  • Contribute to Terraform/OpenTofu and Ansible code for reliability-related infrastructure, following the team's IaC standards and review process.
  • Work with the CI/CD and platform engineers so that reliability requirements are built into pipelines, golden images, and templates rather than added afterward.
  • Help keep CI/CD tooling (Jenkins, Nexus, and related services) healthy and measurable as a dependency of every release.
  • Security (a first-class concern in everything above)
  • Apply least-privilege access, patching, vulnerability response, and secrets hygiene to the systems you operate.
  • Support the reduction of shared-credential risk, such as shared SSH keys, without disrupting running systems.
  • Ensure that operational changes are auditable and consistent with our security and compliance standards.
Team and Standards: Contribute to standards for monitoring, alerting, logging, tagging, and operational readiness. Write clear documentation so that other technical teams can adopt operational practices on their own. Collaborate with dev and QA leads across studios and platform teams to understand their needs and balance self-service with reliability and compliance. Skills/Requirements 8+ years in SRE, DevOps, platform, or production operations engineering, including current hands-on work (in your present or most recent role) and a minimum of 4 consecutive years of hands-on work with the core tools below. Hands-on production Linux administration and troubleshooting, with strong open-source tooling fluency. Kubernetes operations experience in production (EKS or equivalent), including troubleshooting workloads, nodes, networking, and storage. Solid AWS experience in a multi-account, multi-region environment, including VPC and networking, IAM, and the services that support running workloads. Hands-on Prometheus, Grafana, and AWS CloudWatch experience, including alert design, dashboards, and metric instrumentation. Working experience with Zabbix, including building monitors, triggers, and alerts and interfacing with it for monitoring static VM-based infrastructure. Demonstrated incident response and on-call experience, including post-incident reviews and corrective action follow-through. Practical experience defining and using SLIs, SLOs, and error budgets. Strong scripting and automation skills (Python and/or Bash).Working experience with Terraform and/or OpenTofu, including reading, reviewing, and modifying modules safely. A security-first mindset, demonstrated through concrete examples in access design, patching, and incident handling. Strong written and verbal communication, and the ability to work effectively with a distributed team.
Preferred: Rancher or other multi-cluster Kubernetes management, and Kubernetes on bare metal or non-AWS infrastructure. ECS/Fargate experience. Experience supporting hybrid environments that combine public cloud with third-party hosting or bare metal, including servers managed over SSH only. Experience operating Jenkins and Nexus (or comparable CI/CD and artifact tooling) as production services. Helm and Ansible experience. Performance and load testing experience (for example JMeter).HashiCorp Vault experience. Experience in regulated, compliance-driven environments (PCI, SOC 2, or similar).Experience in online gaming, gambling, or other regulated real-money gaming. Regulated-industry or compliance exposure in other domains counts. Relevant certifications (AWS, Certified Kubernetes Administrator, or similar). They are helpful but not a substitute for hands-on depth.
Note: All offers are contingent upon successful completion of a background check*Posted positions are not open to third party recruiters and unsolicited resume submissions will be considered free referrals. AGS is an equal opportunity employer
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

SeniorL5

Location

Kansas City, MO

Occupation

Computer Systems Engineers/Architects

Industry

Computer Systems Design Services

Posted

today

To get sharper similar jobs, create your profile using the link below.

Create profile