Staff Site Reliability Engineer - Remote Eligible

Staff Site Reliability Engineer

The Wikimedia Foundation is looking for a Staff Site Reliability Engineer (SRE) focused on Machine Learning Infrastructure. You will join a distributed team working across UTC -5 to UTC +3 (Eastern Americas, Europe, and Africa) and report directly to the Director of Machine Learning, Chris Albon.

As a Staff SRE specializing in ML infrastructure, your primary responsibility is designing, developing, maintaining, and scaling the foundational infrastructure that enables Wikimedia's Machine Learning Engineers and Researchers to efficiently train, deploy, and monitor machine learning models in production.

You will be responsible for:

• Designing and implementing robust ML infrastructure used for training, deployment, monitoring, and scaling of machine learning models.
• Improving reliability, availability, and scalability of ML infrastructure, ensuring smooth and efficient workflows for internal ML engineers and researchers.
• Collaborating closely with ML engineers, product teams, researchers, SREs, and the Wikimedia volunteer community to identify infrastructure requirements, resolve operational issues, and streamline the ML lifecycle.
• Proactively monitoring and optimizing system performance, capacity, and security to maintain high service quality.
• Providing expert guidance and documentation to teams across Wikimedia to effectively utilize the ML infrastructure and best practices.
• Mentoring team members and sharing knowledge on infrastructure management, operational excellence, and reliability engineering.

Skills and Experience:

• Candidates should be based within UTC -5 to UTC +3 time zones to ensure good collaboration overlap with the team.
• 7+ years of experience in Site Reliability Engineering (SRE), DevOps, or infrastructure engineering roles, with substantial exposure to production-grade machine learning systems.
• Proven expertise with on-premises infrastructure for machine learning workloads (e.g., Kubernetes, Docker, GPU acceleration, distributed training systems).
• Strong proficiency with infrastructure automation and configuration management tools (e.g., Terraform, Ansible, Helm, Argo CD).
• Experience implementing observability, monitoring, and logging for ML systems (e.g., Prometheus, Grafana, ELK stack).
• Familiarity with popular Python-based ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn).
• Strong English communication skills and comfort working asynchronously across global teams.

Qualities that are important to us:

• Collaborative, proactive, and independently motivated.
• Experienced working with diverse, remote teams.
• Committed to open-source software and volunteer communities.
• Systematic thinker focused on operational excellence and reliability.

Additionally, ideal candidates will excel in at least one of these areas:

• Scalable ML Infrastructure: Deep understanding of scalable infrastructure design for high-performance machine learning training and inference workloads.
• Reliability and Operations: Proven track record ensuring high reliability and robust operations of complex, distributed ML systems at scale.
• Tooling and Automation: Demonstrated expertise creating robust tooling and automation solutions that simplify the deployment, management, and monitoring of ML infrastructure.