AI Infrastructure Engineer

AI Infrastructure Engineer

We are seeking an experienced AI Infrastructure Engineer to join our AI Incubation team. You will build and optimize large-scale training infrastructure for Large Language Models (LLMs). The ideal candidate will combine engineering fundamentals with practical experience in AI infrastructure development, demonstrating both technical depth and the ability to deliver scalable solutions for complex AI systems.

The AI incubation team is dedicated to incubating AI breakthroughs, including foundational AI techniques and AI native applications that will largely improve people’s work productivity.

Responsibilities

• Designing and developing scalable AI infrastructure solutions for training and deploying large language models
• Building and optimizing distributed training platforms using cutting-edge technologies
• Implementing and maintaining containerized AI environments using Docker and Kubernetes
• Optimizing CUDA kernels for maximum GPU utilization and performance
• Developing platform software to support AI/ML workflows
• Collaborating with AI researchers to implement efficient training and inference pipelines

What We’re Looking For

Possess a Bachelor’s degree in Computer Science, Artificial Intelligence, Machine Learning, Cognitive Science, or a related field.

Have 5+ years of software engineering experience with a focus on infrastructure and systems.

Exhibit expertise in GPU programming and CUDA optimization.

Have experience with container technologies (Docker, Kubernetes), distributed systems, and cloud computing.

Have experience building large-scale distributed systems and optimizing neural network performance.

Demonstrate programming skills in Python, C++, and CUDA, with deep learning frameworks (PyTorch, Transformers).

Have a deep understanding of neural network architectures and training methodologies.

Salary Range or On Target Earnings: Minimum: $143,000.00. Maximum: $312,800.00. In addition to the base salary and/or OTE listed, Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus, and equity value. Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience. We also have a location-based compensation structure; there may be a different range for candidates in this and other locations.

Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn for more information.

Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars. We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

At Zoom, we believe great work happens when people feel supported and empowered. We’re committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know—we’re here to support you at every step. We welcome people of different backgrounds, experiences, abilities, and perspectives, including qualified applicants with arrest and conviction records and any qualified applicants requiring reasonable accommodations in accordance with the law. If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.

Think of this opportunity as a marathon, not a sprint! We’re building a strong team at Zoom, and we’re looking for talented individuals to join us for the long haul. No need to rush your application – take your time to ensure it’s a good fit for your career goals. We continuously review applications, so submit yours whenever you’re ready to take the next step.