Software Engineering Manager, Collective Communications

Software Engineering Manager, Collective Communications

In this role, you will be a member of the Host Side Collective Communication Libraries (HCCL) software team and part of the Host Side Networking (HSN) organization within the DC Networking and Network Infra organizations. The team develops and owns the software stack around collective communication libraries for the internally developed Meta AI accelerator, Meta Training and Inference Accelerator (MTIA). At the high level, the team's charter is to enable and performance optimize HCCL, our internally developed communication library for the MTIA. Currently, one of the team's focus areas is standing up our first communications stack targeting various AI training workloads. The team is building the communications software stack including hardware customized features, software benchmarks and performance tooling. Specifically we are looking for people to lead designing, developing and operating some of the largest AI infrastructure in the world. This is a rare opportunity to work with the leading AI experts in the industry and build cutting edge AI communications infrastructure.

Responsibilities

• Help define technical roadmap for the team, drive execution of associated tasks and support the team in resolving dependencies
• Guide and mentor team members to develop appropriate skillsets to grow in their careers, and where necessary address under performance
• Collaborate effectively with other groups across the wider organisation such as Co-Design, Software, Hardware, Infrastructure and Operations teams
• Communicate cross-functionally and drive engineering efforts
• Interact with external partners as needed in resolving dependencies associated with objectives

Minimum Qualifications

• 8+ years, or PhD + 4 years, of software engineering work experience, including hands on technical management
• 2+ years of experience managing a networking related Software Engineering Team
• BS or MS in Computer Science or related technical discipline or equivalent experience
• Working knowledge of Collective Communications Libraries such as NVIDIA Collective Communications Library (NCCL) and Message Passing Interface (MPI)
• Experience with software development for Distributed and Embedded systems
• Demonstrated experience recruiting, building, structuring, and leading technical organizations, including performance management
• Experience supporting, coaching, mentoring, and developing software engineers

Preferred Qualifications

• Experience with distributed GPU reliability/performance improvement on RoCE/Infiniband
• Knowledge of network transport stack such as RoCE (RDMA)
• Experience working with Deep Learning frameworks like PyTorch, Caffe2 or TensorFlow
• Knowledge of Machine Learning, Deep Learning and Large Language Models

$177,000/year to $251,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.