Sr. Staff GPU Network Software Engineer - RCCL, Open Source

AMD GPU Communication Libraries Developer

What You Do At AMD Changes Everything At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

The Role

Do you want to develop multi node GPU communication libraries to enable high performance computing and machine learning workloads at Exascale? AMD is searching for talented and motivated engineers to develop Communication libraries as part of the AMD Radeon Open Ecosystem (ROCm).

The Person

You are accustomed to working in a dynamic, geographically distributed agile team, where partnership and collaboration are paramount. You possess excellent written and verbal communication skills, strong attention to detail, and the ability to express your work in a clear, cohesive fashion. You are results-oriented and accustomed to tight deadlines and changing priorities. Most importantly, you are constantly thinking of ways to improve performance of software and hardware.

Key Responsibilities

• Support AMD's RCCL, an open source, GPU-accelerated communication collective middleware and related technologies
• Design, implement, and test networking features for multi-GPU and multi-node communication libraries.
• Benchmark, profile and optimize code to maximize throughput on single-GPU, multi-GPU and clustered systems
• Deliver high-quality code and documentation following best practices for open source software development
• Work with key technical experts across AMD and with our partners and customers to improve ROCm applications, libraries, and tools
• Deploy the libraries on large clusters and debug complex system level issues that could span across different layers of the software stack: gpu kernel drivers, nic driver etc.

Preferred Experience

Strong background developing applications and libraries in C, C++, and Python Experience working with RoCE(RDMA over Converge Ethernet), Libfabric and InfiniBand Experience working with Linux Kerner, Device drivers and network drivers. Experience designing and building GPU Networks for Large Scale Clusters Experience in collective communication libraries: MPI, RCCL, SHMEM and optimization to scale collective communication to scale distributed systems. In-depth knowledge of best-practices in software development, including testing, profiling, debugging, documentation, version control, issue tracking, and planning Contributions to open-source libraries and applications

Academic Credentials

B.Sc. or B.Eng. degree in Computer Science, Software Engineering, Electrical Engineering, or equivalent Advanced degrees, such as M.Sc., M.Eng., Ph.D. are preferred.