AI Back-End Engineer
ibm
Job Description
AI Development Experience: Experience with designing, coding, debugging, testing PyTorch Core & Internals.
• Contribution to and extend PyTorch internals and backend architecture, including:
• TorchInductor
• TorchDynamo
• AOTAutograd
• Debug low-level PyTorch runtime issues (autograd, dispatcher, kernels, graph breaks).
• Deep hands-on experience with PyTorch FSDP
• Optimize model execution paths for training and inference.
• Open-source contributions to PyTorch or related projects
• Experience with proprietary or custom AI accelerators
• Experience integrating AI frameworks with custom or proprietary accelerators
• Advanced skills in C++ and Python
• Experience with GPU programming or accelerator SDKs
• Advanced Python skills and strong debugging ability
• DevOps Methodologies: Experience working with DevOps methodologies to deliver high-quality solutions on AI frameworks ensuring world-class quality, resiliency, performance, security, and stability.
Preferred technical and professional experience
• Deep understanding of:
• AI runtimes
• Memory hierarchies
• Parallel execution models
• PyTorch distributed runtime
• Parameter sharding and memory management
• Hands-on experience with torch.compile and TorchInductor
• Design Thinking Application: Experience employing IBM's Design Thinking to create solutions that provide a great user experience, with a focus on delivering innovative and effective solutions.
• Technical Leadership: Experience leading or contributing to leading-edge projects, driving innovation and solution delivery in Core backend AI areas.
• Excellent communication skills