Machine Learning Engineer - Inference

You will work as part of an established and growing research team, and support in the productionisation of large/complex models for maximum trading impact. You’ll closely collaborate with researchers, hardware and software engineers, and leverage your knowledge of GPU hardware and libraries to drive the optimisation of inference & hardware utilisation.

Your Core Responsibilities: 

• Leverage your knowledge of GPU architecture & libraries to optimise model structure, library use and software-hardware integration
• Deliver extensions, fixes and improvements on top of base CUDNN & TensorRT to support performant evaluation
• Build C++ and CUDA based performance enhancement libraries for common deep learning libraries like Pytorch and JAX

Your Skills and Experience: 

• MS degree in CS or similar fields or equivalent experience
• 3+ years of relevant work experience
• Experienced in fundamental libraries for accelerating ML workflows, like CUDNN/TensorRT, ROCm, OpenVino or OpenPPL.(understanding of one or more ML communication frameworks like NCCL, is an advantage)
• Background in deep learning fundamentals and common deep learning software, especially PyTorch
• Experienced in C++ & CUDA. Experience in Python is also highly desirable