Job Description

Responsibilities

• Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.
• Profile end-to-end ML operation performance and optimize large-scale LLM training and inference workloads.
• Integrate low-level GPU kernels into PyTorch, JAX, and custom internal runtimes.
• Develop performance models, identify bottlenecks, and deliver kernel-level performance improvements.
• Collaborate with ML researchers, distributed systems engineers, and model-serving teams.
• Work with NVIDIA and AMD hardware vendors and track GPU architecture and compiler/toolchain developments.
• Contribute to tooling, documentation, benchmarking suites, and testing frameworks.

Requirements

• 5+ years of industry or research experience in GPU kernel development or high-performance computing.
• Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related field.
• Strong programming skills in C++ and Python, with familiarity with ML frameworks.
• Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization.
• Hands-on experience with Triton and/or JAX Pallas for custom kernel development.
• Strong understanding of PTX, GPU ASM, and low-level GPU execution.
• Extensive experience writing and optimizing custom GPU kernels in C++ and PTX.
• Experience integrating low-level kernels into PyTorch, JAX, or similar frameworks.
• Experience with large-scale LLM training or inference.
• Preferred qualifications include AMD GPU and ROCm optimization, JAX FFI, efficient model-serving frameworks, TPUs, XLA, and contributions to open-source ML systems, compilers, or GPU kernels.

Benefits

• Medical, dental, and vision insurance.
• 401k plan.
• Daily lunch, snacks, and beverages.
• Flexible time off.
• Competitive salary and equity.

Job Tags

Similar Jobs