Member of Technical Staff, ML Systems

About the role We’re looking for a motivated LLM Systems Engineer willing to explore new and unconventional inference systems based on emerging hardware. This role is part engineering, part research – you’ll be responsible for searching and prototyping various algorithms suitable for our inference hardware, as well as guiding our hardware team on the product definition. The ideal candidate has a proven track of record of pursuing ML systems research, and is very familiar with industry-standard LLM inference systems. This role will be performed on-site from one of our offices in Santa Clara, CA or Boston, MA. Essential Duties and Responsibilities - Prototype and optimize emerging ML inference systems. - Develop novel memory models for expandable vRAM. - Write efficient GPU kernels for data movement. - Perform design-space exploration, implementation, and benchmarking of inference engines, both in simulations and on real hardware. Qualifications - MS or PhD in computer systems, ideally with a focus on LLM inference and/or distributed systems. - Prior experience contributing to the core LLM inference infrastructures (vLLM, SGLang, TensorRT, etc.). - Prior experience in accelerator programming (e.g. CUDA, JAX/Pallas, ROCm). - Advanced computer architectures and performance engineering skills is a big plus. Compensation & Benefits - Competitive salary commensurate with experience including base salary, incentive-based bonus, and early stage equity grant. - Comprehensive benefits including health, dental, vision, and life insurance. - Well-equipped, sunny offices in Santa Clara, CA and Boston, MA. - Relocation assistance and visa sponsorship. - Perks include a daily lunch stipend, 401k match, and more. - A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing. The Opportunity - Impact: We are tackling a fundamental challenge at the infrastructure layer: