Senior Machine Learning Engineer, Agentic Systems

The Senior Machine Learning Engineer role at ServiceNow focuses on designing, optimizing, and scaling end-to-end ML infrastructure for training, evaluating, and deploying large language models at Moveworks, underpinning production ML and NLP models that serve hundreds of millions of enterprise employees. This onsite position is based in Mountain View, California.

Responsibilities

• Develop and refine scalable ML infrastructure to enable end-to-end workflows for training, validation, and deployment of large language models.
• Create reusable abstractions to automate multiple stages across diverse ML pipelines.
• Collaborate with cross-functional teams including software engineers, data analysts, ML experts, and product managers to deliver new features.
• Apply experience to promote best practices in machine learning and data engineering across projects.

Requirements

• At least five years of professional experience in machine learning, infrastructure, or related fields.
• Proficiency with deep learning frameworks such as PyTorch or HuggingFace, and familiarity with LLM serving tools like vLLM or TensorRT-LLM.
• Demonstrated ability to design and scale end-to-end machine learning systems.
• Experience building scalable microservices and ETL pipelines.
• Strong Python skills with experience in high-performance languages such as C++ or Go.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• Interest in contributing to research publications within the machine learning and software engineering communities.
• Effective communication and a track record of cross-functional collaboration.

Technologies

• PyTorch
• HuggingFace
• vLLM
• TensorRT-LLM
• Python
• C++
• Go