Senior Machine Learning Engineer, Agentic Systems

Join Moveworks, now part of ServiceNow, onsite at our Mountain View, California campus, as a Senior Machine Learning Engineer. You will build and scale ML infrastructure for training and serving large language models, emphasizing distributed training and inference, robust evaluation and monitoring, and latency optimization. Collaborate with cross functional teams to bring new ML-driven features to life and advance best practices in ML and data engineering.

Benefits

• Health plans, including flexible spending accounts
• 401(k) Plan with company match
• Employee Stock Purchase Plan (ESPP)
• Matching donations
• Flexible time away plan
• Family leave programs
• Equity (when applicable)

Compensation

Base salary range: USD 161,300 to 274,200 per year.

Culture and Work Style

We support a distributed world of work with flexibility and trust. Work personas reflect how work is performed and where, with eligibility determined by factors such as distance to the nearest ServiceNow office.

Responsibilities

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models
• Build abstractions to automate various steps in different ML workflows
• Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
• Leverage your experience to drive best practices in ML and data engineering

Requirements

• 5+ years of industry experience in Machine Learning, Infrastructure or related fields
• Experience with deep learning frameworks such as PyTorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM
• Experience with building and scaling end to end machine learning systems
• Experience building scalable micro services and ETL pipelines
• Expertise in Python and experience with performant languages such as C++ or GoLang
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field
• A love of research publications in the machine learning and software engineering communities
• Effective communicator with experience collaborating cross-functionally with other teams

Key Technologies

• PyTorch
• Huggingface
• vLLM
• TensorRT-LLM
• Python
• C++
• GoLang