Senior Machine Learning Engineer

ServiceNow offers a flexible, inclusive environment with work personas that adapt to the role, including options for remote, in-office, or hybrid arrangements. This onsite Mountain View, CA position invites you to join the Moveworks team to design and scale ML infrastructure for training and serving large language models, with a focus on distributed training, latency optimization, evaluation, and productionizing infrastructure.

As a Senior Machine Learning Engineer you will contribute to building robust pipelines and scalable systems that empower cutting edge ML workflows. You will collaborate across engineering, data analytics, machine learning experts, and product teams to advance new features and establish best practices in ML and data engineering.

Responsibilities

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Develop abstractions to automate steps across different ML workflows.
• Collaborate with cross functional teams of engineers, data analytics, ML experts, and product managers to deliver new features.
• Leverage your experience to drive best practices in ML and data engineering.

Requirements

• 5+ years of industry experience in machine learning, infrastructure, or related fields.
• Experience with deep learning frameworks such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
• Experience building and scaling end-to-end machine learning systems.
• Experience building scalable microservices and ETL pipelines.
• Expertise in Python and experience with performant languages such as C++ or GoLang.
• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
• A love of research publications in machine learning and software engineering communities.
• Effective communicator with experience collaborating cross-functionally with other teams.

Technologies

• Pytorch
• Huggingface
• vLLM
• TensorRT-LLM
• Python
• C++
• GoLang

Additional information

• Work Personas: ServiceNow embraces a distributed world of work with flexible, remote, and in-office options depending on the role and location.
• Equal Opportunity Employer: ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other protected category.
• Accommodations: If you require a reasonable accommodation to complete any part of the application process, or need an alternative method to apply, please contact [email protected].
• Export control: Employment may require export control approvals for certain roles. All employment is contingent upon ServiceNow obtaining any export license or other approvals required by applicable regulations.