Tensorrt Llm

Tensorrt Llm Developer Jobs

3 jobs found

Today

Senior Machine Learning Engineer, Agentic Systems

ServiceNow Mountain View, CA

Mountain View, CA

Today

$161k - $274k/yr Full time Ai Workflows Artificial Intelligence Data Engineering

Apply Now

Job Description

Join Moveworks, now part of ServiceNow, onsite at our Mountain View, California campus, as a Senior Machine Learning Engineer. You will build and scale ML infrastructure for training and serving large language models, emphasizing distributed training and inference, robust evaluation and monitoring, and latency optimization. Collaborate with cross functional teams to bring new ML-driven features to life and advance best practices in ML and data engineering.

Benefits

Health plans, including flexible spending accounts
401(k) Plan with company match
Employee Stock Purchase Plan (ESPP)
Matching donations
Flexible time away plan
Family leave programs
Equity (when applicable)

Compensation

Base salary range: USD 161,300 to 274,200 per year.

Culture and Work Style

We support a distributed world of work with flexibility and trust. Work personas reflect how work is performed and where, with eligibility determined by factors such as distance to the nearest ServiceNow office.

Responsibilities

Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models
Build abstractions to automate various steps in different ML workflows
Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
Leverage your experience to drive best practices in ML and data engineering

Requirements

5+ years of industry experience in Machine Learning, Infrastructure or related fields
Experience with deep learning frameworks such as PyTorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM
Experience with building and scaling end to end machine learning systems
Experience building scalable micro services and ETL pipelines
Expertise in Python and experience with performant languages such as C++ or GoLang
Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field
A love of research publications in the machine learning and software engineering communities
Effective communicator with experience collaborating cross-functionally with other teams

Key Technologies

PyTorch
Huggingface
vLLM
TensorRT-LLM
Python
C++
GoLang

View full job page →

3d ago

Senior Machine Learning Engineer, Agentic Systems

ServiceNow Mountain View, CA

Mountain View, CA

3d ago

Full time Artificial Intelligence Large Language Models Llm Operations

Apply Now

Job Description

The Senior Machine Learning Engineer role at ServiceNow focuses on designing, optimizing, and scaling end-to-end ML infrastructure for training, evaluating, and deploying large language models at Moveworks, underpinning production ML and NLP models that serve hundreds of millions of enterprise employees. This onsite position is based in Mountain View, California.

Responsibilities

Develop and refine scalable ML infrastructure to enable end-to-end workflows for training, validation, and deployment of large language models.
Create reusable abstractions to automate multiple stages across diverse ML pipelines.
Collaborate with cross-functional teams including software engineers, data analysts, ML experts, and product managers to deliver new features.
Apply experience to promote best practices in machine learning and data engineering across projects.

Requirements

At least five years of professional experience in machine learning, infrastructure, or related fields.
Proficiency with deep learning frameworks such as PyTorch or HuggingFace, and familiarity with LLM serving tools like vLLM or TensorRT-LLM.
Demonstrated ability to design and scale end-to-end machine learning systems.
Experience building scalable microservices and ETL pipelines.
Strong Python skills with experience in high-performance languages such as C++ or Go.
Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
Interest in contributing to research publications within the machine learning and software engineering communities.
Effective communication and a track record of cross-functional collaboration.

Technologies

PyTorch
HuggingFace
vLLM
TensorRT-LLM
Python
C++
Go

View full job page →

4d ago

Senior Machine Learning Engineer

ServiceNow Mountain View, CA

Mountain View, CA

4d ago

Full time AI Ai Ml Ai Workflows

Apply Now

Job Description

ServiceNow offers a flexible, inclusive environment with work personas that adapt to the role, including options for remote, in-office, or hybrid arrangements. This onsite Mountain View, CA position invites you to join the Moveworks team to design and scale ML infrastructure for training and serving large language models, with a focus on distributed training, latency optimization, evaluation, and productionizing infrastructure.

As a Senior Machine Learning Engineer you will contribute to building robust pipelines and scalable systems that empower cutting edge ML workflows. You will collaborate across engineering, data analytics, machine learning experts, and product teams to advance new features and establish best practices in ML and data engineering.

Responsibilities

Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
Develop abstractions to automate steps across different ML workflows.
Collaborate with cross functional teams of engineers, data analytics, ML experts, and product managers to deliver new features.
Leverage your experience to drive best practices in ML and data engineering.

Requirements

5+ years of industry experience in machine learning, infrastructure, or related fields.
Experience with deep learning frameworks such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
Experience building and scaling end-to-end machine learning systems.
Experience building scalable microservices and ETL pipelines.
Expertise in Python and experience with performant languages such as C++ or GoLang.
Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or an equivalent field.
A love of research publications in machine learning and software engineering communities.
Effective communicator with experience collaborating cross-functionally with other teams.

Technologies

Pytorch
Huggingface
vLLM
TensorRT-LLM
Python
C++
GoLang

Additional information

Work Personas: ServiceNow embraces a distributed world of work with flexible, remote, and in-office options depending on the role and location.
Equal Opportunity Employer: ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other protected category.
Accommodations: If you require a reasonable accommodation to complete any part of the application process, or need an alternative method to apply, please contact globaltalentss@servicenow.com.
Export control: Employment may require export control approvals for certain roles. All employment is contingent upon ServiceNow obtaining any export license or other approvals required by applicable regulations.

View full job page →

Tensorrt Llm Developer Jobs

Senior Machine Learning Engineer, Agentic Systems

Senior Machine Learning Engineer, Agentic Systems

Senior Machine Learning Engineer

Get Tensorrt Llm Developer Jobs alerts