DeveloperJobs.io
← Back to all jobs

Job Description

Responsibilities

  • Design and optimize scalable ML infrastructure to support training, evaluation, and deployment of large language models.
  • Create abstractions that automate steps across diverse ML workflows.
  • Collaborate with cross-functional teams of engineers, data analytics, ML experts, and product to build new features.
  • Apply your experience to drive best practices in ML and data engineering.

Requirements

  • 5+ years of industry experience in Machine Learning, Infrastructure or related fields
  • Experience with deep learning frameworks such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM
  • Experience building and scaling end-to-end machine learning systems
  • Experience building scalable microservices and ETL pipelines
  • Expertise in Python and experience with performant languages such as C++ or GoLang
  • Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or equivalent field
  • A love of research publications in the machine learning and software engineering communities
  • Effective communicator with experience collaborating cross-functionally with other teams

Technologies

  • Pytorch
  • Huggingface
  • vLLM
  • TensorRT-LLM
  • Python
  • C++
  • GoLang

Location

Mountain View, CA (onsite)

Base salary

Base salary range: USD 161,300 - 274,200 per year

Similar Jobs