DeveloperJobs.io
← Back to all jobs
Goliath Partners

Senior Machine Learning Engineer

Goliath Partners
San Francisco, CA $2,000k - $2,000k/yr Full time Posted 1d ago
Artificial Intelligence Cloud Machine Learning Distributed Machine Learning Engineer Machine Learning Machine Learning Engineering Machine Learning Optimization Machine Learning Serving Software Development
Apply Now

Job Description

Build production ML infrastructure at scale with Goliath Partners in San Francisco, CA (onsite). This Senior Machine Learning Engineer role sits at the intersection of ML infrastructure and distributed systems, helping connect ML Infrastructure Engineers to deliver distributed model training and high-performance inference using modern cloud and GPU tooling. The focus is end-to-end: design, performance optimization, and owning infrastructure that supports demanding AI workloads.

What you’ll do

  • Build and scale the infrastructure powering cutting-edge AI systems, from distributed model training to high-performance inference.
  • Develop scalable distributed training and inference infrastructure that can operate reliably at scale.
  • Optimize system performance, reliability, latency, and throughput for production workloads.
  • Design and own production ML infrastructure, ensuring it meets operational and performance requirements.

What you bring

  • 5+ years of experience in ML Infrastructure, Distributed Systems, or Software Engineering, or equivalent demonstrated expertise.
  • Strong programming skills in Python and C++ or Go.
  • Hands-on experience with PyTorch, JAX, or similar ML frameworks.
  • Experience building scalable distributed training and inference infrastructure.
  • Strong knowledge of Kubernetes, Docker, AWS/GCP, and GPU compute environments.
  • Proven ability to optimize performance and reliability, including latency and throughput.
  • Experience supporting large-scale LLM or foundation model training.
  • Expertise with CUDA, Triton, NCCL, or GPU performance optimization.
  • Experience with distributed training frameworks such as Ray, DeepSpeed, or Megatron-LM.
  • Contributions to high-performance ML systems or influential open-source infrastructure projects.
  • Experience building infrastructure at leading AI research labs or high-growth technology companies.

Tech you’ll work with

Python, C++, Go, PyTorch, JAX, Kubernetes, Docker, AWS, GCP, CUDA, Triton, NCCL, Ray, DeepSpeed, Megatron-LM.

Education

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Mathematics, or a related technical field.
  • PhD in Computer Science, Machine Learning, or Distributed Systems is a plus.
  • Exceptional engineers with demonstrated technical impact and deep systems expertise are strongly encouraged to apply.

Compensation: USD 2,000,000 per year.

Similar Jobs