Principal Machine Learning Engineer

Oracle's Generative AI Services team is seeking a Principal Machine Learning Engineer to shape the architecture, design, and deployment of distributed AI infrastructure. This onsite role in Seattle, WA focuses on building scalable systems for training, fine-tuning, and inference of large models, coordinating with partner engineering teams to deliver reliable production deployments and contributing to open-source frameworks such as vLLM and SGLang.

Responsibilities

• Lead the architecture, design, and development of distributed, scalable, high-performance systems for AI model training, fine-tuning, and inference.
• Build and optimize next-generation AI infrastructure that powers large-scale generative workloads.
• Direct analysis of model architectures to improve performance, efficiency, and scalability.
• Utilize cutting-edge technologies to craft state-of-the-art AI systems and onboard frontier models.
• Benchmark, diagnose, troubleshoot, and resolve issues across the AI model lifecycle, including training, fine-tuning, and serving, ensuring reliable production deployments.
• Contribute to open-source frameworks such as vLLM and SGLang and strengthen OCI's involvement.
• Oversee a team of senior and junior engineers, guiding delivery of the roadmap on schedule with high quality.

Technologies

• vLLM
• SGLang