Llm Orchestration

Llm Orchestration Developer Jobs

3 jobs found

2d ago

Principal, Machine Learning Engineer (L5)

Twilio Indianapolis, IN 🇺🇸 Remote

Indianapolis, IN

2d ago

Full time Ai Ml Artificial Intelligence Engineer

Apply Now

Job Description

Twilio is hiring a Principal Machine Learning Engineer for its Customer Memory Team. In this remote role based in India, you will help build foundational AI and ML capabilities that power intelligent engagement by identifying customers, their history, and the best way to reach them. The focus is on turning advanced research into production-grade experimentation, solving contextual intelligence challenges, and delivering large-scale ML systems that perform reliably in the real world.

What you’ll build

New functionality within a fast-moving product with rapid adoption
Experiments that start from ambiguous ideas and move to rigorous testing within weeks
Contextual intelligence systems that operate at Twilio scale
Production-ready ML capabilities for areas such as LLM orchestration, retrieval strategies, embeddings, vector stores, and data-driven personalization
Autonomous agents capable of multi-turn conversations while maintaining long-term context and consistency

How you’ll work

Bridge research and experimentation with implementation that holds up under real usage
Conduct deep-dive research into state-of-the-art LLM orchestration, retrieval strategies, and personalization approaches
Continuously integrate the latest AI development stacks to reduce boilerplate and focus on core differentiation
Rapidly acquire new technical skills in a fast-paced, high-delivery environment

Requirements

10+ years of applied ML/AI experience, with a record of owning technically ambitious systems end to end rather than contributing only to someone else’s design
Comfort operating in a 0-to-1 environment with ambiguous requirements and a strong bias for action
Proficiency in Python
Experience building cloud-based services on AWS, GCP, or Azure, including high-volume data, streaming or real-time inference paths, and a range of data stores
Deep expertise in designing, architecting, and deploying production-grade ML/AI systems, including LLM orchestration, embedding models, and vector stores
Strong fundamentals of statistical machine learning algorithms, transformer models, and LLMs
Ability to raise the technical bar through mentorship, design review, and standards without formal management authority
Experience building cloud-based services using AWS, GCP, or Azure
Strong communication skills and the ability to collaborate effectively with teammates
Experience with autonomous agents handling multi-turn conversations and maintaining long-term context/consistency
Background in predictive modeling on user behavior, including experiment design and causal or counterfactual methods when randomization is partial
Prior experience working in a globally distributed team

Technologies

Python
AWS, GCP, Azure
LLM orchestration
Embedding models
Vector stores
Transformer models

Location and travel

This role is remote and based in India (Karnataka, Tamil Nadu, Telangana State, Maharashtra, and New Delhi). Occasional travel may be required for project or team in-person meetings.

Benefits

Competitive pay
Generous time off
Ample parental and wellness leave
Healthcare
A retirement savings program

How we hire

We use Artificial Intelligence (AI) to help make our hiring process efficient.
Every hiring decision is made by real Twilions.
While we are remote-first, you may be asked to report in person on an ad-hoc basis for team gatherings, functional off-sites, or customer meetings.

Stay alert to recruitment fraud

Scammers may impersonate Twilio recruiters through fake job postings, emails, websites, or messages.
Engage only with an official @twilio.com email address.
Twilio will never ask for payment, gift cards, cryptocurrency, or banking information during recruiting.
We do not make job offers without a formal interview process or conduct interviews exclusively through text-based messaging apps.

View full job page →

17d ago

Senior Machine Learning Engineer

Steampunk McLean, VA

McLean, VA

17d ago

$140k - $190k/yr Full time Backend Developer Senior Ai Ml

Apply Now

Job Description

Steampunk is seeking a Senior Machine Learning Engineer to help design, build, and deliver production AI systems end to end. This hybrid role in McLean, VA supports mission-focused development across predictive modeling, LLM-powered applications, multi-agent workflows, and RAG pipelines, with an emphasis on strong engineering fundamentals and responsible AI practices.

Role scope

You will work through the full ML lifecycle, from exploratory data analysis and feature engineering to integration, deployment, and ongoing monitoring. The position focuses on shipping scalable AI/ML and generative AI capabilities that integrate with enterprise systems and cloud-native services.

Responsibilities

Develop end-to-end ML/AI solutions across predictive models, LLM-powered applications, multi-agent workflows, and RAG pipelines using structured and unstructured datasets.
Conduct exploratory data analysis, feature engineering, and data visualization to guide model design and validate assumptions.
Use deep learning methods and modern libraries and frameworks to build, improve, and iterate models.
Integrate AI/ML models with enterprise systems, APIs, data platforms, vector databases, and cloud-native services to deliver scalable mission capabilities.
Design and implement prompt strategies, context management layers, retrieval systems, and LLM orchestration logic.
Build scalable inference services, optimize model performance, and partner with MLOps/LLMOps to support deployment, monitoring, and continuous improvement.
Create and execute comprehensive test plans for AI/ML models, including functional, regression, and edge case testing.
Develop evaluation test cases for performance, accuracy, bias, fairness, and robustness, including adversarial and stress testing to assess resilience.
Track quality metrics such as precision, recall, F1 score, false positives/false negatives, and usability metrics, and document defects or unexpected behaviors.
Validate compliance with data privacy, security, and ethical AI standards, including safety guardrails, input sanitization, and content filtering.
Support an Agile software development lifecycle by contributing reusable AI components, libraries, and APIs.
Collaborate with product managers, data architects, designers, and mission stakeholders to translate mission needs into reliable AI-powered features.
Mentor junior developers, perform code reviews, and support engineering excellence across multi-disciplinary AI delivery teams.
Stay current on emerging AI techniques, libraries, foundation models, and agent frameworks, evaluating fit for client missions.
Contribute to the growth of Steampunk’s AI & Data Exploitation Practice.

Requirements

Ability to obtain and maintain a U.S. government security clearance.
Bachelor’s, Master’s, or Ph.D. in Computer Science, Data Science, Artificial Intelligence, Machine Learning, Engineering, or a related scientific/technical discipline.
7+ years of total experience.
3-5 years of industry experience developing ML/AI solutions, including hands-on experience with generative AI or LLM-driven application development.
Experience manipulating structured and unstructured data for analysis, including data modeling and data solution development.
Strong programming skills in Python and modern AI frameworks such as PyTorch, TensorFlow, Keras, Hugging Face Transformers, LangChain, or LlamaIndex.
Experience implementing RAG architectures, embeddings, vector stores, and context retrieval patterns, plus familiarity with multi-agent orchestration and prompt engineering.
Demonstrated experience in big data systems including Hadoop and Spark, and additional programming proficiency in SQL, R, Scala, or Java.
Data visualization skills in Tableau, Power BI, D3, ArcGIS, or similar.
Strong understanding of cloud platforms (AWS, Azure, GCP), including compute, serverless services, and security fundamentals for AI workloads, such as AWS SageMaker or Azure HDInsight.
Working knowledge of containerization (Docker), orchestration (Kubernetes), and CI/CD pipelines for AI-based systems.
Experience with Git, Bash, and Unix commands, with familiarity with DevSecOps, MLOps, and LLMOps practices for AI/ML delivery.
Understanding of responsible AI principles including safety, fairness, privacy, bias mitigation, and model risk management.
Strong analytical and communication skills, with the ability to collaborate across engineering, design, and mission domains.
Proven experience mentoring teammates and raising the technical bar of development teams.
Familiarity with Flask, Solr, or Elasticsearch is a plus.

Technologies

Python, PyTorch, TensorFlow, Keras
Hugging Face Transformers, LangChain, LlamaIndex
RAG architectures, embeddings, vector stores, vector databases
Hadoop, Spark, SQL, R, Scala, Java
Tableau, Power BI, D3, ArcGIS
AWS, Azure, GCP, AWS SageMaker, Azure HDInsight
Docker, Kubernetes, CI/CD pipelines
Git, Bash, Unix commands
DevSecOps, MLOps, LLMOps
Flask, Solr, Elasticsearch
APIs, data platforms, cloud-native services

Compensation and application process

Location: McLean, VA (hybrid).
Salary range: USD 140,000 - 190,000 per year.
Steampunk determines salary based on factors including geographic location, contractual requirements, education, knowledge, skills, competencies, and experience.
Annual salary is one aspect of Steampunk’s total compensation package.
During the application process, you are expected to be on camera during interviews and assessments.
Steampunk reserves the right to take your picture to verify identity and prevent fraud.

About Steampunk

Steampunk is a Change Agent in the Federal contracting industry, serving clients in the Homeland, Federal Civilian, Health and DoD sectors. The company uses a Human-Centered delivery methodology focused on shared accountability to solve mission challenges. Steampunk is an equal opportunity employer and participates in the E-Verify program.

View full job page →

1mo ago

Machine Learning Engineer II

S&P Global New York, NY

New York, NY

1mo ago Closed

$140k - $180k/yr Full time Agentic Ai Agentic Ai Orchestration Ai Ml

This position is no longer accepting applications (closed Sep 28, 2026).

Job Description

Join S&P Global as a mid-level Machine Learning Engineer II focused on building agentic AI systems for financial data. The role emphasizes LLM orchestration, retrieval and evaluation, and end-to-end delivery from experimentation through productionization, with a strong focus on connecting data to actionable insights.

Key Responsibilities

Solve distinct challenges in agentic design and LLM orchestration, including context engineering, data access patterns, memory management, and evaluating agent performance against user needs.
Contribute across the machine learning lifecycle, including problem framing, data exploration, model experimentation, deployment, and monitoring in production to continuously improve Agentic Systems.
Apply advanced NLP methods to leverage proprietary unstructured and structured datasets, extracting insights and building solutions that support business value.
Partner with Data, Product, Design, and Engineering teams to design and build Agents that enhance user experiences and align to business objectives.
Work closely with the ML Operations team to develop automated capabilities for managing the ML systems lifecycle, from technical design to implementation.

Required Qualifications

Bachelor’s degree or higher in Computer Science, Engineering, or a related field.
3+ years of significant, hands-on industry experience in machine learning, NLP, and information retrieval systems, with emphasis on practical application.
Experience spanning the full ML lifecycle, including designing, experimenting, deploying, and maintaining production systems.
Strong proficiency in Python with an understanding of software development best practices.
Experience using machine learning libraries and frameworks for agent orchestration, such as LangGraph and pydanticAI.
Experience with agentic design, including an understanding of user interactions and agent evaluation to improve user experiences.
Demonstrated habits related to effective coding, documentation, collaboration, and communication.
Strong problem-solving skills and a proactive approach to addressing challenges.
Ability to adapt in a fast-paced and dynamic work environment.

Tools & Technologies

Agentic Orchestration, Deep Research, Information Retrieval, Semantic Search
LLM code generation and LLM tool utilization
Textual RAG systems
LangGraph, Transformers, HuggingFace, LightGBM, PyTorch, SKLearn, XGBoost
Jupyter, Matplotlib, Pandas, Weights & Biases, Langfuse, Apache Spark, AWS Athena, DVC, LabelBox, OpenSearch
Postgres/Pgvector, S3, SQLite, Arize, Airflow, AWS, DeepSpeed, Docker, Grafana, Jenkins, LangFuse, LiteLLM, Ray, vLLM
Claude Code, FastAPI, Streamlit, Gradio, Python, pydanticAI

Compensation

USD 140,000 - 180,000 per year.

Location & Work Mode

New York, NY (onsite).

Benefits

Medical, Dental, and Vision insurance
100% company paid premiums
Unlimited Paid Time Off
26 weeks of 100% paid Parental Leave (paternity and maternity)
401(k) plan with 6% employer matching
Generous company matching on donations to non-profit charities
Up to $20,000 tuition assistance toward degree programs, plus up to $4,000/year for ongoing professional education such as industry conferences
Plentiful snacks, drinks, and regularly catered lunches
Dog-friendly office (CAM office)
Bike sharing program memberships
Compassion leave and elder care leave
Mentoring and additional learning opportunities
Opportunity to expand professional network and participate in conferences and events

Recruitment Fraud Alert

If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to reportfraud@spglobal.com.
S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, “pre-employment training” or for equipment/delivery of equipment.

View full job page →

Llm Orchestration Developer Jobs

Principal, Machine Learning Engineer (L5)

Senior Machine Learning Engineer

Machine Learning Engineer II

Get Llm Orchestration Developer Jobs alerts