Llm Evaluation Developer Jobs

1 job found

1d ago

ServiceNow Mountain View, CA

Mountain View, CA

1d ago

$140k - $217k/yr Full time Agentic Ai AI Ai Ml

Join ServiceNow’s GenAI Search Platform team to build machine learning capabilities for LLM-enabled search-based question answering and evaluation.

Drive development of the search platform with LLM-enabled generative AI features in a fast-paced environment
Enable product teams to rapidly build new applications and features, including shipping prototypes to customers at scale
Evaluate and iterate on ranking improvements using a systematic approach
Enforce guarantees on quality, security, privacy, and scalability for enterprise-ready search and summarization
Design systematic evaluation metrics and methodology for search models
Use LLMs to address enterprise challenges, including security and privacy
Collaborate with ranking, product, design, infrastructure, and data science teams to advance agentic search capabilities with a focus on performance and enterprise readiness
Partner with product, user experience, customer success, and other engineering teams to identify, define, and build solutions

3+ years of engineering experience
First-hand experience relevant to search platforms, such as:
- traditional information retrieval
- search ranking and relevance
- recommendation systems
- question answering systems
Background in one or more areas: text processing, information retrieval, natural language understanding, or machine learning
Interest in helping product and ranking teams move faster and scale solutions in an environment focused on customer impact and success

Mountain View, CA (onsite)
Work persona categories may be flexible, remote, or required in office
ServiceNow may confirm eligibility for a work persona by checking the distance between your primary residence and the closest ServiceNow office using a third-party service

Experience with (or desire to learn) large language models, retrieval augmented generation (RAG), and agents
Experience with Python; contributing to mature Python libraries or platform code, including open-source repositories
Experience with Golang is not required

New Llm Evaluation Developer Jobs, daily.