Senior Software Engineer II
Job Description
RELX is seeking a Senior Software Engineer II (onsite) in Oklahoma City, OK to design, build, and deploy production AI systems. This role focuses on agentic workflows, LLM-powered pipelines, RAG, and structured extraction services, with end-to-end ownership from requirements through evaluation and monitoring.
Responsibilities
- Design, build, and deploy production AI systems including agentic workflows, RAG services, and extraction pipelines across multiple business units
- Collaborate with business stakeholders and technical team members to scope AI use cases, define success metrics, and finalize requirements
- Write and review technical specifications and architecture documents for complex AI system components
- Build and maintain evaluation harnesses, establishing and monitoring accuracy, latency, and cost baselines in production
- Apply responsible AI practices, including data handling, PII controls, hallucination mitigation, auditability, and human review where required
- Own cost and performance of LLM workloads, including model selection, caching, and usage attribution
- Build and maintain CI/CD pipelines and deployment automation for AI services across AWS and Azure environments
- Operate in Agile development environments while collaborating with stakeholders across engineering, product, and business functions
- Mentor less-senior engineers on AI system design, evaluation methodology, and production readiness
Requirements
- 5+ years of software engineering experience, including 2+ years building and shipping LLM-based or ML-based systems to production
- BS in Engineering/Computer Science or equivalent experience required
- Demonstrated track record owning an AI feature or service end to end, including design, evaluation, deployment, and monitoring
- Expert proficiency in TypeScript/Node.js and/or Python; working knowledge of C#/.NET is a plus
- Hands-on experience with LLM platforms and APIs (Azure OpenAI or equivalent), including prompt design, tool/function calling, structured outputs, and model selection tradeoffs
- Experience building RAG pipelines, including chunking, embedding, hybrid retrieval, reranking, and grounding/citation
- Strong understanding of schema-driven structured extraction from unstructured data (Zod, Pydantic, JSON Schema) and validation strategies
- Experience with evaluation frameworks for AI systems, including golden datasets, LLM-as-judge, precision/recall on extraction tasks, and regression testing of prompts and agents
- Strong SQL proficiency and understanding of relational and vector data storage (SQL Server, PostgreSQL, Elasticsearch/vector stores)
- Working experience with both AWS and Azure, including compute, storage, networking, IAM, and managed AI services; containerized deployment (Docker, Kubernetes or equivalent), secrets management, and observability (token usage, latency, cost attribution)
- Strong knowledge of software development best practices, test-driven development, and code review
Technologies
- TypeScript, Node.js, Python, C#/.NET
- Azure OpenAI, LLM platforms and APIs
- RAG pipelines, Zod, Pydantic, JSON Schema
- SQL, SQL Server, PostgreSQL, Elasticsearch, vector stores
- AWS, Azure, Docker, Kubernetes, CI/CD, IAM
- Prompt design, tool/function calling, structured outputs, model selection tradeoffs, grounding/citation
- LLM-as-judge
Benefits
- Comprehensive, multi-carrier program for medical, dental and vision benefits
- 401(k) with match and an Employee Share Purchase Plan
- Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
- Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
- Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
- Annual Paid Time Off, up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice
- Annual incentive bonus
About the Role
This position performs complex research, design, and software development assignments in the design and delivery of production AI systems, including agentic workflows, LLM-powered pipelines, retrieval-augmented generation (RAG), and structured extraction services. The role provides direct input to project plans, schedules, and methodology for cross-functional AI products, performs system design typically across multiple systems and data sources, mentors more-junior members of the team, and works with business users and stakeholders to translate ambiguous, unstructured problems into measurable AI solutions.
Location and Compensation
Location: Oklahoma City, OK (onsite).
Compensation: USD 95,300 - 158,800 per yearly.