Advanced Software Engineer
Job Description
Relativity is seeking an Advanced Software Engineer to help build distributed, scalable, and secure full-stack cloud services for AI-powered legal data solutions. The role emphasizes LLM infrastructure, reliability, and delivering performant user interfaces and backend services at massive scale.
Role Focus
You will contribute to the design, development, and operation of cloud services that handle petabytes of data weekly. Work includes improving platform performance and cost efficiency, shaping APIs for product teams, and supporting safe deployment of new models and capabilities, including in government cloud environments.
Responsibilities
- Design, build, and operate distributed, scalable, secure full-stack cloud services processing petabytes of data weekly.
- Develop performant, accessible user interfaces and extend backend services and data pipelines.
- Write clean, testable, maintainable code that delivers measurable customer impact.
- Collaborate with teammates and product partners to solve problems, meet team goals, and build AI-powered legal data solutions at massive scale.
- Contribute to design and code reviews by providing constructive feedback to improve quality and maintainability.
- Participate in service ownership through reliability efforts, including on-call rotations and incident response.
- Improve throughput, latency, and cost per document across the platform through capacity headroom, token efficiency, and model routing and failover across regions.
- Work directly with product teams to shape platform APIs and bring new models and capabilities into production safely, including in government cloud environments.
Requirements
- 3+ years designing, building, and operating cloud-native, distributed systems.
- Hands-on experience with APIs, event-driven architecture, and data platforms.
- Comfort developing cloud-based, distributed services.
- Ability to write clean, maintainable, well-tested code using modern tooling and CI/CD.
- Security- and reliability-focused mindset with strong cross-functional collaboration across engineering, product, and design.
- Proficiency in Python and/or C#/.NET, with production experience running services on Kubernetes in a major cloud.
- Track record of debugging and improving production systems, including distributed tracing, metrics, and owning a service others depend on, including on-call.
Technologies
- Python
- C#/.NET
- Kubernetes
- CI/CD
- APIs
- Event-driven architecture
- Distributed tracing
- Metrics
Preferred
- Experience with full-stack development and modern UI frameworks.
- Familiarity with performance or cost optimization.
- Familiarity with AI-development tools like GitHub Copilot, Cursor, or Claude Code.
- Experience building on LLM APIs (Azure OpenAI, OpenAI, Anthropic), including prompt and model versioning, evaluation, streaming, token accounting, or working within rate limits and provisioned throughput.
- Experience with durable workflow engines (Temporal, Airflow, Step Functions) or high-volume batch and streaming data pipelines.
- Interest in agentic systems including MCP, tool calling, and infrastructure for safe operation in regulated environments.
Location and Work Style
Illinois (hybrid)
Compensation and Benefits
Salary: USD 103,000 - 155,000 per year. Benefits include competitive salary, health and retirement programs, wellness resources, discretionary time off (DTO), parental leave for primary and secondary caregivers, two annual company breaks, home office stipend, an equity program, an annual performance bonus, and long-term incentives.