Machine Learning Engineer
Job Description
Arena Intelligence, Inc. is building infrastructure that makes real-world AI evaluation more reliable, scalable, and repeatable. In this onsite role in the San Francisco Bay Area, you will help shape how model benchmarking systems are engineered, deployed, and continuously improved across end-to-end pipelines and evaluation approaches.
You will contribute to a tight-knit team focused on turning research and product ideas into dependable systems for data, inference, and measurement. The work spans architecture and implementation, with a clear emphasis on scaling core evaluation capabilities and strengthening the foundations for comparing frontier models.
What you will do
- Architect and build core modeling capabilities for data and evaluation products.
- Own the full stack for data handling, model training, and evaluation pipelines.
- Build a feedback loop that supports rapid product iteration as new features are delivered.
- Research state-of-the-art evaluation methods and contribute to a long-term plan for a centralized, scalable evaluation platform.
What you bring
- Strong programming skills and the ability to work across the stack in a typical recommendation system or LLM stack.
- Experience in deep learning, language models, or reward model training.
- Experience using LLMs for fine tuning, prompt engineering, function calling, and related workflows.
- Self-motivation and the willingness to take ownership of tasks.
- A passion for shipping quality products.
- Solid understanding of statistics, including tools and methodologies for evaluating uncertainty in a way that fits the product being shipped.
About the role
- Scale and strengthen the core infrastructure that supports real-world AI evaluation.
- Help define how benchmarking systems are built and improved across data pipelines, inference APIs, and new evaluation methodologies.
- Partner with researchers, engineers, and product leadership to translate new ideas into dependable systems.
- Improve reproducibility, scale to new modalities, and deepen the team’s ability to understand and compare frontier models.
Benefits
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- Work on cutting-edge AI with a small, mission-driven team.
- A culture centered on transparency, trust, and community impact.
Compensation and location
This role is based in the San Francisco Bay Area, CA and is onsite. The company offers competitive compensation aligned to the markets where team members are located. The compensation range is listed on the posting and depends on candidate experience and work location.
Minimum experience: 4 years.