Senior Software Engineer, AI Engineer

Midi Health is hiring a Senior Software Engineer, AI Engineer to design, build, and deliver LLM-powered capabilities end-to-end, with a focus on evaluation, safety, and AI-native engineering.

Responsibilities

• Design, build, and ship LLM-powered features end-to-end, including prompt design, retrieval, tool use, agents, evaluation, and production operations
• Create evaluation harnesses and feedback loops to support responsible AI releases
• Integrate AI capabilities deeply into patient, clinician, and operational workflows
• Work with clinical, product, and safety stakeholders to define what success and quality look like
• Contribute to internal AI-for-engineering practices and engineering tooling
• Stay engaged with research and the AI ecosystem, bringing practical improvements back to the team

Requirements

• 6+ years of software engineering experience, including meaningful recent work building production LLM/ML features
• Strong hands-on coding in Python; able to move across the stack when the feature requires it
• Experience designing AI systems across retrieval, orchestration, caching, evaluation, plus managing cost and latency tradeoffs
• Deep, hands-on command of modern AI coding tools; ability to adopt new techniques quickly
• Mentorship instincts; comfortable sharing what you learn
• Commitment to evaluation and safety; preference for evidence over “vibes-only” releases
• Clear communicator who can explain model behavior to non-technical stakeholders
• Low-ego, curious, and humble working style

Technologies

• Python
• LLM
• ML
• Claude Code
• Cursor
• Copilot

Location and Employment

• San Francisco, CA (hybrid)
• Hybrid by design: two days per week in-office on Tuesday and Thursday in Palo Alto or San Francisco
• Full-time W2

Compensation

• USD 170,000 - 210,000 per year

Nice to Have

• Experience with healthcare, clinical NLP, or regulated AI deployments
• Experience building agentic systems or production RAG at scale

Interview Process

• Recruiter Screen (30 min)
• Hiring Manager Screen (45 min)
• Live Technical Assessment (3 sessions, 150 min total)
• On-Site Interview and Lunch (4 sessions, 150 min total)