Senior Software Engineer, AI
Job Description
Senior Software Engineer, AI at Okta, focusing on GenAI powered user interfaces and backend systems with emphasis on AI integration for internal customers.
Responsibilities
- Design and implement end to end GenAI enabled applications, spanning web UIs, API services, and backend orchestration.
- Develop and integrate large language model experiences using frameworks such as LangChain and LlamaIndex, and tools like OpenAI, Claude, or Gemini.
- Establish, implement, and advocate for operational excellence across services, including SLOs, observability, and incident response frameworks.
- Build responsive, accessible frontend interfaces with React or Vue, prioritizing usability, performance, and reliability of AI outputs.
- Create and maintain a shared library of reusable frontend components and hooks to enable other teams to drop GenAI capabilities into their apps quickly.
- Develop and sustain retrieval augmented generation pipelines with vector search and embedding strategies (Pinecone, FAISS, Qdrant).
- Partner with designers and product managers to iterate on UX patterns for AI powered experiences, including prompts, citations, and summaries.
- Ensure security, privacy, observability, and test coverage across the full stack.
- Contribute to architecture decisions, engineering standards, and best practices for AI and automation systems.
- Collaborate with platform and infrastructure teams to ensure services scale reliably across the organization.
Requirements
- 5–8 years of software engineering experience with full stack development, including 2+ years building AI/ML driven applications.
- 5+ years of frontend experience with React, TypeScript, or Vue, and hands-on work on UI/UX for internal tools or enterprise apps.
- Strong Python development skills and 2+ years building cloud based services using AWS, Docker, and RESTful APIs.
- Hands-on experience with LLM integration, RAG pipelines, prompt engineering, or orchestration frameworks like LangChain or LlamaIndex.
- Solid background in distributed systems, APIs, microservices, container orchestration (ECS/EKS), and cloud platforms (AWS/GCP/Azure).
- Familiarity with secure coding, authentication/authorization, and internal data governance best practices.
- Ability to collaborate across engineering, design, and product teams with strong user empathy and technical ownership.
Technologies
- Python
- AWS
- Docker
- RESTful APIs
- React
- Vue
- TypeScript
- LangChain
- LlamaIndex
- OpenAI
- Claude
- Gemini
- Pinecone
- FAISS
- Qdrant
- ECS
- EKS
- GCP
- Azure
Benefits
- Well-being support and programs
- Opportunities to contribute to social impact initiatives
- Professional growth and community connections
Why Join Okta
- Turn AI ideas into real apps used daily by Okta employees
- End to end full stack work from LLM orchestration to intuitive UIs
- Focus on security, ethics, and technical excellence in AI
The Okta Experience
- Well-being support and programs
- Opportunities to contribute to social impact initiatives
- Professional growth and community connections