Senior Generative AI & Testing Efficiency Developer, Vice President
Job Description
Senior-level Citi role leading AI powered and generative AI driven testing capabilities, onsite in Jacksonville, FL, with a salary range of USD 125,760 to 188,640 per year.
Responsibilities
- Oversee the analysis, design, and development of applications in alignment with the enterprise architecture.
- Collaborate with cross‑functional management teams to integrate systems, roll out new products, and drive process improvements.
- Resolve high‑impact, complex problems by deeply analyzing business processes, system flows, and industry standards.
- Define and enforce standards for coding, testing, debugging, and deployment.
- Develop a comprehensive understanding of how architecture, infrastructure, and applications connect to achieve business goals.
- Provide technical mentorship and coaching to mid‑level developers and analysts; assign work and guide progress.
- Assess and manage risk in technical and business decisions, ensuring compliance with laws, regulations, internal policies, and ethical standards.
- Design and implement AI powered testing solutions, including AI generated test cases.
- Implement intelligent regression test selection and self‑healing automation capabilities.
- Automate defect and failure analysis processes to accelerate remediation.
- Develop and optimize large language model based tools for test data generation and scenario creation.
- Develop and optimize LLM based tools for traceability from requirements to tests.
- Develop and optimize LLM based tools for predictive test failure analysis.
- Embed generative AI capabilities into existing automation frameworks such as Selenium and Playwright.
- Apply advanced GenAI techniques including prompt engineering and retrieval augmented generation to enhance testing intelligence.
- Integrate AI driven testing accelerators into CI/CD pipelines to reduce cycle times and improve stability.
- Support deployment, scalability, monitoring, and optimization of AI models in production environments.
- Contribute to real time and streaming AI systems that enable continuous testing and rapid feedback loops.
- Ensure compliance with Responsible AI principles, data privacy requirements, governance standards, and quality controls.
- Stay current with emerging trends in generative AI and test automation; promote best practices across the organization.
- Mentor junior engineers and QA automation developers on AI assisted testing methodologies.
Requirements
- Hands on experience developing, fine tuning, and optimizing large language models.
- Expertise in retrieval augmented generation systems, hybrid search, and vector retrieval.
- Proficiency with ML frameworks such as PyTorch, TensorFlow, and Keras, including distributed training.
- Experience with GenAI tools and libraries like LangChain, LlamaIndex, LangGraph, Crew.ai, Autogen, Hugging Face, and cloud GenAI APIs (OpenAI, Claude, Gemini).
- Strong knowledge of test automation frameworks (Selenium, Playwright).
- Experience integrating AI capabilities into testing pipelines (AI generated tests, self-healing scripts, test impact analysis).
- Solid understanding of CI/CD systems with a focus on continuous testing.
- Familiarity with QA methodologies, test strategy, functional and non‑functional testing, and quality metrics.
- Advanced Python skills for automation tooling, data preprocessing, API development, and AI workflows.
- Experience with containerization and deployment technologies (Docker, Kubernetes).
- Practical knowledge of model optimization techniques.
- Strong understanding of AI governance, model guardrails, testing risk frameworks, and Responsible AI practices.
- Excellent collaboration and communication skills, with the ability to explain AI driven testing strategies to technical and non‑technical audiences.
- Analytical and proactive mindset with a passion for experimentation, innovation, and mentoring.
Technologies
- LangChain
- LlamaIndex
- LangGraph
- Crew.ai
- Autogen
- Hugging Face
- OpenAI
- Claude
- Gemini
- Selenium
- Playwright
- PyTorch
- TensorFlow
- Keras
- Python
- Docker
- Kubernetes
Benefits
- Medical, dental and vision coverage
- 401(k)
- Life, accident, and disability insurance
- Wellness programs
- Paid time off packages including vacation, sick leave, and holidays