Robert Half is building production-grade generative AI capabilities to strengthen recruiting, placement, and sales workflows, along with internal productivity applications. As a Software Engineer I focused on Generative AI Applications, you will help design, build, test, deploy, and monitor AI-powered applications, APIs, and integrations that translate business goals into reliable systems.
Role overview
In this onsite New York, NY position, you will collaborate with data scientists, data engineers, DevOps, and business stakeholders to deliver scalable technical solutions. The work centers on GenAI application patterns, including retrieval-augmented generation (RAG), prompt orchestration, agent workflows, and evaluation pipelines, while expanding expertise across leading LLM families and platform integrations.
Responsibilities
- Contribute to the design, build, testing, deployment, and monitoring of production-grade generative AI applications, APIs, and integrations supporting recruiting, placement, sales, and internal productivity workflows.
- Partner with data scientists, data engineers, DevOps, and business stakeholders to translate business needs into scalable technical solutions.
- Use and extend GenAI patterns such as RAG, prompt orchestration, agent workflows, and evaluation pipelines, and continue building expertise across leading LLM families and platform integrations.
- Write clean, maintainable, well-tested code and contribute to technical documentation, code reviews, monitoring, and operational best practices.
Requirements
- Strong software engineering fundamentals, with proficiency in Python and experience building APIs, services, data pipelines, or cloud-based applications.
- Hands-on familiarity with generative AI tools and concepts, including LLM APIs, prompt engineering, RAG, vector databases, embeddings, evaluation methods, and leading LLM families; production application experience is strongly preferred.
- Experience with AWS and cloud-based production environments, plus modern engineering practices such as Git, CI/CD, testing, observability, and agile delivery.
- Ability to communicate technical ideas clearly, collaborate across technical and non-technical teams, and work through ambiguous problems with guidance and clear communication.
Technology areas
- Python
- RAG
- Prompt orchestration
- Agent workflows
- Evaluation pipelines
- LLM APIs
- Prompt engineering
- Vector databases
- Embeddings
- AWS
- Git
- CI/CD
- Observability
- Agile delivery
Benefits
- Group health insurance benefits (medical, vision, dental)
- FSA and HSA healthcare accounts
- Life and accident insurance
- Adoption and fertility assistance
- Paid parental leave of up to 6 weeks
- Short/long term disability
- Paid time off for vacation, personal needs, and sick time
- Choice Time Off (CTO) varying based on years of service, pro-rated based on hours worked per week (a new hire earns up to 17 days of CTO per calendar year)
- Up to 11 paid holidays per calendar year
- Opportunity to contribute to a 401(k) savings and investment plan or deferred compensation plan (if eligible), with an employer match of 100% on the first 3% of contributions for eligible employees
About Robert Half
The department is described as a dynamic, global team of diverse professionals developing award-winning AI solutions, including both traditional and generative models. The organization leverages cutting-edge machine learning technologies to drive innovation and enhance recruiting, placement, and sales processes, supported by investments in data science and proprietary data used across core products.
Salary range
The typical annual salary range for this position is $68,000.00 - $102,000.00. The range is negotiable depending upon experience and location.
Application and hiring process
- As part of Robert Halfβs Corporate Services facility employment process, any offer of employment is contingent upon successful completion of a background check.
- Recruiters use their expertise and may utilize AI to help with evaluation of candidates.
Equal opportunity and accommodations
- Robert Half Inc. is an Equal Opportunity Employer (M/F/Disability/Veteran).
- Robert Half is committed to equal employment opportunity for all job seekers, including individuals with disabilities.
- For reasonable accommodation to search or apply, contact HRSolutions@roberthalf.com or call 1.855.744.6947.
- Include the specific accommodation requested and the location(s) (city, state) you would like to apply to in your email.
Fair chance ordinance notes
- San Francisco, CA: qualified applicants with criminal histories will be considered consistent with the San Francisco Fair Chance Ordinance.
- Los Angeles County, CA: qualified applicants with arrest or conviction records will be considered in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.