IT-Software Engineer
Backend Developer
Agentic Ai
Ai Agent
Ai Agent Platform
Ai Platform
Ai Security
APIs
Artificial Intelligence
Artificial Intelligence Engineer
Cloud Platforms
Data Architecture
Data Integration
Database
DevOps
Engineering
Generative AI
Large Language Models
Machine Learning
Management
Project Management
Security
Software Development
Software Engineer
Software Engineering
Job Description
All IT Solutions is hiring an IT-Software Engineer for a client engagement in Chicago, IL (hybrid) on a contract basis.
Responsibilities
- Provide technical leadership and help optimize workflows across teams, with a focus on improving developer experience
- Lead architectural design and coordinate across teams to define scalable solutions
- Design and orchestrate multi-agent workflows and stateful AI systems using modern frameworks such as LangChain, LangGraph, AutoGen, or CrewAI
- Integrate foundation models (Anthropic Claude, OpenAI GPT, Google Gemini) via secure API gateways, including token limits, cost, and rate-limiting management
- Architect AI-native data models by combining relational databases with vector databases for semantic search and RAG (Retrieval-Augmented Generation)
- Build robust white-box testing and continuous evaluation metrics to monitor AI outputs for factual correctness, hallucinations, and safety compliance
- Champion secure, reliable, and scalable software through architectural leadership, risk management, and continuous engineering improvement
- Mentor and scale an engineering team by establishing standards, best practices, and architectural governance for secure coding, CI, and cloud-native deployments
- Increase AI-assisted engineering velocity by integrating coding tools (Cursor, Claude Code, Windsurf) into the team’s daily SDLC
- Create governance policies and coach developers on responsible AI use, including input data sensitivity, license compliance, and security guardrails
- Assess existing systems, services, APIs, and data models to drive modernization, scalability, and performance improvements
- Participate in technical leadership forums with Product Owners, Technical Leads, Architects, and Engineering Managers
- Drive discussions on architecture, engineering health, technical debt, AI adoption, and continuous improvement
- Support collaboration through architecture reviews, RFCs, and technical discussions
- Promote self-service engineering capabilities and platform enablement
- Lead automation initiatives to improve productivity and software quality
- Engage with the team for PR reviews and coordinate with other teams as needed
- Work directly with a Scrum team, including regular interaction during ceremonies and ongoing collaboration
Requirements
- Demonstrated ability to mentor engineers and drive technical excellence
- Ability to work under pressure and within time constraints
- Significant interaction required with the Scrum team, including participation in Daily Standups, Sprint Planning, Grooming, Retro, and Demo
- Bachelor’s degree in Computer science or Electrical engineering or a related field
- 8+ years of professional software engineering experience
- 2+ years in a technical leadership role
- Proven experience designing and delivering large-scale distributed systems
- Strong expertise in software architecture, APIs, microservices, cloud-native applications, and modern engineering practices
- Experience influencing multiple engineering teams and leading organization-wide technical initiatives
- Strong communication, collaboration, and stakeholder management skills
- Experience with Generative AI, AI agents, LLM-powered applications, or intelligent automation platforms
- Experience with AI development tools, coding assistants, and modern developer productivity platforms
- Knowledge of security architecture, application security, and cloud security best practices
- Experience establishing technical governance and engineering standards across multiple teams
- Extensive cloud and DevOps experience, including containerization (Docker, Kubernetes) and public cloud infrastructure (including AWS for AI and LLM infrastructure)
- Hands-on experience with production-level AI agents, prompt engineering, and advanced Agentic PDLC patterns
- Practical knowledge of vector technologies such as Pinecone, Milvus, Chroma, or pgvector
Technology Stack
- Java
- LangChain, LangGraph, AutoGen, CrewAI
- Anthropic Claude, OpenAI GPT, Google Gemini
- Docker, Kubernetes, AWS
- Pinecone, Milvus, Chroma, pgvector
- Model Context Protocol (MCP)
- Cursor, Claude Code, Windsurf