AI Engineer – Senior Software Engineer

Converge Squad 2 is seeking a Senior Software Engineer – AI Engineer to design, build, and productionize AI-powered solutions that span machine learning, generative AI, LLMs, backend engineering, and cloud technologies. This onsite role is based in Randolph, NJ, where you will help deliver scalable, reliable, and secure AI applications from early prototypes through deployment and ongoing optimization.

What you will do

• Design and develop scalable AI-powered applications and services.
• Build and integrate Generative AI and Large Language Model (LLM) capabilities into production applications.
• Create AI/ML pipelines for data preparation, model training, evaluation, deployment, and monitoring.
• Work with LLMs, embeddings, vector databases, Retrieval-Augmented Generation (RAG), prompt engineering, and AI agents.
• Design and implement APIs and backend services that connect AI capabilities with existing products and platforms.
• Evaluate models and approaches using criteria including accuracy, latency, cost, scalability, and reliability.
• Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response-quality improvements.
• Deliver production-ready solutions with observability, logging, monitoring, security, and failure handling.
• Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical implementations.
• Contribute to architecture and design discussions and participate in technical decision-making.
• Perform code reviews, support engineering best practices, and mentor other engineers.
• Stay current with AI, machine learning, LLMs, and related technologies and identify opportunities to apply them to products.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of professional software engineering experience building and deploying production systems.
• Strong programming skills in Python and/or Java.
• Solid understanding of software engineering principles, object-oriented design, data structures, algorithms, and system design.
• Hands-on experience with Generative AI, LLMs, or machine learning systems.
• Experience working with APIs and integrating AI/ML models into applications.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with databases and data processing systems.
• Strong grounding in testing, debugging, CI/CD, version control, and production operations.

Technologies you may work with

• Python, Java, SQL
• Machine Learning, Generative AI, LLMs, NLP, embeddings, RAG, prompt engineering
• LangChain, LlamaIndex, Semantic Kernel
• PyTorch, TensorFlow, scikit-learn
• REST APIs, microservices, distributed systems
• AWS, Azure, Google Cloud
• SQL and NoSQL databases, vector databases
• Git, CI/CD, Docker, Kubernetes, monitoring and observability
• OpenAI, Anthropic, Gemini
• Pinecone, Weaviate, Milvus, OpenSearch, pgvector
• Additional: MLOps/LLMOps

Preferred qualifications

• Experience with OpenAI, Anthropic, Gemini, or other foundation models.
• Experience building RAG applications using embeddings and vector databases.
• Experience with vector databases such as Pinecone, Weaviate, Milvus, OpenSearch, or pgvector.
• Experience with frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
• Experience developing AI agents and tool-using LLM applications.
• Experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn.
• Experience with model evaluation, fine-tuning, or parameter-efficient fine-tuning.
• Familiarity with MLOps/LLMOps practices.
• Experience with Docker, Kubernetes, and cloud-native application development.
• Knowledge of AI security, data privacy, responsible AI, and model safety practices.
• Experience designing highly scalable distributed systems.

Location: Randolph, NJ (onsite)
Experience: 5+ years
Employment type: Full-time
Salary: USD 50,000 - 600,000 per yearly
Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field

All your information will be kept confidential according to EEO guidelines.