Sr. AI & Data Engineer

Accenture is hiring a Sr. AI & Data Engineer for a hybrid role based in Irving, TX. In this position, you will work hands-on with Azure and Databricks to design scalable data pipelines and advanced AI agent capabilities, with expectations to support operational excellence through monitoring, governance, and continuous improvement. The hybrid schedule requires three days per week in the office in the specified hiring locations.

What you will do

• Architect, build, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets using Azure Databricks workflows and Spark technologies.
• Design and optimize Lakehouse architecture using Delta Lake and a Bronze, Silver, Gold layering approach to support efficient, reliable, and governed storage.
• Collaborate with data scientists and business analysts to deliver datasets that are clean, validated, and well-modeled for advanced analytics and AI use cases.
• Design and implement autonomous agents using the Databricks Mosaic AI Agent Framework, including frameworks such as LangChain or AutoGen.
• Build and optimize vector search indexes with Databricks Vector Search to improve accurate context retrieval.
• Process large-scale distributed datasets on the Databricks Intelligence Platform using Apache Spark.
• Design and implement data models aligned to business requirements and improved data usability.
• Continuously evaluate and improve data architecture processes to increase efficiency and effectiveness.
• Design AI agents that include components such as retrieval, orchestration, tool invocation, evaluation harnesses, and lifecycle observability.
• Monitor pipeline health and performance continuously, implementing automated alerting and observability frameworks for faster troubleshooting and proactive optimization.

Requirements

• 3+ years of professional experience as a Data & AI Engineer or related role.
• 3+ years of experience working with Microsoft Azure cloud data services.
• 2+ years with Databricks (including PySpark, SQL, Delta Lake, and workflows).
• Bachelor’s degree or equivalent, with a minimum of 12 years work experience. If an Associate Degree is held, a minimum of 6 years work experience is required.

Technologies you will work with

• Databricks, Azure data services, Azure Databricks, Apache Spark, PySpark, SQL
• Delta Lake and Lakehouse Medallion Architecture: Bronze, Silver, Gold layers
• Databricks Mosaic AI Agent Framework, LangChain, AutoGen
• Databricks Vector Search
• Databricks Intelligence Platform
• Git-based version control, CI/CD pipelines, Azure DevOps, GitHub Actions, Auto Loader
• MLOps / LLMOps, Genie product family
• Databricks Intelligence Platform and Genie product family (as referenced)

Compensation and location

• Location: Irving, TX (hybrid)
• Salary range: USD 59,100 - 205,800 per year

Benefits

• Medical, dental, vision, life, and long-term disability coverage
• 401(k) plan
• Bonus opportunities
• Paid holidays
• Paid time off

Preferred qualifications

• Advanced Python (PySpark) and SQL for data transformation and pipeline development.
• Experience with Azure Databricks, including Spark, Delta Lake, Auto Loader, and Lakehouse Medallion Architecture (Bronze, Silver, Gold).
• Experience with git-based version control and CI/CD pipelines using Azure DevOps or GitHub Actions.
• Experience developing agents using the Mosaic AI Agent Framework.
• Strong problem-solving and performance optimization skills.
• Experience in MLOps / LLMOps, including CI/CD for ML and LLM lifecycle.
• Experience with the Genie product family.
• Databricks Certified Data Engineer Professional (2025).
• Microsoft Certified: Azure Data Engineer Associate.