Azure Data Engineer – AI & Data Platform

Intone Networks seeks an experienced Azure Data Engineer to design scalable cloud data platforms, craft AI driven data pipelines, and derive business insights from remote locations.

Responsibilities

• Data Engineering & Platform Development: Architect, build, and maintain scalable data ingestion, transformation, and ETL/ELT pipelines using Azure services. Develop and optimize data solutions with Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks, and Azure Data Lake Storage. Implement batch and real time processing with Spark, SQL, and Python. Apply enterprise-aligned data modeling to meet business requirements. Manage data integration pipelines.
• AI & Generative AI Enablement: Create AI assisted capabilities for automated data pipeline generation, code acceleration, and notebook creation. Integrate Azure OpenAI and Azure AI Services into data engineering workflows. Build intelligent data quality monitoring, anomaly detection, and predictive analytics. Design AI powered agents for operational monitoring, user notifications, and workflow automation. Evaluate and adopt emerging AI technologies to boost engineering productivity.
• Data Governance & Quality: Implement data quality frameworks, validation rules, and monitoring mechanisms. Ensure security, privacy, and governance compliance. Establish metadata management, lineage tracking, and data cataloging processes. Support audit, regulatory reporting, and compliance requirements.
• Operational Support: Monitor and troubleshoot data pipelines and platform issues. Conduct root cause analyses and implement preventive measures. Support production deployments, release management, and operational excellence initiatives. Collaborate with cross functional teams to resolve data and platform issues.

Requirements

• SQL
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Microsoft Fabric
• Azure Databricks
• Azure Data Lake Storage (ADLS)
• Python
• PySpark
• Data Modeling and Data Warehousing
• Azure DevOps (ADO), CI/CD
• Git
• Version Control
• REST APIs and Data Integration
• AI & Advanced Skills
• Azure OpenAI Service
• Azure AI Services
• Generative AI and Large Language Models (LLMs)
• AI Agents and Workflow Automation
• Retrieval-Augmented Generation (RAG)
• Prompt Engineering
• Intelligent Monitoring and AI-driven Operations

Technologies

• SQL
• Azure Data Factory (ADF)
• Azure Synapse Analytics
• Microsoft Fabric
• Azure Databricks
• Azure Data Lake Storage (ADLS)
• Spark
• Python
• PySpark
• Azure DevOps (ADO)
• Git
• REST APIs
• Azure OpenAI Service
• Azure AI Services
• Generative AI
• Large Language Models (LLMs)
• AI Agents
• Retrieval-Augmented Generation (RAG)
• Prompt Engineering

Role Summary

We are seeking an experienced Azure Data Engineer with expertise in cloud data platforms, modern data engineering practices, and AI driven solutions. The role involves designing, building, and optimizing scalable data pipelines, integrating enterprise data sources, and leveraging Azure AI and Generative AI technologies to improve data engineering productivity and business insights.

Key Competencies

• Problem Solving & Analytical Thinking
• Stakeholder Management
• Collaboration & Communication
• Innovation & Continuous Improvement
• Operational Excellence
• AI Adoption & Automation Mindset