Azure Data Engineer
Big Data
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Integration
Programming
Programming Language
Programming Languages
Software Development
SQL
Job Description
Robotics Technologies is seeking an Azure Data Engineer in Raleigh, NC to design, develop, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The role focuses on end-to-end ETL/ELT delivery, lake and lakehouse architectures, governance, and operational monitoring for reliable analytics platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure data services.
- Build and optimize ETL and ELT workflows using Azure Data Factory.
- Develop data processing solutions with Azure Databricks and PySpark.
- Use Azure Synapse Analytics to support data warehousing and analytical workloads.
- Create complex SQL queries and stored procedures, including performance optimization strategies.
- Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
- Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
- Implement data quality, validation, transformation, and governance processes.
- Develop and maintain batch and real-time data processing solutions.
- Optimize pipelines for performance, scalability, and cost efficiency.
- Implement monitoring, logging, and error-handling mechanisms.
- Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
- Follow security best practices for data access, encryption, and compliance.
Required Skills and Tools
- Cloud platform: Microsoft Azure
- Data integration: Azure Data Factory (ADF)
- Big data processing: Azure Databricks, Apache Spark, PySpark
- Data warehousing: Azure Synapse Analytics
- Storage: Azure Data Lake Storage Gen2
- Programming: Python, PySpark, SQL
- Databases: Azure SQL Database, SQL Server
- Data architecture: Lakehouse, Delta Lake, Medallion Architecture
- DevOps: Azure DevOps, Git, CI/CD
- Data governance: Microsoft Purview
- Streaming: Azure Event Hubs, Stream Analytics
Location and Compensation
- Location: Raleigh, NC (onsite)
- Salary: USD 78 per hour