DeveloperJobs.io
← Back to all jobs

Job Description

Robotics Technologies is seeking an Azure Data Engineer in Raleigh, NC to design, develop, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The role focuses on end-to-end ETL/ELT delivery, lake and lakehouse architectures, governance, and operational monitoring for reliable analytics platforms.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL and ELT workflows using Azure Data Factory.
  • Develop data processing solutions with Azure Databricks and PySpark.
  • Use Azure Synapse Analytics to support data warehousing and analytical workloads.
  • Create complex SQL queries and stored procedures, including performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.

Required Skills and Tools

  • Cloud platform: Microsoft Azure
  • Data integration: Azure Data Factory (ADF)
  • Big data processing: Azure Databricks, Apache Spark, PySpark
  • Data warehousing: Azure Synapse Analytics
  • Storage: Azure Data Lake Storage Gen2
  • Programming: Python, PySpark, SQL
  • Databases: Azure SQL Database, SQL Server
  • Data architecture: Lakehouse, Delta Lake, Medallion Architecture
  • DevOps: Azure DevOps, Git, CI/CD
  • Data governance: Microsoft Purview
  • Streaming: Azure Event Hubs, Stream Analytics

Location and Compensation

  • Location: Raleigh, NC (onsite)
  • Salary: USD 78 per hour

Similar Jobs