Data Engineer – Databricks & ADF (ETL)
Big Data
Data
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Programming
Programming Language
Programming Languages
Software Development
SQL
Job Description
Robotics Technologies is seeking a Data Engineer to design and improve Databricks and Azure Data Factory ETL/ELT pipelines on-site in Dallas, TX.
Responsibilities
- Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF)
- Use Databricks to process, transform, and optimize data workflows
- Write and optimize SQL for data extraction and transformation
- Apply PySpark or Python for large-scale data processing
- Integrate data from multiple sources into data warehouses or data lakes
- Monitor pipelines, troubleshoot issues, and improve performance and reliability
- Collaborate with cross-functional teams to support data quality and pipeline dependability
Requirements
- Hands-on experience with Databricks and Azure Data Factory (ADF)
- Strong understanding of ETL/ELT concepts
- Good knowledge of SQL and data transformations
- Basic experience with Python or PySpark
- Understanding of Azure cloud services and data lake concepts
Tech Stack
- Databricks
- Azure Data Factory (ADF)
- ETL / ELT
- SQL
- PySpark
- Python
- Azure cloud services
- Data lake
Location and Compensation
- Location: Dallas, TX (on-site)
- Salary: USD 78 - 78 per hourly