Lead Azure Data Engineer
Job Description
Robotics Technologies is hiring a Lead Azure Data Engineer to support a 10-month engagement in Houston, TX (onsite), with the role continuing through an extension. This position focuses on delivering end-to-end Azure data engineering work, including Azure Data Factory and Azure Databricks development, while improving pipeline performance and storage efficiency.
Job ID: J55503
Location: Houston, TX (onsite)
Duration: 10 Months + Extension
Pay: USD 63 per hour (listed)
What you will do
- Build Azure Data Factory pipelines, including data flows, triggers, integration runtimes, and parameterized workflows.
- Create and optimize Azure Databricks notebooks, jobs, and workflows, implementing Delta Lake solutions.
- Develop modular data engineering components using Python or Scala, applying unit testing practices.
- Write and tune advanced SQL queries using CTEs and window functions against large datasets.
- Optimize data storage and performance using ADLS Gen2 with Parquet, including partitioning and techniques such as Z-Ordering, OPTIMIZE, and VACUUM.
- Support Git-based CI/CD to promote changes across Azure Data Factory and Databricks environments.
- Partner with stakeholders and take part in testing and delivery activities.
What you bring
- 8-10 years of data engineering experience.
- At least 3 years of experience with Azure.
- Hands-on experience with Azure Data Factory.
- Experience with Azure Databricks.
- Strong advanced SQL skills.
- Programming experience in Python or Scala.
- Experience working with large datasets and data pipeline optimization.
Technologies involved
- Azure Data Factory (data flows, triggers, integration runtimes, parameterized workflows)
- Azure Databricks, Delta Lake
- Python, Scala, SQL
- CTEs, window functions
- ADLS Gen2, Parquet, partitioning
- Z-Ordering, OPTIMIZE, VACUUM
- Git-based CI/CD (CI/CD), unit testing
Employment type: W-2, 1099, C2C
Work authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Bill rate: $63/hour (C2C)
Domain exposure: Aerospace/ Airlines
Client: To Be Discussed Later