Senior Data Engineer
Job Description
Symphony Solutions offers a hybrid work setup across Short Hills, NJ, Charlotte, NC, and Hartford, CT (with 2 days hybrid) and includes flexible work from home options. In this Senior Data Engineer role, you will build and improve production data flows using Azure and Databricks, combining hands-on pipeline development with practical data understanding.
Responsibilities
- Build ETL pipelines daily in an Azure and Databricks environment using SQL and Python.
- Design data projects and implement them end-to-end, with a hands-on approach to pipeline development.
- Write Python code for pipelines within Databricks.
- Develop and work with Spark Declarative pipelines and know how to write them.
- Implement how data is ingested within Databricks.
- Use strong data understanding to analyze datasets and explain what story the data is telling.
Requirements
- Experience building pipelines, designing projects, and implementing them in a hands-on capacity.
- Good understanding of the data, including the ability to review a dataset and communicate what it indicates.
- Ability to learn and pick up new skills quickly, along with basic analytical skills.
Technologies
- Azure
- Databricks
- SQL
- Python
- Unity Catalogue
- Spark
Compensation: USD 50–60 per hour.