NFF Inc is hiring an ETL Data Engineer to support the Enterprise Data team in Washington, DC (onsite). In this role, you will help design and deliver end-to-end ETL pipelines, strengthening data curation, processing, and transformation across cloud and on-prem environments while ensuring data governance, automation, and monitoring.
Why you will like working here
- Medical, Dental and Vision coverage
- Health Savings Account and Flexible Spending Account
- STD, LTD, Supplemental life insurance, and ADD&D
- Comprehensive 401k plan
- Paid Time Off
What you will do
You will analyze, design, develop, implement, replicate, and support complex enterprise data projects. The position requires strong ETL expertise and hands-on delivery across multiple systems, including guidance to user departments on system requirements and constraints. You will advise on operating difficulties in the current state and resolve issues using cloud solutions, while also developing and replicating future enhancements to District data systems.
- Work with Extraction, Transformation, and Loading (ETL) frameworks such as Azure Data Factory, Azure Synapse, Databricks, and Informatica
- Establish and support cloud and on-prem connectivity across systems including ADLS, ADF, and Synapse
- Build end-to-end pipelines that load data from multiple sources into a landing layer or SQL tables
- Develop, standardize, and optimize data workflows and pipelines using best practices
- Adhere to enterprise data governance requirements for accuracy, consistency, security, and reliability
- Automate, monitor, and manage data pipelines and workflows, including alerts
- Analyze system changes for feasibility and provide alternative approaches along with backup and rollback procedures
- Create complex programs and reports using database query language
- Support data pipeline and integration tooling such as Informatica, Apache NiFi, Apache Airflow, and related technologies
- Handle and secure sensitive data according to the level of sensitivity
What you bring
- Bachelor’s degree in Information Technology or related field, or equivalent experience
- 15 years of strong knowledge developing ETL processes, including end-to-end pipelines for loading data from multiple sources
- 15 years ability to gather and document requirements for data extraction, transformation, and load processes
- 15 years understanding of data warehousing, data lake, business intelligence, and information management concepts and standards
- 15 years ability to advise internal and external customers on tools and systems for complex data processing challenges
- 15 years knowledge and use of SQL for relational databases
- 11 years experience with data formats including database-specific (Oracle, SQL Server, DB2, Quickbase), text formats (CSV, XML), and binary formats (Parquet, AVRO)
- 11 years experience contributing to enterprise data governance for accuracy, consistency, security, and reliability
- 7 years experience with Microsoft Azure tools such as Azure Data Factory, Azure Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage; required 5 years experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME
- 5 years experience with visualization and reporting software including MicroStrategy, Tableau, and Esri ArcGIS
- Highly desired 3 years communication skills (oral and written)
- Required 3 years ability to provide excellent customer service to external partners
- Required 3 years ability to work independently or as part of a larger team
- Highly desired 3 years experience performing data functions with Databricks
Compensation: USD 100,000 - 125,000 per year.
Technologies: Azure Data Factory, Azure Synapse, Databricks, Informatica, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python, ADLS, ADF, Synapse, Informatica PowerCenter, Apache NiFi, Apache Airflow, FME, Oracle, SQL Server, DB2, Quickbase, CSV, XML, Parquet, AVRO, SQL, Postgres, MicroStrategy, Tableau, Esri ArcGIS.
