OCTO ETL Data Engineer

Collaboredge Inc. is supporting the Enterprise Data team for OCTO and needs an ETL Data Engineer to help deliver reliable cloud data pipelines. This contract role is based in Washington, DC (onsite) and supports data curation, processing, and transformation for the Cloud Data Exchange using native Azure tooling across ETL, loading, and transformation.

If you enjoy end-to-end pipeline development, governance-focused engineering, and building automation that keeps enterprise workflows running smoothly, this is a strong match. The role also involves collaborating with other agencies and advising user departments on requirements, environment constraints, and cloud-based solutions for current and future District data systems.

Responsibilities

• Analyze, design, develop, implement, replicate, and support complex enterprise data projects.
• Interface with other agencies, gather requirements from stakeholders, and consult with user departments on system requirements.
• Advise on environment constraints and operating difficulties for the current state, then advise and resolve problems using cloud solutions while developing and replicating future enhancements.
• Build and enhance ETL solutions using frameworks such as Azure Data Factory, Synapse, Databricks, and Informatica by reviewing existing code and implementing improvements or new development.
• Establish cloud and on-premise connectivity across systems such as ADLS, ADF, and Synapse, including connectivity for Databricks.
• Develop end-to-end pipelines that load data from multiple sources into a landing layer and/or SQL tables.
• Standardize and optimize data workflows/pipelines while adhering to best practices.
• Support enterprise data governance by ensuring data accuracy, consistency, security, and reliability.
• Automate, monitor, alert, and manage data pipelines and workflows.
• Analyze and evaluate system changes for feasibility and define alternative solutions, backup, and rollback procedures.
• Develop programs and reports using database query language.
• Support upgrades, enhancements, and new systems while ensuring consistency with approved standards.
• Handle and secure sensitive data based on sensitivity level.

Requirements

• ETL development experience, including end-to-end pipelines that load data from multiple sources.
• Ability to gather and document requirements for data extraction, transformation, and load processes.
• Understanding of data warehousing, data lake, business intelligence, and information management concepts and standards.
• Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges.
• Knowledge and use of SQL for relational databases.
• Experience with data formats including database-specific types (Oracle, SQL Server, Postgres, DB2, Quickbase), text formats (CSV, XML), and binary formats (Parquet, AVRO).
• Strong experience with Microsoft Azure tools: Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage.
• Experience with data integration and pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME.
• Contribute to enterprise data governance standards: accuracy, consistency, security, and reliability.
• Strong communication skills, both oral and written.
• Ability to provide excellent customer service to external partners.
• Ability to work independently or as part of a larger team.

Technologies

• Azure Data Factory, Azure Synapse, Databricks
• Informatica, Informatica PowerCenter
• MSSQL Db, Azure SQL DB, SQL
• Azure Data Lake Storage Gen2 (ADLS), Blob Storage
• Python
• Oracle, SQL Server, DB2, Quickbase
• CSV, XML, Parquet, AVRO
• Apache NiFi, Apache Airflow, FME
• MicroStrategy, Tableau, Esri ArcGIS

Minimum Qualifications

• 3+ years of experience
• Bachelor’s degree in Information Technology or related field, or equivalent experience

Background Check

• Extensive criminal history background check required. Cannot submit candidates with recent histories (look back seven years) involving extensive driving, drug, robbery, or any other illegal activity.
• Any criminal activity on the background check will eliminate the candidate from consideration.
• If selected, candidates must complete this criminal background check prior to starting.
• NATIONAL background checks are required; Federal background checks are NOT compliant under this contract.

Compensation: USD 59 - 72 per hour. Job Type: Contract.