Senior IT Data Engineer
Job Description
System One is hiring a Senior IT Data Engineer for an onsite, multi-year contract supporting the Federal Reserve Board’s Division of Research & Statistics. This role focuses on expanding and optimizing data architecture and pipelines to help economic policy and research teams get better data flow, reliable delivery architecture, and ETL/ELT automation.
What you’ll be doing
- Expand and optimize data and data pipeline architecture for the Division of Research & Statistics.
- Optimize data flow and collection to support economic policy and research teams.
- Design and develop an optimal data delivery architecture, and support economists and technical experts in using it effectively.
- Work across multiple teams and systems with diverse data needs.
- Optimize or redesign R&S data architecture to support next-generation data initiatives.
- Design, develop, and automate ETL/ELT workflows and data integration pipelines.
- Build, optimize, and maintain scalable databases, data pipelines, and data processing frameworks.
- Perform root cause analysis on internal and external data and business processes to answer business questions and identify opportunities for improvement.
Requirements
- Bachelor’s degree in computer science, information technology, engineering or a related technical field, plus at least 7 years of related experience (advanced degree preferred).
- Advanced working knowledge of SQL.
- Experience with relational database platforms including PostgreSQL, Microsoft SQL Server, and MySQL.
- Advanced working knowledge of Python, R, and other scripting languages used for data engineering and analytics.
- Experience working with large-scale data systems: distributed computing, scalable data processing, data storage architecture, and optimization of high-volume workloads.
- Experience designing, developing, and automating ETL/ELT workflows and data integration pipelines.
- Experience building, optimizing, and maintaining scalable databases, data pipelines, and data processing frameworks.
- Experience with orchestration and pipeline automation tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
- Experience migrating workflows and data pipelines between on-premises and cloud environments.
- Experience processing, analyzing, and integrating structured and unstructured data sources.
- Experience developing in Linux and using GitLab and/or GitHub.
- Ability to design and communicate enterprise information architecture at conceptual, logical, and physical levels.
- In-depth experience designing and implementing database, data lake, and enterprise data platform solutions.
- Strong software engineering and implementation background across development, testing, and deployment of data applications and services.
- Excellent oral and written communication skills with a strong customer service orientation.
- Exceptional analytical, problem-solving, and troubleshooting skills.
- Understanding of time series data and related analytical and forecasting techniques.
- Experience working in a research environment and/or with economic or financial data.
- Experience with NoSQL and graph database technologies.
- Experience developing, training, deploying, and maintaining machine learning models.
- Working experience with AWS, Microsoft Azure, and Snowflake.
- Experience implementing data warehouses utilizing Change Data Capture (CDC).
- Experience implementing and maintaining CI/CD pipelines and DataOps platforms.
- Working knowledge of additional languages such as Java, Scala, JavaScript, or Perl.
- US citizenship required per government contact.
- Must be able to obtain Public Trust clearance.
Location, contract details, and apply window
- Location: Washington, DC (onsite)
- Job type: Contract (Multi-Year Contract supporting Federal Reserve Board)
- Work authorization: Open to W2 and C2C
- Must apply by: 12pm on July 2nd
Benefits
- Health and welfare benefits coverage options including medical, dental, vision
- Spending accounts
- Life insurance
- Voluntary plans
- Participation in a 401(k) plan
Technologies
- SQL, PostgreSQL, Microsoft SQL Server, MySQL
- Python, R
- Apache Airflow, Prefect, Dagster, AWS Step Functions
- Linux, GitLab, GitHub
- NoSQL, graph database technologies
- Machine learning models
- AWS, Microsoft Azure, Snowflake
- Change Data Capture (CDC), CI/CD pipelines, DataOps platforms
- Java, Scala, JavaScript, Perl