Senior Data Engineer

Senior Data Engineer role enabling IRS project delivery by leading data management, governance, and administration within Databricks and cloud native environments.

Responsibilities

• Design, scale, and maintain data pipelines for intake, governance, and tenant services on the Enterprise Data Platform, ensuring reliability and scalability.
• Optimize Databricks clusters, oversee workspaces, and implement platform policies to enforce standards and security.
• Collaborate closely with cloud infrastructure and security teams to establish secure guardrails for data ingestion, access control, and cross team workflows.

Location

Baltimore, Maryland, onsite

Requirements

• Minimum 8+ years of dedicated cloud technology experience, with AWS or Azure preferred.
• 3 to 5 years hands-on experience deploying, governing, and managing Databricks environments.
• Strong proficiency in PySpark, SQL, Python, Delta Lake, and building robust ETL/ELT pipelines.
• Ability to pass a federal government background check or Public Trust clearance.

Technologies

• Databricks
• PySpark
• SQL
• Python
• Delta Lake
• AWS
• Azure

Compensation

Salary: USD 120,000 per year

Important Notice

This role is part of a proposal for Internal Revenue Services. Hiring is contingent upon the selection of the consultant. Selected candidates will be included in the proposal and must authorize the use of their resume for submission.