DeveloperJobs.io
← Back to all jobs

Job Description

Principal Data Engineer role in Vienna, VA focused on enterprise data platform modernization, governed data products, and AI-enabled data engineering.

Responsibilities

  • Provide senior technical leadership and hands-on expertise across data engineering, analytics, reporting, and data consumption.
  • Lead design and deployment of AI-enabled accelerators and agent-based solutions across the data engineering lifecycle, including code generation, legacy code conversion, pipeline scaffolding, and documentation.
  • Define AI development standards and guardrails, including approved models, human review for AI-generated code, and validation against security and governance requirements.
  • Drive AI-enabled test automation for data engineering initiatives by partnering with quality engineering to reduce manual testing via unit, integration, regression, and data validation testing.
  • Build reusable frameworks for ingestion, transformation, validation, reconciliation, and monitoring.
  • Enable conversational analytics for AI agents by curating semantic definitions, metric views, ontology, metadata, and governed access in Unity Catalog for accurate, explainable, trusted answers.
  • Design, develop, and optimize scalable batch, near real-time, and real-time pipelines using Spark, Python, SQL, Databricks, and related Azure cloud services.
  • Evaluate emerging AI and data engineering technologies, identify high-value enterprise use cases, and recommend adoption strategies.
  • Mentor senior and mid-level engineers through architecture reviews, design standards, coding practices, performance tuning, and operational resilience improvements.
  • Modernize legacy workloads by migrating fragmented reporting and data assets into secure, standardized, governed analytics platforms.
  • Define and implement API-driven and event-based data onboarding patterns using enterprise API management, integration, and streaming platforms (Gravitee, MuleSoft, Kafka).
  • Implement metadata management, lineage, cataloging, and access governance using tools such as Unity Catalog and Alation.
  • Partner with data architects, analysts, product owners, business stakeholders, governance teams, and platform teams to translate business needs into scalable technical solutions.
  • Ensure solutions meet security, reliability, and compliance expectations aligned to Navy Federal policies, engineering standards, and regulatory requirements.
  • Support Agile delivery and DevSecOps practices, including CI/CD deployment, release readiness, defect resolution, and production support.

Requirements

  • Bachelor’s degree in Information Systems, Computer Science, Engineering, Data Engineering, or a related field, or the equivalent combination of education, training, and experience.
  • Advanced hands-on expertise in Spark, Python, SQL, Databricks, and cloud-native data integration, transformation, and analytics solutions.
  • Hands-on experience applying AI-assisted and agentic development tools (including Databricks Genie Code) to accelerate data engineering, with validation of AI-generated output against engineering, security, and governance standards.
  • Strong experience designing, building, and supporting scalable data pipelines and platforms including lakehouse architectures, data warehouses, data marts, and analytical data stores.
  • Expertise in automated data quality validation, reconciliation, monitoring, alerting, error handling, and SLA management.
  • Experience automating data pipeline testing (unit, integration/SIT, regression) in CI/CD, including using AI agents to generate test cases, test data, and validation scripts.
  • Experience with metadata management and lineage using governance and catalog platforms such as Unity Catalog.
  • Experience with BI and analytics platforms such as Power BI, Tableau, Microsoft Fabric, and enterprise reporting modernization patterns.
  • Working knowledge of Azure DevOps, CI/CD pipelines, Agile delivery, production deployment, and operational support practices.
  • Ability to communicate complex technical concepts to business stakeholders, technology leaders, engineers, and cross-functional delivery teams.
  • Strong problem-solving skills, architectural judgment, ownership mindset, and ability to lead delivery in complex, highly regulated environments.

Technologies

  • Spark
  • Python
  • SQL
  • Databricks
  • Azure cloud services
  • Unity Catalog
  • Unity Catalog governed access
  • Unity Catalog semantic definitions
  • Unity Catalog metadata
  • Unity Catalog ontology
  • Unity Catalog metric views
  • Azure DevOps
  • CI/CD pipelines
  • DevSecOps
  • Power BI
  • Tableau
  • Microsoft Fabric
  • Gravitee
  • MuleSoft
  • Kafka
  • Alation
  • Databricks Genie Code
  • Databricks Genie Agents
  • Agent Bricks
  • Databricks Lakebase
  • Lake Transactional/Analytical Processing (LTAP)

Desired Qualifications

  • Master’s degree in Computer Science, Information Technology, Engineering, Analytics, or a related discipline.
  • Experience with AI-ready data product design, feature preparation, data observability, and governed self-service analytics capabilities.
  • Experience building and governing agentic and conversational analytics solutions such as Databricks Genie Agents, Agent Bricks, and Microsoft Fabric data agents, including curation, benchmarking and evaluation, and access controls through Unity Catalog.
  • Familiarity with Databricks Lakebase and Lake Transactional/Analytical Processing (LTAP) patterns that serve operational and analytical workloads from a single governed copy of data.
  • Experience in consumer banking or credit unions.
  • Knowledge of financial services data governance, regulatory traceability, audit readiness, data privacy, information security, and operational risk management expectations.
  • Experience modernizing legacy BI environments, analytical data stores, and on-premises reporting platforms into Azure, Databricks, Microsoft Fabric, or similar cloud-native solutions across business, operational, risk, finance, or member domains.

Hours

  • Monday - Friday, 8:00AM - 4:30PM

Location

  • 820 Follin Lane, Vienna, VA 22180
  • Onsite in Vienna, VA

Compensation

  • USD 151,600 - 208,500 per year
  • Paid within the salary range based on experience, location, and market position

Benefits

  • 11 paid holidays per year
  • Full-time employees: minimum of 15 days annual leave and 10 days sick leave per year
  • Part-time employees: minimum of 7.5 days annual leave and 5 days sick leave per year
  • Interns: 11 paid holidays but not eligible for other types of leave

Additional Information

  • Navy Federal Credit Union currently does not provide sponsorship for this role. Applicants must be authorized to work in the United States without the need for current or future sponsorship.

Protect Yourself From Job Scams

  • Jobs are posted on the career site, jobs.navyfederal.org, and reputable job boards (for example, LinkedIn and Indeed).
  • Jobs are not posted on social media marketplaces, messaging apps, or unverified websites.
  • Navy Federal will never ask candidates for payment, bank details, or personal financial information during the hiring process.

Bank Secrecy Act

  • Remains cognizant of and adheres to Navy Federal policies and procedures and regulations pertaining to the Bank Secrecy Act.

Disclaimers

  • Navy Federal reserves the right to fill this role at a higher or lower grade level based on business need.
  • An assessment may be required to compete for this position.
  • Job postings are subject to close early or extend longer than the anticipated closing date at the hiring team’s discretion based on qualified applicant volume.

Similar Jobs