Principal Engineer I - Senior Data Engineer

Software Resources, Inc. is seeking a Principal Engineer I, focused on senior data engineering, to help deliver critical capabilities for the Bank Regulatory Reporting Program. This hybrid role is based in Phoenix, AZ with 4 days on site and Fridays remote (also supporting Dallas, TX). You will own key components of the enterprise data platform, with a strong emphasis on expert PySpark development, Azure cloud data engineering, and Azure DevOps CI/CD.

What You’ll Do

• Design, build, and implement critical components of the enterprise data platform aligned to the strategic data and analytics needs of the Bank Regulatory Reporting Program.
• Deliver data engineering solutions across the full data lifecycle, including technical hygiene, leveraging Azure DevOps to support the Bank Regulatory Reporting and LFI strategy and roadmap.
• Develop ETL and data pipeline capabilities that cover how data is created, transformed, stored, archived, analyzed, and shared across the Bank and partner systems.
• Write dynamic, parameterized, and reusable PySpark code.
• Build shared frameworks, helper functions, and companion notebook structures.
• Perform performance tuning and optimization of Spark workloads.
• Implement Azure DevOps CI/CD pipelines for data solutions in line with Bank technical standards.
• Apply Test Driven Development methodology to data solutions you design, build, and implement.
• Lead implementation of outcomes, recommendations, and designs from Data Governance and Enterprise Architecture.
• Conduct data exploration and data profiling using tools such as SSAS.
• Participate in data architecture decision-making.
• Provide technical mentorship to team members and other data professionals.
• Collaborate with product owners and business stakeholders to understand business requirements and operational processes.
• Implement quality and compliance by design in all data solutions.
• Implement methods to include unstructured data and big data.

Required Qualifications

• Must be an expert in PySpark.
• 8+ years of data engineering experience with ETL concepts and processes, enterprise data warehouse capabilities, database principles, and related tools (strongly preferred: Azure Data Factory, Azure Synapse Analytics and/or Databricks).
• 5+ years designing, implementing, and supporting cloud data solutions (strongly preferred: Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps).
• Bachelor’s degree in engineering or related field.
• Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, or Spark SQL.
• Experience designing and building reusable, dynamic PySpark components, including companion notebook frameworks, shared helper functions and libraries, and parameter-driven ingestion and transformation patterns.
• Support and influence migration from Azure Synapse to Microsoft Fabric, including modernization of patterns and frameworks.
• Expert level experience in conceptual, logical, and physical data design.
• Azure certifications such as Azure Fundamentals, Azure Fabric Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer.
• Experience using design tools to create conceptual architecture diagrams and data flow diagrams such as Visio, Archimate, or Lucidchart.
• Excellent communication skills, verbal and written.

Preferred Experience

• Experience in Agile, SAFe, and/or Scrum.
• Experience integrating with data quality, data catalog, and data lineage tools.
• Additional cloud data certifications with any major cloud provider (Azure, AWS, GCP).
• Banking or financial services experience, or other experience in highly regulated industries.
• Regulatory Reporting experience, including Large Financial Institution requirements.

Technologies

PySpark, Azure DevOps, ETL, Azure Data Factory, Azure Synapse Analytics, Databricks, Azure Data Lake, Azure Data Services, Azure Logic Apps, Microsoft Fabric, SSAS, T-SQL, PL/SQL, Spark SQL, Visio, Archimate, Lucidchart, SAS, Tableau, PowerBI

Benefits

• Medical, dental, and vision coverage
• A 401(k) with company match
• Short-term disability
• Life insurance with AD&D