Data Engineer

Hybrid Data Engineer role in Philadelphia supporting data integration, data warehousing, ETL/ELT, and pipeline modernization.

Responsibilities

• Support the Firm’s SQL Server/SSIS-based ETL processes and cloud data platforms
• Develop, support, and modernize data integration and warehousing solutions using:
  • SQL Server, SSIS
  • Azure SQL, Azure Data Factory (ADF)
  • Microsoft Fabric and Fabric Data Factory (Data Flows)
• Assist with data warehouse and OLTP environments, including:
  • Data ingestion and transformation
  • Dimensional modeling
  • Data quality
  • Performance optimization
  • Integration activities
• Partner with Business Analysts, Data Architects, Developers, DBAs, and other IT teams to define and implement data
• Analyze data sources, interfaces, and dependencies; produce technical documentation such as:
  • Data flow diagrams
  • ERDs
  • Source-to-target mappings
  • Data lineage
• Design and support data integration solutions with consideration for:
  • Transaction volumes
  • Data availability and timeliness
  • Regulatory and retention requirements
  • Security and privacy
  • System dependencies
• Troubleshoot, diagnose, and resolve production data, database, and integration issues; coordinate with other IT teams as needed
• Develop and maintain SSIS packages, Azure Data Factory and Fabric Data Factory pipelines, and SQL Server objects

Requirements

• Bachelor’s degree from a four-year college or university
• Minimum 5 years of experience, including 3 years of SQL development
• Hands-on experience with Azure Data Factory (ADF) and Fabric Data Factory (FDF), including:
  • Pipeline development
  • Data integration and transformation
  • Orchestration
  • Integration with on-premises and cloud data sources
  • Lakehouse integration for FDF
• Working knowledge of Microsoft Fabric and modern cloud data warehouse architectures, including:
  • Fabric Data Warehouse
  • Lakehouse
  • OneLake
  • Analytics services
• Experience designing and implementing cloud-based ETL/ELT solutions using Microsoft Azure and Fabric
• Experience with Online Transaction Processing (OLTP) using Microsoft SQL Server
• Understanding of data warehouse design, including:
  • Data marts
  • Multidimensional database design
  • Fact tables
  • Star and Snow-flake schema types
  • Schemas
• Hands-on experience in SQL and stored procedure tuning, including database reorganization
• Strong verbal and written communication skills
• Self-starter and strategic thinker with problem-solving skills
• Computer skills including MS Office (MS Word, PowerPoint, Excel)

Technologies

• SQL Server, SSIS
• Azure, Azure SQL
• Microsoft Fabric
• Azure Data Factory (ADF)
• Fabric Data Factory / Data Flows (FDF)
• OLTP
• SQL, stored procedures
• SSIS packages
• Fabric Data Factory pipelines
• Fabric Data Warehouse, Lakehouse, OneLake
• Analytics services
• Multidimensional database design, Fact Tables, Star and Snow-flake, Schemas
• MS Office (MS Word, PowerPoint, Excel)

Certifications

• Recommended but not required:
  • Microsoft Certified Solutions Expert (MCSE): Data Management and Analytics
  • DP-700 – Fabric Data Engineer Associate
  • DP-600 – Fabric Analytics Engineer Associate

California Notice

Pursuant to the California Consumer Privacy Act, the following link contains the Firm’s California Consumer Privacy Act Privacy Notice for Candidates which explains the categories of personal information that we collect and the purposes for which we use such personal information. CCPA Privacy Notice for Candidates

Location: Philadelphia, PA (hybrid: in-office/remote) | Reports to: Data Warehouse Manager