Data Engineer

Aptean is hiring a hands-on Data Engineer to build and operate scalable ingestion and transformation pipelines on Microsoft Fabric for enterprise reporting, analytics, and AI.

Responsibilities

• Build and maintain ingestion pipelines in Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks) and Azure Data Factory
• Create Python and PySpark notebooks to cleanse, transform, and enrich data across medallion layers
• Implement Delta Lake practices, including partitioning, schema evolution, and incremental loads
• Apply data quality routines: null handling, duplicate detection, schema validation, and SCD logic support
• Develop reusable pipeline tooling using metadata-driven and parameterized frameworks
• Debug pipeline failures, performance issues, and data discrepancies; lead root-cause analysis
• Participate in code reviews, testing, and CI/CD using Git-based workflows
• Support gold-layer datasets and semantic models used for Power BI consumption
• Monitor pipeline health and resolve operational issues within defined SLAs; support on-call rotations as needed
• Maintain technical artifacts including data dictionaries, mappings, and runbooks
• Collaborate cross-functionally to deliver reliable data engineering solutions

Requirements

• 3–5 years experience building data pipelines in production or near-production environments
• Hands-on experience with Python and PySpark
• Experience with Azure Data Factory or comparable orchestration tools
• Familiarity with Microsoft Fabric (or strong experience with Azure Synapse / Databricks with willingness to learn Fabric)
• Solid understanding of SQL, data modeling, and performance optimization
• Knowledge of medallion architecture and Delta Lake concepts
• Experience implementing data quality checks and basic SCD handling
• Familiarity with Git branching and CI/CD (Azure DevOps or GitHub Actions)
• Power BI exposure and semantic data model experience is a plus
• Knowledge of data governance concepts such as schema versioning and access controls preferred
• Strong problem-solving skills, attention to detail, and ownership mindset
• Effective communication and collaboration with technical and business teams

Technologies

• Microsoft Fabric
• Azure
• Azure Data Factory
• Python
• PySpark
• Delta Lake
• Power BI
• Git
• Azure DevOps
• GitHub Actions
• SQL
• Microsoft Fabric Pipelines
• Dataflows Gen2
• Notebooks
• Azure Synapse
• Databricks

Benefits

• Work with modern data technologies including Microsoft Fabric and Azure
• Collaborate with experienced data engineering professionals
• Exposure to enterprise-level data, analytics, and AI initiatives
• Growth through hands-on learning and ownership of impactful projects

Location: Alpharetta, GA (onsite). Experience: 3+ years. Work authorization: Candidates must be authorized to work in the United States without current sponsorship; Aptean is unable to sponsor work authorization at this time.