Senior Databricks Data Engineer

Georgia-Pacific is building trusted data capabilities for analytics, advanced analytics, and AI across the enterprise. As a Senior Databricks Data Engineer on the Data Platform team in Atlanta, GA (hybrid), you will help expand access to high-quality data across hundreds of systems and thousands of data assets, while strengthening governed, scalable Databricks-native solutions.

This role focuses on long-term platform value. You will design and enhance Databricks-native pipelines and governed data engineering patterns aligned with enterprise architecture, governance, security, and data-quality standards. You will also partner across Data Governance, delivery teams, and architects to identify common use cases and accelerate adoption of reusable capabilities.

What you’ll do

• Design, build, deploy, and support Databricks-native data engineering solutions including Delta Lake pipelines, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader ingestion pipelines, Unity Catalog resources, and CI/CD automation
• Develop reliable, governed data platforms and pipelines that improve accuracy, consistency, accessibility, and trustworthiness of enterprise data assets
• Create automated tools, reusable templates, and self-service patterns to speed up data development, ingestion, feature engineering, and consumption
• Operate and improve the platform through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization
• Integrate pipelines with enterprise governance capabilities, including metadata, lineage, classification, certification, ownership, and data-quality
• Develop and curate governed data assets for AI and advanced analytics, including semantic models, APIs, Genie Spaces, and AI agents
• Implement validation rules, monitoring, and remediation processes to improve fitness and reliability of critical data assets

What you bring

• Experience building and supporting production-grade Databricks, Delta Lake, and Apache Spark pipelines for both batch and streaming workloads
• Experience developing Databricks Jobs, including Lakeflow Declarative Pipelines and Structured Streaming, as well as multi-task workflows with scheduling, parameters, dependencies, retries, notifications, and operational monitoring
• Hands-on experience with infrastructure and environment-aware deployment automation using Terraform, Databricks Asset Bundles, or other Infrastructure as Code practices, plus Git and CI/CD workflows
• Experience implementing governance and access controls with Unity Catalog, including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions
• Ability to troubleshoot and optimize using Python and Spark diagnostic tools (job logs, Spark UI, query plans, partitioning, join optimization, and Adaptive Query Execution)
• Legal authorization to work permanently in the United States for any employer without requiring a visa transfer or visa sponsorship

Tools you’ll work with

Databricks, Delta Lake, Apache Spark, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Unity Catalog, CI/CD, Terraform, Databricks Asset Bundles, Git, Python, Structured Streaming, Adaptive Query Execution, Apache Hudi, Apache Iceberg, AWS, Microsoft Azure, Google Cloud, Amazon S3, Azure Data Lake Storage Gen2, OneLake, Google Cloud Storage, semantic models, Genie Spaces, AI agents, API

Benefits

• Medical, dental, and vision
• Flexible spending and health savings accounts
• Life insurance, AD&D, and disability
• Retirement
• Paid vacation/time off
• Educational assistance
• May also include infertility assistance, paid parental leave, and adoption assistance

Team and workplace

The Georgia-Pacific Data Platform team partners with Data Governance, Data Delivery, Data Product Owners, Solution Architects, and other platform and product teams to develop governed, reusable capabilities that improve data accessibility, reliability, lineage, and quality across analytics, advanced analytics, and AI use cases.

This position is located at GP HQ on Peachtree St. and is hybrid with an expectation of three (3) days in office per week.

Georgia-Pacific is a Military Ready and Second Chance employer. Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds.