Data Engineer - ETL
Job Description
Build and modernize ETL/ELT pipelines that transition on-prem SQL Server workloads to governed ODS and DWH services backed by a corporate-managed Databricks platform.
Responsibilities
- Assess, document, and rationalize existing SQL Server ETL pipelines, databases, and data silos.
- Refactor redundant or fragile SQL processes into standardized, maintainable ETL/ELT pipelines.
- Design and develop ingestion, transformation, and reconciliation pipelines for governed ODS and DWH environments.
- Implement logging, monitoring, error handling, auditability, lineage, and repeatable deployment practices.
- Develop Databricks notebooks and pipelines using SQL, and as appropriate Python or PySpark.
- Partner with corporate platform teams to align solutions with enterprise architecture, security, and engineering standards.
- Support source-to-target mapping, testing, production support, and migration validation.
- Perform other duties and/or projects as assigned.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Analytics, Data Engineering, or a related field.
- Strong SQL and Microsoft SQL Server development experience.
- Hands-on experience designing, building, and supporting ETL/ELT pipelines.
- Knowledge of relational databases, data warehousing, and incremental data processing.
- Experience troubleshooting complex data issues and reconciling source-to-target results.
- Experience with source control and disciplined software development practices.
- Strong analytical, documentation, and communication skills.
Location Requirement
- Candidate must sit in the Jacksonville, FL office.
Preferred Qualifications
- Databricks, Python, PySpark, or Apache Spark experience.
- Experience migrating legacy ETL workloads to a cloud data platform.
- Dimensional modeling and data quality automation experience.
- Experience in a SOX-controlled or regulated environment.
- Property and casualty insurance industry knowledge (policy, billing, claims, or underwriting data).
- Experience working with Guidewire applications or data, including Guidewire ClaimCenter (GWCC) and Guidewire BillingCenter (GWBilling).
- Experience engineering feature-ready datasets or pipelines for predictive analytics and machine learning.
- Familiarity with model lifecycle concepts, including experimentation, deployment, monitoring, and reproducibility.
- Exposure to generative AI, large language models (LLMs), retrieval-augmented generation (RAG), vector search, or AI-assisted data engineering.
Technologies
- SQL
- Microsoft SQL Server
- Databricks
- Python
- PySpark
- Apache Spark
- ETL/ELT
- ODS
- DWH
- Source control
Additional Information
- Sponsorship not Offered for this Role