Developer Jobs in Fort Mill, SC

1 job found

Include remote jobs

Today

Sr. Data Engineer

Sunbelt Rentals, Inc. Fort Mill, SC

Fort Mill, SC

Today

$130k - $179k/yr Full time Senior Big Data Bigdata

Apply Now

Job Description

Sunbelt Rentals, Inc. is seeking a Sr. Data Engineer to design, build, and support end-to-end IoT data pipelines into Databricks. This onsite role in Fort Mill, SC focuses on streaming ingestion, data quality, and Delta Lake operations, with responsibilities that include technical leadership, mentoring, and troubleshooting production pipeline failures.

Location

Fort Mill, SC (onsite)

Salary

USD 130,315 - 179,183 per yearly

Base Pay Range

$130,315.00 - 179,183.40

Responsibilities

Design, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks using the medallion architecture (Bronze/Silver/Gold).
Lead the development and optimization of streaming ingestion pipelines using Apache Kafka and Databricks Structured Streaming.
Define and enforce data engineering best practices, including pipeline design patterns, data quality frameworks, and schema governance.
Architect and manage Delta Lake tables, including partitioning strategies, Z-ordering, and vacuuming to improve performance and cost efficiency.
Collaborate with infrastructure and cloud teams to configure and manage Databricks clusters, Unity Catalog, and Delta Live Tables.
Mentor junior and mid-level data engineers through code reviews, pair programming, and technical guidance.
Partner with data scientists and analysts to help ensure processed data supports downstream analytical and ML requirements.
Troubleshoot production pipeline failures and drive root cause analysis and resolution.
Evaluate and introduce new tools and technologies to continuously improve the data platform.

Requirements

5+ years of data engineering experience, including at least 2 years working extensively with Databricks.
Strong proficiency in Python and SQL, including experience writing production-grade Spark code.
Hands-on experience building and managing Kafka-based streaming pipelines.
Deep familiarity with Delta Lake, Delta Live Tables, and the Databricks ecosystem (Unity Catalog, Workflows, MLflow).
Experience with IoT data patterns such as high-frequency telemetry ingestion, device state management, and time-series data.
Solid understanding of cloud infrastructure (Azure preferred) and infrastructure-as-code concepts.
Strong communication skills, including the ability to lead technical discussions and translate requirements into architecture.

Technology

Databricks
Apache Kafka
Databricks Structured Streaming
Delta Lake
Delta Live Tables
Unity Catalog
Workflows
MLflow
Python
SQL
Spark
Azure
Infrastructure-as-code
Bronze/Silver/Gold (medallion architecture)
Z-ordering
vacuuming
IoT
ML

Benefits

Health, Dental and Vision plans
401(k) Match
Volunteer time off
Short-term and long-term disability
Accident, Life and Travel insurance, as well as flexible spending
Tuition Reimbursement Options
Employee Assistance Program (EAP)
Length of Service Awards

Eligibility for Benefits

You will become eligible for benefits on the first of the month following 30 days from your start date.

Paid Time Off

12-25 vacation days depending on years of service
5 sick days
6 holidays
2 half day holidays
2 floating holidays
1 inclusion day
1 volunteer day

Preferred Qualifications

Experience with Geotab or similar fleet telematics platforms
Databricks Certified Data Engineer Associate or Professional certification
Familiarity with Azure Key Vault, Event Hubs, or Azure Data Factory
Experience with dbt for data transformation
Bachelor’s degree in computer science, Information Technology, Data Engineering, or equivalent experience

Physical Demands

Must be able to bend, squat, crouch and/or reach and lift up to 25 pounds or more, as required by the job.
Some Sunbelt jobs may require driving for long periods of time, loading and unloading heavy equipment, performing work in extreme weather conditions including rain, wind, or excessive temperatures and/or night and weekend work.
All duties must be performed according to Sunbelt’s safety policies and guidelines.
Reasonable accommodations may be made to comply with ADA/ADAAA.

View full job page →

Get Developer Jobs in Fort Mill, SC alerts

New Developer Jobs in Fort Mill, SC, daily.