Data Engineer
Job Description
CapTech Consulting (CapTech Sports) is hiring a Data Engineer to help build batch and streaming pipelines and data platforms for fan, consumer, brand, and media use cases. The work focuses on bringing together first-party, third-party, and brand/media data, applying entity and identity resolution, and enforcing privacy controls so teams can deliver trusted datasets, APIs, and analytics for personalization and measurement.
What you’ll do
- Build and operate batch and streaming pipelines that ingest first-party data from ticketing, streaming, app, CRM, loyalty, commerce, and email and marketing platforms.
- Ingest and integrate brand and media data, including paid and owned media performance, social, broadcast and streaming audience data, sponsorship and brand tracking, and platform or partner feeds.
- Bring in third-party data such as syndicated audience and consumer data, data clean rooms, and partner-shared datasets, including contract and usage-limit management.
- Implement entity and identity resolution so a single fan maps to one record across ticketing, streaming, app, retail, and media touchpoints, and connect first-party records to third-party audiences.
- Model and transform raw information into trusted, documented datasets for fans, consumers, brands, and media, including audience segments, engagement metrics, and campaign performance.
- Apply consent, privacy, and access controls at the start of the pipeline, with clear separation between first-party and third-party data rights.
- Deliver data products and APIs that support personalization, campaign activation, media and sponsorship measurement, marketing mix analysis, and AI use cases.
- Add data quality tests, monitoring, and lineage so issues surface before clients are impacted.
- Partner with architects, strategists, and analysts to translate requirements into designs, and contribute to estimates and technical proposals.
- Document work and communicate clearly with client engineers and business stakeholders.
- With experience, own pipeline and platform designs end to end, lead workstreams, review code, and mentor other engineers.
Skills and experience
- Python and SQL written for production use.
- Databricks, Snowflake, and Spark, including lakehouse and warehouse patterns.
- dbt, Airflow, or equivalent tooling.
- Cloud experience with AWS, Azure, or GCP, including storage, compute, and managed data services.
- Customer data platform patterns, entity and identity resolution, and master data management.
- Experience with ad platform and media measurement APIs, social and audience data feeds, and data clean rooms (such as Snowflake or Databricks clean rooms).
- REST and event-based integrations with ticketing, CRM, commerce, marketing, and third-party data providers.
- Consent management and privacy regimes including CCPA and GDPR, plus first-party versus third-party data governance.
- Git, CI/CD, infrastructure as code (such as Terraform), and automated testing.
- Experience with at least one modern data platform such as Databricks or Snowflake.
- Interest in sports, media, entertainment, or consumer data; prior experience with fan, customer, marketing, brand, or media data, including third-party sources, is a plus.
- Consulting or client-facing experience preferred.
- Preferred: cloud data certification (AWS, Azure, or GCP) and experience with entity or identity resolution, customer data platforms, or data clean rooms.
Technology areas
- Python, SQL, Databricks, Snowflake, Spark
- dbt, Airflow
- AWS, Azure, GCP
- CCPA, GDPR
- Git, CI/CD, Terraform (infrastructure as code)
Location
Charlotte, NC (hybrid)
Benefits
- CapFlex: Employee-first mentality supporting a remote and hybrid workforce with daily flexibility while serving clients.
- Learning & Development: certification and tuition support, digital on-demand learning, mentorship, and skill development paths.
- Modern Health: mental health and well-being platform offering 1:1 care, group support sessions, and self-serve resources.
- Carrot Fertility: inclusive fertility and family-forming coverage, including adoption, surrogacy, fertility treatments, pregnancy, and employer-sponsored funds.
- Fringe: company-paid stipend program for personalized lifestyle benefits.
- Employee Resource Groups: employee-led groups that support diversity and inclusion in day-to-day operations.
- Philanthropic Partnerships: opportunities for community support through partnerships and pro-bono projects.
- 401(k) Matching: generous matching with no vesting period.
CapTech supports customizable career progression and a comprehensive benefits package, including traditional offerings such as generous PTO, health coverage, disability insurance, and paid family leave, plus extended benefits. CapTech is an equal opportunity employer committed to equality, inclusion, and fairness.
Work authorization: CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.
#LI- JB1
#LI- Hybrid