DeveloperJobs.io
← Back to all jobs

Job Description

Own production data products for autonomous vehicle and ADAS analytics, with Databricks-based pipelines that power governed, self-service datasets and agent-grounded investigations.

Responsibilities

  • Own production data products from ingestion through curated, analytics-ready datasets, including silver-to-gold pipelines used for feature-performance reporting, safety workflows, and self-service analysis.
  • Design and operate reliable Databricks pipelines for large raw vehicle telemetry, covering decoding, deduplication, ordering, completeness, and handling late or missing data.
  • Operate the self-service analytics platform from the engineering side, including workspace onboarding, compute, and governed access for partner teams analyzing approved ADAS data.
  • Raise production standards by defining data quality checks, monitoring, and alerting, and driving resolution before downstream scorecards and investigations become incorrect.
  • Deliver changes through a standard release path using GitHub, Databricks Asset Bundles, automated tests, and a clear dev-to-prod promotion with rollback.
  • Model datasets for reuse so scientists, analysts, and product partners can use them without re-discovering lineage, grain, or known data quality limits.
  • Apply enterprise data governance, including classification, access control, lineage, and privacy constraints for customer and vehicle data.
  • Lead cross-team collaboration with upstream data engineers, scientists, product managers, and safety stakeholders on contracts, feasibility, and production support.
  • Mentor senior and mid-level engineers through design review, code review, and incident response to keep the platform easier to operate than it was.
  • Build agent-dependent data capabilities: an entity spine joining vehicle, event, software, and road context; gold datasets for investigations; and expert procedures encoded for agent execution.
  • Keep agent answers trustworthy by grounding results in approved data, returning evidence, evaluating workflows against known cases, and enforcing access, privacy, and AI review requirements.
  • Connect production analytics to agent workflows using APIs and tool interfaces (including MCP) so investigations, fleet scans, and KPI explanations reuse the same datasets and align with the enterprise agent platform.

Requirements

  • 7+ years of experience building and operating production data platforms.
  • Bachelor’s degree in computer science, Software Engineering, or a closely related technical field, or equivalent demonstrable professional software engineering experience.
  • Deep hands-on experience with Python, SQL, and Spark on a lakehouse (e.g., Databricks).
  • Experience designing batch and incremental pipelines that remain correct with late, duplicate, and incomplete source data.
  • Experience running production operations including monitoring, alerting, incident response, and cost-aware performance tuning.
  • Experience releasing data code through CI/CD, including infrastructure-as-code or bundle-based deployment.
  • Experience putting agent or LLM workflows on production data, including multi-source retrieval, tool use, and grounding checks.
  • Sound judgment on data governance, access control, and sensitive vehicle or customer data.
  • Ability to set technical direction for a domain and bring engineers and non-engineers along.
  • Clear writing and speaking, including design docs and production runbooks.
  • Automotive, ADAS, or vehicle-telemetry experience.
  • Work across more than one cloud, especially Azure and GCP.
  • Experience building self-service analytics for analysts and scientists not on your team.
  • Familiarity with Unity Catalog, data contracts, and medallion (bronze, silver, gold) architecture.
  • Experience supporting safety or regulatory reporting where incorrect data can have real consequences.
  • Experience with agent frameworks, MCP or other tool-calling interfaces, and evaluating agent answers against known cases.
  • Familiarity with diagnostic or investigative workflows that require root-cause explanation.

Technologies

  • Databricks
  • Databricks Asset Bundles
  • GitHub
  • Python
  • SQL
  • Spark
  • CI/CD
  • Infrastructure-as-code
  • Unity Catalog
  • Medallion (bronze, silver, gold) architecture
  • APIs
  • MCP

Compensation

  • Base salary: USD 159,200 - 220,500 per yearly
  • Bonus potential: incentive pay program with payouts based on company performance, job level, and individual performance

Benefits

  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Employee assistance program
  • GM vehicle discounts

Work Location

  • Warren, MI (hybrid)
  • Expected to report to Warren Global Technical Center or Austin Technical Center three times per week at minimum (or other frequency dictated by the business if more than 3 days)

Accommodations

General Motors offers opportunities to all job seekers, including individuals with disabilities. For a reasonable accommodation related to your job search or application, email us or call 1-800-865-7580. Include a description of the requested accommodation, plus the job title and requisition number.

Similar Jobs