Senior AI Data Engineer
Job Description
General Motors’ GPSC Insights Engineering team is building scalable data and AI engineering solutions to support purchasing supply chain use cases. In this hybrid role based in Austin, TX, you will design and deliver trusted, secure, observable data and AI capabilities from early discovery through production deployment, enabling BI, advanced analytics, machine learning, and generative AI.
What you’ll deliver
- Own architecture, design, development, and production delivery of scalable data and AI engineering solutions across batch, streaming, and near-real-time workloads.
- Assemble, curate, and transform structured, semi-structured, and unstructured datasets for training, validation, evaluation, feature generation, embedding generation, retrieval, and inference.
- Design and implement robust source-system integrations from files, database extracts, APIs, event streams, external suppliers, and supply-chain systems.
- Build data pipelines and reusable data products with data contracts, schema management, lineage, metadata, quality checks, and observability.
- Develop and operationalize feature, embedding, and vector-retrieval pipelines for machine learning and generative AI applications.
- Build AI-enabled data and application workflows using appropriate AI development frameworks and services, applying retrieval, evaluation, and workflow orchestration patterns where appropriate.
- Establish repeatable MLOps/LLMOps patterns, including data and model versioning, experiment and evaluation workflows, CI/CD, deployment automation, monitoring, drift detection, and retraining triggers.
- Design for functional and non-functional requirements, including performance, scalability, reliability, resiliency, security, privacy, cost, and SLA/SLO attainment.
- Lead architecture discussions and technology evaluations, identifying tradeoffs and driving decisions for complex problems with limited precedent.
- Implement process improvements, automation, infrastructure redesign, and developer tooling to increase delivery speed and reduce operational risk.
- Partner with data scientists, ML engineers, product owners, business stakeholders, platform teams, cybersecurity, and governance partners to translate needs into actionable plans.
- Collaborate with operations teams to resolve production issues, perform root-cause analysis, and implement preventative improvements across data and AI platforms.
- Communicate risks, progress, and results to technical and non-technical audiences using data to demonstrate value.
- Mentor peers and junior engineers through guidance, design reviews, documentation, and knowledge sharing while raising engineering standards.
- Model GM behaviors such as speaking candidly about risks, protecting sensitive information, experimenting responsibly, moving with urgency, collaborating inclusively, and owning outcomes.
Required background
- Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, or a related field (or equivalent experience).
- 6+ years of experience in data engineering, software engineering, platform engineering, or a related discipline, including production delivery of scalable data solutions.
- Strong proficiency in Python and SQL; experience with Scala or another production language is a plus.
- Hands-on experience engineering data pipelines or platforms supporting machine learning, advanced analytics, or generative AI workloads, including data preparation, feature or embedding generation, evaluation, or inference data delivery.
- Experience with distributed data processing such as Apache Spark and container orchestration such as Kubernetes.
- Proficiency with streaming and event-driven solutions using Kafka (or comparable), including operation in Kubernetes-based environments.
- Cloud experience (Azure preferred; AWS or GCP considered).
- Solid understanding of CI/CD, infrastructure automation, testing, observability, incident response, and production support practices.
- Experience with data architecture and modeling, schema design, data contracts, relational and non-relational data stores, object storage, and APIs.
- Strong knowledge of performance optimization techniques such as partitioning, clustering, caching, indexing, and workload tuning.
- Working knowledge of data quality, governance, metadata, lineage, privacy, access controls, and responsible use of sensitive data in AI systems.
- Experience with AI development frameworks and services such as LangChain, CrewAI, Vertex AI, or comparable technologies.
- Working knowledge of RAG/vector search, FastAPI/React application patterns, LLM evaluation, and agent orchestration.
- Strong collaboration, communication, and influencing skills across multiple teams and disciplines, driving outcomes without direct authority.
Tech you’ll work with
Python, SQL, Scala, Apache Spark, Kubernetes, Kafka, Azure, AWS, GCP, LangChain, CrewAI, Vertex AI, RAG, FastAPI, React, MLOps, LLMOps, CI/CD deployment automation, vector-retrieval, vector search, LLM evaluation, agent orchestration, retrieval and workflow orchestration, drift detection, retraining triggers.
Pay and benefits
- Expected base compensation: $134,000 - $188,600 per year.
- An incentive pay program with payouts based on company performance, job level, and individual performance.
- Medical, Dental, Vision.
- Health Savings Account and Flexible Spending Accounts.
- Retirement savings plan.
- Sickness and accident benefits.
- Life insurance.
- Paid vacation and holidays.
- Tuition assistance programs.
- Employee assistance program.
- GM vehicle discounts and more.
Job details
- Location: Austin, TX (hybrid).
- Hybrid expectations: report to Austin, TX three times per week at minimum (or other frequency dictated by the business if more than 3 days).
- This job may be eligible for relocation benefits.
- GM does not provide immigration-related sponsorship for this role.
Preferred qualifications
- Master’s degree in Computer Science, Software Engineering, Data Science, or a related field.
- Experience with generative AI or LLM data pipelines, retrieval-augmented generation, prompt and evaluation datasets, vector databases, embeddings, or knowledge retrieval systems.
- Experience with feature stores, model registries, experiment tracking, model serving, data/model monitoring, or other MLOps/LLMOps capabilities.
- Experience with Databricks, Snowflake, Azure Machine Learning, MLflow, or similar platforms.
- Experience designing ingestion and processing frameworks for heterogeneous and multimodal data such as documents, video, audio, and images.
- Knowledge of data observability, model/data drift, bias or fairness considerations, explainability, and controls for trustworthy AI.
- Experience with Hadoop, Hive, HBase, ADLS/S3, event queues, key-value datastores, document stores, or comparable big-data technologies.
- Experience with automotive, manufacturing, global purchasing, supplier, or supply-chain data domains.
Accommodations
General Motors offers opportunities to all job seekers, including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email or call 1-800-865-7580.