Senior Data Engineer

Senior Data Engineer role supporting scalable industrial data pipelines, with a primary focus on Fivetran within GM’s Intelligent Manufacturing organization.

Responsibilities

• Assemble large, complex datasets aligned to functional and non-functional business requirements
• Identify, design, and deliver process improvements such as automation, data delivery optimization, and infrastructure redesign for scalability
• Lead data-driven solution delivery across multiple languages, tools, and technologies
• Build and configure end-to-end data pipelines using Fivetran to support efficient ETL (extract, transform, load)
• Set up integrations in Fivetran by connecting multiple source systems (APIs, SaaS platforms, databases) and managing schema mapping and transformations
• Monitor pipeline performance, troubleshoot issues, and implement changes to improve scalability and reliability
• Participate in architecture discussions, solution design, and strategic technology adoption
• Design and optimize highly scalable pipelines that include complex transformations and efficient code
• Design and build new source system integrations from varied formats (files, database extracts, APIs)
• Implement data delivery solutions that meet SLA requirements
• Collaborate with operations teams to address production issues related to the platform
• Apply best practices including Agile methodologies, design thinking, and continuous deployment
• Develop tooling and automation to make deployments and production monitoring more repeatable
• Partner with business and technology teams by providing leadership, best practices, and coaching
• Mentor peers and junior engineers; educate others on emerging industry trends and technologies

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience
• 7+ years of data engineering and development experience, including Python or Scala, SQL, and relational and non-relational data storage (ETL frameworks, big data processing, NoSQL)
• 3+ years experience with distributed data processing (Spark) and container orchestration (Kubernetes)
• Proficiency with data streaming in Kubernetes and Kafka
• Proven experience with Fivetran (pipeline setup, connectors, transformations)
• Cloud platform experience: Azure preferred; AWS or GCP also considered
• Solid understanding of CI/CD principles and tools
• Familiarity with big data technologies such as Hadoop, Hive, HBase, and object storage (ADLS/S3) and event queues
• Strong understanding of performance optimization techniques including partitioning, clustering, and caching
• Proficiency with SQL, key-value datastores, and document stores
• Familiarity with data architecture and modeling concepts that support efficient data consumption
• Advanced understanding of data normalization and denormalization
• Ability to translate enterprise requirements into effective data models when applicable
• Design, build, and optimize scalable batch and streaming pipelines using Databricks (Apache Spark, Delta Lake) to support Medalion Architecture
• Automate workflows and maintain clear documentation for data processes
• Contribute to the design and operational management of a cloud-native data platform on Azure, integrating services such as Azure Data Lake Storage, Event Hubs, Azure SQL, and AKS
• Monitor and troubleshoot data pipelines and platform workloads; optimize Spark jobs, cluster configurations, and SQL warehouses for performance
• Strong collaboration and communication skills across multiple teams and disciplines

Technologies

• Fivetran
• Python
• Scala
• SQL
• ETL frameworks
• Spark
• Kubernetes
• Kafka
• Azure
• AWS
• GCP
• CI/CD
• Hadoop
• Hive
• HBase
• Object Storage (ADLS/S3)
• Event Queues
• Databricks
• Apache Spark
• Delta Lake
• Medalion Architecture
• Azure Data Lake Storage
• Event Hubs
• Azure SQL
• AKS
• Agile methodologies
• Continuous deployment

Role context

• Focus on designing, building, and optimizing industrialized data assets and pipelines to support Business Intelligence and Advanced Analytics
• Work within Intelligent Manufacturing under Data Engineering Software to deliver scalable solutions that meet functional and non-functional requirements
• Contribute across databases, streaming technologies, CI/CD, and cloud platforms

Intelligent Manufacturing team scope

• Ideating, incubating, and delivering new plant data solutions
• Integrating with business and IT teams to develop real-time solutions leveraging plant floor data for decision-making, plant asset maintenance, safety, and operational performance, including Vehicle Build Data

Preferred qualifications

• Master’s degree in Computer Science, Software Engineering, or related field
• Knowledge of data governance, metadata management, or data quality and observability
• Familiarity with schema design and data contracts
• Experience handling various file formats (video, audio, image)
• Experience with Databricks, Snowflake, or similar platforms

Compensation

• Expected base compensation: $125,000 - $168,650 per year
• Actual base compensation within the identified range varies based on position-relevant factors
• Bonus potential: incentive pay program with payouts based on company performance, job level, and individual performance

Benefits

• Bonus Potential (incentive pay program)
• Medical
• Dental
• Vision
• Health Savings Account
• Flexible Spending Accounts
• Retirement savings plan
• Sickness and accident benefits
• Life insurance
• Paid vacation and holidays
• Tuition assistance programs
• Employee assistance program
• GM vehicle discounts

Location and work mode

• Austin, TX
• Hybrid

Immigration notice

• GM does not provide immigration-related sponsorship for this role
• Do not apply if you will need GM immigration sponsorship now or in the future
• This includes direct company sponsorship, GM as the immigration employer of record on a government form, and any work authorization requiring a written submission or other immigration support from the company (including H-1B, OPT, STEM OPT, CPT, TN, J-1, etc.)

Accommodations

• General Motors offers opportunities to all job seekers, including individuals with disabilities
• For reasonable accommodations to assist with the job search or application, email or call 1-800-865-7580