DeveloperJobs.io
← Back to all jobs

Job Description

The Sr Data Engineer - Data and AI role focuses on building cloud-native, reusable data products and AI-ready capabilities, using modern engineering practices for real-time processing, automation, observability, metadata management, and governed data access.

Location and Schedule

San Jose, CA (hybrid)

Schedule: Mon-Fri, 8am - 5 pm (Hybrid)

Additional listed locations: Hillsboro, OR | Marlborough or Chelmsford, MA | San Jose, CA

Compensation

Salary: USD 116,500 - 140,000 per year

Target compensation: $116,500 - $140,000 + Annual Bonus

Summary of the Role

This position develops AI-native infrastructure and delivers data-as-a-product capabilities, including real-time governed consumption to support analytics, data science, and AI-enabled solutions. The scope includes building pipelines and architectures for real-time availability, along with governance, discovery, lineage, and data contracts.

Core Responsibilities

  • Engineer AI-native infrastructure supporting real-time data processing
  • Build semantic layers and knowledge graphs to enable intelligent query routing and context-aware data access
  • Develop infrastructure for agentic AI systems with multi-agent orchestration
  • Implement GenAI-powered data quality, entity resolution, and metadata management
  • Maintain end-to-end accountability for data products, from ingestion through consumption
  • Deliver data products with defined SLAs, quality metrics, and customer satisfaction measures
  • Build self-service platforms that include embedded governance, lineage, and discovery
  • Establish data contracts and APIs for reliable, versioned data consumption
  • Build high-quality pipelines supporting analysts, data scientists, and AI agents
  • Implement CDC and event-driven architectures for real-time data availability
  • Deploy infrastructure-as-code using CDK and Terraform

Required Qualifications

  • 5+ years in data engineering with cloud-native architectures
  • 4+ years of SQL experience
  • Experience with data modeling, warehousing, and building ETL pipelines
  • Strong expertise with AWS, Databricks, and Snowflake
  • Proven experience with real-time streaming (Kafka, Kinesis, Flink, Spark)
  • Hands-on AI/ML infrastructure experience (SageMaker, Bedrock)
  • Proficiency in Python, SQL, and infrastructure-as-code

Preferred Qualifications

  • Knowledge graphs (Neptune, Neo4j) and semantic layers
  • GenAI applications and LLM integration patterns
  • Vector databases and feature stores
  • Data mesh and domain-oriented architecture

Technology Stack

  • AWS, Databricks, Snowflake
  • Kafka, Kinesis, Flink, Spark
  • SageMaker, Bedrock
  • Python, SQL
  • CDK, Terraform
  • CDC

Benefits

  • Traditional medical, dental, and vision coverage
  • Generous 401(k) match
  • Paid Time Off: accrue up to 15 days in the first year, plus 40 hours of sick time and 3 personal days that refresh annually
  • Paid federal holidays
  • Special employee pricing on lending products such as mortgage, auto, and personal loans (eligibility subject to standard account requirements and underwriting criteria)

Similar Jobs