The Sr Data Engineer - Data and AI role focuses on building cloud-native, reusable data products and AI-ready capabilities, using modern engineering practices for real-time processing, automation, observability, metadata management, and governed data access.
Location and Schedule
San Jose, CA (hybrid)
Schedule: Mon-Fri, 8am - 5 pm (Hybrid)
Additional listed locations: Hillsboro, OR | Marlborough or Chelmsford, MA | San Jose, CA
Compensation
Salary: USD 116,500 - 140,000 per year
Target compensation: $116,500 - $140,000 + Annual Bonus
Summary of the Role
This position develops AI-native infrastructure and delivers data-as-a-product capabilities, including real-time governed consumption to support analytics, data science, and AI-enabled solutions. The scope includes building pipelines and architectures for real-time availability, along with governance, discovery, lineage, and data contracts.
Core Responsibilities
- Engineer AI-native infrastructure supporting real-time data processing
- Build semantic layers and knowledge graphs to enable intelligent query routing and context-aware data access
- Develop infrastructure for agentic AI systems with multi-agent orchestration
- Implement GenAI-powered data quality, entity resolution, and metadata management
- Maintain end-to-end accountability for data products, from ingestion through consumption
- Deliver data products with defined SLAs, quality metrics, and customer satisfaction measures
- Build self-service platforms that include embedded governance, lineage, and discovery
- Establish data contracts and APIs for reliable, versioned data consumption
- Build high-quality pipelines supporting analysts, data scientists, and AI agents
- Implement CDC and event-driven architectures for real-time data availability
- Deploy infrastructure-as-code using CDK and Terraform
Required Qualifications
- 5+ years in data engineering with cloud-native architectures
- 4+ years of SQL experience
- Experience with data modeling, warehousing, and building ETL pipelines
- Strong expertise with AWS, Databricks, and Snowflake
- Proven experience with real-time streaming (Kafka, Kinesis, Flink, Spark)
- Hands-on AI/ML infrastructure experience (SageMaker, Bedrock)
- Proficiency in Python, SQL, and infrastructure-as-code
Preferred Qualifications
- Knowledge graphs (Neptune, Neo4j) and semantic layers
- GenAI applications and LLM integration patterns
- Vector databases and feature stores
- Data mesh and domain-oriented architecture
Technology Stack
- AWS, Databricks, Snowflake
- Kafka, Kinesis, Flink, Spark
- SageMaker, Bedrock
- Python, SQL
- CDK, Terraform
- CDC
Benefits
- Traditional medical, dental, and vision coverage
- Generous 401(k) match
- Paid Time Off: accrue up to 15 days in the first year, plus 40 hours of sick time and 3 personal days that refresh annually
- Paid federal holidays
- Special employee pricing on lending products such as mortgage, auto, and personal loans (eligibility subject to standard account requirements and underwriting criteria)