Sr. Data Engineer (GCP/Vertex AI)
Job Description
As a Senior Data Engineer focused on GCP and Vertex AI, you will support H-E-B Digital Technology in building data and machine learning infrastructure for personalized search and product recommendations. This onsite role in San Antonio, TX involves cross-functional delivery of scalable, production-grade solutions using modern cloud and ML practices.
Responsibilities
- Build and maintain data and machine learning infrastructure supporting H-E-B’s Customer Experience Engineering organization.
- Own data orchestration, feature engineering, and model serving used to deliver personalized search and product recommendations to millions of H-E-B customers each week.
- Collaborate with Data Science, Machine Learning Engineering, Search Engineering, Product Management, and Customer Experience teams to translate business objectives into scalable, production-grade technical solutions.
- Provide hands-on support for personalized online product search, search ranking algorithms, semantic search, and large-scale product recommendation or customer personalization platforms.
- Leverage Google Cloud Platform, including Vertex AI, Feature Stores, and MLOps practices to operationalize machine learning and personalization models with Data Scientists and ML Engineers.
- Use Python, PySpark, and SQL to develop and operate large-scale data pipelines and support data manipulation.
- Apply expertise in data lake and Lakehouse architectures, data modeling, ETL/ELT pipelines, and real-time event-driven streaming using Kafka.
- Design and build scalable APIs and low-latency data services that support machine learning applications in production.
- Partner across Product, Data Science, and Engineering teams to deliver resilient technical solutions aligned to business goals.
Requirements
- Advanced knowledge of Lean Startup and Agile methods.
- Knowledge of business intelligence, analytics, reporting, and application integration.
- Knowledge of data architectures including data warehouse, data lake, and data mesh, and when to apply each.
- Strong understanding of data architecture and data modeling best practices for data and analytic platforms.
- Strong working knowledge of coding standards and design principles or patterns.
- Strong prioritization skills.
- Strong verbal and written communication skills, including data presentation.
- Ability to deliver on ambiguous projects with incomplete information.
- Ability and willingness to learn new technologies as they emerge.
- Ability to work calmly under pressure.
- Ability to work a flexible schedule as needed.
- Ability to collaborate across multiple work locations.
- Ability to work in a team environment and take feedback from peers and mentors.
- A related degree or comparable formal training, certification, or work experience.
- 5+ years of experience related to data engineering.
- Experience with Lean Startup or Agile development methodologies.
- Experience in large-scale infrastructure, large data sets, and mission-critical SLAs.
Technologies
- Google Cloud Platform (GCP)
- Vertex AI
- Feature Stores
- MLOps
- Python
- PySpark
- SQL
- Kafka
Location
- San Antonio, TX (On-site)
Nice-to-Have Qualifications
- Background in retail, e-commerce, or high-volume digital commerce environments.
- Familiarity with vector search, search indexing and relevance tuning, and recommendation methodologies such as collaborative filtering, content-based filtering, embeddings, and feature engineering.
- Experience processing high-volume clickstream and behavioral event data, including work with Customer 360 platforms and customer identity resolution.
- Knowledge of A/B testing, experimentation frameworks, and metrics used to evaluate the business impact of search and personalization models.
Background
- A related degree or comparable formal training, certification, or work experience.
- 5+ years of experience related to data engineering.
- Experience in Lean Startup or Agile development methodologies.
- Experience working in large-scale infrastructure, large data sets, and mission-critical SLAs.