Staff Data Engineer
Apache Airflow
Application Security
Automation
Big Data
Bigdata
Cloud Infrastructure
Cloud Native
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Science
Data Warehouse
Database
Databases
DevOps
Devops Tools
DevSecOps
Distributed Systems
Engineering
Engineering Software
ETL
Facilities Management
Flink
Informatica
Information Technology (IT)
Integration
Kubernetes
Management
Platform Engineering
Project Management
Security Automation
Software Security
Spark
SQL
Stream Processing
Streaming Data
Workflow Orchestration
Job Description
Visa Technology and Operations LLC is seeking a Staff Data Engineer within its Value Added Services – Digital Marketing & Engagement organization. In this hybrid role in Austin, TX, you will design and evolve Visa’s data token platform while leading large-scale data pipeline and data platform initiatives in an agile environment.
You will help build distributed, production-grade systems for batch and real-time processing, translating partner and analytics needs into scalable data solutions. This position also emphasizes data governance, automation and observability across the data lifecycle, and technical leadership through mentoring and best-practice adoption.
Responsibilities
- Design, build, and optimize large-scale data pipelines for batch and real-time processing
- Develop and maintain distributed data systems that are highly available, scalable, and resilient
- Lead initiatives to process, transform, and manage structured and unstructured data across platforms
- Drive development of data platforms and data products for analytics, reporting, and machine learning use cases
- Partner with product, analytics, and business teams to translate requirements into scalable data solutions
- Architect solutions using big data technologies including Hadoop, Spark, and distributed data processing frameworks
- Build and optimize ETL/ELT pipelines, ensuring high data quality, reliability, and performance
- Implement automation, monitoring, and observability across the data lifecycle
- Lead proof-of-concept efforts to evaluate and adopt new data engineering technologies
- Influence and drive best practices in data engineering, including data modeling, pipeline design, and governance
- Mentor engineers and support a culture of continuous learning and accountability
- Collaborate with stakeholders to understand data requirements and deliver impactful solutions
- Architect and implement secure, robust, and scalable data platforms
- Drive innovation through experimentation, prototyping, and rapid iteration
- Ensure strong data governance, quality, and operational excellence
- Engage cross-functionally to align on technical and business outcomes
Requirements
- 5 or more years of relevant work experience with a Bachelors Degree; or at least 2 years of work experience with an Advanced degree (e.g., Masters, MBA, JD, MD); or 0 years of work experience with a PhD
- 6 or more years of work experience with a Bachelors Degree; or 4 or more years of relevant experience with an Advanced Degree (e.g., Masters, MBA, JD, MD); or up to 3 years of relevant experience with a PhD
- Demonstrated leadership delivering high-quality, large-scale, enterprise-class applications
- Solid big data engineering experience with knowledge of Hadoop, Apache Spark, Python, and SQL
- Experience with Docker and Kubernetes for containerization
- Proficiency creating and managing large-scale data pipelines and machine learning models
- Experience developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models
- Experience with Kafka, Redis, Flink, TensorFlow, Triton, and AWS services
- Skilled in Unix/Shell or Python scripting and scheduling tools such as Airflow and Control-M
- Familiarity with Agile development, TDD, CI/CD, and various databases
- Proven track record of building reliable, scalable, and operable applications
- Ability to manage component security analysis and collaborate with security teams
- Strong work ethic and focus on immediate goals, with proven experience as a technical leader
- Passion for mentoring and helping junior engineers grow professionally
- Excellent communication and interpersonal skills, with a strong team approach
Technologies
- Hadoop, Spark, ETL/ELT, distributed data processing framework
- Python, SQL
- Docker, Kubernetes
- Kafka, Redis, Flink
- TensorFlow, Triton
- AWS services
- Unix/Shell
- Airflow, Control-M
- Agile, TDD, CI/CD, databases
Benefits
- Medical, Dental, Vision
- 401(k)
- FSA/HSA
- Life Insurance
- Paid Time Off
- Wellness Program
- Potential sales incentive payments (if applicable)
- Bonus and equity
Location, Travel, and Work Schedule
- Location: Austin, TX (hybrid)
- Travel requirements: 5-10% of the time
- Office expectation: Visa requires at least 3 days in office; exact days will be confirmed by your Hiring Manager
- Work hours: Varies upon the needs of the department
Compensation
- Salary range: USD 137,200 - 219,700 per year
- Estimated range for US applicants: $137,200.00 to $219,700.00 USD per year
- Potential for sales incentive payments (if applicable), and eligibility for bonus and equity
- Salary may vary based on job-related factors including knowledge, skills, experience, and location
Work Environment
- Office setting
- Requires sitting and standing at a desk, in-person and telephone communication, and frequent use of standard office equipment such as telephones and computers