Sr Data Engineer II
Backend Developer
Application Security
Artificial Intelligence
Automation
Big Data
Cassandra
Cloud
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Database
Databases
DevOps
Devops Tools
DevSecOps
Elasticsearch
Engineering
Engineering Software
ETL
Informatica
Information Technology (IT)
Kubernetes
Llm Operations
Platform Engineering
Security Automation
Stream Processing
Streaming Data
Job Description
American Express is seeking a Senior Data Engineer to support AI-ready data engineering across intelligent payment platforms. The role focuses on designing and evolving scalable data capabilities that turn large-scale payment data into real-time intelligence, analytics, machine learning, and Generative AI use cases.
Role Focus
You will contribute to the end-to-end engineering of highly scalable data platforms used for critical payment capabilities. Work will sit at the intersection of data engineering, distributed systems, cloud-native technologies, and AI, supporting secure and reliable products and experiences.
Responsibilities
- Help design, build, and evolve highly scalable, AI-ready data platforms that power critical payment capabilities and enable real-time intelligence, advanced analytics, machine learning, and Generative AI use cases.
- Work across data engineering and distributed systems to transform large-scale payment data into intelligent, secure, and reliable products and experiences.
Requirements
- Experience designing, implementing, and operating large-scale distributed data platforms and systems.
- Strong experience with NoSQL technologies such as Cassandra, Elasticsearch, Couchbase, or Redis.
- Experience with large-scale distributed data processing technologies such as Apache Spark.
- Strong programming experience with Python, Java, Scala, or similar languages.
- Experience designing data pipelines, data models, APIs, and event-driven architectures.
- Strong understanding of distributed system concepts, including scalability, reliability, resiliency, security, and performance.
- Demonstrated ability to solve complex engineering problems and deliver production-grade solutions.
Technologies
- Cassandra, Elasticsearch, Couchbase, Redis
- Apache Spark
- Python, Java, Scala
- Apache Kafka
- Docker, Kubernetes, OpenShift
- Generative AI, LLMs, RAG
- Embeddings, vector databases/search
- AI agent architectures
- MLOps/LLMOps
- Microservices
Preferred Qualifications
- Experience building AI/ML-ready data platforms supporting machine learning, Generative AI, or intelligent application use cases.
- Familiarity with Generative AI, LLMs, RAG, embeddings, vector databases/search, and AI agent architectures.
- Experience integrating AI/ML models and services into production environments.
- Familiarity with MLOps/LLMOps, including deployment, evaluation, monitoring, observability, governance, and lifecycle management.
- Experience with distributed messaging and streaming platforms such as Apache Kafka.
- Experience with real-time distributed processing using technologies such as Spark, Kafka, Cassandra, and Elasticsearch.
- Experience developing microservices and cloud-native applications.
- Experience with Docker, Kubernetes, OpenShift, or similar container platforms.
- Experience with CI/CD, DevOps, infrastructure automation, and production observability.
- Understanding of Responsible AI, data privacy, security, governance, and model risk considerations.
- Experience architecting large-scale systems with an emphasis on availability, scalability, performance, resiliency, and cost efficiency.
- Ability to stay current with emerging AI and data engineering technologies and identify opportunities to apply them to real-world business problems.
- Strong communication, collaboration, and technical leadership skills, including the ability to mentor engineers and influence technical direction.
Benefits
- Competitive base salaries
- Bonus incentives
- 6% Company Match on retirement savings plan
- Free financial coaching and financial well-being support
- Comprehensive medical, dental, vision, life insurance, and disability benefits
- Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
- 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
- Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
- Free and confidential counseling support through the Healthy Minds program
- Career development and training opportunities
VISA Sponsorship
Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for certain positions.
Location & Compensation
Phoenix, AZ (hybrid). Salary range: USD 123,000 - 215,250 per yearly.
Similar Jobs
