Big Data Engineer II
Amazon Emr
Amazon Web Services
Artificial Intelligence
AWS
Big Data
Cloud
Cloud Platforms
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Engineer
Engineering
ETL
Firehose
Reporting and Analytics
SQL
Job Description
This on-site role, Big Data Engineer II, is based in Dallas, TX, and centers on architecting data solutions for AWS revenue data products. The position emphasizes building scalable data pipelines and AI driven automation, mentoring engineers, and translating business requirements into practical technical solutions.
Responsibilities
- Modernize the Revenue technology stack to support AWS growth while preserving security policies, architectural standards, and operational best practices
- Design and implement end-to-end data pipelines that convert raw data from diverse upstream sources into actionable insights for quota management, forecasting, and compensation decisions
- Develop frameworks, tools, and AI powered solutions that automate manual processes, reduce operational overhead, and speed up time-to-insight for Revenue customers
- Create and maintain dimensional data models and data structures that enable self-service analytics and support evolving reporting needs across Finance, Sales Operations, and Analytics teams
- Mentor a team of Data Engineers to deliver cross-functional solutions, foster technical growth, and uphold engineering excellence standards
- Architect and optimize Revenue data infrastructure, ensuring enterprise-grade security, cost efficiency, and scalability while processing billions of daily transactions across 20+ data sources
- Collaborate with product managers, stakeholders, and customers to translate business requirements into technically actionable solutions
Requirements
- 3+ years of data engineering experience
- 3+ years of developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes
- 3+ years of developing and operating large-scale data structures for business intelligence analytics using SQL
- Bachelor's degree or above in Computer Science, Computer Engineering, Data Science, Electrical Engineering, or related fields, or 3+ years of professional software development experience
- Experience in at least one object-oriented programming language (e.g., JavaScript, Python, C#)
Technologies
- JavaScript
- Python
- C#
- SQL
- Redshift
- S3
- AWS Glue
- EMR
- Kinesis
- FireHose
- Lambda
- IAM
- Hadoop
- Hive
- Spark
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Parental leave
- Sign-on payments
- Restricted stock units (RSUs)