Data Engineer, NAST-CX Tech
Job Description
Data Engineer on the Amazon Transportation Services (ATS) team focused on building scalable data infrastructure and ETL pipelines using AWS to support reporting, analytics, and ML initiatives.
Responsibilities
- Translate business requirements into data platform architecture for BI engineers, data scientists, and product managers.
- Collaborate with other technology and data engineering teams to extract, transform, and load data from diverse sources using AWS data technologies.
- Explore and adopt the latest AWS technologies to enable new capabilities and boost efficiency.
- Maintain and enhance existing data pipelines; establish scalable, efficient, automated data ingestion processes.
- Partner with BIE leaders, business owners, and developers to identify new data sources and deliver BI and Analytics solutions.
- Develop end-to-end automation of data pipelines so datasets are readily consumable by visualization tools, ML platforms, and daily/weekly/monthly reporting processes.
- Strengthen processes to maintain data integrity, availability, and auditability.
Requirements
- 5+ years of data engineering experience.
- Experience with data modeling, warehousing, and building ETL pipelines.
- Experience with SQL.
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS.
- Experience mentoring team members on best practices.
Technologies
- SQL
- Python
- Java
- Scala
- NodeJS
- Hadoop
- Hive
- Spark
- EMR
- AWS data technologies
Benefits
- Medical, Dental, and Vision Coverage
- Maternity and Parental Leave Options
- Paid Time Off (PTO)
- 401(k) Plan
A Day in the Life
- Develop new data engineering patterns that leverage modern cloud architectures and extend or migrate existing pipelines accordingly.
- Design and implement complex ETL pipelines in the big data platform and BI solutions to support growing data demand, delivering data as a service that informs day-to-day decisions.
About the Team
Amazon offers a comprehensive benefits package for regular, full-time employees, including medical, dental, and vision coverage, maternity and parental leave, Paid Time Off, and a 401(k) plan. Benefits can vary by location, hours, length of employment, and job status.