Data Engineer II

Data Engineer II within Amazon Security focuses on building scalable data infrastructure and pipelines to support security investigations, threat modeling, and detection. This onsite role in Seattle, WA offers a salary range of USD 132,100 to 178,800 per year and requires at least four years of data engineering experience.

Responsibilities

• Shape and advance the team's data strategy and storage roadmap by collaborating closely with partner teams
• Lead the design of data governance, define data schemas, and develop tools to enable secure, compliant data sharing with customers
• Continuously improve data quality and operations through automation and end-to-end CI/CD data pipelines
• Promote best practices in data integrity, modeling, testing, analysis, validation, and documentation
• Build end-to-end data pipelines to ingest and transform data from diverse sources and systems
• Leverage AI and large language models to automate manual and repetitive data engineering tasks
• Evaluate and deploy big data technologies such as Redshift, Iceberg, Hive/EMR, Spark, SNS, and SQS to optimize handling of large datasets
• Analyze business processes, logical data models, and relational database implementations
• Write high-performance, optimized SQL queries

Requirements

• Minimum of four years of data engineering experience
• Experience with data modeling, data warehousing, and building ETL pipelines
• At least four years of experience analyzing and interpreting data using Redshift, Oracle, NoSQL, and related technologies
• Knowledge of professional software engineering practices across the full software development lifecycle, including coding standards, architectures, code reviews, version control, continuous deployments, testing, and operational excellence

Technologies

• Amazon EMR
• AWS Glue
• Amazon Athena
• Amazon Redshift
• Amazon S3
• Amazon SNS
• Amazon SQS
• Apache Airflow
• Iceberg
• Hive
• Spark
• SQL
• AI/LLM

Benefits

• Health insurance
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments
• Restricted stock units (RSUs)
• Employee Assistance Program (EAP)
• Mental health support
• Medical advice line
• Flexible spending accounts
• Adoption and surrogacy reimbursement coverage

Description

Amazon Security (AmSec) is seeking a Data Engineer II to join a team of skilled professionals focused on resource and application discovery within Amazon security. The product, Veritas, is a foundational service that provides data for security initiatives such as security reviews, threat modeling and detection, access control, and incident response. You will join an AmSec organization that spans over ten countries worldwide.