Data Engineer

The Data Engineer role on the AWS Infrastructure Services team focuses on building and maintaining ETL pipelines, designing data architectures, and delivering analytics solutions for internal customers. You will collaborate with BI engineers and software teams to translate data into actionable insights and standardize metrics.

Location

Seattle, WA (onsite)

Compensation

USD 101,300 to 160,000 per year

Responsibilities

• Develop and maintain automated ETL pipelines with monitoring, using Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, and KMS.
• Support and enhance reporting and analytics infrastructure for internal business customers.
• Design and enforce data security and access controls for enterprise scale data warehouse and data lake implementations, including encryption and logging.
• Create data objects for business analytics using data modeling techniques.
• Develop and optimize data warehouse and data lake schemas with best practices for DDL, partitioning, compression, and parallel processing.
• Maintain metadata, data catalog, and user documentation for internal stakeholders.
• Collaborate with business customers and software teams to gather requirements for data publishing and consumption through data warehouse, data lake, and analytics solutions.

Requirements

• At least 1 year of data engineering experience.
• Experience with data modeling, warehousing, and building ETL pipelines.
• Proficiency in one or more query languages (such as SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, or Scala).
• Experience with one or more scripting languages (such as Python or KornShell).

Technologies

• Python
• Spark
• SQL
• S3
• Glue
• Lambda
• SNS
• SQS
• KMS
• Hadoop
• Hive
• EMR
• Informatica
• ODI
• SSIS
• BODI
• Datastage

Benefits

• Sign on payments
• Restricted stock units (RSUs)
• Comprehensive health coverage including medical, dental, vision, prescription, Basic Life and AD&D with optional supplemental life plans, EAP, mental health support, Medical Advice Line, Flexible Spending Accounts, and Adoption and Surrogacy reimbursement
• 401(k) retirement plan with company matching
• Paid time off and parental leave

A Day in the Life

• Investigate innovative data transformation techniques and approaches
• Develop and deploy intelligent, automated reporting solutions
• Partner with cross functional teams to address complex analytical challenges
• Evaluate emerging technologies to advance the data strategy