AWS Cloud Data Engineer
Job Description
Guidehouse is seeking an AWS Cloud Data Engineer for an onsite role in San Antonio, TX. In this position you will design, build, and maintain data pipelines and processing solutions in AWS, collaborating with DBAs, data scientists, and business stakeholders to deliver scalable data solutions.
Guidehouse offers a comprehensive benefits package, including medical, prescription, dental and vision coverage; a 401(k) retirement plan; group life and disability coverage; health savings and flexible spending accounts; transit and parking benefits; tuition reimbursement and ongoing learning opportunities; an employee referral program; corporate sponsored events and community outreach; Care.com annual membership; an employee assistance program; and supplemental benefits via Corestream. A discretionary variable incentive bonus may be available. This role requires U.S. citizenship or a Green Card and the ability to obtain a Public Trust clearance.
Responsibilities
- Design, implement, and maintain robust data pipelines and processing solutions on AWS.
- Collaborate with the AWS Cloud DBA to deliver end-to-end data solutions migrating data from legacy systems to AWS for optimal performance and reliability.
- Apply hands-on experience with AWS data services and modern data architectures, partnering with database administrators, data scientists, and business stakeholders to deliver scalable solutions.
- Create scalable data pipelines using AWS Glue, Step Functions, Lambda, and Kinesis.
- Develop ETL and ELT processes to ingest, transform, and load data into data warehouses and data lakes.
- Architect and maintain data lakes on S3, implement data cataloging with AWS Glue Catalog, and optimize formats such as Parquet and Delta.
- Design data warehouse solutions with Redshift and integrate with RDS/Aurora databases managed by the DBA team.
- Develop real-time and batch data processing using Kinesis Data Streams, Kinesis Analytics, EMR, and AWS Batch.
- Create and maintain data models, schemas, and documentation.
- Work with the DBA team to optimize data access patterns and query performance across relational and analytical databases.
- Build automated data quality checks, monitoring, and alerting systems.
- Implement data governance policies and ensure compliance with data retention, privacy, and security requirements.
Requirements
- U.S. citizenship or permanent resident status is required.
- Must obtain and maintain a Federal or DoD Public Trust clearance prior to onboarding. Active Public Trust or suitability is preferred.
- Bachelor's degree in computer science, data engineering, or a related field; or four years of additional relevant experience in lieu of a degree.
- Minimum six years of data engineering experience, with at least three years in AWS cloud environments.
- Strong expertise with AWS data services including S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, and Lambda.
- Proficiency in Python, Scala, or Java for data processing and pipeline development.
- Experience with SQL and familiarity with relational databases (PostgreSQL, Oracle) and NoSQL systems (DynamoDB, DocumentDB).
- Understanding of data modeling for transactional and analytical workloads.
- Experience with Infrastructure as Code tools (Terraform, CloudFormation, CDK) and CI/CD pipelines for data workflows.
- Strong analytical and problem-solving skills with a focus on data quality and reliability.
- Proven ability to collaborate with DBAs, data scientists, and business stakeholders.
Technologies
- S3
- Glue
- DMS
- Athena
- Redshift
- EMR
- Kinesis
- Lambda
- Python
- Scala
- Java
- SQL
- PostgreSQL
- Oracle
- DynamoDB
- DocumentDB
- Terraform
- CloudFormation
- CDK
- Kinesis Data Streams
- Kinesis Analytics
- AWS Batch
- Parquet
- Delta
- AWS Glue Catalog
- RDS
- Aurora
- Git
- Docker
- Kubernetes
- ECS
- EKS
- QuickSight
- Tableau
- PowerBI
- JSON
- Avro
- ORC
- Apache Spark
- Apache Airflow
Travel
Up to 10 percent travel may be required.
Clearance
Ability to obtain a Public Trust clearance is required. Candidates must obtain approved adjudication prior to onboarding. Active Public Trust or suitability is preferred.