AWS Cloud Data Engineer

Guidehouse Digital, LLC is seeking an experienced AWS Cloud Data Engineer to design, build, and manage scalable data pipelines and processing solutions within the AWS ecosystem. This on-site role in San Antonio, Texas, engages with DBAs, data scientists, and business stakeholders to migrate data, optimize performance, and uphold data quality and governance.

Responsibilities

• Design, build, and maintain robust data pipelines and processing solutions in the AWS cloud.
• Collaborate with the AWS Cloud DBA to create end-to-end data solutions that migrate data from legacy applications to the AWS platform, ensuring performance and reliability.
• Apply hands-on experience with AWS data services and modern data architectures, working with DBAs, data scientists, and business stakeholders to deliver scalable data solutions.
• Design and implement scalable pipelines using AWS Glue, Step Functions, Lambda, and Kinesis; develop ETL and ELT processes to ingest, transform, and load data into data warehouses and data lakes.
• Architect and maintain data lakes on S3; implement data cataloging with AWS Glue Catalog; optimize storage formats such as Parquet and Delta Lake; design data warehouses with Redshift and integrate with RDS/Aurora databases managed by the DBA team.
• Develop real-time and batch data processing solutions using Kinesis Data Streams, Kinesis Analytics, EMR, and AWS Batch.
• Create and maintain data models, schemas, and documentation; collaborate with the DBA team to optimize data access patterns and query performance across relational and analytical databases.
• Implement automated data quality checks, monitoring, and alerting; establish data governance policies and ensure compliance with data retention, privacy, and security requirements.

Requirements

• US Citizenship or Green Card is required.
• Must be able to obtain and maintain a Federal or DoD PUBLIC TRUST; candidates must obtain approved adjudication prior to onboarding. Candidates with an active PUBLIC TRUST or suitability are preferred.
• Bachelor’s degree in computer science, data engineering, or a related field; additional four years of experience may be substituted for the degree.
• Minimum six (6) years of experience in data engineering, with at least three (3) years focused on AWS cloud environments.
• Strong expertise in AWS data services including S3, Glue, DMS, Athena, Redshift, EMR, Kinesis, and Lambda.
• Proficiency in programming languages such as Python, Scala, or Java for data processing and pipeline development.
• Experience with SQL and working knowledge of relational databases (PostgreSQL, Oracle) and NoSQL systems (DynamoDB, DocumentDB).
• Understanding of data modeling concepts for transactional and analytical workloads.
• Experience with Infrastructure as Code tools (Terraform, CloudFormation, CDK) and CI/CD pipelines for data engineering workflows.
• Strong analytical and problem-solving abilities with attention to data quality and system reliability.
• Proven ability to work collaboratively with database administrators, data scientists, and business stakeholders.

Technologies

• AWS Glue
• Step Functions
• Lambda
• Kinesis
• S3
• Glue Catalog
• Redshift
• RDS
• Aurora
• Kinesis Data Streams
• Kinesis Analytics
• EMR
• AWS Batch
• Python
• Scala
• Java
• SQL
• PostgreSQL
• Oracle
• DynamoDB
• DocumentDB
• Terraform
• CloudFormation
• CDK
• Git
• Docker
• Kubernetes
• ECS
• EKS
• QuickSight
• Tableau
• PowerBI
• JSON
• Avro
• Parquet
• ORC
• Delta Lake
• Apache Spark
• Apache Airflow

Benefits

• Medical, Rx, Dental and Vision Insurance
• Personal and Family Sick Time and Company Paid Holidays
• Parental Leave
• 401(k) Retirement Plan
• Group Term Life and Travel Assistance
• Voluntary Life and AD&D Insurance
• Health Savings Account, Flexible Spending Accounts for Health Care and Dependent Care
• Transit and Parking Commuter Benefits
• Short-Term and Long-Term Disability
• Tuition Reimbursement, Personal Development, Certifications and Learning Opportunities
• Employee Referral Program
• Corporate Sponsored Events and Community Outreach
• Care.com annual membership
• Employee Assistance Program
• Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)
• Position may be eligible for a discretionary variable incentive bonus