Data Engineer
3d Design Tools
Amazon Web Services
AWS
Aws Data Lake
Aws Data Lakehouse
Aws Data Warehouse
Aws Glue
Big Data
Cloud
Cloud Computing
Cloud Data Warehouse
Cloud Operations
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Engineer
ETL
Informatica
Information Technology (IT)
IT Services
MongoDB
Programming Language
Programming Languages
Rds
Reporting and Analytics
SQL
Job Description
VISUAL SOFT, INC is seeking a Data Engineer to support secure, mission-critical data environments within a classified cloud infrastructure. This role is fully onsite in Huntsville, Alabama and requires an active Top Secret clearance as well as U.S. citizenship.
In this position (Mid-Level or Senior), you will build and maintain ETL and data integration capabilities across on-premises and AWS environments, including real-time and batch processing, automation, and data governance activities.
What you will do
- Design, develop, and maintain ETL workflows to extract, transform, and load large-scale structured and unstructured datasets.
- Build data migration solutions between legacy and modern systems using SQL, Java, and cloud-native tools.
- Create data integration frameworks using AWS services including Glue, Lambda, S3, RDS, Redshift, and Kinesis.
- Develop automation scripts with Python, Shell, or Bash for deployment, data validation, and maintenance.
- Maintain and enhance data pipelines for real-time and batch data processing.
- Support data quality, metadata management, and data governance efforts.
- Participate in Agile/Scrum sprints, contributing to design, code reviews, testing, and documentation.
- Troubleshoot and resolve data-related issues across on-premises and AWS environments.
Required education
- Bachelor’s Degree (B.S.) in Computer Science, Information Systems, Engineering, or a related field.
Required experience
- 5+ years (Mid-Level) or 8+ years (Senior-Level) in data engineering or database development.
Skills and qualifications
- Strong hands-on experience with ETL tools, such as Informatica, Talend, Pentaho, AWS Glue, or custom Java ETL frameworks.
- Proficiency in SQL and at least one major RDBMS, including Oracle or PostgreSQL.
- Experience with data migration projects and data quality validation.
- Proficiency in Java or Python for data processing and automation.
- Cloud experience, preferably AWS (including RDS, S3, Lambda, Redshift, Glue).
- Working knowledge of Linux/Unix environments and shell scripting.
- Experience working in an Agile/Scrum development environment.
- Excellent problem-solving, analytical, and communication skills.
Technologies
- ETL, AWS Glue, AWS Lambda, Amazon S3, Amazon RDS, Amazon Redshift, Amazon Kinesis
- SQL, Java, Python, Shell, Bash
- Informatica, Talend, Pentaho
- Oracle, PostgreSQL, MongoDB
- Linux/Unix, Agile/Scrum, and AWS cloud services
Location and clearance
- Huntsville, Alabama (100% onsite)
- Clearance required: Active Top Secret Clearance (U.S. Citizenship Required)
Employment type
- Full-Time / Permanent
- 1099 Consultant
Benefits
- 3 weeks of Paid time off (PTO) that includes sick leave
- 2 floating and 8 public holidays
- Company covers 50% of health and dental insurance for all full-time employees (dependents at extra cost)
- STD, LTD, and one-time salary equivalent of life insurance at no cost to all full-time employees
- 401k program after 90 days with a company match of 4% and immediate vesting
- Profit sharing for w-2 employees with no benefits and no employee contributions required
- Floating and holidays expire at the end of every year of service