Senior Data Engineer
Senior
3d Design Tools
Amazon Rds Aurora
Amazon Web Services
AWS
Aws Athena
Aws Data Warehouse
Aws Glue
Big Data
Cloud
Cloud Computing
Cloud Data Engineering
Cloud Data Warehouse
Cloud Operations
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lake
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
IT Services
Programming Language
Programming Languages
Rendering Engines
Reporting and Analytics
SQL
Job Description
Vertage is building a cloud data foundation for NextBrain, and this Senior Data Engineer role is central to making operational, engineering, analytical, and contextual information available in a secure and reliable way. You will help shape the pipelines, storage architecture, data models, APIs, and automated quality controls on AWS that support NextBrain Off-Prem and its AI-driven capabilities.
This position is based in the United States (onsite) and offers an hourly salary of USD 80 - 85. The role requires 5+ years of data engineering experience and a Bachelor’s degree in Computer Science, Data Engineering, Engineering, or a related field.
What you’ll do
- Design and implement the NextBrain cloud data architecture.
- Build scalable ingestion, transformation, storage, and serving pipelines on AWS.
- Create pipelines for operational, historical, engineering, application, and contextual data.
- Design data models optimized for analytical applications and AI consumption.
- Establish storage patterns across relational, object, time-series, and analytical data stores.
- Develop APIs and services so NextBrain tools and agents can retrieve data consistently.
- Set up automated data-quality validation, reconciliation, and monitoring.
- Implement metadata management, lineage, cataloging, and data-governance practices.
- Design mechanisms for data segregation and access control.
- Optimize pipelines for scalability, performance, reliability, and cost.
- Partner with operational subject-matter experts to validate the meaning and quality of source data.
- Support migration of information from document-based repositories into structured, cloud-hosted data services.
- Collaborate with AI/ML engineers to create reliable datasets, feature pipelines, retrieval mechanisms, and knowledge sources.
- Establish reusable data integration patterns to accelerate onboarding of additional NextBrain use cases and sites.
Skills and qualifications
- 5+ years of data engineering experience.
- Python and SQL skills.
- Hands-on experience building production data pipelines in AWS.
- Experience with AWS data technologies such as S3, Glue, Lambda, RDS/Aurora, Redshift, Athena, Kinesis, or equivalent technologies.
- ETL/ELT architecture and orchestration framework experience.
- Strong understanding of relational and non-relational database design.
- Experience implementing automated data-quality processes.
- Experience building APIs or data services.
- Understanding of data governance, lineage, security, and access-control principles.
Technologies you’ll work with
- Python, SQL
- Amazon S3, AWS Glue, AWS Lambda
- RDS/Aurora, Redshift, Athena
- Amazon Kinesis
- ETL/ELT
Preferred experience
- Time-series data
- Streaming and event-driven architectures
- Industrial IoT, SCADA, historians, or operational technology data
- Energy-generation assets such as solar, battery storage, wind, or conventional generation
- Data architectures for AI/ML and generative AI applications
- Vector databases and retrieval architectures
- High-volume telemetry datasets
Communication
- English with professional working proficiency