Data Engineer -3

Realign LLC is hiring a Data Engineer for an onsite Production support role in Charlotte, NC. This position focuses on keeping production data flows reliable while improving performance and data quality across multiple technology stacks. If you enjoy root-cause analysis, data engineering, and operational excellence, this role combines hands-on pipeline ownership with support work for complex enterprise environments.

What you’ll do

• Implement and maintain data flows that follow data management standards, with a focus on enhancing data quality.
• Design and build ETL/ELT pipelines, ingestion processes, and distributed data processing jobs.
• Support production issues by troubleshooting pipeline problems, performance bottlenecks, and data discrepancies across different tech stacks, including Hadoop, Oracle, and MongoDB.
• Perform advanced performance tuning for SQL, Spark, or other distributed data workflows.
• Work with distributed data tools such as Apache Spark, Databricks, and the Hadoop ecosystem.
• Build and manage datasets in relational and cloud-based data platforms such as Teradata, Snowflake, SQL Server, and Azure/AWS/GCP.
• Apply strong controls for data modeling, metadata, data quality, data lineage, and secure data management.
• Contribute to automated test suites, analyze test failures, and support test-driven development.
• Support monitoring and observability for pipelines using logs, metrics, and health checks.
• Use CI/CD practices and Git to support automated deployment workflows.
• Follow enterprise data governance, compliance, and operational risk frameworks, including data security practices (encryption, masking, and PII handling).

Experience and skills needed

• 5 to 10 years of experience in Data Engineering, Software Engineering, or a related technical discipline.
• Primary skills: PySpark, Hive, Python, SQL, Hadoop.
• Experience with distributed processing frameworks including Apache Spark and ecosystems such as Hadoop.
• Hands-on dataset work across relational and cloud platforms (e.g., Teradata, Snowflake, SQL Server, Azure/AWS/GCP).
• Knowledge of automated testing, test failure analysis, and support for test-driven development practices.
• Secondary skills: Unix, Agile, and base support.
• DevOps-focused experience: CI/CD, version control with Git, and automated deployment practices.
• Operational and incident support knowledge, including Autosys.
• Experience with App Gov related development and other mandates.
• Knowledge of BI tools and/or experience supporting analytical workloads and teams such as data science.
• Client preference: prior experience in a financial institution or other regulated industry.
• Strong collaboration and communication skills across engineering, product, and business teams.

Salary: $98,000 per year.

Location: Charlotte, NC (onsite).

Technologies you’ll work with

• PySpark, Hive, Python, SQL
• Hadoop, Apache Spark, Databricks
• Teradata, Snowflake, SQL Server
• Azure, AWS, GCP
• Unix
• Git, CI/CD
• Autosys, Oracle, MongoDB
• App Gov