Data Engineer -5

Realign LLC is hiring a Data Engineer for an on-site production support focused role in Charlotte, NC. The position centers on implementing reliable data flows, maintaining data quality standards, and addressing production root-cause and performance issues across multiple data platforms.

Role Responsibilities

• Implement efficient data flows, enforce data management standards, enhance data quality, and support continuous delivery and release cycles.
• Perform root-cause analysis for production issues across multiple technology stacks including Hadoop, Oracle, and MongoDB.
• Analyze and resolve performance issues affecting data services and pipelines.
• Complete development work related to App Gov and other mandates.

Required Skills

• Primary: PySpark, Hive, Python, SQL, Hadoop
• Hands-on data work: Design and build ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs.
• Distributed data tools: Practical experience with Apache Spark, Databricks, or Hadoop ecosystems.
• Platforms: Experience building and managing datasets in relational and/or cloud-based data platforms including Teradata, Snowflake, SQL Server, and Azure/AWS/GCP.
• Data governance and management: Strong understanding of data modeling, metadata, data quality controls, data lineage, and secure data management.
• Testing and delivery: Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
• Engineering practices: Knowledge of CI/CD pipelines, version control with Git, and automated deployment practices.
• Operational and security: Experience adhering to enterprise data governance, compliance, and operational risk frameworks; knowledge of data security practices including encryption, masking, and PII handling.
• Performance tuning and troubleshooting: Advanced experience tuning SQL, Spark, or distributed data workflows; ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
• Observability: Experience implementing monitoring and observability for data pipelines using logs, metrics, and health checks.
• Collaboration: Strong communication skills and ability to collaborate across engineering, product, and business teams.
• Supporting workloads: Experience supporting analytical workloads, BI tools, or data science teams.
• Regulated environment: Prior experience in a financial institution or other regulated industry.

Technology Stack

• PySpark, Hive, Python, SQL, Hadoop
• Unix, ETL, ELT
• Apache Spark, Databricks
• Teradata, Snowflake, SQL Server
• Azure, AWS, GCP
• Git, CI/CD
• MongoDB, Oracle
• App Gov

Location and Salary

Location: Charlotte, NC (onsite).
Compensation: USD 98,000 per year.

Experience

• Minimum of 5 years of experience
• 5 to 10 years experience in Data Engineering, Software Engineering, or a related technical discipline