Data Engineer

ABACUS is seeking a Data Engineer to design, build, and support data pipelines within a modern Azure-based data platform. This role focuses on reliable data integration from internal and external systems in regulated environments, with an emphasis on ETL development, pipeline operations, and data quality.

Based in Dallas, TX (onsite), you will use Python and SQL Server (T-SQL) to ingest, transform, and integrate data, while partnering with data, software, and DevOps teams to meet reporting and business logic needs.

Key Responsibilities

• Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from sources such as structured files and RESTful APIs.
• Write, test, and debug Python for data processing, automation, and basic integrations using established standards and best practices.
• Create and maintain T-SQL queries, views, and stored procedures that support business logic and reporting requirements.
• Assist with building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage.
• Support monitoring of data pipelines and help troubleshoot data quality issues, pipeline failures, and performance problems.
• Follow defined data quality, security, and compliance procedures in regulated environments such as healthcare and financial services.
• Collaborate with data analysts, software engineers, and DevOps teams to understand data requirements and upstream systems.
• Participate in code reviews, implement feedback, and continuously improve coding and engineering practices.
• Create and maintain clear documentation for pipelines, logic, and operational processes.

Required Qualifications

• 1–4 years of professional experience in Data Engineering, Software Engineering, or a related technical role.
• Strong hands-on proficiency in Python, including functions, error handling, and debugging.
• Experience working with relational databases, preferably SQL Server.
• Strong working knowledge of SQL, including joins, aggregations, subqueries, and basic performance considerations.
• Exposure to integrating or consuming data from RESTful APIs or external data sources.
• Familiarity with Git or similar version control systems.
• Strong analytical and problem-solving skills with the ability to learn quickly.
• Bachelor's Degree (listed as preferred).

Technologies

• Python, SQL Server, T-SQL
• Azure, Azure Data Factory, Azure SQL, Azure Blob Storage
• RESTful APIs
• Git
• Power BI, Azure Synapse, Azure DevOps, Azure Functions
• .NET Framework, C#, HIPAA, SOC2, SIEM tools

Preferred Experience

• Additional Azure services such as Azure Synapse, Azure DevOps, and Azure Functions.
• Understanding of data modeling and warehousing concepts.
• Exposure to cybersecurity data, SIEM tools, or SOC operations.
• Knowledge of .NET Framework and C#-based APIs for data consumption contexts.
• Background in MSP/MSSP environments or consulting.
• Familiarity with Power BI or other data visualization tools.

Success Profile

• Ability to work effectively in a collaborative, fast-paced environment.
• Good written and verbal communication skills.