Data Engineer

The Data Engineer role at A-dec, Inc. (USA) focuses on expanding and optimizing data architecture, building data integrations, and improving data flow to support cross-functional teams working across software development, data architecture, and analytics. This position also supports real-time and batch ingestion into the EDW and helps optimize the company’s data warehouse for next-generation products and data initiatives.

Responsibilities

• Build real-time and batch data integrations from disparate source systems into the EDW.
• Collaborate with data and analytics experts to improve the functionality of data systems.
• Write complex SQL queries for reporting and application consumption.
• Assemble large, complex data sets that satisfy functional and non-functional business requirements.
• Design and implement real-time ETL and batch processing to support modeling and reporting needs.
• Provide production support for data integration and transformation pipelines.
• Scale and tune data pipelines, databases, and SQL queries to improve performance.
• Build and maintain data reconciliation processes.
• Identify trends in data sets and develop algorithms that make raw data more usable for the enterprise.
• Connect data to users across mixed cloud and on-prem environments.
• Improve data reliability, efficiency, and overall data quality.
• Partner with data architects and analysts to support modeling and reporting, and to build and maintain internal data processing and visualization.
• Translate requests into replicable analytic reports using varying applications.
• Create tools to deliver data, including APIs and packages, as needed.
• Troubleshoot database software and data integrity issues, including root cause analysis.

Requirements

• Bachelor’s degree in Computer Science or a related technical field (or equivalent practical experience).
• 2+ years of experience in Information Technology with a focus on Business Applications, Data Engineering, Data Architecture, Data Analytics and Science.
• Strong understanding of data warehousing and Business Intelligence environments.
• Excellent problem solving, critical thinking, and communication skills.
• Experience with distributed source code version control systems (for example, git).
• Experience with a ticketing system such as ServiceNow or JIRA.
• Expertise with Python, databases, and SQL.
• Strong analytic skills working with unstructured datasets.
• Experience with data pipeline and workflow management tools.

Preferred Qualifications

• Experience in an Azure environment (for example, Synapse, Azure SQL DB, Azure ML Pipeline, Azure Data Factory).
• Knowledge of machine learning and data science processes.
• Experience building reports and dashboards using BI tools.
• Basic knowledge of statistics.
• Strong communications skills for requirements gathering.

Technologies

Python, SQL, git, ServiceNow, JIRA, EDW, Azure, Synapse, Azure SQL DB, Azure ML Pipeline, Azure Data Factory, APIs.

Location and Experience

• Location: Newberg, OR (onsite)
• Minimum experience: 2 years
• Education: Bachelor’s degree in Computer Science or related technical field (or equivalent practical experience)