Data Engineer

Black Canyon Consulting is seeking a Data Engineer to design, develop, and maintain data infrastructure that supports AI/ML and analytical workloads. This onsite role in Washington, DC emphasizes reliable and accessible data pipelines, end-to-end operational readiness, and practical support for downstream data consumers.

Key Responsibilities

• Design, implement, and maintain scalable data pipelines for analytical and AI/ML workloads
• Build, monitor, troubleshoot, and optimize ETL and ELT pipelines
• Create workflows to ingest, transform, process, and deliver data
• Configure and integrate databases, data lakes, data warehouses, feature stores, and other data platforms
• Develop and maintain data transformation and feature engineering processes
• Ensure data reliability, accessibility, quality, and operational readiness
• Develop APIs and service layers to expose data or model endpoints to downstream applications and systems
• Collaborate with data scientists, software engineers, analysts, and other technical teams to meet data requirements
• Monitor pipeline performance and resolve data processing or integration issues
• Implement processes to validate data accuracy, completeness, and consistency
• Support deployment and operation of data infrastructure across the system lifecycle
• Identify opportunities to improve pipeline scalability, performance, maintainability, and efficiency
• Document data pipelines, integrations, transformations, and technical processes

Required Qualifications

• Experience designing, developing, and maintaining data pipelines
• Experience building and optimizing ETL and/or ELT workflows
• Experience working with relational and/or non-relational databases
• Experience integrating databases, data lakes, data warehouses, or similar data platforms
• Experience developing data transformation workflows
• Experience supporting data used for analytical, AI, or machine learning workloads
• Experience developing or integrating APIs and service layers
• Strong understanding of data reliability, accessibility, quality, and operational readiness
• Experience monitoring, troubleshooting, and optimizing data pipelines
• Understanding of data modeling and data architecture principles
• Strong programming and problem-solving skills
• Ability to work collaboratively with software engineers, data scientists, analysts, and other technical stakeholders

Location and Experience Level

Location: Washington, DC (onsite)

Minimum experience: 3 years

• Junior: 3+ years of relevant experience
• Mid-Level: 5+ years of relevant experience
• Senior: 8+ years of relevant experience

Desired Skills

• Experience supporting machine learning or artificial intelligence environments
• Experience developing feature engineering workflows or working with feature stores
• Experience designing data infrastructure for high-volume or distributed systems
• Experience with cloud-based data platforms and infrastructure
• Experience developing APIs that expose data, analytical results, or model endpoints
• Experience with automated data pipeline monitoring and alerting
• Experience optimizing data pipelines for performance, reliability, and scalability
• Experience working with modern data lakehouse or warehouse architectures
• Experience implementing data validation, testing, and quality controls

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• 401k plan with employer contribution
• Paid holidays
• Vacation
• Tuition reimbursement