Senior Data Engineer

The Senior Data Engineer will help iDC Logistics, Inc. run and evolve a production data platform, owning operational readiness while delivering reliable transformations and validations against established reporting and billing outcomes.

Location

City of Industry, CA (onsite)

Salary

USD 140,000 - 180,000 per yearly

Experience and Education

• Minimum experience: 7 years
• Education: Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or related field

Responsibilities

• Own environment setup and management for a production platform that supports report delivery and billing.
• Handle refresh and orchestration operations, monitoring and alerting, and incident response for production data workflows.
• Manage security-role hierarchies and grants, including ongoing performance and maintenance considerations.
• Maintain pipeline automation and environment promotion so releases are routine and reliable.
• Build staging and gold dbt models, including tests, aligned to defined business semantics and existing conventions.
• Flag requests that could conflict with established definitions.
• Review teammates’ work, including AI-generated code, for correctness and adherence to standards.
• Analyze and absorb legacy and vendor source systems, including workflows involving undocumented schemas.
• Validate that new platform outputs match legacy system reporting and billing figures before cutover.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or related field.
• 7+ years designing, developing, and maintaining large-scale data pipelines and data warehouse solutions.
• SQL proficiency, including joins, window functions, grain and aggregation tradeoffs, NULL semantics, and the ability to explain query result behavior.
• Production Python experience, including writing and maintaining Python code that ran in production.
• Experience owning scheduled data pipelines in production, including diagnosing and fixing pipeline failures.
• Working depth in a modern transformation framework: dbt preferred; SQLMesh, Dataform, Coalesce, Databricks declarative pipelines, or a comparable in-house framework also qualify.
• Production operations ownership, including deployments, environment management, on-call or equivalent responsibilities, and incident response.
• Dimensional modeling knowledge, including grain, facts and dimensions, conformance, and slowly-changing history.
• Git-based workflow practices: branching, pull requests, code review, and CI.
• Communication skills for writing, discussion, and presentations, including explaining technical findings to non-technical stakeholders.
• Independent problem-solving with the ability to investigate unfamiliar problems before escalating.
• AI tooling used regularly for research, design, and verification, including building workflow tooling and verifying AI output before relying on it.

Technologies

• SQL
• Python
• dbt
• SQLMesh
• Dataform
• Coalesce
• Databricks declarative pipelines
• Git
• Azure (Data Factory)
• Azure (ADLS Gen2)
• Azure (Key Vault)
• AWS
• GCP
• Snowflake
• Terraform

Benefits

• Medical, dental, and vision insurance
• Basic and voluntary life and voluntary ancillary coverages for accident, critical illness and hospital indemnity
• Paid sick leave
• Bereavement pay
• Holiday and vacation pay
• 401k plan eligibility on the first day of the third month following hire date
• 401(k)
• 401(k) matching
• Dental insurance
• Employee assistance program
• Flexible spending account
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Professional development assistance
• Referral program
• Vision insurance

Preferred Qualifications

• Multi-tenant or customer-facing data experience (isolation, audit, lineage)
• Azure (Data Factory, ADLS Gen2, Key Vault); AWS or GCP experience transfers
• Snowflake
• Terraform or equivalent infrastructure-as-code
• Legacy and vendor-system reverse-engineering
• Logistics, supply-chain or warehousing domain experience
• Familiarity with BI tools