The Senior Data Engineer role at McKesson is based in Irving, Texas, with the option for 100 percent remote work from a U.S. home office. The position centers on designing, building, and maintaining scalable data solutions that enable analytics, AI initiatives, and business intelligence, including ETL/ELT processes on Databricks, data lake and data warehouse ingestion, and data governance.
Responsibilities
- Design, develop, and sustain scalable, high-performance data solutions that empower analytics, AI, and business intelligence across the organization.
- Define and document technical requirements for data flows between varied operational systems and the data warehouse; drive end-to-end ETL/ELT development using Apache Spark on Databricks.
- Support data ingestion into data lakes and warehouses, implement Delta Lake for transactional integrity, and orchestrate both batch and streaming data pipelines.
- Collaborate with cross-functional technology teams to extract, transform, and load data from diverse sources, optimize data models, and maintain software aligned with business needs.
- Explore and integrate emerging AWS technologies to enhance data engineering capabilities, craft complex SQL queries for data validation and transformation, and manage Databricks workspaces, clusters, and jobs.
- Support data quality initiatives, ensure governance and security policy compliance, and assist in developing and operationalizing machine learning and generative AI applications.
- Assist in troubleshooting production workflows, refactor legacy systems, participate in code reviews, and mentor junior engineers.
- Apply a strong understanding of modern data architecture, approach problems proactively, and build reliable, scalable, and innovative data solutions.
- Role allows 100 percent telecommuting from a home office within the United States.
Requirements
- Bachelor’s Degree in Computer Science or a related field
- Five years of experience in data engineering or a related occupation
- Experience in data engineering with Databricks and AWS
- Proficiency with Apache Spark, SQL, and Python or Scala
- Experience with Delta Lake, Unity Catalog, and cloud data warehouses such as Redshift
- Experience with data modeling, ETL/ELT processes, and data governance
- Experience with orchestration tools such as GitLab or Bitbucket and CI/CD practices
- Experience collaborating with cross-functional teams to deliver data solutions using Python and Databricks in Agile environments
- Experience designing and optimizing scalable data pipelines with Python and Spark in Databricks
- Experience developing modular, reusable components in Databricks notebooks and workflows
- Experience implementing data validation frameworks to ensure pipeline accuracy
Technologies
- Databricks
- Apache Spark
- AWS
- Delta Lake
- Unity Catalog
- Redshift
- SQL
- Python
- Scala
- GitLab
- Bitbucket
- CI/CD
- Databricks notebooks
- Databricks workflows
Compensation
Salary: USD 141,336 - 184,400 per year
Benefits
- Competitive compensation package as part of Total Rewards
- Annual bonus or long-term incentive opportunities may be offered
How to Apply
To apply, please send resumes to JobPostings@McKesson.com. Reference #: 002115.
Equal Employment Opportunity
McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.
McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to United States Disability_Accommodation@McKesson.com or Canada Accessibility@mckesson.ca. Resumes or CVs submitted to these email addresses will not be accepted.
