Dataproc Developer Jobs

1 job found

1d ago

Online Sr Data Engineer (SEO)

Home Depot / THD Atlanta, GA

Atlanta, GA

1d ago

Full time Senior Apache Airflow Big Data

Apply Now

Job Description

Based in Atlanta, GA and operating onsite, this role sits at the heart of Home Depot's THD online data initiatives. The Online Senior Data Engineer will define data operation standards, build and sustain data pipelines, and enable analytics capabilities that align with the company's digital data needs.

Responsibilities

20% - Business Collaboration
- Leverage extensive business knowledge into solution approach
- Effectively develop trust and collaboration with internal customers and cross-functional teams
- Provide general education on advanced analytics to technical and non-technical business partners
- Deep understanding of IT needs for the team to be successful in tackling business problems
- Actively seek out new business opportunities to leverage data science as a competitive advantage
30% - Project Management & Team Support
- Work with project teams and business partners to determine project goals
- Provide direction on prioritization of work and ensure quality of work
- Provide mentoring and coaching to more junior roles to support their technical competencies
- Collaborate with managers and team in the distribution of workload and resources
- Support recruiting and hiring efforts for the team
35% - Solution Development
- Execute tasks with high levels of efficiency and quality
- Make appropriate selection, utilization and interpretation of advanced analytical methodologies
- Effectively communicate insights and recommendations to both technical and non-technical leaders and business customers/partners
- Prepare reports, updates and/or presentations related to progress made on a project or solution
- Clearly communicate impacts of recommendations to drive alignment and appropriate implementation
15% - Technical Exploration & Development
- Guide and direct project teams in the requirements gathering, design, and development of complex applications/programs
- Seek further knowledge on key developments within advanced analytics, technical skill sets, and additional data sources
- Participate in the continuous improvement of predictive and prescriptive analytics by developing replicable solutions

Requirements

Must be 18 years of age or older
Must be legally permitted to work in the United States

Technologies

Python
Google BigQuery
PySpark
Airflow
DataProc
SQL
JavaScript
React
Nucleus
Retina
KPI Shield
Alert Goose

Direct Manager / Direct Reports

This Position typically reports to Manager or Above
This role has 0 direct reports

Travel Requirements

Typically requires overnight travel 5% to 20% of the time

Physical Requirements

Most of the time is spent sitting in a comfortable position with periodic movement; occasional lifting of light items may be required.

Working Conditions

Located in a comfortable indoor environment; adverse conditions are infrequent and not objectionable.

Minimum Qualifications

Must be 18 years of age or older
Must be legally permitted to work in the United States

Preferred Qualifications

Bachelors or Masters in a quantitative field (Analytics, Computer Science, Math, Physics, Statistics, etc.) or relevant work experience
5+ years of relevant work experience
Experience in predictive modeling, data mining and data analysis
Experience developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, scripting, and supporting pipelines in production
Proficiency in Python
Experience defining and capturing metadata and rules for ETL processes
Experience building Batch and Streaming pipelines
Direct experience writing analytical SQL queries and performance tuning
Ability to stitch and maintain data from multiple sources
Experience with JavaScript, front-end frameworks (React, Nucleus), and QA apps (Retina, KPI Shield, Alert Goose)
Ability to produce tags for site data
Proficiency coding in Python and Google BigQuery to stitch and enrich data from multiple sources
Proven ability to use PySpark, AirFlow, and DataProc to engineer and automate data pipelines
Skill in optimizing pipeline run times and reducing storage/compute costs
Ability to prioritize requests and manage a product roadmap
Coaching experience to help junior engineers improve code and data engineering practices
Strong verbal and written communications across all levels

Minimum Education

Bachelor's degree or equivalent in a related field

Preferred Education

Master's degree or equivalent in a related field

Minimum Years of Work Experience

4 years

Preferred Years of Work Experience

5 years

Minimum Leadership Experience

No previous leadership experience

Preferred Leadership Experience

No previous leadership experience

Certifications

None

Competencies

Action Oriented
Collaborates
Drives Engagement
Communicates Effectively
Customer Focus
Drives Results
Manages Conflict

View full job page →

Get Dataproc Developer Jobs alerts

New Dataproc Developer Jobs, daily.