Data Engineer Sr
Application Security
Automation
Azure Data Engineer
Big Data
Bigdata
Change Data Capture
Cloud
Cloud Data Engineering
Cloud Data Warehouse
Cloud Infrastructure
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lake
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Dataops
DevOps
DevSecOps
ETL
Facilities Management
Informatica
Information Technology (IT)
Infrastructure As Code
Security Automation
Snowflake
Software Security
Spark
SQL
Job Description
Oshkosh’s Advanced Analytics team is building engineering and service data capabilities to support preventive maintenance and intelligent control of vehicles. In this senior role, you will design and deliver data analytics platforms by engineering reliable CDC and ETL pipelines, supporting data governance, and enabling analytics to move from prototype to production with a clear architectural roadmap.
What you’ll do
- Design and develop scalable Change Data Capture (CDC) and ETL solutions to move data from source systems into analytics platforms, covering structured and unstructured data plus batch and streaming.
- Build data processing pipelines and leverage cloud and infrastructure tooling, including Terraform, Spark, Databricks, Snowflake, and Git.
- Support and operate Azure infrastructure management and services such as ADLS Gen2, Azure Compute, Azure Data Factory, AI Foundry, AKS, VPCs, and Storage Accounts, along with related components.
- Assist with data governance, including quality and security practices across a data lake and enterprise data warehouse systems across business segments.
- Perform performance tuning and troubleshooting for data processing issues.
- Collaborate across disciplines, departments, and segments, coordinating and communicating progress clearly.
- Develop rapid prototyping and design approaches to deliver solutions quickly to the business.
- Maintain reference architecture and documentation to support architectural governance and the application roadmap.
- Assist with education efforts for others on best practices in areas such as data modeling, database design, ETL design, and job scheduling and monitoring.
- Support or direct feasibility studies and project estimates, including manpower, budget, and timelines for proposed R&D work.
- Complete tasks on a mutually agreed schedule with the supervisor/program manager, with minimum mentoring, while providing feedback on technical hurdles and progress.
What you bring
- Bachelor’s degree in computer science, data science, or a related field, plus 4+ years as a data engineer, ETL developer, and/or data warehouse DBA.
- 3–5 years of prior experience in a data engineering or analytics organization in a technical role.
- 2+ years of software development experience (Python/Go preferred).
- 3+ years of major cloud provider experience (AWS/Azure/GCP).
- Strong proficiency with SQL, Bash, and Python, including experience with Anaconda.
- 2+ years operating in Unix/Linux and Windows server environments.
- 2+ years operating in an Agile / Scrum environment.
- Experience with cloud-based data services and solutions such as Azure Synapse / Data Lake, AWS RedShift, Snowflake, and GCP Big Query.
- Experience partnering with analytics and data science teams to build production-grade GenAI/ML solutions.
- Familiarity with CDC tooling such as Qlik Replicate, Striim, and Debeezium.
- Experience with big data tools and architectures including Cloudera Hadoop, HDFS, Hive, and Spark.
- Working knowledge of telematics interfaces and streaming solutions such as MQTT, NiFi, and Kafka.
- Automotive or heavy duty on or off-road vehicle experience, including digital data bus concepts and Ethernet or Controller Area Network (CAN).
- Strong critical thinking, analytical, and problem-solving skills, with the ability to manage multiple priorities in a fast-paced environment.
- Excellent interpersonal skills, including the ability to present information and respond to questions from leadership and peers.
Compensation
Pay range: USD $104,100.00 - $173,900.00 per year.