Senior Data Engineer
Job Description
Allied Solutions builds data platforms that turn acquisition, curation, and transformation into usable assets for business intelligence, advanced analytics, and data monetization. As a Senior Data Engineer in Carmel, IN (onsite), you will help shape modern data architecture and deliver reliable warehouse and data pipeline foundations for internal and external customers.
What you get
- Medical, dental, and vision coverage
- 100% company-paid life and disability coverage
- 401(k) options with company match
- Three weeks PTO by the end of your first year
- Career growth opportunities for employees of all levels
Responsibilities
- Create detailed documentation for the data warehouse, data stores, and end-to-end data flows
- Troubleshoot and correct data and data processing errors in existing solutions
- Partner with technical teams and internal and external users to develop technical designs
- Develop and continually refine BI-focused data architecture
- Work closely with the Data Intelligence department to understand customer data and reporting needs and deliver the required backend data outcomes
- Perform gap analysis between source system databases and Allied’s enterprise data warehouse to support Business Intelligence efforts
- Develop and maintain datasets while standardizing data collection and processing methodologies
- Provide technical guidance and contribute to decisions that affect cross-functional teams
- Attend and contribute to architecture meetings to align on project scope, timeline, and cost estimates
- Plan and execute data extraction, integration, and/or pushes to and from third-party providers
- Deliver enterprise data solutions, including ETL maintenance, warehouse data models, periodic upgrades, security, governance, and performance optimization
- Maintain a working understanding of warehouse and data mart models and the business information contained in them
- Identify process improvement opportunities or alternative technologies to improve speed to business value
- Collaborate with developers and subject matter experts to set the technical vision and evaluate trade-offs between usability and performance
- Mentor other ETL Developers and Data Engineers
Requirements
- Bachelor’s Degree required, or equivalent education/work experience
- 5+ years of experience with data warehousing, databases (MS SQL Server, Snowflake), and dimensional modeling
- 5+ years of experience in end-to-end data analysis and development
- 3-5 years of experience with AWS cloud services (AWS Glue, Lambda, S3, etc.)
- 3-5 years of experience with Snowflake (Snowpipe, Snowpark, Streamlit, Streams/Tasks) (preferred)
- Extensive experience with SQL
- Experience with R or Python (preferred)
- Experience with Git and CI/CD (preferred)
- Strong attention to detail
- Familiarity with Object-Oriented Analysis, Project Management, Business Analysis Methodology, and the SDLC
- Ability to collaborate effectively and work as part of a team
- Customer-oriented problem-solving approach focused on productivity, efficiency, and quality
- Effective communicator to clients, management, and project partners
- Experience with cloud-based technologies and services (SaaS, PaaS, IaaS) (preferred)
- Experience with Master Data Management (preferred)
- Strong analytical and product management skills, including interpreting customer business needs and translating them into application and operational requirements
Technologies you may work with
- SQL, MS SQL Server, Snowflake
- AWS Glue, AWS Lambda, S3
- Snowpipe, Snowpark, Streamlit, Streams/Tasks
- R, Python
- Git, CI/CD
- SaaS, PaaS, IaaS