Data Engineer IV
Job Description
The Data Engineer IV role at Farm Credit Financial Partners is based in Springfield, Massachusetts, offering a hybrid work arrangement. The position centers on transforming data into readily analyzable formats, expanding and optimizing data pipelines for Association partners, and building new data platforms to support strategic initiatives aligned with business and enterprise goals.
Responsibilities
- Lead and architect an enterprise-scale data engineering project team within a matrix organization.
- Provide strategic direction for the design, enhancement, and long-term support of data platforms.
- Drive the data engineering strategy by influencing processes such as automating manual tasks, optimizing data delivery, and redesigning infrastructure for greater scalability.
- Build and optimize the infrastructure required for efficient extraction, transformation, and loading of data from diverse sources.
- Oversee engineering standards through code reviews to ensure quality and adherence to best practices.
- Shape enterprise-wide data governance policies in partnership with senior leadership and stakeholders, covering data quality, management, policies, business process management, and risk management related to organizational data.
- Coach and mentor junior engineers.
- Effectively communicate technical direction to senior leadership and cross-functional stakeholders; foster an innovative team culture and process improvements during development.
- Demonstrate thought leadership in data engineering practices and enterprise data strategy.
Requirements
- Bachelor's degree in computer science or MIS.
- 10+ years of experience in data modeling and cloud technologies.
- Expert-level experience with Azure stack components including Databricks, Data Factory, SQL, Python, and Power BI.
- 2+ years of leading large, distributed technical teams.
- Ability to work effectively in both Agile and Waterfall environments.
- Strong organizational, analytical, and communication skills.
- Proficiency in the Microsoft Office Suite.
- Strong customer service focus, viewing data consumers as customers.
- Familiarity with software development best practices.
- Knowledge of Artificial Intelligence concepts and technologies, including or similar to ChatGPT, Claude, Windsurf, Perplexity AI, Grok, and Gemini.
Technologies
- Databricks
- Data Factory
- SQL
- Python
- Power BI
- Microsoft Office Suite
- ChatGPT
- Claude
- Windsurf
- Perplexity AI
- Grok
- Gemini
- Artificial Intelligence concepts and technologies
Benefits
- Competitive earnings
- Hybrid and remote work options
- Tuition reimbursement
- Generous 401(k) matching
- Development opportunities through company-sponsored trainings and certifications
Essential Functions
- Ability to report to work in person and attend work-related functions and activities.
- Capacity to sit at a desk and use a computer for extended periods.
- Capability to lift, carry, and move objects up to 10 pounds occasionally.
- Occasional travel as required.
- Proficiency in typing and using various software programs; operation of general office equipment.
- Work in an office setting with moderate noise levels.
- Additional physical demands include frequent talking or hearing, occasional push/pull, stoop/kneel, bend/twist, and reach to retrieve or move items.
- Ability to work scheduled hours and overtime as needed.
- Designation as hybrid (home on Mondays and Fridays, office Tue–Thu) or remote; exceptions to the work arrangement may be made based on business needs.
- Company reserves the right to change a position's designation at any time.
- Ability to concentrate and focus on details when reviewing documents, analyzing data, and performing computer-based tasks.
- Skill in managing multiple tasks and deadlines with accuracy and efficiency.
- Problem-solving capability and sound decision-making.
- Ability to handle job-related stress and interactions with clients, colleagues, or external parties.
- Clear verbal and written communication.
- Ability to collaborate effectively with others in a collegial environment.
Reasonable Accommodation
Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of their position.