Lead Data Engineer
Backend Developer
Artificial Intelligence
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Engineer
ETL
Informatica
Integration
Lead Data Engineering
Programming Language
Programming Languages
Pyspark
Reporting and Analytics
SQL
Job Description
The Lead Data Engineer position will support the Leasing Data Engineering group, with a focus on data architecture, modernization of cloud platforms, and delivering AI-ready data solutions across leasing transaction and related datasets. The role is based onsite in Westmont, IL.
Key Responsibilities
- Design and deliver data models and architecture for leasing transaction, broker, CRM, and market availability data.
- Build and optimize cloud-based pipelines and platform components on Azure and/or AWS, migrating siloed data sources into a unified, governed data layer.
- Develop robust, fault-tolerant batch and incremental pipelines using Python/PySpark and SQL, with a production-ready focus.
- Design data products and semantic structures, including API/MCP interfaces to support AI systems and analytics applications.
- Implement integration services and APIs to expose leasing data to enterprise applications and downstream consumers.
Required Qualifications
- 7+ years of experience in data engineering and Big Data development, with a demonstrated record delivering complex projects.
- Hands-on experience with cloud data platforms on Azure or AWS, including services such as Databricks, Data Factory, Synapse, Glue, or EMR.
- Advanced proficiency in Python and SQL, including expertise with PySpark/Spark for distributed processing at scale.
- Strong skills in data modeling and architecture, including experience with SQL and NoSQL databases.
- Experience designing and building API services and integrating data platforms with downstream applications, including familiarity with AI/agentic workflows and MCP integrations.
Technology Focus
- Cloud and Data Platforms: Azure, AWS, Databricks, Data Factory, Synapse, Glue, EMR
- Data and Processing: Python, PySpark, Spark, SQL, NoSQL
- Interfaces: API, MCP
- AI: AI
Compensation and Location
- Location: Westmont, IL (onsite)
- Pay range: USD $70 to $75 per hour
Benefits
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k), Plus Match
- Weekly Pay
Similar Jobs
