Senior Databricks Data Engineer / Lakehouse Architect
Senior
Big Data
Bigdata
Change Data Capture
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Databricks
Engineer
ETL
Lakehouse
Pyspark
Spark
SQL
Job Description
Bilink Corp is building a strong lakehouse practice and needs a senior engineer to own platform design and production delivery. This hybrid role is based in Chicago, IL (River North), with an initial focus on establishing a Databricks platform on Azure and integrating SAP as a primary data source. If you enjoy turning architecture into reliable pipelines, governance, and measurable performance wins, this is a direct W2 position with a team that values technical leadership.
What you’ll build and run
- Own the work from architecture through delivery, designing, building, and operating a Databricks lakehouse in production
- Develop ETL/ELT pipelines in Databricks using Spark and PySpark, Delta Lake, and medallion architecture
- Implement incremental loads and CDC using MERGE
- Set up governance and security with Unity Catalog
- Drive performance and cost tuning while keeping data quality high
How you’ll partner with the team
- Act as the trusted technical voice with the client’s business, analytics, and IT teams
- Set engineering standards and mentor other engineers
What you bring
- 7+ years in data engineering, including 4+ years hands-on with Databricks on production projects
- Experience designing a data platform, not only building pipelines inside one environment
- Azure strongly preferred (AWS or GCP considered)
- Strong Python and SQL, plus solid data modeling and data warehousing
- Clear communication with technical and non-technical stakeholders
- Education: Bachelor’s or Master’s in Computer Science, Engineering, or a related field, or equivalent experience
- Live in the Chicago area and able to be in the River North office 3 days a week
- Authorized to work in the US (visa sponsorship considered for an exceptional candidate already based in Chicago area)
- No C2C / corp-to-corp / third-party vendors; this is a direct W2 employee role
Technology focus
- Databricks, Spark, PySpark, Delta Lake, Unity Catalog
- MERGE, CDC, Python, SQL, Azure (AWS/GCP considered)
- Medallion architecture
Compensation and benefits
Salary: USD 110,000 - 160,000 per year.
- 401(k) with match
- Health insurance
- Dental insurance
- Paid time off
- 401(k) matching
Nice to have
- SAP data integration (S/4HANA, BW, HANA) into a lakehouse
- Consulting experience
- Databricks certification (Data Engineer Professional or Associate)
Interview process
- Short written screening (application questions)
- 20-minute intro call
- On-site at River North office: 40-minute case study, then a presentation and technical discussion with the team