Senior Data Engineer
Job Description
Join the State of Illinois as a Senior Data Engineer and help build enterprise-ready data pipelines that power analytics, operations, and regulatory reporting. This hybrid role is based in Chicago, IL (headquarters: 555 W Monroe St, Chicago, IL 60661), with flexible in-office availability based on operational needs. You will work under administrative direction, lead technical governance, and apply engineering best practices across the Department of Innovation & Technology (DoIT).
This salaried, full-time position offers an anticipated starting salary of $9,130 per month with a full range of $9,130-$13,573 per month, and includes a comprehensive benefits package, paid time off, parental leave, retirement programs, tuition reimbursement options, and eligibility for federal Public Service Loan Forgiveness.
Responsibilities
- Serve as the Senior Data Engineer for DoIT, delivering highly complex advisory and engineering functions, including design, development, and optimization of enterprise data pipelines and scalable data platforms.
- Design, build, and optimize enterprise ETL and ELT pipelines, distributed processing workloads, and semantic data models for analytics, business intelligence, and operational reporting.
- Provide technical governance for enterprise data lake architecture, supporting high availability, data quality, cost-efficient storage tiering, and end-to-end observability across the enterprise data asset inventory.
- Design and govern CI/CD automation frameworks for data engineering workloads to ensure code promotion, environment parity, and reliable, secure production deployments.
- Implement and improve enterprise role-based access control for data platforms, ensuring technically enforced, auditable access aligned with DoIT security standards and applicable state and federal governance requirements.
- Engineer and optimize data workloads across relational and non-relational platforms, including large-scale RDBMS (for example Microsoft SQL Server and Azure SQL Database or equivalent), document databases (MongoDB, Couchbase), key-value stores (Redis, DynamoDB), and graph databases (Neo4j, Cosmos DB Gremlin API).
- Act as a senior technical contributor and player/coach within cross-functional data delivery squads, representing enterprise data engineering standards and advising vendor partners and executive stakeholders.
- Stay current through ongoing education using online training platforms, meetings, training sessions, seminars, and conferences.
- Perform other duties as required or assigned within the scope of the position description.
Required Qualifications
- Knowledge, skills, and mental development equivalent to four (4) years of college with coursework in Computer Science, Computer Engineering, Information Systems, Data Engineering, Software Engineering, Management Information Science, or a closely related field.
- Five (5) years of professional experience in a related Information Technology field, including experience in data engineering, software engineering, database administration, business intelligence development, data architecture, systems integration, or a closely related discipline.
- Five (5) years designing, building, and optimizing enterprise-scale data pipelines and fault-tolerant ETL/ELT patterns, including production near-time workloads and hands-on SQL performance tuning (execution plan analysis, index strategy, workload optimization) across platforms such as Microsoft SQL Server, Azure SQL Database, DB2, or equivalent.
- Five (5) years optimizing distributed processing and Spark execution engine workloads, including advanced tuning of batch, micro-batch, and streaming workloads (execution plans, shuffle and partition strategy, memory management, cluster autoscaling) across platforms such as Databricks, Apache Spark, Azure Synapse, Teradata Vantage, Snowflake, Amazon EMR, Starburst, or Cloudera, or equivalent.
- Five (5) years enterprise data platform and lakehouse architecture design experience, including multi-zone lake and lakehouse patterns, open table format optimization, schema evolution, and integration of storage, compute, and catalog layers across Microsoft Fabric, Databricks Unity Catalog, Snowflake, or equivalent.
- Four (4) years engineering reusable data access layers and gateway patterns that abstract source system complexity, reduce redundant data movement, and provide consistent governed interfaces for downstream consumers and applications.
Technologies
- SQL, ETL, ELT, CI/CD, DataOps, Spark; Microsoft SQL Server, Azure SQL Database, DB2
- MongoDB, Couchbase, Redis, DynamoDB, Neo4j, Cosmos DB Gremlin API
- Databricks, Apache Spark, Azure Synapse, Teradata Vantage, Snowflake, Amazon EMR, Starburst, Cloudera
- Microsoft Fabric, Databricks Unity Catalog, Terraform, Azure Bicep, Databricks Asset Bundles, GitHub Actions
Benefits
- Competitive Group Insurance benefits including health, life, dental, and vision plans.
- Flexible work schedules when available and dependent upon position.
- Paid vacation: 10-25 days annually (10 days for first year of state employment).
- Paid sick time: 12 days annually with year-to-year carryover.
- Paid personal business days: 3 per year.
- Paid holidays: 13-14 per year depending on election years.
- 12 weeks of paid parental leave.
- Pension plan through the State Employees Retirement System.
- Deferred Compensation Program (voluntary supplemental retirement plan).
- Optional pre-tax programs: MCAP and DCAP.
- Tuition Reimbursement Program and eligibility for Federal Public Service Loan Forgiveness Program.
- Additional information: https://www2.illinois.gov/cms/benefits/Pages/default.aspx
Application Details
- Job Requisition ID: 59962
- Opening Date: 11/13/2026
- Closing Date: 12/01/2026
- Agency: Department of Innovation and Technology
- Class Title: INFORMATION SYSTEMS ANALYST III - 21167
- Job Type: Salaried | Category: Full Time | Vacancies: 1
- Work Schedule: 8:30 AM - 5:00 PM Monday - Friday (hours may vary)
- Hybrid schedule: 1 to 5 days per week in office depending on operational needs
- Union position: applicable collective bargaining agreement/labor contract provisions apply.
- Agency Contact: [email protected]
How to apply: Apply electronically at illinois.jobs2web.com. Email and paper applications will not be considered. Proof of educational coursework is required (for example, unofficial transcripts, copies of official transcripts, account records/screenshots, or similar documents created by an academic institution).
Note on sponsorship: The State of Illinois does not provide sponsorship for employment visa status (such as H-1B) and is not able to provide OPT extensions under the STEM-designated degree program for F-1 students. To be considered for permanent employment, applicants must currently be authorized to work in the United States on a full-time basis.
Disclosure of salary history: In compliance with the Illinois Equal Pay Act, applicants are not asked to include wage or salary history in application materials.
Reasonable accommodation: The State of Illinois is committed to providing reasonable accommodations for people with disabilities. Contact [email protected] or call 217-524-7514 for information about accommodations during the hiring process.